Task 13671728

Name	hadcm3n_u4p5_1980_40_007546148_2
Workunit	7743380
Created	29 Nov 2011, 11:36:35 UTC
Sent	29 Nov 2011, 11:44:04 UTC
Report deadline	28 Feb 2012, 19:11:15 UTC
Received	3 Jan 2012, 7:42:49 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	959555
Run time	24 days 23 hours 9 min 32 sec
CPU time	24 days 11 hours 41 min 31 sec
Validate state	Invalid
Credit	11,819.52
Device peak FLOPS	2.65 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 13:32:24 (3556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:31:16 (4124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:51:20 (3492): No heartbeat from core client for 30 sec - exiting 09:51:21 (3492): No heartbeat from core client for 30 sec - exiting 09:51:22 (3492): No heartbeat from core client for 30 sec - exiting 09:51:23 (3492): No heartbeat from core client for 30 sec - exiting 09:51:24 (3492): No heartbeat from core client for 30 sec - exiting 09:51:25 (3492): No heartbeat from core client for 30 sec - exiting 09:51:26 (3492): No heartbeat from core client for 30 sec - exiting 09:51:28 (3492): No heartbeat from core client for 30 sec - exiting 09:51:29 (3492): No heartbeat from core client for 30 sec - exiting 09:51:30 (3492): No heartbeat from core client for 30 sec - exiting 09:51:31 (3492): No heartbeat from core client for 30 sec - exiting 09:51:32 (3492): No heartbeat from core client for 30 sec - exiting 09:51:33 (3492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:51:34 (3492): No heartbeat from core client for 30 sec - exiting 09:51:35 (3492): No heartbeat from core client for 30 sec - exiting 09:51:36 (3492): No heartbeat from core client for 30 sec - exiting 09:51:37 (3492): No heartbeat from core client for 30 sec - exiting 09:51:39 (3492): No heartbeat from core client for 30 sec - exiting 09:51:40 (3492): No heartbeat from core client for 30 sec - exiting 09:51:41 (3492): No heartbeat from core client for 30 sec - exiting 09:51:42 (3492): No heartbeat from core client for 30 sec - exiting 09:51:43 (3492): No heartbeat from core client for 30 sec - exiting 09:51:44 (3492): No heartbeat from core client for 30 sec - exiting 10:00:14 (3312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:34:48 (3440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:33:38 (8512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:48:08 (3740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:42:39 (1648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2932, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2932, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2932, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2932, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2932, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2932, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Jan 2012 07:46:01	959555	13671728	hadcm3n_u4p5_1980_40_007546148_2	984,960	2,108,594	2.1408
03 Jan 2012 07:46:01	959555	13671728	hadcm3n_u4p5_1980_40_007546148_2	959,040	2,053,079	2.1408
03 Jan 2012 07:46:01	959555	13671728	hadcm3n_u4p5_1980_40_007546148_2	933,120	1,997,360	2.1405
03 Jan 2012 07:46:01	959555	13671728	hadcm3n_u4p5_1980_40_007546148_2	907,200	1,941,650	2.1403
03 Jan 2012 07:46:01	959555	13671728	hadcm3n_u4p5_1980_40_007546148_2	881,280	1,885,946	2.1400
03 Jan 2012 07:46:01	959555	13671728	hadcm3n_u4p5_1980_40_007546148_2	855,360	1,830,326	2.1398
03 Jan 2012 07:46:01	959555	13671728	hadcm3n_u4p5_1980_40_007546148_2	829,440	1,774,394	2.1393
03 Jan 2012 07:46:01	959555	13671728	hadcm3n_u4p5_1980_40_007546148_2	803,520	1,718,381	2.1386
29 Dec 2011 00:16:26	959555	13671728	hadcm3n_u4p5_1980_40_007546148_2	777,600	1,662,372	2.1378
28 Dec 2011 13:05:53	959555	13671728	hadcm3n_u4p5_1980_40_007546148_2	751,680	1,606,234	2.1369
28 Dec 2011 13:05:53	959555	13671728	hadcm3n_u4p5_1980_40_007546148_2	725,760	1,549,952	2.1356
28 Dec 2011 13:05:53	959555	13671728	hadcm3n_u4p5_1980_40_007546148_2	699,840	1,493,632	2.1342
28 Dec 2011 13:05:53	959555	13671728	hadcm3n_u4p5_1980_40_007546148_2	673,920	1,437,515	2.1331
28 Dec 2011 13:05:53	959555	13671728	hadcm3n_u4p5_1980_40_007546148_2	648,000	1,381,033	2.1312
28 Dec 2011 13:05:53	959555	13671728	hadcm3n_u4p5_1980_40_007546148_2	622,080	1,324,209	2.1287
28 Dec 2011 13:05:53	959555	13671728	hadcm3n_u4p5_1980_40_007546148_2	596,160	1,267,515	2.1261
28 Dec 2011 13:05:53	959555	13671728	hadcm3n_u4p5_1980_40_007546148_2	570,240	1,210,723	2.1232
28 Dec 2011 13:05:53	959555	13671728	hadcm3n_u4p5_1980_40_007546148_2	544,320	1,153,828	2.1198
22 Dec 2011 08:48:29	959555	13671728	hadcm3n_u4p5_1980_40_007546148_2	518,400	1,096,840	2.1158
22 Dec 2011 08:48:29	959555	13671728	hadcm3n_u4p5_1980_40_007546148_2	492,480	1,040,168	2.1121