Task 16389666

Name	hadcm3n_87jc_1980_40_008516271_1
Workunit	8663783
Created	23 Mar 2014, 17:01:40 UTC
Sent	23 Mar 2014, 17:01:45 UTC
Report deadline	23 Jun 2014, 0:28:56 UTC
Received	16 May 2014, 16:49:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1125052
Run time	6 days 13 hours 13 min 48 sec
CPU time	4 days 13 hours 28 min 18 sec
Validate state	Invalid
Credit	2,799.36
Device peak FLOPS	2.71 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:16:23 (5048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:16:24 (5048): No heartbeat from core client for 30 sec - exiting 15:16:25 (5048): No heartbeat from core client for 30 sec - exiting 15:16:27 (5048): No heartbeat from core client for 30 sec - exiting 15:16:28 (5048): No heartbeat from core client for 30 sec - exiting 15:16:29 (5048): No heartbeat from core client for 30 sec - exiting 15:16:30 (5048): No heartbeat from core client for 30 sec - exiting 15:16:31 (5048): No heartbeat from core client for 30 sec - exiting 15:16:32 (5048): No heartbeat from core client for 30 sec - exiting 15:16:33 (5048): No heartbeat from core client for 30 sec - exiting 15:16:34 (5048): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:40:15 (11968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:40:16 (11968): No heartbeat from core client for 30 sec - exiting 17:40:17 (11968): No heartbeat from core client for 30 sec - exiting 17:40:19 (11968): No heartbeat from core client for 30 sec - exiting 17:40:20 (11968): No heartbeat from core client for 30 sec - exiting 17:40:21 (11968): No heartbeat from core client for 30 sec - exiting 17:40:22 (11968): No heartbeat from core client for 30 sec - exiting 17:40:23 (11968): No heartbeat from core client for 30 sec - exiting 17:40:24 (11968): No heartbeat from core client for 30 sec - exiting 17:40:26 (11968): No heartbeat from core client for 30 sec - exiting 17:40:27 (11968): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:59:26 (13132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6432, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6432, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6432, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4052, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:59:48 (4052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:22:20 (4328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:48:41 (7520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:29:18 (7852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8184, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8184, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Mar 2014 14:43:03	1125052	16389666	hadcm3n_87jc_1980_40_008516271_1	233,280	390,990	1.6761
28 Mar 2014 01:51:09	1125052	16389666	hadcm3n_87jc_1980_40_008516271_1	207,360	347,231	1.6745
27 Mar 2014 13:24:56	1125052	16389666	hadcm3n_87jc_1980_40_008516271_1	181,440	305,325	1.6828
27 Mar 2014 01:13:07	1125052	16389666	hadcm3n_87jc_1980_40_008516271_1	155,520	263,837	1.6965
26 Mar 2014 11:35:34	1125052	16389666	hadcm3n_87jc_1980_40_008516271_1	129,600	221,623	1.7101
25 Mar 2014 23:33:35	1125052	16389666	hadcm3n_87jc_1980_40_008516271_1	103,680	180,669	1.7426
25 Mar 2014 10:41:28	1125052	16389666	hadcm3n_87jc_1980_40_008516271_1	77,760	138,107	1.7761
24 Mar 2014 20:49:31	1125052	16389666	hadcm3n_87jc_1980_40_008516271_1	51,840	91,863	1.7720
24 Mar 2014 06:27:27	1125052	16389666	hadcm3n_87jc_1980_40_008516271_1	25,920	45,603	1.7594