Task 15840334

Name	hadcm3n_o6li_1980_40_008384776_1
Workunit	8535635
Created	12 Jun 2013, 14:21:11 UTC
Sent	12 Jun 2013, 14:56:05 UTC
Report deadline	11 Sep 2013, 22:23:16 UTC
Received	30 Dec 2013, 18:08:31 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1100208
Run time	22 days 1 hours 42 min 5 sec
CPU time	14 days 4 hours 59 min 34 sec
Validate state	Invalid
Credit	7,464.96
Device peak FLOPS	2.74 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 15:51:23 (1988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:00:59 (6460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 02:49:49 (6848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:59:51 (1884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:09:51 (6472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:19:52 (4952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:34:53 (2896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:49:54 (6280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:54:55 (452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:09:56 (6860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:02:47 (6036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:03:31 (5732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:03:45 (5984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:04:11 (4680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:04:51 (5460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:50:41 (1848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:16:58 (2380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6056, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6056, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6056, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6056, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6056, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6056, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Dec 2013 07:16:36	1100208	15840334	hadcm3n_o6li_1980_40_008384776_1	622,080	1,195,191	1.9213
29 Dec 2013 07:42:07	1100208	15840334	hadcm3n_o6li_1980_40_008384776_1	596,160	1,144,987	1.9206
28 Dec 2013 13:26:40	1100208	15840334	hadcm3n_o6li_1980_40_008384776_1	570,240	1,095,254	1.9207
27 Dec 2013 17:36:31	1100208	15840334	hadcm3n_o6li_1980_40_008384776_1	544,320	1,044,983	1.9198
16 Dec 2013 09:04:01	1100208	15840334	hadcm3n_o6li_1980_40_008384776_1	518,400	994,684	1.9188
15 Dec 2013 00:09:02	1100208	15840334	hadcm3n_o6li_1980_40_008384776_1	492,480	945,828	1.9205
13 Dec 2013 18:35:52	1100208	15840334	hadcm3n_o6li_1980_40_008384776_1	466,560	896,172	1.9208
12 Dec 2013 13:57:59	1100208	15840334	hadcm3n_o6li_1980_40_008384776_1	440,640	846,778	1.9217
11 Dec 2013 07:12:38	1100208	15840334	hadcm3n_o6li_1980_40_008384776_1	414,720	797,321	1.9226
10 Dec 2013 01:54:00	1100208	15840334	hadcm3n_o6li_1980_40_008384776_1	388,800	748,296	1.9246
14 Nov 2013 18:22:23	1100208	15840334	hadcm3n_o6li_1980_40_008384776_1	362,880	698,948	1.9261
14 Nov 2013 02:21:46	1100208	15840334	hadcm3n_o6li_1980_40_008384776_1	336,960	650,669	1.9310
12 Nov 2013 21:03:26	1100208	15840334	hadcm3n_o6li_1980_40_008384776_1	311,040	600,513	1.9307
11 Nov 2013 07:41:16	1100208	15840334	hadcm3n_o6li_1980_40_008384776_1	285,120	550,606	1.9311
10 Nov 2013 17:31:59	1100208	15840334	hadcm3n_o6li_1980_40_008384776_1	259,200	500,873	1.9324
10 Nov 2013 04:01:48	1100208	15840334	hadcm3n_o6li_1980_40_008384776_1	233,280	453,082	1.9422
09 Nov 2013 14:51:47	1100208	15840334	hadcm3n_o6li_1980_40_008384776_1	207,360	405,952	1.9577
09 Nov 2013 00:34:20	1100208	15840334	hadcm3n_o6li_1980_40_008384776_1	181,440	358,613	1.9765
08 Nov 2013 11:07:53	1100208	15840334	hadcm3n_o6li_1980_40_008384776_1	155,520	310,866	1.9989
07 Nov 2013 21:54:07	1100208	15840334	hadcm3n_o6li_1980_40_008384776_1	129,600	263,752	2.0351