Task 15815080

Name	hadcm3n_o6kw_1940_40_008383370_0
Workunit	8534229
Created	1 Jun 2013, 8:02:12 UTC
Sent	1 Jun 2013, 16:28:14 UTC
Report deadline	31 Aug 2013, 23:55:25 UTC
Received	13 Jun 2013, 1:05:50 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1255152
Run time	5 days 8 hours 51 min 18 sec
CPU time	4 days 19 hours 29 min
Validate state	Invalid
Credit	6,842.88
Device peak FLOPS	3.61 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 10:06:45 (31692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:06:46 (31692): No heartbeat from core client for 30 sec - exiting 10:06:47 (31692): No heartbeat from core client for 30 sec - exiting 10:06:48 (31692): No heartbeat from core client for 30 sec - exiting 10:06:49 (31692): No heartbeat from core client for 30 sec - exiting 10:06:50 (31692): No heartbeat from core client for 30 sec - exiting 10:06:51 (31692): No heartbeat from core client for 30 sec - exiting 10:06:52 (31692): No heartbeat from core client for 30 sec - exiting 10:06:53 (31692): No heartbeat from core client for 30 sec - exiting 10:06:54 (31692): No heartbeat from core client for 30 sec - exiting 10:06:55 (31692): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 14:13:39 (5944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:13:41 (5944): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:03:02 (4796): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:29:22 (2736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:29:23 (2736): No heartbeat from core client for 30 sec - exiting 18:29:24 (2736): No heartbeat from core client for 30 sec - exiting 18:29:25 (2736): No heartbeat from core client for 30 sec - exiting 18:29:26 (2736): No heartbeat from core client for 30 sec - exiting 18:29:27 (2736): No heartbeat from core client for 30 sec - exiting 18:29:28 (2736): No heartbeat from core client for 30 sec - exiting 18:29:29 (2736): No heartbeat from core client for 30 sec - exiting 18:29:30 (2736): No heartbeat from core client for 30 sec - exiting 18:29:31 (2736): No heartbeat from core client for 30 sec - exiting 18:29:32 (2736): No heartbeat from core client for 30 sec - exiting 18:29:33 (2736): No heartbeat from core client for 30 sec - exiting 19:30:49 (10448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:30:50 (10448): No heartbeat from core client for 30 sec - exiting 19:30:51 (10448): No heartbeat from core client for 30 sec - exiting 19:30:52 (10448): No heartbeat from core client for 30 sec - exiting 19:30:53 (10448): No heartbeat from core client for 30 sec - exiting 19:30:54 (10448): No heartbeat from core client for 30 sec - exiting 19:30:55 (10448): No heartbeat from core client for 30 sec - exiting 19:30:56 (10448): No heartbeat from core client for 30 sec - exiting 19:30:57 (10448): No heartbeat from core client for 30 sec - exiting 19:30:58 (10448): No heartbeat from core client for 30 sec - exiting 19:30:59 (10448): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:38:01 (2900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:07:56 (10316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:12:57 (10404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1432, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1432, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1432, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1432, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1432, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1432, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Jun 2013 07:15:21	1255152	15815080	hadcm3n_o6kw_1940_40_008383370_0	570,240	405,386	0.7109
12 Jun 2013 02:13:08	1255152	15815080	hadcm3n_o6kw_1940_40_008383370_0	544,320	387,330	0.7116
11 Jun 2013 21:14:26	1255152	15815080	hadcm3n_o6kw_1940_40_008383370_0	518,400	369,414	0.7126
11 Jun 2013 10:49:06	1255152	15815080	hadcm3n_o6kw_1940_40_008383370_0	492,480	351,474	0.7137
11 Jun 2013 05:52:04	1255152	15815080	hadcm3n_o6kw_1940_40_008383370_0	466,560	333,886	0.7156
11 Jun 2013 01:40:15	1255152	15815080	hadcm3n_o6kw_1940_40_008383370_0	440,640	316,288	0.7178
09 Jun 2013 03:07:27	1255152	15815080	hadcm3n_o6kw_1940_40_008383370_0	414,720	298,061	0.7187
08 Jun 2013 22:10:23	1255152	15815080	hadcm3n_o6kw_1940_40_008383370_0	388,800	280,380	0.7211
08 Jun 2013 17:12:36	1255152	15815080	hadcm3n_o6kw_1940_40_008383370_0	362,880	261,880	0.7217
08 Jun 2013 02:25:57	1255152	15815080	hadcm3n_o6kw_1940_40_008383370_0	336,960	243,411	0.7224
07 Jun 2013 04:08:29	1255152	15815080	hadcm3n_o6kw_1940_40_008383370_0	311,040	224,604	0.7221
06 Jun 2013 22:55:54	1255152	15815080	hadcm3n_o6kw_1940_40_008383370_0	285,120	205,723	0.7215
06 Jun 2013 18:31:39	1255152	15815080	hadcm3n_o6kw_1940_40_008383370_0	259,200	186,500	0.7195
06 Jun 2013 03:39:02	1255152	15815080	hadcm3n_o6kw_1940_40_008383370_0	233,280	167,833	0.7194
05 Jun 2013 21:55:53	1255152	15815080	hadcm3n_o6kw_1940_40_008383370_0	207,360	149,582	0.7214
04 Jun 2013 22:25:28	1255152	15815080	hadcm3n_o6kw_1940_40_008383370_0	181,440	130,854	0.7212
04 Jun 2013 01:40:47	1255152	15815080	hadcm3n_o6kw_1940_40_008383370_0	155,520	112,013	0.7202
03 Jun 2013 21:22:46	1255152	15815080	hadcm3n_o6kw_1940_40_008383370_0	129,600	93,452	0.7211
03 Jun 2013 00:47:12	1255152	15815080	hadcm3n_o6kw_1940_40_008383370_0	103,680	74,666	0.7202
02 Jun 2013 19:46:43	1255152	15815080	hadcm3n_o6kw_1940_40_008383370_0	77,760	56,575	0.7276