Task 13019864

Name	hadcm3n_t0pn_1940_40_007313799_1
Workunit	7511229
Created	28 Jun 2011, 12:25:22 UTC
Sent	28 Jun 2011, 12:25:53 UTC
Report deadline	27 Sep 2011, 19:53:04 UTC
Received	30 Sep 2011, 18:13:03 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1107643
Run time	15 days 4 hours 8 min 47 sec
CPU time	12 days 18 hours 41 min 46 sec
Validate state	Invalid
Credit	8,087.04
Device peak FLOPS	2.95 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:19:05 (4480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:57:08 (6100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:08:36 (3984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:57:57 (4800): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:02:10 (3292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:34:20 (4112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:08:06 (2104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:17:15 (4320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:17:16 (4320): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3608, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3608, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3608, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3608, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2232, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4364, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Sep 2011 20:10:27	1107643	13019864	hadcm3n_t0pn_1940_40_007313799_1	673,920	1,092,532	1.6212
25 Sep 2011 06:44:23	1107643	13019864	hadcm3n_t0pn_1940_40_007313799_1	648,000	1,048,419	1.6179
24 Sep 2011 15:16:13	1107643	13019864	hadcm3n_t0pn_1940_40_007313799_1	622,080	1,004,914	1.6154
24 Sep 2011 00:41:07	1107643	13019864	hadcm3n_t0pn_1940_40_007313799_1	596,160	962,424	1.6144
18 Sep 2011 23:56:34	1107643	13019864	hadcm3n_t0pn_1940_40_007313799_1	570,240	921,232	1.6155
18 Sep 2011 05:54:02	1107643	13019864	hadcm3n_t0pn_1940_40_007313799_1	544,320	878,881	1.6146
17 Sep 2011 15:13:33	1107643	13019864	hadcm3n_t0pn_1940_40_007313799_1	518,400	836,019	1.6127
17 Sep 2011 03:12:27	1107643	13019864	hadcm3n_t0pn_1940_40_007313799_1	492,480	794,008	1.6123
12 Sep 2011 02:17:15	1107643	13019864	hadcm3n_t0pn_1940_40_007313799_1	466,560	752,120	1.6121
11 Sep 2011 08:41:15	1107643	13019864	hadcm3n_t0pn_1940_40_007313799_1	440,640	710,157	1.6116
10 Sep 2011 17:47:20	1107643	13019864	hadcm3n_t0pn_1940_40_007313799_1	414,720	668,331	1.6115
10 Sep 2011 04:39:02	1107643	13019864	hadcm3n_t0pn_1940_40_007313799_1	388,800	626,503	1.6114
04 Sep 2011 06:22:08	1107643	13019864	hadcm3n_t0pn_1940_40_007313799_1	362,880	584,984	1.6121
03 Sep 2011 18:31:34	1107643	13019864	hadcm3n_t0pn_1940_40_007313799_1	336,960	544,832	1.6169
03 Sep 2011 01:20:02	1107643	13019864	hadcm3n_t0pn_1940_40_007313799_1	311,040	502,895	1.6168
02 Sep 2011 08:55:00	1107643	13019864	hadcm3n_t0pn_1940_40_007313799_1	285,120	461,112	1.6173
01 Sep 2011 18:26:00	1107643	13019864	hadcm3n_t0pn_1940_40_007313799_1	259,200	418,101	1.6130
01 Sep 2011 06:53:11	1107643	13019864	hadcm3n_t0pn_1940_40_007313799_1	233,280	378,137	1.6210
31 Aug 2011 18:17:05	1107643	13019864	hadcm3n_t0pn_1940_40_007313799_1	207,360	337,663	1.6284
31 Aug 2011 06:54:07	1107643	13019864	hadcm3n_t0pn_1940_40_007313799_1	181,440	297,876	1.6417