Task 15998667

Name	hadcm3n_83qj_1980_40_008462782_1
Workunit	8613638
Created	1 Sep 2013, 0:40:09 UTC
Sent	1 Sep 2013, 0:55:42 UTC
Report deadline	1 Dec 2013, 8:22:53 UTC
Received	19 Sep 2013, 1:26:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1215242
Run time	5 days 19 hours 36 min 26 sec
CPU time	5 days 11 hours 12 min 38 sec
Validate state	Invalid
Credit	5,598.72
Device peak FLOPS	3.68 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> Das Gerät erkennt den Befehl nicht. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:04:39 (17692): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:54:46 (6572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:33:23 (9692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:33:24 (9692): No heartbeat from core client for 30 sec - exiting 00:35:42 (2520): No heartbeat from core client for 30 sec - exiting 00:35:43 (2520): No heartbeat from core client for 30 sec - exiting 00:35:44 (2520): No heartbeat from core client for 30 sec - exiting 00:35:45 (2520): No heartbeat from core client for 30 sec - exiting 00:35:46 (2520): No heartbeat from core client for 30 sec - exiting 00:35:47 (2520): No heartbeat from core client for 30 sec - exiting 00:35:48 (2520): No heartbeat from core client for 30 sec - exiting 00:35:49 (2520): No heartbeat from core client for 30 sec - exiting 00:35:50 (2520): No heartbeat from core client for 30 sec - exiting 00:35:51 (2520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:37:34 (7028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:38:33 (6940): No heartbeat from core client for 30 sec - exiting 00:38:34 (6940): No heartbeat from core client for 30 sec - exiting 00:38:35 (6940): No heartbeat from core client for 30 sec - exiting 00:38:36 (6940): No heartbeat from core client for 30 sec - exiting 00:38:37 (6940): No heartbeat from core client for 30 sec - exiting 00:38:38 (6940): No heartbeat from core client for 30 sec - exiting 00:38:39 (6940): No heartbeat from core client for 30 sec - exiting 00:38:40 (6940): No heartbeat from core client for 30 sec - exiting 00:38:41 (6940): No heartbeat from core client for 30 sec - exiting 00:38:42 (6940): No heartbeat from core client for 30 sec - exiting 00:38:43 (6940): No heartbeat from core client for 30 sec - exiting 00:38:44 (6940): No heartbeat from core client for 30 sec - exiting 00:38:45 (6940): No heartbeat from core client for 30 sec - exiting 00:38:46 (6940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:40:44 (10952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:40:45 (10952): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:49:15 (8756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:31:22 (3520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:31:23 (3520): No heartbeat from core client for 30 sec - exiting 00:31:24 (3520): No heartbeat from core client for 30 sec - exiting 00:31:25 (3520): No heartbeat from core client for 30 sec - exiting 00:31:26 (3520): No heartbeat from core client for 30 sec - exiting 00:31:27 (3520): No heartbeat from core client for 30 sec - exiting 00:31:28 (3520): No heartbeat from core client for 30 sec - exiting 00:31:29 (3520): No heartbeat from core client for 30 sec - exiting 00:31:30 (3520): No heartbeat from core client for 30 sec - exiting 00:31:31 (3520): No heartbeat from core client for 30 sec - exiting 00:31:32 (3520): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:30:57 (6992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:30:58 (6992): No heartbeat from core client for 30 sec - exiting 00:30:59 (6992): No heartbeat from core client for 30 sec - exiting 00:31:00 (6992): No heartbeat from core client for 30 sec - exiting 00:31:01 (6992): No heartbeat from core client for 30 sec - exiting 00:31:02 (6992): No heartbeat from core client for 30 sec - exiting 00:31:03 (6992): No heartbeat from core client for 30 sec - exiting 00:31:04 (6992): No heartbeat from core client for 30 sec - exiting 00:31:05 (6992): No heartbeat from core client for 30 sec - exiting 00:31:06 (6992): No heartbeat from core client for 30 sec - exiting 00:31:07 (6992): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:31:17 (9316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:31:18 (9316): No heartbeat from core client for 30 sec - exiting 00:31:19 (9316): No heartbeat from core client for 30 sec - exiting 00:31:20 (9316): No heartbeat from core client for 30 sec - exiting 00:31:21 (9316): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8128, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8128, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8128, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8128, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8128, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8128, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Sep 2013 22:09:26	1215242	15998667	hadcm3n_83qj_1980_40_008462782_1	466,560	470,907	1.0093
17 Sep 2013 20:34:03	1215242	15998667	hadcm3n_83qj_1980_40_008462782_1	440,640	444,693	1.0092
16 Sep 2013 21:35:16	1215242	15998667	hadcm3n_83qj_1980_40_008462782_1	414,720	419,248	1.0109
15 Sep 2013 23:18:08	1215242	15998667	hadcm3n_83qj_1980_40_008462782_1	388,800	393,761	1.0128
15 Sep 2013 00:51:52	1215242	15998667	hadcm3n_83qj_1980_40_008462782_1	362,880	368,102	1.0144
14 Sep 2013 02:05:23	1215242	15998667	hadcm3n_83qj_1980_40_008462782_1	336,960	342,443	1.0163
13 Sep 2013 03:24:48	1215242	15998667	hadcm3n_83qj_1980_40_008462782_1	311,040	316,176	1.0165
12 Sep 2013 20:03:05	1215242	15998667	hadcm3n_83qj_1980_40_008462782_1	285,120	290,704	1.0196
10 Sep 2013 23:23:23	1215242	15998667	hadcm3n_83qj_1980_40_008462782_1	259,200	264,573	1.0207
10 Sep 2013 00:15:31	1215242	15998667	hadcm3n_83qj_1980_40_008462782_1	233,280	237,765	1.0192
08 Sep 2013 23:31:00	1215242	15998667	hadcm3n_83qj_1980_40_008462782_1	207,360	211,133	1.0182
08 Sep 2013 00:49:01	1215242	15998667	hadcm3n_83qj_1980_40_008462782_1	181,440	184,631	1.0176
07 Sep 2013 01:42:16	1215242	15998667	hadcm3n_83qj_1980_40_008462782_1	155,520	158,391	1.0185
06 Sep 2013 02:54:55	1215242	15998667	hadcm3n_83qj_1980_40_008462782_1	129,600	132,747	1.0243
05 Sep 2013 03:51:59	1215242	15998667	hadcm3n_83qj_1980_40_008462782_1	103,680	105,990	1.0223
04 Sep 2013 19:29:57	1215242	15998667	hadcm3n_83qj_1980_40_008462782_1	77,760	79,528	1.0227
03 Sep 2013 20:35:49	1215242	15998667	hadcm3n_83qj_1980_40_008462782_1	51,840	52,921	1.0209
02 Sep 2013 20:30:17	1215242	15998667	hadcm3n_83qj_1980_40_008462782_1	25,920	26,569	1.0250