Task 13670400

Name	hadcm3n_yga2_1940_40_007546600_1
Workunit	7743832
Created	29 Nov 2011, 7:22:54 UTC
Sent	30 Nov 2011, 14:33:35 UTC
Report deadline	29 Feb 2012, 22:00:46 UTC
Received	4 Dec 2011, 11:55:24 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1122757
Run time	3 days 20 hours 35 min 38 sec
CPU time	3 days 19 hours 12 min 41 sec
Validate state	Invalid
Credit	1,244.16
Device peak FLOPS	1.69 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 22:55:47 (5088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:56:44 (1408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:01:21 (1412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 08:03:36 (5928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:04:53 (4464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:05:31 (5008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 08:07:29 (4596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:08:09 (5224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 08:11:04 (1188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:54:23 (6040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:55:04 (6040): No heartbeat from core client for 30 sec - exiting 01:55:05 (6040): No heartbeat from core client for 30 sec - exiting 01:55:06 (6040): No heartbeat from core client for 30 sec - exiting 01:55:07 (6040): No heartbeat from core client for 30 sec - exiting 01:55:09 (6040): No heartbeat from core client for 30 sec - exiting 01:55:10 (6040): No heartbeat from core client for 30 sec - exiting 01:55:11 (6040): No heartbeat from core client for 30 sec - exiting 01:55:12 (6040): No heartbeat from core client for 30 sec - exiting 01:55:13 (6040): No heartbeat from core client for 30 sec - exiting 01:55:14 (6040): No heartbeat from core client for 30 sec - exiting 01:55:15 (6040): No heartbeat from core client for 30 sec - exiting 01:55:16 (6040): No heartbeat from core client for 30 sec - exiting 01:55:17 (6040): No heartbeat from core client for 30 sec - exiting 01:55:18 (6040): No heartbeat from core client for 30 sec - exiting 01:55:19 (6040): No heartbeat from core client for 30 sec - exiting 01:55:21 (6040): No heartbeat from core client for 30 sec - exiting 01:55:22 (6040): No heartbeat from core client for 30 sec - exiting 01:55:23 (6040): No heartbeat from core client for 30 sec - exiting 01:55:24 (6040): No heartbeat from core client for 30 sec - exiting 01:55:25 (6040): No heartbeat from core client for 30 sec - exiting 01:55:26 (6040): No heartbeat from core client for 30 sec - exiting 01:55:27 (6040): No heartbeat from core client for 30 sec - exiting 01:55:28 (6040): No heartbeat from core client for 30 sec - exiting 01:55:29 (6040): No heartbeat from core client for 30 sec - exiting 01:55:30 (6040): No heartbeat from core client for 30 sec - exiting 01:55:32 (6040): No heartbeat from core client for 30 sec - exiting 01:55:33 (6040): No heartbeat from core client for 30 sec - exiting 01:55:34 (6040): No heartbeat from core client for 30 sec - exiting 01:55:35 (6040): No heartbeat from core client for 30 sec - exiting 01:55:36 (6040): No heartbeat from core client for 30 sec - exiting 01:55:37 (6040): No heartbeat from core client for 30 sec - exiting 01:55:38 (6040): No heartbeat from core client for 30 sec - exiting 01:55:39 (6040): No heartbeat from core client for 30 sec - exiting 01:55:40 (6040): No heartbeat from core client for 30 sec - exiting 01:55:41 (6040): No heartbeat from core client for 30 sec - exiting 01:55:42 (6040): No heartbeat from core client for 30 sec - exiting 01:55:44 (6040): No heartbeat from core client for 30 sec - exiting 01:55:45 (6040): No heartbeat from core client for 30 sec - exiting 01:55:46 (6040): No heartbeat from core client for 30 sec - exiting 01:55:47 (6040): No heartbeat from core client for 30 sec - exiting 01:55:48 (6040): No heartbeat from core client for 30 sec - exiting 01:55:49 (6040): No heartbeat from core client for 30 sec - exiting 01:55:50 (6040): No heartbeat from core client for 30 sec - exiting 01:55:51 (6040): No heartbeat from core client for 30 sec - exiting 01:55:52 (6040): No heartbeat from core client for 30 sec - exiting 01:55:53 (6040): No heartbeat from core client for 30 sec - exiting 01:55:54 (6040): No heartbeat from core client for 30 sec - exiting 01:55:56 (6040): No heartbeat from core client for 30 sec - exiting 01:55:57 (6040): No heartbeat from core client for 30 sec - exiting 01:55:58 (6040): No heartbeat from core client for 30 sec - exiting 01:55:59 (6040): No heartbeat from core client for 30 sec - exiting 01:56:00 (6040): No heartbeat from core client for 30 sec - exiting 01:56:01 (6040): No heartbeat from core client for 30 sec - exiting 01:56:02 (6040): No heartbeat from core client for 30 sec - exiting 01:56:03 (6040): No heartbeat from core client for 30 sec - exiting 01:56:04 (6040): No heartbeat from core client for 30 sec - exiting 01:56:05 (6040): No heartbeat from core client for 30 sec - exiting 01:56:06 (6040): No heartbeat from core client for 30 sec - exiting 01:56:08 (6040): No heartbeat from core client for 30 sec - exiting 01:56:09 (6040): No heartbeat from core client for 30 sec - exiting 01:56:10 (6040): No heartbeat from core client for 30 sec - exiting 01:56:11 (6040): No heartbeat from core client for 30 sec - exiting 01:56:12 (6040): No heartbeat from core client for 30 sec - exiting 01:56:13 (6040): No heartbeat from core client for 30 sec - exiting 01:56:14 (6040): No heartbeat from core client for 30 sec - exiting 01:56:15 (6040): No heartbeat from core client for 30 sec - exiting 01:56:16 (6040): No heartbeat from core client for 30 sec - exiting 01:56:17 (6040): No heartbeat from core client for 30 sec - exiting 01:56:18 (6040): No heartbeat from core client for 30 sec - exiting 01:56:20 (6040): No heartbeat from core client for 30 sec - exiting 01:56:21 (6040): No heartbeat from core client for 30 sec - exiting 01:56:22 (6040): No heartbeat from core client for 30 sec - exiting 01:56:23 (6040): No heartbeat from core client for 30 sec - exiting 01:56:24 (6040): No heartbeat from core client for 30 sec - exiting 01:56:25 (6040): No heartbeat from core client for 30 sec - exiting 01:56:26 (6040): No heartbeat from core client for 30 sec - exiting 01:56:27 (6040): No heartbeat from core client for 30 sec - exiting 01:56:28 (6040): No heartbeat from core client for 30 sec - exiting 02:03:39 (4032): No heartbeat from core client for 30 sec - exiting 02:03:40 (4032): No heartbeat from core client for 30 sec - exiting 02:03:41 (4032): No heartbeat from core client for 30 sec - exiting 02:03:42 (4032): No heartbeat from core client for 30 sec - exiting 02:03:43 (4032): No heartbeat from core client for 30 sec - exiting 02:03:44 (4032): No heartbeat from core client for 30 sec - exiting 02:03:45 (4032): No heartbeat from core client for 30 sec - exiting 02:03:46 (4032): No heartbeat from core client for 30 sec - exiting 02:03:47 (4032): No heartbeat from core client for 30 sec - exiting 02:03:48 (4032): No heartbeat from core client for 30 sec - exiting 02:03:49 (4032): No heartbeat from core client for 30 sec - exiting 02:03:51 (4032): No heartbeat from core client for 30 sec - exiting 02:03:52 (4032): No heartbeat from core client for 30 sec - exiting 02:03:53 (4032): No heartbeat from core client for 30 sec - exiting 02:03:54 (4032): No heartbeat from core client for 30 sec - exiting 02:03:55 (4032): No heartbeat from core client for 30 sec - exiting 02:03:56 (4032): No heartbeat from core client for 30 sec - exiting 02:03:57 (4032): No heartbeat from core client for 30 sec - exiting 02:03:58 (4032): No heartbeat from core client for 30 sec - exiting 02:03:59 (4032): No heartbeat from core client for 30 sec - exiting 02:04:00 (4032): No heartbeat from core client for 30 sec - exiting 02:04:01 (4032): No heartbeat from core client for 30 sec - exiting 02:04:03 (4032): No heartbeat from core client for 30 sec - exiting 02:04:04 (4032): No heartbeat from core client for 30 sec - exiting 02:04:05 (4032): No heartbeat from core client for 30 sec - exiting 02:04:06 (4032): No heartbeat from core client for 30 sec - exiting 02:04:07 (4032): No heartbeat from core client for 30 sec - exiting 02:04:08 (4032): No heartbeat from core client for 30 sec - exiting 02:04:09 (4032): No heartbeat from core client for 30 sec - exiting 02:04:10 (4032): No heartbeat from core client for 30 sec - exiting 02:04:11 (4032): No heartbeat from core client for 30 sec - exiting 02:04:45 (4032): No heartbeat from core client for 30 sec - exiting 02:04:46 (4032): No heartbeat from core client for 30 sec - exiting 02:04:47 (4032): No heartbeat from core client for 30 sec - exiting 02:04:48 (4032): No heartbeat from core client for 30 sec - exiting 02:04:50 (4032): No heartbeat from core client for 30 sec - exiting 02:04:51 (4032): No heartbeat from core client for 30 sec - exiting 02:04:52 (4032): No heartbeat from core client for 30 sec - exiting 02:04:53 (4032): No heartbeat from core client for 30 sec - exiting 02:04:54 (4032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:04:55 (4032): No heartbeat from core client for 30 sec - exiting 02:04:56 (4032): No heartbeat from core client for 30 sec - exiting 02:04:57 (4032): No heartbeat from core client for 30 sec - exiting 02:06:13 (6132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:53:07 (4368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:53:10 (4368): No heartbeat from core client for 30 sec - exiting 03:53:11 (4368): No heartbeat from core client for 30 sec - exiting 03:53:12 (4368): No heartbeat from core client for 30 sec - exiting 03:53:13 (4368): No heartbeat from core client for 30 sec - exiting 03:53:14 (4368): No heartbeat from core client for 30 sec - exiting 03:53:15 (4368): No heartbeat from core client for 30 sec - exiting 03:53:16 (4368): No heartbeat from core client for 30 sec - exiting 03:53:17 (4368): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4664, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4664, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4664, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4664, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4664, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4664, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Dec 2011 10:20:19	1122757	13670400	hadcm3n_yga2_1940_40_007546600_1	103,680	322,849	3.1139
03 Dec 2011 11:21:50	1122757	13670400	hadcm3n_yga2_1940_40_007546600_1	77,760	242,513	3.1187
02 Dec 2011 12:22:59	1122757	13670400	hadcm3n_yga2_1940_40_007546600_1	51,840	160,879	3.1034
01 Dec 2011 13:22:35	1122757	13670400	hadcm3n_yga2_1940_40_007546600_1	25,920	80,453	3.1039