Task 15995750

Name	hadcm3n_82y0_1980_40_008461755_0
Workunit	8612611
Created	30 Aug 2013, 22:19:20 UTC
Sent	1 Sep 2013, 18:17:13 UTC
Report deadline	2 Dec 2013, 1:44:24 UTC
Received	3 Oct 2013, 21:35:51 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1404734
Run time	9 hours 0 min 9 sec
CPU time	7 hours 45 min 40 sec
Validate state	Invalid
Credit	311.04
Device peak FLOPS	4.15 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:47:31 (7880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8924, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:22:02 (5160): No heartbeat from core client for 30 sec - exiting 22:22:03 (5160): No heartbeat from core client for 30 sec - exiting 22:22:04 (5160): No heartbeat from core client for 30 sec - exiting 22:22:05 (5160): No heartbeat from core client for 30 sec - exiting 22:22:06 (5160): No heartbeat from core client for 30 sec - exiting 22:22:07 (5160): No heartbeat from core client for 30 sec - exiting 22:22:08 (5160): No heartbeat from core client for 30 sec - exiting 22:22:09 (5160): No heartbeat from core client for 30 sec - exiting 22:22:10 (5160): No heartbeat from core client for 30 sec - exiting 22:22:11 (5160): No heartbeat from core client for 30 sec - exiting 22:22:12 (5160): No heartbeat from core client for 30 sec - exiting 22:22:13 (5160): No heartbeat from core client for 30 sec - exiting 22:22:14 (5160): No heartbeat from core client for 30 sec - exiting 22:22:15 (5160): No heartbeat from core client for 30 sec - exiting 22:22:16 (5160): No heartbeat from core client for 30 sec - exiting 22:22:17 (5160): No heartbeat from core client for 30 sec - exiting 22:22:18 (5160): No heartbeat from core client for 30 sec - exiting 22:22:19 (5160): No heartbeat from core client for 30 sec - exiting 22:22:20 (5160): No heartbeat from core client for 30 sec - exiting 22:22:21 (5160): No heartbeat from core client for 30 sec - exiting 22:22:22 (5160): No heartbeat from core client for 30 sec - exiting 22:22:23 (5160): No heartbeat from core client for 30 sec - exiting 22:22:24 (5160): No heartbeat from core client for 30 sec - exiting 22:22:25 (5160): No heartbeat from core client for 30 sec - exiting 22:22:26 (5160): No heartbeat from core client for 30 sec - exiting 22:22:27 (5160): No heartbeat from core client for 30 sec - exiting 22:22:28 (5160): No heartbeat from core client for 30 sec - exiting 22:22:29 (5160): No heartbeat from core client for 30 sec - exiting 22:22:30 (5160): No heartbeat from core client for 30 sec - exiting 22:22:31 (5160): No heartbeat from core client for 30 sec - exiting 22:22:32 (5160): No heartbeat from core client for 30 sec - exiting 22:22:33 (5160): No heartbeat from core client for 30 sec - exiting 22:22:34 (5160): No heartbeat from core client for 30 sec - exiting 22:22:35 (5160): No heartbeat from core client for 30 sec - exiting 22:22:36 (5160): No heartbeat from core client for 30 sec - exiting 22:22:37 (5160): No heartbeat from core client for 30 sec - exiting 22:22:38 (5160): No heartbeat from core client for 30 sec - exiting 22:22:39 (5160): No heartbeat from core client for 30 sec - exiting 22:22:40 (5160): No heartbeat from core client for 30 sec - exiting 22:22:41 (5160): No heartbeat from core client for 30 sec - exiting 22:22:42 (5160): No heartbeat from core client for 30 sec - exiting 22:22:43 (5160): No heartbeat from core client for 30 sec - exiting 22:22:44 (5160): No heartbeat from core client for 30 sec - exiting 22:22:45 (5160): No heartbeat from core client for 30 sec - exiting 22:22:46 (5160): No heartbeat from core client for 30 sec - exiting 22:22:47 (5160): No heartbeat from core client for 30 sec - exiting 22:22:48 (5160): No heartbeat from core client for 30 sec - exiting 22:22:49 (5160): No heartbeat from core client for 30 sec - exiting 22:22:50 (5160): No heartbeat from core client for 30 sec - exiting 22:22:51 (5160): No heartbeat from core client for 30 sec - exiting 22:22:52 (5160): No heartbeat from core client for 30 sec - exiting 22:22:53 (5160): No heartbeat from core client for 30 sec - exiting 22:22:54 (5160): No heartbeat from core client for 30 sec - exiting 22:22:55 (5160): No heartbeat from core client for 30 sec - exiting 22:22:56 (5160): No heartbeat from core client for 30 sec - exiting 22:22:57 (5160): No heartbeat from core client for 30 sec - exiting 22:22:58 (5160): No heartbeat from core client for 30 sec - exiting 22:22:59 (5160): No heartbeat from core client for 30 sec - exiting 22:23:00 (5160): No heartbeat from core client for 30 sec - exiting 22:23:01 (5160): No heartbeat from core client for 30 sec - exiting 22:23:02 (5160): No heartbeat from core client for 30 sec - exiting 22:23:03 (5160): No heartbeat from core client for 30 sec - exiting 22:23:04 (5160): No heartbeat from core client for 30 sec - exiting 22:23:05 (5160): No heartbeat from core client for 30 sec - exiting 22:23:06 (5160): No heartbeat from core client for 30 sec - exiting 22:23:07 (5160): No heartbeat from core client for 30 sec - exiting 22:23:08 (5160): No heartbeat from core client for 30 sec - exiting 22:23:09 (5160): No heartbeat from core client for 30 sec - exiting 22:23:10 (5160): No heartbeat from core client for 30 sec - exiting 22:23:11 (5160): No heartbeat from core client for 30 sec - exiting 22:23:12 (5160): No heartbeat from core client for 30 sec - exiting 22:23:13 (5160): No heartbeat from core client for 30 sec - exiting 22:23:14 (5160): No heartbeat from core client for 30 sec - exiting 22:23:15 (5160): No heartbeat from core client for 30 sec - exiting 22:23:16 (5160): No heartbeat from core client for 30 sec - exiting 22:23:17 (5160): No heartbeat from core client for 30 sec - exiting 22:23:18 (5160): No heartbeat from core client for 30 sec - exiting 22:23:19 (5160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4336, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4336, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4336, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4336, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4336, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4336, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Sep 2013 12:11:38	1279516	15995750	hadcm3n_82y0_1980_40_008461755_0	25,920	22,193	0.8562