Task 15635958

Name	hadcm3n_zaqw_1960_40_008320986_0
Workunit	8472121
Created	24 Feb 2013, 16:42:13 UTC
Sent	24 Feb 2013, 16:43:06 UTC
Report deadline	27 May 2013, 0:10:17 UTC
Received	28 Mar 2013, 9:58:48 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1267596
Run time	2 days 10 hours 58 min 48 sec
CPU time	1 days 19 hours 59 min 33 sec
Validate state	Invalid
Credit	622.08
Device peak FLOPS	2.74 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.8.44</core_client_version> <![CDATA[ <message> The device does not recognise the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:24:53 (6568): No heartbeat from core client for 30 sec - exiting 19:24:54 (6568): No heartbeat from core client for 30 sec - exiting 19:24:55 (6568): No heartbeat from core client for 30 sec - exiting 19:24:56 (6568): No heartbeat from core client for 30 sec - exiting 19:24:57 (6568): No heartbeat from core client for 30 sec - exiting 19:24:58 (6568): No heartbeat from core client for 30 sec - exiting 19:24:59 (6568): No heartbeat from core client for 30 sec - exiting 19:25:00 (6568): No heartbeat from core client for 30 sec - exiting 19:25:01 (6568): No heartbeat from core client for 30 sec - exiting 19:25:02 (6568): No heartbeat from core client for 30 sec - exiting 19:25:03 (6568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:58:29 (4540): No heartbeat from core client for 30 sec - exiting 18:58:30 (4540): No heartbeat from core client for 30 sec - exiting 18:58:31 (4540): No heartbeat from core client for 30 sec - exiting 18:58:32 (4540): No heartbeat from core client for 30 sec - exiting 18:58:33 (4540): No heartbeat from core client for 30 sec - exiting 18:58:34 (4540): No heartbeat from core client for 30 sec - exiting 18:58:35 (4540): No heartbeat from core client for 30 sec - exiting 18:58:36 (4540): No heartbeat from core client for 30 sec - exiting 18:58:37 (4540): No heartbeat from core client for 30 sec - exiting 18:58:38 (4540): No heartbeat from core client for 30 sec - exiting 18:58:39 (4540): No heartbeat from core client for 30 sec - exiting 18:58:40 (4540): No heartbeat from core client for 30 sec - exiting 18:58:41 (4540): No heartbeat from core client for 30 sec - exiting 18:58:42 (4540): No heartbeat from core client for 30 sec - exiting 18:58:43 (4540): No heartbeat from core client for 30 sec - exiting 18:58:44 (4540): No heartbeat from core client for 30 sec - exiting 18:58:45 (4540): No heartbeat from core client for 30 sec - exiting 18:58:46 (4540): No heartbeat from core client for 30 sec - exiting 18:58:47 (4540): No heartbeat from core client for 30 sec - exiting 18:58:48 (4540): No heartbeat from core client for 30 sec - exiting 18:58:49 (4540): No heartbeat from core client for 30 sec - exiting 18:58:50 (4540): No heartbeat from core client for 30 sec - exiting 18:58:51 (4540): No heartbeat from core client for 30 sec - exiting 18:58:52 (4540): No heartbeat from core client for 30 sec - exiting 18:58:53 (4540): No heartbeat from core client for 30 sec - exiting 18:58:54 (4540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:40:31 (4696): No heartbeat from core client for 30 sec - exiting 14:40:32 (4696): No heartbeat from core client for 30 sec - exiting 14:40:33 (4696): No heartbeat from core client for 30 sec - exiting 14:40:34 (4696): No heartbeat from core client for 30 sec - exiting 14:40:35 (4696): No heartbeat from core client for 30 sec - exiting 14:40:36 (4696): No heartbeat from core client for 30 sec - exiting 14:40:37 (4696): No heartbeat from core client for 30 sec - exiting 14:40:38 (4696): No heartbeat from core client for 30 sec - exiting 14:40:39 (4696): No heartbeat from core client for 30 sec - exiting 14:40:40 (4696): No heartbeat from core client for 30 sec - exiting 14:40:41 (4696): No heartbeat from core client for 30 sec - exiting 14:40:42 (4696): No heartbeat from core client for 30 sec - exiting 14:40:43 (4696): No heartbeat from core client for 30 sec - exiting 14:40:44 (4696): No heartbeat from core client for 30 sec - exiting 14:40:45 (4696): No heartbeat from core client for 30 sec - exiting 14:40:46 (4696): No heartbeat from core client for 30 sec - exiting 14:40:47 (4696): No heartbeat from core client for 30 sec - exiting 14:40:48 (4696): No heartbeat from core client for 30 sec - exiting 14:40:49 (4696): No heartbeat from core client for 30 sec - exiting 14:40:50 (4696): No heartbeat from core client for 30 sec - exiting 14:40:51 (4696): No heartbeat from core client for 30 sec - exiting 14:40:52 (4696): No heartbeat from core client for 30 sec - exiting 14:40:53 (4696): No heartbeat from core client for 30 sec - exiting 14:40:54 (4696): No heartbeat from core client for 30 sec - exiting 14:40:55 (4696): No heartbeat from core client for 30 sec - exiting 14:40:56 (4696): No heartbeat from core client for 30 sec - exiting 14:40:57 (4696): No heartbeat from core client for 30 sec - exiting 14:40:58 (4696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:59:23 (4664): No heartbeat from core client for 30 sec - exiting 15:59:25 (4664): No heartbeat from core client for 30 sec - exiting 15:59:26 (4664): No heartbeat from core client for 30 sec - exiting 15:59:27 (4664): No heartbeat from core client for 30 sec - exiting 15:59:28 (4664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:59:29 (4664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:19:14 (1564): No heartbeat from core client for 30 sec - exiting 08:19:15 (1564): No heartbeat from core client for 30 sec - exiting 08:19:16 (1564): No heartbeat from core client for 30 sec - exiting 08:19:17 (1564): No heartbeat from core client for 30 sec - exiting 08:19:18 (1564): No heartbeat from core client for 30 sec - exiting 08:19:19 (1564): No heartbeat from core client for 30 sec - exiting 08:19:20 (1564): No heartbeat from core client for 30 sec - exiting 08:19:21 (1564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2680, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2680, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2680, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2680, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2680, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2680, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Mar 2013 22:10:10	1267596	15635958	hadcm3n_zaqw_1960_40_008320986_0	51,840	108,919	2.1011
20 Mar 2013 05:51:19	1267596	15635958	hadcm3n_zaqw_1960_40_008320986_0	25,920	55,712	2.1494