Task 13618425

Name	hadcm3n_o3lk_1980_40_007535876_2
Workunit	7733108
Created	8 Nov 2011, 12:51:22 UTC
Sent	8 Nov 2011, 12:54:25 UTC
Report deadline	7 Feb 2012, 20:21:36 UTC
Received	21 Nov 2011, 8:12:31 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1178933
Run time	3 days 20 hours 27 min 56 sec
CPU time	3 days 15 hours 3 min 16 sec
Validate state	Invalid
Credit	1,866.24
Device peak FLOPS	2.50 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:06:14 (4288): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 11:06:47 (4288): No heartbeat from core client for 30 sec - exiting 11:06:54 (4288): No heartbeat from core client for 30 sec - exiting 11:06:55 (4288): No heartbeat from core client for 30 sec - exiting 11:06:56 (4288): No heartbeat from core client for 30 sec - exiting 11:06:57 (4288): No heartbeat from core client for 30 sec - exiting 11:06:58 (4288): No heartbeat from core client for 30 sec - exiting 11:06:59 (4288): No heartbeat from core client for 30 sec - exiting 11:07:00 (4288): No heartbeat from core client for 30 sec - exiting 11:07:01 (4288): No heartbeat from core client for 30 sec - exiting 11:07:02 (4288): No heartbeat from core client for 30 sec - exiting 11:07:06 (4288): No heartbeat from core client for 30 sec - exiting 11:07:07 (4288): No heartbeat from core client for 30 sec - exiting 11:07:08 (4288): No heartbeat from core client for 30 sec - exiting 11:07:09 (4288): No heartbeat from core client for 30 sec - exiting 11:07:10 (4288): No heartbeat from core client for 30 sec - exiting 11:07:11 (4288): No heartbeat from core client for 30 sec - exiting 11:07:12 (4288): No heartbeat from core client for 30 sec - exiting 11:07:14 (4288): No heartbeat from core client for 30 sec - exiting 11:07:15 (4288): No heartbeat from core client for 30 sec - exiting 11:07:16 (4288): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5080, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5080, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5080, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5080, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5080, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5080, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Nov 2011 03:06:36	1178933	13618425	hadcm3n_o3lk_1980_40_007535876_2	155,520	292,791	1.8827
15 Nov 2011 18:06:24	1178933	13618425	hadcm3n_o3lk_1980_40_007535876_2	129,600	245,192	1.8919
15 Nov 2011 18:06:24	1178933	13618425	hadcm3n_o3lk_1980_40_007535876_2	103,680	196,496	1.8952
15 Nov 2011 18:06:24	1178933	13618425	hadcm3n_o3lk_1980_40_007535876_2	77,760	147,855	1.9014
15 Nov 2011 18:06:24	1178933	13618425	hadcm3n_o3lk_1980_40_007535876_2	51,840	98,955	1.9089
10 Nov 2011 09:23:30	1178933	13618425	hadcm3n_o3lk_1980_40_007535876_2	25,920	49,884	1.9245