Task 12734367

Name	hadcm3n_o0z3_1900_40_007196594_0
Workunit	7394874
Created	28 Mar 2011, 13:58:41 UTC
Sent	2 Apr 2011, 9:38:16 UTC
Report deadline	2 Jul 2011, 17:05:27 UTC
Received	21 Apr 2011, 23:38:35 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1038505
Run time	13 days 3 hours 30 min 15 sec
CPU time	12 days 23 hours 48 min 15 sec
Validate state	Invalid
Credit	8,087.04
Device peak FLOPS	2.39 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:20:09 (5920): No heartbeat from core client for 30 sec - exiting 03:20:10 (5920): No heartbeat from core client for 30 sec - exiting 03:20:11 (5920): No heartbeat from core client for 30 sec - exiting 03:20:12 (5920): No heartbeat from core client for 30 sec - exiting 03:20:13 (5920): No heartbeat from core client for 30 sec - exiting 03:20:14 (5920): No heartbeat from core client for 30 sec - exiting 03:20:15 (5920): No heartbeat from core client for 30 sec - exiting 03:20:16 (5920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5164, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5164, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5164, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5164, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5164, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5164, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Apr 2011 12:10:39	1038505	12734367	hadcm3n_o0z3_1900_40_007196594_0	673,920	1,119,832	1.6617
20 Apr 2011 19:46:33	1038505	12734367	hadcm3n_o0z3_1900_40_007196594_0	648,000	1,077,785	1.6632
20 Apr 2011 15:42:54	1038505	12734367	hadcm3n_o0z3_1900_40_007196594_0	622,080	1,034,723	1.6633
20 Apr 2011 15:42:53	1038505	12734367	hadcm3n_o0z3_1900_40_007196594_0	596,160	991,531	1.6632
20 Apr 2011 15:42:53	1038505	12734367	hadcm3n_o0z3_1900_40_007196594_0	570,240	948,445	1.6632
20 Apr 2011 15:42:53	1038505	12734367	hadcm3n_o0z3_1900_40_007196594_0	544,320	906,551	1.6655
20 Apr 2011 15:42:53	1038505	12734367	hadcm3n_o0z3_1900_40_007196594_0	518,400	863,423	1.6656
20 Apr 2011 15:42:53	1038505	12734367	hadcm3n_o0z3_1900_40_007196594_0	492,480	820,673	1.6664
20 Apr 2011 15:42:53	1038505	12734367	hadcm3n_o0z3_1900_40_007196594_0	466,560	778,510	1.6686
20 Apr 2011 15:42:53	1038505	12734367	hadcm3n_o0z3_1900_40_007196594_0	440,640	736,548	1.6715
20 Apr 2011 15:42:53	1038505	12734367	hadcm3n_o0z3_1900_40_007196594_0	414,720	694,292	1.6741
20 Apr 2011 15:42:53	1038505	12734367	hadcm3n_o0z3_1900_40_007196594_0	388,800	651,187	1.6749
20 Apr 2011 15:42:53	1038505	12734367	hadcm3n_o0z3_1900_40_007196594_0	362,880	608,436	1.6767
13 Apr 2011 08:16:33	1038505	12734367	hadcm3n_o0z3_1900_40_007196594_0	336,960	564,476	1.6752
12 Apr 2011 17:24:25	1038505	12734367	hadcm3n_o0z3_1900_40_007196594_0	311,040	520,426	1.6732
12 Apr 2011 09:08:04	1038505	12734367	hadcm3n_o0z3_1900_40_007196594_0	285,120	476,790	1.6722
11 Apr 2011 11:37:04	1038505	12734367	hadcm3n_o0z3_1900_40_007196594_0	259,200	433,599	1.6728
10 Apr 2011 21:22:07	1038505	12734367	hadcm3n_o0z3_1900_40_007196594_0	233,280	389,991	1.6718
10 Apr 2011 07:34:55	1038505	12734367	hadcm3n_o0z3_1900_40_007196594_0	207,360	347,077	1.6738
09 Apr 2011 17:06:48	1038505	12734367	hadcm3n_o0z3_1900_40_007196594_0	181,440	304,178	1.6765