Task 12745904

Name	hadcm3n_o5ex_1900_40_007202348_1
Workunit	7400628
Created	28 Mar 2011, 14:13:37 UTC
Sent	29 Mar 2011, 21:17:30 UTC
Report deadline	29 Jun 2011, 4:44:41 UTC
Received	13 Apr 2011, 4:05:02 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1141734
Run time	9 days 10 hours 26 min 46 sec
CPU time	7 days 10 hours 30 min 12 sec
Validate state	Invalid
Credit	2,177.28
Device peak FLOPS	1.97 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 06:55:25 (5444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:43:38 (2404): No heartbeat from core client for 30 sec - exiting 15:43:39 (2404): No heartbeat from core client for 30 sec - exiting 15:43:40 (2404): No heartbeat from core client for 30 sec - exiting 15:43:41 (2404): No heartbeat from core client for 30 sec - exiting 15:43:42 (2404): No heartbeat from core client for 30 sec - exiting 15:43:43 (2404): No heartbeat from core client for 30 sec - exiting 15:43:44 (2404): No heartbeat from core client for 30 sec - exiting 15:43:45 (2404): No heartbeat from core client for 30 sec - exiting 15:43:46 (2404): No heartbeat from core client for 30 sec - exiting 15:43:47 (2404): No heartbeat from core client for 30 sec - exiting 15:43:48 (2404): No heartbeat from core client for 30 sec - exiting 15:43:49 (2404): No heartbeat from core client for 30 sec - exiting 15:43:50 (2404): No heartbeat from core client for 30 sec - exiting 15:43:51 (2404): No heartbeat from core client for 30 sec - exiting 15:43:52 (2404): No heartbeat from core client for 30 sec - exiting 15:43:54 (2404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:41:18 (7864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:42:29 (4252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:52:16 (7360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:18:21 (6920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:18:22 (6920): No heartbeat from core client for 30 sec - exiting 02:19:04 (5116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:55:03 (4496): No heartbeat from core client for 30 sec - exiting 09:55:05 (4496): No heartbeat from core client for 30 sec - exiting 09:55:06 (4496): No heartbeat from core client for 30 sec - exiting 09:55:06 (4496): No heartbeat from core client for 30 sec - exiting 09:55:07 (4496): No heartbeat from core client for 30 sec - exiting 09:55:08 (4496): No heartbeat from core client for 30 sec - exiting 09:55:09 (4496): No heartbeat from core client for 30 sec - exiting 09:55:11 (4496): No heartbeat from core client for 30 sec - exiting 09:55:12 (4496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7904, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6228, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6228, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6228, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6228, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6228, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Apr 2011 17:17:53	1141734	12745904	hadcm3n_o5ex_1900_40_007202348_1	181,440	585,086	3.2247
08 Apr 2011 22:57:02	1141734	12745904	hadcm3n_o5ex_1900_40_007202348_1	155,520	503,866	3.2399
07 Apr 2011 08:49:50	1141734	12745904	hadcm3n_o5ex_1900_40_007202348_1	129,600	422,202	3.2577
05 Apr 2011 15:36:24	1141734	12745904	hadcm3n_o5ex_1900_40_007202348_1	103,680	340,146	3.2807
03 Apr 2011 05:58:53	1141734	12745904	hadcm3n_o5ex_1900_40_007202348_1	77,760	253,638	3.2618
01 Apr 2011 22:16:52	1141734	12745904	hadcm3n_o5ex_1900_40_007202348_1	51,840	168,663	3.2535
31 Mar 2011 12:47:32	1141734	12745904	hadcm3n_o5ex_1900_40_007202348_1	25,920	83,471	3.2203