Task 12993394

Name	hadcm3n_s5ss_1940_40_007301161_0
Workunit	7498585
Created	21 Jun 2011, 2:30:55 UTC
Sent	21 Jun 2011, 2:32:47 UTC
Report deadline	20 Sep 2011, 9:59:58 UTC
Received	1 Jul 2011, 17:45:47 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1090356
Run time	3 days 1 hours 12 min 8 sec
CPU time	2 days 14 hours 59 min 53 sec
Validate state	Invalid
Credit	2,799.36
Device peak FLOPS	3.32 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.26</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 06:08:56 (2628): No heartbeat from core client for 30 sec - exiting 06:08:57 (2628): No heartbeat from core client for 30 sec - exiting 06:08:58 (2628): No heartbeat from core client for 30 sec - exiting 06:09:00 (2628): No heartbeat from core client for 30 sec - exiting 06:09:01 (2628): No heartbeat from core client for 30 sec - exiting 06:09:02 (2628): No heartbeat from core client for 30 sec - exiting 06:09:03 (2628): No heartbeat from core client for 30 sec - exiting 06:09:04 (2628): No heartbeat from core client for 30 sec - exiting 06:09:05 (2628): No heartbeat from core client for 30 sec - exiting 06:09:06 (2628): No heartbeat from core client for 30 sec - exiting 06:09:07 (2628): No heartbeat from core client for 30 sec - exiting 06:09:08 (2628): No heartbeat from core client for 30 sec - exiting 06:09:09 (2628): No heartbeat from core client for 30 sec - exiting 06:09:10 (2628): No heartbeat from core client for 30 sec - exiting 06:09:12 (2628): No heartbeat from core client for 30 sec - exiting 06:09:13 (2628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:15:39 (4188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:15:41 (4188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 01:14:30 (5760): No heartbeat from core client for 30 sec - exiting 01:14:31 (5760): No heartbeat from core client for 30 sec - exiting 01:14:32 (5760): No heartbeat from core client for 30 sec - exiting 01:14:33 (5760): No heartbeat from core client for 30 sec - exiting 01:14:34 (5760): No heartbeat from core client for 30 sec - exiting 01:14:35 (5760): No heartbeat from core client for 30 sec - exiting 01:14:36 (5760): No heartbeat from core client for 30 sec - exiting 01:14:37 (5760): No heartbeat from core client for 30 sec - exiting 01:14:39 (5760): No heartbeat from core client for 30 sec - exiting 01:14:40 (5760): No heartbeat from core client for 30 sec - exiting 01:14:41 (5760): No heartbeat from core client for 30 sec - exiting 01:14:42 (5760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:14:43 (5760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:21:07 (4288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4172, iMonCtr=1 Model crash detected, will try to restart... 09:10:21 (4372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Jul 2011 17:27:08	1090356	12993394	hadcm3n_s5ss_1940_40_007301161_0	233,280	252,178	1.0810
01 Jul 2011 10:19:22	1090356	12993394	hadcm3n_s5ss_1940_40_007301161_0	207,360	229,241	1.1055
30 Jun 2011 00:31:23	1090356	12993394	hadcm3n_s5ss_1940_40_007301161_0	181,440	205,636	1.1334
29 Jun 2011 20:09:26	1090356	12993394	hadcm3n_s5ss_1940_40_007301161_0	155,520	181,800	1.1690
29 Jun 2011 06:19:39	1090356	12993394	hadcm3n_s5ss_1940_40_007301161_0	129,600	157,942	1.2187
25 Jun 2011 02:29:57	1090356	12993394	hadcm3n_s5ss_1940_40_007301161_0	103,680	132,835	1.2812
23 Jun 2011 18:04:53	1090356	12993394	hadcm3n_s5ss_1940_40_007301161_0	77,760	99,219	1.2760
23 Jun 2011 08:57:32	1090356	12993394	hadcm3n_s5ss_1940_40_007301161_0	51,840	67,516	1.3024
21 Jun 2011 20:40:47	1090356	12993394	hadcm3n_s5ss_1940_40_007301161_0	25,920	34,868	1.3452