Task 13468737

Name	hadcm3n_o420_1940_40_007446236_4
Workunit	7643739
Created	10 Oct 2011, 8:40:46 UTC
Sent	10 Oct 2011, 8:40:51 UTC
Report deadline	9 Jan 2012, 16:08:02 UTC
Received	28 Oct 2011, 16:06:52 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1017617
Run time	4 days 3 hours 1 min 42 sec
CPU time	3 days 19 hours 23 min 58 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.14 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:41:39 (1688): No heartbeat from core client for 30 sec - exiting 10:41:42 (1688): No heartbeat from core client for 30 sec - exiting 10:41:43 (1688): No heartbeat from core client for 30 sec - exiting 10:41:44 (1688): No heartbeat from core client for 30 sec - exiting 10:41:45 (1688): No heartbeat from core client for 30 sec - exiting 10:41:46 (1688): No heartbeat from core client for 30 sec - exiting 10:41:47 (1688): No heartbeat from core client for 30 sec - exiting 10:41:48 (1688): No heartbeat from core client for 30 sec - exiting 10:41:49 (1688): No heartbeat from core client for 30 sec - exiting 10:41:50 (1688): No heartbeat from core client for 30 sec - exiting 10:41:52 (1688): No heartbeat from core client for 30 sec - exiting 10:41:53 (1688): No heartbeat from core client for 30 sec - exiting 10:41:54 (1688): No heartbeat from core client for 30 sec - exiting 10:41:55 (1688): No heartbeat from core client for 30 sec - exiting 10:41:56 (1688): No heartbeat from core client for 30 sec - exiting 10:41:57 (1688): No heartbeat from core client for 30 sec - exiting 10:41:58 (1688): No heartbeat from core client for 30 sec - exiting 10:41:59 (1688): No heartbeat from core client for 30 sec - exiting 10:42:00 (1688): No heartbeat from core client for 30 sec - exiting 10:42:01 (1688): No heartbeat from core client for 30 sec - exiting 10:42:02 (1688): No heartbeat from core client for 30 sec - exiting 10:42:04 (1688): No heartbeat from core client for 30 sec - exiting 10:42:05 (1688): No heartbeat from core client for 30 sec - exiting 10:42:06 (1688): No heartbeat from core client for 30 sec - exiting 10:42:07 (1688): No heartbeat from core client for 30 sec - exiting 10:42:08 (1688): No heartbeat from core client for 30 sec - exiting 10:42:09 (1688): No heartbeat from core client for 30 sec - exiting 10:42:10 (1688): No heartbeat from core client for 30 sec - exiting 10:42:11 (1688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4456, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5776, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5776, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 08:03:29 (4492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5632, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5632, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5632, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Oct 2011 15:11:44	1017617	13468737	hadcm3n_o420_1940_40_007446236_4	259,200	325,221	1.2547
31 Oct 2011 14:10:25	1017617	13468737	hadcm3n_o420_1940_40_007446236_4	233,280	292,611	1.2543
31 Oct 2011 14:10:25	1017617	13468737	hadcm3n_o420_1940_40_007446236_4	207,360	260,510	1.2563
31 Oct 2011 14:10:25	1017617	13468737	hadcm3n_o420_1940_40_007446236_4	181,440	228,135	1.2574
31 Oct 2011 14:10:25	1017617	13468737	hadcm3n_o420_1940_40_007446236_4	155,520	195,795	1.2590
31 Oct 2011 14:10:24	1017617	13468737	hadcm3n_o420_1940_40_007446236_4	129,600	163,401	1.2608
18 Oct 2011 12:26:41	1017617	13468737	hadcm3n_o420_1940_40_007446236_4	103,680	130,539	1.2591
14 Oct 2011 07:22:57	1017617	13468737	hadcm3n_o420_1940_40_007446236_4	77,760	97,226	1.2503
12 Oct 2011 20:18:30	1017617	13468737	hadcm3n_o420_1940_40_007446236_4	51,840	64,800	1.2500
11 Oct 2011 17:00:15	1017617	13468737	hadcm3n_o420_1940_40_007446236_4	25,920	32,471	1.2527