Task 15845564

Name	hadcm3n_4cut_1940_40_008302193_2
Workunit	8453328
Created	17 Jun 2013, 1:32:19 UTC
Sent	17 Jun 2013, 2:16:46 UTC
Report deadline	16 Sep 2013, 9:43:57 UTC
Received	2 Mar 2014, 10:03:38 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1246862
Run time	27 days 10 hours 25 min 57 sec
CPU time	27 days 10 hours 25 min 57 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.82 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>5.10.30</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:09:22 (9904): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 10:09:23 (9904): No heartbeat from core client for 30 sec - exiting 10:09:24 (9904): No heartbeat from core client for 30 sec - exiting 10:09:25 (9904): No heartbeat from core client for 30 sec - exiting 10:09:26 (9904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:39:21 (10284): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 09:39:23 (10284): No heartbeat from core client for 30 sec - exiting 09:39:24 (10284): No heartbeat from core client for 30 sec - exiting 09:39:25 (10284): No heartbeat from core client for 30 sec - exiting 09:39:26 (10284): No heartbeat from core client for 30 sec - exiting 09:39:27 (10284): No heartbeat from core client for 30 sec - exiting 09:39:28 (10284): No heartbeat from core client for 30 sec - exiting 09:39:29 (10284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7300, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7742FF6B write attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8124, selfPID=8124, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x775EFF6B write attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:31:10 (8216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:08:57 (388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:21 (7204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:56:24 (9148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:27:08 (4016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:38:00 (4288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:15:00 (8056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:00:01 (1356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:12:42 (7520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:24:04 (7896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:46:05 (1584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:52:02 (5364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:53:16 (6468): No heartbeat from core client for 30 sec - exiting 21:53:17 (6468): No heartbeat from core client for 30 sec - exiting 21:53:19 (6468): No heartbeat from core client for 30 sec - exiting 21:53:20 (6468): No heartbeat from core client for 30 sec - exiting 21:53:21 (6468): No heartbeat from core client for 30 sec - exiting 21:53:22 (6468): No heartbeat from core client for 30 sec - exiting 21:53:23 (6468): No heartbeat from core client for 30 sec - exiting 21:53:24 (6468): No heartbeat from core client for 30 sec - exiting 21:53:25 (6468): No heartbeat from core client for 30 sec - exiting 21:53:26 (6468): No heartbeat from core client for 30 sec - exiting 21:53:27 (6468): No heartbeat from core client for 30 sec - exiting 21:53:28 (6468): No heartbeat from core client for 30 sec - exiting 21:53:29 (6468): No heartbeat from core client for 30 sec - exiting 21:53:31 (6468): No heartbeat from core client for 30 sec - exiting 21:53:32 (6468): No heartbeat from core client for 30 sec - exiting 21:53:33 (6468): No heartbeat from core client for 30 sec - exiting 21:53:34 (6468): No heartbeat from core client for 30 sec - exiting 21:53:35 (6468): No heartbeat from core client for 30 sec - exiting 21:53:36 (6468): No heartbeat from core client for 30 sec - exiting 21:53:37 (6468): No heartbeat from core client for 30 sec - exiting 21:53:38 (6468): No heartbeat from core client for 30 sec - exiting 21:53:39 (6468): No heartbeat from core client for 30 sec - exiting 21:53:40 (6468): No heartbeat from core client for 30 sec - exiting 21:53:41 (6468): No heartbeat from core client for 30 sec - exiting 21:53:43 (6468): No heartbeat from core client for 30 sec - exiting 21:53:44 (6468): No heartbeat from core client for 30 sec - exiting 21:53:45 (6468): No heartbeat from core client for 30 sec - exiting 21:53:46 (6468): No heartbeat from core client for 30 sec - exiting 21:53:47 (6468): No heartbeat from core client for 30 sec - exiting 21:53:48 (6468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:53:02 (6768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:12:29 (7700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:26:46 (2160): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 19:26:48 (2160): No heartbeat from core client for 30 sec - exiting 19:26:49 (2160): No heartbeat from core client for 30 sec - exiting 19:26:50 (2160): No heartbeat from core client for 30 sec - exiting 19:26:51 (2160): No heartbeat from core client for 30 sec - exiting 19:26:52 (2160): No heartbeat from core client for 30 sec - exiting 19:26:53 (2160): No heartbeat from core client for 30 sec - exiting 19:26:54 (2160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:08:10 (5712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:22:27 (8024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadcm3n_4cut_1940_40_008302193_2_2.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Mar 2014 10:08:05	1246862	15845564	hadcm3n_4cut_1940_40_008302193_2	1,036,800	2,369,433	2.2853
18 Feb 2014 12:03:00	1246862	15845564	hadcm3n_4cut_1940_40_008302193_2	1,010,880	2,303,846	2.2790
10 Feb 2014 21:33:54	1246862	15845564	hadcm3n_4cut_1940_40_008302193_2	984,960	2,236,087	2.2702
10 Feb 2014 02:31:02	1246862	15845564	hadcm3n_4cut_1940_40_008302193_2	959,040	2,170,411	2.2631
04 Feb 2014 03:58:16	1246862	15845564	hadcm3n_4cut_1940_40_008302193_2	933,120	2,106,283	2.2572
02 Feb 2014 13:24:18	1246862	15845564	hadcm3n_4cut_1940_40_008302193_2	907,200	2,048,390	2.2579
26 Jan 2014 01:35:44	1246862	15845564	hadcm3n_4cut_1940_40_008302193_2	881,280	1,987,481	2.2552
19 Jan 2014 22:38:10	1246862	15845564	hadcm3n_4cut_1940_40_008302193_2	855,360	1,917,787	2.2421
18 Jan 2014 12:18:05	1246862	15845564	hadcm3n_4cut_1940_40_008302193_2	829,440	1,851,889	2.2327
14 Jan 2014 02:11:57	1246862	15845564	hadcm3n_4cut_1940_40_008302193_2	803,520	1,793,988	2.2327
07 Jan 2014 02:01:14	1246862	15845564	hadcm3n_4cut_1940_40_008302193_2	777,600	1,731,524	2.2268
02 Jan 2014 20:42:42	1246862	15845564	hadcm3n_4cut_1940_40_008302193_2	751,680	1,667,660	2.2186
21 Dec 2013 14:21:39	1246862	15845564	hadcm3n_4cut_1940_40_008302193_2	725,760	1,605,762	2.2125
15 Dec 2013 18:19:32	1246862	15845564	hadcm3n_4cut_1940_40_008302193_2	699,840	1,546,419	2.2097
11 Dec 2013 16:09:37	1246862	15845564	hadcm3n_4cut_1940_40_008302193_2	673,920	1,485,087	2.2037
03 Dec 2013 02:47:26	1246862	15845564	hadcm3n_4cut_1940_40_008302193_2	648,000	1,422,929	2.1959
25 Nov 2013 01:19:24	1246862	15845564	hadcm3n_4cut_1940_40_008302193_2	622,080	1,363,034	2.1911
17 Nov 2013 03:07:29	1246862	15845564	hadcm3n_4cut_1940_40_008302193_2	596,160	1,301,681	2.1834
12 Nov 2013 04:00:46	1246862	15845564	hadcm3n_4cut_1940_40_008302193_2	570,240	1,238,650	2.1722
22 Oct 2013 01:35:10	1246862	15845564	hadcm3n_4cut_1940_40_008302193_2	544,320	1,182,493	2.1724