Task 16465215

Name	hadam3p_anz_p1i9_2012_1_008632624_0
Workunit	8779136
Created	3 Apr 2014, 9:42:26 UTC
Sent	11 Apr 2014, 13:00:57 UTC
Report deadline	24 Mar 2015, 18:20:57 UTC
Received	3 May 2014, 6:13:51 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1258442
Run time	6 days 7 hours 41 min 50 sec
CPU time	6 days 4 hours 20 min 40 sec
Validate state	Invalid
Credit	4,981.10
Device peak FLOPS	3.04 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:33:56 (7140): No heartbeat from core client for 30 sec - exiting 02:33:57 (7140): No heartbeat from core client for 30 sec - exiting 02:33:58 (7140): No heartbeat from core client for 30 sec - exiting 02:33:59 (7140): No heartbeat from core client for 30 sec - exiting 02:34:00 (7140): No heartbeat from core client for 30 sec - exiting 02:34:01 (7140): No heartbeat from core client for 30 sec - exiting 02:34:02 (7140): No heartbeat from core client for 30 sec - exiting 02:34:03 (7140): No heartbeat from core client for 30 sec - exiting 02:34:05 (7140): No heartbeat from core client for 30 sec - exiting 02:34:06 (7140): No heartbeat from core client for 30 sec - exiting 02:34:07 (7140): No heartbeat from core client for 30 sec - exiting 02:34:08 (7140): No heartbeat from core client for 30 sec - exiting 02:34:09 (7140): No heartbeat from core client for 30 sec - exiting 02:34:10 (7140): No heartbeat from core client for 30 sec - exiting 02:34:11 (7140): No heartbeat from core client for 30 sec - exiting 02:34:12 (7140): No heartbeat from core client for 30 sec - exiting 02:34:13 (7140): No heartbeat from core client for 30 sec - exiting 02:34:14 (7140): No heartbeat from core client for 30 sec - exiting 02:34:15 (7140): No heartbeat from core client for 30 sec - exiting 02:34:17 (7140): No heartbeat from core client for 30 sec - exiting 02:34:18 (7140): No heartbeat from core client for 30 sec - exiting 02:34:19 (7140): No heartbeat from core client for 30 sec - exiting 02:34:20 (7140): No heartbeat from core client for 30 sec - exiting 02:34:21 (7140): No heartbeat from core client for 30 sec - exiting 02:34:22 (7140): No heartbeat from core client for 30 sec - exiting 02:34:23 (7140): No heartbeat from core client for 30 sec - exiting 02:34:24 (7140): No heartbeat from core client for 30 sec - exiting 02:34:25 (7140): No heartbeat from core client for 30 sec - exiting 02:34:26 (7140): No heartbeat from core client for 30 sec - exiting 02:34:27 (7140): No heartbeat from core client for 30 sec - exiting 02:34:29 (7140): No heartbeat from core client for 30 sec - exiting 02:34:30 (7140): No heartbeat from core client for 30 sec - exiting 02:34:31 (7140): No heartbeat from core client for 30 sec - exiting 02:34:32 (7140): No heartbeat from core client for 30 sec - exiting 02:34:33 (7140): No heartbeat from core client for 30 sec - exiting 02:34:34 (7140): No heartbeat from core client for 30 sec - exiting 02:34:35 (7140): No heartbeat from core client for 30 sec - exiting 02:34:36 (7140): No heartbeat from core client for 30 sec - exiting 02:34:37 (7140): No heartbeat from core client for 30 sec - exiting 02:34:38 (7140): No heartbeat from core client for 30 sec - exiting 02:34:39 (7140): No heartbeat from core client for 30 sec - exiting 02:34:41 (7140): No heartbeat from core client for 30 sec - exiting 02:34:42 (7140): No heartbeat from core client for 30 sec - exiting 02:34:43 (7140): No heartbeat from core client for 30 sec - exiting 02:34:44 (7140): No heartbeat from core client for 30 sec - exiting 02:34:45 (7140): No heartbeat from core client for 30 sec - exiting 02:34:46 (7140): No heartbeat from core client for 30 sec - exiting 02:34:47 (7140): No heartbeat from core client for 30 sec - exiting 02:34:48 (7140): No heartbeat from core client for 30 sec - exiting 02:34:49 (7140): No heartbeat from core client for 30 sec - exiting 02:34:50 (7140): No heartbeat from core client for 30 sec - exiting 02:34:51 (7140): No heartbeat from core client for 30 sec - exiting 02:34:53 (7140): No heartbeat from core client for 30 sec - exiting 02:34:54 (7140): No heartbeat from core client for 30 sec - exiting 02:34:55 (7140): No heartbeat from core client for 30 sec - exiting 02:34:56 (7140): No heartbeat from core client for 30 sec - exiting 02:34:57 (7140): No heartbeat from core client for 30 sec - exiting 02:34:58 (7140): No heartbeat from core client for 30 sec - exiting 02:34:59 (7140): No heartbeat from core client for 30 sec - exiting 02:35:00 (7140): No heartbeat from core client for 30 sec - exiting 02:35:01 (7140): No heartbeat from core client for 30 sec - exiting 02:35:02 (7140): No heartbeat from core client for 30 sec - exiting 02:35:04 (7140): No heartbeat from core client for 30 sec - exiting 02:35:05 (7140): No heartbeat from core client for 30 sec - exiting 02:35:06 (7140): No heartbeat from core client for 30 sec - exiting 02:35:07 (7140): No heartbeat from core client for 30 sec - exiting 02:35:08 (7140): No heartbeat from core client for 30 sec - exiting 02:35:09 (7140): No heartbeat from core client for 30 sec - exiting 02:35:10 (7140): No heartbeat from core client for 30 sec - exiting 02:35:11 (7140): No heartbeat from core client for 30 sec - exiting 02:35:12 (7140): No heartbeat from core client for 30 sec - exiting 02:35:13 (7140): No heartbeat from core client for 30 sec - exiting 02:35:14 (7140): No heartbeat from core client for 30 sec - exiting 02:35:16 (7140): No heartbeat from core client for 30 sec - exiting 02:35:49 (7140): No heartbeat from core client for 30 sec - exiting 02:35:50 (7140): No heartbeat from core client for 30 sec - exiting 02:35:52 (7140): No heartbeat from core client for 30 sec - exiting 02:35:53 (7140): No heartbeat from core client for 30 sec - exiting 02:35:54 (7140): No heartbeat from core client for 30 sec - exiting 02:35:55 (7140): No heartbeat from core client for 30 sec - exiting 02:35:56 (7140): No heartbeat from core client for 30 sec - exiting 02:35:57 (7140): No heartbeat from core client for 30 sec - exiting 02:35:58 (7140): No heartbeat from core client for 30 sec - exiting 02:35:59 (7140): No heartbeat from core client for 30 sec - exiting 02:36:00 (7140): No heartbeat from core client for 30 sec - exiting 02:36:01 (7140): No heartbeat from core client for 30 sec - exiting 02:36:02 (7140): No heartbeat from core client for 30 sec - exiting 02:36:04 (7140): No heartbeat from core client for 30 sec - exiting 02:36:05 (7140): No heartbeat from core client for 30 sec - exiting 02:36:06 (7140): No heartbeat from core client for 30 sec - exiting 02:36:07 (7140): No heartbeat from core client for 30 sec - exiting 02:36:08 (7140): No heartbeat from core client for 30 sec - exiting 02:36:09 (7140): No heartbeat from core client for 30 sec - exiting 02:36:10 (7140): No heartbeat from core client for 30 sec - exiting 02:36:11 (7140): No heartbeat from core client for 30 sec - exiting 02:36:12 (7140): No heartbeat from core client for 30 sec - exiting 02:36:13 (7140): No heartbeat from core client for 30 sec - exiting 02:36:14 (7140): No heartbeat from core client for 30 sec - exiting 02:36:16 (7140): No heartbeat from core client for 30 sec - exiting 02:36:17 (7140): No heartbeat from core client for 30 sec - exiting 02:36:18 (7140): No heartbeat from core client for 30 sec - exiting 02:36:19 (7140): No heartbeat from core client for 30 sec - exiting 02:36:20 (7140): No heartbeat from core client for 30 sec - exiting 02:36:21 (7140): No heartbeat from core client for 30 sec - exiting 02:36:55 (7140): No heartbeat from core client for 30 sec - exiting 02:36:56 (7140): No heartbeat from core client for 30 sec - exiting 02:36:57 (7140): No heartbeat from core client for 30 sec - exiting 02:36:58 (7140): No heartbeat from core client for 30 sec - exiting 02:36:59 (7140): No heartbeat from core client for 30 sec - exiting 02:37:00 (7140): No heartbeat from core client for 30 sec - exiting 02:37:01 (7140): No heartbeat from core client for 30 sec - exiting 02:37:03 (7140): No heartbeat from core client for 30 sec - exiting 02:37:04 (7140): No heartbeat from core client for 30 sec - exiting 02:37:05 (7140): No heartbeat from core client for 30 sec - exiting 02:37:06 (7140): No heartbeat from core client for 30 sec - exiting 02:37:07 (7140): No heartbeat from core client for 30 sec - exiting 02:37:08 (7140): No heartbeat from core client for 30 sec - exiting 02:37:09 (7140): No heartbeat from core client for 30 sec - exiting 02:37:10 (7140): No heartbeat from core client for 30 sec - exiting 02:37:11 (7140): No heartbeat from core client for 30 sec - exiting 02:37:12 (7140): No heartbeat from core client for 30 sec - exiting 02:37:13 (7140): No heartbeat from core client for 30 sec - exiting 02:37:15 (7140): No heartbeat from core client for 30 sec - exiting 02:37:16 (7140): No heartbeat from core client for 30 sec - exiting 02:37:17 (7140): No heartbeat from core client for 30 sec - exiting 02:37:18 (7140): No heartbeat from core client for 30 sec - exiting 02:37:19 (7140): No heartbeat from core client for 30 sec - exiting 02:37:20 (7140): No heartbeat from core client for 30 sec - exiting 02:37:21 (7140): No heartbeat from core client for 30 sec - exiting 02:37:22 (7140): No heartbeat from core client for 30 sec - exiting 02:37:23 (7140): No heartbeat from core client for 30 sec - exiting 02:37:24 (7140): No heartbeat from core client for 30 sec - exiting 02:37:25 (7140): No heartbeat from core client for 30 sec - exiting 02:37:27 (7140): No heartbeat from core client for 30 sec - exiting 02:37:28 (7140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:48:46 (6284): No heartbeat from core client for 30 sec - exiting 06:48:47 (6284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:28:31 (240): No heartbeat from core client for 30 sec - exiting 23:28:32 (240): No heartbeat from core client for 30 sec - exiting 23:28:33 (240): No heartbeat from core client for 30 sec - exiting 23:28:34 (240): No heartbeat from core client for 30 sec - exiting 23:28:35 (240): No heartbeat from core client for 30 sec - exiting 23:28:37 (240): No heartbeat from core client for 30 sec - exiting 23:28:38 (240): No heartbeat from core client for 30 sec - exiting 23:28:39 (240): No heartbeat from core client for 30 sec - exiting 23:28:40 (240): No heartbeat from core client for 30 sec - exiting 23:28:41 (240): No heartbeat from core client for 30 sec - exiting 23:28:42 (240): No heartbeat from core client for 30 sec - exiting 23:28:43 (240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:53:08 (8528): No heartbeat from core client for 30 sec - exiting 22:53:09 (8528): No heartbeat from core client for 30 sec - exiting 22:53:10 (8528): No heartbeat from core client for 30 sec - exiting 22:53:11 (8528): No heartbeat from core client for 30 sec - exiting 22:53:12 (8528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:58:18 (2656): No heartbeat from core client for 30 sec - exiting 17:58:19 (2656): No heartbeat from core client for 30 sec - exiting 17:58:20 (2656): No heartbeat from core client for 30 sec - exiting 17:58:21 (2656): No heartbeat from core client for 30 sec - exiting 17:58:22 (2656): No heartbeat from core client for 30 sec - exiting 17:58:23 (2656): No heartbeat from core client for 30 sec - exiting 17:58:24 (2656): No heartbeat from core client for 30 sec - exiting 17:58:25 (2656): No heartbeat from core client for 30 sec - exiting 17:58:27 (2656): No heartbeat from core client for 30 sec - exiting 17:58:28 (2656): No heartbeat from core client for 30 sec - exiting 17:58:29 (2656): No heartbeat from core client for 30 sec - exiting 17:58:30 (2656): No heartbeat from core client for 30 sec - exiting 17:58:31 (2656): No heartbeat from core client for 30 sec - exiting 17:58:32 (2656): No heartbeat from core client for 30 sec - exiting 17:58:33 (2656): No heartbeat from core client for 30 sec - exiting 17:58:34 (2656): No heartbeat from core client for 30 sec - exiting 17:58:35 (2656): No heartbeat from core client for 30 sec - exiting 17:58:36 (2656): No heartbeat from core client for 30 sec - exiting 17:58:37 (2656): No heartbeat from core client for 30 sec - exiting 17:58:39 (2656): No heartbeat from core client for 30 sec - exiting 17:58:40 (2656): No heartbeat from core client for 30 sec - exiting 17:58:41 (2656): No heartbeat from core client for 30 sec - exiting 17:58:42 (2656): No heartbeat from core client for 30 sec - exiting 17:58:43 (2656): No heartbeat from core client for 30 sec - exiting 17:58:44 (2656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:44:08 (7184): No heartbeat from core client for 30 sec - exiting 23:44:09 (7184): No heartbeat from core client for 30 sec - exiting 23:44:10 (7184): No heartbeat from core client for 30 sec - exiting 23:44:11 (7184): No heartbeat from core client for 30 sec - exiting 23:44:12 (7184): No heartbeat from core client for 30 sec - exiting 23:44:13 (7184): No heartbeat from core client for 30 sec - exiting 23:44:14 (7184): No heartbeat from core client for 30 sec - exiting 23:44:15 (7184): No heartbeat from core client for 30 sec - exiting 23:44:16 (7184): No heartbeat from core client for 30 sec - exiting 23:44:17 (7184): No heartbeat from core client for 30 sec - exiting 23:44:19 (7184): No heartbeat from core client for 30 sec - exiting 23:44:20 (7184): No heartbeat from core client for 30 sec - exiting 23:44:21 (7184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:16:24 (3956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:35:46 (7952): No heartbeat from core client for 30 sec - exiting 18:35:47 (7952): No heartbeat from core client for 30 sec - exiting 18:35:48 (7952): No heartbeat from core client for 30 sec - exiting 18:35:49 (7952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3208, selfPID=3208, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5924, selfPID=6188, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_p1i9_2012_1_008632624_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_p1i9_2012_1_008632624_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Apr 2014 15:01:46	1258442	16465215	hadam3p_anz_p1i9_2012_1_008632624_0	115,499	491,375	4.2544
25 Apr 2014 06:55:31	1258442	16465215	hadam3p_anz_p1i9_2012_1_008632624_0	103,979	442,589	4.2565
23 Apr 2014 12:58:09	1258442	16465215	hadam3p_anz_p1i9_2012_1_008632624_0	92,459	393,917	4.2605
22 Apr 2014 06:35:19	1258442	16465215	hadam3p_anz_p1i9_2012_1_008632624_0	80,939	344,481	4.2561
20 Apr 2014 12:03:40	1258442	16465215	hadam3p_anz_p1i9_2012_1_008632624_0	69,419	295,241	4.2530
19 Apr 2014 22:00:18	1258442	16465215	hadam3p_anz_p1i9_2012_1_008632624_0	57,899	246,652	4.2600
19 Apr 2014 06:04:04	1258442	16465215	hadam3p_anz_p1i9_2012_1_008632624_0	46,379	197,926	4.2676
17 Apr 2014 12:55:29	1258442	16465215	hadam3p_anz_p1i9_2012_1_008632624_0	34,859	149,493	4.2885
16 Apr 2014 07:20:25	1258442	16465215	hadam3p_anz_p1i9_2012_1_008632624_0	23,339	99,615	4.2682
13 Apr 2014 10:46:36	1258442	16465215	hadam3p_anz_p1i9_2012_1_008632624_0	11,819	49,641	4.2001