Task 18334565

Name	hadam3p_anz_e3rp_2013_1_009760698_0
Workunit	9831736
Created	20 Apr 2015, 22:33:33 UTC
Sent	22 Apr 2015, 18:00:05 UTC
Report deadline	3 Apr 2016, 23:20:05 UTC
Received	25 May 2015, 18:05:29 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	493442
Run time	14 hours 6 min 57 sec
CPU time	13 hours 16 min 18 sec
Validate state	Invalid
Credit	509.72
Device peak FLOPS	4.04 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:08:03 (139036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:08:05 (139036): No heartbeat from core client for 30 sec - exiting 00:08:06 (139036): No heartbeat from core client for 30 sec - exiting 00:11:50 (139380): No heartbeat from core client for 30 sec - exiting 00:11:53 (139380): No heartbeat from core client for 30 sec - exiting 00:11:54 (139380): No heartbeat from core client for 30 sec - exiting 00:11:55 (139380): No heartbeat from core client for 30 sec - exiting 00:11:56 (139380): No heartbeat from core client for 30 sec - exiting 00:11:57 (139380): No heartbeat from core client for 30 sec - exiting 00:11:58 (139380): No heartbeat from core client for 30 sec - exiting 00:11:59 (139380): No heartbeat from core client for 30 sec - exiting 00:12:00 (139380): No heartbeat from core client for 30 sec - exiting 00:12:01 (139380): No heartbeat from core client for 30 sec - exiting 00:12:02 (139380): No heartbeat from core client for 30 sec - exiting 00:12:03 (139380): No heartbeat from core client for 30 sec - exiting 00:12:04 (139380): No heartbeat from core client for 30 sec - exiting 00:12:05 (139380): No heartbeat from core client for 30 sec - exiting 00:12:06 (139380): No heartbeat from core client for 30 sec - exiting 00:12:07 (139380): No heartbeat from core client for 30 sec - exiting 00:12:08 (139380): No heartbeat from core client for 30 sec - exiting 00:12:09 (139380): No heartbeat from core client for 30 sec - exiting 00:12:10 (139380): No heartbeat from core client for 30 sec - exiting 00:12:11 (139380): No heartbeat from core client for 30 sec - exiting 00:12:12 (139380): No heartbeat from core client for 30 sec - exiting 00:12:13 (139380): No heartbeat from core client for 30 sec - exiting 00:12:14 (139380): No heartbeat from core client for 30 sec - exiting 00:12:15 (139380): No heartbeat from core client for 30 sec - exiting 00:12:16 (139380): No heartbeat from core client for 30 sec - exiting 00:12:17 (139380): No heartbeat from core client for 30 sec - exiting 00:12:18 (139380): No heartbeat from core client for 30 sec - exiting 00:12:19 (139380): No heartbeat from core client for 30 sec - exiting 00:12:20 (139380): No heartbeat from core client for 30 sec - exiting 00:12:21 (139380): No heartbeat from core client for 30 sec - exiting 00:12:22 (139380): No heartbeat from core client for 30 sec - exiting 00:12:23 (139380): No heartbeat from core client for 30 sec - exiting 00:12:24 (139380): No heartbeat from core client for 30 sec - exiting 00:12:25 (139380): No heartbeat from core client for 30 sec - exiting 00:12:26 (139380): No heartbeat from core client for 30 sec - exiting 00:12:27 (139380): No heartbeat from core client for 30 sec - exiting 00:12:28 (139380): No heartbeat from core client for 30 sec - exiting 00:12:29 (139380): No heartbeat from core client for 30 sec - exiting 00:12:30 (139380): No heartbeat from core client for 30 sec - exiting 00:12:31 (139380): No heartbeat from core client for 30 sec - exiting 00:12:32 (139380): No heartbeat from core client for 30 sec - exiting 00:12:33 (139380): No heartbeat from core client for 30 sec - exiting 00:12:34 (139380): No heartbeat from core client for 30 sec - exiting 00:12:35 (139380): No heartbeat from core client for 30 sec - exiting 00:12:36 (139380): No heartbeat from core client for 30 sec - exiting 00:12:37 (139380): No heartbeat from core client for 30 sec - exiting 00:12:38 (139380): No heartbeat from core client for 30 sec - exiting 00:12:39 (139380): No heartbeat from core client for 30 sec - exiting 00:12:40 (139380): No heartbeat from core client for 30 sec - exiting 00:12:41 (139380): No heartbeat from core client for 30 sec - exiting 00:12:42 (139380): No heartbeat from core client for 30 sec - exiting 00:12:43 (139380): No heartbeat from core client for 30 sec - exiting 00:12:44 (139380): No heartbeat from core client for 30 sec - exiting 00:12:45 (139380): No heartbeat from core client for 30 sec - exiting 00:12:46 (139380): No heartbeat from core client for 30 sec - exiting 00:12:47 (139380): No heartbeat from core client for 30 sec - exiting 00:12:48 (139380): No heartbeat from core client for 30 sec - exiting 00:12:49 (139380): No heartbeat from core client for 30 sec - exiting 00:12:50 (139380): No heartbeat from core client for 30 sec - exiting 00:12:51 (139380): No heartbeat from core client for 30 sec - exiting 00:12:52 (139380): No heartbeat from core client for 30 sec - exiting 00:12:53 (139380): No heartbeat from core client for 30 sec - exiting 00:12:54 (139380): No heartbeat from core client for 30 sec - exiting 00:12:55 (139380): No heartbeat from core client for 30 sec - exiting 00:12:56 (139380): No heartbeat from core client for 30 sec - exiting 00:12:57 (139380): No heartbeat from core client for 30 sec - exiting 00:12:58 (139380): No heartbeat from core client for 30 sec - exiting 00:12:59 (139380): No heartbeat from core client for 30 sec - exiting 00:13:00 (139380): No heartbeat from core client for 30 sec - exiting 00:13:01 (139380): No heartbeat from core client for 30 sec - exiting 00:13:02 (139380): No heartbeat from core client for 30 sec - exiting 00:13:03 (139380): No heartbeat from core client for 30 sec - exiting 00:13:04 (139380): No heartbeat from core client for 30 sec - exiting 00:13:05 (139380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:13:06 (139380): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 00:23:57 (132252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:24:02 (132252): No heartbeat from core client for 30 sec - exiting 00:24:03 (132252): No heartbeat from core client for 30 sec - exiting 00:24:04 (132252): No heartbeat from core client for 30 sec - exiting 00:24:05 (132252): No heartbeat from core client for 30 sec - exiting 00:24:06 (132252): No heartbeat from core client for 30 sec - exiting 00:24:07 (132252): No heartbeat from core client for 30 sec - exiting 00:26:08 (141704): No heartbeat from core client for 30 sec - exiting 00:26:09 (141704): No heartbeat from core client for 30 sec - exiting 00:26:10 (141704): No heartbeat from core client for 30 sec - exiting 00:26:11 (141704): No heartbeat from core client for 30 sec - exiting 00:26:12 (141704): No heartbeat from core client for 30 sec - exiting 00:26:13 (141704): No heartbeat from core client for 30 sec - exiting 00:26:14 (141704): No heartbeat from core client for 30 sec - exiting 00:26:15 (141704): No heartbeat from core client for 30 sec - exiting 00:26:16 (141704): No heartbeat from core client for 30 sec - exiting 00:26:17 (141704): No heartbeat from core client for 30 sec - exiting 00:26:18 (141704): No heartbeat from core client for 30 sec - exiting 00:26:19 (141704): No heartbeat from core client for 30 sec - exiting 00:26:20 (141704): No heartbeat from core client for 30 sec - exiting 00:26:21 (141704): No heartbeat from core client for 30 sec - exiting 00:26:22 (141704): No heartbeat from core client for 30 sec - exiting 00:26:23 (141704): No heartbeat from core client for 30 sec - exiting 00:26:24 (141704): No heartbeat from core client for 30 sec - exiting 00:26:25 (141704): No heartbeat from core client for 30 sec - exiting 00:26:26 (141704): No heartbeat from core client for 30 sec - exiting 00:26:27 (141704): No heartbeat from core client for 30 sec - exiting 00:26:28 (141704): No heartbeat from core client for 30 sec - exiting 00:26:29 (141704): No heartbeat from core client for 30 sec - exiting 00:26:30 (141704): No heartbeat from core client for 30 sec - exiting 00:26:31 (141704): No heartbeat from core client for 30 sec - exiting 00:26:32 (141704): No heartbeat from core client for 30 sec - exiting 00:26:33 (141704): No heartbeat from core client for 30 sec - exiting 00:26:34 (141704): No heartbeat from core client for 30 sec - exiting 00:26:35 (141704): No heartbeat from core client for 30 sec - exiting 00:26:36 (141704): No heartbeat from core client for 30 sec - exiting 00:26:37 (141704): No heartbeat from core client for 30 sec - exiting 00:26:38 (141704): No heartbeat from core client for 30 sec - exiting 00:26:39 (141704): No heartbeat from core client for 30 sec - exiting 00:26:40 (141704): No heartbeat from core client for 30 sec - exiting 00:26:41 (141704): No heartbeat from core client for 30 sec - exiting 00:26:42 (141704): No heartbeat from core client for 30 sec - exiting 00:26:43 (141704): No heartbeat from core client for 30 sec - exiting 00:26:44 (141704): No heartbeat from core client for 30 sec - exiting 00:26:45 (141704): No heartbeat from core client for 30 sec - exiting 00:26:46 (141704): No heartbeat from core client for 30 sec - exiting 00:26:47 (141704): No heartbeat from core client for 30 sec - exiting 00:26:48 (141704): No heartbeat from core client for 30 sec - exiting 00:26:49 (141704): No heartbeat from core client for 30 sec - exiting 00:26:50 (141704): No heartbeat from core client for 30 sec - exiting 00:26:51 (141704): No heartbeat from core client for 30 sec - exiting 00:26:52 (141704): No heartbeat from core client for 30 sec - exiting 00:26:53 (141704): No heartbeat from core client for 30 sec - exiting 00:26:54 (141704): No heartbeat from core client for 30 sec - exiting 00:26:55 (141704): No heartbeat from core client for 30 sec - exiting 00:26:56 (141704): No heartbeat from core client for 30 sec - exiting 00:26:57 (141704): No heartbeat from core client for 30 sec - exiting 00:26:58 (141704): No heartbeat from core client for 30 sec - exiting 00:26:59 (141704): No heartbeat from core client for 30 sec - exiting 00:27:00 (141704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:27:01 (141704): No heartbeat from core client for 30 sec - exiting 00:27:02 (141704): No heartbeat from core client for 30 sec - exiting 00:27:37 (141168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:44:23 (136204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:44:25 (136204): No heartbeat from core client for 30 sec - exiting 00:44:26 (136204): No heartbeat from core client for 30 sec - exiting 00:46:28 (142256): No heartbeat from core client for 30 sec - exiting 00:46:29 (142256): No heartbeat from core client for 30 sec - exiting 00:46:30 (142256): No heartbeat from core client for 30 sec - exiting 00:46:31 (142256): No heartbeat from core client for 30 sec - exiting 00:46:32 (142256): No heartbeat from core client for 30 sec - exiting 00:46:33 (142256): No heartbeat from core client for 30 sec - exiting 00:46:34 (142256): No heartbeat from core client for 30 sec - exiting 00:46:35 (142256): No heartbeat from core client for 30 sec - exiting 00:46:36 (142256): No heartbeat from core client for 30 sec - exiting 00:46:37 (142256): No heartbeat from core client for 30 sec - exiting 00:46:38 (142256): No heartbeat from core client for 30 sec - exiting 00:46:39 (142256): No heartbeat from core client for 30 sec - exiting 00:46:40 (142256): No heartbeat from core client for 30 sec - exiting 00:46:41 (142256): No heartbeat from core client for 30 sec - exiting 00:46:42 (142256): No heartbeat from core client for 30 sec - exiting 00:46:43 (142256): No heartbeat from core client for 30 sec - exiting 00:46:44 (142256): No heartbeat from core client for 30 sec - exiting 00:46:45 (142256): No heartbeat from core client for 30 sec - exiting 00:46:46 (142256): No heartbeat from core client for 30 sec - exiting 00:46:47 (142256): No heartbeat from core client for 30 sec - exiting 00:46:48 (142256): No heartbeat from core client for 30 sec - exiting 00:46:49 (142256): No heartbeat from core client for 30 sec - exiting 00:46:50 (142256): No heartbeat from core client for 30 sec - exiting 00:46:51 (142256): No heartbeat from core client for 30 sec - exiting 00:46:52 (142256): No heartbeat from core client for 30 sec - exiting 00:46:53 (142256): No heartbeat from core client for 30 sec - exiting 00:46:54 (142256): No heartbeat from core client for 30 sec - exiting 00:46:55 (142256): No heartbeat from core client for 30 sec - exiting 00:46:56 (142256): No heartbeat from core client for 30 sec - exiting 00:46:57 (142256): No heartbeat from core client for 30 sec - exiting 00:46:58 (142256): No heartbeat from core client for 30 sec - exiting 00:46:59 (142256): No heartbeat from core client for 30 sec - exiting 00:47:00 (142256): No heartbeat from core client for 30 sec - exiting 00:47:01 (142256): No heartbeat from core client for 30 sec - exiting 00:47:02 (142256): No heartbeat from core client for 30 sec - exiting 00:47:03 (142256): No heartbeat from core client for 30 sec - exiting 00:47:04 (142256): No heartbeat from core client for 30 sec - exiting 00:47:05 (142256): No heartbeat from core client for 30 sec - exiting 00:47:06 (142256): No heartbeat from core client for 30 sec - exiting 00:47:07 (142256): No heartbeat from core client for 30 sec - exiting 00:47:08 (142256): No heartbeat from core client for 30 sec - exiting 00:47:09 (142256): No heartbeat from core client for 30 sec - exiting 00:47:10 (142256): No heartbeat from core client for 30 sec - exiting 00:47:11 (142256): No heartbeat from core client for 30 sec - exiting 00:47:12 (142256): No heartbeat from core client for 30 sec - exiting 00:47:13 (142256): No heartbeat from core client for 30 sec - exiting 00:47:14 (142256): No heartbeat from core client for 30 sec - exiting 00:47:15 (142256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:47:16 (142256): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 00:49:24 (136748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:50:16 (141512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:59:25 (142024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:59:28 (142024): No heartbeat from core client for 30 sec - exiting 00:59:31 (142024): No heartbeat from core client for 30 sec - exiting 00:59:32 (142024): No heartbeat from core client for 30 sec - exiting 00:59:33 (142024): No heartbeat from core client for 30 sec - exiting 00:59:34 (142024): No heartbeat from core client for 30 sec - exiting 00:59:35 (142024): No heartbeat from core client for 30 sec - exiting 01:02:36 (140856): No heartbeat from core client for 30 sec - exiting 01:02:37 (140856): No heartbeat from core client for 30 sec - exiting 01:02:38 (140856): No heartbeat from core client for 30 sec - exiting 01:02:39 (140856): No heartbeat from core client for 30 sec - exiting 01:02:40 (140856): No heartbeat from core client for 30 sec - exiting 01:02:41 (140856): No heartbeat from core client for 30 sec - exiting 01:02:42 (140856): No heartbeat from core client for 30 sec - exiting 01:02:43 (140856): No heartbeat from core client for 30 sec - exiting 01:02:44 (140856): No heartbeat from core client for 30 sec - exiting 01:02:45 (140856): No heartbeat from core client for 30 sec - exiting 01:02:46 (140856): No heartbeat from core client for 30 sec - exiting 01:02:47 (140856): No heartbeat from core client for 30 sec - exiting 01:02:48 (140856): No heartbeat from core client for 30 sec - exiting 01:02:49 (140856): No heartbeat from core client for 30 sec - exiting 01:02:50 (140856): No heartbeat from core client for 30 sec - exiting 01:02:51 (140856): No heartbeat from core client for 30 sec - exiting 01:02:52 (140856): No heartbeat from core client for 30 sec - exiting 01:02:53 (140856): No heartbeat from core client for 30 sec - exiting 01:02:54 (140856): No heartbeat from core client for 30 sec - exiting 01:02:55 (140856): No heartbeat from core client for 30 sec - exiting 01:02:56 (140856): No heartbeat from core client for 30 sec - exiting 01:02:57 (140856): No heartbeat from core client for 30 sec - exiting 01:02:58 (140856): No heartbeat from core client for 30 sec - exiting 01:02:59 (140856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:03:00 (140856): No heartbeat from core client for 30 sec - exiting 01:03:01 (140856): No heartbeat from core client for 30 sec - exiting 01:08:05 (142688): No heartbeat from core client for 30 sec - exiting 01:08:06 (142688): No heartbeat from core client for 30 sec - exiting 01:08:07 (142688): No heartbeat from core client for 30 sec - exiting 01:08:08 (142688): No heartbeat from core client for 30 sec - exiting 01:08:09 (142688): No heartbeat from core client for 30 sec - exiting 01:08:10 (142688): No heartbeat from core client for 30 sec - exiting 01:08:11 (142688): No heartbeat from core client for 30 sec - exiting 01:08:12 (142688): No heartbeat from core client for 30 sec - exiting 01:08:13 (142688): No heartbeat from core client for 30 sec - exiting 01:08:14 (142688): No heartbeat from core client for 30 sec - exiting 01:08:15 (142688): No heartbeat from core client for 30 sec - exiting 01:08:16 (142688): No heartbeat from core client for 30 sec - exiting 01:08:17 (142688): No heartbeat from core client for 30 sec - exiting 01:08:18 (142688): No heartbeat from core client for 30 sec - exiting 01:08:19 (142688): No heartbeat from core client for 30 sec - exiting 01:08:20 (142688): No heartbeat from core client for 30 sec - exiting 01:08:21 (142688): No heartbeat from core client for 30 sec - exiting 01:08:22 (142688): No heartbeat from core client for 30 sec - exiting 01:08:23 (142688): No heartbeat from core client for 30 sec - exiting 01:08:24 (142688): No heartbeat from core client for 30 sec - exiting 01:08:25 (142688): No heartbeat from core client for 30 sec - exiting 01:08:26 (142688): No heartbeat from core client for 30 sec - exiting 01:08:27 (142688): No heartbeat from core client for 30 sec - exiting 01:08:28 (142688): No heartbeat from core client for 30 sec - exiting 01:08:29 (142688): No heartbeat from core client for 30 sec - exiting 01:08:30 (142688): No heartbeat from core client for 30 sec - exiting 01:08:31 (142688): No heartbeat from core client for 30 sec - exiting 01:08:32 (142688): No heartbeat from core client for 30 sec - exiting 01:08:33 (142688): No heartbeat from core client for 30 sec - exiting 01:08:34 (142688): No heartbeat from core client for 30 sec - exiting 01:08:35 (142688): No heartbeat from core client for 30 sec - exiting 01:08:36 (142688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:00:33 (192952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=187560, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=191088, selfPID=193952, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_e3rp_2013_1_009760698_0_2.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e3rp_2013_1_009760698_0_3.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e3rp_2013_1_009760698_0_4.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e3rp_2013_1_009760698_0_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e3rp_2013_1_009760698_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e3rp_2013_1_009760698_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e3rp_2013_1_009760698_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e3rp_2013_1_009760698_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e3rp_2013_1_009760698_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e3rp_2013_1_009760698_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e3rp_2013_1_009760698_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 May 2015 02:11:52	493442	18334565	hadam3p_anz_e3rp_2013_1_009760698_0	11,819	33,735	2.8543