Task 18619169

Name	hadam3p_anz_f7ri_2013_1_009944434_0
Workunit	9971796
Created	23 Jun 2015, 20:23:45 UTC
Sent	23 Jun 2015, 20:32:42 UTC
Report deadline	5 Jun 2016, 1:52:42 UTC
Received	23 Jul 2015, 6:12:04 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1366415
Run time	2 days 8 hours 25 min 46 sec
CPU time	1 days 16 hours 9 min 42 sec
Validate state	Invalid
Credit	1,503.36
Device peak FLOPS	3.83 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5704, selfPID=5404, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4064, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:48:09 (3332): No heartbeat from core client for 30 sec - exiting 06:48:10 (3332): No heartbeat from core client for 30 sec - exiting 06:48:11 (3332): No heartbeat from core client for 30 sec - exiting 06:48:12 (3332): No heartbeat from core client for 30 sec - exiting 06:48:13 (3332): No heartbeat from core client for 30 sec - exiting 06:48:14 (3332): No heartbeat from core client for 30 sec - exiting 06:48:15 (3332): No heartbeat from core client for 30 sec - exiting 06:48:16 (3332): No heartbeat from core client for 30 sec - exiting 06:48:17 (3332): No heartbeat from core client for 30 sec - exiting 06:48:18 (3332): No heartbeat from core client for 30 sec - exiting 06:48:19 (3332): No heartbeat from core client for 30 sec - exiting 06:48:20 (3332): No heartbeat from core client for 30 sec - exiting 06:48:21 (3332): No heartbeat from core client for 30 sec - exiting 06:48:22 (3332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:18:40 (3364): No heartbeat from core client for 30 sec - exiting 07:18:41 (3364): No heartbeat from core client for 30 sec - exiting 07:18:42 (3364): No heartbeat from core client for 30 sec - exiting 07:18:43 (3364): No heartbeat from core client for 30 sec - exiting 07:18:44 (3364): No heartbeat from core client for 30 sec - exiting 07:18:45 (3364): No heartbeat from core client for 30 sec - exiting 07:18:46 (3364): No heartbeat from core client for 30 sec - exiting 07:18:47 (3364): No heartbeat from core client for 30 sec - exiting 07:18:48 (3364): No heartbeat from core client for 30 sec - exiting 07:18:49 (3364): No heartbeat from core client for 30 sec - exiting 07:18:50 (3364): No heartbeat from core client for 30 sec - exiting 07:18:51 (3364): No heartbeat from core client for 30 sec - exiting 07:18:52 (3364): No heartbeat from core client for 30 sec - exiting 07:18:53 (3364): No heartbeat from core client for 30 sec - exiting 07:18:54 (3364): No heartbeat from core client for 30 sec - exiting 07:18:55 (3364): No heartbeat from core client for 30 sec - exiting 07:18:56 (3364): No heartbeat from core client for 30 sec - exiting 07:18:57 (3364): No heartbeat from core client for 30 sec - exiting 07:18:58 (3364): No heartbeat from core client for 30 sec - exiting 07:18:59 (3364): No heartbeat from core client for 30 sec - exiting 07:19:00 (3364): No heartbeat from core client for 30 sec - exiting 07:19:01 (3364): No heartbeat from core client for 30 sec - exiting 07:19:02 (3364): No heartbeat from core client for 30 sec - exiting 07:19:03 (3364): No heartbeat from core client for 30 sec - exiting 07:19:04 (3364): No heartbeat from core client for 30 sec - exiting 07:19:05 (3364): No heartbeat from core client for 30 sec - exiting 07:19:06 (3364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4332, selfPID=5880, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:21:55 (5472): No heartbeat from core client for 30 sec - exiting 15:21:56 (5472): No heartbeat from core client for 30 sec - exiting 15:21:57 (5472): No heartbeat from core client for 30 sec - exiting 15:21:58 (5472): No heartbeat from core client for 30 sec - exiting 15:21:59 (5472): No heartbeat from core client for 30 sec - exiting 15:22:00 (5472): No heartbeat from core client for 30 sec - exiting 15:22:01 (5472): No heartbeat from core client for 30 sec - exiting 15:22:02 (5472): No heartbeat from core client for 30 sec - exiting 15:22:03 (5472): No heartbeat from core client for 30 sec - exiting 15:22:04 (5472): No heartbeat from core client for 30 sec - exiting 15:22:05 (5472): No heartbeat from core client for 30 sec - exiting 15:22:06 (5472): No heartbeat from core client for 30 sec - exiting 15:22:07 (5472): No heartbeat from core client for 30 sec - exiting 15:22:08 (5472): No heartbeat from core client for 30 sec - exiting 15:22:09 (5472): No heartbeat from core client for 30 sec - exiting 15:22:10 (5472): No heartbeat from core client for 30 sec - exiting 15:22:11 (5472): No heartbeat from core client for 30 sec - exiting 15:22:12 (5472): No heartbeat from core client for 30 sec - exiting 15:22:13 (5472): No heartbeat from core client for 30 sec - exiting 15:22:14 (5472): No heartbeat from core client for 30 sec - exiting 15:22:15 (5472): No heartbeat from core client for 30 sec - exiting 15:22:16 (5472): No heartbeat from core client for 30 sec - exiting 15:22:17 (5472): No heartbeat from core client for 30 sec - exiting 15:22:18 (5472): No heartbeat from core client for 30 sec - exiting 15:22:19 (5472): No heartbeat from core client for 30 sec - exiting 15:22:20 (5472): No heartbeat from core client for 30 sec - exiting 15:22:21 (5472): No heartbeat from core client for 30 sec - exiting 15:22:22 (5472): No heartbeat from core client for 30 sec - exiting 15:22:23 (5472): No heartbeat from core client for 30 sec - exiting 15:22:24 (5472): No heartbeat from core client for 30 sec - exiting 15:22:25 (5472): No heartbeat from core client for 30 sec - exiting 15:22:27 (5472): No heartbeat from core client for 30 sec - exiting 15:22:28 (5472): No heartbeat from core client for 30 sec - exiting 15:22:29 (5472): No heartbeat from core client for 30 sec - exiting 15:22:30 (5472): No heartbeat from core client for 30 sec - exiting 15:22:31 (5472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... ReSuspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4256, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7072, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=1672, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5156, selfPID=5012, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_f7ri_2013_1_009944434_0_4.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f7ri_2013_1_009944434_0_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f7ri_2013_1_009944434_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f7ri_2013_1_009944434_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f7ri_2013_1_009944434_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f7ri_2013_1_009944434_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f7ri_2013_1_009944434_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f7ri_2013_1_009944434_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f7ri_2013_1_009944434_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Jul 2015 21:42:19	1366415	18619169	hadam3p_anz_f7ri_2013_1_009944434_0	34,859	144,140	4.1349
15 Jul 2015 07:21:11	1366415	18619169	hadam3p_anz_f7ri_2013_1_009944434_0	23,339	96,685	4.1426
03 Jul 2015 08:34:37	1366415	18619169	hadam3p_anz_f7ri_2013_1_009944434_0	11,819	48,939	4.1407