Task 16459780

Name	hadam3p_anz_o8y6_2012_1_008628380_0
Workunit	8774892
Created	2 Apr 2014, 19:46:38 UTC
Sent	13 Apr 2014, 22:12:24 UTC
Report deadline	27 Mar 2015, 3:32:24 UTC
Received	26 Apr 2014, 14:44:09 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1299704
Run time	1 days 4 hours 28 min 4 sec
CPU time	1 days 4 hours 15 min 40 sec
Validate state	Invalid
Credit	1,006.54
Device peak FLOPS	2.82 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:10:34 (2776): No heartbeat from core client for 30 sec - exiting 20:10:35 (2776): No heartbeat from core client for 30 sec - exiting 20:10:36 (2776): No heartbeat from core client for 30 sec - exiting 20:10:37 (2776): No heartbeat from core client for 30 sec - exiting 20:10:38 (2776): No heartbeat from core client for 30 sec - exiting 20:10:39 (2776): No heartbeat from core client for 30 sec - exiting 20:10:40 (2776): No heartbeat from core client for 30 sec - exiting 20:10:41 (2776): No heartbeat from core client for 30 sec - exiting 20:10:42 (2776): No heartbeat from core client for 30 sec - exiting 20:10:43 (2776): No heartbeat from core client for 30 sec - exiting 20:10:44 (2776): No heartbeat from core client for 30 sec - exiting 20:10:45 (2776): No heartbeat from core client for 30 sec - exiting 20:10:46 (2776): No heartbeat from core client for 30 sec - exiting 20:10:47 (2776): No heartbeat from core client for 30 sec - exiting 20:10:48 (2776): No heartbeat from core client for 30 sec - exiting 20:10:49 (2776): No heartbeat from core client for 30 sec - exiting 20:10:50 (2776): No heartbeat from core client for 30 sec - exiting 20:10:51 (2776): No heartbeat from core client for 30 sec - exiting 20:10:52 (2776): No heartbeat from core client for 30 sec - exiting 20:10:53 (2776): No heartbeat from core client for 30 sec - exiting 20:10:54 (2776): No heartbeat from core client for 30 sec - exiting 20:10:55 (2776): No heartbeat from core client for 30 sec - exiting 20:10:56 (2776): No heartbeat from core client for 30 sec - exiting 20:10:57 (2776): No heartbeat from core client for 30 sec - exiting 20:10:58 (2776): No heartbeat from core client for 30 sec - exiting 20:10:59 (2776): No heartbeat from core client for 30 sec - exiting 20:11:00 (2776): No heartbeat from core client for 30 sec - exiting 20:11:01 (2776): No heartbeat from core client for 30 sec - exiting 20:11:02 (2776): No heartbeat from core client for 30 sec - exiting 20:11:03 (2776): No heartbeat from core client for 30 sec - exiting 20:11:04 (2776): No heartbeat from core client for 30 sec - exiting 20:11:05 (2776): No heartbeat from core client for 30 sec - exiting 20:11:06 (2776): No heartbeat from core client for 30 sec - exiting 20:11:07 (2776): No heartbeat from core client for 30 sec - exiting 20:11:08 (2776): No heartbeat from core client for 30 sec - exiting 20:11:09 (2776): No heartbeat from core client for 30 sec - exiting 20:11:10 (2776): No heartbeat from core client for 30 sec - exiting 20:11:11 (2776): No heartbeat from core client for 30 sec - exiting 20:11:12 (2776): No heartbeat from core client for 30 sec - exiting 20:11:13 (2776): No heartbeat from core client for 30 sec - exiting 20:11:14 (2776): No heartbeat from core client for 30 sec - exiting 20:11:15 (2776): No heartbeat from core client for 30 sec - exiting 20:11:16 (2776): No heartbeat from core client for 30 sec - exiting 20:11:17 (2776): No heartbeat from core client for 30 sec - exiting 20:11:18 (2776): No heartbeat from core client for 30 sec - exiting 20:11:19 (2776): No heartbeat from core client for 30 sec - exiting 20:11:20 (2776): No heartbeat from core client for 30 sec - exiting 20:11:21 (2776): No heartbeat from core client for 30 sec - exiting 20:11:22 (2776): No heartbeat from core client for 30 sec - exiting 20:11:23 (2776): No heartbeat from core client for 30 sec - exiting 20:11:24 (2776): No heartbeat from core client for 30 sec - exiting 20:11:25 (2776): No heartbeat from core client for 30 sec - exiting 20:11:26 (2776): No heartbeat from core client for 30 sec - exiting 20:11:27 (2776): No heartbeat from core client for 30 sec - exiting 20:11:28 (2776): No heartbeat from core client for 30 sec - exiting 20:11:29 (2776): No heartbeat from core client for 30 sec - exiting 20:11:30 (2776): No heartbeat from core client for 30 sec - exiting 20:11:31 (2776): No heartbeat from core client for 30 sec - exiting 20:11:32 (2776): No heartbeat from core client for 30 sec - exiting 20:11:33 (2776): No heartbeat from core client for 30 sec - exiting 20:11:34 (2776): No heartbeat from core client for 30 sec - exiting 20:11:35 (2776): No heartbeat from core client for 30 sec - exiting 20:11:36 (2776): No heartbeat from core client for 30 sec - exiting 20:11:37 (2776): No heartbeat from core client for 30 sec - exiting 20:11:38 (2776): No heartbeat from core client for 30 sec - exiting 20:11:39 (2776): No heartbeat from core client for 30 sec - exiting 20:11:40 (2776): No heartbeat from core client for 30 sec - exiting 20:11:41 (2776): No heartbeat from core client for 30 sec - exiting 20:11:42 (2776): No heartbeat from core client for 30 sec - exiting 20:11:43 (2776): No heartbeat from core client for 30 sec - exiting 20:11:44 (2776): No heartbeat from core client for 30 sec - exiting 20:11:45 (2776): No heartbeat from core client for 30 sec - exiting 20:11:46 (2776): No heartbeat from core client for 30 sec - exiting 20:11:47 (2776): No heartbeat from core client for 30 sec - exiting 20:11:48 (2776): No heartbeat from core client for 30 sec - exiting 20:11:49 (2776): No heartbeat from core client for 30 sec - exiting 20:11:50 (2776): No heartbeat from core client for 30 sec - exiting 20:11:51 (2776): No heartbeat from core client for 30 sec - exiting 20:11:52 (2776): No heartbeat from core client for 30 sec - exiting 20:11:53 (2776): No heartbeat from core client for 30 sec - exiting 20:11:54 (2776): No heartbeat from core client for 30 sec - exiting 20:11:55 (2776): No heartbeat from core client for 30 sec - exiting 20:11:56 (2776): No heartbeat from core client for 30 sec - exiting 20:11:57 (2776): No heartbeat from core client for 30 sec - exiting 20:11:58 (2776): No heartbeat from core client for 30 sec - exiting 20:11:59 (2776): No heartbeat from core client for 30 sec - exiting 20:12:00 (2776): No heartbeat from core client for 30 sec - exiting 20:12:01 (2776): No heartbeat from core client for 30 sec - exiting 20:12:02 (2776): No heartbeat from core client for 30 sec - exiting 20:12:03 (2776): No heartbeat from core client for 30 sec - exiting 20:12:04 (2776): No heartbeat from core client for 30 sec - exiting 20:12:05 (2776): No heartbeat from core client for 30 sec - exiting 20:12:06 (2776): No heartbeat from core client for 30 sec - exiting 20:12:07 (2776): No heartbeat from core client for 30 sec - exiting 20:12:08 (2776): No heartbeat from core client for 30 sec - exiting 20:12:09 (2776): No heartbeat from core client for 30 sec - exiting 20:12:10 (2776): No heartbeat from core client for 30 sec - exiting 20:12:11 (2776): No heartbeat from core client for 30 sec - exiting 20:12:12 (2776): No heartbeat from core client for 30 sec - exiting 20:12:13 (2776): No heartbeat from core client for 30 sec - exiting 20:12:14 (2776): No heartbeat from core client for 30 sec - exiting 20:12:15 (2776): No heartbeat from core client for 30 sec - exiting 20:12:16 (2776): No heartbeat from core client for 30 sec - exiting 20:12:17 (2776): No heartbeat from core client for 30 sec - exiting 20:12:18 (2776): No heartbeat from core client for 30 sec - exiting 20:12:19 (2776): No heartbeat from core client for 30 sec - exiting 20:12:20 (2776): No heartbeat from core client for 30 sec - exiting 20:12:21 (2776): No heartbeat from core client for 30 sec - exiting 20:12:22 (2776): No heartbeat from core client for 30 sec - exiting 20:12:23 (2776): No heartbeat from core client for 30 sec - exiting 20:12:24 (2776): No heartbeat from core client for 30 sec - exiting 20:12:25 (2776): No heartbeat from core client for 30 sec - exiting 20:12:26 (2776): No heartbeat from core client for 30 sec - exiting 20:12:27 (2776): No heartbeat from core client for 30 sec - exiting 20:12:28 (2776): No heartbeat from core client for 30 sec - exiting 20:12:29 (2776): No heartbeat from core client for 30 sec - exiting 20:12:30 (2776): No heartbeat from core client for 30 sec - exiting 20:12:31 (2776): No heartbeat from core client for 30 sec - exiting 20:12:32 (2776): No heartbeat from core client for 30 sec - exiting 20:12:33 (2776): No heartbeat from core client for 30 sec - exiting 20:12:34 (2776): No heartbeat from core client for 30 sec - exiting 20:12:35 (2776): No heartbeat from core client for 30 sec - exiting 20:12:36 (2776): No heartbeat from core client for 30 sec - exiting 20:12:37 (2776): No heartbeat from core client for 30 sec - exiting 20:12:38 (2776): No heartbeat from core client for 30 sec - exiting 20:12:39 (2776): No heartbeat from core client for 30 sec - exiting 20:12:40 (2776): No heartbeat from core client for 30 sec - exiting 20:12:41 (2776): No heartbeat from core client for 30 sec - exiting 20:12:42 (2776): No heartbeat from core client for 30 sec - exiting 20:12:43 (2776): No heartbeat from core client for 30 sec - exiting 20:12:44 (2776): No heartbeat from core client for 30 sec - exiting 20:12:45 (2776): No heartbeat from core client for 30 sec - exiting 20:12:46 (2776): No heartbeat from core client for 30 sec - exiting 20:12:47 (2776): No heartbeat from core client for 30 sec - exiting 20:12:48 (2776): No heartbeat from core client for 30 sec - exiting 20:12:49 (2776): No heartbeat from core client for 30 sec - exiting 20:12:50 (2776): No heartbeat from core client for 30 sec - exiting 20:12:51 (2776): No heartbeat from core client for 30 sec - exiting 20:12:52 (2776): No heartbeat from core client for 30 sec - exiting 20:12:53 (2776): No heartbeat from core client for 30 sec - exiting 20:12:54 (2776): No heartbeat from core client for 30 sec - exiting 20:12:55 (2776): No heartbeat from core client for 30 sec - exiting 20:12:56 (2776): No heartbeat from core client for 30 sec - exiting 20:12:57 (2776): No heartbeat from core client for 30 sec - exiting 20:12:58 (2776): No heartbeat from core client for 30 sec - exiting 20:12:59 (2776): No heartbeat from core client for 30 sec - exiting 20:13:00 (2776): No heartbeat from core client for 30 sec - exiting 20:13:01 (2776): No heartbeat from core client for 30 sec - exiting 20:13:02 (2776): No heartbeat from core client for 30 sec - exiting 20:13:03 (2776): No heartbeat from core client for 30 sec - exiting 20:13:04 (2776): No heartbeat from core client for 30 sec - exiting 20:13:05 (2776): No heartbeat from core client for 30 sec - exiting 20:13:06 (2776): No heartbeat from core client for 30 sec - exiting 20:13:07 (2776): No heartbeat from core client for 30 sec - exiting 20:13:08 (2776): No heartbeat from core client for 30 sec - exiting 20:13:09 (2776): No heartbeat from core client for 30 sec - exiting 20:13:10 (2776): No heartbeat from core client for 30 sec - exiting 20:13:11 (2776): No heartbeat from core client for 30 sec - exiting 20:13:12 (2776): No heartbeat from core client for 30 sec - exiting 20:13:13 (2776): No heartbeat from core client for 30 sec - exiting 20:13:14 (2776): No heartbeat from core client for 30 sec - exiting 20:13:15 (2776): No heartbeat from core client for 30 sec - exiting 20:13:16 (2776): No heartbeat from core client for 30 sec - exiting 20:13:17 (2776): No heartbeat from core client for 30 sec - exiting 20:13:18 (2776): No heartbeat from core client for 30 sec - exiting 20:13:19 (2776): No heartbeat from core client for 30 sec - exiting 20:13:20 (2776): No heartbeat from core client for 30 sec - exiting 20:13:21 (2776): No heartbeat from core client for 30 sec - exiting 20:13:22 (2776): No heartbeat from core client for 30 sec - exiting 20:13:23 (2776): No heartbeat from core client for 30 sec - exiting 20:13:24 (2776): No heartbeat from core client for 30 sec - exiting 20:13:25 (2776): No heartbeat from core client for 30 sec - exiting 20:13:26 (2776): No heartbeat from core client for 30 sec - exiting 20:13:27 (2776): No heartbeat from core client for 30 sec - exiting 20:13:28 (2776): No heartbeat from core client for 30 sec - exiting 20:13:29 (2776): No heartbeat from core client for 30 sec - exiting 20:13:30 (2776): No heartbeat from core client for 30 sec - exiting 20:13:31 (2776): No heartbeat from core client for 30 sec - exiting 20:13:32 (2776): No heartbeat from core client for 30 sec - exiting 20:13:33 (2776): No heartbeat from core client for 30 sec - exiting 20:13:34 (2776): No heartbeat from core client for 30 sec - exiting 20:13:35 (2776): No heartbeat from core client for 30 sec - exiting 20:13:36 (2776): No heartbeat from core client for 30 sec - exiting 20:13:37 (2776): No heartbeat from core client for 30 sec - exiting 20:13:38 (2776): No heartbeat from core client for 30 sec - exiting 20:13:39 (2776): No heartbeat from core client for 30 sec - exiting 20:13:40 (2776): No heartbeat from core client for 30 sec - exiting 20:13:41 (2776): No heartbeat from core client for 30 sec - exiting 20:13:42 (2776): No heartbeat from core client for 30 sec - exiting 20:13:43 (2776): No heartbeat from core client for 30 sec - exiting 20:13:44 (2776): No heartbeat from core client for 30 sec - exiting 20:13:45 (2776): No heartbeat from core client for 30 sec - exiting 20:13:46 (2776): No heartbeat from core client for 30 sec - exiting 20:13:47 (2776): No heartbeat from core client for 30 sec - exiting 20:13:48 (2776): No heartbeat from core client for 30 sec - exiting 20:13:49 (2776): No heartbeat from core client for 30 sec - exiting 20:13:50 (2776): No heartbeat from core client for 30 sec - exiting 20:13:51 (2776): No heartbeat from core client for 30 sec - exiting 20:13:52 (2776): No heartbeat from core client for 30 sec - exiting 20:13:53 (2776): No heartbeat from core client for 30 sec - exiting 20:13:54 (2776): No heartbeat from core client for 30 sec - exiting 20:13:55 (2776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3372, selfPID=4248, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4504, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3448, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4404, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4212, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4872, selfPID=3864, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_o8y6_2012_1_008628380_0_3.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_o8y6_2012_1_008628380_0_4.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_o8y6_2012_1_008628380_0_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_o8y6_2012_1_008628380_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_o8y6_2012_1_008628380_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_o8y6_2012_1_008628380_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_o8y6_2012_1_008628380_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_o8y6_2012_1_008628380_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_o8y6_2012_1_008628380_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_o8y6_2012_1_008628380_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Apr 2014 01:08:26	1299704	16459780	hadam3p_anz_o8y6_2012_1_008628380_0	23,339	98,089	4.2028
19 Apr 2014 22:55:29	1299704	16459780	hadam3p_anz_o8y6_2012_1_008628380_0	11,819	49,398	4.1795