Task 16445359

Name	hadam3p_anz_a66q_2012_1_008614354_0
Workunit	8760866
Created	2 Apr 2014, 14:42:42 UTC
Sent	29 Apr 2014, 22:55:28 UTC
Report deadline	12 Apr 2015, 4:15:28 UTC
Received	11 Jun 2014, 1:11:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1053744
Run time	2 days 9 hours 46 min 37 sec
CPU time	2 days 7 hours 16 min 10 sec
Validate state	Invalid
Credit	1,006.54
Device peak FLOPS	3.03 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 04:50:08 (3840): No heartbeat from core client for 30 sec - exiting 04:50:09 (3840): No heartbeat from core client for 30 sec - exiting 04:50:10 (3840): No heartbeat from core client for 30 sec - exiting 04:50:11 (3840): No heartbeat from core client for 30 sec - exiting 04:50:12 (3840): No heartbeat from core client for 30 sec - exiting 04:50:13 (3840): No heartbeat from core client for 30 sec - exiting 04:50:14 (3840): No heartbeat from core client for 30 sec - exiting 04:50:15 (3840): No heartbeat from core client for 30 sec - exiting 04:50:16 (3840): No heartbeat from core client for 30 sec - exiting 04:50:17 (3840): No heartbeat from core client for 30 sec - exiting 04:50:18 (3840): No heartbeat from core client for 30 sec - exiting 04:50:20 (3840): No heartbeat from core client for 30 sec - exiting 04:50:21 (3840): No heartbeat from core client for 30 sec - exiting 04:50:22 (3840): No heartbeat from core client for 30 sec - exiting 04:50:23 (3840): No heartbeat from core client for 30 sec - exiting 04:50:24 (3840): No heartbeat from core client for 30 sec - exiting 04:50:25 (3840): No heartbeat from core client for 30 sec - exiting 04:50:26 (3840): No heartbeat from core client for 30 sec - exiting 04:50:27 (3840): No heartbeat from core client for 30 sec - exiting 04:50:28 (3840): No heartbeat from core client for 30 sec - exiting 04:50:29 (3840): No heartbeat from core client for 30 sec - exiting 04:50:30 (3840): No heartbeat from core client for 30 sec - exiting 04:50:31 (3840): No heartbeat from core client for 30 sec - exiting 04:50:32 (3840): No heartbeat from core client for 30 sec - exiting 04:50:33 (3840): No heartbeat from core client for 30 sec - exiting 04:50:34 (3840): No heartbeat from core client for 30 sec - exiting 04:50:35 (3840): No heartbeat from core client for 30 sec - exiting 04:50:36 (3840): No heartbeat from core client for 30 sec - exiting 04:50:37 (3840): No heartbeat from core client for 30 sec - exiting 04:50:38 (3840): No heartbeat from core client for 30 sec - exiting 04:50:39 (3840): No heartbeat from core client for 30 sec - exiting 04:50:40 (3840): No heartbeat from core client for 30 sec - exiting 04:50:41 (3840): No heartbeat from core client for 30 sec - exiting 04:50:42 (3840): No heartbeat from core client for 30 sec - exiting 04:50:43 (3840): No heartbeat from core client for 30 sec - exiting 04:50:44 (3840): No heartbeat from core client for 30 sec - exiting 04:50:45 (3840): No heartbeat from core client for 30 sec - exiting 04:50:46 (3840): No heartbeat from core client for 30 sec - exiting 04:50:47 (3840): No heartbeat from core client for 30 sec - exiting 04:50:48 (3840): No heartbeat from core client for 30 sec - exiting 04:50:49 (3840): No heartbeat from core client for 30 sec - exiting 04:50:50 (3840): No heartbeat from core client for 30 sec - exiting 04:50:51 (3840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:50:52 (3840): No heartbeat from core client for 30 sec - exiting 04:50:53 (3840): No heartbeat from core client for 30 sec - exiting 04:50:54 (3840): No heartbeat from core client for 30 sec - exiting 04:50:55 (3840): No heartbeat from core client for 30 sec - exiting 04:50:56 (3840): No heartbeat from core client for 30 sec - exiting 04:50:57 (3840): No heartbeat from core client for 30 sec - exiting 04:50:58 (3840): No heartbeat from core client for 30 sec - exiting 04:50:59 (3840): No heartbeat from core client for 30 sec - exiting 04:51:00 (3840): No heartbeat from core client for 30 sec - exiting 04:51:01 (3840): No heartbeat from core client for 30 sec - exiting 04:56:16 (3620): No heartbeat from core client for 30 sec - exiting 04:56:17 (3620): No heartbeat from core client for 30 sec - exiting 04:56:18 (3620): No heartbeat from core client for 30 sec - exiting 04:56:19 (3620): No heartbeat from core client for 30 sec - exiting 04:56:20 (3620): No heartbeat from core client for 30 sec - exiting 04:56:21 (3620): No heartbeat from core client for 30 sec - exiting 04:56:22 (3620): No heartbeat from core client for 30 sec - exiting 04:56:23 (3620): No heartbeat from core client for 30 sec - exiting 04:56:24 (3620): No heartbeat from core client for 30 sec - exiting 04:56:25 (3620): No heartbeat from core client for 30 sec - exiting 04:56:26 (3620): No heartbeat from core client for 30 sec - exiting 04:56:27 (3620): No heartbeat from core client for 30 sec - exiting 04:56:28 (3620): No heartbeat from core client for 30 sec - exiting 04:56:29 (3620): No heartbeat from core client for 30 sec - exiting 04:56:30 (3620): No heartbeat from core client for 30 sec - exiting 04:56:31 (3620): No heartbeat from core client for 30 sec - exiting 04:56:32 (3620): No heartbeat from core client for 30 sec - exiting 04:56:33 (3620): No heartbeat from core client for 30 sec - exiting 04:56:34 (3620): No heartbeat from core client for 30 sec - exiting 04:56:35 (3620): No heartbeat from core client for 30 sec - exiting 04:56:36 (3620): No heartbeat from core client for 30 sec - exiting 04:56:37 (3620): No heartbeat from core client for 30 sec - exiting 04:56:38 (3620): No heartbeat from core client for 30 sec - exiting 04:56:39 (3620): No heartbeat from core client for 30 sec - exiting 04:56:40 (3620): No heartbeat from core client for 30 sec - exiting 04:56:41 (3620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:56:42 (3620): No heartbeat from core client for 30 sec - exiting 04:56:43 (3620): No heartbeat from core client for 30 sec - exiting 04:56:44 (3620): No heartbeat from core client for 30 sec - exiting 04:56:45 (3620): No heartbeat from core client for 30 sec - exiting 04:56:46 (3620): No heartbeat from core client for 30 sec - exiting 04:56:47 (3620): No heartbeat from core client for 30 sec - exiting 04:56:48 (3620): No heartbeat from core client for 30 sec - exiting 04:56:49 (3620): No heartbeat from core client for 30 sec - exiting 04:56:50 (3620): No heartbeat from core client for 30 sec - exiting 04:56:51 (3620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4556, selfPID=4556, iMonCtr=2 05:04:02 (3376): No heartbeat from core client for 30 sec - exiting 05:04:03 (3376): No heartbeat from core client for 30 sec - exiting 05:04:04 (3376): No heartbeat from core client for 30 sec - exiting 05:04:05 (3376): No heartbeat from core client for 30 sec - exiting 05:04:06 (3376): No heartbeat from core client for 30 sec - exiting 05:04:07 (3376): No heartbeat from core client for 30 sec - exiting 05:04:08 (3376): No heartbeat from core client for 30 sec - exiting 05:04:09 (3376): No heartbeat from core client for 30 sec - exiting 05:04:10 (3376): No heartbeat from core client for 30 sec - exiting 05:04:11 (3376): No heartbeat from core client for 30 sec - exiting 05:04:12 (3376): No heartbeat from core client for 30 sec - exiting 05:04:13 (3376): No heartbeat from core client for 30 sec - exiting 05:04:14 (3376): No heartbeat from core client for 30 sec - exiting 05:04:15 (3376): No heartbeat from core client for 30 sec - exiting 05:04:16 (3376): No heartbeat from core client for 30 sec - exiting 05:04:17 (3376): No heartbeat from core client for 30 sec - exiting 05:04:18 (3376): No heartbeat from core client for 30 sec - exiting 05:04:19 (3376): No heartbeat from core client for 30 sec - exiting 05:04:20 (3376): No heartbeat from core client for 30 sec - exiting 05:04:21 (3376): No heartbeat from core client for 30 sec - exiting 05:04:22 (3376): No heartbeat from core client for 30 sec - exiting 05:04:23 (3376): No heartbeat from core client for 30 sec - exiting 05:04:24 (3376): No heartbeat from core client for 30 sec - exiting 05:04:25 (3376): No heartbeat from core client for 30 sec - exiting 05:04:26 (3376): No heartbeat from core client for 30 sec - exiting 05:04:27 (3376): No heartbeat from core client for 30 sec - exiting 05:04:28 (3376): No heartbeat from core client for 30 sec - exiting 05:04:29 (3376): No heartbeat from core client for 30 sec - exiting 05:04:30 (3376): No heartbeat from core client for 30 sec - exiting 05:04:31 (3376): No heartbeat from core client for 30 sec - exiting 05:04:32 (3376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 02:02:23 (1232): No heartbeat from core client for 30 sec - exiting 02:02:24 (1232): No heartbeat from core client for 30 sec - exiting 02:02:25 (1232): No heartbeat from core client for 30 sec - exiting 02:02:26 (1232): No heartbeat from core client for 30 sec - exiting 02:02:27 (1232): No heartbeat from core client for 30 sec - exiting 02:02:28 (1232): No heartbeat from core client for 30 sec - exiting 02:02:29 (1232): No heartbeat from core client for 30 sec - exiting 02:02:30 (1232): No heartbeat from core client for 30 sec - exiting 02:02:31 (1232): No heartbeat from core client for 30 sec - exiting 02:02:32 (1232): No heartbeat from core client for 30 sec - exiting 02:02:33 (1232): No heartbeat from core client for 30 sec - exiting 02:02:34 (1232): No heartbeat from core client for 30 sec - exiting 02:02:35 (1232): No heartbeat from core client for 30 sec - exiting 02:02:36 (1232): No heartbeat from core client for 30 sec - exiting 02:02:37 (1232): No heartbeat from core client for 30 sec - exiting 02:02:38 (1232): No heartbeat from core client for 30 sec - exiting 02:02:39 (1232): No heartbeat from core client for 30 sec - exiting 02:02:40 (1232): No heartbeat from core client for 30 sec - exiting 02:02:41 (1232): No heartbeat from core client for 30 sec - exiting 02:02:42 (1232): No heartbeat from core client for 30 sec - exiting 02:02:44 (1232): No heartbeat from core client for 30 sec - exiting 02:02:45 (1232): No heartbeat from core client for 30 sec - exiting 02:02:46 (1232): No heartbeat from core client for 30 sec - exiting 02:02:47 (1232): No heartbeat from core client for 30 sec - exiting 02:02:48 (1232): No heartbeat from core client for 30 sec - exiting 02:02:49 (1232): No heartbeat from core client for 30 sec - exiting 02:02:50 (1232): No heartbeat from core client for 30 sec - exiting 02:02:51 (1232): No heartbeat from core client for 30 sec - exiting 02:02:52 (1232): No heartbeat from core client for 30 sec - exiting 02:02:53 (1232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:02:54 (1232): No heartbeat from core client for 30 sec - exiting 02:02:55 (1232): No heartbeat from core client for 30 sec - exiting 02:02:56 (1232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 05:15:49 (2288): No heartbeat from core client for 30 sec - exiting 05:15:50 (2288): No heartbeat from core client for 30 sec - exiting 05:15:51 (2288): No heartbeat from core client for 30 sec - exiting 05:15:52 (2288): No heartbeat from core client for 30 sec - exiting 05:15:53 (2288): No heartbeat from core client for 30 sec - exiting 05:15:54 (2288): No heartbeat from core client for 30 sec - exiting 05:15:55 (2288): No heartbeat from core client for 30 sec - exiting 05:15:56 (2288): No heartbeat from core client for 30 sec - exiting 05:15:57 (2288): No heartbeat from core client for 30 sec - exiting 05:15:58 (2288): No heartbeat from core client for 30 sec - exiting 05:15:59 (2288): No heartbeat from core client for 30 sec - exiting 05:16:00 (2288): No heartbeat from core client for 30 sec - exiting 05:16:01 (2288): No heartbeat from core client for 30 sec - exiting 05:16:02 (2288): No heartbeat from core client for 30 sec - exiting 05:16:03 (2288): No heartbeat from core client for 30 sec - exiting 05:16:04 (2288): No heartbeat from core client for 30 sec - exiting 05:16:05 (2288): No heartbeat from core client for 30 sec - exiting 05:16:06 (2288): No heartbeat from core client for 30 sec - exiting 05:16:07 (2288): No heartbeat from core client for 30 sec - exiting 05:16:08 (2288): No heartbeat from core client for 30 sec - exiting 05:16:09 (2288): No heartbeat from core client for 30 sec - exiting 05:16:10 (2288): No heartbeat from core client for 30 sec - exiting 05:16:11 (2288): No heartbeat from core client for 30 sec - exiting 05:16:12 (2288): No heartbeat from core client for 30 sec - exiting 05:16:13 (2288): No heartbeat from core client for 30 sec - exiting 05:16:14 (2288): No heartbeat from core client for 30 sec - exiting 05:16:15 (2288): No heartbeat from core client for 30 sec - exiting 05:16:16 (2288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:16:17 (2288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1388, selfPID=1388, iMonCtr=2 19:10:14 (3904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=5784, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5244, selfPID=5244, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5244, selfPID=3556, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_anz_a66q_2012_1_008614354_0_3.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a66q_2012_1_008614354_0_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a66q_2012_1_008614354_0_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a66q_2012_1_008614354_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a66q_2012_1_008614354_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a66q_2012_1_008614354_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a66q_2012_1_008614354_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a66q_2012_1_008614354_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a66q_2012_1_008614354_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a66q_2012_1_008614354_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Jun 2014 00:27:57	1053744	16445359	hadam3p_anz_a66q_2012_1_008614354_0	23,339	136,020	5.8280
03 Jun 2014 11:12:08	1053744	16445359	hadam3p_anz_a66q_2012_1_008614354_0	11,819	71,226	6.0264