Task 17587370

Name	hadam3p_anz_l1u0_2012_1_009301159_0
Workunit	9385347
Created	17 Dec 2014, 19:06:56 UTC
Sent	29 Dec 2014, 18:08:24 UTC
Report deadline	11 Dec 2015, 23:28:24 UTC
Received	2 Jan 2015, 14:56:25 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1314778
Run time	2 days 7 hours 50 min 7 sec
CPU time	2 days 2 hours 19 min 4 sec
Validate state	Invalid
Credit	2,497.00
Device peak FLOPS	3.17 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.39</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:46:57 (3400): No heartbeat from core client for 30 sec - exiting 10:46:58 (3400): No heartbeat from core client for 30 sec - exiting 10:46:59 (3400): No heartbeat from core client for 30 sec - exiting 10:47:00 (3400): No heartbeat from core client for 30 sec - exiting 10:47:01 (3400): No heartbeat from core client for 30 sec - exiting 10:47:02 (3400): No heartbeat from core client for 30 sec - exiting 10:47:03 (3400): No heartbeat from core client for 30 sec - exiting 10:47:04 (3400): No heartbeat from core client for 30 sec - exiting 10:47:05 (3400): No heartbeat from core client for 30 sec - exiting 10:47:06 (3400): No heartbeat from core client for 30 sec - exiting 10:47:07 (3400): No heartbeat from core client for 30 sec - exiting 10:47:08 (3400): No heartbeat from core client for 30 sec - exiting 10:47:09 (3400): No heartbeat from core client for 30 sec - exiting 10:47:10 (3400): No heartbeat from core client for 30 sec - exiting 10:47:11 (3400): No heartbeat from core client for 30 sec - exiting 10:47:12 (3400): No heartbeat from core client for 30 sec - exiting 10:47:13 (3400): No heartbeat from core client for 30 sec - exiting 10:47:14 (3400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:32:53 (6608): No heartbeat from core client for 30 sec - exiting 16:32:54 (6608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 04:54:47 (7484): No heartbeat from core client for 30 sec - exiting 04:54:49 (7484): No heartbeat from core client for 30 sec - exiting 04:54:50 (7484): No heartbeat from core client for 30 sec - exiting 04:54:51 (7484): No heartbeat from core client for 30 sec - exiting 04:54:52 (7484): No heartbeat from core client for 30 sec - exiting 04:54:53 (7484): No heartbeat from core client for 30 sec - exiting 04:54:54 (7484): No heartbeat from core client for 30 sec - exiting 04:54:55 (7484): No heartbeat from core client for 30 sec - exiting 04:54:56 (7484): No heartbeat from core client for 30 sec - exiting 04:54:57 (7484): No heartbeat from core client for 30 sec - exiting 04:54:58 (7484): No heartbeat from core client for 30 sec - exiting 04:54:59 (7484): No heartbeat from core client for 30 sec - exiting 04:55:00 (7484): No heartbeat from core client for 30 sec - exiting 04:55:01 (7484): No heartbeat from core client for 30 sec - exiting 04:55:02 (7484): No heartbeat from core client for 30 sec - exiting 04:55:03 (7484): No heartbeat from core client for 30 sec - exiting 04:55:04 (7484): No heartbeat from core client for 30 sec - exiting 04:55:05 (7484): No heartbeat from core client for 30 sec - exiting 04:55:06 (7484): No heartbeat from core client for 30 sec - exiting 04:55:07 (7484): No heartbeat from core client for 30 sec - exiting 04:55:08 (7484): No heartbeat from core client for 30 sec - exiting 04:55:09 (7484): No heartbeat from core client for 30 sec - exiting 04:55:10 (7484): No heartbeat from core client for 30 sec - exiting 04:55:11 (7484): No heartbeat from core client for 30 sec - exiting 04:55:12 (7484): No heartbeat from core client for 30 sec - exiting 04:55:13 (7484): No heartbeat from core client for 30 sec - exiting 04:55:14 (7484): No heartbeat from core client for 30 sec - exiting 04:55:15 (7484): No heartbeat from core client for 30 sec - exiting 04:55:16 (7484): No heartbeat from core client for 30 sec - exiting 04:55:17 (7484): No heartbeat from core client for 30 sec - exiting 04:55:18 (7484): No heartbeat from core client for 30 sec - exiting 04:55:19 (7484): No heartbeat from core client for 30 sec - exiting 04:55:20 (7484): No heartbeat from core client for 30 sec - exiting 04:55:21 (7484): No heartbeat from core client for 30 sec - exiting 04:55:22 (7484): No heartbeat from core client for 30 sec - exiting 04:55:23 (7484): No heartbeat from core client for 30 sec - exiting 04:55:24 (7484): No heartbeat from core client for 30 sec - exiting 04:55:25 (7484): No heartbeat from core client for 30 sec - exiting 04:55:26 (7484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:46:34 (7300): No heartbeat from core client for 30 sec - exiting 10:46:35 (7300): No heartbeat from core client for 30 sec - exiting 10:46:36 (7300): No heartbeat from core client for 30 sec - exiting 10:46:37 (7300): No heartbeat from core client for 30 sec - exiting 10:46:38 (7300): No heartbeat from core client for 30 sec - exiting 10:46:39 (7300): No heartbeat from core client for 30 sec - exiting 10:46:40 (7300): No heartbeat from core client for 30 sec - exiting 10:46:41 (7300): No heartbeat from core client for 30 sec - exiting 10:46:42 (7300): No heartbeat from core client for 30 sec - exiting 10:46:43 (7300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:53:05 (3588): No heartbeat from core client for 30 sec - exiting 03:53:06 (3588): No heartbeat from core client for 30 sec - exiting 03:53:07 (3588): No heartbeat from core client for 30 sec - exiting 03:53:08 (3588): No heartbeat from core client for 30 sec - exiting 03:53:09 (3588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:12:44 (4696): No heartbeat from core client for 30 sec - exiting 16:12:45 (4696): No heartbeat from core client for 30 sec - exiting 16:12:46 (4696): No heartbeat from core client for 30 sec - exiting 16:12:47 (4696): No heartbeat from core client for 30 sec - exiting 16:12:48 (4696): No heartbeat from core client for 30 sec - exiting 16:12:49 (4696): No heartbeat from core client for 30 sec - exiting 16:12:50 (4696): No heartbeat from core client for 30 sec - exiting 16:12:51 (4696): No heartbeat from core client for 30 sec - exiting 16:12:52 (4696): No heartbeat from core client for 30 sec - exiting 16:12:53 (4696): No heartbeat from core client for 30 sec - exiting 16:12:54 (4696): No heartbeat from core client for 30 sec - exiting 16:12:55 (4696): No heartbeat from core client for 30 sec - exiting 16:12:56 (4696): No heartbeat from core client for 30 sec - exiting 16:12:57 (4696): No heartbeat from core client for 30 sec - exiting 16:12:58 (4696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:55:32 (7804): No heartbeat from core client for 30 sec - exiting 14:55:33 (7804): No heartbeat from core client for 30 sec - exiting 14:55:34 (7804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=7644, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4488, selfPID=7572, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_l1u0_2012_1_009301159_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_l1u0_2012_1_009301159_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_l1u0_2012_1_009301159_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_l1u0_2012_1_009301159_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_l1u0_2012_1_009301159_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_l1u0_2012_1_009301159_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_l1u0_2012_1_009301159_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Jan 2015 11:21:32	1314778	17587370	hadam3p_anz_l1u0_2012_1_009301159_0	57,899	179,752	3.1046
02 Jan 2015 00:40:06	1314778	17587370	hadam3p_anz_l1u0_2012_1_009301159_0	46,379	145,847	3.1447
01 Jan 2015 07:22:26	1314778	17587370	hadam3p_anz_l1u0_2012_1_009301159_0	34,859	111,300	3.1929
31 Dec 2014 06:51:29	1314778	17587370	hadam3p_anz_l1u0_2012_1_009301159_0	23,339	75,868	3.2507
30 Dec 2014 11:29:32	1314778	17587370	hadam3p_anz_l1u0_2012_1_009301159_0	11,819	39,594	3.3500