Task 18903637

Name	hadam3p_anz_w00j_2006_1_010175975_0
Workunit	10130131
Created	12 Sep 2015, 20:01:48 UTC
Sent	13 Sep 2015, 10:43:55 UTC
Report deadline	25 Aug 2016, 16:03:55 UTC
Received	17 Sep 2015, 22:10:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1345147
Run time	2 days 5 hours 39 min 5 sec
CPU time	2 days 0 hours 54 min 6 sec
Validate state	Invalid
Credit	1,503.36
Device peak FLOPS	3.86 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.6.9</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... 13:34:09 (24624): No heartbeat from core client for 30 sec - exiting 13:34:11 (24624): No heartbeat from core client for 30 sec - exiting 13:34:12 (24624): No heartbeat from core client for 30 sec - exiting 13:34:13 (24624): No heartbeat from core client for 30 sec - exiting 13:34:14 (24624): No heartbeat from core client for 30 sec - exiting 13:34:15 (24624): No heartbeat from core client for 30 sec - exiting 13:34:16 (24624): No heartbeat from core client for 30 sec - exiting 13:34:17 (24624): No heartbeat from core client for 30 sec - exiting 13:34:18 (24624): No heartbeat from core client for 30 sec - exiting 13:34:19 (24624): No heartbeat from core client for 30 sec - exiting 13:34:20 (24624): No heartbeat from core client for 30 sec - exiting 13:34:21 (24624): No heartbeat from core client for 30 sec - exiting 13:34:23 (24624): No heartbeat from core client for 30 sec - exiting 13:34:24 (24624): No heartbeat from core client for 30 sec - exiting 13:34:25 (24624): No heartbeat from core client for 30 sec - exiting 13:34:26 (24624): No heartbeat from core client for 30 sec - exiting 13:34:27 (24624): No heartbeat from core client for 30 sec - exiting 13:34:28 (24624): No heartbeat from core client for 30 sec - exiting 13:34:29 (24624): No heartbeat from core client for 30 sec - exiting 13:34:30 (24624): No heartbeat from core client for 30 sec - exiting 13:34:31 (24624): No heartbeat from core client for 30 sec - exiting 13:34:32 (24624): No heartbeat from core client for 30 sec - exiting 13:34:33 (24624): No heartbeat from core client for 30 sec - exiting 13:34:35 (24624): No heartbeat from core client for 30 sec - exiting 13:34:36 (24624): No heartbeat from core client for 30 sec - exiting 13:34:37 (24624): No heartbeat from core client for 30 sec - exiting 13:34:38 (24624): No heartbeat from core client for 30 sec - exiting 13:34:39 (24624): No heartbeat from core client for 30 sec - exiting 13:34:40 (24624): No heartbeat from core client for 30 sec - exiting 13:34:41 (24624): No heartbeat from core client for 30 sec - exiting 13:34:42 (24624): No heartbeat from core client for 30 sec - exiting 13:34:43 (24624): No heartbeat from core client for 30 sec - exiting 13:34:44 (24624): No heartbeat from core client for 30 sec - exiting 13:34:45 (24624): No heartbeat from core client for 30 sec - exiting 13:34:47 (24624): No heartbeat from core client for 30 sec - exiting 13:34:48 (24624): No heartbeat from core client for 30 sec - exiting 13:34:49 (24624): No heartbeat from core client for 30 sec - exiting 13:34:50 (24624): No heartbeat from core client for 30 sec - exiting 13:34:51 (24624): No heartbeat from core client for 30 sec - exiting 13:34:52 (24624): No heartbeat from core client for 30 sec - exiting 13:34:53 (24624): No heartbeat from core client for 30 sec - exiting 13:34:54 (24624): No heartbeat from core client for 30 sec - exiting 13:34:55 (24624): No heartbeat from core client for 30 sec - exiting 13:34:56 (24624): No heartbeat from core client for 30 sec - exiting 13:34:57 (24624): No heartbeat from core client for 30 sec - exiting 13:34:59 (24624): No heartbeat from core client for 30 sec - exiting 13:35:00 (24624): No heartbeat from core client for 30 sec - exiting 13:35:01 (24624): No heartbeat from core client for 30 sec - exiting 13:35:02 (24624): No heartbeat from core client for 30 sec - exiting 13:35:03 (24624): No heartbeat from core client for 30 sec - exiting 13:35:04 (24624): No heartbeat from core client for 30 sec - exiting 13:35:05 (24624): No heartbeat from core client for 30 sec - exiting 13:35:06 (24624): No heartbeat from core client for 30 sec - exiting 13:35:07 (24624): No heartbeat from core client for 30 sec - exiting 13:35:08 (24624): No heartbeat from core client for 30 sec - exiting 13:35:09 (24624): No heartbeat from core client for 30 sec - exiting 13:35:11 (24624): No heartbeat from core client for 30 sec - exiting 13:35:12 (24624): No heartbeat from core client for 30 sec - exiting 13:35:13 (24624): No heartbeat from core client for 30 sec - exiting 13:35:14 (24624): No heartbeat from core client for 30 sec - exiting 13:35:15 (24624): No heartbeat from core client for 30 sec - exiting 13:35:16 (24624): No heartbeat from core client for 30 sec - exiting 13:35:17 (24624): No heartbeat from core client for 30 sec - exiting 13:35:18 (24624): No heartbeat from core client for 30 sec - exiting 13:35:19 (24624): No heartbeat from core client for 30 sec - exiting 13:35:20 (24624): No heartbeat from core client for 30 sec - exiting 13:35:22 (24624): No heartbeat from core client for 30 sec - exiting 13:35:23 (24624): No heartbeat from core client for 30 sec - exiting 13:35:24 (24624): No heartbeat from core client for 30 sec - exiting 13:35:25 (24624): No heartbeat from core client for 30 sec - exiting 13:35:26 (24624): No heartbeat from core client for 30 sec - exiting 13:35:27 (24624): No heartbeat from core client for 30 sec - exiting 13:35:28 (24624): No heartbeat from core client for 30 sec - exiting 13:35:29 (24624): No heartbeat from core client for 30 sec - exiting 13:35:30 (24624): No heartbeat from core client for 30 sec - exiting 13:35:31 (24624): No heartbeat from core client for 30 sec - exiting 13:35:32 (24624): No heartbeat from core client for 30 sec - exiting 13:35:34 (24624): No heartbeat from core client for 30 sec - exiting 13:35:35 (24624): No heartbeat from core client for 30 sec - exiting 13:35:36 (24624): No heartbeat from core client for 30 sec - exiting 13:35:37 (24624): No heartbeat from core client for 30 sec - exiting 13:35:38 (24624): No heartbeat from core client for 30 sec - exiting 13:35:39 (24624): No heartbeat from core client for 30 sec - exiting 13:35:40 (24624): No heartbeat from core client for 30 sec - exiting 13:35:41 (24624): No heartbeat from core client for 30 sec - exiting 13:35:42 (24624): No heartbeat from core client for 30 sec - exiting 13:35:43 (24624): No heartbeat from core client for 30 sec - exiting 13:35:44 (24624): No heartbeat from core client for 30 sec - exiting 13:35:45 (24624): No heartbeat from core client for 30 sec - exiting 13:35:46 (24624): No heartbeat from core client for 30 sec - exiting 13:35:47 (24624): No heartbeat from core client for 30 sec - exiting 13:35:48 (24624): No heartbeat from core client for 30 sec - exiting 13:35:49 (24624): No heartbeat from core client for 30 sec - exiting 13:35:50 (24624): No heartbeat from core client for 30 sec - exiting 13:35:51 (24624): No heartbeat from core client for 30 sec - exiting 13:35:52 (24624): No heartbeat from core client for 30 sec - exiting 13:35:53 (24624): No heartbeat from core client for 30 sec - exiting 13:35:54 (24624): No heartbeat from core client for 30 sec - exiting 13:35:55 (24624): No heartbeat from core client for 30 sec - exiting 13:35:56 (24624): No heartbeat from core client for 30 sec - exiting 13:35:57 (24624): No heartbeat from core client for 30 sec - exiting 13:35:58 (24624): No heartbeat from core client for 30 sec - exiting 13:35:59 (24624): No heartbeat from core client for 30 sec - exiting 13:36:00 (24624): No heartbeat from core client for 30 sec - exiting 13:36:01 (24624): No heartbeat from core client for 30 sec - exiting 13:36:02 (24624): No heartbeat from core client for 30 sec - exiting 13:36:03 (24624): No heartbeat from core client for 30 sec - exiting 13:36:04 (24624): No heartbeat from core client for 30 sec - exiting 13:36:05 (24624): No heartbeat from core client for 30 sec - exiting 13:36:06 (24624): No heartbeat from core client for 30 sec - exiting 13:36:07 (24624): No heartbeat from core client for 30 sec - exiting 13:36:08 (24624): No heartbeat from core client for 30 sec - exiting 13:36:09 (24624): No heartbeat from core client for 30 sec - exiting 13:36:10 (24624): No heartbeat from core client for 30 sec - exiting 13:36:11 (24624): No heartbeat from core client for 30 sec - exiting 13:36:12 (24624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=40420, selfPID=40420, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=48180, selfPID=0, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=48180, selfPID=48180, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=49076, selfPID=49076, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=41060, selfPID=41060, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=49448, selfPID=49448, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=49268, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=49220, selfPID=47672, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_w00j_2006_1_010175975_0_4.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_w00j_2006_1_010175975_0_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_w00j_2006_1_010175975_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_w00j_2006_1_010175975_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_w00j_2006_1_010175975_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_w00j_2006_1_010175975_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_w00j_2006_1_010175975_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_w00j_2006_1_010175975_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_w00j_2006_1_010175975_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Sep 2015 06:59:57	1345147	18903637	hadam3p_anz_w00j_2006_1_010175975_0	34,859	156,650	4.4938
16 Sep 2015 03:57:23	1345147	18903637	hadam3p_anz_w00j_2006_1_010175975_0	23,339	104,587	4.4812
14 Sep 2015 15:20:43	1345147	18903637	hadam3p_anz_w00j_2006_1_010175975_0	11,819	52,642	4.4540