Task 18292653

Name	hadam3p_anz_m19v_2013_1_009738786_0
Workunit	9809784
Created	9 Apr 2015, 10:50:25 UTC
Sent	10 Apr 2015, 5:54:42 UTC
Report deadline	22 Mar 2016, 11:14:42 UTC
Received	13 May 2015, 3:36:09 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1351496
Run time	2 days 19 hours 31 min 26 sec
CPU time	2 days 10 hours 47 min 34 sec
Validate state	Invalid
Credit	1,503.36
Device peak FLOPS	3.79 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.27</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5300, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6264, selfPID=6264, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 01:01:47 (5560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:02:52 (364): No heartbeat from core client for 30 sec - exiting 01:02:53 (364): No heartbeat from core client for 30 sec - exiting 01:02:54 (364): No heartbeat from core client for 30 sec - exiting 01:02:55 (364): No heartbeat from core client for 30 sec - exiting 01:02:56 (364): No heartbeat from core client for 30 sec - exiting 01:02:57 (364): No heartbeat from core client for 30 sec - exiting 01:02:58 (364): No heartbeat from core client for 30 sec - exiting 01:02:59 (364): No heartbeat from core client for 30 sec - exiting 01:03:00 (364): No heartbeat from core client for 30 sec - exiting 01:03:01 (364): No heartbeat from core client for 30 sec - exiting 01:03:02 (364): No heartbeat from core client for 30 sec - exiting 01:03:03 (364): No heartbeat from core client for 30 sec - exiting 01:03:04 (364): No heartbeat from core client for 30 sec - exiting 01:03:05 (364): No heartbeat from core client for 30 sec - exiting 01:03:06 (364): No heartbeat from core client for 30 sec - exiting 01:03:07 (364): No heartbeat from core client for 30 sec - exiting 01:03:08 (364): No heartbeat from core client for 30 sec - exiting 01:03:09 (364): No heartbeat from core client for 30 sec - exiting 01:03:10 (364): No heartbeat from core client for 30 sec - exiting 01:03:11 (364): No heartbeat from core client for 30 sec - exiting 01:03:12 (364): No heartbeat from core client for 30 sec - exiting 01:03:13 (364): No heartbeat from core client for 30 sec - exiting 01:03:14 (364): No heartbeat from core client for 30 sec - exiting 01:03:15 (364): No heartbeat from core client for 30 sec - exiting 01:03:16 (364): No heartbeat from core client for 30 sec - exiting 01:03:17 (364): No heartbeat from core client for 30 sec - exiting 01:03:18 (364): No heartbeat from core client for 30 sec - exiting 01:03:19 (364): No heartbeat from core client for 30 sec - exiting 01:03:20 (364): No heartbeat from core client for 30 sec - exiting 01:03:21 (364): No heartbeat from core client for 30 sec - exiting 01:03:22 (364): No heartbeat from core client for 30 sec - exiting 01:03:23 (364): No heartbeat from core client for 30 sec - exiting 01:03:24 (364): No heartbeat from core client for 30 sec - exiting 01:03:25 (364): No heartbeat from core client for 30 sec - exiting 01:03:26 (364): No heartbeat from core client for 30 sec - exiting 01:03:27 (364): No heartbeat from core client for 30 sec - exiting 01:03:28 (364): No heartbeat from core client for 30 sec - exiting 01:03:29 (364): No heartbeat from core client for 30 sec - exiting 01:03:30 (364): No heartbeat from core client for 30 sec - exiting 01:03:31 (364): No heartbeat from core client for 30 sec - exiting 01:03:32 (364): No heartbeat from core client for 30 sec - exiting 01:03:33 (364): No heartbeat from core client for 30 sec - exiting 01:03:34 (364): No heartbeat from core client for 30 sec - exiting 01:03:35 (364): No heartbeat from core client for 30 sec - exiting 01:03:36 (364): No heartbeat from core client for 30 sec - exiting 01:03:37 (364): No heartbeat from core client for 30 sec - exiting 01:03:38 (364): No heartbeat from core client for 30 sec - exiting 01:03:39 (364): No heartbeat from core client for 30 sec - exiting 01:03:40 (364): No heartbeat from core client for 30 sec - exiting 01:03:41 (364): No heartbeat from core client for 30 sec - exiting 01:03:42 (364): No heartbeat from core client for 30 sec - exiting 01:03:43 (364): No heartbeat from core client for 30 sec - exiting 01:03:44 (364): No heartbeat from core client for 30 sec - exiting 01:03:45 (364): No heartbeat from core client for 30 sec - exiting 01:03:46 (364): No heartbeat from core client for 30 sec - exiting 01:03:47 (364): No heartbeat from core client for 30 sec - exiting 01:03:48 (364): No heartbeat from core client for 30 sec - exiting 01:03:49 (364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:05:36 (2464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4100, selfPID=4100, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5456, selfPID=5880, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5016, selfPID=5016, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6036, selfPID=3924, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:35:02 (5268): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:03:25 (10164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=2944, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1600, selfPID=1144, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_m19v_2013_1_009738786_0_4.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m19v_2013_1_009738786_0_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m19v_2013_1_009738786_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m19v_2013_1_009738786_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m19v_2013_1_009738786_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m19v_2013_1_009738786_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m19v_2013_1_009738786_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m19v_2013_1_009738786_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m19v_2013_1_009738786_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 May 2015 09:44:38	1351496	18292653	hadam3p_anz_m19v_2013_1_009738786_0	34,859	192,370	5.5185
08 May 2015 19:11:05	1351496	18292653	hadam3p_anz_m19v_2013_1_009738786_0	23,339	130,045	5.5720
19 Apr 2015 02:42:10	1351496	18292653	hadam3p_anz_m19v_2013_1_009738786_0	11,819	66,311	5.6105