Task 16628673

Name	hadam3p_anz_rby7_2012_1_008745101_0
Workunit	8891079
Created	8 May 2014, 20:09:05 UTC
Sent	8 May 2014, 23:48:57 UTC
Report deadline	21 Apr 2015, 5:08:57 UTC
Received	29 May 2014, 6:57:27 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1214168
Run time	7 days 9 hours 26 min 39 sec
CPU time	7 days 2 hours 25 min 31 sec
Validate state	Invalid
Credit	3,987.46
Device peak FLOPS	2.94 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:26:24 (4852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4780, selfPID=4780, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:51:34 (5068): No heartbeat from core client for 30 sec - exiting 01:51:36 (5068): No heartbeat from core client for 30 sec - exiting 01:51:37 (5068): No heartbeat from core client for 30 sec - exiting 01:51:38 (5068): No heartbeat from core client for 30 sec - exiting 01:51:39 (5068): No heartbeat from core client for 30 sec - exiting 01:51:40 (5068): No heartbeat from core client for 30 sec - exiting 01:51:41 (5068): No heartbeat from core client for 30 sec - exiting 01:51:42 (5068): No heartbeat from core client for 30 sec - exiting 01:51:43 (5068): No heartbeat from core client for 30 sec - exiting 01:51:44 (5068): No heartbeat from core client for 30 sec - exiting 01:51:45 (5068): No heartbeat from core client for 30 sec - exiting 01:51:46 (5068): No heartbeat from core client for 30 sec - exiting 01:51:47 (5068): No heartbeat from core client for 30 sec - exiting 01:51:48 (5068): No heartbeat from core client for 30 sec - exiting 01:51:49 (5068): No heartbeat from core client for 30 sec - exiting 01:51:50 (5068): No heartbeat from core client for 30 sec - exiting 01:51:51 (5068): No heartbeat from core client for 30 sec - exiting 01:51:52 (5068): No heartbeat from core client for 30 sec - exiting 01:51:53 (5068): No heartbeat from core client for 30 sec - exiting 01:51:54 (5068): No heartbeat from core client for 30 sec - exiting 01:51:55 (5068): No heartbeat from core client for 30 sec - exiting 01:51:56 (5068): No heartbeat from core client for 30 sec - exiting 01:51:57 (5068): No heartbeat from core client for 30 sec - exiting 01:51:58 (5068): No heartbeat from core client for 30 sec - exiting 01:51:59 (5068): No heartbeat from core client for 30 sec - exiting 01:52:00 (5068): No heartbeat from core client for 30 sec - exiting 01:52:01 (5068): No heartbeat from core client for 30 sec - exiting 01:52:02 (5068): No heartbeat from core client for 30 sec - exiting 01:52:03 (5068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:52:05 (5068): No heartbeat from core client for 30 sec - exiting 01:52:06 (5068): No heartbeat from core client for 30 sec - exiting 01:52:07 (5068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:17:17 (6272): No heartbeat from core client for 30 sec - exiting 11:17:18 (6272): No heartbeat from core client for 30 sec - exiting 11:17:19 (6272): No heartbeat from core client for 30 sec - exiting 11:17:20 (6272): No heartbeat from core client for 30 sec - exiting 11:17:21 (6272): No heartbeat from core client for 30 sec - exiting 11:17:22 (6272): No heartbeat from core client for 30 sec - exiting 11:17:23 (6272): No heartbeat from core client for 30 sec - exiting 11:17:24 (6272): No heartbeat from core client for 30 sec - exiting 11:17:25 (6272): No heartbeat from core client for 30 sec - exiting 11:17:26 (6272): No heartbeat from core client for 30 sec - exiting 11:17:27 (6272): No heartbeat from core client for 30 sec - exiting 11:17:28 (6272): No heartbeat from core client for 30 sec - exiting 11:17:29 (6272): No heartbeat from core client for 30 sec - exiting 11:17:30 (6272): No heartbeat from core client for 30 sec - exiting 11:17:31 (6272): No heartbeat from core client for 30 sec - exiting 11:17:32 (6272): No heartbeat from core client for 30 sec - exiting 11:17:33 (6272): No heartbeat from core client for 30 sec - exiting 11:17:34 (6272): No heartbeat from core client for 30 sec - exiting 11:17:35 (6272): No heartbeat from core client for 30 sec - exiting 11:17:36 (6272): No heartbeat from core client for 30 sec - exiting 11:17:37 (6272): No heartbeat from core client for 30 sec - exiting 11:17:38 (6272): No heartbeat from core client for 30 sec - exiting 11:17:39 (6272): No heartbeat from core client for 30 sec - exiting 11:17:40 (6272): No heartbeat from core client for 30 sec - exiting 11:17:41 (6272): No heartbeat from core client for 30 sec - exiting 11:17:42 (6272): No heartbeat from core client for 30 sec - exiting 11:17:43 (6272): No heartbeat from core client for 30 sec - exiting 11:17:44 (6272): No heartbeat from core client for 30 sec - exiting 11:17:45 (6272): No heartbeat from core client for 30 sec - exiting 11:17:46 (6272): No heartbeat from core client for 30 sec - exiting 11:17:47 (6272): No heartbeat from core client for 30 sec - exiting 11:17:48 (6272): No heartbeat from core client for 30 sec - exiting 11:17:49 (6272): No heartbeat from core client for 30 sec - exiting 11:17:50 (6272): No heartbeat from core client for 30 sec - exiting 11:17:51 (6272): No heartbeat from core client for 30 sec - exiting 11:17:52 (6272): No heartbeat from core client for 30 sec - exiting 11:17:53 (6272): No heartbeat from core client for 30 sec - exiting 11:17:54 (6272): No heartbeat from core client for 30 sec - exiting 11:17:55 (6272): No heartbeat from core client for 30 sec - exiting 11:17:56 (6272): No heartbeat from core client for 30 sec - exiting 11:17:57 (6272): No heartbeat from core client for 30 sec - exiting 11:17:58 (6272): No heartbeat from core client for 30 sec - exiting 11:17:59 (6272): No heartbeat from core client for 30 sec - exiting 11:18:01 (6272): No heartbeat from core client for 30 sec - exiting 11:18:05 (6272): No heartbeat from core client for 30 sec - exiting 11:18:06 (6272): No heartbeat from core client for 30 sec - exiting 11:18:08 (6272): No heartbeat from core client for 30 sec - exiting 11:18:09 (6272): No heartbeat from core client for 30 sec - exiting 11:18:47 (6272): No heartbeat from core client for 30 sec - exiting 11:18:48 (6272): No heartbeat from core client for 30 sec - exiting 11:18:49 (6272): No heartbeat from core client for 30 sec - exiting 11:18:50 (6272): No heartbeat from core client for 30 sec - exiting 11:18:51 (6272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:18:52 (6272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7168, selfPID=7168, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7436, selfPID=7436, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:32:23 (6520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6864, selfPID=6864, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:56:52 (6304): No heartbeat from core client for 30 sec - exiting 09:56:53 (6304): No heartbeat from core client for 30 sec - exiting 09:56:55 (6304): No heartbeat from core client for 30 sec - exiting 09:56:56 (6304): No heartbeat from core client for 30 sec - exiting 09:56:57 (6304): No heartbeat from core client for 30 sec - exiting 09:56:58 (6304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:04:18 (2852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:14:05 (2632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:48:01 (620): No heartbeat from core client for 30 sec - exiting 17:48:02 (620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=3208, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7524, selfPID=1096, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_rby7_2012_1_008745101_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_rby7_2012_1_008745101_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_rby7_2012_1_008745101_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_rby7_2012_1_008745101_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 May 2014 15:22:08	1214168	16628673	hadam3p_anz_rby7_2012_1_008745101_0	92,459	590,899	6.3909
22 May 2014 18:17:07	1214168	16628673	hadam3p_anz_rby7_2012_1_008745101_0	80,939	516,178	6.3774
20 May 2014 05:36:07	1214168	16628673	hadam3p_anz_rby7_2012_1_008745101_0	69,419	436,880	6.2934
16 May 2014 17:23:12	1214168	16628673	hadam3p_anz_rby7_2012_1_008745101_0	57,899	369,976	6.3900
14 May 2014 10:19:54	1214168	16628673	hadam3p_anz_rby7_2012_1_008745101_0	46,379	298,512	6.4364
12 May 2014 17:57:16	1214168	16628673	hadam3p_anz_rby7_2012_1_008745101_0	34,859	220,760	6.3329
11 May 2014 12:08:48	1214168	16628673	hadam3p_anz_rby7_2012_1_008745101_0	23,339	148,345	6.3561
10 May 2014 09:30:11	1214168	16628673	hadam3p_anz_rby7_2012_1_008745101_0	11,819	75,206	6.3631