Task 18902838

Name	hadam3p_anz_w023_1999_1_010175191_0
Workunit	10129347
Created	12 Sep 2015, 19:52:18 UTC
Sent	13 Sep 2015, 1:09:49 UTC
Report deadline	25 Aug 2016, 6:29:49 UTC
Received	30 Sep 2015, 14:03:06 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1207840
Run time	6 days 6 hours 39 min 24 sec
CPU time	5 days 20 hours 39 min 7 sec
Validate state	Invalid
Credit	2,993.82
Device peak FLOPS	3.14 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.6.9</core_client_version> <![CDATA[ <stderr_txt> 12:16:52 (3924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:15:00 (2656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:34:48 (2892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:38:36 (3536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:36:56 (508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:46:17 (3872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:44:37 (1928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:42:44 (1372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:40:08 (2228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:39:38 (3928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:38:39 (1728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:35:31 (3856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:12:11 (3336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:10:54 (3280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:09:52 (3444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:07:48 (288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1472, selfPID=1472, iMonCtr=2 17:06:18 (252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:52:26 (1824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2196, selfPID=2196, iMonCtr=2 16:40:14 (2228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2144, selfPID=2144, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:15:19 (2816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:12:24 (636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:47:32 (3152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:43:39 (2776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:45:35 (1360): No heartbeat from core client for 30 sec - exiting 16:45:36 (1360): No heartbeat from core client for 30 sec - exiting 16:45:37 (1360): No heartbeat from core client for 30 sec - exiting 16:45:38 (1360): No heartbeat from core client for 30 sec - exiting 16:45:39 (1360): No heartbeat from core client for 30 sec - exiting 16:45:40 (1360): No heartbeat from core client for 30 sec - exiting 16:45:41 (1360): No heartbeat from core client for 30 sec - exiting 16:45:42 (1360): No heartbeat from core client for 30 sec - exiting 16:45:43 (1360): No heartbeat from core client for 30 sec - exiting 16:45:44 (1360): No heartbeat from core client for 30 sec - exiting 16:45:45 (1360): No heartbeat from core client for 30 sec - exiting 16:45:47 (1360): No heartbeat from core client for 30 sec - exiting 16:45:48 (1360): No heartbeat from core client for 30 sec - exiting 16:45:49 (1360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:42:36 (3520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:43:40 (2716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:23:52 (1828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:51:41 (676): No heartbeat from core client for 30 sec - exiting 05:51:43 (676): No heartbeat from core client for 30 sec - exiting 05:51:44 (676): No heartbeat from core client for 30 sec - exiting 05:51:45 (676): No heartbeat from core client for 30 sec - exiting 05:51:46 (676): No heartbeat from core client for 30 sec - exiting 05:51:47 (676): No heartbeat from core client for 30 sec - exiting 05:51:48 (676): No heartbeat from core client for 30 sec - exiting 05:51:49 (676): No heartbeat from core client for 30 sec - exiting 05:51:50 (676): No heartbeat from core client for 30 sec - exiting 05:51:51 (676): No heartbeat from core client for 30 sec - exiting 05:51:52 (676): No heartbeat from core client for 30 sec - exiting 05:51:53 (676): No heartbeat from core client for 30 sec - exiting 05:51:55 (676): No heartbeat from core client for 30 sec - exiting 05:51:56 (676): No heartbeat from core client for 30 sec - exiting 05:51:57 (676): No heartbeat from core client for 30 sec - exiting 05:51:58 (676): No heartbeat from core client for 30 sec - exiting 05:51:59 (676): No heartbeat from core client for 30 sec - exiting 05:52:00 (676): No heartbeat from core client for 30 sec - exiting 05:52:01 (676): No heartbeat from core client for 30 sec - exiting 05:52:02 (676): No heartbeat from core client for 30 sec - exiting 05:52:03 (676): No heartbeat from core client for 30 sec - exiting 05:52:04 (676): No heartbeat from core client for 30 sec - exiting 05:52:05 (676): No heartbeat from core client for 30 sec - exiting 05:52:07 (676): No heartbeat from core client for 30 sec - exiting 05:52:08 (676): No heartbeat from core client for 30 sec - exiting 05:52:09 (676): No heartbeat from core client for 30 sec - exiting 05:52:10 (676): No heartbeat from core client for 30 sec - exiting 05:52:11 (676): No heartbeat from core client for 30 sec - exiting 05:52:12 (676): No heartbeat from core client for 30 sec - exiting 05:52:13 (676): No heartbeat from core client for 30 sec - exiting 05:52:14 (676): No heartbeat from core client for 30 sec - exiting 05:52:15 (676): No heartbeat from core client for 30 sec - exiting 05:52:16 (676): No heartbeat from core client for 30 sec - exiting 05:52:18 (676): No heartbeat from core client for 30 sec - exiting 05:52:19 (676): No heartbeat from core client for 30 sec - exiting 05:52:20 (676): No heartbeat from core client for 30 sec - exiting 05:52:21 (676): No heartbeat from core client for 30 sec - exiting 05:52:22 (676): No heartbeat from core client for 30 sec - exiting 05:52:23 (676): No heartbeat from core client for 30 sec - exiting 05:52:24 (676): No heartbeat from core client for 30 sec - exiting 05:52:25 (676): No heartbeat from core client for 30 sec - exiting 05:52:26 (676): No heartbeat from core client for 30 sec - exiting 05:52:27 (676): No heartbeat from core client for 30 sec - exiting 05:52:28 (676): No heartbeat from core client for 30 sec - exiting 05:52:30 (676): No heartbeat from core client for 30 sec - exiting 05:52:31 (676): No heartbeat from core client for 30 sec - exiting 05:52:32 (676): No heartbeat from core client for 30 sec - exiting 05:52:33 (676): No heartbeat from core client for 30 sec - exiting 05:52:34 (676): No heartbeat from core client for 30 sec - exiting 05:52:35 (676): No heartbeat from core client for 30 sec - exiting 05:52:36 (676): No heartbeat from core client for 30 sec - exiting 05:52:37 (676): No heartbeat from core client for 30 sec - exiting 05:52:38 (676): No heartbeat from core client for 30 sec - exiting 05:52:39 (676): No heartbeat from core client for 30 sec - exiting 05:52:40 (676): No heartbeat from core client for 30 sec - exiting 05:52:42 (676): No heartbeat from core client for 30 sec - exiting 05:52:43 (676): No heartbeat from core client for 30 sec - exiting 05:52:44 (676): No heartbeat from core client for 30 sec - exiting 05:52:45 (676): No heartbeat from core client for 30 sec - exiting 05:52:46 (676): No heartbeat from core client for 30 sec - exiting 05:52:47 (676): No heartbeat from core client for 30 sec - exiting 05:52:48 (676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:45:20 (3580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:47:02 (3864): No heartbeat from core client for 30 sec - exiting 10:47:03 (3864): No heartbeat from core client for 30 sec - exiting 10:47:04 (3864): No heartbeat from core client for 30 sec - exiting 10:47:05 (3864): No heartbeat from core client for 30 sec - exiting 10:47:06 (3864): No heartbeat from core client for 30 sec - exiting 10:47:07 (3864): No heartbeat from core client for 30 sec - exiting 10:47:09 (3864): No heartbeat from core client for 30 sec - exiting 10:47:10 (3864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:44:20 (3952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:45:24 (2772): No heartbeat from core client for 30 sec - exiting 12:45:25 (2772): No heartbeat from core client for 30 sec - exiting 12:45:26 (2772): No heartbeat from core client for 30 sec - exiting 12:45:27 (2772): No heartbeat from core client for 30 sec - exiting 12:45:29 (2772): No heartbeat from core client for 30 sec - exiting 12:45:30 (2772): No heartbeat from core client for 30 sec - exiting 12:45:31 (2772): No heartbeat from core client for 30 sec - exiting 12:45:32 (2772): No heartbeat from core client for 30 sec - exiting 12:45:33 (2772): No heartbeat from core client for 30 sec - exiting 12:45:34 (2772): No heartbeat from core client for 30 sec - exiting 12:45:35 (2772): No heartbeat from core client for 30 sec - exiting 12:45:36 (2772): No heartbeat from core client for 30 sec - exiting 12:45:37 (2772): No heartbeat from core client for 30 sec - exiting 12:45:38 (2772): No heartbeat from core client for 30 sec - exiting 12:45:39 (2772): No heartbeat from core client for 30 sec - exiting 12:45:41 (2772): No heartbeat from core client for 30 sec - exiting 12:45:42 (2772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:02:59 (4044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:01:16 (2744): No heartbeat from core client for 30 sec - exiting 15:01:18 (2744): No heartbeat from core client for 30 sec - exiting 15:01:19 (2744): No heartbeat from core client for 30 sec - exiting 15:01:20 (2744): No heartbeat from core client for 30 sec - exiting 15:01:21 (2744): No heartbeat from core client for 30 sec - exiting 15:01:22 (2744): No heartbeat from core client for 30 sec - exiting 15:01:23 (2744): No heartbeat from core client for 30 sec - exiting 15:01:24 (2744): No heartbeat from core client for 30 sec - exiting 15:01:25 (2744): No heartbeat from core client for 30 sec - exiting 15:01:26 (2744): No heartbeat from core client for 30 sec - exiting 15:01:27 (2744): No heartbeat from core client for 30 sec - exiting 15:01:29 (2744): No heartbeat from core client for 30 sec - exiting 15:01:30 (2744): No heartbeat from core client for 30 sec - exiting 15:01:31 (2744): No heartbeat from core client for 30 sec - exiting 15:01:32 (2744): No heartbeat from core client for 30 sec - exiting 15:01:33 (2744): No heartbeat from core client for 30 sec - exiting 15:01:34 (2744): No heartbeat from core client for 30 sec - exiting 15:01:35 (2744): No heartbeat from core client for 30 sec - exiting 15:01:36 (2744): No heartbeat from core client for 30 sec - exiting 15:01:37 (2744): No heartbeat from core client for 30 sec - exiting 15:01:38 (2744): No heartbeat from core client for 30 sec - exiting 15:01:39 (2744): No heartbeat from core client for 30 sec - exiting 15:01:41 (2744): No heartbeat from core client for 30 sec - exiting 15:01:42 (2744): No heartbeat from core client for 30 sec - exiting 15:01:43 (2744): No heartbeat from core client for 30 sec - exiting 15:01:44 (2744): No heartbeat from core client for 30 sec - exiting 15:01:45 (2744): No heartbeat from core client for 30 sec - exiting 15:01:46 (2744): No heartbeat from core client for 30 sec - exiting 15:01:47 (2744): No heartbeat from core client for 30 sec - exiting 15:01:48 (2744): No heartbeat from core client for 30 sec - exiting 15:01:49 (2744): No heartbeat from core client for 30 sec - exiting 15:01:50 (2744): No heartbeat from core client for 30 sec - exiting 15:01:51 (2744): No heartbeat from core client for 30 sec - exiting 15:01:53 (2744): No heartbeat from core client for 30 sec - exiting 15:01:54 (2744): No heartbeat from core client for 30 sec - exiting 15:01:55 (2744): No heartbeat from core client for 30 sec - exiting 15:01:56 (2744): No heartbeat from core client for 30 sec - exiting 15:01:57 (2744): No heartbeat from core client for 30 sec - exiting 15:01:58 (2744): No heartbeat from core client for 30 sec - exiting 15:01:59 (2744): No heartbeat from core client for 30 sec - exiting 15:02:00 (2744): No heartbeat from core client for 30 sec - exiting 15:02:01 (2744): No heartbeat from core client for 30 sec - exiting 15:02:02 (2744): No heartbeat from core client for 30 sec - exiting 15:02:04 (2744): No heartbeat from core client for 30 sec - exiting 15:02:05 (2744): No heartbeat from core client for 30 sec - exiting 15:02:06 (2744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: inactr1: Can not open stash_sets file Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3628, selfPID=940, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_w023_1999_1_010175191_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_w023_1999_1_010175191_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_w023_1999_1_010175191_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_w023_1999_1_010175191_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_w023_1999_1_010175191_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_w023_1999_1_010175191_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Sep 2015 06:13:02	1207840	18902838	hadam3p_anz_w023_1999_1_010175191_0	69,419	455,901	6.5674
25 Sep 2015 09:45:41	1207840	18902838	hadam3p_anz_w023_1999_1_010175191_0	57,899	380,438	6.5707
23 Sep 2015 08:12:49	1207840	18902838	hadam3p_anz_w023_1999_1_010175191_0	46,379	304,117	6.5572
19 Sep 2015 07:45:28	1207840	18902838	hadam3p_anz_w023_1999_1_010175191_0	34,859	227,662	6.5309
15 Sep 2015 10:12:31	1207840	18902838	hadam3p_anz_w023_1999_1_010175191_0	23,339	151,211	6.4789
13 Sep 2015 23:28:21	1207840	18902838	hadam3p_anz_w023_1999_1_010175191_0	11,819	75,626	6.3987