Task 18813563

Name	hadam3p_anz_a07y_2008_1_010095880_1
Workunit	10075470
Created	12 Aug 2015, 19:52:36 UTC
Sent	18 Aug 2015, 0:13:04 UTC
Report deadline	30 Jul 2016, 5:33:04 UTC
Received	24 Aug 2015, 0:26:48 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1303251
Run time	4 days 10 hours 4 min 52 sec
CPU time	3 days 11 hours 38 min 22 sec
Validate state	Invalid
Credit	4,981.10
Device peak FLOPS	3.22 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> 01:25:38 (41876): No heartbeat from core client for 30 sec - exiting 01:25:39 (41876): No heartbeat from core client for 30 sec - exiting 01:25:40 (41876): No heartbeat from core client for 30 sec - exiting 01:25:41 (41876): No heartbeat from core client for 30 sec - exiting 01:25:42 (41876): No heartbeat from core client for 30 sec - exiting 01:25:43 (41876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:14:12 (42480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:17:31 (42396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:17:32 (42396): No heartbeat from core client for 30 sec - exiting 05:29:04 (43192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:29:05 (43192): No heartbeat from core client for 30 sec - exiting 06:37:52 (43912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:11:35 (45348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:40:15 (45368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=45312, selfPID=45312, iMonCtr=2 08:48:04 (44700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=46228, selfPID=46228, iMonCtr=2 08:48:05 (44700): No heartbeat from core client for 30 sec - exiting 10:27:02 (46356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:27:03 (46356): No heartbeat from core client for 30 sec - exiting 12:15:51 (45248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:50:25 (39788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:50:26 (39788): No heartbeat from core client for 30 sec - exiting 14:57:38 (46412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:00:41 (47168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=46980, selfPID=46980, iMonCtr=2 15:05:18 (49040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=40824, selfPID=40824, iMonCtr=2 15:43:11 (45728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:06:42 (48464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:44:43 (50236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:24:58 (50696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:24:59 (50696): No heartbeat from core client for 30 sec - exiting 18:27:09 (51660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:53:02 (51476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:34:49 (46996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:42:58 (52396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:07:45 (53176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:45:28 (48788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:42:55 (50468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:42:56 (50468): No heartbeat from core client for 30 sec - exiting 01:17:52 (56020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:15:52 (56268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:15:53 (56268): No heartbeat from core client for 30 sec - exiting 05:43:42 (56516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:43:43 (56516): No heartbeat from core client for 30 sec - exiting 07:27:02 (56616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:27:04 (56616): No heartbeat from core client for 30 sec - exiting 08:32:12 (47356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:48:21 (55356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:32:08 (55500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:32:11 (55500): No heartbeat from core client for 30 sec - exiting 11:17:59 (5020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:18:00 (5020): No heartbeat from core client for 30 sec - exiting 12:22:39 (57376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:22:41 (57376): No heartbeat from core client for 30 sec - exiting 14:10:59 (5020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:47:17 (62944): No heartbeat from core client for 30 sec - exiting 15:47:19 (62944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:47:20 (62944): No heartbeat from core client for 30 sec - exiting 15:47:21 (62944): No heartbeat from core client for 30 sec - exiting 15:47:22 (62944): No heartbeat from core client for 30 sec - exiting 16:05:05 (62892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:05:07 (62892): No heartbeat from core client for 30 sec - exiting 16:05:08 (62892): No heartbeat from core client for 30 sec - exiting 16:05:09 (62892): No heartbeat from core client for 30 sec - exiting 16:50:32 (61488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:50:33 (61488): No heartbeat from core client for 30 sec - exiting 17:48:37 (62908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:56:47 (61152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:46:36 (59612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:46:38 (59612): No heartbeat from core client for 30 sec - exiting 19:58:30 (64856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:37:42 (65388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:02:52 (6704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:04:13 (3128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4204, selfPID=4204, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 12:45:54 (2596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:57:29 (9528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:28:03 (7572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:28:04 (7572): No heartbeat from core client for 30 sec - exiting 18:15:52 (8208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:51:43 (4160): No heartbeat from core client for 30 sec - exiting 18:51:44 (4160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:51:46 (4160): No heartbeat from core client for 30 sec - exiting 20:53:43 (8788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:29:03 (4232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:40:49 (6540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:07:27 (5360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:07:28 (5360): No heartbeat from core client for 30 sec - exiting 07:54:29 (6336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:00:16 (2532): No heartbeat from core client for 30 sec - exiting 08:00:17 (2532): No heartbeat from core client for 30 sec - exiting 08:00:18 (2532): No heartbeat from core client for 30 sec - exiting 08:00:19 (2532): No heartbeat from core client for 30 sec - exiting 08:00:20 (2532): No heartbeat from core client for 30 sec - exiting 08:00:21 (2532): No heartbeat from core client for 30 sec - exiting 08:00:22 (2532): No heartbeat from core client for 30 sec - exiting 08:00:23 (2532): No heartbeat from core client for 30 sec - exiting 08:00:24 (2532): No heartbeat from core client for 30 sec - exiting 08:00:25 (2532): No heartbeat from core client for 30 sec - exiting 08:00:26 (2532): No heartbeat from core client for 30 sec - exiting 08:00:27 (2532): No heartbeat from core client for 30 sec - exiting 08:00:28 (2532): No heartbeat from core client for 30 sec - exiting 08:00:29 (2532): No heartbeat from core client for 30 sec - exiting 08:00:30 (2532): No heartbeat from core client for 30 sec - exiting 08:00:31 (2532): No heartbeat from core client for 30 sec - exiting 08:00:32 (2532): No heartbeat from core client for 30 sec - exiting 08:00:33 (2532): No heartbeat from core client for 30 sec - exiting 08:00:34 (2532): No heartbeat from core client for 30 sec - exiting 08:00:35 (2532): No heartbeat from core client for 30 sec - exiting 08:00:36 (2532): No heartbeat from core client for 30 sec - exiting 08:00:37 (2532): No heartbeat from core client for 30 sec - exiting 08:00:38 (2532): No heartbeat from core client for 30 sec - exiting 08:00:39 (2532): No heartbeat from core client for 30 sec - exiting 08:00:40 (2532): No heartbeat from core client for 30 sec - exiting 08:00:41 (2532): No heartbeat from core client for 30 sec - exiting 08:00:42 (2532): No heartbeat from core client for 30 sec - exiting 08:00:43 (2532): No heartbeat from core client for 30 sec - exiting 08:00:44 (2532): No heartbeat from core client for 30 sec - exiting 08:00:45 (2532): No heartbeat from core client for 30 sec - exiting 08:00:46 (2532): No heartbeat from core client for 30 sec - exiting 08:00:47 (2532): No heartbeat from core client for 30 sec - exiting 08:00:48 (2532): No heartbeat from core client for 30 sec - exiting 08:00:49 (2532): No heartbeat from core client for 30 sec - exiting 08:00:50 (2532): No heartbeat from core client for 30 sec - exiting 08:00:51 (2532): No heartbeat from core client for 30 sec - exiting 08:00:52 (2532): No heartbeat from core client for 30 sec - exiting 08:00:53 (2532): No heartbeat from core client for 30 sec - exiting 08:00:54 (2532): No heartbeat from core client for 30 sec - exiting 08:00:55 (2532): No heartbeat from core client for 30 sec - exiting 08:00:56 (2532): No heartbeat from core client for 30 sec - exiting 08:00:57 (2532): No heartbeat from core client for 30 sec - exiting 08:00:58 (2532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:00:59 (2532): No heartbeat from core client for 30 sec - exiting 08:06:12 (7508): No heartbeat from core client for 30 sec - exiting 08:06:13 (7508): No heartbeat from core client for 30 sec - exiting 08:06:14 (7508): No heartbeat from core client for 30 sec - exiting 08:06:15 (7508): No heartbeat from core client for 30 sec - exiting 08:06:16 (7508): No heartbeat from core client for 30 sec - exiting 08:06:17 (7508): No heartbeat from core client for 30 sec - exiting 08:06:18 (7508): No heartbeat from core client for 30 sec - exiting 08:06:19 (7508): No heartbeat from core client for 30 sec - exiting 08:06:20 (7508): No heartbeat from core client for 30 sec - exiting 08:06:21 (7508): No heartbeat from core client for 30 sec - exiting 08:06:22 (7508): No heartbeat from core client for 30 sec - exiting 08:06:23 (7508): No heartbeat from core client for 30 sec - exiting 08:06:24 (7508): No heartbeat from core client for 30 sec - exiting 08:06:25 (7508): No heartbeat from core client for 30 sec - exiting 08:06:26 (7508): No heartbeat from core client for 30 sec - exiting 08:06:27 (7508): No heartbeat from core client for 30 sec - exiting 08:06:28 (7508): No heartbeat from core client for 30 sec - exiting 08:06:29 (7508): No heartbeat from core client for 30 sec - exiting 08:06:30 (7508): No heartbeat from core client for 30 sec - exiting 08:06:31 (7508): No heartbeat from core client for 30 sec - exiting 08:06:32 (7508): No heartbeat from core client for 30 sec - exiting 08:06:33 (7508): No heartbeat from core client for 30 sec - exiting 08:06:34 (7508): No heartbeat from core client for 30 sec - exiting 08:06:35 (7508): No heartbeat from core client for 30 sec - exiting 08:06:36 (7508): No heartbeat from core client for 30 sec - exiting 08:06:38 (7508): No heartbeat from core client for 30 sec - exiting 08:06:39 (7508): No heartbeat from core client for 30 sec - exiting 08:06:40 (7508): No heartbeat from core client for 30 sec - exiting 08:06:41 (7508): No heartbeat from core client for 30 sec - exiting 08:06:42 (7508): No heartbeat from core client for 30 sec - exiting 08:06:43 (7508): No heartbeat from core client for 30 sec - exiting 08:06:44 (7508): No heartbeat from core client for 30 sec - exiting 08:06:45 (7508): No heartbeat from core client for 30 sec - exiting 08:06:46 (7508): No heartbeat from core client for 30 sec - exiting 08:06:47 (7508): No heartbeat from core client for 30 sec - exiting 08:06:48 (7508): No heartbeat from core client for 30 sec - exiting 08:06:49 (7508): No heartbeat from core client for 30 sec - exiting 08:06:50 (7508): No heartbeat from core client for 30 sec - exiting 08:06:51 (7508): No heartbeat from core client for 30 sec - exiting 08:06:52 (7508): No heartbeat from core client for 30 sec - exiting 08:06:53 (7508): No heartbeat from core client for 30 sec - exiting 08:06:54 (7508): No heartbeat from core client for 30 sec - exiting 08:06:55 (7508): No heartbeat from core client for 30 sec - exiting 08:06:56 (7508): No heartbeat from core client for 30 sec - exiting 08:06:57 (7508): No heartbeat from core client for 30 sec - exiting 08:06:58 (7508): No heartbeat from core client for 30 sec - exiting 08:06:59 (7508): No heartbeat from core client for 30 sec - exiting 08:07:00 (7508): No heartbeat from core client for 30 sec - exiting 08:07:01 (7508): No heartbeat from core client for 30 sec - exiting 08:07:02 (7508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:14:43 (7256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:14:44 (7256): No heartbeat from core client for 30 sec - exiting 09:14:45 (7256): No heartbeat from core client for 30 sec - exiting 09:14:46 (7256): No heartbeat from core client for 30 sec - exiting 11:13:32 (6956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1964, selfPID=1964, iMonCtr=2 22:17:03 (5320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4416, selfPID=4416, iMonCtr=2 23:28:12 (4612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:19:01 (3660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:26:01 (2476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:56:16 (3492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:03:40 (3992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:50:30 (13232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11180, selfPID=11180, iMonCtr=2 14:57:32 (11132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:15:12 (17828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:25:35 (17964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:34:51 (14676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:58:20 (16992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:33:21 (20924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:11:14 (22768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:59:30 (26388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:15:38 (35304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:55:43 (19556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:24:10 (8860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:25:11 (6684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9424, selfPID=9424, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=792, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10044, selfPID=9888, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_a07y_2008_1_010095880_1_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a07y_2008_1_010095880_1_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Aug 2015 08:51:20	1303251	18813563	hadam3p_anz_a07y_2008_1_010095880_1	115,499	281,933	2.4410
22 Aug 2015 22:59:00	1303251	18813563	hadam3p_anz_a07y_2008_1_010095880_1	103,979	255,486	2.4571
22 Aug 2015 10:20:28	1303251	18813563	hadam3p_anz_a07y_2008_1_010095880_1	92,459	228,441	2.4707
22 Aug 2015 00:56:06	1303251	18813563	hadam3p_anz_a07y_2008_1_010095880_1	80,939	199,857	2.4692
21 Aug 2015 03:40:59	1303251	18813563	hadam3p_anz_a07y_2008_1_010095880_1	69,419	173,064	2.4930
20 Aug 2015 17:54:10	1303251	18813563	hadam3p_anz_a07y_2008_1_010095880_1	57,899	145,728	2.5169
20 Aug 2015 08:21:52	1303251	18813563	hadam3p_anz_a07y_2008_1_010095880_1	46,379	118,651	2.5583
20 Aug 2015 00:00:58	1303251	18813563	hadam3p_anz_a07y_2008_1_010095880_1	34,859	91,966	2.6382
19 Aug 2015 06:30:36	1303251	18813563	hadam3p_anz_a07y_2008_1_010095880_1	23,339	61,223	2.6232
18 Aug 2015 14:07:34	1303251	18813563	hadam3p_anz_a07y_2008_1_010095880_1	11,819	30,612	2.5901