Task 19214414

Name	hadam3p_anz_k58p_201212_12_306_010268754_0
Workunit	10268754
Created	25 Jan 2016, 13:49:50 UTC
Sent	25 Jan 2016, 17:01:00 UTC
Report deadline	6 Jan 2017, 22:21:00 UTC
Received	13 Feb 2016, 1:39:56 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1360541
Run time	11 days 14 hours 6 min 4 sec
CPU time	8 days 22 hours 39 min 45 sec
Validate state	Invalid
Credit	4,981.10
Device peak FLOPS	2.23 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <stderr_txt> 21:34:48 (5804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:58:07 (2880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7744, iMonCtr=2 06:02:44 (4728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:19:57 (1708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=940, selfPID=5532, iMonCtr=1 Model crash detected, will try to restart... 23:30:23 (5744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:29:51 (6204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:29:52 (6204): No heartbeat from core client for 30 sec - exiting 03:29:53 (6204): No heartbeat from core client for 30 sec - exiting 03:29:54 (6204): No heartbeat from core client for 30 sec - exiting 03:29:55 (6204): No heartbeat from core client for 30 sec - exiting 03:29:56 (6204): No heartbeat from core client for 30 sec - exiting 03:29:57 (6204): No heartbeat from core client for 30 sec - exiting 03:29:58 (6204): No heartbeat from core client for 30 sec - exiting 03:29:59 (6204): No heartbeat from core client for 30 sec - exiting 03:30:00 (6204): No heartbeat from core client for 30 sec - exiting 03:30:01 (6204): No heartbeat from core client for 30 sec - exiting 05:21:42 (2476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:21:43 (2476): No heartbeat from core client for 30 sec - exiting 05:21:44 (2476): No heartbeat from core client for 30 sec - exiting 05:21:45 (2476): No heartbeat from core client for 30 sec - exiting 05:21:46 (2476): No heartbeat from core client for 30 sec - exiting 05:21:47 (2476): No heartbeat from core client for 30 sec - exiting 05:21:48 (2476): No heartbeat from core client for 30 sec - exiting 05:21:49 (2476): No heartbeat from core client for 30 sec - exiting 05:21:50 (2476): No heartbeat from core client for 30 sec - exiting 05:21:51 (2476): No heartbeat from core client for 30 sec - exiting 05:21:52 (2476): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7944, iMonCtr=2 21:02:56 (5628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:18:05 (7268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:41:42 (7836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:45:01 (2772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:12:52 (5572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:33:53 (7312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:34:21 (7936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:30:22 (8372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:07:10 (9368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:00:41 (5632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:49:39 (4116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:49:40 (4116): No heartbeat from core client for 30 sec - exiting 18:49:41 (4116): No heartbeat from core client for 30 sec - exiting 18:49:42 (4116): No heartbeat from core client for 30 sec - exiting 18:49:43 (4116): No heartbeat from core client for 30 sec - exiting 18:49:44 (4116): No heartbeat from core client for 30 sec - exiting 18:49:45 (4116): No heartbeat from core client for 30 sec - exiting 18:49:46 (4116): No heartbeat from core client for 30 sec - exiting 18:49:47 (4116): No heartbeat from core client for 30 sec - exiting 18:49:48 (4116): No heartbeat from core client for 30 sec - exiting 18:49:49 (4116): No heartbeat from core client for 30 sec - exiting 20:27:30 (1268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:43:35 (1880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:16:34 (5584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:50:53 (8184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:02:52 (5084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:07:22 (3832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:15:58 (2160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:44:36 (5224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:29:26 (7888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:29:27 (7888): No heartbeat from core client for 30 sec - exiting 02:29:28 (7888): No heartbeat from core client for 30 sec - exiting 02:29:29 (7888): No heartbeat from core client for 30 sec - exiting 02:29:30 (7888): No heartbeat from core client for 30 sec - exiting 02:29:31 (7888): No heartbeat from core client for 30 sec - exiting 02:29:32 (7888): No heartbeat from core client for 30 sec - exiting 02:29:33 (7888): No heartbeat from core client for 30 sec - exiting 02:29:34 (7888): No heartbeat from core client for 30 sec - exiting 02:29:35 (7888): No heartbeat from core client for 30 sec - exiting 02:29:36 (7888): No heartbeat from core client for 30 sec - exiting 05:45:59 (7120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8968, iMonCtr=2 21:43:06 (4892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:40:32 (8060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:40:33 (8060): No heartbeat from core client for 30 sec - exiting 05:40:34 (8060): No heartbeat from core client for 30 sec - exiting 05:40:35 (8060): No heartbeat from core client for 30 sec - exiting 05:40:36 (8060): No heartbeat from core client for 30 sec - exiting 05:40:37 (8060): No heartbeat from core client for 30 sec - exiting 05:40:38 (8060): No heartbeat from core client for 30 sec - exiting 05:40:39 (8060): No heartbeat from core client for 30 sec - exiting 05:40:40 (8060): No heartbeat from core client for 30 sec - exiting 05:40:41 (8060): No heartbeat from core client for 30 sec - exiting 05:40:42 (8060): No heartbeat from core client for 30 sec - exiting 22:33:13 (4308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:10:37 (4284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:10:38 (4284): No heartbeat from core client for 30 sec - exiting 02:10:39 (4284): No heartbeat from core client for 30 sec - exiting 02:10:40 (4284): No heartbeat from core client for 30 sec - exiting 02:10:41 (4284): No heartbeat from core client for 30 sec - exiting 02:10:42 (4284): No heartbeat from core client for 30 sec - exiting 02:10:43 (4284): No heartbeat from core client for 30 sec - exiting 02:10:44 (4284): No heartbeat from core client for 30 sec - exiting 02:10:45 (4284): No heartbeat from core client for 30 sec - exiting 02:10:46 (4284): No heartbeat from core client for 30 sec - exiting 02:10:47 (4284): No heartbeat from core client for 30 sec - exiting 10:18:11 (7036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:01:49 (7816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:14:39 (9832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:34:59 (8352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:47:27 (7540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:53:19 (13804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:53:20 (13804): No heartbeat from core client for 30 sec - exiting 18:53:21 (13804): No heartbeat from core client for 30 sec - exiting 18:53:22 (13804): No heartbeat from core client for 30 sec - exiting 18:53:23 (13804): No heartbeat from core client for 30 sec - exiting 18:53:24 (13804): No heartbeat from core client for 30 sec - exiting 18:53:25 (13804): No heartbeat from core client for 30 sec - exiting 18:53:26 (13804): No heartbeat from core client for 30 sec - exiting 18:53:27 (13804): No heartbeat from core client for 30 sec - exiting 18:53:28 (13804): No heartbeat from core client for 30 sec - exiting 18:53:29 (13804): No heartbeat from core client for 30 sec - exiting 22:45:49 (8500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:56:42 (14600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:55:07 (14744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:07:10 (16300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:03:27 (15056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:03:29 (15056): No heartbeat from core client for 30 sec - exiting 17:03:30 (15056): No heartbeat from core client for 30 sec - exiting 17:03:31 (15056): No heartbeat from core client for 30 sec - exiting 17:03:32 (15056): No heartbeat from core client for 30 sec - exiting 17:03:33 (15056): No heartbeat from core client for 30 sec - exiting 17:03:34 (15056): No heartbeat from core client for 30 sec - exiting 17:03:35 (15056): No heartbeat from core client for 30 sec - exiting 17:03:36 (15056): No heartbeat from core client for 30 sec - exiting 17:03:37 (15056): No heartbeat from core client for 30 sec - exiting 17:03:38 (15056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 21:42:59 (8760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:48:06 (18708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:10:42 (4628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:41:44 (7056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:25:42 (7468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5060, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4396, selfPID=6816, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3096, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4152, selfPID=5892, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 20:57:51 (6004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:13:59 (8048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:14:00 (8048): No heartbeat from core client for 30 sec - exiting 04:14:01 (8048): No heartbeat from core client for 30 sec - exiting 04:14:02 (8048): No heartbeat from core client for 30 sec - exiting 04:14:03 (8048): No heartbeat from core client for 30 sec - exiting 04:14:04 (8048): No heartbeat from core client for 30 sec - exiting 04:14:05 (8048): No heartbeat from core client for 30 sec - exiting 04:14:06 (8048): No heartbeat from core client for 30 sec - exiting 04:14:07 (8048): No heartbeat from core client for 30 sec - exiting 04:14:08 (8048): No heartbeat from core client for 30 sec - exiting 04:14:09 (8048): No heartbeat from core client for 30 sec - exiting 04:15:15 (7484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:15:16 (7484): No heartbeat from core client for 30 sec - exiting 04:15:17 (7484): No heartbeat from core client for 30 sec - exiting 04:15:18 (7484): No heartbeat from core client for 30 sec - exiting 04:15:19 (7484): No heartbeat from core client for 30 sec - exiting 04:15:20 (7484): No heartbeat from core client for 30 sec - exiting 04:15:21 (7484): No heartbeat from core client for 30 sec - exiting 04:15:22 (7484): No heartbeat from core client for 30 sec - exiting 04:15:23 (7484): No heartbeat from core client for 30 sec - exiting 04:15:24 (7484): No heartbeat from core client for 30 sec - exiting 04:15:25 (7484): No heartbeat from core client for 30 sec - exiting 06:49:05 (6316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:22:53 (4760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3684, iMonCtr=2 06:20:14 (5920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:40:58 (5084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:40:59 (5084): No heartbeat from core client for 30 sec - exiting 21:41:00 (5084): No heartbeat from core client for 30 sec - exiting 21:41:01 (5084): No heartbeat from core client for 30 sec - exiting 21:41:02 (5084): No heartbeat from core client for 30 sec - exiting 21:41:03 (5084): No heartbeat from core client for 30 sec - exiting 21:41:04 (5084): No heartbeat from core client for 30 sec - exiting 21:41:05 (5084): No heartbeat from core client for 30 sec - exiting 21:41:06 (5084): No heartbeat from core client for 30 sec - exiting 21:41:07 (5084): No heartbeat from core client for 30 sec - exiting 21:41:08 (5084): No heartbeat from core client for 30 sec - exiting 21:41:09 (5084): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6020, selfPID=6020, iMonCtr=2 01:40:45 (6740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:40:46 (6740): No heartbeat from core client for 30 sec - exiting 01:40:47 (6740): No heartbeat from core client for 30 sec - exiting 01:40:48 (6740): No heartbeat from core client for 30 sec - exiting 01:40:49 (6740): No heartbeat from core client for 30 sec - exiting 01:40:50 (6740): No heartbeat from core client for 30 sec - exiting 01:40:51 (6740): No heartbeat from core client for 30 sec - exiting 01:40:52 (6740): No heartbeat from core client for 30 sec - exiting 01:40:53 (6740): No heartbeat from core client for 30 sec - exiting 01:40:54 (6740): No heartbeat from core client for 30 sec - exiting 01:40:55 (6740): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=8832, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9084, selfPID=9084, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9084, selfPID=8056, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_k58p_201212_12_306_010268754_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_k58p_201212_12_306_010268754_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Feb 2016 00:40:22	1360541	19214414	hadam3p_anz_k58p_201212_12_306_010268754_0	115,499	772,082	6.6848
10 Feb 2016 07:59:10	1360541	19214414	hadam3p_anz_k58p_201212_12_306_010268754_0	103,979	692,138	6.6565
08 Feb 2016 04:08:42	1360541	19214414	hadam3p_anz_k58p_201212_12_306_010268754_0	92,459	605,941	6.5536
06 Feb 2016 12:48:36	1360541	19214414	hadam3p_anz_k58p_201212_12_306_010268754_0	80,939	520,337	6.4288
04 Feb 2016 15:38:14	1360541	19214414	hadam3p_anz_k58p_201212_12_306_010268754_0	69,419	438,181	6.3121
02 Feb 2016 06:43:24	1360541	19214414	hadam3p_anz_k58p_201212_12_306_010268754_0	57,899	362,525	6.2613
31 Jan 2016 13:39:09	1360541	19214414	hadam3p_anz_k58p_201212_12_306_010268754_0	46,379	286,394	6.1751
30 Jan 2016 00:08:32	1360541	19214414	hadam3p_anz_k58p_201212_12_306_010268754_0	34,859	205,427	5.8931
27 Jan 2016 19:33:01	1360541	19214414	hadam3p_anz_k58p_201212_12_306_010268754_0	23,339	125,652	5.3838
27 Jan 2016 05:07:28	1360541	19214414	hadam3p_anz_k58p_201212_12_306_010268754_0	11,819	74,433	6.2977