Task 17533189

Name	hadam3p_anz_m16w_2012_1_009268716_0
Workunit	9361632
Created	1 Dec 2014, 16:19:51 UTC
Sent	2 Dec 2014, 6:13:20 UTC
Report deadline	14 Nov 2015, 11:33:20 UTC
Received	10 Dec 2014, 7:46:34 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1348064
Run time	4 days 18 hours 11 min 28 sec
CPU time	4 days 18 hours 11 min 28 sec
Validate state	Invalid
Credit	3,490.64
Device peak FLOPS	3.03 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.27</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 07:19:30 (3628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6996, selfPID=6996, iMonCtr=2 07:55:05 (7400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:28:03 (8004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:28:04 (8004): No heartbeat from core client for 30 sec - exiting 08:28:05 (8004): No heartbeat from core client for 30 sec - exiting 08:28:06 (8004): No heartbeat from core client for 30 sec - exiting 09:04:39 (8620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8492, selfPID=8492, iMonCtr=2 09:20:17 (9004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:29:36 (8276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:29:37 (8276): No heartbeat from core client for 30 sec - exiting 10:03:53 (8612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:16:31 (7780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:16:32 (7780): No heartbeat from core client for 30 sec - exiting 11:16:36 (7780): No heartbeat from core client for 30 sec - exiting 11:49:47 (6688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8816, selfPID=8816, iMonCtr=2 12:24:37 (7452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:38 (7452): No heartbeat from core client for 30 sec - exiting 12:24:39 (7452): No heartbeat from core client for 30 sec - exiting 12:24:40 (7452): No heartbeat from core client for 30 sec - exiting 12:24:41 (7452): No heartbeat from core client for 30 sec - exiting 12:24:42 (7452): No heartbeat from core client for 30 sec - exiting 12:53:13 (9680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:27:36 (8588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:27:37 (8588): No heartbeat from core client for 30 sec - exiting 13:27:38 (8588): No heartbeat from core client for 30 sec - exiting 13:27:39 (8588): No heartbeat from core client for 30 sec - exiting 13:27:40 (8588): No heartbeat from core client for 30 sec - exiting 13:27:41 (8588): No heartbeat from core client for 30 sec - exiting 13:27:42 (8588): No heartbeat from core client for 30 sec - exiting 13:27:43 (8588): No heartbeat from core client for 30 sec - exiting 13:27:44 (8588): No heartbeat from core client for 30 sec - exiting 13:27:45 (8588): No heartbeat from core client for 30 sec - exiting 13:27:46 (8588): No heartbeat from core client for 30 sec - exiting 13:28:47 (8824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:04:02 (9144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:10:33 (4356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:10:34 (4356): No heartbeat from core client for 30 sec - exiting 14:56:30 (9616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:56:31 (9616): No heartbeat from core client for 30 sec - exiting 15:31:30 (8880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:31:31 (8880): No heartbeat from core client for 30 sec - exiting 15:31:35 (8880): No heartbeat from core client for 30 sec - exiting 15:31:36 (8880): No heartbeat from core client for 30 sec - exiting 15:31:37 (8880): No heartbeat from core client for 30 sec - exiting 15:31:38 (8880): No heartbeat from core client for 30 sec - exiting 15:31:39 (8880): No heartbeat from core client for 30 sec - exiting 15:38:16 (9064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:38:17 (9064): No heartbeat from core client for 30 sec - exiting 15:38:19 (9064): No heartbeat from core client for 30 sec - exiting 15:38:24 (9064): No heartbeat from core client for 30 sec - exiting 15:38:26 (9064): No heartbeat from core client for 30 sec - exiting 15:38:27 (9064): No heartbeat from core client for 30 sec - exiting 16:03:01 (9524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:08:47 (10856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:08:48 (10856): No heartbeat from core client for 30 sec - exiting 16:08:49 (10856): No heartbeat from core client for 30 sec - exiting 16:08:51 (10856): No heartbeat from core client for 30 sec - exiting 16:08:52 (10856): No heartbeat from core client for 30 sec - exiting 16:08:53 (10856): No heartbeat from core client for 30 sec - exiting 16:08:54 (10856): No heartbeat from core client for 30 sec - exiting 16:32:38 (10984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:32:39 (10984): No heartbeat from core client for 30 sec - exiting 16:32:41 (10984): No heartbeat from core client for 30 sec - exiting 16:32:42 (10984): No heartbeat from core client for 30 sec - exiting 17:08:53 (7404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:08:54 (7404): No heartbeat from core client for 30 sec - exiting 17:08:55 (7404): No heartbeat from core client for 30 sec - exiting 17:10:43 (10624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:18:27 (8580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:18:28 (8580): No heartbeat from core client for 30 sec - exiting 17:18:32 (8580): No heartbeat from core client for 30 sec - exiting 17:18:33 (8580): No heartbeat from core client for 30 sec - exiting 17:18:35 (8580): No heartbeat from core client for 30 sec - exiting 17:29:30 (10468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:29:31 (10468): No heartbeat from core client for 30 sec - exiting 17:29:32 (10468): No heartbeat from core client for 30 sec - exiting 17:29:33 (10468): No heartbeat from core client for 30 sec - exiting 17:29:34 (10468): No heartbeat from core client for 30 sec - exiting 17:29:35 (10468): No heartbeat from core client for 30 sec - exiting 17:36:52 (10824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:36:53 (10824): No heartbeat from core client for 30 sec - exiting 17:36:54 (10824): No heartbeat from core client for 30 sec - exiting 17:36:55 (10824): No heartbeat from core client for 30 sec - exiting 17:36:56 (10824): No heartbeat from core client for 30 sec - exiting 17:45:17 (9876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:45:18 (9876): No heartbeat from core client for 30 sec - exiting 17:52:36 (10636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:02:04 (7480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:07:42 (10564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:07:43 (10564): No heartbeat from core client for 30 sec - exiting 18:07:45 (10564): No heartbeat from core client for 30 sec - exiting 18:07:48 (10564): No heartbeat from core client for 30 sec - exiting 18:07:49 (10564): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:17:52 (2400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:17:53 (2400): No heartbeat from core client for 30 sec - exiting 23:17:54 (2400): No heartbeat from core client for 30 sec - exiting 23:17:58 (2400): No heartbeat from core client for 30 sec - exiting 23:52:48 (10492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:52:49 (10492): No heartbeat from core client for 30 sec - exiting 23:52:50 (10492): No heartbeat from core client for 30 sec - exiting 23:52:51 (10492): No heartbeat from core client for 30 sec - exiting 23:52:52 (10492): No heartbeat from core client for 30 sec - exiting 02:00:34 (14192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 01:53:57 (960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:53:58 (960): No heartbeat from core client for 30 sec - exiting 01:53:59 (960): No heartbeat from core client for 30 sec - exiting 01:54:01 (960): No heartbeat from core client for 30 sec - exiting 01:54:02 (960): No heartbeat from core client for 30 sec - exiting 01:54:03 (960): No heartbeat from core client for 30 sec - exiting 01:54:04 (960): No heartbeat from core client for 30 sec - exiting 01:54:05 (960): No heartbeat from core client for 30 sec - exiting 01:54:06 (960): No heartbeat from core client for 30 sec - exiting 01:54:07 (960): No heartbeat from core client for 30 sec - exiting 02:27:43 (7560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:33:59 (8568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:34:00 (8568): No heartbeat from core client for 30 sec - exiting 03:34:01 (8568): No heartbeat from core client for 30 sec - exiting 03:34:02 (8568): No heartbeat from core client for 30 sec - exiting 03:34:03 (8568): No heartbeat from core client for 30 sec - exiting 03:34:06 (8568): No heartbeat from core client for 30 sec - exiting 03:34:07 (8568): No heartbeat from core client for 30 sec - exiting 03:34:08 (8568): No heartbeat from core client for 30 sec - exiting 03:34:09 (8568): No heartbeat from core client for 30 sec - exiting 04:07:40 (8940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:13:39 (1628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:47:25 (4944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:47:26 (4944): No heartbeat from core client for 30 sec - exiting 05:47:27 (4944): No heartbeat from core client for 30 sec - exiting 05:47:28 (4944): No heartbeat from core client for 30 sec - exiting 05:47:29 (4944): No heartbeat from core client for 30 sec - exiting 05:47:30 (4944): No heartbeat from core client for 30 sec - exiting 05:47:31 (4944): No heartbeat from core client for 30 sec - exiting 05:47:32 (4944): No heartbeat from core client for 30 sec - exiting 05:47:33 (4944): No heartbeat from core client for 30 sec - exiting 05:47:34 (4944): No heartbeat from core client for 30 sec - exiting 05:47:35 (4944): No heartbeat from core client for 30 sec - exiting 06:20:29 (7924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:53:14 (2472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:53:15 (2472): No heartbeat from core client for 30 sec - exiting 06:53:16 (2472): No heartbeat from core client for 30 sec - exiting 06:53:17 (2472): No heartbeat from core client for 30 sec - exiting 06:53:18 (2472): No heartbeat from core client for 30 sec - exiting 06:53:19 (2472): No heartbeat from core client for 30 sec - exiting 06:53:20 (2472): No heartbeat from core client for 30 sec - exiting 06:53:21 (2472): No heartbeat from core client for 30 sec - exiting 06:53:22 (2472): No heartbeat from core client for 30 sec - exiting 06:53:23 (2472): No heartbeat from core client for 30 sec - exiting 06:53:24 (2472): No heartbeat from core client for 30 sec - exiting 07:27:54 (6536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:02:27 (8048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:34:57 (9284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:08:59 (9532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:42:30 (7556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:42:31 (7556): No heartbeat from core client for 30 sec - exiting 09:42:32 (7556): No heartbeat from core client for 30 sec - exiting 09:42:33 (7556): No heartbeat from core client for 30 sec - exiting 09:42:34 (7556): No heartbeat from core client for 30 sec - exiting 09:42:35 (7556): No heartbeat from core client for 30 sec - exiting 09:42:36 (7556): No heartbeat from core client for 30 sec - exiting 09:42:37 (7556): No heartbeat from core client for 30 sec - exiting 09:42:38 (7556): No heartbeat from core client for 30 sec - exiting 09:42:39 (7556): No heartbeat from core client for 30 sec - exiting 09:42:40 (7556): No heartbeat from core client for 30 sec - exiting 11:21:21 (10036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4112, selfPID=4112, iMonCtr=2 11:56:03 (8356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:56:04 (8356): No heartbeat from core client for 30 sec - exiting 11:56:05 (8356): No heartbeat from core client for 30 sec - exiting 11:56:06 (8356): No heartbeat from core client for 30 sec - exiting 11:56:07 (8356): No heartbeat from core client for 30 sec - exiting 11:56:08 (8356): No heartbeat from core client for 30 sec - exiting 11:56:09 (8356): No heartbeat from core client for 30 sec - exiting 11:56:10 (8356): No heartbeat from core client for 30 sec - exiting 11:56:11 (8356): No heartbeat from core client for 30 sec - exiting 11:56:12 (8356): No heartbeat from core client for 30 sec - exiting 11:56:13 (8356): No heartbeat from core client for 30 sec - exiting 14:06:05 (9340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9612, selfPID=9612, iMonCtr=2 14:40:45 (10836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:40:46 (10836): No heartbeat from core client for 30 sec - exiting 17:19:49 (10728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:44:52 (8672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10344, selfPID=10344, iMonCtr=2 18:12:41 (11848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:12:42 (11848): No heartbeat from core client for 30 sec - exiting 18:38:42 (8644): No heartbeat from core client for 30 sec - exiting 18:38:43 (8644): No heartbeat from core client for 30 sec - exiting 18:38:44 (8644): No heartbeat from core client for 30 sec - exiting 18:38:45 (8644): No heartbeat from core client for 30 sec - exiting 18:38:46 (8644): No heartbeat from core client for 30 sec - exiting 18:38:47 (8644): No heartbeat from core client for 30 sec - exiting 18:38:48 (8644): No heartbeat from core client for 30 sec - exiting 18:38:49 (8644): No heartbeat from core client for 30 sec - exiting 18:38:50 (8644): No heartbeat from core client for 30 sec - exiting 18:38:51 (8644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:12:05 (12136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11776, selfPID=11776, iMonCtr=2 19:44:56 (11440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:44:57 (11440): No heartbeat from core client for 30 sec - exiting 19:44:58 (11440): No heartbeat from core client for 30 sec - exiting 19:45:02 (11440): No heartbeat from core client for 30 sec - exiting 19:45:03 (11440): No heartbeat from core client for 30 sec - exiting 19:45:04 (11440): No heartbeat from core client for 30 sec - exiting 19:45:05 (11440): No heartbeat from core client for 30 sec - exiting 19:45:06 (11440): No heartbeat from core client for 30 sec - exiting 20:18:39 (4660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:18:40 (4660): No heartbeat from core client for 30 sec - exiting 20:18:41 (4660): No heartbeat from core client for 30 sec - exiting 20:18:42 (4660): No heartbeat from core client for 30 sec - exiting 20:18:43 (4660): No heartbeat from core client for 30 sec - exiting 20:18:44 (4660): No heartbeat from core client for 30 sec - exiting 20:52:42 (11708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:52:43 (11708): No heartbeat from core client for 30 sec - exiting 20:52:44 (11708): No heartbeat from core client for 30 sec - exiting 20:52:45 (11708): No heartbeat from core client for 30 sec - exiting 20:52:46 (11708): No heartbeat from core client for 30 sec - exiting 20:52:47 (11708): No heartbeat from core client for 30 sec - exiting 20:52:48 (11708): No heartbeat from core client for 30 sec - exiting 21:25:31 (10532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:25:32 (10532): No heartbeat from core client for 30 sec - exiting 22:00:05 (12856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:33:46 (12308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:33:47 (12308): No heartbeat from core client for 30 sec - exiting 22:33:51 (12308): No heartbeat from core client for 30 sec - exiting 22:33:52 (12308): No heartbeat from core client for 30 sec - exiting 22:33:53 (12308): No heartbeat from core client for 30 sec - exiting 22:33:54 (12308): No heartbeat from core client for 30 sec - exiting 22:33:55 (12308): No heartbeat from core client for 30 sec - exiting 23:36:45 (12868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:36:46 (12868): No heartbeat from core client for 30 sec - exiting 23:36:47 (12868): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:39:20 (19868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:13:52 (23244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:13:53 (23244): No heartbeat from core client for 30 sec - exiting 06:13:54 (23244): No heartbeat from core client for 30 sec - exiting 06:13:55 (23244): No heartbeat from core client for 30 sec - exiting 06:13:56 (23244): No heartbeat from core client for 30 sec - exiting 06:13:57 (23244): No heartbeat from core client for 30 sec - exiting 06:13:58 (23244): No heartbeat from core client for 30 sec - exiting 06:13:59 (23244): No heartbeat from core client for 30 sec - exiting 06:14:00 (23244): No heartbeat from core client for 30 sec - exiting 08:19:28 (23400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=23260, selfPID=23260, iMonCtr=2 08:53:11 (24500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:53:12 (24500): No heartbeat from core client for 30 sec - exiting 08:53:13 (24500): No heartbeat from core client for 30 sec - exiting 09:27:32 (23204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:27:33 (23204): No heartbeat from core client for 30 sec - exiting 09:27:34 (23204): No heartbeat from core client for 30 sec - exiting 09:27:35 (23204): No heartbeat from core client for 30 sec - exiting 09:27:36 (23204): No heartbeat from core client for 30 sec - exiting 09:27:37 (23204): No heartbeat from core client for 30 sec - exiting 09:27:38 (23204): No heartbeat from core client for 30 sec - exiting 09:27:39 (23204): No heartbeat from core client for 30 sec - exiting 09:27:40 (23204): No heartbeat from core client for 30 sec - exiting 09:27:41 (23204): No heartbeat from core client for 30 sec - exiting 09:27:42 (23204): No heartbeat from core client for 30 sec - exiting 09:54:22 (24556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:59:29 (21716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:59:30 (21716): No heartbeat from core client for 30 sec - exiting 11:05:50 (24220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:39:03 (18704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:44:56 (4260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:44:57 (4260): No heartbeat from core client for 30 sec - exiting 12:44:58 (4260): No heartbeat from core client for 30 sec - exiting 13:17:59 (23828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:51:58 (23620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:51:59 (23620): No heartbeat from core client for 30 sec - exiting 14:25:04 (23084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:25:05 (23084): No heartbeat from core client for 30 sec - exiting 14:25:06 (23084): No heartbeat from core client for 30 sec - exiting 14:59:22 (21612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:59:23 (21612): No heartbeat from core client for 30 sec - exiting 14:59:24 (21612): No heartbeat from core client for 30 sec - exiting 14:59:25 (21612): No heartbeat from core client for 30 sec - exiting 14:59:26 (21612): No heartbeat from core client for 30 sec - exiting 14:59:27 (21612): No heartbeat from core client for 30 sec - exiting 15:05:56 (23900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:05:57 (23900): No heartbeat from core client for 30 sec - exiting 15:05:58 (23900): No heartbeat from core client for 30 sec - exiting 15:06:02 (23900): No heartbeat from core client for 30 sec - exiting 15:06:03 (23900): No heartbeat from core client for 30 sec - exiting 15:06:04 (23900): No heartbeat from core client for 30 sec - exiting 15:06:06 (23900): No heartbeat from core client for 30 sec - exiting 15:06:07 (23900): No heartbeat from core client for 30 sec - exiting 15:39:02 (23756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:43:33 (18716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:43:34 (18716): No heartbeat from core client for 30 sec - exiting 16:43:35 (18716): No heartbeat from core client for 30 sec - exiting 16:43:36 (18716): No heartbeat from core client for 30 sec - exiting 16:43:37 (18716): No heartbeat from core client for 30 sec - exiting 16:43:38 (18716): No heartbeat from core client for 30 sec - exiting 16:43:39 (18716): No heartbeat from core client for 30 sec - exiting 17:17:28 (19680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:17:29 (19680): No heartbeat from core client for 30 sec - exiting 17:17:30 (19680): No heartbeat from core client for 30 sec - exiting 17:17:31 (19680): No heartbeat from core client for 30 sec - exiting 17:17:32 (19680): No heartbeat from core client for 30 sec - exiting 17:17:33 (19680): No heartbeat from core client for 30 sec - exiting 17:17:34 (19680): No heartbeat from core client for 30 sec - exiting 17:17:35 (19680): No heartbeat from core client for 30 sec - exiting 17:17:36 (19680): No heartbeat from core client for 30 sec - exiting 17:17:37 (19680): No heartbeat from core client for 30 sec - exiting 17:17:38 (19680): No heartbeat from core client for 30 sec - exiting 17:52:36 (24748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:28:32 (20988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:28:33 (20988): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=25552, selfPID=25552, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 01:45:43 (29184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:19:20 (29564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=26848, selfPID=26848, iMonCtr=2 02:53:34 (29420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:33:37 (16492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=29192, selfPID=29192, iMonCtr=2 06:08:07 (28312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:08:08 (28312): No heartbeat from core client for 30 sec - exiting 06:08:09 (28312): No heartbeat from core client for 30 sec - exiting 07:14:14 (27516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:14:15 (27516): No heartbeat from core client for 30 sec - exiting 07:14:16 (27516): No heartbeat from core client for 30 sec - exiting 07:14:17 (27516): No heartbeat from core client for 30 sec - exiting 07:48:08 (29112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:48:09 (29112): No heartbeat from core client for 30 sec - exiting 07:48:11 (29112): No heartbeat from core client for 30 sec - exiting 07:48:12 (29112): No heartbeat from core client for 30 sec - exiting 07:48:13 (29112): No heartbeat from core client for 30 sec - exiting 07:48:14 (29112): No heartbeat from core client for 30 sec - exiting 07:48:15 (29112): No heartbeat from core client for 30 sec - exiting 07:48:16 (29112): No heartbeat from core client for 30 sec - exiting 07:48:17 (29112): No heartbeat from core client for 30 sec - exiting 07:48:18 (29112): No heartbeat from core client for 30 sec - exiting 08:22:59 (28700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:23:00 (28700): No heartbeat from core client for 30 sec - exiting 08:23:01 (28700): No heartbeat from core client for 30 sec - exiting 08:23:04 (28700): No heartbeat from core client for 30 sec - exiting 08:23:05 (28700): No heartbeat from core client for 30 sec - exiting 08:23:06 (28700): No heartbeat from core client for 30 sec - exiting 08:23:07 (28700): No heartbeat from core client for 30 sec - exiting 08:23:08 (28700): No heartbeat from core client for 30 sec - exiting 08:23:09 (28700): No heartbeat from core client for 30 sec - exiting 08:59:08 (25612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:05:04 (25804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:05:06 (25804): No heartbeat from core client for 30 sec - exiting 11:11:35 (29888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:11:36 (29888): No heartbeat from core client for 30 sec - exiting 11:11:37 (29888): No heartbeat from core client for 30 sec - exiting 11:11:38 (29888): No heartbeat from core client for 30 sec - exiting 11:11:40 (29888): No heartbeat from core client for 30 sec - exiting 11:11:41 (29888): No heartbeat from core client for 30 sec - exiting 11:44:30 (30668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:44:31 (30668): No heartbeat from core client for 30 sec - exiting 11:44:33 (30668): No heartbeat from core client for 30 sec - exiting 11:44:34 (30668): No heartbeat from core client for 30 sec - exiting 11:44:35 (30668): No heartbeat from core client for 30 sec - exiting 12:17:44 (30584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:52:02 (21596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:52:03 (21596): No heartbeat from core client for 30 sec - exiting 12:52:05 (21596): No heartbeat from core client for 30 sec - exiting 12:52:06 (21596): No heartbeat from core client for 30 sec - exiting 12:52:07 (21596): No heartbeat from core client for 30 sec - exiting 12:52:08 (21596): No heartbeat from core client for 30 sec - exiting 13:27:12 (29840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:22:55 (35036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:29:24 (34360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:29:25 (34360): No heartbeat from core client for 30 sec - exiting 01:29:29 (34360): No heartbeat from core client for 30 sec - exiting 02:03:48 (25780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:03:49 (25780): No heartbeat from core client for 30 sec - exiting 02:36:12 (32296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:10:55 (32600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:10:56 (32600): No heartbeat from core client for 30 sec - exiting 03:10:57 (32600): No heartbeat from core client for 30 sec - exiting 03:10:59 (32600): No heartbeat from core client for 30 sec - exiting 03:11:00 (32600): No heartbeat from core client for 30 sec - exiting 03:11:01 (32600): No heartbeat from core client for 30 sec - exiting 03:11:02 (32600): No heartbeat from core client for 30 sec - exiting 03:11:03 (32600): No heartbeat from core client for 30 sec - exiting 03:11:04 (32600): No heartbeat from core client for 30 sec - exiting 03:11:05 (32600): No heartbeat from core client for 30 sec - exiting 03:44:39 (35808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:44:40 (35808): No heartbeat from core client for 30 sec - exiting 03:44:41 (35808): No heartbeat from core client for 30 sec - exiting 03:44:42 (35808): No heartbeat from core client for 30 sec - exiting 03:50:17 (35056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:50:18 (35056): No heartbeat from core client for 30 sec - exiting 03:55:40 (34536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:23:07 (35084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:23:08 (35084): No heartbeat from core client for 30 sec - exiting 04:23:09 (35084): No heartbeat from core client for 30 sec - exiting 04:23:10 (35084): No heartbeat from core client for 30 sec - exiting 04:23:11 (35084): No heartbeat from core client for 30 sec - exiting 04:23:12 (35084): No heartbeat from core client for 30 sec - exiting 04:23:13 (35084): No heartbeat from core client for 30 sec - exiting 04:56:40 (32756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:56:41 (32756): No heartbeat from core client for 30 sec - exiting 04:56:42 (32756): No heartbeat from core client for 30 sec - exiting 04:56:43 (32756): No heartbeat from core client for 30 sec - exiting 04:56:44 (32756): No heartbeat from core client for 30 sec - exiting 04:56:45 (32756): No heartbeat from core client for 30 sec - exiting 04:56:46 (32756): No heartbeat from core client for 30 sec - exiting 04:56:47 (32756): No heartbeat from core client for 30 sec - exiting 04:56:48 (32756): No heartbeat from core client for 30 sec - exiting 04:56:49 (32756): No heartbeat from core client for 30 sec - exiting 04:56:50 (32756): No heartbeat from core client for 30 sec - exiting 05:32:09 (32472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:35:50 (34672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:35:51 (34672): No heartbeat from core client for 30 sec - exiting 06:35:52 (34672): No heartbeat from core client for 30 sec - exiting 06:35:53 (34672): No heartbeat from core client for 30 sec - exiting 06:35:54 (34672): No heartbeat from core client for 30 sec - exiting 06:35:55 (34672): No heartbeat from core client for 30 sec - exiting 07:07:46 (36792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:07:47 (36792): No heartbeat from core client for 30 sec - exiting 07:07:48 (36792): No heartbeat from core client for 30 sec - exiting 07:07:49 (36792): No heartbeat from core client for 30 sec - exiting 07:07:50 (36792): No heartbeat from core client for 30 sec - exiting 07:07:51 (36792): No heartbeat from core client for 30 sec - exiting 07:07:54 (36792): No heartbeat from core client for 30 sec - exiting 08:05:00 (36208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:38:40 (36644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:38:41 (36644): No heartbeat from core client for 30 sec - exiting 08:38:42 (36644): No heartbeat from core client for 30 sec - exiting 08:38:43 (36644): No heartbeat from core client for 30 sec - exiting 08:38:44 (36644): No heartbeat from core client for 30 sec - exiting 08:38:45 (36644): No heartbeat from core client for 30 sec - exiting 08:38:46 (36644): No heartbeat from core client for 30 sec - exiting 08:38:47 (36644): No heartbeat from core client for 30 sec - exiting 08:38:48 (36644): No heartbeat from core client for 30 sec - exiting 08:38:49 (36644): No heartbeat from core client for 30 sec - exiting 08:38:50 (36644): No heartbeat from core client for 30 sec - exiting 09:12:21 (36764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:44:20 (36604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:19:26 (35296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:19:27 (35296): No heartbeat from core client for 30 sec - exiting 11:19:28 (35296): No heartbeat from core client for 30 sec - exiting 11:19:29 (35296): No heartbeat from core client for 30 sec - exiting 11:19:30 (35296): No heartbeat from core client for 30 sec - exiting 11:19:31 (35296): No heartbeat from core client for 30 sec - exiting 12:55:00 (37864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:27:30 (37660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:27:31 (37660): No heartbeat from core client for 30 sec - exiting 13:27:32 (37660): No heartbeat from core client for 30 sec - exiting 14:00:18 (37560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:33:23 (36912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:33:24 (36912): No heartbeat from core client for 30 sec - exiting 14:33:25 (36912): No heartbeat from core client for 30 sec - exiting 14:33:26 (36912): No heartbeat from core client for 30 sec - exiting 14:33:27 (36912): No heartbeat from core client for 30 sec - exiting 14:33:28 (36912): No heartbeat from core client for 30 sec - exiting 14:33:29 (36912): No heartbeat from core client for 30 sec - exiting 14:33:30 (36912): No heartbeat from core client for 30 sec - exiting 14:33:31 (36912): No heartbeat from core client for 30 sec - exiting 14:33:32 (36912): No heartbeat from core client for 30 sec - exiting 14:33:33 (36912): No heartbeat from core client for 30 sec - exiting 15:07:40 (37004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:49:31 (40892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:49:32 (40892): No heartbeat from core client for 30 sec - exiting 22:49:33 (40892): No heartbeat from core client for 30 sec - exiting 22:49:34 (40892): No heartbeat from core client for 30 sec - exiting 22:49:35 (40892): No heartbeat from core client for 30 sec - exiting 22:49:36 (40892): No heartbeat from core client for 30 sec - exiting 23:22:20 (38608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:22:21 (38608): No heartbeat from core client for 30 sec - exiting 23:22:22 (38608): No heartbeat from core client for 30 sec - exiting 23:22:23 (38608): No heartbeat from core client for 30 sec - exiting 23:22:24 (38608): No heartbeat from core client for 30 sec - exiting 23:22:26 (38608): No heartbeat from core client for 30 sec - exiting 23:22:27 (38608): No heartbeat from core client for 30 sec - exiting 00:55:34 (39964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:31:29 (39712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:05:12 (39472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:05:13 (39472): No heartbeat from core client for 30 sec - exiting 02:05:14 (39472): No heartbeat from core client for 30 sec - exiting 02:05:15 (39472): No heartbeat from core client for 30 sec - exiting 02:05:16 (39472): No heartbeat from core client for 30 sec - exiting 02:05:17 (39472): No heartbeat from core client for 30 sec - exiting 02:05:18 (39472): No heartbeat from core client for 30 sec - exiting 02:05:19 (39472): No heartbeat from core client for 30 sec - exiting 02:05:21 (39472): No heartbeat from core client for 30 sec - exiting 02:05:22 (39472): No heartbeat from core client for 30 sec - exiting 02:05:23 (39472): No heartbeat from core client for 30 sec - exiting 02:39:21 (34220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=41520, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=33732, selfPID=40940, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_m16w_2012_1_009268716_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m16w_2012_1_009268716_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m16w_2012_1_009268716_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m16w_2012_1_009268716_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m16w_2012_1_009268716_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Dec 2014 15:44:31	1348064	17533189	hadam3p_anz_m16w_2012_1_009268716_0	80,939	372,597	4.6034
08 Dec 2014 15:29:25	1348064	17533189	hadam3p_anz_m16w_2012_1_009268716_0	69,419	319,475	4.6021
07 Dec 2014 14:57:05	1348064	17533189	hadam3p_anz_m16w_2012_1_009268716_0	57,899	266,298	4.5994
06 Dec 2014 18:15:11	1348064	17533189	hadam3p_anz_m16w_2012_1_009268716_0	46,379	214,674	4.6287
05 Dec 2014 23:50:45	1348064	17533189	hadam3p_anz_m16w_2012_1_009268716_0	34,859	159,917	4.5875
04 Dec 2014 02:23:00	1348064	17533189	hadam3p_anz_m16w_2012_1_009268716_0	23,339	107,319	4.5983
03 Dec 2014 11:02:35	1348064	17533189	hadam3p_anz_m16w_2012_1_009268716_0	11,819	54,573	4.6174