Task 16423735

Name	hadam3p_anz_n95r_2012_1_008599487_2
Workunit	8745999
Created	28 Mar 2014, 8:13:20 UTC
Sent	28 Mar 2014, 8:22:31 UTC
Report deadline	10 Mar 2015, 13:42:31 UTC
Received	20 Jun 2014, 8:39:28 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1262606
Run time	7 days 8 hours 32 min 14 sec
CPU time	7 days 8 hours 10 min 47 sec
Validate state	Invalid
Credit	3,490.64
Device peak FLOPS	2.80 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> 12:20:50 (2268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:21:26 (3776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1084, selfPID=1084, iMonCtr=2 12:23:25 (2752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:27:58 (4788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:30:08 (5564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:52:32 (3240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5304, selfPID=4912, iMonCtr=1 Model crash detected, will try to restart... 09:22:51 (1356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:42:56 (5188): No heartbeat from core client for 30 sec - exiting 11:42:57 (5188): No heartbeat from core client for 30 sec - exiting 11:42:58 (5188): No heartbeat from core client for 30 sec - exiting 11:42:59 (5188): No heartbeat from core client for 30 sec - exiting 11:43:00 (5188): No heartbeat from core client for 30 sec - exiting 11:43:01 (5188): No heartbeat from core client for 30 sec - exiting 11:43:02 (5188): No heartbeat from core client for 30 sec - exiting 11:43:03 (5188): No heartbeat from core client for 30 sec - exiting 11:43:04 (5188): No heartbeat from core client for 30 sec - exiting 11:43:05 (5188): No heartbeat from core client for 30 sec - exiting 11:43:06 (5188): No heartbeat from core client for 30 sec - exiting 11:43:07 (5188): No heartbeat from core client for 30 sec - exiting 11:43:08 (5188): No heartbeat from core client for 30 sec - exiting 11:43:09 (5188): No heartbeat from core client for 30 sec - exiting 11:43:10 (5188): No heartbeat from core client for 30 sec - exiting 11:43:11 (5188): No heartbeat from core client for 30 sec - exiting 11:43:12 (5188): No heartbeat from core client for 30 sec - exiting 11:43:13 (5188): No heartbeat from core client for 30 sec - exiting 11:43:14 (5188): No heartbeat from core client for 30 sec - exiting 11:43:15 (5188): No heartbeat from core client for 30 sec - exiting 11:43:16 (5188): No heartbeat from core client for 30 sec - exiting 11:43:17 (5188): No heartbeat from core client for 30 sec - exiting 11:43:18 (5188): No heartbeat from core client for 30 sec - exiting 11:43:19 (5188): No heartbeat from core client for 30 sec - exiting 11:43:20 (5188): No heartbeat from core client for 30 sec - exiting 11:43:21 (5188): No heartbeat from core client for 30 sec - exiting 11:43:22 (5188): No heartbeat from core client for 30 sec - exiting 11:43:23 (5188): No heartbeat from core client for 30 sec - exiting 11:43:24 (5188): No heartbeat from core client for 30 sec - exiting 11:43:25 (5188): No heartbeat from core client for 30 sec - exiting 11:43:26 (5188): No heartbeat from core client for 30 sec - exiting 11:43:27 (5188): No heartbeat from core client for 30 sec - exiting 11:43:28 (5188): No heartbeat from core client for 30 sec - exiting 11:43:29 (5188): No heartbeat from core client for 30 sec - exiting 11:43:30 (5188): No heartbeat from core client for 30 sec - exiting 11:43:31 (5188): No heartbeat from core client for 30 sec - exiting 11:43:32 (5188): No heartbeat from core client for 30 sec - exiting 11:43:33 (5188): No heartbeat from core client for 30 sec - exiting 11:43:34 (5188): No heartbeat from core client for 30 sec - exiting 11:43:35 (5188): No heartbeat from core client for 30 sec - exiting 11:43:36 (5188): No heartbeat from core client for 30 sec - exiting 11:43:37 (5188): No heartbeat from core client for 30 sec - exiting 11:43:38 (5188): No heartbeat from core client for 30 sec - exiting 11:43:39 (5188): No heartbeat from core client for 30 sec - exiting 11:43:40 (5188): No heartbeat from core client for 30 sec - exiting 11:43:41 (5188): No heartbeat from core client for 30 sec - exiting 11:43:42 (5188): No heartbeat from core client for 30 sec - exiting 11:43:43 (5188): No heartbeat from core client for 30 sec - exiting 11:43:44 (5188): No heartbeat from core client for 30 sec - exiting 11:43:45 (5188): No heartbeat from core client for 30 sec - exiting 11:43:46 (5188): No heartbeat from core client for 30 sec - exiting 11:43:47 (5188): No heartbeat from core client for 30 sec - exiting 11:43:48 (5188): No heartbeat from core client for 30 sec - exiting 11:43:49 (5188): No heartbeat from core client for 30 sec - exiting 11:43:50 (5188): No heartbeat from core client for 30 sec - exiting 11:43:51 (5188): No heartbeat from core client for 30 sec - exiting 11:43:52 (5188): No heartbeat from core client for 30 sec - exiting 11:43:53 (5188): No heartbeat from core client for 30 sec - exiting 11:43:54 (5188): No heartbeat from core client for 30 sec - exiting 11:43:55 (5188): No heartbeat from core client for 30 sec - exiting 11:43:56 (5188): No heartbeat from core client for 30 sec - exiting 11:43:57 (5188): No heartbeat from core client for 30 sec - exiting 11:43:58 (5188): No heartbeat from core client for 30 sec - exiting 11:43:59 (5188): No heartbeat from core client for 30 sec - exiting 11:44:00 (5188): No heartbeat from core client for 30 sec - exiting 11:44:01 (5188): No heartbeat from core client for 30 sec - exiting 11:44:02 (5188): No heartbeat from core client for 30 sec - exiting 11:44:03 (5188): No heartbeat from core client for 30 sec - exiting 11:44:04 (5188): No heartbeat from core client for 30 sec - exiting 11:44:05 (5188): No heartbeat from core client for 30 sec - exiting 11:44:06 (5188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:23:14 (5928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5092, selfPID=5092, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3280, selfPID=3896, iMonCtr=1 Model crash detected, will try to restart... 17:32:09 (3004): No heartbeat from core client for 30 sec - exiting 17:32:10 (3004): No heartbeat from core client for 30 sec - exiting 17:32:11 (3004): No heartbeat from core client for 30 sec - exiting 17:32:12 (3004): No heartbeat from core client for 30 sec - exiting 17:32:13 (3004): No heartbeat from core client for 30 sec - exiting 17:32:14 (3004): No heartbeat from core client for 30 sec - exiting 17:32:15 (3004): No heartbeat from core client for 30 sec - exiting 17:32:16 (3004): No heartbeat from core client for 30 sec - exiting 17:32:17 (3004): No heartbeat from core client for 30 sec - exiting 17:32:18 (3004): No heartbeat from core client for 30 sec - exiting 17:32:19 (3004): No heartbeat from core client for 30 sec - exiting 17:32:20 (3004): No heartbeat from core client for 30 sec - exiting 17:32:21 (3004): No heartbeat from core client for 30 sec - exiting 17:32:22 (3004): No heartbeat from core client for 30 sec - exiting 17:32:23 (3004): No heartbeat from core client for 30 sec - exiting 17:32:24 (3004): No heartbeat from core client for 30 sec - exiting 17:32:25 (3004): No heartbeat from core client for 30 sec - exiting 17:32:26 (3004): No heartbeat from core client for 30 sec - exiting 17:32:27 (3004): No heartbeat from core client for 30 sec - exiting 17:32:28 (3004): No heartbeat from core client for 30 sec - exiting 17:32:29 (3004): No heartbeat from core client for 30 sec - exiting 17:32:30 (3004): No heartbeat from core client for 30 sec - exiting 17:32:31 (3004): No heartbeat from core client for 30 sec - exiting 17:32:32 (3004): No heartbeat from core client for 30 sec - exiting 17:32:33 (3004): No heartbeat from core client for 30 sec - exiting 17:32:34 (3004): No heartbeat from core client for 30 sec - exiting 17:32:35 (3004): No heartbeat from core client for 30 sec - exiting 17:32:36 (3004): No heartbeat from core client for 30 sec - exiting 17:32:37 (3004): No heartbeat from core client for 30 sec - exiting 17:32:38 (3004): No heartbeat from core client for 30 sec - exiting 17:32:39 (3004): No heartbeat from core client for 30 sec - exiting 17:32:40 (3004): No heartbeat from core client for 30 sec - exiting 17:32:41 (3004): No heartbeat from core client for 30 sec - exiting 17:32:42 (3004): No heartbeat from core client for 30 sec - exiting 17:32:43 (3004): No heartbeat from core client for 30 sec - exiting 17:32:44 (3004): No heartbeat from core client for 30 sec - exiting 17:32:45 (3004): No heartbeat from core client for 30 sec - exiting 17:32:46 (3004): No heartbeat from core client for 30 sec - exiting 17:32:47 (3004): No heartbeat from core client for 30 sec - exiting 17:32:48 (3004): No heartbeat from core client for 30 sec - exiting 17:32:49 (3004): No heartbeat from core client for 30 sec - exiting 17:32:50 (3004): No heartbeat from core client for 30 sec - exiting 17:32:51 (3004): No heartbeat from core client for 30 sec - exiting 17:32:52 (3004): No heartbeat from core client for 30 sec - exiting 17:32:53 (3004): No heartbeat from core client for 30 sec - exiting 17:32:54 (3004): No heartbeat from core client for 30 sec - exiting 17:32:55 (3004): No heartbeat from core client for 30 sec - exiting 17:32:56 (3004): No heartbeat from core client for 30 sec - exiting 17:32:57 (3004): No heartbeat from core client for 30 sec - exiting 17:32:58 (3004): No heartbeat from core client for 30 sec - exiting 17:32:59 (3004): No heartbeat from core client for 30 sec - exiting 17:33:00 (3004): No heartbeat from core client for 30 sec - exiting 17:33:01 (3004): No heartbeat from core client for 30 sec - exiting 17:33:02 (3004): No heartbeat from core client for 30 sec - exiting 17:33:03 (3004): No heartbeat from core client for 30 sec - exiting 17:33:04 (3004): No heartbeat from core client for 30 sec - exiting 17:33:05 (3004): No heartbeat from core client for 30 sec - exiting 17:33:06 (3004): No heartbeat from core client for 30 sec - exiting 17:33:07 (3004): No heartbeat from core client for 30 sec - exiting 17:33:08 (3004): No heartbeat from core client for 30 sec - exiting 17:33:09 (3004): No heartbeat from core client for 30 sec - exiting 17:33:10 (3004): No heartbeat from core client for 30 sec - exiting 17:33:11 (3004): No heartbeat from core client for 30 sec - exiting 17:33:12 (3004): No heartbeat from core client for 30 sec - exiting 17:33:13 (3004): No heartbeat from core client for 30 sec - exiting 17:33:14 (3004): No heartbeat from core client for 30 sec - exiting 17:33:15 (3004): No heartbeat from core client for 30 sec - exiting 17:33:16 (3004): No heartbeat from core client for 30 sec - exiting 17:33:17 (3004): No heartbeat from core client for 30 sec - exiting 17:33:18 (3004): No heartbeat from core client for 30 sec - exiting 17:33:19 (3004): No heartbeat from core client for 30 sec - exiting 17:33:20 (3004): No heartbeat from core client for 30 sec - exiting 17:33:21 (3004): No heartbeat from core client for 30 sec - exiting 17:33:22 (3004): No heartbeat from core client for 30 sec - exiting 17:33:23 (3004): No heartbeat from core client for 30 sec - exiting 17:33:24 (3004): No heartbeat from core client for 30 sec - exiting 17:33:25 (3004): No heartbeat from core client for 30 sec - exiting 17:33:26 (3004): No heartbeat from core client for 30 sec - exiting 17:33:27 (3004): No heartbeat from core client for 30 sec - exiting 17:33:28 (3004): No heartbeat from core client for 30 sec - exiting 17:33:29 (3004): No heartbeat from core client for 30 sec - exiting 17:33:30 (3004): No heartbeat from core client for 30 sec - exiting 17:33:31 (3004): No heartbeat from core client for 30 sec - exiting 17:33:32 (3004): No heartbeat from core client for 30 sec - exiting 17:33:33 (3004): No heartbeat from core client for 30 sec - exiting 17:33:34 (3004): No heartbeat from core client for 30 sec - exiting 17:33:35 (3004): No heartbeat from core client for 30 sec - exiting 17:33:36 (3004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:37:17 (4192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4012, selfPID=4012, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4144, selfPID=4144, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 17:42:07 (5820): No heartbeat from core client for 30 sec - exiting 17:42:08 (5820): No heartbeat from core client for 30 sec - exiting 17:42:10 (5820): No heartbeat from core client for 30 sec - exiting 17:42:11 (5820): No heartbeat from core client for 30 sec - exiting 17:42:12 (5820): No heartbeat from core client for 30 sec - exiting 17:42:13 (5820): No heartbeat from core client for 30 sec - exiting 17:42:14 (5820): No heartbeat from core client for 30 sec - exiting 17:42:15 (5820): No heartbeat from core client for 30 sec - exiting 17:42:16 (5820): No heartbeat from core client for 30 sec - exiting 17:42:17 (5820): No heartbeat from core client for 30 sec - exiting 17:42:18 (5820): No heartbeat from core client for 30 sec - exiting 17:42:19 (5820): No heartbeat from core client for 30 sec - exiting 17:42:20 (5820): No heartbeat from core client for 30 sec - exiting 17:42:22 (5820): No heartbeat from core client for 30 sec - exiting 17:42:23 (5820): No heartbeat from core client for 30 sec - exiting 17:42:24 (5820): No heartbeat from core client for 30 sec - exiting 17:42:25 (5820): No heartbeat from core client for 30 sec - exiting 17:42:26 (5820): No heartbeat from core client for 30 sec - exiting 17:42:27 (5820): No heartbeat from core client for 30 sec - exiting 17:42:28 (5820): No heartbeat from core client for 30 sec - exiting 17:42:29 (5820): No heartbeat from core client for 30 sec - exiting 17:42:30 (5820): No heartbeat from core client for 30 sec - exiting 17:42:31 (5820): No heartbeat from core client for 30 sec - exiting 17:42:32 (5820): No heartbeat from core client for 30 sec - exiting 17:42:34 (5820): No heartbeat from core client for 30 sec - exiting 17:42:35 (5820): No heartbeat from core client for 30 sec - exiting 17:42:36 (5820): No heartbeat from core client for 30 sec - exiting 17:42:37 (5820): No heartbeat from core client for 30 sec - exiting 17:42:38 (5820): No heartbeat from core client for 30 sec - exiting 17:42:39 (5820): No heartbeat from core client for 30 sec - exiting 17:42:40 (5820): No heartbeat from core client for 30 sec - exiting 17:42:41 (5820): No heartbeat from core client for 30 sec - exiting 17:42:42 (5820): No heartbeat from core client for 30 sec - exiting 17:42:43 (5820): No heartbeat from core client for 30 sec - exiting 17:42:44 (5820): No heartbeat from core client for 30 sec - exiting 17:42:46 (5820): No heartbeat from core client for 30 sec - exiting 17:42:47 (5820): No heartbeat from core client for 30 sec - exiting 17:42:48 (5820): No heartbeat from core client for 30 sec - exiting 17:42:49 (5820): No heartbeat from core client for 30 sec - exiting 17:42:50 (5820): No heartbeat from core client for 30 sec - exiting 17:42:51 (5820): No heartbeat from core client for 30 sec - exiting 17:42:52 (5820): No heartbeat from core client for 30 sec - exiting 17:42:53 (5820): No heartbeat from core client for 30 sec - exiting 17:42:54 (5820): No heartbeat from core client for 30 sec - exiting 17:42:55 (5820): No heartbeat from core client for 30 sec - exiting 17:42:56 (5820): No heartbeat from core client for 30 sec - exiting 17:42:58 (5820): No heartbeat from core client for 30 sec - exiting 17:42:59 (5820): No heartbeat from core client for 30 sec - exiting 17:43:00 (5820): No heartbeat from core client for 30 sec - exiting 17:43:01 (5820): No heartbeat from core client for 30 sec - exiting 17:43:02 (5820): No heartbeat from core client for 30 sec - exiting 17:43:03 (5820): No heartbeat from core client for 30 sec - exiting 17:43:04 (5820): No heartbeat from core client for 30 sec - exiting 17:43:05 (5820): No heartbeat from core client for 30 sec - exiting 17:43:06 (5820): No heartbeat from core client for 30 sec - exiting 17:43:07 (5820): No heartbeat from core client for 30 sec - exiting 17:43:08 (5820): No heartbeat from core client for 30 sec - exiting 17:43:10 (5820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:27:08 (3424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5140, selfPID=5140, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5884, selfPID=5884, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:51:37 (5776): No heartbeat from core client for 30 sec - exiting 13:51:38 (5776): No heartbeat from core client for 30 sec - exiting 13:51:40 (5776): No heartbeat from core client for 30 sec - exiting 13:51:41 (5776): No heartbeat from core client for 30 sec - exiting 13:51:42 (5776): No heartbeat from core client for 30 sec - exiting 13:51:43 (5776): No heartbeat from core client for 30 sec - exiting 13:51:44 (5776): No heartbeat from core client for 30 sec - exiting 13:51:45 (5776): No heartbeat from core client for 30 sec - exiting 13:51:46 (5776): No heartbeat from core client for 30 sec - exiting 13:51:47 (5776): No heartbeat from core client for 30 sec - exiting 13:51:48 (5776): No heartbeat from core client for 30 sec - exiting 13:51:49 (5776): No heartbeat from core client for 30 sec - exiting 13:51:50 (5776): No heartbeat from core client for 30 sec - exiting 13:51:51 (5776): No heartbeat from core client for 30 sec - exiting 13:51:53 (5776): No heartbeat from core client for 30 sec - exiting 13:51:54 (5776): No heartbeat from core client for 30 sec - exiting 13:51:55 (5776): No heartbeat from core client for 30 sec - exiting 13:51:56 (5776): No heartbeat from core client for 30 sec - exiting 13:51:57 (5776): No heartbeat from core client for 30 sec - exiting 13:51:58 (5776): No heartbeat from core client for 30 sec - exiting 13:51:59 (5776): No heartbeat from core client for 30 sec - exiting 13:52:00 (5776): No heartbeat from core client for 30 sec - exiting 13:52:01 (5776): No heartbeat from core client for 30 sec - exiting 13:52:02 (5776): No heartbeat from core client for 30 sec - exiting 13:52:04 (5776): No heartbeat from core client for 30 sec - exiting 13:52:05 (5776): No heartbeat from core client for 30 sec - exiting 13:52:06 (5776): No heartbeat from core client for 30 sec - exiting 13:52:07 (5776): No heartbeat from core client for 30 sec - exiting 13:52:08 (5776): No heartbeat from core client for 30 sec - exiting 13:52:09 (5776): No heartbeat from core client for 30 sec - exiting 13:52:10 (5776): No heartbeat from core client for 30 sec - exiting 13:52:11 (5776): No heartbeat from core client for 30 sec - exiting 13:52:12 (5776): No heartbeat from core client for 30 sec - exiting 13:52:13 (5776): No heartbeat from core client for 30 sec - exiting 13:52:14 (5776): No heartbeat from core client for 30 sec - exiting 13:52:16 (5776): No heartbeat from core client for 30 sec - exiting 13:52:17 (5776): No heartbeat from core client for 30 sec - exiting 13:52:18 (5776): No heartbeat from core client for 30 sec - exiting 13:52:19 (5776): No heartbeat from core client for 30 sec - exiting 13:52:20 (5776): No heartbeat from core client for 30 sec - exiting 13:52:21 (5776): No heartbeat from core client for 30 sec - exiting 13:52:22 (5776): No heartbeat from core client for 30 sec - exiting 13:52:23 (5776): No heartbeat from core client for 30 sec - exiting 13:52:24 (5776): No heartbeat from core client for 30 sec - exiting 13:52:25 (5776): No heartbeat from core client for 30 sec - exiting 13:52:26 (5776): No heartbeat from core client for 30 sec - exiting 13:52:28 (5776): No heartbeat from core client for 30 sec - exiting 13:52:29 (5776): No heartbeat from core client for 30 sec - exiting 13:52:30 (5776): No heartbeat from core client for 30 sec - exiting 13:52:31 (5776): No heartbeat from core client for 30 sec - exiting 13:52:32 (5776): No heartbeat from core client for 30 sec - exiting 13:52:33 (5776): No heartbeat from core client for 30 sec - exiting 13:52:34 (5776): No heartbeat from core client for 30 sec - exiting 13:52:35 (5776): No heartbeat from core client for 30 sec - exiting 13:52:36 (5776): No heartbeat from core client for 30 sec - exiting 13:52:37 (5776): No heartbeat from core client for 30 sec - exiting 13:52:38 (5776): No heartbeat from core client for 30 sec - exiting 13:52:40 (5776): No heartbeat from core client for 30 sec - exiting 13:52:41 (5776): No heartbeat from core client for 30 sec - exiting 13:52:42 (5776): No heartbeat from core client for 30 sec - exiting 13:52:43 (5776): No heartbeat from core client for 30 sec - exiting 13:52:44 (5776): No heartbeat from core client for 30 sec - exiting 13:52:45 (5776): No heartbeat from core client for 30 sec - exiting 13:52:46 (5776): No heartbeat from core client for 30 sec - exiting 13:52:47 (5776): No heartbeat from core client for 30 sec - exiting 13:52:48 (5776): No heartbeat from core client for 30 sec - exiting 13:52:49 (5776): No heartbeat from core client for 30 sec - exiting 13:52:50 (5776): No heartbeat from core client for 30 sec - exiting 13:52:52 (5776): No heartbeat from core client for 30 sec - exiting 13:52:53 (5776): No heartbeat from core client for 30 sec - exiting 13:52:54 (5776): No heartbeat from core client for 30 sec - exiting 13:52:55 (5776): No heartbeat from core client for 30 sec - exiting 13:52:56 (5776): No heartbeat from core client for 30 sec - exiting 13:52:57 (5776): No heartbeat from core client for 30 sec - exiting 13:52:58 (5776): No heartbeat from core client for 30 sec - exiting 13:52:59 (5776): No heartbeat from core client for 30 sec - exiting 13:53:00 (5776): No heartbeat from core client for 30 sec - exiting 13:53:01 (5776): No heartbeat from core client for 30 sec - exiting 13:53:02 (5776): No heartbeat from core client for 30 sec - exiting 13:53:04 (5776): No heartbeat from core client for 30 sec - exiting 13:53:05 (5776): No heartbeat from core client for 30 sec - exiting 13:53:06 (5776): No heartbeat from core client for 30 sec - exiting 13:53:07 (5776): No heartbeat from core client for 30 sec - exiting 13:53:08 (5776): No heartbeat from core client for 30 sec - exiting 13:53:09 (5776): No heartbeat from core client for 30 sec - exiting 13:53:10 (5776): No heartbeat from core client for 30 sec - exiting 13:53:11 (5776): No heartbeat from core client for 30 sec - exiting 13:53:12 (5776): No heartbeat from core client for 30 sec - exiting 13:53:13 (5776): No heartbeat from core client for 30 sec - exiting 13:53:14 (5776): No heartbeat from core client for 30 sec - exiting 13:53:16 (5776): No heartbeat from core client for 30 sec - exiting 13:53:17 (5776): No heartbeat from core client for 30 sec - exiting 13:53:18 (5776): No heartbeat from core client for 30 sec - exiting 13:53:19 (5776): No heartbeat from core client for 30 sec - exiting 13:53:20 (5776): No heartbeat from core client for 30 sec - exiting 13:53:21 (5776): No heartbeat from core client for 30 sec - exiting 13:53:22 (5776): No heartbeat from core client for 30 sec - exiting 13:53:23 (5776): No heartbeat from core client for 30 sec - exiting 13:53:24 (5776): No heartbeat from core client for 30 sec - exiting 13:53:25 (5776): No heartbeat from core client for 30 sec - exiting 13:53:26 (5776): No heartbeat from core client for 30 sec - exiting 13:53:28 (5776): No heartbeat from core client for 30 sec - exiting 13:53:29 (5776): No heartbeat from core client for 30 sec - exiting 13:53:30 (5776): No heartbeat from core client for 30 sec - exiting 13:53:31 (5776): No heartbeat from core client for 30 sec - exiting 13:53:32 (5776): No heartbeat from core client for 30 sec - exiting 13:53:33 (5776): No heartbeat from core client for 30 sec - exiting 13:53:34 (5776): No heartbeat from core client for 30 sec - exiting 13:53:35 (5776): No heartbeat from core client for 30 sec - exiting 13:53:36 (5776): No heartbeat from core client for 30 sec - exiting 13:53:37 (5776): No heartbeat from core client for 30 sec - exiting 13:53:39 (5776): No heartbeat from core client for 30 sec - exiting 13:53:40 (5776): No heartbeat from core client for 30 sec - exiting 13:53:41 (5776): No heartbeat from core client for 30 sec - exiting 13:53:42 (5776): No heartbeat from core client for 30 sec - exiting 13:53:43 (5776): No heartbeat from core client for 30 sec - exiting 13:53:44 (5776): No heartbeat from core client for 30 sec - exiting 13:53:45 (5776): No heartbeat from core client for 30 sec - exiting 13:53:46 (5776): No heartbeat from core client for 30 sec - exiting 13:53:47 (5776): No heartbeat from core client for 30 sec - exiting 13:53:48 (5776): No heartbeat from core client for 30 sec - exiting 13:53:49 (5776): No heartbeat from core client for 30 sec - exiting 13:53:51 (5776): No heartbeat from core client for 30 sec - exiting 13:53:52 (5776): No heartbeat from core client for 30 sec - exiting 13:53:53 (5776): No heartbeat from core client for 30 sec - exiting 13:53:54 (5776): No heartbeat from core client for 30 sec - exiting 13:53:55 (5776): No heartbeat from core client for 30 sec - exiting 13:53:56 (5776): No heartbeat from core client for 30 sec - exiting 13:53:57 (5776): No heartbeat from core client for 30 sec - exiting 13:53:58 (5776): No heartbeat from core client for 30 sec - exiting 13:53:59 (5776): No heartbeat from core client for 30 sec - exiting 13:54:00 (5776): No heartbeat from core client for 30 sec - exiting 13:54:01 (5776): No heartbeat from core client for 30 sec - exiting 13:54:03 (5776): No heartbeat from core client for 30 sec - exiting 13:54:04 (5776): No heartbeat from core client for 30 sec - exiting 13:54:05 (5776): No heartbeat from core client for 30 sec - exiting 13:54:06 (5776): No heartbeat from core client for 30 sec - exiting 13:54:07 (5776): No heartbeat from core client for 30 sec - exiting 13:54:08 (5776): No heartbeat from core client for 30 sec - exiting 13:54:09 (5776): No heartbeat from core client for 30 sec - exiting 13:54:10 (5776): No heartbeat from core client for 30 sec - exiting 13:54:11 (5776): No heartbeat from core client for 30 sec - exiting 13:54:12 (5776): No heartbeat from core client for 30 sec - exiting 13:54:13 (5776): No heartbeat from core client for 30 sec - exiting 13:54:15 (5776): No heartbeat from core client for 30 sec - exiting 13:54:16 (5776): No heartbeat from core client for 30 sec - exiting 13:54:17 (5776): No heartbeat from core client for 30 sec - exiting 13:54:18 (5776): No heartbeat from core client for 30 sec - exiting 13:54:19 (5776): No heartbeat from core client for 30 sec - exiting 13:54:20 (5776): No heartbeat from core client for 30 sec - exiting 13:54:21 (5776): No heartbeat from core client for 30 sec - exiting 13:54:22 (5776): No heartbeat from core client for 30 sec - exiting 13:54:23 (5776): No heartbeat from core client for 30 sec - exiting 13:54:24 (5776): No heartbeat from core client for 30 sec - exiting 13:54:25 (5776): No heartbeat from core client for 30 sec - exiting 13:54:27 (5776): No heartbeat from core client for 30 sec - exiting 13:54:28 (5776): No heartbeat from core client for 30 sec - exiting 13:54:29 (5776): No heartbeat from core client for 30 sec - exiting 13:54:30 (5776): No heartbeat from core client for 30 sec - exiting 13:54:31 (5776): No heartbeat from core client for 30 sec - exiting 13:54:32 (5776): No heartbeat from core client for 30 sec - exiting 13:54:33 (5776): No heartbeat from core client for 30 sec - exiting 13:54:34 (5776): No heartbeat from core client for 30 sec - exiting 13:54:35 (5776): No heartbeat from core client for 30 sec - exiting 13:54:36 (5776): No heartbeat from core client for 30 sec - exiting 13:54:37 (5776): No heartbeat from core client for 30 sec - exiting 13:54:39 (5776): No heartbeat from core client for 30 sec - exiting 13:54:40 (5776): No heartbeat from core client for 30 sec - exiting 13:54:41 (5776): No heartbeat from core client for 30 sec - exiting 13:54:42 (5776): No heartbeat from core client for 30 sec - exiting 13:54:43 (5776): No heartbeat from core client for 30 sec - exiting 13:54:44 (5776): No heartbeat from core client for 30 sec - exiting 13:54:45 (5776): No heartbeat from core client for 30 sec - exiting 13:54:46 (5776): No heartbeat from core client for 30 sec - exiting 13:54:47 (5776): No heartbeat from core client for 30 sec - exiting 13:54:48 (5776): No heartbeat from core client for 30 sec - exiting 13:54:49 (5776): No heartbeat from core client for 30 sec - exiting 13:54:51 (5776): No heartbeat from core client for 30 sec - exiting 13:54:52 (5776): No heartbeat from core client for 30 sec - exiting 13:54:53 (5776): No heartbeat from core client for 30 sec - exiting 13:54:54 (5776): No heartbeat from core client for 30 sec - exiting 13:54:55 (5776): No heartbeat from core client for 30 sec - exiting 13:54:56 (5776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1588, selfPID=1588, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5296, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4144, selfPID=6124, iMonCtr=1 Model crash detected, will try to restart... 08:24:42 (5384): No heartbeat from core client for 30 sec - exiting 08:24:44 (5384): No heartbeat from core client for 30 sec - exiting 08:24:45 (5384): No heartbeat from core client for 30 sec - exiting 08:24:46 (5384): No heartbeat from core client for 30 sec - exiting 08:24:47 (5384): No heartbeat from core client for 30 sec - exiting 08:24:48 (5384): No heartbeat from core client for 30 sec - exiting 08:24:49 (5384): No heartbeat from core client for 30 sec - exiting 08:24:50 (5384): No heartbeat from core client for 30 sec - exiting 08:24:51 (5384): No heartbeat from core client for 30 sec - exiting 08:24:52 (5384): No heartbeat from core client for 30 sec - exiting 08:24:53 (5384): No heartbeat from core client for 30 sec - exiting 08:24:54 (5384): No heartbeat from core client for 30 sec - exiting 08:24:55 (5384): No heartbeat from core client for 30 sec - exiting 08:24:57 (5384): No heartbeat from core client for 30 sec - exiting 08:24:58 (5384): No heartbeat from core client for 30 sec - exiting 08:24:59 (5384): No heartbeat from core client for 30 sec - exiting 08:25:00 (5384): No heartbeat from core client for 30 sec - exiting 08:25:01 (5384): No heartbeat from core client for 30 sec - exiting 08:25:02 (5384): No heartbeat from core client for 30 sec - exiting 08:25:03 (5384): No heartbeat from core client for 30 sec - exiting 08:25:04 (5384): No heartbeat from core client for 30 sec - exiting 08:25:05 (5384): No heartbeat from core client for 30 sec - exiting 08:25:06 (5384): No heartbeat from core client for 30 sec - exiting 08:25:07 (5384): No heartbeat from core client for 30 sec - exiting 08:25:08 (5384): No heartbeat from core client for 30 sec - exiting 08:25:10 (5384): No heartbeat from core client for 30 sec - exiting 08:25:11 (5384): No heartbeat from core client for 30 sec - exiting 08:25:12 (5384): No heartbeat from core client for 30 sec - exiting 08:25:13 (5384): No heartbeat from core client for 30 sec - exiting 08:25:14 (5384): No heartbeat from core client for 30 sec - exiting 08:25:15 (5384): No heartbeat from core client for 30 sec - exiting 08:25:16 (5384): No heartbeat from core client for 30 sec - exiting 08:25:17 (5384): No heartbeat from core client for 30 sec - exiting 08:25:18 (5384): No heartbeat from core client for 30 sec - exiting 08:25:19 (5384): No heartbeat from core client for 30 sec - exiting 08:25:20 (5384): No heartbeat from core client for 30 sec - exiting 08:25:22 (5384): No heartbeat from core client for 30 sec - exiting 08:25:23 (5384): No heartbeat from core client for 30 sec - exiting 08:25:24 (5384): No heartbeat from core client for 30 sec - exiting 08:25:25 (5384): No heartbeat from core client for 30 sec - exiting 08:25:26 (5384): No heartbeat from core client for 30 sec - exiting 08:25:27 (5384): No heartbeat from core client for 30 sec - exiting 08:25:28 (5384): No heartbeat from core client for 30 sec - exiting 08:25:29 (5384): No heartbeat from core client for 30 sec - exiting 08:25:30 (5384): No heartbeat from core client for 30 sec - exiting 08:25:31 (5384): No heartbeat from core client for 30 sec - exiting 08:25:32 (5384): No heartbeat from core client for 30 sec - exiting 08:25:34 (5384): No heartbeat from core client for 30 sec - exiting 08:25:35 (5384): No heartbeat from core client for 30 sec - exiting 08:25:36 (5384): No heartbeat from core client for 30 sec - exiting 08:25:37 (5384): No heartbeat from core client for 30 sec - exiting 08:25:38 (5384): No heartbeat from core client for 30 sec - exiting 08:25:39 (5384): No heartbeat from core client for 30 sec - exiting 08:25:40 (5384): No heartbeat from core client for 30 sec - exiting 08:25:41 (5384): No heartbeat from core client for 30 sec - exiting 08:25:42 (5384): No heartbeat from core client for 30 sec - exiting 08:25:43 (5384): No heartbeat from core client for 30 sec - exiting 08:25:44 (5384): No heartbeat from core client for 30 sec - exiting 08:25:46 (5384): No heartbeat from core client for 30 sec - exiting 08:25:47 (5384): No heartbeat from core client for 30 sec - exiting 08:25:48 (5384): No heartbeat from core client for 30 sec - exiting 08:25:49 (5384): No heartbeat from core client for 30 sec - exiting 08:25:50 (5384): No heartbeat from core client for 30 sec - exiting 08:25:51 (5384): No heartbeat from core client for 30 sec - exiting 08:26:26 (5384): No heartbeat from core client for 30 sec - exiting 08:26:27 (5384): No heartbeat from core client for 30 sec - exiting 08:26:28 (5384): No heartbeat from core client for 30 sec - exiting 08:26:29 (5384): No heartbeat from core client for 30 sec - exiting 08:26:30 (5384): No heartbeat from core client for 30 sec - exiting 08:26:31 (5384): No heartbeat from core client for 30 sec - exiting 08:26:32 (5384): No heartbeat from core client for 30 sec - exiting 08:26:33 (5384): No heartbeat from core client for 30 sec - exiting 08:26:35 (5384): No heartbeat from core client for 30 sec - exiting 08:26:36 (5384): No heartbeat from core client for 30 sec - exiting 08:26:37 (5384): No heartbeat from core client for 30 sec - exiting 08:26:38 (5384): No heartbeat from core client for 30 sec - exiting 08:26:39 (5384): No heartbeat from core client for 30 sec - exiting 08:26:40 (5384): No heartbeat from core client for 30 sec - exiting 08:26:41 (5384): No heartbeat from core client for 30 sec - exiting 08:26:42 (5384): No heartbeat from core client for 30 sec - exiting 08:26:43 (5384): No heartbeat from core client for 30 sec - exiting 08:26:44 (5384): No heartbeat from core client for 30 sec - exiting 08:26:45 (5384): No heartbeat from core client for 30 sec - exiting 08:26:47 (5384): No heartbeat from core client for 30 sec - exiting 08:26:48 (5384): No heartbeat from core client for 30 sec - exiting 08:26:49 (5384): No heartbeat from core client for 30 sec - exiting 08:26:50 (5384): No heartbeat from core client for 30 sec - exiting 08:26:51 (5384): No heartbeat from core client for 30 sec - exiting 08:26:52 (5384): No heartbeat from core client for 30 sec - exiting 08:26:53 (5384): No heartbeat from core client for 30 sec - exiting 08:26:54 (5384): No heartbeat from core client for 30 sec - exiting 08:26:55 (5384): No heartbeat from core client for 30 sec - exiting 08:26:56 (5384): No heartbeat from core client for 30 sec - exiting 08:26:57 (5384): No heartbeat from core client for 30 sec - exiting 08:26:59 (5384): No heartbeat from core client for 30 sec - exiting 08:27:00 (5384): No heartbeat from core client for 30 sec - exiting 08:27:01 (5384): No heartbeat from core client for 30 sec - exiting 08:27:02 (5384): No heartbeat from core client for 30 sec - exiting 08:27:03 (5384): No heartbeat from core client for 30 sec - exiting 08:27:04 (5384): No heartbeat from core client for 30 sec - exiting 08:27:05 (5384): No heartbeat from core client for 30 sec - exiting 08:27:06 (5384): No heartbeat from core client for 30 sec - exiting 08:27:07 (5384): No heartbeat from core client for 30 sec - exiting 08:27:08 (5384): No heartbeat from core client for 30 sec - exiting 08:27:09 (5384): No heartbeat from core client for 30 sec - exiting 08:27:10 (5384): No heartbeat from core client for 30 sec - exiting 08:27:11 (5384): No heartbeat from core client for 30 sec - exiting 08:27:12 (5384): No heartbeat from core client for 30 sec - exiting 08:27:13 (5384): No heartbeat from core client for 30 sec - exiting 08:27:14 (5384): No heartbeat from core client for 30 sec - exiting 08:27:15 (5384): No heartbeat from core client for 30 sec - exiting 08:27:16 (5384): No heartbeat from core client for 30 sec - exiting 08:27:17 (5384): No heartbeat from core client for 30 sec - exiting 08:27:18 (5384): No heartbeat from core client for 30 sec - exiting 08:27:19 (5384): No heartbeat from core client for 30 sec - exiting 08:27:20 (5384): No heartbeat from core client for 30 sec - exiting 08:27:21 (5384): No heartbeat from core client for 30 sec - exiting 08:27:22 (5384): No heartbeat from core client for 30 sec - exiting 08:27:23 (5384): No heartbeat from core client for 30 sec - exiting 08:27:24 (5384): No heartbeat from core client for 30 sec - exiting 08:27:25 (5384): No heartbeat from core client for 30 sec - exiting 08:27:26 (5384): No heartbeat from core client for 30 sec - exiting 08:27:27 (5384): No heartbeat from core client for 30 sec - exiting 08:27:28 (5384): No heartbeat from core client for 30 sec - exiting 08:27:29 (5384): No heartbeat from core client for 30 sec - exiting 08:27:30 (5384): No heartbeat from core client for 30 sec - exiting 08:27:31 (5384): No heartbeat from core client for 30 sec - exiting 08:27:32 (5384): No heartbeat from core client for 30 sec - exiting 08:27:33 (5384): No heartbeat from core client for 30 sec - exiting 08:27:34 (5384): No heartbeat from core client for 30 sec - exiting 08:27:35 (5384): No heartbeat from core client for 30 sec - exiting 08:27:36 (5384): No heartbeat from core client for 30 sec - exiting 08:27:37 (5384): No heartbeat from core client for 30 sec - exiting 08:27:38 (5384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=1132, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3196, selfPID=4832, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_n95r_2012_1_008599487_2_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n95r_2012_1_008599487_2_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n95r_2012_1_008599487_2_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n95r_2012_1_008599487_2_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n95r_2012_1_008599487_2_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Jun 2014 07:59:18	1262606	16423735	hadam3p_anz_n95r_2012_1_008599487_2	80,939	555,034	6.8574
28 May 2014 15:18:00	1262606	16423735	hadam3p_anz_n95r_2012_1_008599487_2	69,419	452,651	6.5206
21 May 2014 08:41:04	1262606	16423735	hadam3p_anz_n95r_2012_1_008599487_2	57,899	342,858	5.9217
16 May 2014 16:32:30	1262606	16423735	hadam3p_anz_n95r_2012_1_008599487_2	46,379	247,436	5.3351
09 May 2014 12:59:22	1262606	16423735	hadam3p_anz_n95r_2012_1_008599487_2	34,859	191,979	5.5073
25 Apr 2014 06:30:25	1262606	16423735	hadam3p_anz_n95r_2012_1_008599487_2	23,339	131,498	5.6343
04 Apr 2014 16:24:57	1262606	16423735	hadam3p_anz_n95r_2012_1_008599487_2	11,819	70,854	5.9949