Task 16939383

Name	hadam3p_anz_rfxd_2012_1_008947220_0
Workunit	9091395
Created	27 Aug 2014, 10:45:12 UTC
Sent	8 Sep 2014, 14:10:35 UTC
Report deadline	21 Aug 2015, 19:30:35 UTC
Received	24 Nov 2014, 6:31:42 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID	1327312
Run time	2 days 4 hours 35 min 19 sec
CPU time	1 days 23 hours 0 min 28 sec
Validate state	Invalid
Credit	509.72
Device peak FLOPS	2.27 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> from core client for 30 sec - exiting 12:54:17 (6280): No heartbeat from core client for 30 sec - exiting 12:54:18 (6280): No heartbeat from core client for 30 sec - exiting 12:54:19 (6280): No heartbeat from core client for 30 sec - exiting 12:54:20 (6280): No heartbeat from core client for 30 sec - exiting 12:54:21 (6280): No heartbeat from core client for 30 sec - exiting 12:54:22 (6280): No heartbeat from core client for 30 sec - exiting 12:54:24 (6280): No heartbeat from core client for 30 sec - exiting 12:54:25 (6280): No heartbeat from core client for 30 sec - exiting 12:54:26 (6280): No heartbeat from core client for 30 sec - exiting 12:54:27 (6280): No heartbeat from core client for 30 sec - exiting 12:54:28 (6280): No heartbeat from core client for 30 sec - exiting 12:54:29 (6280): No heartbeat from core client for 30 sec - exiting 12:54:30 (6280): No heartbeat from core client for 30 sec - exiting 12:54:31 (6280): No heartbeat from core client for 30 sec - exiting 12:54:32 (6280): No heartbeat from core client for 30 sec - exiting 12:54:33 (6280): No heartbeat from core client for 30 sec - exiting 12:54:34 (6280): No heartbeat from core client for 30 sec - exiting 12:54:36 (6280): No heartbeat from core client for 30 sec - exiting 12:54:37 (6280): No heartbeat from core client for 30 sec - exiting 12:54:38 (6280): No heartbeat from core client for 30 sec - exiting 12:54:39 (6280): No heartbeat from core client for 30 sec - exiting 12:54:40 (6280): No heartbeat from core client for 30 sec - exiting 12:54:41 (6280): No heartbeat from core client for 30 sec - exiting 12:54:42 (6280): No heartbeat from core client for 30 sec - exiting 12:54:43 (6280): No heartbeat from core client for 30 sec - exiting 12:54:44 (6280): No heartbeat from core client for 30 sec - exiting 12:54:45 (6280): No heartbeat from core client for 30 sec - exiting 12:54:46 (6280): No heartbeat from core client for 30 sec - exiting 12:54:47 (6280): No heartbeat from core client for 30 sec - exiting 12:54:49 (6280): No heartbeat from core client for 30 sec - exiting 12:54:50 (6280): No heartbeat from core client for 30 sec - exiting 12:54:51 (6280): No heartbeat from core client for 30 sec - exiting 12:54:52 (6280): No heartbeat from core client for 30 sec - exiting 12:54:53 (6280): No heartbeat from core client for 30 sec - exiting 12:54:54 (6280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:56:59 (6772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:57:33 (4996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1832, iMonCtr=2 07:52:29 (6084): No heartbeat from core client for 30 sec - exiting 07:52:30 (6084): No heartbeat from core client for 30 sec - exiting 07:52:31 (6084): No heartbeat from core client for 30 sec - exiting 07:52:32 (6084): No heartbeat from core client for 30 sec - exiting 07:52:33 (6084): No heartbeat from core client for 30 sec - exiting 07:52:34 (6084): No heartbeat from core client for 30 sec - exiting 07:52:35 (6084): No heartbeat from core client for 30 sec - exiting 07:52:36 (6084): No heartbeat from core client for 30 sec - exiting 07:52:37 (6084): No heartbeat from core client for 30 sec - exiting 07:52:39 (6084): No heartbeat from core client for 30 sec - exiting 07:52:40 (6084): No heartbeat from core client for 30 sec - exiting 07:52:41 (6084): No heartbeat from core client for 30 sec - exiting 07:52:42 (6084): No heartbeat from core client for 30 sec - exiting 07:52:43 (6084): No heartbeat from core client for 30 sec - exiting 07:52:44 (6084): No heartbeat from core client for 30 sec - exiting 07:52:45 (6084): No heartbeat from core client for 30 sec - exiting 07:52:46 (6084): No heartbeat from core client for 30 sec - exiting 07:52:47 (6084): No heartbeat from core client for 30 sec - exiting 07:52:48 (6084): No heartbeat from core client for 30 sec - exiting 07:52:49 (6084): No heartbeat from core client for 30 sec - exiting 07:52:51 (6084): No heartbeat from core client for 30 sec - exiting 07:52:52 (6084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:53:09 (5340): Can't acquire lockfile (32) - waiting 35s Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2728, selfPID=5340, iMonCtr=1 Model crash detected, will try to restart... 18:22:55 (4972): No heartbeat from core client for 30 sec - exiting 18:22:56 (4972): No heartbeat from core client for 30 sec - exiting 18:22:57 (4972): No heartbeat from core client for 30 sec - exiting 18:22:58 (4972): No heartbeat from core client for 30 sec - exiting 18:22:59 (4972): No heartbeat from core client for 30 sec - exiting 18:23:00 (4972): No heartbeat from core client for 30 sec - exiting 18:23:01 (4972): No heartbeat from core client for 30 sec - exiting 18:23:03 (4972): No heartbeat from core client for 30 sec - exiting 18:23:04 (4972): No heartbeat from core client for 30 sec - exiting 18:23:05 (4972): No heartbeat from core client for 30 sec - exiting 18:23:06 (4972): No heartbeat from core client for 30 sec - exiting 18:23:07 (4972): No heartbeat from core client for 30 sec - exiting 18:23:08 (4972): No heartbeat from core client for 30 sec - exiting 18:23:09 (4972): No heartbeat from core client for 30 sec - exiting 18:23:10 (4972): No heartbeat from core client for 30 sec - exiting 18:23:11 (4972): No heartbeat from core client for 30 sec - exiting 18:23:12 (4972): No heartbeat from core client for 30 sec - exiting 18:23:13 (4972): No heartbeat from core client for 30 sec - exiting 18:23:15 (4972): No heartbeat from core client for 30 sec - exiting 18:23:16 (4972): No heartbeat from core client for 30 sec - exiting 18:23:17 (4972): No heartbeat from core client for 30 sec - exiting 18:23:18 (4972): No heartbeat from core client for 30 sec - exiting 18:23:19 (4972): No heartbeat from core client for 30 sec - exiting 18:23:20 (4972): No heartbeat from core client for 30 sec - exiting 18:23:21 (4972): No heartbeat from core client for 30 sec - exiting 18:23:22 (4972): No heartbeat from core client for 30 sec - exiting 18:23:23 (4972): No heartbeat from core client for 30 sec - exiting 18:23:24 (4972): No heartbeat from core client for 30 sec - exiting 18:23:25 (4972): No heartbeat from core client for 30 sec - exiting 18:23:27 (4972): No heartbeat from core client for 30 sec - exiting 18:23:28 (4972): No heartbeat from core client for 30 sec - exiting 18:23:29 (4972): No heartbeat from core client for 30 sec - exiting 18:23:30 (4972): No heartbeat from core client for 30 sec - exiting 18:23:31 (4972): No heartbeat from core client for 30 sec - exiting 18:23:32 (4972): No heartbeat from core client for 30 sec - exiting 18:23:33 (4972): No heartbeat from core client for 30 sec - exiting 18:23:34 (4972): No heartbeat from core client for 30 sec - exiting 18:23:35 (4972): No heartbeat from core client for 30 sec - exiting 18:23:37 (4972): No heartbeat from core client for 30 sec - exiting 18:23:38 (4972): No heartbeat from core client for 30 sec - exiting 18:23:39 (4972): No heartbeat from core client for 30 sec - exiting 18:23:40 (4972): No heartbeat from core client for 30 sec - exiting 18:23:41 (4972): No heartbeat from core client for 30 sec - exiting 18:23:42 (4972): No heartbeat from core client for 30 sec - exiting 18:23:43 (4972): No heartbeat from core client for 30 sec - exiting 18:23:44 (4972): No heartbeat from core client for 30 sec - exiting 18:23:45 (4972): No heartbeat from core client for 30 sec - exiting 18:23:46 (4972): No heartbeat from core client for 30 sec - exiting 18:23:47 (4972): No heartbeat from core client for 30 sec - exiting 18:23:48 (4972): No heartbeat from core client for 30 sec - exiting 18:23:49 (4972): No heartbeat from core client for 30 sec - exiting 18:23:51 (4972): No heartbeat from core client for 30 sec - exiting 18:23:52 (4972): No heartbeat from core client for 30 sec - exiting 18:23:53 (4972): No heartbeat from core client for 30 sec - exiting 18:23:54 (4972): No heartbeat from core client for 30 sec - exiting 18:23:55 (4972): No heartbeat from core client for 30 sec - exiting 18:23:56 (4972): No heartbeat from core client for 30 sec - exiting 18:23:57 (4972): No heartbeat from core client for 30 sec - exiting 18:23:58 (4972): No heartbeat from core client for 30 sec - exiting 18:23:59 (4972): No heartbeat from core client for 30 sec - exiting 18:24:00 (4972): No heartbeat from core client for 30 sec - exiting 18:24:01 (4972): No heartbeat from core client for 30 sec - exiting 18:24:03 (4972): No heartbeat from core client for 30 sec - exiting 18:24:04 (4972): No heartbeat from core client for 30 sec - exiting 18:24:05 (4972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional WoSuspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6200, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6344, iMonCtr=2 21:38:17 (5156): No heartbeat from core client for 30 sec - exiting 21:38:18 (5156): No heartbeat from core client for 30 sec - exiting 21:38:19 (5156): No heartbeat from core client for 30 sec - exiting 21:38:20 (5156): No heartbeat from core client for 30 sec - exiting 21:38:21 (5156): No heartbeat from core client for 30 sec - exiting 21:38:22 (5156): No heartbeat from core client for 30 sec - exiting 21:38:24 (5156): No heartbeat from core client for 30 sec - exiting 21:38:25 (5156): No heartbeat from core client for 30 sec - exiting 21:38:26 (5156): No heartbeat from core client for 30 sec - exiting 21:38:27 (5156): No heartbeat from core client for 30 sec - exiting 21:38:28 (5156): No heartbeat from core client for 30 sec - exiting 21:38:29 (5156): No heartbeat from core client for 30 sec - exiting 21:38:30 (5156): No heartbeat from core client for 30 sec - exiting 21:38:31 (5156): No heartbeat from core client for 30 sec - exiting 21:38:32 (5156): No heartbeat from core client for 30 sec - exiting 21:38:33 (5156): No heartbeat from core client for 30 sec - exiting 21:38:34 (5156): No heartbeat from core client for 30 sec - exiting 21:38:36 (5156): No heartbeat from core client for 30 sec - exiting 21:38:37 (5156): No heartbeat from core client for 30 sec - exiting 21:38:38 (5156): No heartbeat from core client for 30 sec - exiting 21:38:39 (5156): No heartbeat from core client for 30 sec - exiting 21:38:40 (5156): No heartbeat from core client for 30 sec - exiting 21:38:41 (5156): No heartbeat from core client for 30 sec - exiting 21:38:42 (5156): No heartbeat from core client for 30 sec - exiting 21:38:43 (5156): No heartbeat from core client for 30 sec - exiting 21:38:44 (5156): No heartbeat from core client for 30 sec - exiting 21:38:45 (5156): No heartbeat from core client for 30 sec - exiting 21:38:46 (5156): No heartbeat from core client for 30 sec - exiting 21:38:47 (5156): No heartbeat from core client for 30 sec - exiting 21:38:49 (5156): No heartbeat from core client for 30 sec - exiting 21:38:50 (5156): No heartbeat from core client for 30 sec - exiting 21:38:51 (5156): No heartbeat from core client for 30 sec - exiting 21:38:52 (5156): No heartbeat from core client for 30 sec - exiting 21:38:53 (5156): No heartbeat from core client for 30 sec - exiting 21:38:54 (5156): No heartbeat from core client for 30 sec - exiting 21:38:55 (5156): No heartbeat from core client for 30 sec - exiting 21:38:56 (5156): No heartbeat from core client for 30 sec - exiting 21:38:57 (5156): No heartbeat from core client for 30 sec - exiting 21:38:58 (5156): No heartbeat from core client for 30 sec - exiting 21:38:59 (5156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6448, selfPID=6448, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6544, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4764, iMonCtr=2 Model crash detected, will try to restart... 10:49:13 (6600): No heartbeat from core client for 30 sec - exiting 10:49:15 (6600): No heartbeat from core client for 30 sec - exiting 10:49:16 (6600): No heartbeat from core client for 30 sec - exiting 10:49:17 (6600): No heartbeat from core client for 30 sec - exiting 10:49:18 (6600): No heartbeat from core client for 30 sec - exiting 10:49:19 (6600): No heartbeat from core client for 30 sec - exiting 10:49:20 (6600): No heartbeat from core client for 30 sec - exiting 10:49:21 (6600): No heartbeat from core client for 30 sec - exiting 10:49:22 (6600): No heartbeat from core client for 30 sec - exiting 10:49:23 (6600): No heartbeat from core client for 30 sec - exiting 10:49:24 (6600): No heartbeat from core client for 30 sec - exiting 10:49:25 (6600): No heartbeat from core client for 30 sec - exiting 10:49:26 (6600): No heartbeat from core client for 30 sec - exiting 10:49:27 (6600): No heartbeat from core client for 30 sec - exiting 10:49:28 (6600): No heartbeat from core client for 30 sec - exiting 10:49:29 (6600): No heartbeat from core client for 30 sec - exiting 10:49:30 (6600): No heartbeat from core client for 30 sec - exiting 10:49:31 (6600): No heartbeat from core client for 30 sec - exiting 10:49:32 (6600): No heartbeat from core client for 30 sec - exiting 10:49:33 (6600): No heartbeat from core client for 30 sec - exiting 10:49:34 (6600): No heartbeat from core client for 30 sec - exiting 10:49:35 (6600): No heartbeat from core client for 30 sec - exiting 10:49:36 (6600): No heartbeat from core client for 30 sec - exiting 10:49:37 (6600): No heartbeat from core client for 30 sec - exiting 10:49:38 (6600): No heartbeat from core client for 30 sec - exiting 10:49:39 (6600): No heartbeat from core client for 30 sec - exiting 10:49:40 (6600): No heartbeat from core client for 30 sec - exiting 10:49:41 (6600): No heartbeat from core client for 30 sec - exiting 10:49:42 (6600): No heartbeat from core client for 30 sec - exiting 10:49:43 (6600): No heartbeat from core client for 30 sec - exiting 10:49:44 (6600): No heartbeat from core client for 30 sec - exiting 10:49:45 (6600): No heartbeat from core client for 30 sec - exiting 10:49:46 (6600): No heartbeat from core client for 30 sec - exiting 10:49:47 (6600): No heartbeat from core client for 30 sec - exiting 10:49:48 (6600): No heartbeat from core client for 30 sec - exiting 10:49:49 (6600): No heartbeat from core client for 30 sec - exiting 10:49:50 (6600): No heartbeat from core client for 30 sec - exiting 10:49:51 (6600): No heartbeat from core client for 30 sec - exiting 10:49:52 (6600): No heartbeat from core client for 30 sec - exiting 10:49:53 (6600): No heartbeat from core client for 30 sec - exiting 10:49:54 (6600): No heartbeat from core client for 30 sec - exiting 10:49:55 (6600): No heartbeat from core client for 30 sec - exiting 10:49:56 (6600): No heartbeat from core client for 30 sec - exiting 10:49:57 (6600): No heartbeat from core client for 30 sec - exiting 10:49:58 (6600): No heartbeat from core client for 30 sec - exiting 10:49:59 (6600): No heartbeat from core client for 30 sec - exiting 10:50:00 (6600): No heartbeat from core client for 30 sec - exiting 10:50:01 (6600): No heartbeat from core client for 30 sec - exiting 10:50:02 (6600): No heartbeat from core client for 30 sec - exiting 10:50:03 (6600): No heartbeat from core client for 30 sec - exiting 10:50:04 (6600): No heartbeat from core client for 30 sec - exiting 10:50:05 (6600): No heartbeat from core client for 30 sec - exiting 10:50:06 (6600): No heartbeat from core client for 30 sec - exiting 10:50:07 (6600): No heartbeat from core client for 30 sec - exiting 10:50:08 (6600): No heartbeat from core client for 30 sec - exiting 10:50:09 (6600): No heartbeat from core client for 30 sec - exiting 10:50:10 (6600): No heartbeat from core client for 30 sec - exiting 10:50:11 (6600): No heartbeat from core client for 30 sec - exiting 10:50:12 (6600): No heartbeat from core client for 30 sec - exiting 10:50:13 (6600): No heartbeat from core client for 30 sec - exiting 10:50:14 (6600): No heartbeat from core client for 30 sec - exiting 10:50:15 (6600): No heartbeat from core client for 30 sec - exiting 10:50:16 (6600): No heartbeat from core client for 30 sec - exiting 10:50:17 (6600): No heartbeat from core client for 30 sec - exiting 10:50:18 (6600): No heartbeat from core client for 30 sec - exiting 10:50:19 (6600): No heartbeat from core client for 30 sec - exiting 10:50:20 (6600): No heartbeat from core client for 30 sec - exiting 10:50:21 (6600): No heartbeat from core client for 30 sec - exiting 10:50:22 (6600): No heartbeat from core client for 30 sec - exiting 10:50:23 (6600): No heartbeat from core client for 30 sec - exiting 10:50:24 (6600): No heartbeat from core client for 30 sec - exiting 10:50:25 (6600): No heartbeat from core client for 30 sec - exiting 10:50:26 (6600): No heartbeat from core client for 30 sec - exiting 10:50:27 (6600): No heartbeat from core client for 30 sec - exiting 10:50:28 (6600): No heartbeat from core client for 30 sec - exiting 10:50:29 (6600): No heartbeat from core client for 30 sec - exiting 10:50:30 (6600): No heartbeat from core client for 30 sec - exiting 10:50:31 (6600): No heartbeat from core client for 30 sec - exiting 10:50:32 (6600): No heartbeat from core client for 30 sec - exiting 10:50:33 (6600): No heartbeat from core client for 30 sec - exiting 10:50:34 (6600): No heartbeat from core client for 30 sec - exiting 10:50:35 (6600): No heartbeat from core client for 30 sec - exiting 10:50:36 (6600): No heartbeat from core client for 30 sec - exiting 10:50:37 (6600): No heartbeat from core client for 30 sec - exiting 10:50:38 (6600): No heartbeat from core client for 30 sec - exiting 10:50:39 (6600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:50:40 (6600): No heartbeat from core client for 30 sec - exiting 10:50:41 (6600): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 10:54:24 (1696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:00:02 (7888): No heartbeat from core client for 30 sec - exiting 11:00:15 (7888): No heartbeat from core client for 30 sec - exiting 11:00:16 (7888): No heartbeat from core client for 30 sec - exiting 11:00:17 (7888): No heartbeat from core client for 30 sec - exiting 11:00:18 (7888): No heartbeat from core client for 30 sec - exiting 11:00:21 (7888): No heartbeat from core client for 30 sec - exiting 11:00:22 (7888): No heartbeat from core client for 30 sec - exiting 11:00:23 (7888): No heartbeat from core client for 30 sec - exiting 11:00:24 (7888): No heartbeat from core client for 30 sec - exiting 11:00:25 (7888): No heartbeat from core client for 30 sec - exiting 11:00:26 (7888): No heartbeat from core client for 30 sec - exiting 11:00:27 (7888): No heartbeat from core client for 30 sec - exiting 11:00:28 (7888): No heartbeat from core client for 30 sec - exiting 11:00:29 (7888): No heartbeat from core client for 30 sec - exiting 11:00:30 (7888): No heartbeat from core client for 30 sec - exiting 11:00:31 (7888): No heartbeat from core client for 30 sec - exiting 11:00:32 (7888): No heartbeat from core client for 30 sec - exiting 11:00:33 (7888): No heartbeat from core client for 30 sec - exiting 11:00:34 (7888): No heartbeat from core client for 30 sec - exiting 11:00:35 (7888): No heartbeat from core client for 30 sec - exiting 11:00:36 (7888): No heartbeat from core client for 30 sec - exiting 11:00:37 (7888): No heartbeat from core client for 30 sec - exiting 11:00:38 (7888): No heartbeat from core client for 30 sec - exiting 11:00:41 (7888): No heartbeat from core client for 30 sec - exiting 11:00:42 (7888): No heartbeat from core client for 30 sec - exiting 11:00:43 (7888): No heartbeat from core client for 30 sec - exiting 11:00:46 (7888): No heartbeat from core client for 30 sec - exiting 11:00:47 (7888): No heartbeat from core client for 30 sec - exiting 11:00:48 (7888): No heartbeat from core client for 30 sec - exiting 11:00:49 (7888): No heartbeat from core client for 30 sec - exiting 11:00:50 (7888): No heartbeat from core client for 30 sec - exiting 11:00:51 (7888): No heartbeat from core client for 30 sec - exiting 11:00:52 (7888): No heartbeat from core client for 30 sec - exiting 11:00:53 (7888): No heartbeat from core client for 30 sec - exiting 11:00:54 (7888): No heartbeat from core client for 30 sec - exiting 11:00:55 (7888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5668, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6964, iMonCtr=2 Model crash detected, will try to restart... 07:27:43 (5376): No heartbeat from core client for 30 sec - exiting 07:27:44 (5376): No heartbeat from core client for 30 sec - exiting 07:27:46 (5376): No heartbeat from core client for 30 sec - exiting 07:27:47 (5376): No heartbeat from core client for 30 sec - exiting 07:27:48 (5376): No heartbeat from core client for 30 sec - exiting 07:27:49 (5376): No heartbeat from core client for 30 sec - exiting 07:27:50 (5376): No heartbeat from core client for 30 sec - exiting 07:27:51 (5376): No heartbeat from core client for 30 sec - exiting 07:27:52 (5376): No heartbeat from core client for 30 sec - exiting 07:27:53 (5376): No heartbeat from core client for 30 sec - exiting 07:27:54 (5376): No heartbeat from core client for 30 sec - exiting 07:27:55 (5376): No heartbeat from core client for 30 sec - exiting 07:27:56 (5376): No heartbeat from core client for 30 sec - exiting 07:27:58 (5376): No heartbeat from core client for 30 sec - exiting 07:27:59 (5376): No heartbeat from core client for 30 sec - exiting 07:28:00 (5376): No heartbeat from core client for 30 sec - exiting 07:28:01 (5376): No heartbeat from core client for 30 sec - exiting 07:28:02 (5376): No heartbeat from core client for 30 sec - exiting 07:28:03 (5376): No heartbeat from core client for 30 sec - exiting 07:28:04 (5376): No heartbeat from core client for 30 sec - exiting 07:28:05 (5376): No heartbeat from core client for 30 sec - exiting 07:28:06 (5376): No heartbeat from core client for 30 sec - exiting 07:28:07 (5376): No heartbeat from core client for 30 sec - exiting 07:28:08 (5376): No heartbeat from core client for 30 sec - exiting 07:28:10 (5376): No heartbeat from core client for 30 sec - exiting 07:28:11 (5376): No heartbeat from core client for 30 sec - exiting 07:28:12 (5376): No heartbeat from core client for 30 sec - exiting 07:28:13 (5376): No heartbeat from core client for 30 sec - exiting 07:28:14 (5376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5960, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6116, selfPID=1768, iMonCtr=1 Model crash detected, will try to restart... 12:54:52 (3124): No heartbeat from core client for 30 sec - exiting 12:54:53 (3124): No heartbeat from core client for 30 sec - exiting 12:54:55 (3124): No heartbeat from core client for 30 sec - exiting 12:54:56 (3124): No heartbeat from core client for 30 sec - exiting 12:54:57 (3124): No heartbeat from core client for 30 sec - exiting 12:54:58 (3124): No heartbeat from core client for 30 sec - exiting 12:54:59 (3124): No heartbeat from core client for 30 sec - exiting 12:55:00 (3124): No heartbeat from core client for 30 sec - exiting 12:55:01 (3124): No heartbeat from core client for 30 sec - exiting 12:55:02 (3124): No heartbeat from core client for 30 sec - exiting 12:55:03 (3124): No heartbeat from core client for 30 sec - exiting 12:55:04 (3124): No heartbeat from core client for 30 sec - exiting 12:55:05 (3124): No heartbeat from core client for 30 sec - exiting 12:55:07 (3124): No heartbeat from core client for 30 sec - exiting 12:55:08 (3124): No heartbeat from core client for 30 sec - exiting 12:55:09 (3124): No heartbeat from core client for 30 sec - exiting 12:55:10 (3124): No heartbeat from core client for 30 sec - exiting 12:55:11 (3124): No heartbeat from core client for 30 sec - exiting 12:55:12 (3124): No heartbeat from core client for 30 sec - exiting 12:55:13 (3124): No heartbeat from core client for 30 sec - exiting 12:55:14 (3124): No heartbeat from core client for 30 sec - exiting 12:55:15 (3124): No heartbeat from core client for 30 sec - exiting 12:55:16 (3124): No heartbeat from core client for 30 sec - exiting 12:55:17 (3124): No heartbeat from core client for 30 sec - exiting 12:55:19 (3124): No heartbeat from core client for 30 sec - exiting 12:55:20 (3124): No heartbeat from core client for 30 sec - exiting 12:55:21 (3124): No heartbeat from core client for 30 sec - exiting 12:55:22 (3124): No heartbeat from core client for 30 sec - exiting 12:55:23 (3124): No heartbeat from core client for 30 sec - exiting 12:55:24 (3124): No heartbeat from core client for 30 sec - exiting 12:55:25 (3124): No heartbeat from core client for 30 sec - exiting 12:55:26 (3124): No heartbeat from core client for 30 sec - exiting 12:55:27 (3124): No heartbeat from core client for 30 sec - exiting 12:55:28 (3124): No heartbeat from core client for 30 sec - exiting 12:55:29 (3124): No heartbeat from core client for 30 sec - exiting 12:55:31 (3124): No heartbeat from core client for 30 sec - exiting 12:55:32 (3124): No heartbeat from core client for 30 sec - exiting 12:55:33 (3124): No heartbeat from core client for 30 sec - exiting 12:55:34 (3124): No heartbeat from core client for 30 sec - exiting 12:55:35 (3124): No heartbeat from core client for 30 sec - exiting 12:55:36 (3124): No heartbeat from core client for 30 sec - exiting 12:55:37 (3124): No heartbeat from core client for 30 sec - exiting 12:55:38 (3124): No heartbeat from core client for 30 sec - exiting 12:55:39 (3124): No heartbeat from core client for 30 sec - exiting 12:55:40 (3124): No heartbeat from core client for 30 sec - exiting 12:55:41 (3124): No heartbeat from core client for 30 sec - exiting 12:55:43 (3124): No heartbeat from core client for 30 sec - exiting 12:55:44 (3124): No heartbeat from core client for 30 sec - exiting 12:55:45 (3124): No heartbeat from core client for 30 sec - exiting 12:55:46 (3124): No heartbeat from core client for 30 sec - exiting 12:55:47 (3124): No heartbeat from core client for 30 sec - exiting 12:55:48 (3124): No heartbeat from core client for 30 sec - exiting 12:55:49 (3124): No heartbeat from core client for 30 sec - exiting 12:55:50 (3124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4444, selfPID=4444, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4268, iMonCtr=2 Model crash detected, will try to restart... 16:08:13 (5828): No heartbeat from core client for 30 sec - exiting 16:08:15 (5828): No heartbeat from core client for 30 sec - exiting 16:08:16 (5828): No heartbeat from core client for 30 sec - exiting 16:08:17 (5828): No heartbeat from core client for 30 sec - exiting 16:08:18 (5828): No heartbeat from core client for 30 sec - exiting 16:08:19 (5828): No heartbeat from core client for 30 sec - exiting 16:08:20 (5828): No heartbeat from core client for 30 sec - exiting 16:08:21 (5828): No heartbeat from core client for 30 sec - exiting 16:08:22 (5828): No heartbeat from core client for 30 sec - exiting 16:08:23 (5828): No heartbeat from core client for 30 sec - exiting 16:08:24 (5828): No heartbeat from core client for 30 sec - exiting 16:08:25 (5828): No heartbeat from core client for 30 sec - exiting 16:08:27 (5828): No heartbeat from core client for 30 sec - exiting 16:08:28 (5828): No heartbeat from core client for 30 sec - exiting 16:08:29 (5828): No heartbeat from core client for 30 sec - exiting 16:08:30 (5828): No heartbeat from core client for 30 sec - exiting 16:08:31 (5828): No heartbeat from core client for 30 sec - exiting 16:08:32 (5828): No heartbeat from core client for 30 sec - exiting 16:08:33 (5828): No heartbeat from core client for 30 sec - exiting 16:08:34 (5828): No heartbeat from core client for 30 sec - exiting 16:08:35 (5828): No heartbeat from core client for 30 sec - exiting 16:08:36 (5828): No heartbeat from core client for 30 sec - exiting 16:08:37 (5828): No heartbeat from core client for 30 sec - exiting 16:08:39 (5828): No heartbeat from core client for 30 sec - exiting 16:08:40 (5828): No heartbeat from core client for 30 sec - exiting 16:08:41 (5828): No heartbeat from core client for 30 sec - exiting 16:08:42 (5828): No heartbeat from core client for 30 sec - exiting 16:08:43 (5828): No heartbeat from core client for 30 sec - exiting 16:08:44 (5828): No heartbeat from core client for 30 sec - exiting 16:08:45 (5828): No heartbeat from core client for 30 sec - exiting 16:08:46 (5828): No heartbeat from core client for 30 sec - exiting 16:08:47 (5828): No heartbeat from core client for 30 sec - exiting 16:08:48 (5828): No heartbeat from core client for 30 sec - exiting 16:08:49 (5828): No heartbeat from core client for 30 sec - exiting 16:08:50 (5828): No heartbeat from core client for 30 sec - exiting 16:08:51 (5828): No heartbeat from core client for 30 sec - exiting 16:08:53 (5828): No heartbeat from core client for 30 sec - exiting 16:08:54 (5828): No heartbeat from core client for 30 sec - exiting 16:08:55 (5828): No heartbeat from core client for 30 sec - exiting 16:08:56 (5828): No heartbeat from core client for 30 sec - exiting 16:08:57 (5828): No heartbeat from core client for 30 sec - exiting 16:08:58 (5828): No heartbeat from core client for 30 sec - exiting 16:08:59 (5828): No heartbeat from core client for 30 sec - exiting 16:09:00 (5828): No heartbeat from core client for 30 sec - exiting 16:09:01 (5828): No heartbeat from core client for 30 sec - exiting 16:09:02 (5828): No heartbeat from core client for 30 sec - exiting 16:09:03 (5828): No heartbeat from core client for 30 sec - exiting 16:09:04 (5828): No heartbeat from core client for 30 sec - exiting 16:09:06 (5828): No heartbeat from core client for 30 sec - exiting 16:09:07 (5828): No heartbeat from core client for 30 sec - exiting 16:09:08 (5828): No heartbeat from core client for 30 sec - exiting 16:09:09 (5828): No heartbeat from core client for 30 sec - exiting 16:09:10 (5828): No heartbeat from core client for 30 sec - exiting 16:09:11 (5828): No heartbeat from core client for 30 sec - exiting 16:09:12 (5828): No heartbeat from core client for 30 sec - exiting 16:09:13 (5828): No heartbeat from core client for 30 sec - exiting 16:09:14 (5828): No heartbeat from core client for 30 sec - exiting 16:09:15 (5828): No heartbeat from core client for 30 sec - exiting 16:09:17 (5828): No heartbeat from core client for 30 sec - exiting 16:09:18 (5828): No heartbeat from core client for 30 sec - exiting 16:09:19 (5828): No heartbeat from core client for 30 sec - exiting 16:09:20 (5828): No heartbeat from core client for 30 sec - exiting 16:09:21 (5828): No heartbeat from core client for 30 sec - exiting 16:09:22 (5828): No heartbeat from core client for 30 sec - exiting 16:09:23 (5828): No heartbeat from core client for 30 sec - exiting 16:09:24 (5828): No heartbeat from core client for 30 sec - exiting 16:09:25 (5828): No heartbeat from core client for 30 sec - exiting 16:09:26 (5828): No heartbeat from core client for 30 sec - exiting 16:09:27 (5828): No heartbeat from core client for 30 sec - exiting 16:09:29 (5828): No heartbeat from core client for 30 sec - exiting 16:09:30 (5828): No heartbeat from core client for 30 sec - exiting 16:09:31 (5828): No heartbeat from core client for 30 sec - exiting 16:09:32 (5828): No heartbeat from core client for 30 sec - exiting 16:09:33 (5828): No heartbeat from core client for 30 sec - exiting 16:09:34 (5828): No heartbeat from core client for 30 sec - exiting 16:09:35 (5828): No heartbeat from core client for 30 sec - exiting 16:09:36 (5828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1872, iMonCtr=2 19:17:46 (5156): No heartbeat from core client for 30 sec - exiting 19:17:47 (5156): No heartbeat from core client for 30 sec - exiting 19:17:49 (5156): No heartbeat from core client for 30 sec - exiting 19:17:50 (5156): No heartbeat from core client for 30 sec - exiting 19:17:51 (5156): No heartbeat from core client for 30 sec - exiting 19:17:52 (5156): No heartbeat from core client for 30 sec - exiting 19:17:53 (5156): No heartbeat from core client for 30 sec - exiting 19:17:54 (5156): No heartbeat from core client for 30 sec - exiting 19:17:55 (5156): No heartbeat from core client for 30 sec - exiting 19:17:56 (5156): No heartbeat from core client for 30 sec - exiting 19:17:57 (5156): No heartbeat from core client for 30 sec - exiting 19:17:58 (5156): No heartbeat from core client for 30 sec - exiting 19:17:59 (5156): No heartbeat from core client for 30 sec - exiting 19:18:01 (5156): No heartbeat from core client for 30 sec - exiting 19:18:02 (5156): No heartbeat from core client for 30 sec - exiting 19:18:03 (5156): No heartbeat from core client for 30 sec - exiting 19:18:04 (5156): No heartbeat from core client for 30 sec - exiting 19:18:05 (5156): No heartbeat from core client for 30 sec - exiting 19:18:06 (5156): No heartbeat from core client for 30 sec - exiting 19:18:07 (5156): No heartbeat from core client for 30 sec - exiting 19:18:08 (5156): No heartbeat from core client for 30 sec - exiting 19:18:09 (5156): No heartbeat from core client for 30 sec - exiting 19:18:10 (5156): No heartbeat from core client for 30 sec - exiting 19:18:11 (5156): No heartbeat from core client for 30 sec - exiting 19:18:12 (5156): No heartbeat from core client for 30 sec - exiting 19:18:13 (5156): No heartbeat from core client for 30 sec - exiting 19:18:14 (5156): No heartbeat from core client for 30 sec - exiting 19:18:15 (5156): No heartbeat from core client for 30 sec - exiting 19:18:16 (5156): No heartbeat from core client for 30 sec - exiting 19:18:17 (5156): No heartbeat from core client for 30 sec - exiting 19:18:18 (5156): No heartbeat from core client for 30 sec - exiting 19:18:19 (5156): No heartbeat from core client for 30 sec - exiting 19:18:20 (5156): No heartbeat from core client for 30 sec - exiting 19:18:21 (5156): No heartbeat from core client for 30 sec - exiting 19:18:22 (5156): No heartbeat from core client for 30 sec - exiting 19:18:23 (5156): No heartbeat from core client for 30 sec - exiting 19:18:25 (5156): No heartbeat from core client for 30 sec - exiting 19:18:26 (5156): No heartbeat from core client for 30 sec - exiting 19:18:27 (5156): No heartbeat from core client for 30 sec - exiting 19:18:28 (5156): No heartbeat from core client for 30 sec - exiting 19:18:29 (5156): No heartbeat from core client for 30 sec - exiting 19:18:30 (5156): No heartbeat from core client for 30 sec - exiting 19:18:31 (5156): No heartbeat from core client for 30 sec - exiting 19:18:32 (5156): No heartbeat from core client for 30 sec - exiting 19:18:33 (5156): No heartbeat from core client for 30 sec - exiting 19:18:34 (5156): No heartbeat from core client for 30 sec - exiting 19:18:35 (5156): No heartbeat from core client for 30 sec - exiting 19:18:36 (5156): No heartbeat from core client for 30 sec - exiting 19:18:37 (5156): No heartbeat from core client for 30 sec - exiting 19:18:38 (5156): No heartbeat from core client for 30 sec - exiting 19:18:40 (5156): No heartbeat from core client for 30 sec - exiting 19:18:41 (5156): No heartbeat from core client for 30 sec - exiting 19:18:42 (5156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=884, selfPID=884, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:31:19 (5720): No heartbeat from core client for 30 sec - exiting 14:31:20 (5720): No heartbeat from core client for 30 sec - exiting 14:31:21 (5720): No heartbeat from core client for 30 sec - exiting 14:31:22 (5720): No heartbeat from core client for 30 sec - exiting 14:31:23 (5720): No heartbeat from core client for 30 sec - exiting 14:31:24 (5720): No heartbeat from core client for 30 sec - exiting 14:31:25 (5720): No heartbeat from core client for 30 sec - exiting 14:31:26 (5720): No heartbeat from core client for 30 sec - exiting 14:31:27 (5720): No heartbeat from core client for 30 sec - exiting 14:31:28 (5720): No heartbeat from core client for 30 sec - exiting 14:31:29 (5720): No heartbeat from core client for 30 sec - exiting 14:31:30 (5720): No heartbeat from core client for 30 sec - exiting 14:31:31 (5720): No heartbeat from core client for 30 sec - exiting 14:31:32 (5720): No heartbeat from core client for 30 sec - exiting 14:31:33 (5720): No heartbeat from core client for 30 sec - exiting 14:31:34 (5720): No heartbeat from core client for 30 sec - exiting 14:31:35 (5720): No heartbeat from core client for 30 sec - exiting 14:31:36 (5720): No heartbeat from core client for 30 sec - exiting 14:31:37 (5720): No heartbeat from core client for 30 sec - exiting 14:31:38 (5720): No heartbeat from core client for 30 sec - exiting 14:31:39 (5720): No heartbeat from core client for 30 sec - exiting 14:31:40 (5720): No heartbeat from core client for 30 sec - exiting 14:31:41 (5720): No heartbeat from core client for 30 sec - exiting 14:31:42 (5720): No heartbeat from core client for 30 sec - exiting 14:31:43 (5720): No heartbeat from core client for 30 sec - exiting 14:31:44 (5720): No heartbeat from core client for 30 sec - exiting 14:31:45 (5720): No heartbeat from core client for 30 sec - exiting 14:31:46 (5720): No heartbeat from core client for 30 sec - exiting 14:31:47 (5720): No heartbeat from core client for 30 sec - exiting 14:31:48 (5720): No heartbeat from core client for 30 sec - exiting 14:31:49 (5720): No heartbeat from core client for 30 sec - exiting 14:31:50 (5720): No heartbeat from core client for 30 sec - exiting 14:31:51 (5720): No heartbeat from core client for 30 sec - exiting 14:31:52 (5720): No heartbeat from core client for 30 sec - exiting 14:31:53 (5720): No heartbeat from core client for 30 sec - exiting 14:31:54 (5720): No heartbeat from core client for 30 sec - exiting 14:31:55 (5720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3940, selfPID=3940, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=276, selfPID=2944, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2860, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3820, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3812, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2676, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3824, selfPID=3464, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5244, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2268, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5512, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=836, selfPID=2072, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5828, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5556, selfPID=4212, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3364, selfPID=2912, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5308, selfPID=5944, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2836, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4508, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4864, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4584, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1208, selfPID=4748, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4284, selfPID=4640, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> finish file present too long </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Sep 2014 12:12:27	1327312	16939383	hadam3p_anz_rfxd_2012_1_008947220_0	11,819	101,909	8.6225