Task 13777979

Name	hadcm3n_u2b4_1980_40_007615775_1
Workunit	7793905
Created	14 Dec 2011, 12:46:01 UTC
Sent	14 Dec 2011, 12:47:22 UTC
Report deadline	14 Mar 2012, 20:14:33 UTC
Received	14 Jan 2012, 17:29:43 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	893865
Run time	20 days 22 hours 18 min 5 sec
CPU time	17 days 2 hours 57 min 43 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.21 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> nt for 30 sec - exiting 02:20:19 (1088): No heartbeat from core client for 30 sec - exiting 02:20:20 (1088): No heartbeat from core client for 30 sec - exiting 02:20:21 (1088): No heartbeat from core client for 30 sec - exiting 02:21:25 (7300): No heartbeat from core client for 30 sec - exiting 02:21:26 (7300): No heartbeat from core client for 30 sec - exiting 02:21:27 (7300): No heartbeat from core client for 30 sec - exiting 02:21:28 (7300): No heartbeat from core client for 30 sec - exiting 02:21:29 (7300): No heartbeat from core client for 30 sec - exiting 02:21:30 (7300): No heartbeat from core client for 30 sec - exiting 02:21:31 (7300): No heartbeat from core client for 30 sec - exiting 02:21:32 (7300): No heartbeat from core client for 30 sec - exiting 02:21:33 (7300): No heartbeat from core client for 30 sec - exiting 02:21:34 (7300): No heartbeat from core client for 30 sec - exiting 02:21:35 (7300): No heartbeat from core client for 30 sec - exiting 02:21:36 (7300): No heartbeat from core client for 30 sec - exiting 02:21:37 (7300): No heartbeat from core client for 30 sec - exiting 02:21:38 (7300): No heartbeat from core client for 30 sec - exiting 02:21:39 (7300): No heartbeat from core client for 30 sec - exiting 02:21:40 (7300): No heartbeat from core client for 30 sec - exiting 02:21:41 (7300): No heartbeat from core client for 30 sec - exiting 02:21:42 (7300): No heartbeat from core client for 30 sec - exiting 02:21:43 (7300): No heartbeat from core client for 30 sec - exiting 02:21:44 (7300): No heartbeat from core client for 30 sec - exiting 02:21:45 (7300): No heartbeat from core client for 30 sec - exiting 02:21:46 (7300): No heartbeat from core client for 30 sec - exiting 02:21:47 (7300): No heartbeat from core client for 30 sec - exiting 02:21:48 (7300): No heartbeat from core client for 30 sec - exiting 02:21:49 (7300): No heartbeat from core client for 30 sec - exiting 02:21:50 (7300): No heartbeat from core client for 30 sec - exiting 02:21:51 (7300): No heartbeat from core client for 30 sec - exiting 02:21:52 (7300): No heartbeat from core client for 30 sec - exiting 02:21:53 (7300): No heartbeat from core client for 30 sec - exiting 02:21:54 (7300): No heartbeat from core client for 30 sec - exiting 02:21:55 (7300): No heartbeat from core client for 30 sec - exiting 02:21:56 (7300): No heartbeat from core client for 30 sec - exiting 02:21:57 (7300): No heartbeat from core client for 30 sec - exiting 02:21:58 (7300): No heartbeat from core client for 30 sec - exiting 02:21:59 (7300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6560, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:58:02 (7872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:58:04 (7872): No heartbeat from core client for 30 sec - exiting 22:58:05 (7872): No heartbeat from core client for 30 sec - exiting 22:58:06 (7872): No heartbeat from core client for 30 sec - exiting 22:58:07 (7872): No heartbeat from core client for 30 sec - exiting 22:58:08 (7872): No heartbeat from core client for 30 sec - exiting 22:58:09 (7872): No heartbeat from core client for 30 sec - exiting 22:58:10 (7872): No heartbeat from core client for 30 sec - exiting 00:00:04 (2468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:00:06 (2468): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:25:27 (7440): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 11:25:29 (7440): No heartbeat from core client for 30 sec - exiting 11:25:30 (7440): No heartbeat from core client for 30 sec - exiting 11:25:31 (7440): No heartbeat from core client for 30 sec - exiting 11:25:32 (7440): No heartbeat from core client for 30 sec - exiting 11:25:33 (7440): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:26:56 (7516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:26:57 (7516): No heartbeat from core client for 30 sec - exiting 12:26:58 (7516): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 14:07:36 (6332): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 14:07:37 (6332): No heartbeat from core client for 30 sec - exiting 17:22:38 (852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:22:39 (852): No heartbeat from core client for 30 sec - exiting 17:22:40 (852): No heartbeat from core client for 30 sec - exiting 20:49:11 (7584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:49:12 (7584): No heartbeat from core client for 30 sec - exiting 20:49:13 (7584): No heartbeat from core client for 30 sec - exiting 20:49:58 (5464): No heartbeat from core client for 30 sec - exiting 20:49:59 (5464): No heartbeat from core client for 30 sec - exiting 20:50:00 (5464): No heartbeat from core client for 30 sec - exiting 20:50:01 (5464): No heartbeat from core client for 30 sec - exiting 20:50:02 (5464): No heartbeat from core client for 30 sec - exiting 20:50:03 (5464): No heartbeat from core client for 30 sec - exiting 20:50:04 (5464): No heartbeat from core client for 30 sec - exiting 20:50:05 (5464): No heartbeat from core client for 30 sec - exiting 20:50:06 (5464): No heartbeat from core client for 30 sec - exiting 20:50:07 (5464): No heartbeat from core client for 30 sec - exiting 20:50:08 (5464): No heartbeat from core client for 30 sec - exiting 20:50:09 (5464): No heartbeat from core client for 30 sec - exiting 20:50:10 (5464): No heartbeat from core client for 30 sec - exiting 20:50:11 (5464): No heartbeat from core client for 30 sec - exiting 20:50:12 (5464): No heartbeat from core client for 30 sec - exiting 20:50:13 (5464): No heartbeat from core client for 30 sec - exiting 20:50:14 (5464): No heartbeat from core client for 30 sec - exiting 20:50:15 (5464): No heartbeat from core client for 30 sec - exiting 20:50:16 (5464): No heartbeat from core client for 30 sec - exiting 20:50:17 (5464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:11:20 (6280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6676, iMonCtr=1 Model crash detected, will try to restart... 21:29:31 (1972): No heartbeat from core client for 30 sec - exiting 21:29:32 (1972): No heartbeat from core client for 30 sec - exiting 21:29:33 (1972): No heartbeat from core client for 30 sec - exiting 21:29:34 (1972): No heartbeat from core client for 30 sec - exiting 21:29:35 (1972): No heartbeat from core client for 30 sec - exiting 21:29:36 (1972): No heartbeat from core client for 30 sec - exiting 21:29:37 (1972): No heartbeat from core client for 30 sec - exiting 21:29:38 (1972): No heartbeat from core client for 30 sec - exiting 21:29:39 (1972): No heartbeat from core client for 30 sec - exiting 21:29:40 (1972): No heartbeat from core client for 30 sec - exiting 21:29:41 (1972): No heartbeat from core client for 30 sec - exiting 21:29:42 (1972): No heartbeat from core client for 30 sec - exiting 21:29:43 (1972): No heartbeat from core client for 30 sec - exiting 21:29:44 (1972): No heartbeat from core client for 30 sec - exiting 21:29:45 (1972): No heartbeat from core client for 30 sec - exiting 21:29:46 (1972): No heartbeat from core client for 30 sec - exiting 21:29:47 (1972): No heartbeat from core client for 30 sec - exiting 21:29:48 (1972): No heartbeat from core client for 30 sec - exiting 21:29:49 (1972): No heartbeat from core client for 30 sec - exiting 21:29:50 (1972): No heartbeat from core client for 30 sec - exiting 21:29:51 (1972): No heartbeat from core client for 30 sec - exiting 21:29:52 (1972): No heartbeat from core client for 30 sec - exiting 21:29:53 (1972): No heartbeat from core client for 30 sec - exiting 21:29:54 (1972): No heartbeat from core client for 30 sec - exiting 21:29:55 (1972): No heartbeat from core client for 30 sec - exiting 21:29:56 (1972): No heartbeat from core client for 30 sec - exiting 21:29:57 (1972): No heartbeat from core client for 30 sec - exiting 21:29:58 (1972): No heartbeat from core client for 30 sec - exiting 21:29:59 (1972): No heartbeat from core client for 30 sec - exiting 21:30:00 (1972): No heartbeat from core client for 30 sec - exiting 21:30:01 (1972): No heartbeat from core client for 30 sec - exiting 21:30:02 (1972): No heartbeat from core client for 30 sec - exiting 21:30:03 (1972): No heartbeat from core client for 30 sec - exiting 21:30:04 (1972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:49:54 (6840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:49:55 (6840): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6348, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6348, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 07:49:33 (4560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:49:35 (4560): No heartbeat from core client for 30 sec - exiting 07:49:36 (4560): No heartbeat from core client for 30 sec - exiting 07:49:37 (4560): No heartbeat from core client for 30 sec - exiting 07:49:38 (4560): No heartbeat from core client for 30 sec - exiting 07:49:39 (4560): No heartbeat from core client for 30 sec - exiting 07:49:40 (4560): No heartbeat from core client for 30 sec - exiting 07:49:41 (4560): No heartbeat from core client for 30 sec - exiting 07:49:42 (4560): No heartbeat from core client for 30 sec - exiting 07:49:43 (4560): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:28:42 (3112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:28:43 (3112): No heartbeat from core client for 30 sec - exiting 02:28:44 (3112): No heartbeat from core client for 30 sec - exiting 02:28:46 (3112): No heartbeat from core client for 30 sec - exiting 11:02:25 (2692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:02:26 (2692): No heartbeat from core client for 30 sec - exiting 11:02:27 (2692): No heartbeat from core client for 30 sec - exiting 11:35:04 (11976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:35:05 (11976): No heartbeat from core client for 30 sec - exiting 11:36:03 (14812): No heartbeat from core client for 30 sec - exiting 11:36:04 (14812): No heartbeat from core client for 30 sec - exiting 11:36:05 (14812): No heartbeat from core client for 30 sec - exiting 11:36:06 (14812): No heartbeat from core client for 30 sec - exiting 11:36:07 (14812): No heartbeat from core client for 30 sec - exiting 11:36:08 (14812): No heartbeat from core client for 30 sec - exiting 11:36:09 (14812): No heartbeat from core client for 30 sec - exiting 11:36:10 (14812): No heartbeat from core client for 30 sec - exiting 11:36:11 (14812): No heartbeat from core client for 30 sec - exiting 11:36:12 (14812): No heartbeat from core client for 30 sec - exiting 11:36:13 (14812): No heartbeat from core client for 30 sec - exiting 11:36:14 (14812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:42:34 (15048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:53:40 (14376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:53:41 (14376): No heartbeat from core client for 30 sec - exiting 11:53:42 (14376): No heartbeat from core client for 30 sec - exiting 11:53:43 (14376): No heartbeat from core client for 30 sec - exiting 11:53:44 (14376): No heartbeat from core client for 30 sec - exiting 00:55:16 (6888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:55:18 (6888): No heartbeat from core client for 30 sec - exiting 00:55:19 (6888): No heartbeat from core client for 30 sec - exiting 00:55:20 (6888): No heartbeat from core client for 30 sec - exiting 00:55:21 (6888): No heartbeat from core client for 30 sec - exiting 00:57:08 (24304): No heartbeat from core client for 30 sec - exiting 00:57:09 (24304): No heartbeat from core client for 30 sec - exiting 00:57:10 (24304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:10:10 (22544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:10:11 (22544): No heartbeat from core client for 30 sec - exiting 01:10:59 (21868): No heartbeat from core client for 30 sec - exiting 01:11:00 (21868): No heartbeat from core client for 30 sec - exiting 01:11:01 (21868): No heartbeat from core client for 30 sec - exiting 01:11:02 (21868): No heartbeat from core client for 30 sec - exiting 01:11:03 (21868): No heartbeat from core client for 30 sec - exiting 01:11:04 (21868): No heartbeat from core client for 30 sec - exiting 01:11:05 (21868): No heartbeat from core client for 30 sec - exiting 01:11:06 (21868): No heartbeat from core client for 30 sec - exiting 01:11:07 (21868): No heartbeat from core client for 30 sec - exiting 01:11:08 (21868): No heartbeat from core client for 30 sec - exiting 01:11:09 (21868): No heartbeat from core client for 30 sec - exiting 01:11:10 (21868): No heartbeat from core client for 30 sec - exiting 01:11:11 (21868): No heartbeat from core client for 30 sec - exiting 01:11:12 (21868): No heartbeat from core client for 30 sec - exiting 01:11:13 (21868): No heartbeat from core client for 30 sec - exiting 01:11:14 (21868): No heartbeat from core client for 30 sec - exiting 01:11:15 (21868): No heartbeat from core client for 30 sec - exiting 01:11:16 (21868): No heartbeat from core client for 30 sec - exiting 01:11:17 (21868): No heartbeat from core client for 30 sec - exiting 01:11:18 (21868): No heartbeat from core client for 30 sec - exiting 01:11:19 (21868): No heartbeat from core client for 30 sec - exiting 01:11:20 (21868): No heartbeat from core client for 30 sec - exiting 01:11:21 (21868): No heartbeat from core client for 30 sec - exiting 01:11:23 (21868): No heartbeat from core client for 30 sec - exiting 01:11:24 (21868): No heartbeat from core client for 30 sec - exiting 01:11:26 (21868): No heartbeat from core client for 30 sec - exiting 01:11:30 (21868): No heartbeat from core client for 30 sec - exiting 01:11:31 (21868): No heartbeat from core client for 30 sec - exiting 01:11:32 (21868): No heartbeat from core client for 30 sec - exiting 01:11:35 (21868): No heartbeat from core client for 30 sec - exiting 01:11:37 (21868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:21:21 (23288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:21:22 (23288): No heartbeat from core client for 30 sec - exiting 01:21:23 (23288): No heartbeat from core client for 30 sec - exiting 11:17:02 (7728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:17:03 (7728): No heartbeat from core client for 30 sec - exiting 11:17:04 (7728): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 11:19:34 (6580): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 00:40:40 (3912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:40:42 (3912): No heartbeat from core client for 30 sec - exiting 00:40:43 (3912): No heartbeat from core client for 30 sec - exiting 00:40:44 (3912): No heartbeat from core client for 30 sec - exiting 00:41:43 (7548): No heartbeat from core client for 30 sec - exiting 00:41:44 (7548): No heartbeat from core client for 30 sec - exiting 00:41:45 (7548): No heartbeat from core client for 30 sec - exiting 00:41:46 (7548): No heartbeat from core client for 30 sec - exiting 00:41:47 (7548): No heartbeat from core client for 30 sec - exiting 00:41:48 (7548): No heartbeat from core client for 30 sec - exiting 00:41:49 (7548): No heartbeat from core client for 30 sec - exiting 00:41:50 (7548): No heartbeat from core client for 30 sec - exiting 00:41:51 (7548): No heartbeat from core client for 30 sec - exiting 00:41:52 (7548): No heartbeat from core client for 30 sec - exiting 00:41:53 (7548): No heartbeat from core client for 30 sec - exiting 00:41:54 (7548): No heartbeat from core client for 30 sec - exiting 00:41:55 (7548): No heartbeat from core client for 30 sec - exiting 00:41:56 (7548): No heartbeat from core client for 30 sec - exiting 00:41:57 (7548): No heartbeat from core client for 30 sec - exiting 00:41:58 (7548): No heartbeat from core client for 30 sec - exiting 00:41:59 (7548): No heartbeat from core client for 30 sec - exiting 00:42:00 (7548): No heartbeat from core client for 30 sec - exiting 00:42:01 (7548): No heartbeat from core client for 30 sec - exiting 00:42:02 (7548): No heartbeat from core client for 30 sec - exiting 00:42:03 (7548): No heartbeat from core client for 30 sec - exiting 00:42:04 (7548): No heartbeat from core client for 30 sec - exiting 00:42:05 (7548): No heartbeat from core client for 30 sec - exiting 00:42:06 (7548): No heartbeat from core client for 30 sec - exiting 00:42:07 (7548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7964, iMonCtr=1 Model crash detected, will try to restart... 09:48:19 (5908): No heartbeat from core client for 30 sec - exiting 09:48:20 (5908): No heartbeat from core client for 30 sec - exiting 09:48:21 (5908): No heartbeat from core client for 30 sec - exiting 09:48:22 (5908): No heartbeat from core client for 30 sec - exiting 09:48:23 (5908): No heartbeat from core client for 30 sec - exiting 09:48:24 (5908): No heartbeat from core client for 30 sec - exiting 09:48:26 (5908): No heartbeat from core client for 30 sec - exiting 09:48:27 (5908): No heartbeat from core client for 30 sec - exiting 09:48:28 (5908): No heartbeat from core client for 30 sec - exiting 09:48:29 (5908): No heartbeat from core client for 30 sec - exiting 09:48:30 (5908): No heartbeat from core client for 30 sec - exiting 09:48:31 (5908): No heartbeat from core client for 30 sec - exiting 09:48:32 (5908): No heartbeat from core client for 30 sec - exiting 09:48:33 (5908): No heartbeat from core client for 30 sec - exiting 09:48:34 (5908): No heartbeat from core client for 30 sec - exiting 09:48:35 (5908): No heartbeat from core client for 30 sec - exiting 09:48:36 (5908): No heartbeat from core client for 30 sec - exiting 09:48:37 (5908): No heartbeat from core client for 30 sec - exiting 09:48:39 (5908): No heartbeat from core client for 30 sec - exiting 09:48:40 (5908): No heartbeat from core client for 30 sec - exiting 09:48:41 (5908): No heartbeat from core client for 30 sec - exiting 09:48:42 (5908): No heartbeat from core client for 30 sec - exiting 09:48:43 (5908): No heartbeat from core client for 30 sec - exiting 09:48:44 (5908): No heartbeat from core client for 30 sec - exiting 09:48:45 (5908): No heartbeat from core client for 30 sec - exiting 09:48:46 (5908): No heartbeat from core client for 30 sec - exiting 09:48:47 (5908): No heartbeat from core client for 30 sec - exiting 09:48:48 (5908): No heartbeat from core client for 30 sec - exiting 09:48:49 (5908): No heartbeat from core client for 30 sec - exiting 09:48:50 (5908): No heartbeat from core client for 30 sec - exiting 09:48:51 (5908): No heartbeat from core client for 30 sec - exiting 09:48:52 (5908): No heartbeat from core client for 30 sec - exiting 09:48:53 (5908): No heartbeat from core client for 30 sec - exiting 09:48:54 (5908): No heartbeat from core client for 30 sec - exiting 09:48:55 (5908): No heartbeat from core client for 30 sec - exiting 09:48:56 (5908): No heartbeat from core client for 30 sec - exiting 09:48:57 (5908): No heartbeat from core client for 30 sec - exiting 09:48:58 (5908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:48:59 (5908): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:47:04 (7648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:47:05 (7648): No heartbeat from core client for 30 sec - exiting 15:47:06 (7648): No heartbeat from core client for 30 sec - exiting 15:47:07 (7648): No heartbeat from core client for 30 sec - exiting 15:47:08 (7648): No heartbeat from core client for 30 sec - exiting 15:48:58 (3092): No heartbeat from core client for 30 sec - exiting 15:48:59 (3092): No heartbeat from core client for 30 sec - exiting 15:49:00 (3092): No heartbeat from core client for 30 sec - exiting 15:49:01 (3092): No heartbeat from core client for 30 sec - exiting 15:49:03 (3092): No heartbeat from core client for 30 sec - exiting 15:49:04 (3092): No heartbeat from core client for 30 sec - exiting 15:49:05 (3092): No heartbeat from core client for 30 sec - exiting 15:49:06 (3092): No heartbeat from core client for 30 sec - exiting 15:49:07 (3092): No heartbeat from core client for 30 sec - exiting 15:49:08 (3092): No heartbeat from core client for 30 sec - exiting 15:49:09 (3092): No heartbeat from core client for 30 sec - exiting 15:49:10 (3092): No heartbeat from core client for 30 sec - exiting 15:49:11 (3092): No heartbeat from core client for 30 sec - exiting 15:49:12 (3092): No heartbeat from core client for 30 sec - exiting 15:49:13 (3092): No heartbeat from core client for 30 sec - exiting 15:49:14 (3092): No heartbeat from core client for 30 sec - exiting 15:49:15 (3092): No heartbeat from core client for 30 sec - exiting 15:49:16 (3092): No heartbeat from core client for 30 sec - exiting 15:49:17 (3092): No heartbeat from core client for 30 sec - exiting 15:49:18 (3092): No heartbeat from core client for 30 sec - exiting 15:49:19 (3092): No heartbeat from core client for 30 sec - exiting 15:49:20 (3092): No heartbeat from core client for 30 sec - exiting 15:49:21 (3092): No heartbeat from core client for 30 sec - exiting 15:49:22 (3092): No heartbeat from core client for 30 sec - exiting 15:49:23 (3092): No heartbeat from core client for 30 sec - exiting 15:49:24 (3092): No heartbeat from core client for 30 sec - exiting 15:49:25 (3092): No heartbeat from core client for 30 sec - exiting 15:49:26 (3092): No heartbeat from core client for 30 sec - exiting 15:49:27 (3092): No heartbeat from core client for 30 sec - exiting 15:49:28 (3092): No heartbeat from core client for 30 sec - exiting 15:49:29 (3092): No heartbeat from core client for 30 sec - exiting 15:49:30 (3092): No heartbeat from core client for 30 sec - exiting 15:49:31 (3092): No heartbeat from core client for 30 sec - exiting 15:49:32 (3092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:51:50 (7392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:52:27 (7888): No heartbeat from core client for 30 sec - exiting 15:52:28 (7888): No heartbeat from core client for 30 sec - exiting 15:52:29 (7888): No heartbeat from core client for 30 sec - exiting 15:52:30 (7888): No heartbeat from core client for 30 sec - exiting 15:52:31 (7888): No heartbeat from core client for 30 sec - exiting 15:52:32 (7888): No heartbeat from core client for 30 sec - exiting 15:52:33 (7888): No heartbeat from core client for 30 sec - exiting 15:52:34 (7888): No heartbeat from core client for 30 sec - exiting 15:52:36 (7888): No heartbeat from core client for 30 sec - exiting 15:52:37 (7888): No heartbeat from core client for 30 sec - exiting 15:52:38 (7888): No heartbeat from core client for 30 sec - exiting 15:52:39 (7888): No heartbeat from core client for 30 sec - exiting 15:52:40 (7888): No heartbeat from core client for 30 sec - exiting 15:52:41 (7888): No heartbeat from core client for 30 sec - exiting 15:52:42 (7888): No heartbeat from core client for 30 sec - exiting 15:52:43 (7888): No heartbeat from core client for 30 sec - exiting 15:52:44 (7888): No heartbeat from core client for 30 sec - exiting 15:52:45 (7888): No heartbeat from core client for 30 sec - exiting 15:52:46 (7888): No heartbeat from core client for 30 sec - exiting 15:52:47 (7888): No heartbeat from core client for 30 sec - exiting 15:52:48 (7888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:23:21 (6676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:23:22 (6676): No heartbeat from core client for 30 sec - exiting 16:24:59 (3108): No heartbeat from core client for 30 sec - exiting 16:25:00 (3108): No heartbeat from core client for 30 sec - exiting 16:25:01 (3108): No heartbeat from core client for 30 sec - exiting 16:25:02 (3108): No heartbeat from core client for 30 sec - exiting 16:25:03 (3108): No heartbeat from core client for 30 sec - exiting 16:25:04 (3108): No heartbeat from core client for 30 sec - exiting 16:25:05 (3108): No heartbeat from core client for 30 sec - exiting 16:25:06 (3108): No heartbeat from core client for 30 sec - exiting 16:25:07 (3108): No heartbeat from core client for 30 sec - exiting 16:25:08 (3108): No heartbeat from core client for 30 sec - exiting 16:25:09 (3108): No heartbeat from core client for 30 sec - exiting 16:25:10 (3108): No heartbeat from core client for 30 sec - exiting 16:25:11 (3108): No heartbeat from core client for 30 sec - exiting 16:25:12 (3108): No heartbeat from core client for 30 sec - exiting 16:25:13 (3108): No heartbeat from core client for 30 sec - exiting 16:25:14 (3108): No heartbeat from core client for 30 sec - exiting 16:25:15 (3108): No heartbeat from core client for 30 sec - exiting 16:25:16 (3108): No heartbeat from core client for 30 sec - exiting 16:25:17 (3108): No heartbeat from core client for 30 sec - exiting 16:25:18 (3108): No heartbeat from core client for 30 sec - exiting 16:25:19 (3108): No heartbeat from core client for 30 sec - exiting 16:25:20 (3108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:28:24 (6028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:28:26 (6028): No heartbeat from core client for 30 sec - exiting 17:28:27 (6028): No heartbeat from core client for 30 sec - exiting 17:30:03 (2216): No heartbeat from core client for 30 sec - exiting 17:30:04 (2216): No heartbeat from core client for 30 sec - exiting 17:30:05 (2216): No heartbeat from core client for 30 sec - exiting 17:30:06 (2216): No heartbeat from core client for 30 sec - exiting 17:30:07 (2216): No heartbeat from core client for 30 sec - exiting 17:30:08 (2216): No heartbeat from core client for 30 sec - exiting 17:30:10 (2216): No heartbeat from core client for 30 sec - exiting 17:30:11 (2216): No heartbeat from core client for 30 sec - exiting 17:30:12 (2216): No heartbeat from core client for 30 sec - exiting 17:30:13 (2216): No heartbeat from core client for 30 sec - exiting 17:30:14 (2216): No heartbeat from core client for 30 sec - exiting 17:30:15 (2216): No heartbeat from core client for 30 sec - exiting 17:30:16 (2216): No heartbeat from core client for 30 sec - exiting 17:30:17 (2216): No heartbeat from core client for 30 sec - exiting 17:30:18 (2216): No heartbeat from core client for 30 sec - exiting 17:30:19 (2216): No heartbeat from core client for 30 sec - exiting 17:30:20 (2216): No heartbeat from core client for 30 sec - exiting 17:30:22 (2216): No heartbeat from core client for 30 sec - exiting 17:30:23 (2216): No heartbeat from core client for 30 sec - exiting 17:30:24 (2216): No heartbeat from core client for 30 sec - exiting 17:30:25 (2216): No heartbeat from core client for 30 sec - exiting 17:30:26 (2216): No heartbeat from core client for 30 sec - exiting 17:30:27 (2216): No heartbeat from core client for 30 sec - exiting 17:30:28 (2216): No heartbeat from core client for 30 sec - exiting 17:30:29 (2216): No heartbeat from core client for 30 sec - exiting 17:30:30 (2216): No heartbeat from core client for 30 sec - exiting 17:30:31 (2216): No heartbeat from core client for 30 sec - exiting 17:30:32 (2216): No heartbeat from core client for 30 sec - exiting 17:30:33 (2216): No heartbeat from core client for 30 sec - exiting 17:30:34 (2216): No heartbeat from core client for 30 sec - exiting 17:30:35 (2216): No heartbeat from core client for 30 sec - exiting 17:30:36 (2216): No heartbeat from core client for 30 sec - exiting 17:30:37 (2216): No heartbeat from core client for 30 sec - exiting 17:30:38 (2216): No heartbeat from core client for 30 sec - exiting 17:30:39 (2216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:53:04 (5872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:53:05 (5872): No heartbeat from core client for 30 sec - exiting 21:03:32 (4460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:03:34 (4460): No heartbeat from core client for 30 sec - exiting 21:03:35 (4460): No heartbeat from core client for 30 sec - exiting 21:03:36 (4460): No heartbeat from core client for 30 sec - exiting 21:04:47 (6392): No heartbeat from core client for 30 sec - exiting 21:04:48 (6392): No heartbeat from core client for 30 sec - exiting 21:04:49 (6392): No heartbeat from core client for 30 sec - exiting 21:04:50 (6392): No heartbeat from core client for 30 sec - exiting 21:04:51 (6392): No heartbeat from core client for 30 sec - exiting 21:04:52 (6392): No heartbeat from core client for 30 sec - exiting 21:04:53 (6392): No heartbeat from core client for 30 sec - exiting 21:04:54 (6392): No heartbeat from core client for 30 sec - exiting 21:04:55 (6392): No heartbeat from core client for 30 sec - exiting 21:04:56 (6392): No heartbeat from core client for 30 sec - exiting 21:04:57 (6392): No heartbeat from core client for 30 sec - exiting 21:04:58 (6392): No heartbeat from core client for 30 sec - exiting 21:04:59 (6392): No heartbeat from core client for 30 sec - exiting 21:05:00 (6392): No heartbeat from core client for 30 sec - exiting 21:05:01 (6392): No heartbeat from core client for 30 sec - exiting 21:05:02 (6392): No heartbeat from core client for 30 sec - exiting 21:05:03 (6392): No heartbeat from core client for 30 sec - exiting 21:05:04 (6392): No heartbeat from core client for 30 sec - exiting 21:05:05 (6392): No heartbeat from core client for 30 sec - exiting 21:05:06 (6392): No heartbeat from core client for 30 sec - exiting 21:05:07 (6392): No heartbeat from core client for 30 sec - exiting 21:05:08 (6392): No heartbeat from core client for 30 sec - exiting 21:05:09 (6392): No heartbeat from core client for 30 sec - exiting 21:05:11 (6392): No heartbeat from core client for 30 sec - exiting 21:05:12 (6392): No heartbeat from core client for 30 sec - exiting 21:05:13 (6392): No heartbeat from core client for 30 sec - exiting 21:05:14 (6392): No heartbeat from core client for 30 sec - exiting 21:05:15 (6392): No heartbeat from core client for 30 sec - exiting 21:05:17 (6392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7756, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:49:56 (6652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:49:57 (6652): No heartbeat from core client for 30 sec - exiting 21:49:58 (6652): No heartbeat from core client for 30 sec - exiting 21:49:59 (6652): No heartbeat from core client for 30 sec - exiting 21:51:18 (7332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:50:06 (3764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:50:07 (3764): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7032, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 11:16:35 (800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:16:36 (800): No heartbeat from core client for 30 sec - exiting 11:40:50 (7448): No heartbeat from core client for 30 sec - exiting 11:40:51 (7448): No heartbeat from core client for 30 sec - exiting 11:40:52 (7448): No heartbeat from core client for 30 sec - exiting 11:40:53 (7448): No heartbeat from core client for 30 sec - exiting 11:40:54 (7448): No heartbeat from core client for 30 sec - exiting 11:40:55 (7448): No heartbeat from core client for 30 sec - exiting 11:40:56 (7448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:12:00 (1560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:12:01 (1560): No heartbeat from core client for 30 sec - exiting 13:12:55 (5044): No heartbeat from core client for 30 sec - exiting 13:12:56 (5044): No heartbeat from core client for 30 sec - exiting 13:12:57 (5044): No heartbeat from core client for 30 sec - exiting 13:12:58 (5044): No heartbeat from core client for 30 sec - exiting 13:12:59 (5044): No heartbeat from core client for 30 sec - exiting 13:13:00 (5044): No heartbeat from core client for 30 sec - exiting 13:13:01 (5044): No heartbeat from core client for 30 sec - exiting 13:13:02 (5044): No heartbeat from core client for 30 sec - exiting 13:13:03 (5044): No heartbeat from core client for 30 sec - exiting 13:13:04 (5044): No heartbeat from core client for 30 sec - exiting 13:13:05 (5044): No heartbeat from core client for 30 sec - exiting 13:13:06 (5044): No heartbeat from core client for 30 sec - exiting 13:13:07 (5044): No heartbeat from core client for 30 sec - exiting 13:13:08 (5044): No heartbeat from core client for 30 sec - exiting 13:13:09 (5044): No heartbeat from core client for 30 sec - exiting 13:13:10 (5044): No heartbeat from core client for 30 sec - exiting 13:13:11 (5044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:07:17 (6484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:07:19 (6484): No heartbeat from core client for 30 sec - exiting 14:44:42 (10104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:44:45 (10104): No heartbeat from core client for 30 sec - exiting 14:45:50 (8276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:17:10 (6904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:17:11 (6904): No heartbeat from core client for 30 sec - exiting 15:18:09 (10104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:49:08 (8276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:49:09 (8276): No heartbeat from core client for 30 sec - exiting 15:49:10 (8276): No heartbeat from core client for 30 sec - exiting 15:50:26 (7116): No heartbeat from core client for 30 sec - exiting 15:50:27 (7116): No heartbeat from core client for 30 sec - exiting 15:50:28 (7116): No heartbeat from core client for 30 sec - exiting 15:50:29 (7116): No heartbeat from core client for 30 sec - exiting 15:50:30 (7116): No heartbeat from core client for 30 sec - exiting 15:50:31 (7116): No heartbeat from core client for 30 sec - exiting 15:50:32 (7116): No heartbeat from core client for 30 sec - exiting 15:50:33 (7116): No heartbeat from core client for 30 sec - exiting 15:50:34 (7116): No heartbeat from core client for 30 sec - exiting 15:50:35 (7116): No heartbeat from core client for 30 sec - exiting 15:50:36 (7116): No heartbeat from core client for 30 sec - exiting 15:50:37 (7116): No heartbeat from core client for 30 sec - exiting 15:50:39 (7116): No heartbeat from core client for 30 sec - exiting 15:50:40 (7116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:07:06 (7248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:55:52 (9836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:55:53 (9836): No heartbeat from core client for 30 sec - exiting 16:55:54 (9836): No heartbeat from core client for 30 sec - exiting 16:55:55 (9836): No heartbeat from core client for 30 sec - exiting 16:55:56 (9836): No heartbeat from core client for 30 sec - exiting 16:58:03 (11456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:19:02 (9676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:19:04 (9676): No heartbeat from core client for 30 sec - exiting 13:19:05 (9676): No heartbeat from core client for 30 sec - exiting 13:19:06 (9676): No heartbeat from core client for 30 sec - exiting 23:34:05 (11232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:34:07 (11232): No heartbeat from core client for 30 sec - exiting 23:34:08 (11232): No heartbeat from core client for 30 sec - exiting 23:34:09 (11232): No heartbeat from core client for 30 sec - exiting 23:34:10 (11232): No heartbeat from core client for 30 sec - exiting 23:34:11 (11232): No heartbeat from core client for 30 sec - exiting 23:34:12 (11232): No heartbeat from core client for 30 sec - exiting 23:35:33 (10376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12180, iMonCtr=1 Model crash detected, will try to restart... 21:14:58 (908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:14:59 (908): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8652, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:47:06 (4212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:47:07 (4212): No heartbeat from core client for 30 sec - exiting 16:22:52 (6976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:22:53 (6976): No heartbeat from core client for 30 sec - exiting 16:22:54 (6976): No heartbeat from core client for 30 sec - exiting 16:22:55 (6976): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6756, iMonCtr=1 Model crash detected, will try to restart... 09:38:11 (2712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:06:20 (7824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:06:21 (7824): No heartbeat from core client for 30 sec - exiting 21:39:43 (7344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:39:45 (7344): No heartbeat from core client for 30 sec - exiting 21:39:46 (7344): No heartbeat from core client for 30 sec - exiting 21:39:47 (7344): No heartbeat from core client for 30 sec - exiting 21:40:58 (8056): No heartbeat from core client for 30 sec - exiting 21:40:59 (8056): No heartbeat from core client for 30 sec - exiting 21:41:00 (8056): No heartbeat from core client for 30 sec - exiting 21:41:01 (8056): No heartbeat from core client for 30 sec - exiting 21:41:02 (8056): No heartbeat from core client for 30 sec - exiting 21:41:03 (8056): No heartbeat from core client for 30 sec - exiting 21:41:04 (8056): No heartbeat from core client for 30 sec - exiting 21:41:05 (8056): No heartbeat from core client for 30 sec - exiting 21:41:06 (8056): No heartbeat from core client for 30 sec - exiting 21:41:07 (8056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:12:28 (6868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:12:29 (6868): No heartbeat from core client for 30 sec - exiting 22:13:21 (3968): No heartbeat from core client for 30 sec - exiting 22:13:22 (3968): No heartbeat from core client for 30 sec - exiting 22:13:24 (3968): No heartbeat from core client for 30 sec - exiting 22:13:25 (3968): No heartbeat from core client for 30 sec - exiting 22:13:26 (3968): No heartbeat from core client for 30 sec - exiting 22:13:27 (3968): No heartbeat from core client for 30 sec - exiting 22:13:28 (3968): No heartbeat from core client for 30 sec - exiting 22:13:29 (3968): No heartbeat from core client for 30 sec - exiting 22:13:30 (3968): No heartbeat from core client for 30 sec - exiting 22:13:31 (3968): No heartbeat from core client for 30 sec - exiting 22:13:32 (3968): No heartbeat from core client for 30 sec - exiting 22:13:33 (3968): No heartbeat from core client for 30 sec - exiting 22:13:34 (3968): No heartbeat from core client for 30 sec - exiting 22:13:35 (3968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:44:15 (7380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:44:20 (7380): No heartbeat from core client for 30 sec - exiting 22:44:21 (7380): No heartbeat from core client for 30 sec - exiting 22:44:22 (7380): No heartbeat from core client for 30 sec - exiting 22:44:23 (7380): No heartbeat from core client for 30 sec - exiting 22:45:50 (7992): No heartbeat from core client for 30 sec - exiting 22:45:51 (7992): No heartbeat from core client for 30 sec - exiting 22:45:52 (7992): No heartbeat from core client for 30 sec - exiting 22:45:54 (7992): No heartbeat from core client for 30 sec - exiting 22:45:55 (7992): No heartbeat from core client for 30 sec - exiting 22:45:56 (7992): No heartbeat from core client for 30 sec - exiting 22:45:57 (7992): No heartbeat from core client for 30 sec - exiting 22:45:58 (7992): No heartbeat from core client for 30 sec - exiting 22:45:59 (7992): No heartbeat from core client for 30 sec - exiting 22:46:00 (7992): No heartbeat from core client for 30 sec - exiting 22:46:01 (7992): No heartbeat from core client for 30 sec - exiting 22:46:02 (7992): No heartbeat from core client for 30 sec - exiting 22:46:03 (7992): No heartbeat from core client for 30 sec - exiting 22:46:04 (7992): No heartbeat from core client for 30 sec - exiting 22:46:05 (7992): No heartbeat from core client for 30 sec - exiting 22:46:06 (7992): No heartbeat from core client for 30 sec - exiting 22:46:07 (7992): No heartbeat from core client for 30 sec - exiting 22:46:08 (7992): No heartbeat from core client for 30 sec - exiting 22:46:09 (7992): No heartbeat from core client for 30 sec - exiting 22:46:10 (7992): No heartbeat from core client for 30 sec - exiting 22:46:12 (7992): No heartbeat from core client for 30 sec - exiting 22:46:14 (7992): No heartbeat from core client for 30 sec - exiting 22:46:15 (7992): No heartbeat from core client for 30 sec - exiting 22:46:16 (7992): No heartbeat from core client for 30 sec - exiting 22:46:18 (7992): No heartbeat from core client for 30 sec - exiting 22:46:19 (7992): No heartbeat from core client for 30 sec - exiting 22:46:20 (7992): No heartbeat from core client for 30 sec - exiting 22:46:22 (7992): No heartbeat from core client for 30 sec - exiting 22:46:24 (7992): No heartbeat from core client for 30 sec - exiting 22:46:26 (7992): No heartbeat from core client for 30 sec - exiting 22:46:27 (7992): No heartbeat from core client for 30 sec - exiting 22:46:29 (7992): No heartbeat from core client for 30 sec - exiting 22:46:30 (7992): No heartbeat from core client for 30 sec - exiting 22:46:32 (7992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:07:16 (5936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:07:17 (5936): No heartbeat from core client for 30 sec - exiting 23:08:07 (7160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:47:33 (6908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:18:31 (6928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:18:32 (6928): No heartbeat from core client for 30 sec - exiting 00:18:33 (6928): No heartbeat from core client for 30 sec - exiting 00:19:57 (7808): No heartbeat from core client for 30 sec - exiting 00:19:58 (7808): No heartbeat from core client for 30 sec - exiting 00:19:59 (7808): No heartbeat from core client for 30 sec - exiting 00:20:00 (7808): No heartbeat from core client for 30 sec - exiting 00:20:02 (7808): No heartbeat from core client for 30 sec - exiting 00:20:03 (7808): No heartbeat from core client for 30 sec - exiting 00:20:04 (7808): No heartbeat from core client for 30 sec - exiting 00:20:05 (7808): No heartbeat from core client for 30 sec - exiting 00:20:06 (7808): No heartbeat from core client for 30 sec - exiting 00:20:07 (7808): No heartbeat from core client for 30 sec - exiting 00:20:08 (7808): No heartbeat from core client for 30 sec - exiting 00:20:09 (7808): No heartbeat from core client for 30 sec - exiting 00:20:10 (7808): No heartbeat from core client for 30 sec - exiting 00:20:11 (7808): No heartbeat from core client for 30 sec - exiting 00:20:12 (7808): No heartbeat from core client for 30 sec - exiting 00:20:13 (7808): No heartbeat from core client for 30 sec - exiting 00:20:14 (7808): No heartbeat from core client for 30 sec - exiting 00:20:15 (7808): No heartbeat from core client for 30 sec - exiting 00:20:16 (7808): No heartbeat from core client for 30 sec - exiting 00:20:17 (7808): No heartbeat from core client for 30 sec - exiting 00:20:18 (7808): No heartbeat from core client for 30 sec - exiting 00:20:19 (7808): No heartbeat from core client for 30 sec - exiting 00:20:20 (7808): No heartbeat from core client for 30 sec - exiting 00:20:21 (7808): No heartbeat from core client for 30 sec - exiting 00:20:22 (7808): No heartbeat from core client for 30 sec - exiting 00:20:23 (7808): No heartbeat from core client for 30 sec - exiting 00:20:24 (7808): No heartbeat from core client for 30 sec - exiting 00:20:25 (7808): No heartbeat from core client for 30 sec - exiting 00:20:26 (7808): No heartbeat from core client for 30 sec - exiting 00:20:27 (7808): No heartbeat from core client for 30 sec - exiting 00:20:28 (7808): No heartbeat from core client for 30 sec - exiting 00:20:29 (7808): No heartbeat from core client for 30 sec - exiting 00:20:30 (7808): No heartbeat from core client for 30 sec - exiting 00:20:31 (7808): No heartbeat from core client for 30 sec - exiting 00:20:32 (7808): No heartbeat from core client for 30 sec - exiting 00:20:33 (7808): No heartbeat from core client for 30 sec - exiting 00:20:34 (7808): No heartbeat from core client for 30 sec - exiting 00:20:35 (7808): No heartbeat from core client for 30 sec - exiting 00:20:36 (7808): No heartbeat from core client for 30 sec - exiting 00:20:37 (7808): No heartbeat from core client for 30 sec - exiting 00:20:38 (7808): No heartbeat from core client for 30 sec - exiting 00:20:39 (7808): No heartbeat from core client for 30 sec - exiting 00:20:40 (7808): No heartbeat from core client for 30 sec - exiting 00:20:41 (7808): No heartbeat from core client for 30 sec - exiting 00:20:42 (7808): No heartbeat from core client for 30 sec - exiting 00:20:43 (7808): No heartbeat from core client for 30 sec - exiting 00:20:44 (7808): No heartbeat from core client for 30 sec - exiting 00:20:45 (7808): No heartbeat from core client for 30 sec - exiting 00:20:46 (7808): No heartbeat from core client for 30 sec - exiting 00:20:47 (7808): No heartbeat from core client for 30 sec - exiting 00:20:48 (7808): No heartbeat from core client for 30 sec - exiting 00:20:49 (7808): No heartbeat from core client for 30 sec - exiting 00:20:50 (7808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:54:35 (6592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:54:36 (6592): No heartbeat from core client for 30 sec - exiting 12:54:37 (6592): No heartbeat from core client for 30 sec - exiting 12:55:40 (4036): No heartbeat from core client for 30 sec - exiting 12:55:41 (4036): No heartbeat from core client for 30 sec - exiting 12:55:42 (4036): No heartbeat from core client for 30 sec - exiting 12:55:43 (4036): No heartbeat from core client for 30 sec - exiting 12:55:44 (4036): No heartbeat from core client for 30 sec - exiting 12:55:45 (4036): No heartbeat from core client for 30 sec - exiting 12:55:46 (4036): No heartbeat from core client for 30 sec - exiting 12:55:47 (4036): No heartbeat from core client for 30 sec - exiting 12:55:48 (4036): No heartbeat from core client for 30 sec - exiting 12:55:49 (4036): No heartbeat from core client for 30 sec - exiting 12:55:50 (4036): No heartbeat from core client for 30 sec - exiting 12:55:51 (4036): No heartbeat from core client for 30 sec - exiting 12:55:52 (4036): No heartbeat from core client for 30 sec - exiting 12:55:53 (4036): No heartbeat from core client for 30 sec - exiting 12:55:54 (4036): No heartbeat from core client for 30 sec - exiting 12:55:55 (4036): No heartbeat from core client for 30 sec - exiting 12:55:56 (4036): No heartbeat from core client for 30 sec - exiting 12:55:57 (4036): No heartbeat from core client for 30 sec - exiting 12:55:58 (4036): No heartbeat from core client for 30 sec - exiting 12:55:59 (4036): No heartbeat from core client for 30 sec - exiting 12:56:00 (4036): No heartbeat from core client for 30 sec - exiting 12:56:01 (4036): No heartbeat from core client for 30 sec - exiting 12:56:02 (4036): No heartbeat from core client for 30 sec - exiting 12:56:03 (4036): No heartbeat from core client for 30 sec - exiting 12:56:04 (4036): No heartbeat from core client for 30 sec - exiting 12:56:05 (4036): No heartbeat from core client for 30 sec - exiting 12:56:06 (4036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:57:17 (7056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:57:18 (7056): No heartbeat from core client for 30 sec - exiting 13:57:19 (7056): No heartbeat from core client for 30 sec - exiting 13:57:20 (7056): No heartbeat from core client for 30 sec - exiting 13:58:49 (4992): No heartbeat from core client for 30 sec - exiting 13:58:50 (4992): No heartbeat from core client for 30 sec - exiting 13:58:51 (4992): No heartbeat from core client for 30 sec - exiting 13:58:52 (4992): No heartbeat from core client for 30 sec - exiting 13:58:53 (4992): No heartbeat from core client for 30 sec - exiting 13:58:54 (4992): No heartbeat from core client for 30 sec - exiting 13:58:55 (4992): No heartbeat from core client for 30 sec - exiting 13:58:56 (4992): No heartbeat from core client for 30 sec - exiting 13:58:57 (4992): No heartbeat from core client for 30 sec - exiting 13:58:58 (4992): No heartbeat from core client for 30 sec - exiting 13:58:59 (4992): No heartbeat from core client for 30 sec - exiting 13:59:00 (4992): No heartbeat from core client for 30 sec - exiting 13:59:01 (4992): No heartbeat from core client for 30 sec - exiting 13:59:02 (4992): No heartbeat from core client for 30 sec - exiting 13:59:03 (4992): No heartbeat from core client for 30 sec - exiting 13:59:04 (4992): No heartbeat from core client for 30 sec - exiting 13:59:05 (4992): No heartbeat from core client for 30 sec - exiting 13:59:06 (4992): No heartbeat from core client for 30 sec - exiting 13:59:07 (4992): No heartbeat from core client for 30 sec - exiting 13:59:08 (4992): No heartbeat from core client for 30 sec - exiting 13:59:09 (4992): No heartbeat from core client for 30 sec - exiting 13:59:10 (4992): No heartbeat from core client for 30 sec - exiting 13:59:11 (4992): No heartbeat from core client for 30 sec - exiting 13:59:12 (4992): No heartbeat from core client for 30 sec - exiting 13:59:13 (4992): No heartbeat from core client for 30 sec - exiting 13:59:14 (4992): No heartbeat from core client for 30 sec - exiting 13:59:15 (4992): No heartbeat from core client for 30 sec - exiting 13:59:16 (4992): No heartbeat from core client for 30 sec - exiting 13:59:17 (4992): No heartbeat from core client for 30 sec - exiting 13:59:18 (4992): No heartbeat from core client for 30 sec - exiting 13:59:19 (4992): No heartbeat from core client for 30 sec - exiting 13:59:20 (4992): No heartbeat from core client for 30 sec - exiting 13:59:21 (4992): No heartbeat from core client for 30 sec - exiting 13:59:22 (4992): No heartbeat from core client for 30 sec - exiting 13:59:23 (4992): No heartbeat from core client for 30 sec - exiting 13:59:24 (4992): No heartbeat from core client for 30 sec - exiting 13:59:25 (4992): No heartbeat from core client for 30 sec - exiting 13:59:26 (4992): No heartbeat from core client for 30 sec - exiting 13:59:27 (4992): No heartbeat from core client for 30 sec - exiting 13:59:28 (4992): No heartbeat from core client for 30 sec - exiting 13:59:29 (4992): No heartbeat from core client for 30 sec - exiting 13:59:30 (4992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:15:41 (3940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:15:43 (3940): No heartbeat from core client for 30 sec - exiting 23:15:44 (3940): No heartbeat from core client for 30 sec - exiting 23:15:45 (3940): No heartbeat from core client for 30 sec - exiting 23:15:46 (3940): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3164, iMonCtr=1 Model crash detected, will try to restart... 10:59:40 (484): No heartbeat from core client for 30 sec - exiting 10:59:41 (484): No heartbeat from core client for 30 sec - exiting 10:59:42 (484): No heartbeat from core client for 30 sec - exiting 10:59:43 (484): No heartbeat from core client for 30 sec - exiting 10:59:44 (484): No heartbeat from core client for 30 sec - exiting 10:59:45 (484): No heartbeat from core client for 30 sec - exiting 10:59:46 (484): No heartbeat from core client for 30 sec - exiting 10:59:47 (484): No heartbeat from core client for 30 sec - exiting 10:59:48 (484): No heartbeat from core client for 30 sec - exiting 10:59:49 (484): No heartbeat from core client for 30 sec - exiting 10:59:50 (484): No heartbeat from core client for 30 sec - exiting 10:59:51 (484): No heartbeat from core client for 30 sec - exiting 10:59:52 (484): No heartbeat from core client for 30 sec - exiting 10:59:53 (484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7704, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=492, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:16:18 (6616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:16:20 (6616): No heartbeat from core client for 30 sec - exiting 23:16:21 (6616): No heartbeat from core client for 30 sec - exiting 23:16:22 (6616): No heartbeat from core client for 30 sec - exiting CSuspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:20:14 (7292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:20:16 (7292): No heartbeat from core client for 30 sec - exiting 15:15:28 (6584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:15:29 (6584): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7724, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 14:05:56 (6516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:05:57 (6516): No heartbeat from core client for 30 sec - exiting 14:05:58 (6516): No heartbeat from core client for 30 sec - exiting 14:05:59 (6516): No heartbeat from core client for 30 sec - exiting 14:06:00 (6516): No heartbeat from core client for 30 sec - exiting 14:06:01 (6516): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8520, iMonCtr=1 Model crash detected, will try to restart... 11:03:02 (5568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:03:03 (5568): No heartbeat from core client for 30 sec - exiting 11:03:04 (5568): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2444, iMonCtr=1 Model crash detected, will try to restart... 14:20:30 (8188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:20:32 (8188): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6412, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Jan 2012 17:29:40	893865	13777979	hadcm3n_u2b4_1980_40_007615775_1	518,400	1,479,456	2.8539
11 Jan 2012 20:44:23	893865	13777979	hadcm3n_u2b4_1980_40_007615775_1	492,480	1,405,620	2.8542
10 Jan 2012 02:16:54	893865	13777979	hadcm3n_u2b4_1980_40_007615775_1	466,560	1,331,748	2.8544
08 Jan 2012 16:46:43	893865	13777979	hadcm3n_u2b4_1980_40_007615775_1	440,640	1,259,719	2.8588
06 Jan 2012 19:13:28	893865	13777979	hadcm3n_u2b4_1980_40_007615775_1	414,720	1,186,497	2.8610
05 Jan 2012 08:39:29	893865	13777979	hadcm3n_u2b4_1980_40_007615775_1	388,800	1,112,546	2.8615
03 Jan 2012 19:25:37	893865	13777979	hadcm3n_u2b4_1980_40_007615775_1	362,880	1,035,976	2.8549
02 Jan 2012 01:38:19	893865	13777979	hadcm3n_u2b4_1980_40_007615775_1	336,960	961,690	2.8540
01 Jan 2012 03:46:20	893865	13777979	hadcm3n_u2b4_1980_40_007615775_1	311,040	887,402	2.8530
31 Dec 2011 04:05:16	893865	13777979	hadcm3n_u2b4_1980_40_007615775_1	285,120	811,123	2.8448
29 Dec 2011 01:41:52	893865	13777979	hadcm3n_u2b4_1980_40_007615775_1	259,200	735,497	2.8376
27 Dec 2011 02:41:04	893865	13777979	hadcm3n_u2b4_1980_40_007615775_1	233,280	661,240	2.8345
26 Dec 2011 00:23:31	893865	13777979	hadcm3n_u2b4_1980_40_007615775_1	207,360	585,735	2.8247
24 Dec 2011 22:56:16	893865	13777979	hadcm3n_u2b4_1980_40_007615775_1	181,440	511,043	2.8166
22 Dec 2011 19:03:46	893865	13777979	hadcm3n_u2b4_1980_40_007615775_1	155,520	436,425	2.8062
21 Dec 2011 02:26:24	893865	13777979	hadcm3n_u2b4_1980_40_007615775_1	129,600	362,803	2.7994
19 Dec 2011 03:46:34	893865	13777979	hadcm3n_u2b4_1980_40_007615775_1	103,680	287,442	2.7724
18 Dec 2011 02:36:22	893865	13777979	hadcm3n_u2b4_1980_40_007615775_1	77,760	212,559	2.7335
16 Dec 2011 22:36:02	893865	13777979	hadcm3n_u2b4_1980_40_007615775_1	51,840	140,867	2.7173
15 Dec 2011 19:20:58	893865	13777979	hadcm3n_u2b4_1980_40_007615775_1	25,920	70,333	2.7135