Task 15455172

Name	hadcm3n_z96j_1880_40_008251805_0
Workunit	8406929
Created	22 Nov 2012, 19:40:03 UTC
Sent	22 Nov 2012, 19:44:03 UTC
Report deadline	22 Feb 2013, 3:11:14 UTC
Received	19 Jan 2013, 23:21:21 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1207183
Run time	33 days 7 hours 58 min 10 sec
CPU time	17 days 7 hours 18 min 42 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.78 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> 10:25:25 (1988): No heartbeat from core client for 30 sec - exiting 10:25:26 (1988): No heartbeat from core client for 30 sec - exiting 10:25:27 (1988): No heartbeat from core client for 30 sec - exiting 10:25:28 (1988): No heartbeat from core client for 30 sec - exiting 10:25:29 (1988): No heartbeat from core client for 30 sec - exiting 10:25:30 (1988): No heartbeat from core client for 30 sec - exiting 10:25:31 (1988): No heartbeat from core client for 30 sec - exiting 10:25:32 (1988): No heartbeat from core client for 30 sec - exiting 10:25:33 (1988): No heartbeat from core client for 30 sec - exiting 10:25:34 (1988): No heartbeat from core client for 30 sec - exiting 10:25:35 (1988): No heartbeat from core client for 30 sec - exiting 10:25:36 (1988): No heartbeat from core client for 30 sec - exiting 10:25:37 (1988): No heartbeat from core client for 30 sec - exiting 10:25:38 (1988): No heartbeat from core client for 30 sec - exiting 10:25:39 (1988): No heartbeat from core client for 30 sec - exiting 10:25:40 (1988): No heartbeat from core client for 30 sec - exiting 10:25:41 (1988): No heartbeat from core client for 30 sec - exiting 10:25:42 (1988): No heartbeat from core client for 30 sec - exiting 10:25:43 (1988): No heartbeat from core client for 30 sec - exiting 10:25:44 (1988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:24:52 (11432): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 18:16:35 (8028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8924, iMonCtr=1 Model crash detected, will try to restart... 18:57:02 (9044): No heartbeat from core client for 30 sec - exiting 18:57:04 (9044): No heartbeat from core client for 30 sec - exiting 18:57:05 (9044): No heartbeat from core client for 30 sec - exiting 18:57:06 (9044): No heartbeat from core client for 30 sec - exiting 18:57:07 (9044): No heartbeat from core client for 30 sec - exiting 18:57:08 (9044): No heartbeat from core client for 30 sec - exiting 18:57:09 (9044): No heartbeat from core client for 30 sec - exiting 18:57:10 (9044): No heartbeat from core client for 30 sec - exiting 18:57:11 (9044): No heartbeat from core client for 30 sec - exiting 18:57:12 (9044): No heartbeat from core client for 30 sec - exiting 18:57:13 (9044): No heartbeat from core client for 30 sec - exiting 18:57:14 (9044): No heartbeat from core client for 30 sec - exiting 18:57:15 (9044): No heartbeat from core client for 30 sec - exiting 18:57:16 (9044): No heartbeat from core client for 30 sec - exiting 18:57:17 (9044): No heartbeat from core client for 30 sec - exiting 18:57:18 (9044): No heartbeat from core client for 30 sec - exiting 18:57:19 (9044): No heartbeat from core client for 30 sec - exiting 18:57:20 (9044): No heartbeat from core client for 30 sec - exiting 18:57:21 (9044): No heartbeat from core client for 30 sec - exiting 18:57:22 (9044): No heartbeat from core client for 30 sec - exiting 18:57:23 (9044): No heartbeat from core client for 30 sec - exiting 18:57:24 (9044): No heartbeat from core client for 30 sec - exiting 18:57:25 (9044): No heartbeat from core client for 30 sec - exiting 18:57:26 (9044): No heartbeat from core client for 30 sec - exiting 18:57:27 (9044): No heartbeat from core client for 30 sec - exiting 18:57:28 (9044): No heartbeat from core client for 30 sec - exiting 18:57:29 (9044): No heartbeat from core client for 30 sec - exiting 18:57:30 (9044): No heartbeat from core client for 30 sec - exiting 18:57:31 (9044): No heartbeat from core client for 30 sec - exiting 18:57:32 (9044): No heartbeat from core client for 30 sec - exiting 18:57:33 (9044): No heartbeat from core client for 30 sec - exiting 18:57:34 (9044): No heartbeat from core client for 30 sec - exiting 18:57:35 (9044): No heartbeat from core client for 30 sec - exiting 18:57:36 (9044): No heartbeat from core client for 30 sec - exiting 18:57:37 (9044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:57:38 (9044): No heartbeat from core client for 30 sec - exiting 18:58:59 (12208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:29:03 (12276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:43:01 (10556): No heartbeat from core client for 30 sec - exiting 13:43:02 (10556): No heartbeat from core client for 30 sec - exiting 13:43:03 (10556): No heartbeat from core client for 30 sec - exiting 13:43:04 (10556): No heartbeat from core client for 30 sec - exiting 13:43:05 (10556): No heartbeat from core client for 30 sec - exiting 13:43:06 (10556): No heartbeat from core client for 30 sec - exiting 13:43:07 (10556): No heartbeat from core client for 30 sec - exiting 13:43:08 (10556): No heartbeat from core client for 30 sec - exiting 13:43:09 (10556): No heartbeat from core client for 30 sec - exiting 13:43:10 (10556): No heartbeat from core client for 30 sec - exiting 13:43:11 (10556): No heartbeat from core client for 30 sec - exiting 13:43:12 (10556): No heartbeat from core client for 30 sec - exiting 13:43:13 (10556): No heartbeat from core client for 30 sec - exiting 13:43:14 (10556): No heartbeat from core client for 30 sec - exiting 13:43:15 (10556): No heartbeat from core client for 30 sec - exiting 13:43:16 (10556): No heartbeat from core client for 30 sec - exiting 13:43:17 (10556): No heartbeat from core client for 30 sec - exiting 13:43:18 (10556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10116, iMonCtr=1 Model crash detected, will try to restart... 11:15:08 (7588): No heartbeat from core client for 30 sec - exiting 11:15:10 (7588): No heartbeat from core client for 30 sec - exiting 11:15:11 (7588): No heartbeat from core client for 30 sec - exiting 11:15:12 (7588): No heartbeat from core client for 30 sec - exiting 11:15:13 (7588): No heartbeat from core client for 30 sec - exiting 11:15:14 (7588): No heartbeat from core client for 30 sec - exiting 11:15:15 (7588): No heartbeat from core client for 30 sec - exiting 11:15:16 (7588): No heartbeat from core client for 30 sec - exiting 11:15:17 (7588): No heartbeat from core client for 30 sec - exiting 11:15:18 (7588): No heartbeat from core client for 30 sec - exiting 11:15:19 (7588): No heartbeat from core client for 30 sec - exiting 11:15:20 (7588): No heartbeat from core client for 30 sec - exiting 11:15:21 (7588): No heartbeat from core client for 30 sec - exiting 11:15:22 (7588): No heartbeat from core client for 30 sec - exiting 11:15:23 (7588): No heartbeat from core client for 30 sec - exiting 11:15:24 (7588): No heartbeat from core client for 30 sec - exiting 11:15:25 (7588): No heartbeat from core client for 30 sec - exiting 11:15:26 (7588): No heartbeat from core client for 30 sec - exiting 11:15:27 (7588): No heartbeat from core client for 30 sec - exiting 11:15:28 (7588): No heartbeat from core client for 30 sec - exiting 11:15:29 (7588): No heartbeat from core client for 30 sec - exiting 11:15:30 (7588): No heartbeat from core client for 30 sec - exiting 11:15:31 (7588): No heartbeat from core client for 30 sec - exiting 11:15:32 (7588): No heartbeat from core client for 30 sec - exiting 11:15:33 (7588): No heartbeat from core client for 30 sec - exiting 11:15:34 (7588): No heartbeat from core client for 30 sec - exiting 11:15:35 (7588): No heartbeat from core client for 30 sec - exiting 11:15:36 (7588): No heartbeat from core client for 30 sec - exiting 11:15:37 (7588): No heartbeat from core client for 30 sec - exiting 11:15:38 (7588): No heartbeat from core client for 30 sec - exiting 11:15:39 (7588): No heartbeat from core client for 30 sec - exiting 11:15:40 (7588): No heartbeat from core client for 30 sec - exiting 11:15:41 (7588): No heartbeat from core client for 30 sec - exiting 11:15:42 (7588): No heartbeat from core client for 30 sec - exiting 11:15:43 (7588): No heartbeat from core client for 30 sec - exiting 11:15:44 (7588): No heartbeat from core client for 30 sec - exiting 11:15:45 (7588): No heartbeat from core client for 30 sec - exiting 11:15:46 (7588): No heartbeat from core client for 30 sec - exiting 11:15:47 (7588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:07:52 (16436): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 17:07:56 (16436): No heartbeat from core client for 30 sec - exiting 17:07:57 (16436): No heartbeat from core client for 30 sec - exiting 17:07:58 (16436): No heartbeat from core client for 30 sec - exiting 17:07:59 (16436): No heartbeat from core client for 30 sec - exiting 17:08:00 (16436): No heartbeat from core client for 30 sec - exiting 17:08:01 (16436): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:41:35 (17076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:41:37 (17076): No heartbeat from core client for 30 sec - exiting 08:42:59 (11608): No heartbeat from core client for 30 sec - exiting 08:43:00 (11608): No heartbeat from core client for 30 sec - exiting 08:43:01 (11608): No heartbeat from core client for 30 sec - exiting 08:43:02 (11608): No heartbeat from core client for 30 sec - exiting 08:43:03 (11608): No heartbeat from core client for 30 sec - exiting 08:43:04 (11608): No heartbeat from core client for 30 sec - exiting 08:43:05 (11608): No heartbeat from core client for 30 sec - exiting 08:43:06 (11608): No heartbeat from core client for 30 sec - exiting 08:43:07 (11608): No heartbeat from core client for 30 sec - exiting 08:43:08 (11608): No heartbeat from core client for 30 sec - exiting 08:43:09 (11608): No heartbeat from core client for 30 sec - exiting 08:43:10 (11608): No heartbeat from core client for 30 sec - exiting 08:43:11 (11608): No heartbeat from core client for 30 sec - exiting 08:43:12 (11608): No heartbeat from core client for 30 sec - exiting 08:43:13 (11608): No heartbeat from core client for 30 sec - exiting 08:43:14 (11608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:00:56 (844): No heartbeat from core client for 30 sec - exiting 09:00:57 (844): No heartbeat from core client for 30 sec - exiting 09:00:58 (844): No heartbeat from core client for 30 sec - exiting 09:00:59 (844): No heartbeat from core client for 30 sec - exiting 09:01:00 (844): No heartbeat from core client for 30 sec - exiting 09:01:01 (844): No heartbeat from core client for 30 sec - exiting 09:01:02 (844): No heartbeat from core client for 30 sec - exiting 09:01:03 (844): No heartbeat from core client for 30 sec - exiting 09:01:04 (844): No heartbeat from core client for 30 sec - exiting 09:01:05 (844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:01:06 (844): No heartbeat from core client for 30 sec - exiting 09:01:07 (844): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 22:06:03 (10628): No heartbeat from core client for 30 sec - exiting 22:06:04 (10628): No heartbeat from core client for 30 sec - exiting 22:06:05 (10628): No heartbeat from core client for 30 sec - exiting 22:06:06 (10628): No heartbeat from core client for 30 sec - exiting 22:06:07 (10628): No heartbeat from core client for 30 sec - exiting 22:06:08 (10628): No heartbeat from core client for 30 sec - exiting 22:06:09 (10628): No heartbeat from core client for 30 sec - exiting 22:06:10 (10628): No heartbeat from core client for 30 sec - exiting 22:06:11 (10628): No heartbeat from core client for 30 sec - exiting 22:06:12 (10628): No heartbeat from core client for 30 sec - exiting 22:06:13 (10628): No heartbeat from core client for 30 sec - exiting 22:06:14 (10628): No heartbeat from core client for 30 sec - exiting 22:06:15 (10628): No heartbeat from core client for 30 sec - exiting 22:06:16 (10628): No heartbeat from core client for 30 sec - exiting 22:06:17 (10628): No heartbeat from core client for 30 sec - exiting 22:06:18 (10628): No heartbeat from core client for 30 sec - exiting 22:06:19 (10628): No heartbeat from core client for 30 sec - exiting 22:06:20 (10628): No heartbeat from core client for 30 sec - exiting 22:06:21 (10628): No heartbeat from core client for 30 sec - exiting 22:06:22 (10628): No heartbeat from core client for 30 sec - exiting 22:06:23 (10628): No heartbeat from core client for 30 sec - exiting 22:06:24 (10628): No heartbeat from core client for 30 sec - exiting 22:06:25 (10628): No heartbeat from core client for 30 sec - exiting 22:06:26 (10628): No heartbeat from core client for 30 sec - exiting 22:06:27 (10628): No heartbeat from core client for 30 sec - exiting 22:06:28 (10628): No heartbeat from core client for 30 sec - exiting 22:06:29 (10628): No heartbeat from core client for 30 sec - exiting 22:06:30 (10628): No heartbeat from core client for 30 sec - exiting 22:06:31 (10628): No heartbeat from core client for 30 sec - exiting 22:06:32 (10628): No heartbeat from core client for 30 sec - exiting 22:06:33 (10628): No heartbeat from core client for 30 sec - exiting 22:06:34 (10628): No heartbeat from core client for 30 sec - exiting 22:06:35 (10628): No heartbeat from core client for 30 sec - exiting 22:06:36 (10628): No heartbeat from core client for 30 sec - exiting 22:06:37 (10628): No heartbeat from core client for 30 sec - exiting 22:06:38 (10628): No heartbeat from core client for 30 sec - exiting 22:06:39 (10628): No heartbeat from core client for 30 sec - exiting 22:06:40 (10628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:47:09 (16504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:47:17 (16504): No heartbeat from core client for 30 sec - exiting 17:47:18 (16504): No heartbeat from core client for 30 sec - exiting 17:47:19 (16504): No heartbeat from core client for 30 sec - exiting 17:47:20 (16504): No heartbeat from core client for 30 sec - exiting 17:47:21 (16504): No heartbeat from core client for 30 sec - exiting 17:47:22 (16504): No heartbeat from core client for 30 sec - exiting 17:47:23 (16504): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:35:01 (15632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:35:03 (15632): No heartbeat from core client for 30 sec - exiting 17:35:04 (15632): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 10:54:50 (8940): No heartbeat from core client for 30 sec - exiting 10:54:51 (8940): No heartbeat from core client for 30 sec - exiting 10:54:52 (8940): No heartbeat from core client for 30 sec - exiting 10:54:53 (8940): No heartbeat from core client for 30 sec - exiting 10:54:54 (8940): No heartbeat from core client for 30 sec - exiting 10:54:55 (8940): No heartbeat from core client for 30 sec - exiting 10:54:56 (8940): No heartbeat from core client for 30 sec - exiting 10:54:57 (8940): No heartbeat from core client for 30 sec - exiting 10:54:58 (8940): No heartbeat from core client for 30 sec - exiting 10:54:59 (8940): No heartbeat from core client for 30 sec - exiting 10:55:00 (8940): No heartbeat from core client for 30 sec - exiting 10:55:01 (8940): No heartbeat from core client for 30 sec - exiting 10:55:02 (8940): No heartbeat from core client for 30 sec - exiting 10:55:03 (8940): No heartbeat from core client for 30 sec - exiting 10:55:04 (8940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:05:44 (11276): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 09:05:47 (11276): No heartbeat from core client for 30 sec - exiting 09:05:48 (11276): No heartbeat from core client for 30 sec - exiting 09:05:49 (11276): No heartbeat from core client for 30 sec - exiting 09:05:50 (11276): No heartbeat from core client for 30 sec - exiting 09:05:51 (11276): No heartbeat from core client for 30 sec - exiting 09:05:52 (11276): No heartbeat from core client for 30 sec - exiting 09:05:53 (11276): No heartbeat from core client for 30 sec - exiting 09:05:54 (11276): No heartbeat from core client for 30 sec - exiting 09:05:55 (11276): No heartbeat from core client for 30 sec - exiting 10:49:52 (8700): No heartbeat from core client for 30 sec - exiting 10:49:53 (8700): No heartbeat from core client for 30 sec - exiting 10:49:54 (8700): No heartbeat from core client for 30 sec - exiting 10:49:55 (8700): No heartbeat from core client for 30 sec - exiting 10:49:56 (8700): No heartbeat from core client for 30 sec - exiting 10:49:57 (8700): No heartbeat from core client for 30 sec - exiting 10:49:58 (8700): No heartbeat from core client for 30 sec - exiting 10:49:59 (8700): No heartbeat from core client for 30 sec - exiting 10:50:00 (8700): No heartbeat from core client for 30 sec - exiting 10:50:01 (8700): No heartbeat from core client for 30 sec - exiting 10:50:02 (8700): No heartbeat from core client for 30 sec - exiting 10:50:03 (8700): No heartbeat from core client for 30 sec - exiting 10:50:04 (8700): No heartbeat from core client for 30 sec - exiting 10:50:05 (8700): No heartbeat from core client for 30 sec - exiting 10:50:06 (8700): No heartbeat from core client for 30 sec - exiting 10:50:07 (8700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:50:08 (8700): No heartbeat from core client for 30 sec - exiting 10:52:18 (4960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15992, iMonCtr=1 Model crash detected, will try to restart... 09:30:57 (3688): No heartbeat from core client for 30 sec - exiting 09:30:58 (3688): No heartbeat from core client for 30 sec - exiting 09:30:59 (3688): No heartbeat from core client for 30 sec - exiting 09:31:00 (3688): No heartbeat from core client for 30 sec - exiting 09:31:01 (3688): No heartbeat from core client for 30 sec - exiting 09:31:02 (3688): No heartbeat from core client for 30 sec - exiting 09:31:03 (3688): No heartbeat from core client for 30 sec - exiting 09:31:04 (3688): No heartbeat from core client for 30 sec - exiting 09:31:05 (3688): No heartbeat from core client for 30 sec - exiting 09:31:06 (3688): No heartbeat from core client for 30 sec - exiting 09:31:07 (3688): No heartbeat from core client for 30 sec - exiting 09:31:08 (3688): No heartbeat from core client for 30 sec - exiting 09:31:09 (3688): No heartbeat from core client for 30 sec - exiting 09:31:10 (3688): No heartbeat from core client for 30 sec - exiting 09:31:11 (3688): No heartbeat from core client for 30 sec - exiting 09:31:12 (3688): No heartbeat from core client for 30 sec - exiting 09:31:13 (3688): No heartbeat from core client for 30 sec - exiting 09:31:14 (3688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:31:15 (3688): No heartbeat from core client for 30 sec - exiting 09:31:16 (3688): No heartbeat from core client for 30 sec - exiting 09:31:17 (3688): No heartbeat from core client for 30 sec - exiting 09:31:18 (3688): No heartbeat from core client for 30 sec - exiting 09:31:19 (3688): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 13:03:07 (9668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:07:02 (11532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:38:05 (9708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:38:07 (9708): No heartbeat from core client for 30 sec - exiting 11:38:08 (9708): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=21128, iMonCtr=1 Model crash detected, will try to restart... 18:07:08 (10088): No heartbeat from core client for 30 sec - exiting 18:07:09 (10088): No heartbeat from core client for 30 sec - exiting 18:07:10 (10088): No heartbeat from core client for 30 sec - exiting 18:07:11 (10088): No heartbeat from core client for 30 sec - exiting 18:07:12 (10088): No heartbeat from core client for 30 sec - exiting 18:07:13 (10088): No heartbeat from core client for 30 sec - exiting 18:07:14 (10088): No heartbeat from core client for 30 sec - exiting 18:07:15 (10088): No heartbeat from core client for 30 sec - exiting 18:07:16 (10088): No heartbeat from core client for 30 sec - exiting 18:07:17 (10088): No heartbeat from core client for 30 sec - exiting 18:07:18 (10088): No heartbeat from core client for 30 sec - exiting 18:07:19 (10088): No heartbeat from core client for 30 sec - exiting 18:07:20 (10088): No heartbeat from core client for 30 sec - exiting 18:07:21 (10088): No heartbeat from core client for 30 sec - exiting 18:07:22 (10088): No heartbeat from core client for 30 sec - exiting 18:07:23 (10088): No heartbeat from core client for 30 sec - exiting 18:07:24 (10088): No heartbeat from core client for 30 sec - exiting 18:07:25 (10088): No heartbeat from core client for 30 sec - exiting 18:07:26 (10088): No heartbeat from core client for 30 sec - exiting 18:07:27 (10088): No heartbeat from core client for 30 sec - exiting 18:07:28 (10088): No heartbeat from core client for 30 sec - exiting 18:07:29 (10088): No heartbeat from core client for 30 sec - exiting 18:07:30 (10088): No heartbeat from core client for 30 sec - exiting 18:07:31 (10088): No heartbeat from core client for 30 sec - exiting 18:07:32 (10088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:07:33 (10088): No heartbeat from core client for 30 sec - exiting 18:08:46 (11552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:57:26 (5040): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 16:57:28 (5040): No heartbeat from core client for 30 sec - exiting 16:57:29 (5040): No heartbeat from core client for 30 sec - exiting 16:57:30 (5040): No heartbeat from core client for 30 sec - exiting 16:57:31 (5040): No heartbeat from core client for 30 sec - exiting 16:57:32 (5040): No heartbeat from core client for 30 sec - exiting 16:57:33 (5040): No heartbeat from core client for 30 sec - exiting 16:57:34 (5040): No heartbeat from core client for 30 sec - exiting 16:57:35 (5040): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Jan 2013 22:47:33	1207183	15455172	hadcm3n_z96j_1880_40_008251805_0	1,036,800	1,494,563	1.4415
19 Jan 2013 02:13:45	1207183	15455172	hadcm3n_z96j_1880_40_008251805_0	1,010,880	1,455,477	1.4398
17 Jan 2013 08:14:30	1207183	15455172	hadcm3n_z96j_1880_40_008251805_0	984,960	1,418,084	1.4397
14 Jan 2013 22:15:55	1207183	15455172	hadcm3n_z96j_1880_40_008251805_0	959,040	1,381,753	1.4408
13 Jan 2013 11:34:51	1207183	15455172	hadcm3n_z96j_1880_40_008251805_0	933,120	1,344,623	1.4410
11 Jan 2013 16:40:53	1207183	15455172	hadcm3n_z96j_1880_40_008251805_0	907,200	1,308,325	1.4422
10 Jan 2013 08:18:34	1207183	15455172	hadcm3n_z96j_1880_40_008251805_0	881,280	1,270,718	1.4419
07 Jan 2013 13:41:07	1207183	15455172	hadcm3n_z96j_1880_40_008251805_0	855,360	1,234,375	1.4431
06 Jan 2013 07:45:54	1207183	15455172	hadcm3n_z96j_1880_40_008251805_0	829,440	1,197,146	1.4433
04 Jan 2013 22:04:50	1207183	15455172	hadcm3n_z96j_1880_40_008251805_0	803,520	1,159,047	1.4425
03 Jan 2013 13:40:31	1207183	15455172	hadcm3n_z96j_1880_40_008251805_0	777,600	1,122,034	1.4429
02 Jan 2013 07:54:54	1207183	15455172	hadcm3n_z96j_1880_40_008251805_0	751,680	1,084,926	1.4433
01 Jan 2013 14:05:39	1207183	15455172	hadcm3n_z96j_1880_40_008251805_0	725,760	1,046,538	1.4420
31 Dec 2012 20:06:31	1207183	15455172	hadcm3n_z96j_1880_40_008251805_0	699,840	1,009,656	1.4427
30 Dec 2012 15:15:55	1207183	15455172	hadcm3n_z96j_1880_40_008251805_0	673,920	972,305	1.4428
29 Dec 2012 16:27:29	1207183	15455172	hadcm3n_z96j_1880_40_008251805_0	648,000	935,258	1.4433
28 Dec 2012 11:40:07	1207183	15455172	hadcm3n_z96j_1880_40_008251805_0	622,080	898,379	1.4442
27 Dec 2012 00:02:29	1207183	15455172	hadcm3n_z96j_1880_40_008251805_0	596,160	862,124	1.4461
26 Dec 2012 00:42:14	1207183	15455172	hadcm3n_z96j_1880_40_008251805_0	570,240	825,968	1.4485
25 Dec 2012 02:26:09	1207183	15455172	hadcm3n_z96j_1880_40_008251805_0	544,320	789,252	1.4500