Task 16033067

Name	hadcm3n_4en4_1980_40_008361220_3
Workunit	8512079
Created	24 Sep 2013, 12:21:20 UTC
Sent	24 Sep 2013, 12:21:39 UTC
Report deadline	24 Dec 2013, 19:48:50 UTC
Received	2 Oct 2013, 14:00:24 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1211829
Run time	7 days 0 hours 46 min 41 sec
CPU time	6 days 9 hours 39 min 29 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.35 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> 20:00:34 (20632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:00:35 (20632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:50:06 (21236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:50:07 (21236): No heartbeat from core client for 30 sec - exiting 23:50:09 (21236): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 23:55:06 (20392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:55:07 (20392): No heartbeat from core client for 30 sec - exiting 23:59:30 (20708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:59:32 (20708): No heartbeat from core client for 30 sec - exiting 23:59:33 (20708): No heartbeat from core client for 30 sec - exiting 00:03:53 (21088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:03:54 (21088): No heartbeat from core client for 30 sec - exiting 00:06:45 (20988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:07:04 (20988): No heartbeat from core client for 30 sec - exiting 00:07:12 (20988): No heartbeat from core client for 30 sec - exiting 00:07:14 (20988): No heartbeat from core client for 30 sec - exiting 00:07:15 (20988)Suspended CPDN Monitor - Suspend request from BOINC... 00:13:28 (21300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:13:30 (21300): No heartbeat from core client for 30 sec - exiting Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=21820, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=21820, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=21820, iMonCtr=1 Model crash detected, will try to restart... 00:19:05 (21820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:19:06 (21820): No heartbeat from core client for 30 sec - exiting 00:22:11 (22464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:29:33 (22432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:37:13 (14936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:37:14 (14936): No heartbeat from core client for 30 sec - exiting 00:51:57 (20640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:52:00 (20640): No heartbeat from core client for 30 sec - exiting 00:52:01 (20640): No heartbeat from core client for 30 sec - exiting 00:52:02 (20640): No heartbeat from core client for 30 sec - exiting 00:52:03 (20640): No heartbeat from core client for 30 sec - exiting 00:52:04 (20640): No heartbeat from core client for 30 sec - exiting 00:56:18 (18980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:56:19 (18980): No heartbeat from core client for 30 sec - exiting 01:01:21 (21540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:09:27 (19720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:09:29 (19720): No heartbeat from core client for 30 sec - exiting 01:09:30 (19720): No heartbeat from core client for 30 sec - exiting 01:09:31 (19720): No heartbeat from core client for 30 sec - exiting 01:17:10 (19508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:17:11 (19508): No heartbeat from core client for 30 sec - exiting 01:17:12 (19508): No heartbeat from core client for 30 sec - exiting 01:17:13 (19508): No heartbeat from core client for 30 sec - exiting 01:17:14 (19508): No heartbeat from core client for 30 sec - exiting 01:17:15 (19508): No heartbeat from core client for 30 sec - exiting 01:17:16 (19508): No heartbeat from core client for 30 sec - exiting 01:17:18 (19508): No heartbeat from core client for 30 sec - exiting 01:17:19 (19508): No heartbeat from core client for 30 sec - exiting 01:17:20 (19508): No heartbeat from core client for 30 sec - exiting 01:17:21 (19508): No heartbeat from core client for 30 sec - exiting 01:22:31 (19484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:22:33 (19484): No heartbeat from core client for 30 sec - exiting 01:22:34 (19484): No heartbeat from core client for 30 sec - exiting 01:22:35 (19484): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 03:01:53 (21132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:01:55 (21132): No heartbeat from core client for 30 sec - exiting 03:06:34 (21884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:06:44 (21884): No heartbeat from core client for 30 sec - exiting 03:06:45 (21884): No heartbeat from core client for 30 sec - exiting 03:06:47 (21884): No heartbeat from core client for 30 sec - exiting 03:17:10 (21468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:17:13 (21468): No heartbeat from core client for 30 sec - exiting 03:17:14 (21468): No heartbeat from core client for 30 sec - exiting 03:17:15 (21468): No heartbeat from core client for 30 sec - exiting 03:19:34 (21888): No heartbeat from core client for 30 sec - exiting 03:19:35 (21888): No heartbeat from core client for 30 sec - exiting 03:19:36 (21888): No heartbeat from core client for 30 sec - exiting 03:19:37 (21888): No heartbeat from core client for 30 sec - exiting 03:19:38 (21888): No heartbeat from core client for 30 sec - exiting 03:19:39 (21888): No heartbeat from core client for 30 sec - exiting 03:19:40 (21888): No heartbeat from core client for 30 sec - exiting 03:19:41 (21888): No heartbeat from core client for 30 sec - exiting 03:19:42 (21888): No heartbeat from core client for 30 sec - exiting 03:19:43 (21888): No heartbeat from core client for 30 sec - exiting 03:19:45 (21888): No heartbeat from core client for 30 sec - exiting 03:19:46 (21888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:27:01 (16492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:27:02 (16492): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 04:22:35 (20768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:22:36 (20768): No heartbeat from core client for 30 sec - exiting 04:30:54 (22332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:30:56 (22332): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 04:34:32 (17448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:34:46 (17448): No heartbeat from core client for 30 sec - exiting 04:34:49 (17448): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 04:39:34 (20832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:44:12 (10596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:44:14 (10596): No heartbeat from core client for 30 sec - exiting 04:44:15 (10596): No heartbeat from core client for 30 sec - exiting 04:44:16 (10596): No heartbeat from core client for 30 sec - exiting 04:44:17 (10596): No heartbeat from core client for 30 sec - exiting 04:44:18 (10596): No heartbeat from core client for 30 sec - exiting 04:44:20 (10596): No heartbeat from core client for 30 sec - exiting 05:08:40 (21164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:08:41 (21164): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:30:35 (23928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:30:36 (23928): No heartbeat from core client for 30 sec - exiting 05:30:37 (23928): No heartbeat from core client for 30 sec - exiting 05:38:41 (23600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:38:42 (23600): No heartbeat from core client for 30 sec - exiting 05:53:35 (22996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:53:36 (22996): No heartbeat from core client for 30 sec - exiting 06:01:19 (23540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:01:20 (23540): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 06:08:39 (23440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:08:42 (23440): No heartbeat from core client for 30 sec - exiting 06:08:43 (23440): No heartbeat from core client for 30 sec - exiting 06:08:44 (23440): No heartbeat from core client for 30 sec - exiting 06:08:45 (23440): No heartbeat from core client for 30 sec - exiting 06:18:08 (23076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:18:10 (23076): No heartbeat from core client for 30 sec - exiting 06:19:45 (2132): No heartbeat from core client for 30 sec - exiting 06:19:46 (2132): No heartbeat from core client for 30 sec - exiting 06:19:47 (2132): No heartbeat from core client for 30 sec - exiting 06:19:48 (2132): No heartbeat from core client for 30 sec - exiting 06:19:49 (2132): No heartbeat from core client for 30 sec - exiting 06:19:50 (2132): No heartbeat from core client for 30 sec - exiting 06:19:51 (2132): No heartbeat from core client for 30 sec - exiting 06:19:52 (2132): No heartbeat from core client for 30 sec - exiting 06:19:53 (2132): No heartbeat from core client for 30 sec - exiting 06:19:54 (2132): No heartbeat from core client for 30 sec - exiting 06:19:56 (2132): No heartbeat from core client for 30 sec - exiting 06:19:57 (2132): No heartbeat from core client for 30 sec - exiting 06:19:58 (2132): No heartbeat from core client for 30 sec - exiting 06:19:59 (2132): No heartbeat from core client for 30 sec - exiting 06:20:00 (2132): No heartbeat from core client for 30 sec - exiting 06:20:01 (2132): No heartbeat from core client for 30 sec - exiting 06:20:02 (2132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:09:57 (3704): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 04:09:58 (3704): No heartbeat from core client for 30 sec - exiting 04:10:00 (3704): No heartbeat from core client for 30 sec - exiting 04:10:01 (3704): No heartbeat from core client for 30 sec - exiting 04:10:02 (3704): No heartbeat from core client for 30 sec - exiting 04:10:03 (3704): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:17:40 (932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:24:59 (4344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:25:00 (4344): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:32:47 (4292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:32:48 (4292): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 04:41:37 (4180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:48:55 (4812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:48:56 (4812): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 04:56:31 (5344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:04:01 (5600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:04:03 (5600): No heartbeat from core client for 30 sec - exiting 05:04:04 (5600): No heartbeat from core client for 30 sec - exiting 05:04:05 (5600): No heartbeat from core client for 30 sec - exiting 05:11:46 (5068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:19:51 (6016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:27:04 (5324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:27:06 (5324): No heartbeat from core client for 30 sec - exiting 05:35:20 (3376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:42:48 (4224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:42:49 (4224): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:50:40 (1676): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 05:50:42 (1676): No heartbeat from core client for 30 sec - exiting 05:50:43 (1676): No heartbeat from core client for 30 sec - exiting 05:58:11 (4504): No heartbeat from core client for 30 sec - exiting 05:58:12 (4504): No heartbeat from core client for 30 sec - exiting 05:58:14 (4504): No heartbeat from core client for 30 sec - exiting 05:58:15 (4504): No heartbeat from core client for 30 sec - exiting 05:58:16 (4504): No heartbeat from core client for 30 sec - exiting 05:58:17 (4504): No heartbeat from core client for 30 sec - exiting 05:58:18 (4504): No heartbeat from core client for 30 sec - exiting 05:58:19 (4504): No heartbeat from core client for 30 sec - exiting 05:58:20 (4504): No heartbeat from core client for 30 sec - exiting 05:58:21 (4504): No heartbeat from core client for 30 sec - exiting 05:58:22 (4504): No heartbeat from core client for 30 sec - exiting 05:58:23 (4504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:12:29 (4252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:12:31 (4252): No heartbeat from core client for 30 sec - exiting 06:12:32 (4252): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 06:41:01 (4116): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 06:41:02 (4116): No heartbeat from core client for 30 sec - exiting 06:41:03 (4116): No heartbeat from core client for 30 sec - exiting 06:41:04 (4116): No heartbeat from core client for 30 sec - exiting 06:41:06 (4116): No heartbeat from core client for 30 sec - exiting 06:41:07 (4116): No heartbeat from core client for 30 sec - exiting 06:41:08 (4116): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:07:46 (3176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:07:47 (3176): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:15:58 (1636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:30:30 (3812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:30:31 (3812): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:37:59 (3592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:47:33 (2164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:06:51 (3492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:06:52 (3492): No heartbeat from core client for 30 sec - exiting 21:06:53 (3492): No heartbeat from core client for 30 sec - exiting 21:21:39 (3500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:29:02 (2860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:34:05 (1280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:36:20 (1448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:43:35 (3180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:50:53 (2932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:04:41 (2740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:08:21 (652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:08:23 (652): No heartbeat from core client for 30 sec - exiting 04:08:24 (652): No heartbeat from core client for 30 sec - exiting 04:08:25 (652): No heartbeat from core client for 30 sec - exiting 04:08:26 (652): No heartbeat from core client for 30 sec - exiting 04:08:27 (652): No heartbeat from core client for 30 sec - exiting 04:08:28 (652): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:17:13 (3700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:17:14 (3700): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:07:04 (5940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:07:06 (5940): No heartbeat from core client for 30 sec - exiting 04:07:07 (5940): No heartbeat from core client for 30 sec - exiting 04:07:08 (5940): No heartbeat from core client for 30 sec - exiting 04:07:09 (5940): No heartbeat from core client for 30 sec - exiting 04:07:10 (5940): No heartbeat from core client for 30 sec - exiting 04:07:11 (5940): No heartbeat from core client for 30 sec - exiting 04:12:09 (7820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:12:11 (7820): No heartbeat from core client for 30 sec - exiting 04:12:12 (7820): No heartbeat from core client for 30 sec - exiting 04:12:13 (7820): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:20:33 (6972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:28:22 (6156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:42:58 (7592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Ocean Restart file copy failed on 4en4ko.dai7b30 Suspended CPDN Monitor - Suspend request from BOINC... 06:47:23 (4804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:47:29 (4804): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:08:00 (7364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:08:02 (7364): No heartbeat from core client for 30 sec - exiting 20:08:03 (7364): No heartbeat from core client for 30 sec - exiting 20:08:04 (7364): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:52:22 (5368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:52:24 (5368): No heartbeat from core client for 30 sec - exiting 21:00:09 (2292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:03:31 (7768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:07:47 (5580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:15:05 (7036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:22:42 (7456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:37:25 (9576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:37:36 (9576): No heartbeat from core client for 30 sec - exiting 21:37:37 (9576): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 21:46:14 (7240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:53:38 (9204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:23:57 (9620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:23:58 (9620): No heartbeat from core client for 30 sec - exiting 02:24:00 (9620): No heartbeat from core client for 30 sec - exiting 02:24:01 (9620): No heartbeat from core client for 30 sec - exiting 02:24:02 (9620): No heartbeat from core client for 30 sec - exiting 02:24:03 (9620): No heartbeat from core client for 30 sec - exiting 02:32:01 (9120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:32:03 (9120): No heartbeat from core client for 30 sec - exiting 02:32:05 (9120): No heartbeat from core client for 30 sec - exiting 02:32:06 (9120): No heartbeat from core client for 30 sec - exiting 02:32:07 (9120): No heartbeat from core client for 30 sec - exiting 02:32:08 (9120): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Oct 2013 14:04:53	1211829	16033067	hadcm3n_4en4_1980_40_008361220_3	259,200	553,165	2.1341
02 Oct 2013 14:04:53	1211829	16033067	hadcm3n_4en4_1980_40_008361220_3	233,280	501,452	2.1496
01 Oct 2013 00:52:16	1211829	16033067	hadcm3n_4en4_1980_40_008361220_3	207,360	450,132	2.1708
30 Sep 2013 19:03:56	1211829	16033067	hadcm3n_4en4_1980_40_008361220_3	181,440	398,498	2.1963
29 Sep 2013 13:15:46	1211829	16033067	hadcm3n_4en4_1980_40_008361220_3	155,520	347,076	2.2317
28 Sep 2013 21:00:05	1211829	16033067	hadcm3n_4en4_1980_40_008361220_3	129,600	295,684	2.2815
28 Sep 2013 05:48:26	1211829	16033067	hadcm3n_4en4_1980_40_008361220_3	103,680	244,291	2.3562
27 Sep 2013 19:04:15	1211829	16033067	hadcm3n_4en4_1980_40_008361220_3	77,760	192,752	2.4788
26 Sep 2013 23:14:19	1211829	16033067	hadcm3n_4en4_1980_40_008361220_3	51,840	141,255	2.7248
25 Sep 2013 23:18:19	1211829	16033067	hadcm3n_4en4_1980_40_008361220_3	25,920	81,231	3.1339