Task 15420397

Name	hadcm3n_y93f_1980_40_008242935_1
Workunit	8398059
Created	30 Oct 2012, 18:29:37 UTC
Sent	30 Oct 2012, 18:30:11 UTC
Report deadline	30 Jan 2013, 1:57:22 UTC
Received	10 Jan 2013, 14:20:29 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	1 (0x00000001) Unknown error code
Computer ID	1158160
Run time	5 days 0 hours 47 min 35 sec
CPU time	2 days 4 hours 32 min 17 sec
Validate state	Invalid
Credit	933.12
Device peak FLOPS	2.54 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <message> Incorrect function. (0x1) - exit code 1 (0x1) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4148, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:50:48 (5948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:06:39 (5620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:06:40 (5620): No heartbeat from core client for 30 sec - exiting 11:13:09 (3244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:08:28 (5728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:08:29 (5728): No heartbeat from core client for 30 sec - exiting 12:08:30 (5728): No heartbeat from core client for 30 sec - exiting 13:00:55 (4884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:00:56 (4884): No heartbeat from core client for 30 sec - exiting 13:00:57 (4884): No heartbeat from core client for 30 sec - exiting 13:00:58 (4884): No heartbeat from core client for 30 sec - exiting 13:19:52 (5100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:19:53 (5100): No heartbeat from core client for 30 sec - exiting 14:00:11 (6116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:00:12 (6116): No heartbeat from core client for 30 sec - exiting 14:00:13 (6116): No heartbeat from core client for 30 sec - exiting 14:06:14 (5360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:06:15 (5360): No heartbeat from core client for 30 sec - exiting 14:19:11 (5952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:19:12 (5952): No heartbeat from core client for 30 sec - exiting 14:19:13 (5952): No heartbeat from core client for 30 sec - exiting 14:19:14 (5952): No heartbeat from core client for 30 sec - exiting 14:34:35 (2796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:31:55 (3440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:31:56 (3440): No heartbeat from core client for 30 sec - exiting 15:53:28 (1856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:53:29 (1856): No heartbeat from core client for 30 sec - exiting 16:24:17 (5648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:01:52 (4348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:01:53 (4348): No heartbeat from core client for 30 sec - exiting 17:30:08 (5932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:30:09 (5932): No heartbeat from core client for 30 sec - exiting 17:30:10 (5932): No heartbeat from core client for 30 sec - exiting 17:30:11 (5932): No heartbeat from core client for 30 sec - exiting 10:26:35 (4164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:42:36 (5092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:42:37 (5092): No heartbeat from core client for 30 sec - exiting 10:58:00 (4456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:58:01 (4456): No heartbeat from core client for 30 sec - exiting 11:35:40 (1592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:35:41 (1592): No heartbeat from core client for 30 sec - exiting 11:35:42 (1592): No heartbeat from core client for 30 sec - exiting 11:35:43 (1592): No heartbeat from core client for 30 sec - exiting 11:41:37 (4076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:41:38 (4076): No heartbeat from core client for 30 sec - exiting 11:41:39 (4076): No heartbeat from core client for 30 sec - exiting 11:41:40 (4076): No heartbeat from core client for 30 sec - exiting 13:24:40 (4476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:24:41 (4476): No heartbeat from core client for 30 sec - exiting 13:49:40 (3288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:11:35 (4128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:43:12 (4228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:41:09 (3696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:41:10 (3696): No heartbeat from core client for 30 sec - exiting 10:01:03 (2132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:50:27 (1468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:37:25 (4544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:37:26 (4544): No heartbeat from core client for 30 sec - exiting 13:01:05 (1984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:38:13 (4140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:33:07 (2848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:33:08 (2848): No heartbeat from core client for 30 sec - exiting 10:17:46 (5044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:17:47 (5044): No heartbeat from core client for 30 sec - exiting 10:17:48 (5044): No heartbeat from core client for 30 sec - exiting 10:17:49 (5044): No heartbeat from core client for 30 sec - exiting 13:13:49 (5304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:34:34 (3232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:20:56 (3920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:33:49 (4896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:33:50 (4896): No heartbeat from core client for 30 sec - exiting 15:21:51 (4084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:21:52 (4084): No heartbeat from core client for 30 sec - exiting 08:01:32 (4372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:11:08 (3284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:11:09 (3284): No heartbeat from core client for 30 sec - exiting 08:11:10 (3284): No heartbeat from core client for 30 sec - exiting 09:03:33 (3356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:03:34 (3356): No heartbeat from core client for 30 sec - exiting 13:24:32 (5000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:11:09 (5128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:11:10 (5128): No heartbeat from core client for 30 sec - exiting 15:11:11 (5128): No heartbeat from core client for 30 sec - exiting 15:11:12 (5128): No heartbeat from core client for 30 sec - exiting 15:11:13 (5128): No heartbeat from core client for 30 sec - exiting 15:11:14 (5128): No heartbeat from core client for 30 sec - exiting 15:11:15 (5128): No heartbeat from core client for 30 sec - exiting 15:11:16 (5128): No heartbeat from core client for 30 sec - exiting 15:11:17 (5128): No heartbeat from core client for 30 sec - exiting 17:08:38 (4688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:08:39 (4688): No heartbeat from core client for 30 sec - exiting 17:08:40 (4688): No heartbeat from core client for 30 sec - exiting 17:23:59 (5468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:12:05 (4696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:05:12 (4532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:05:13 (4532): No heartbeat from core client for 30 sec - exiting 14:05:14 (4532): No heartbeat from core client for 30 sec - exiting 17:02:38 (3276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:55:03 (4256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:55:04 (4256): No heartbeat from core client for 30 sec - exiting 14:31:06 (5792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:41:25 (4352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:41:26 (4352): No heartbeat from core client for 30 sec - exiting 15:32:21 (892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:17:43 (4000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:17:44 (4000): No heartbeat from core client for 30 sec - exiting 08:17:45 (4000): No heartbeat from core client for 30 sec - exiting 09:05:13 (4592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:05:14 (4592): No heartbeat from core client for 30 sec - exiting 09:05:15 (4592): No heartbeat from core client for 30 sec - exiting 09:05:16 (4592): No heartbeat from core client for 30 sec - exiting 09:08:21 (4564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:14:42 (4968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:14:43 (4968): No heartbeat from core client for 30 sec - exiting 09:14:44 (4968): No heartbeat from core client for 30 sec - exiting 09:17:43 (1324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:17:44 (1324): No heartbeat from core client for 30 sec - exiting 09:17:45 (1324): No heartbeat from core client for 30 sec - exiting 09:17:46 (1324): No heartbeat from core client for 30 sec - exiting 09:17:47 (1324): No heartbeat from core client for 30 sec - exiting 09:20:52 (5184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:20:53 (5184): No heartbeat from core client for 30 sec - exiting 09:20:54 (5184): No heartbeat from core client for 30 sec - exiting 09:23:54 (212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:23:55 (212): No heartbeat from core client for 30 sec - exiting 09:23:56 (212): No heartbeat from core client for 30 sec - exiting 09:23:57 (212): No heartbeat from core client for 30 sec - exiting 09:30:07 (5692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:30:08 (5692): No heartbeat from core client for 30 sec - exiting 09:30:09 (5692): No heartbeat from core client for 30 sec - exiting 09:30:10 (5692): No heartbeat from core client for 30 sec - exiting 09:30:11 (5692): No heartbeat from core client for 30 sec - exiting 09:33:13 (5492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:39:26 (5632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:49:30 (4152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:49:31 (4152): No heartbeat from core client for 30 sec - exiting 08:18:55 (4632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:04:21 (3608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:04:22 (3608): No heartbeat from core client for 30 sec - exiting 07:52:55 (4764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:52:56 (4764): No heartbeat from core client for 30 sec - exiting 07:52:57 (4764): No heartbeat from core client for 30 sec - exiting 12:16:15 (2452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:16:16 (2452): No heartbeat from core client for 30 sec - exiting 08:46:00 (4904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:46:01 (4904): No heartbeat from core client for 30 sec - exiting 08:46:02 (4904): No heartbeat from core client for 30 sec - exiting 09:17:18 (3200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:23:39 (3024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:23:40 (3024): No heartbeat from core client for 30 sec - exiting 09:23:41 (3024): No heartbeat from core client for 30 sec - exiting 09:23:42 (3024): No heartbeat from core client for 30 sec - exiting 09:58:29 (4248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:58:30 (4248): No heartbeat from core client for 30 sec - exiting 09:58:31 (4248): No heartbeat from core client for 30 sec - exiting 10:45:14 (3992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:45:15 (3992): No heartbeat from core client for 30 sec - exiting 11:22:47 (3676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:22:48 (3676): No heartbeat from core client for 30 sec - exiting 13:24:25 (3336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:45:07 (4108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:25:44 (4012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:25:45 (4012): No heartbeat from core client for 30 sec - exiting 10:12:24 (2356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:52:47 (4136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:52:48 (4136): No heartbeat from core client for 30 sec - exiting 12:39:10 (4668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:29:27 (4860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:25:56 (2792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:25:57 (2792): No heartbeat from core client for 30 sec - exiting 14:25:58 (2792): No heartbeat from core client for 30 sec - exiting 14:41:22 (3492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:41:23 (3492): No heartbeat from core client for 30 sec - exiting 14:41:24 (3492): No heartbeat from core client for 30 sec - exiting 14:41:25 (3492): No heartbeat from core client for 30 sec - exiting 14:41:26 (3492): No heartbeat from core client for 30 sec - exiting 14:41:27 (3492): No heartbeat from core client for 30 sec - exiting 16:06:13 (796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:06:14 (796): No heartbeat from core client for 30 sec - exiting 16:06:15 (796): No heartbeat from core client for 30 sec - exiting 11:51:23 (4128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:31:28 (5656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:31:29 (5656): No heartbeat from core client for 30 sec - exiting 12:41:03 (6128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:41:04 (6128): No heartbeat from core client for 30 sec - exiting 12:41:05 (6128): No heartbeat from core client for 30 sec - exiting 13:31:49 (5432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:54:36 (3696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:54:37 (3696): No heartbeat from core client for 30 sec - exiting 14:37:59 (356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:48:08 (1984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:41:22 (4232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:12:28 (5996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:12:29 (5996): No heartbeat from core client for 30 sec - exiting 15:12:30 (5996): No heartbeat from core client for 30 sec - exiting 15:27:58 (5764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:53:07 (4464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:53:08 (4464): No heartbeat from core client for 30 sec - exiting 15:53:09 (4464): No heartbeat from core client for 30 sec - exiting 15:53:10 (4464): No heartbeat from core client for 30 sec - exiting 15:53:11 (4464): No heartbeat from core client for 30 sec - exiting 15:53:12 (4464): No heartbeat from core client for 30 sec - exiting 16:08:42 (5740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:08:43 (5740): No heartbeat from core client for 30 sec - exiting 16:08:44 (5740): No heartbeat from core client for 30 sec - exiting 09:50:40 (4700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:41:21 (4536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:41:22 (4536): No heartbeat from core client for 30 sec - exiting 12:36:13 (3700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:36:14 (3700): No heartbeat from core client for 30 sec - exiting 13:38:16 (4276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:38:17 (4276): No heartbeat from core client for 30 sec - exiting 15:41:15 (3636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:03:23 (1232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:09:06 (4916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:09:07 (4916): No heartbeat from core client for 30 sec - exiting 08:12:36 (3908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:12:37 (3908): No heartbeat from core client for 30 sec - exiting 08:15:37 (3180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:19:09 (2132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:19:10 (2132): No heartbeat from core client for 30 sec - exiting 08:19:11 (2132): No heartbeat from core client for 30 sec - exiting 08:31:45 (2488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:31:46 (2488): No heartbeat from core client for 30 sec - exiting 09:34:21 (4452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:19:17 (4532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:19:18 (4532): No heartbeat from core client for 30 sec - exiting 10:48:22 (4200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:48:23 (4200): No heartbeat from core client for 30 sec - exiting 12:41:13 (6036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:41:17 (5912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:07:00 (3544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:07:01 (3544): No heartbeat from core client for 30 sec - exiting 16:23:20 (4792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:49:23 (4268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:49:24 (4268): No heartbeat from core client for 30 sec - exiting 08:19:55 (3412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:19:56 (3412): No heartbeat from core client for 30 sec - exiting 08:19:58 (3412): No heartbeat from core client for 30 sec - exiting 08:29:35 (4256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:29:36 (4256): No heartbeat from core client for 30 sec - exiting 09:01:00 (3248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:01:01 (3248): No heartbeat from core client for 30 sec - exiting 09:01:02 (3248): No heartbeat from core client for 30 sec - exiting 10:40:44 (1500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:40:45 (1500): No heartbeat from core client for 30 sec - exiting 10:40:46 (1500): No heartbeat from core client for 30 sec - exiting 13:13:50 (684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:55:10 (4960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:55:11 (4960): No heartbeat from core client for 30 sec - exiting 15:00:42 (708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:00:43 (708): No heartbeat from core client for 30 sec - exiting 16:02:52 (5808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:02:53 (5808): No heartbeat from core client for 30 sec - exiting 17:05:50 (3332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:58:24 (4132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:42:15 (3836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:42:16 (3836): No heartbeat from core client for 30 sec - exiting 11:13:18 (2860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:13:19 (2860): No heartbeat from core client for 30 sec - exiting 11:38:00 (3940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:38:01 (3940): No heartbeat from core client for 30 sec - exiting 12:11:55 (892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:44:59 (4436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:54:32 (6008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:54:33 (6008): No heartbeat from core client for 30 sec - exiting 09:05:30 (4284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:14:00 (2580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:14:01 (2580): No heartbeat from core client for 30 sec - exiting 10:14:02 (2580): No heartbeat from core client for 30 sec - exiting 11:03:29 (2656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:03:30 (2656): No heartbeat from core client for 30 sec - exiting 11:03:31 (2656): No heartbeat from core client for 30 sec - exiting 11:41:53 (5920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:41:54 (5920): No heartbeat from core client for 30 sec - exiting 12:11:24 (5872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:06:50 (1744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:57:37 (4692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:57:38 (4692): No heartbeat from core client for 30 sec - exiting 16:57:39 (4692): No heartbeat from core client for 30 sec - exiting 17:22:25 (5612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:22:26 (5612): No heartbeat from core client for 30 sec - exiting 17:22:27 (5612): No heartbeat from core client for 30 sec - exiting 17:22:28 (5612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 11:25:01 (2140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:25:02 (2140): No heartbeat from core client for 30 sec - exiting 13:17:17 (4252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:41:47 (3208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:32:01 (3380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:32:02 (3380): No heartbeat from core client for 30 sec - exiting 14:32:03 (3380): No heartbeat from core client for 30 sec - exiting 14:47:56 (3920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:47:57 (3920): No heartbeat from core client for 30 sec - exiting 15:53:34 (2284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:11:07 (3956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:11:08 (3956): No heartbeat from core client for 30 sec - exiting 10:11:09 (3956): No heartbeat from core client for 30 sec - exiting 13:29:22 (1732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:29:24 (1732): No heartbeat from core client for 30 sec - exiting 13:29:25 (1732): No heartbeat from core client for 30 sec - exiting 13:29:26 (1732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 11:05:41 (4452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:05:43 (4452): No heartbeat from core client for 30 sec - exiting 11:05:44 (4452): No heartbeat from core client for 30 sec - exiting 11:05:45 (4452): No heartbeat from core client for 30 sec - exiting 11:05:46 (4452): No heartbeat from core client for 30 sec - exiting 11:05:47 (4452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3440, iMonCtr=1 Model crash detected, will try to restart... 17:16:40 (4256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:16:42 (4256): No heartbeat from core client for 30 sec - exiting 17:16:43 (4256): No heartbeat from core client for 30 sec - exiting 08:35:54 (5080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:29:11 (5016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:29:12 (5016): No heartbeat from core client for 30 sec - exiting 11:49:46 (4016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:49:47 (4016): No heartbeat from core client for 30 sec - exiting 12:50:11 (3308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:50:12 (3308): No heartbeat from core client for 30 sec - exiting 13:14:59 (4228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:15:00 (4228): No heartbeat from core client for 30 sec - exiting 15:25:06 (2524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:25:07 (2524): No heartbeat from core client for 30 sec - exiting 15:25:08 (2524): No heartbeat from core client for 30 sec - exiting 08:54:32 (4860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:10:12 (924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:40:03 (2000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:40:04 (2000): No heartbeat from core client for 30 sec - exiting 10:55:53 (5088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:11:28 (3016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:05:44 (4480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:35:21 (2524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:59:18 (4852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:59:19 (4852): No heartbeat from core client for 30 sec - exiting 10:59:20 (4852): No heartbeat from core client for 30 sec - exiting 10:59:21 (4852): No heartbeat from core client for 30 sec - exiting 10:59:22 (4852): No heartbeat from core client for 30 sec - exiting 11:17:09 (3288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:17:11 (3288): No heartbeat from core client for 30 sec - exiting 13:41:21 (4136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:41:22 (4136): No heartbeat from core client for 30 sec - exiting 14:32:41 (5112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:32:42 (5112): No heartbeat from core client for 30 sec - exiting 15:13:21 (4756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:18:57 (2212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:34:25 (880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:32:46 (4296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:17:49 (4036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:50:21 (3964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CNo Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3132, selfPID=3132, iMonCtr=1 07:53:01 (4264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:53:02 (4264): No heartbeat from core client for 30 sec - exiting 07:53:03 (4264): No heartbeat from core client for 30 sec - exiting 07:53:04 (4264): No heartbeat from core client for 30 sec - exiting 12:56:36 (4328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:23:28 (5208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:15:11 (5240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:15:12 (5240): No heartbeat from core client for 30 sec - exiting 08:41:39 (3248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:41:40 (3248): No heartbeat from core client for 30 sec - exiting 14:05:16 (2884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:16:43 (3076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:16:44 (3076): No heartbeat from core client for 30 sec - exiting 17:22:32 (2520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:49:10 (3960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:29:35 (3888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:29:36 (3888): No heartbeat from core client for 30 sec - exiting 15:08:20 (4704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:04:34 (4092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:04:35 (4092): No heartbeat from core client for 30 sec - exiting 08:04:36 (4092): No heartbeat from core client for 30 sec - exiting 08:04:37 (4092): No heartbeat from core client for 30 sec - exiting 08:20:17 (4704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:28:07 (4136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:18:55 (2776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:18:56 (2776): No heartbeat from core client for 30 sec - exiting 11:44:05 (4392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:51:30 (4356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:51:31 (4356): No heartbeat from core client for 30 sec - exiting 16:06:46 (4104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:06:47 (4104): No heartbeat from core client for 30 sec - exiting 08:59:14 (4544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:59:15 (4544): No heartbeat from core client for 30 sec - exiting 08:59:16 (4544): No heartbeat from core client for 30 sec - exiting 08:59:17 (4544): No heartbeat from core client for 30 sec - exiting 08:59:18 (4544): No heartbeat from core client for 30 sec - exiting 11:22:03 (4416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:18:08 (3512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:54:03 (3128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:54:04 (3128): No heartbeat from core client for 30 sec - exiting 07:54:05 (3128): No heartbeat from core client for 30 sec - exiting 07:54:06 (3128): No heartbeat from core client for 30 sec - exiting 07:54:07 (3128): No heartbeat from core client for 30 sec - exiting 07:54:08 (3128): No heartbeat from core client for 30 sec - exiting 08:19:21 (2916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:17:32 (4228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:17:33 (4228): No heartbeat from core client for 30 sec - exiting 10:17:34 (4228): No heartbeat from core client for 30 sec - exiting 12:49:51 (3612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:49:52 (3612): No heartbeat from core client for 30 sec - exiting 14:01:11 (6004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:01:12 (6004): No heartbeat from core client for 30 sec - exiting 14:01:13 (6004): No heartbeat from core client for 30 sec - exiting 14:01:14 (6004): No heartbeat from core client for 30 sec - exiting 14:06:18 (5792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:06:19 (5792): No heartbeat from core client for 30 sec - exiting 14:06:20 (5792): No heartbeat from core client for 30 sec - exiting 14:06:21 (5792): No heartbeat from core client for 30 sec - exiting 08:07:58 (4108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:14:14 (4704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:14:15 (4704): No heartbeat from core client for 30 sec - exiting 08:14:16 (4704): No heartbeat from core client for 30 sec - exiting 08:14:17 (4704): No heartbeat from core client for 30 sec - exiting 08:14:18 (4704): No heartbeat from core client for 30 sec - exiting 08:23:49 (1952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:54:26 (4904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:09:52 (3488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:09:53 (3488): No heartbeat from core client for 30 sec - exiting 09:48:00 (3512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:59:13 (5552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:59:14 (5552): No heartbeat from core client for 30 sec - exiting 11:14:50 (4444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:14:51 (4444): No heartbeat from core client for 30 sec - exiting 11:14:53 (4444): No heartbeat from core client for 30 sec - exiting 11:14:54 (4444): No heartbeat from core client for 30 sec - exiting 11:14:55 (4444): No heartbeat from core client for 30 sec - exiting 17:02:02 (6132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:02:03 (6132): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:19:29 (2588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:22:10 (4128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:28:53 (4368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:28:54 (4368): No heartbeat from core client for 30 sec - exiting 08:47:53 (4128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:54 (4128): No heartbeat from core client for 30 sec - exiting 08:47:55 (4128): No heartbeat from core client for 30 sec - exiting 11:51:57 (2692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:51:58 (2692): No heartbeat from core client for 30 sec - exiting </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Nov 2012 22:24:07	1158160	15420397	hadcm3n_y93f_1980_40_008242935_1	77,760	146,157	1.8796
03 Nov 2012 14:25:31	1158160	15420397	hadcm3n_y93f_1980_40_008242935_1	51,840	97,482	1.8804
01 Nov 2012 15:32:37	1158160	15420397	hadcm3n_y93f_1980_40_008242935_1	25,920	48,859	1.8850