Task 12995073

Name	hadcm3n_o0au_1940_40_007301530_0
Workunit	7498954
Created	22 Jun 2011, 13:45:42 UTC
Sent	22 Jun 2011, 13:45:51 UTC
Report deadline	21 Sep 2011, 21:13:02 UTC
Received	13 Aug 2011, 2:39:57 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1073821
Run time	23 days 16 hours 14 min 43 sec
CPU time	22 days 20 hours 32 min 3 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.69 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> 01:06:30 (2964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:06:31 (2964): No heartbeat from core client for 30 sec - exiting 13:10:21 (2372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:10:23 (2372): No heartbeat from core client for 30 sec - exiting 13:10:24 (2372): No heartbeat from core client for 30 sec - exiting 19:29:39 (5772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:29:41 (5772): No heartbeat from core client for 30 sec - exiting 19:29:42 (5772): No heartbeat from core client for 30 sec - exiting 01:35:39 (5580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:41:05 (5984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:41:06 (5984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 19:55:16 (5140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:56:26 (5880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:42:56 (2160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:02:02 (2136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:02:03 (2136): No heartbeat from core client for 30 sec - exiting 18:02:44 (5468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:14:06 (2120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:19:04 (2420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:19:59 (4244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:59:17 (4164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:00:29 (2524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:00:41 (2524): No heartbeat from core client for 30 sec - exiting 04:00:42 (2524): No heartbeat from core client for 30 sec - exiting 04:00:43 (2524): No heartbeat from core client for 30 sec - exiting 04:00:44 (2524): No heartbeat from core client for 30 sec - exiting 04:00:46 (2524): No heartbeat from core client for 30 sec - exiting 04:01:34 (2864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:28:37 (6176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:59:23 (2068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:00:13 (6580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:00:14 (6580): No heartbeat from core client for 30 sec - exiting 11:00:15 (6580): No heartbeat from core client for 30 sec - exiting 11:00:17 (6580): No heartbeat from core client for 30 sec - exiting 11:00:18 (6580): No heartbeat from core client for 30 sec - exiting 11:00:19 (6580): No heartbeat from core client for 30 sec - exiting 11:00:20 (6580): No heartbeat from core client for 30 sec - exiting 11:00:21 (6580): No heartbeat from core client for 30 sec - exiting 11:00:22 (6580): No heartbeat from core client for 30 sec - exiting 11:00:23 (6580): No heartbeat from core client for 30 sec - exiting 11:00:24 (6580): No heartbeat from core client for 30 sec - exiting 12:35:46 (2704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4876, iMonCtr=1 Model crash detected, will try to restart... 12:01:32 (4880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:16:57 (4472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:17:35 (1688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:29:12 (2056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:31:02 (4672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:32:21 (3692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:47:23 (1124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:50:29 (1736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:05:55 (2872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:08:44 (3796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:22:52 (2612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:27:14 (1260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:02:28 (1176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:04:25 (4212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:15:55 (3740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:19:36 (4204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:23:04 (4120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:31:25 (5004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 05:40:18 (2980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:40:21 (2844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:40:22 (2844): No heartbeat from core client for 30 sec - exiting 10:41:00 (1012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:24:10 (6104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:27:27 (5700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 02:10:26 (812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:12:10 (6620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:26:47 (4316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:26:48 (4316): No heartbeat from core client for 30 sec - exiting 12:40:22 (4716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:06:58 (5068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:07:36 (4432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:58:12 (3744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:05:26 (2616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:34:41 (4936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:37:07 (2992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:37:47 (5012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:58:40 (5052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:59:23 (1568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:37:59 (3616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:27:13 (5436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:27:53 (6064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:33:25 (5076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:14:26 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:14:27 (5056): No heartbeat from core client for 30 sec - exiting 04:15:07 (5776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:42:49 (5496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:43:29 (4572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:44:05 (3972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:07:08 (4452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:13:28 (1208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:32:39 (4452): No heartbeat from core client for 30 sec - exiting 02:32:40 (4452): No heartbeat from core client for 30 sec - exiting 02:32:41 (4452): No heartbeat from core client for 30 sec - exiting 02:32:42 (4452): No heartbeat from core client for 30 sec - exiting 02:32:43 (4452): No heartbeat from core client for 30 sec - exiting 02:32:44 (4452): No heartbeat from core client for 30 sec - exiting 02:32:45 (4452): No heartbeat from core client for 30 sec - exiting 02:32:46 (4452): No heartbeat from core client for 30 sec - exiting 02:32:48 (4452): No heartbeat from core client for 30 sec - exiting 02:32:49 (4452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:34:05 (2092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:34:58 (4048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:40:32 (2948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:41:21 (1988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:06:21 (3136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:20:01 (3800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:00:10 (5044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:26:35 (4496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:42:53 (3696): No heartbeat from core client for 30 sec - exiting 15:42:54 (3696): No heartbeat from core client for 30 sec - exiting 15:42:55 (3696): No heartbeat from core client for 30 sec - exiting 15:42:56 (3696): No heartbeat from core client for 30 sec - exiting 15:42:57 (3696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2780, iMonCtr=1 Model crash detected, will try to restart... 16:00:04 (5108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:32:12 (820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:32:52 (604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:41:23 (1040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:41:25 (1040): No heartbeat from core client for 30 sec - exiting 10:10:39 (2080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:44:30 (2716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:53:25 (1176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:09:23 (4104): No heartbeat from core client for 30 sec - exiting 17:09:24 (4104): No heartbeat from core client for 30 sec - exiting 17:09:25 (4104): No heartbeat from core client for 30 sec - exiting 17:09:26 (4104): No heartbeat from core client for 30 sec - exiting 17:09:27 (4104): No heartbeat from core client for 30 sec - exiting 17:09:28 (4104): No heartbeat from core client for 30 sec - exiting 17:09:29 (4104): No heartbeat from core client for 30 sec - exiting 17:09:30 (4104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:51:40 (4436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:39:58 (3680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:40:59 (604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:58:55 (5652): No heartbeat from core client for 30 sec - exiting 07:58:56 (5652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:58:57 (5652): No heartbeat from core client for 30 sec - exiting 07:58:58 (5652): No heartbeat from core client for 30 sec - exiting 07:58:59 (5652): No heartbeat from core client for 30 sec - exiting 07:59:00 (5652): No heartbeat from core client for 30 sec - exiting 08:00:30 (4004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:15:31 (196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:15:43 (196): No heartbeat from core client for 30 sec - exiting 08:15:44 (196): No heartbeat from core client for 30 sec - exiting 08:15:45 (196): No heartbeat from core client for 30 sec - exiting 08:15:46 (196): No heartbeat from core client for 30 sec - exiting 08:15:47 (196): No heartbeat from core client for 30 sec - exiting 08:15:48 (196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:57:56 (6108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 02:15:00 (6088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 02:43:25 (4020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4632, selfPID=4632, iMonCtr=1 12:50:43 (5572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:49:49 (6088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:38:41 (1600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:52:44 (5976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:52:55 (5976): No heartbeat from core client for 30 sec - exiting 12:52:56 (5976): No heartbeat from core client for 30 sec - exiting 12:52:57 (5976): No heartbeat from core client for 30 sec - exiting 12:52:58 (5976): No heartbeat from core client for 30 sec - exiting 12:52:59 (5976): No heartbeat from core client for 30 sec - exiting 12:53:00 (5976): No heartbeat from core client for 30 sec - exiting 12:53:01 (5976): No heartbeat from core client for 30 sec - exiting 12:53:02 (5976): No heartbeat from core client for 30 sec - exiting 12:53:03 (5976): No heartbeat from core client for 30 sec - exiting 12:53:04 (5976): No heartbeat from core client for 30 sec - exiting 12:53:05 (5976): No heartbeat from core client for 30 sec - exiting 12:53:06 (5976): No heartbeat from core client for 30 sec - exiting 12:53:07 (5976): No heartbeat from core client for 30 sec - exiting 12:53:08 (5976): No heartbeat from core client for 30 sec - exiting 12:53:09 (5976): No heartbeat from core client for 30 sec - exiting 12:53:10 (5976): No heartbeat from core client for 30 sec - exiting 12:53:11 (5976): No heartbeat from core client for 30 sec - exiting 12:53:15 (5976): No heartbeat from core client for 30 sec - exiting 12:53:58 (5644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:54:31 (4024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:56:31 (2856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:56:36 (2856): No heartbeat from core client for 30 sec - exiting 06:56:37 (2856): No heartbeat from core client for 30 sec - exiting 06:56:38 (2856): No heartbeat from core client for 30 sec - exiting 06:56:39 (2856): No heartbeat from core client for 30 sec - exiting 06:56:40 (2856): No heartbeat from core client for 30 sec - exiting 06:56:41 (2856): No heartbeat from core client for 30 sec - exiting 06:56:42 (2856): No heartbeat from core client for 30 sec - exiting 06:56:43 (2856): No heartbeat from core client for 30 sec - exiting 06:56:44 (2856): No heartbeat from core client for 30 sec - exiting 06:56:45 (2856): No heartbeat from core client for 30 sec - exiting 06:58:13 (2068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 04:38:47 (5516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:39:32 (1312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:42:30 (5576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:44:08 (3252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:30:32 (5460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:19:39 (2516): No heartbeat from core client for 30 sec - exiting 09:19:40 (2516): No heartbeat from core client for 30 sec - exiting 09:19:41 (2516): No heartbeat from core client for 30 sec - exiting 09:19:42 (2516): No heartbeat from core client for 30 sec - exiting 09:19:43 (2516): No heartbeat from core client for 30 sec - exiting 09:19:44 (2516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:47:20 (5056): No heartbeat from core client for 30 sec - exiting 21:47:21 (5056): No heartbeat from core client for 30 sec - exiting 21:47:22 (5056): No heartbeat from core client for 30 sec - exiting 21:47:23 (5056): No heartbeat from core client for 30 sec - exiting 21:47:24 (5056): No heartbeat from core client for 30 sec - exiting 21:47:25 (5056): No heartbeat from core client for 30 sec - exiting 21:47:26 (5056): No heartbeat from core client for 30 sec - exiting 21:47:27 (5056): No heartbeat from core client for 30 sec - exiting 21:47:28 (5056): No heartbeat from core client for 30 sec - exiting 21:47:29 (5056): No heartbeat from core client for 30 sec - exiting 21:47:30 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:47:31 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:37:04 (4588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:23:53 (4296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:24:28 (4448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:12:38 (5052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:58:59 (4408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:59:35 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:51:46 (484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:52:28 (1784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4384, iMonCtr=1 Model crash detected, will try to restart... 04:50:06 (2448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:52:26 (3440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 05:21:04 (4728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:27:42 (4124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:28:59 (2716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:39:30 (7144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:47:15 (2488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:33:43 (3896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:33:57 (3896): No heartbeat from core client for 30 sec - exiting 18:33:58 (3896): No heartbeat from core client for 30 sec - exiting 18:33:59 (3896): No heartbeat from core client for 30 sec - exiting 18:34:00 (3896): No heartbeat from core client for 30 sec - exiting 18:34:01 (3896): No heartbeat from core client for 30 sec - exiting 18:34:02 (3896): No heartbeat from core client for 30 sec - exiting 18:36:09 (5664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Aug 2011 00:37:08	1073821	12995073	hadcm3n_o0au_1940_40_007301530_0	1,036,800	1,973,923	1.9039
12 Aug 2011 08:30:56	1073821	12995073	hadcm3n_o0au_1940_40_007301530_0	1,010,880	1,920,665	1.9000
11 Aug 2011 08:14:04	1073821	12995073	hadcm3n_o0au_1940_40_007301530_0	984,960	1,867,643	1.8962
10 Aug 2011 15:32:12	1073821	12995073	hadcm3n_o0au_1940_40_007301530_0	959,040	1,814,565	1.8921
10 Aug 2011 00:35:11	1073821	12995073	hadcm3n_o0au_1940_40_007301530_0	933,120	1,761,521	1.8878
09 Aug 2011 03:10:10	1073821	12995073	hadcm3n_o0au_1940_40_007301530_0	907,200	1,708,100	1.8828
08 Aug 2011 11:29:12	1073821	12995073	hadcm3n_o0au_1940_40_007301530_0	881,280	1,653,485	1.8762
07 Aug 2011 18:11:38	1073821	12995073	hadcm3n_o0au_1940_40_007301530_0	855,360	1,598,720	1.8691
07 Aug 2011 01:52:06	1073821	12995073	hadcm3n_o0au_1940_40_007301530_0	829,440	1,543,556	1.8610
06 Aug 2011 08:19:52	1073821	12995073	hadcm3n_o0au_1940_40_007301530_0	803,520	1,488,164	1.8521
05 Aug 2011 15:19:54	1073821	12995073	hadcm3n_o0au_1940_40_007301530_0	777,600	1,433,739	1.8438
04 Aug 2011 20:48:06	1073821	12995073	hadcm3n_o0au_1940_40_007301530_0	751,680	1,379,945	1.8358
03 Aug 2011 23:49:07	1073821	12995073	hadcm3n_o0au_1940_40_007301530_0	725,760	1,324,972	1.8256
03 Aug 2011 06:40:45	1073821	12995073	hadcm3n_o0au_1940_40_007301530_0	699,840	1,270,439	1.8153
25 Jul 2011 17:56:40	1073821	12995073	hadcm3n_o0au_1940_40_007301530_0	673,920	1,219,394	1.8094
09 Jul 2011 15:07:30	1073821	12995073	hadcm3n_o0au_1940_40_007301530_0	648,000	1,171,966	1.8086
09 Jul 2011 01:51:53	1073821	12995073	hadcm3n_o0au_1940_40_007301530_0	622,080	1,125,391	1.8091
08 Jul 2011 04:47:14	1073821	12995073	hadcm3n_o0au_1940_40_007301530_0	596,160	1,078,436	1.8090
07 Jul 2011 15:43:41	1073821	12995073	hadcm3n_o0au_1940_40_007301530_0	570,240	1,030,986	1.8080
07 Jul 2011 15:43:41	1073821	12995073	hadcm3n_o0au_1940_40_007301530_0	544,320	983,873	1.8075