Task 13337661

Name	hadcm3n_o5o9_1900_40_007440409_1
Workunit	7637912
Created	5 Sep 2011, 18:20:12 UTC
Sent	5 Sep 2011, 20:12:20 UTC
Report deadline	6 Dec 2011, 3:39:31 UTC
Received	16 Nov 2011, 21:45:03 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	1 (0x00000001) Unknown error code
Computer ID	1150866
Run time	3 days 15 hours 9 min 55 sec
CPU time	2 days 15 hours 16 min 5 sec
Validate state	Invalid
Credit	1,244.16
Device peak FLOPS	2.90 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> Incorrect function. (0x1) - exit code 1 (0x1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:30:02 (5368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:15:14 (3088): No heartbeat from core client for 30 sec - exiting 22:15:15 (3088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:16:12 (5460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:37:14 (4456): No heartbeat from core client for 30 sec - exiting 18:37:15 (4456): No heartbeat from core client for 30 sec - exiting 18:37:16 (4456): No heartbeat from core client for 30 sec - exiting 18:37:17 (4456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:18:04 (4496): No heartbeat from core client for 30 sec - exiting 23:18:05 (4496): No heartbeat from core client for 30 sec - exiting 23:18:06 (4496): No heartbeat from core client for 30 sec - exiting 23:18:07 (4496): No heartbeat from core client for 30 sec - exiting 23:18:08 (4496): No heartbeat from core client for 30 sec - exiting 23:18:09 (4496): No heartbeat from core client for 30 sec - exiting 23:18:10 (4496): No heartbeat from core client for 30 sec - exiting 23:18:11 (4496): No heartbeat from core client for 30 sec - exiting 23:18:12 (4496): No heartbeat from core client for 30 sec - exiting 23:18:13 (4496): No heartbeat from core client for 30 sec - exiting 23:18:14 (4496): No heartbeat from core client for 30 sec - exiting 23:18:16 (4496): No heartbeat from core client for 30 sec - exiting 23:18:17 (4496): No heartbeat from core client for 30 sec - exiting 23:18:18 (4496): No heartbeat from core client for 30 sec - exiting 23:18:19 (4496): No heartbeat from core client for 30 sec - exiting 23:18:20 (4496): No heartbeat from core client for 30 sec - exiting 23:18:21 (4496): No heartbeat from core client for 30 sec - exiting 23:18:22 (4496): No heartbeat from core client for 30 sec - exiting 23:18:23 (4496): No heartbeat from core client for 30 sec - exiting 23:18:24 (4496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:35:05 (4220): No heartbeat from core client for 30 sec - exiting 19:35:06 (4220): No heartbeat from core client for 30 sec - exiting 19:35:08 (4220): No heartbeat from core client for 30 sec - exiting 19:35:09 (4220): No heartbeat from core client for 30 sec - exiting 19:35:10 (4220): No heartbeat from core client for 30 sec - exiting 19:35:11 (4220): No heartbeat from core client for 30 sec - exiting 19:35:12 (4220): No heartbeat from core client for 30 sec - exiting 19:35:13 (4220): No heartbeat from core client for 30 sec - exiting 19:35:14 (4220): No heartbeat from core client for 30 sec - exiting 19:35:15 (4220): No heartbeat from core client for 30 sec - exiting 19:35:16 (4220): No heartbeat from core client for 30 sec - exiting 19:35:17 (4220): No heartbeat from core client for 30 sec - exiting 19:35:18 (4220): No heartbeat from core client for 30 sec - exiting 19:35:20 (4220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:57:04 (6020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:57:50 (5776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:32:57 (6100): No heartbeat from core client for 30 sec - exiting 13:32:59 (6100): No heartbeat from core client for 30 sec - exiting 13:33:00 (6100): No heartbeat from core client for 30 sec - exiting 13:33:01 (6100): No heartbeat from core client for 30 sec - exiting 13:33:02 (6100): No heartbeat from core client for 30 sec - exiting 13:33:03 (6100): No heartbeat from core client for 30 sec - exiting 13:33:04 (6100): No heartbeat from core client for 30 sec - exiting 13:33:05 (6100): No heartbeat from core client for 30 sec - exiting 13:33:06 (6100): No heartbeat from core client for 30 sec - exiting 13:33:07 (6100): No heartbeat from core client for 30 sec - exiting 13:33:09 (6100): No heartbeat from core client for 30 sec - exiting 13:33:10 (6100): No heartbeat from core client for 30 sec - exiting 13:33:11 (6100): No heartbeat from core client for 30 sec - exiting 13:33:12 (6100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:32:03 (6648): No heartbeat from core client for 30 sec - exiting 18:32:04 (6648): No heartbeat from core client for 30 sec - exiting 18:32:05 (6648): No heartbeat from core client for 30 sec - exiting 18:32:06 (6648): No heartbeat from core client for 30 sec - exiting 18:32:07 (6648): No heartbeat from core client for 30 sec - exiting 18:32:08 (6648): No heartbeat from core client for 30 sec - exiting 18:32:09 (6648): No heartbeat from core client for 30 sec - exiting 18:32:10 (6648): No heartbeat from core client for 30 sec - exiting 18:32:11 (6648): No heartbeat from core client for 30 sec - exiting 18:32:12 (6648): No heartbeat from core client for 30 sec - exiting 18:32:13 (6648): No heartbeat from core client for 30 sec - exiting 18:32:14 (6648): No heartbeat from core client for 30 sec - exiting 18:32:15 (6648): No heartbeat from core client for 30 sec - exiting 18:32:16 (6648): No heartbeat from core client for 30 sec - exiting 18:32:17 (6648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:10:04 (1952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:02:26 (6268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:20:41 (2872): No heartbeat from core client for 30 sec - exiting 21:20:42 (2872): No heartbeat from core client for 30 sec - exiting 21:20:43 (2872): No heartbeat from core client for 30 sec - exiting 21:20:44 (2872): No heartbeat from core client for 30 sec - exiting 21:20:45 (2872): No heartbeat from core client for 30 sec - exiting 21:20:46 (2872): No heartbeat from core client for 30 sec - exiting 21:20:47 (2872): No heartbeat from core client for 30 sec - exiting 21:20:48 (2872): No heartbeat from core client for 30 sec - exiting 21:20:49 (2872): No heartbeat from core client for 30 sec - exiting 21:20:50 (2872): No heartbeat from core client for 30 sec - exiting 21:20:52 (2872): No heartbeat from core client for 30 sec - exiting 21:20:53 (2872): No heartbeat from core client for 30 sec - exiting 21:20:54 (2872): No heartbeat from core client for 30 sec - exiting 21:20:55 (2872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:20:56 (2872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 19:41:30 (6404): No heartbeat from core client for 30 sec - exiting 19:41:32 (6404): No heartbeat from core client for 30 sec - exiting 19:41:33 (6404): No heartbeat from core client for 30 sec - exiting 19:41:34 (6404): No heartbeat from core client for 30 sec - exiting 19:41:35 (6404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:55:34 (7148): No heartbeat from core client for 30 sec - exiting 20:55:35 (7148): No heartbeat from core client for 30 sec - exiting 20:55:36 (7148): No heartbeat from core client for 30 sec - exiting 20:55:37 (7148): No heartbeat from core client for 30 sec - exiting 20:55:38 (7148): No heartbeat from core client for 30 sec - exiting 20:55:39 (7148): No heartbeat from core client for 30 sec - exiting 20:55:40 (7148): No heartbeat from core client for 30 sec - exiting 20:55:41 (7148): No heartbeat from core client for 30 sec - exiting 20:55:42 (7148): No heartbeat from core client for 30 sec - exiting 20:55:43 (7148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:35:31 (5400): No heartbeat from core client for 30 sec - exiting 18:35:32 (5400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:20:49 (8048): No heartbeat from core client for 30 sec - exiting 19:20:50 (8048): No heartbeat from core client for 30 sec - exiting 19:20:51 (8048): No heartbeat from core client for 30 sec - exiting 19:20:52 (8048): No heartbeat from core client for 30 sec - exiting 19:20:53 (8048): No heartbeat from core client for 30 sec - exiting 19:20:54 (8048): No heartbeat from core client for 30 sec - exiting 19:20:55 (8048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6508, iMonCtr=1 Model crash detected, will try to restart... 18:26:52 (6024): No heartbeat from core client for 30 sec - exiting 18:26:53 (6024): No heartbeat from core client for 30 sec - exiting 18:26:54 (6024): No heartbeat from core client for 30 sec - exiting 18:26:55 (6024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:50:50 (7644): No heartbeat from core client for 30 sec - exiting 22:50:51 (7644): No heartbeat from core client for 30 sec - exiting 22:50:52 (7644): No heartbeat from core client for 30 sec - exiting 22:50:53 (7644): No heartbeat from core client for 30 sec - exiting 22:50:54 (7644): No heartbeat from core client for 30 sec - exiting 22:50:56 (7644): No heartbeat from core client for 30 sec - exiting 22:50:57 (7644): No heartbeat from core client for 30 sec - exiting 22:50:58 (7644): No heartbeat from core client for 30 sec - exiting 22:50:59 (7644): No heartbeat from core client for 30 sec - exiting 22:51:00 (7644): No heartbeat from core client for 30 sec - exiting 22:51:01 (7644): No heartbeat from core client for 30 sec - exiting 22:51:02 (7644): No heartbeat from core client for 30 sec - exiting 22:51:03 (7644): No heartbeat from core client for 30 sec - exiting 22:51:04 (7644): No heartbeat from core client for 30 sec - exiting 22:51:05 (7644): No heartbeat from core client for 30 sec - exiting 22:51:06 (7644): No heartbeat from core client for 30 sec - exiting 22:51:08 (7644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:50:18 (804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:16:04 (6616): No heartbeat from core client for 30 sec - exiting 23:16:05 (6616): No heartbeat from core client for 30 sec - exiting 23:16:06 (6616): No heartbeat from core client for 30 sec - exiting 23:16:07 (6616): No heartbeat from core client for 30 sec - exiting 23:16:08 (6616): No heartbeat from core client for 30 sec - exiting 23:16:10 (6616): No heartbeat from core client for 30 sec - exiting 23:16:11 (6616): No heartbeat from core client for 30 sec - exiting 23:16:12 (6616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:16:13 (6616): No heartbeat from core client for 30 sec - exiting 08:06:56 (10500): No heartbeat from core client for 30 sec - exiting 08:06:57 (10500): No heartbeat from core client for 30 sec - exiting 08:06:58 (10500): No heartbeat from core client for 30 sec - exiting 08:06:59 (10500): No heartbeat from core client for 30 sec - exiting 08:07:00 (10500): No heartbeat from core client for 30 sec - exiting 08:07:02 (10500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:07:03 (10500): No heartbeat from core client for 30 sec - exiting 15:28:15 (7112): No heartbeat from core client for 30 sec - exiting 15:28:16 (7112): No heartbeat from core client for 30 sec - exiting 15:28:17 (7112): No heartbeat from core client for 30 sec - exiting 15:28:18 (7112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:00:07 (12252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:47:52 (6348): No heartbeat from core client for 30 sec - exiting 22:47:53 (6348): No heartbeat from core client for 30 sec - exiting 22:47:54 (6348): No heartbeat from core client for 30 sec - exiting 22:47:56 (6348): No heartbeat from core client for 30 sec - exiting 22:47:57 (6348): No heartbeat from core client for 30 sec - exiting 22:47:58 (6348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:22:26 (10832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:20:19 (7536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:57:33 (7260): No heartbeat from core client for 30 sec - exiting 17:57:34 (7260): No heartbeat from core client for 30 sec - exiting 17:57:35 (7260): No heartbeat from core client for 30 sec - exiting 17:57:36 (7260): No heartbeat from core client for 30 sec - exiting 17:57:37 (7260): No heartbeat from core client for 30 sec - exiting 17:57:38 (7260): No heartbeat from core client for 30 sec - exiting 17:57:39 (7260): No heartbeat from core client for 30 sec - exiting 17:57:41 (7260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:47:36 (7672): No heartbeat from core client for 30 sec - exiting 22:47:38 (7672): No heartbeat from core client for 30 sec - exiting 22:47:39 (7672): No heartbeat from core client for 30 sec - exiting 22:47:40 (7672): No heartbeat from core client for 30 sec - exiting 22:47:41 (7672): No heartbeat from core client for 30 sec - exiting 22:47:42 (7672): No heartbeat from core client for 30 sec - exiting 22:47:43 (7672): No heartbeat from core client for 30 sec - exiting 22:47:44 (7672): No heartbeat from core client for 30 sec - exiting 22:47:45 (7672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:22:46 (10668): No heartbeat from core client for 30 sec - exiting 21:22:47 (10668): No heartbeat from core client for 30 sec - exiting 21:22:48 (10668): No heartbeat from core client for 30 sec - exiting 21:22:49 (10668): No heartbeat from core client for 30 sec - exiting 21:22:50 (10668): No heartbeat from core client for 30 sec - exiting 21:22:51 (10668): No heartbeat from core client for 30 sec - exiting 21:22:52 (10668): No heartbeat from core client for 30 sec - exiting 21:22:54 (10668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:22:55 (10668): No heartbeat from core client for 30 sec - exiting 21:24:30 (7600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:31:49 (4944): No heartbeat from core client for 30 sec - exiting 16:31:50 (4944): No heartbeat from core client for 30 sec - exiting 16:31:51 (4944): No heartbeat from core client for 30 sec - exiting 16:31:52 (4944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:31:53 (4944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 18:35:51 (5040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:44:16 (6204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:09:56 (8012): No heartbeat from core client for 30 sec - exiting 23:09:57 (8012): No heartbeat from core client for 30 sec - exiting 23:09:58 (8012): No heartbeat from core client for 30 sec - exiting 23:09:59 (8012): No heartbeat from core client for 30 sec - exiting 23:10:00 (8012): No heartbeat from core client for 30 sec - exiting 23:10:01 (8012): No heartbeat from core client for 30 sec - exiting 23:10:02 (8012): No heartbeat from core client for 30 sec - exiting 23:10:03 (8012): No heartbeat from core client for 30 sec - exiting 23:10:04 (8012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:11:19 (3424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:28:33 (7652): No heartbeat from core client for 30 sec - exiting 23:28:34 (7652): No heartbeat from core client for 30 sec - exiting 23:28:35 (7652): No heartbeat from core client for 30 sec - exiting 23:28:36 (7652): No heartbeat from core client for 30 sec - exiting 23:28:37 (7652): No heartbeat from core client for 30 sec - exiting 23:28:38 (7652): No heartbeat from core client for 30 sec - exiting 23:28:39 (7652): No heartbeat from core client for 30 sec - exiting 23:28:41 (7652): No heartbeat from core client for 30 sec - exiting 23:28:42 (7652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:29:54 (4892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:05:56 (7764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:06:59 (9676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:02:25 (7420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:03:21 (1824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:56:24 (6404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:59:37 (10296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:00:41 (548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:00:57 (7072): No heartbeat from core client for 30 sec - exiting 21:00:58 (7072): No heartbeat from core client for 30 sec - exiting 21:00:59 (7072): No heartbeat from core client for 30 sec - exiting 21:01:00 (7072): No heartbeat from core client for 30 sec - exiting 21:01:01 (7072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:33:03 (6692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:52:39 (6724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:09:17 (10940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:21:04 (6956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:58:34 (6584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:06:29 (6516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:08:54 (5152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:15:59 (3192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:23:21 (8456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:42:38 (6968): No heartbeat from core client for 30 sec - exiting 09:42:39 (6968): No heartbeat from core client for 30 sec - exiting 09:42:40 (6968): No heartbeat from core client for 30 sec - exiting 09:42:41 (6968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:48:43 (1164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:53:55 (9072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:59:09 (148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:11:57 (9048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:21:35 (3956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:23:08 (8704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:27:34 (6988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:29:07 (5300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:52:06 (6976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8056, iMonCtr=1 Model crash detected, will try to restart... 22:10:13 (6420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:16:12 (2000): No heartbeat from core client for 30 sec - exiting 13:16:13 (2000): No heartbeat from core client for 30 sec - exiting 13:16:14 (2000): No heartbeat from core client for 30 sec - exiting 13:16:15 (2000): No heartbeat from core client for 30 sec - exiting 13:16:17 (2000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:41:15 (9492): No heartbeat from core client for 30 sec - exiting 14:41:16 (9492): No heartbeat from core client for 30 sec - exiting 14:41:17 (9492): No heartbeat from core client for 30 sec - exiting 14:41:18 (9492): No heartbeat from core client for 30 sec - exiting 14:41:19 (9492): No heartbeat from core client for 30 sec - exiting 14:41:21 (9492): No heartbeat from core client for 30 sec - exiting 14:41:22 (9492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:54:10 (800): No heartbeat from core client for 30 sec - exiting 20:54:11 (800): No heartbeat from core client for 30 sec - exiting 20:54:12 (800): No heartbeat from core client for 30 sec - exiting 20:54:13 (800): No heartbeat from core client for 30 sec - exiting 20:54:14 (800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:06:06 (3296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:30:58 (11488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:03:05 (5284): No heartbeat from core client for 30 sec - exiting 19:03:06 (5284): No heartbeat from core client for 30 sec - exiting 19:03:07 (5284): No heartbeat from core client for 30 sec - exiting 19:03:08 (5284): No heartbeat from core client for 30 sec - exiting 19:03:10 (5284): No heartbeat from core client for 30 sec - exiting 19:03:11 (5284): No heartbeat from core client for 30 sec - exiting 19:03:12 (5284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:03:13 (5284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 23:30:53 (7996): No heartbeat from core client for 30 sec - exiting 23:30:55 (7996): No heartbeat from core client for 30 sec - exiting 23:30:56 (7996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:27:01 (9332): No heartbeat from core client for 30 sec - exiting 18:27:02 (9332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:11:20 (10960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:57:46 (7688): No heartbeat from core client for 30 sec - exiting 08:57:47 (7688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:46:20 (6216): No heartbeat from core client for 30 sec - exiting 18:46:21 (6216): No heartbeat from core client for 30 sec - exiting 18:46:22 (6216): No heartbeat from core client for 30 sec - exiting 18:46:23 (6216): No heartbeat from core client for 30 sec - exiting 18:46:25 (6216): No heartbeat from core client for 30 sec - exiting 18:46:26 (6216): No heartbeat from core client for 30 sec - exiting 18:46:27 (6216): No heartbeat from core client for 30 sec - exiting 18:46:28 (6216): No heartbeat from core client for 30 sec - exiting 18:46:29 (6216): No heartbeat from core client for 30 sec - exiting 18:46:30 (6216): No heartbeat from core client for 30 sec - exiting 18:46:31 (6216): No heartbeat from core client for 30 sec - exiting 18:46:32 (6216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:13:01 (1304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:45:57 (8836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:49:20 (4596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:31:53 (7388): No heartbeat from core client for 30 sec - exiting 19:31:54 (7388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:17:00 (6376): No heartbeat from core client for 30 sec - exiting 18:17:02 (6376): No heartbeat from core client for 30 sec - exiting 18:17:03 (6376): No heartbeat from core client for 30 sec - exiting 18:17:04 (6376): No heartbeat from core client for 30 sec - exiting 18:17:05 (6376): No heartbeat from core client for 30 sec - exiting 18:17:06 (6376): No heartbeat from core client for 30 sec - exiting 18:17:07 (6376): No heartbeat from core client for 30 sec - exiting 18:17:08 (6376): No heartbeat from core client for 30 sec - exiting 18:17:09 (6376): No heartbeat from core client for 30 sec - exiting 18:17:10 (6376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:33:35 (6868): No heartbeat from core client for 30 sec - exiting 19:33:36 (6868): No heartbeat from core client for 30 sec - exiting 19:33:37 (6868): No heartbeat from core client for 30 sec - exiting 19:33:38 (6868): No heartbeat from core client for 30 sec - exiting 19:33:39 (6868): No heartbeat from core client for 30 sec - exiting 19:33:40 (6868): No heartbeat from core client for 30 sec - exiting 19:33:42 (6868): No heartbeat from core client for 30 sec - exiting 19:33:43 (6868): No heartbeat from core client for 30 sec - exiting 19:33:44 (6868): No heartbeat from core client for 30 sec - exiting 19:33:45 (6868): No heartbeat from core client for 30 sec - exiting 19:33:46 (6868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:56:21 (5820): No heartbeat from core client for 30 sec - exiting 08:56:22 (5820): No heartbeat from core client for 30 sec - exiting 08:56:23 (5820): No heartbeat from core client for 30 sec - exiting 08:56:24 (5820): No heartbeat from core client for 30 sec - exiting 08:56:25 (5820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:57:01 (7744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:55:34 (7296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:29:52 (7264): No heartbeat from core client for 30 sec - exiting 10:29:54 (7264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:33:33 (7524): No heartbeat from core client for 30 sec - exiting 19:33:34 (7524): No heartbeat from core client for 30 sec - exiting 19:33:35 (7524): No heartbeat from core client for 30 sec - exiting 19:33:36 (7524): No heartbeat from core client for 30 sec - exiting 19:33:37 (7524): No heartbeat from core client for 30 sec - exiting 19:33:38 (7524): No heartbeat from core client for 30 sec - exiting 19:33:39 (7524): No heartbeat from core client for 30 sec - exiting 19:33:40 (7524): No heartbeat from core client for 30 sec - exiting 19:33:41 (7524): No heartbeat from core client for 30 sec - exiting 19:33:43 (7524): No heartbeat from core client for 30 sec - exiting 19:33:44 (7524): No heartbeat from core client for 30 sec - exiting 19:33:45 (7524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:24:18 (2072): No heartbeat from core client for 30 sec - exiting 19:24:20 (2072): No heartbeat from core client for 30 sec - exiting 19:24:21 (2072): No heartbeat from core client for 30 sec - exiting 19:24:22 (2072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8236, iMonCtr=1 Model crash detected, will try to restart... 19:38:36 (8236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:20:54 (7912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:29:00 (7476): No heartbeat from core client for 30 sec - exiting 19:29:01 (7476): No heartbeat from core client for 30 sec - exiting 19:29:03 (7476): No heartbeat from core client for 30 sec - exiting 19:29:04 (7476): No heartbeat from core client for 30 sec - exiting 19:29:05 (7476): No heartbeat from core client for 30 sec - exiting 19:29:06 (7476): No heartbeat from core client for 30 sec - exiting 19:29:07 (7476): No heartbeat from core client for 30 sec - exiting 19:29:08 (7476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:46:47 (11928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:14:22 (6160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6452, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7760, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8460, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 22:32:19 (1496): No heartbeat from core client for 30 sec - exiting 22:32:21 (1496): No heartbeat from core client for 30 sec - exiting 22:32:22 (1496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:13:30 (8016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:42:21 (3464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:50:24 (5796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:57:47 (1792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:59:19 (8660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:00:53 (8708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:21:46 (8112):16:37:24 (7020): Can't set up shared mem: -1. Will run in standalone mode. CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=784, selfPID=784, iMonCtr=1 </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Oct 2011 16:41:09	1150866	13337661	hadcm3n_o5o9_1900_40_007440409_1	103,680	190,344	1.8359
10 Oct 2011 21:48:48	1150866	13337661	hadcm3n_o5o9_1900_40_007440409_1	77,760	143,112	1.8404
29 Sep 2011 15:37:02	1150866	13337661	hadcm3n_o5o9_1900_40_007440409_1	51,840	95,257	1.8375
17 Sep 2011 17:48:00	1150866	13337661	hadcm3n_o5o9_1900_40_007440409_1	25,920	47,953	1.8500