Task 15914803

Name	hadcm3n_4i84_1940_40_008312201_2
Workunit	8463336
Created	14 Aug 2013, 11:39:23 UTC
Sent	15 Aug 2013, 4:25:14 UTC
Report deadline	14 Nov 2013, 11:52:25 UTC
Received	24 Aug 2013, 11:58:56 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1226353
Run time	4 days 17 hours 34 min 4 sec
CPU time	1 days 9 hours 36 min 3 sec
Validate state	Invalid
Credit	311.04
Device peak FLOPS	1.84 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> 22:56:36 (9016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:56:37 (9016): No heartbeat from core client for 30 sec - exiting 22:56:38 (9016): No heartbeat from core client for 30 sec - exiting 02:46:23 (8532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:46:24 (8532): No heartbeat from core client for 30 sec - exiting 02:46:25 (8532): No heartbeat from core client for 30 sec - exiting 02:51:57 (8516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:22:27 (9604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:57:13 (4116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:57:14 (4116): No heartbeat from core client for 30 sec - exiting 12:57:15 (4116): No heartbeat from core client for 30 sec - exiting 13:52:01 (8136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:52:09 (8136): No heartbeat from core client for 30 sec - exiting 13:52:10 (8136): No heartbeat from core client for 30 sec - exiting 13:52:11 (8136): No heartbeat from core client for 30 sec - exiting 13:52:12 (8136): No heartbeat from core client for 30 sec - exiting 13:52:13 (8136): No heartbeat from core client for 30 sec - exiting 14:55:01 (6420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:55:02 (6420): No heartbeat from core client for 30 sec - exiting 16:16:25 (9872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:16:27 (9872): No heartbeat from core client for 30 sec - exiting 16:46:22 (3924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:46:26 (3924): No heartbeat from core client for 30 sec - exiting 16:52:25 (10080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:52:28 (10080): No heartbeat from core client for 30 sec - exiting 16:52:29 (10080): No heartbeat from core client for 30 sec - exiting 16:52:30 (10080): No heartbeat from core client for 30 sec - exiting 17:04:30 (6364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:48:39 (7876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:48:40 (7876): No heartbeat from core client for 30 sec - exiting 18:48:41 (7876): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8500, iMonCtr=1 Model crash detected, will try to restart... 00:20:30 (6620): No heartbeat from core client for 30 sec - exiting 00:20:32 (6620): No heartbeat from core client for 30 sec - exiting 00:20:33 (6620): No heartbeat from core client for 30 sec - exiting 00:20:34 (6620): No heartbeat from core client for 30 sec - exiting 00:20:36 (6620): No heartbeat from core client for 30 sec - exiting 00:20:37 (6620): No heartbeat from core client for 30 sec - exiting 00:20:38 (6620): No heartbeat from core client for 30 sec - exiting 00:20:40 (6620): No heartbeat from core client for 30 sec - exiting 00:20:41 (6620): No heartbeat from core client for 30 sec - exiting 00:20:42 (6620): No heartbeat from core client for 30 sec - exiting 00:20:43 (6620): No heartbeat from core client for 30 sec - exiting 00:20:45 (6620): No heartbeat from core client for 30 sec - exiting 00:20:46 (6620): No heartbeat from core client for 30 sec - exiting 00:20:48 (6620): No heartbeat from core client for 30 sec - exiting 00:20:51 (6620): No heartbeat from core client for 30 sec - exiting 00:20:52 (6620): No heartbeat from core client for 30 sec - exiting 00:20:53 (6620): No heartbeat from core client for 30 sec - exiting 00:20:54 (6620): No heartbeat from core client for 30 sec - exiting 00:20:55 (6620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:20:56 (6620): No heartbeat from core client for 30 sec - exiting 00:22:16 (8040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:15:33 (7532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:43:17 (12956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:05:54 (13192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:05:55 (13192): No heartbeat from core client for 30 sec - exiting 04:05:56 (13192): No heartbeat from core client for 30 sec - exiting 04:11:58 (12636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:11:59 (12636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:00:47 (14720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:00:54 (14720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:45:33 (13600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:00:24 (12208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:00:25 (12208): No heartbeat from core client for 30 sec - exiting 08:00:26 (12208): No heartbeat from core client for 30 sec - exiting 18:03:02 (2364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:08:33 (1068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:35:30 (7368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:35:31 (7368): No heartbeat from core client for 30 sec - exiting 03:14:47 (7228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:14:48 (7228): No heartbeat from core client for 30 sec - exiting 03:20:58 (2464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:27:11 (7708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:39:00 (6692): No heartbeat from core client for 30 sec - exiting 03:39:01 (6692): No heartbeat from core client for 30 sec - exiting 03:39:02 (6692): No heartbeat from core client for 30 sec - exiting 03:39:03 (6692): No heartbeat from core client for 30 sec - exiting 03:39:04 (6692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:51:01 (7996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:52:06 (6864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:52:07 (6864): No heartbeat from core client for 30 sec - exiting 03:52:08 (6864): No heartbeat from core client for 30 sec - exiting 03:52:09 (6864): No heartbeat from core client for 30 sec - exiting 03:52:10 (6864): No heartbeat from core client for 30 sec - exiting 03:52:11 (6864): No heartbeat from core client for 30 sec - exiting 04:02:29 (7676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:26:21 (584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:32:23 (5584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:32:24 (5584): No heartbeat from core client for 30 sec - exiting 05:02:09 (1916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:02:10 (1916): No heartbeat from core client for 30 sec - exiting 05:33:44 (7760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:33:45 (7760): No heartbeat from core client for 30 sec - exiting 05:43:10 (1268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:43:11 (1268): No heartbeat from core client for 30 sec - exiting 06:18:48 (7700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:05:10 (6080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:05:11 (6080): No heartbeat from core client for 30 sec - exiting 07:11:59 (7712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:29:26 (7560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:42:56 (2724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:46:47 (7468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:58:27 (6984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:05:09 (6876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:05:10 (6876): No heartbeat from core client for 30 sec - exiting 08:11:28 (7880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:12:32 (6168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:12:33 (6168): No heartbeat from core client for 30 sec - exiting 08:17:40 (6708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:23:43 (1828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:35:43 (368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:48:24 (5128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:54:49 (7184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:55:50 (7776): No heartbeat from core client for 30 sec - exiting 08:55:51 (7776): No heartbeat from core client for 30 sec - exiting 08:55:52 (7776): No heartbeat from core client for 30 sec - exiting 08:55:53 (7776): No heartbeat from core client for 30 sec - exiting 08:55:54 (7776): No heartbeat from core client for 30 sec - exiting 08:55:55 (7776): No heartbeat from core client for 30 sec - exiting 08:55:56 (7776): No heartbeat from core client for 30 sec - exiting 08:55:57 (7776): No heartbeat from core client for 30 sec - exiting 08:55:58 (7776): No heartbeat from core client for 30 sec - exiting 08:55:59 (7776): No heartbeat from core client for 30 sec - exiting 08:56:00 (7776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:03:29 (2312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:12:22 (1700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:18:26 (6672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:41:56 (464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:41:57 (464): No heartbeat from core client for 30 sec - exiting 09:41:58 (464): No heartbeat from core client for 30 sec - exiting 09:41:59 (464): No heartbeat from core client for 30 sec - exiting 10:11:33 (7828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:11:35 (7828): No heartbeat from core client for 30 sec - exiting 11:33:01 (8056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:33:02 (8056): No heartbeat from core client for 30 sec - exiting 18:16:40 (7916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:16:41 (7916): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8380, iMonCtr=1 Model crash detected, will try to restart... 02:53:52 (5588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:54:54 (7228): No heartbeat from core client for 30 sec - exiting 02:54:55 (7228): No heartbeat from core client for 30 sec - exiting 02:54:56 (7228): No heartbeat from core client for 30 sec - exiting 02:54:57 (7228): No heartbeat from core client for 30 sec - exiting 02:54:59 (7228): No heartbeat from core client for 30 sec - exiting 02:55:00 (7228): No heartbeat from core client for 30 sec - exiting 02:55:01 (7228): No heartbeat from core client for 30 sec - exiting 02:55:02 (7228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:56:03 (300): No heartbeat from core client for 30 sec - exiting 02:56:04 (300): No heartbeat from core client for 30 sec - exiting 02:56:06 (300): No heartbeat from core client for 30 sec - exiting 02:56:07 (300): No heartbeat from core client for 30 sec - exiting 02:56:08 (300): No heartbeat from core client for 30 sec - exiting 02:56:09 (300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:57:52 (7900): No heartbeat from core client for 30 sec - exiting 02:57:54 (7900): No heartbeat from core client for 30 sec - exiting 02:57:55 (7900): No heartbeat from core client for 30 sec - exiting 02:57:56 (7900): No heartbeat from core client for 30 sec - exiting 02:57:57 (7900): No heartbeat from core client for 30 sec - exiting 02:57:58 (7900): No heartbeat from core client for 30 sec - exiting 02:57:59 (7900): No heartbeat from core client for 30 sec - exiting 02:58:00 (7900): No heartbeat from core client for 30 sec - exiting 02:58:01 (7900): No heartbeat from core client for 30 sec - exiting 02:58:02 (7900): No heartbeat from core client for 30 sec - exiting 02:58:03 (7900): No heartbeat from core client for 30 sec - exiting 02:58:04 (7900): No heartbeat from core client for 30 sec - exiting 02:58:05 (7900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:59:12 (7760): No heartbeat from core client for 30 sec - exiting 02:59:14 (7760): No heartbeat from core client for 30 sec - exiting 02:59:15 (7760): No heartbeat from core client for 30 sec - exiting 02:59:16 (7760): No heartbeat from core client for 30 sec - exiting 02:59:17 (7760): No heartbeat from core client for 30 sec - exiting 02:59:18 (7760): No heartbeat from core client for 30 sec - exiting 02:59:19 (7760): No heartbeat from core client for 30 sec - exiting 02:59:20 (7760): No heartbeat from core client for 30 sec - exiting 02:59:21 (7760): No heartbeat from core client for 30 sec - exiting 02:59:22 (7760): No heartbeat from core client for 30 sec - exiting 02:59:23 (7760): No heartbeat from core client for 30 sec - exiting 02:59:24 (7760): No heartbeat from core client for 30 sec - exiting 02:59:25 (7760): No heartbeat from core client for 30 sec - exiting 02:59:26 (7760): No heartbeat from core client for 30 sec - exiting 02:59:27 (7760): No heartbeat from core client for 30 sec - exiting 02:59:28 (7760): No heartbeat from core client for 30 sec - exiting 02:59:29 (7760): No heartbeat from core client for 30 sec - exiting 02:59:30 (7760): No heartbeat from core client for 30 sec - exiting 02:59:31 (7760): No heartbeat from core client for 30 sec - exiting 02:59:32 (7760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:59:33 (7760): No heartbeat from core client for 30 sec - exiting 03:33:00 (5376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:33:03 (5376): No heartbeat from core client for 30 sec - exiting 03:33:04 (5376): No heartbeat from core client for 30 sec - exiting 03:36:43 (9172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:36:44 (9172): No heartbeat from core client for 30 sec - exiting 03:59:12 (6672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:05:01 (6996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:39:27 (6672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:39:28 (6672): No heartbeat from core client for 30 sec - exiting 04:51:03 (1220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:55:01 (6132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:57:03 (1888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:02:53 (3108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:02:54 (3108): No heartbeat from core client for 30 sec - exiting 05:02:55 (3108): No heartbeat from core client for 30 sec - exiting 05:14:59 (180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:20:52 (7056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:25:51 (1772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:43:54 (4636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:50:03 (4536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:50:04 (4536): No heartbeat from core client for 30 sec - exiting 06:27:27 (4596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:27:28 (4596): No heartbeat from core client for 30 sec - exiting 06:41:46 (916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:10:14 (8252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:10:15 (8252): No heartbeat from core client for 30 sec - exiting 07:21:59 (2932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:27:50 (8052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:27:51 (8052): No heartbeat from core client for 30 sec - exiting 07:50:43 (8308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:13:31 (8124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:13:32 (8124): No heartbeat from core client for 30 sec - exiting 08:13:33 (8124): No heartbeat from core client for 30 sec - exiting 08:25:06 (6792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:25:07 (6792): No heartbeat from core client for 30 sec - exiting 08:30:57 (8732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:36:47 (7824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:42:33 (6196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:17:38 (6400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:17:40 (6400): No heartbeat from core client for 30 sec - exiting 09:23:30 (7472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:40:14 (6308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:45:57 (5156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:00:24 (4480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:16:35 (5084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:20:31 (4468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:55:18 (6984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:55:19 (6984): No heartbeat from core client for 30 sec - exiting 11:12:20 (1196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:12:28 (2964): Can't acquire lockfile (32) - waiting 35s 11:29:52 (2964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:29:53 (2964): No heartbeat from core client for 30 sec - exiting 11:29:54 (2964): No heartbeat from core client for 30 sec - exiting 11:29:55 (2964): No heartbeat from core client for 30 sec - exiting 11:29:56 (2964): No heartbeat from core client for 30 sec - exiting 11:47:12 (7364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:53:02 (4428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:04:36 (5344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:16:16 (3968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:22:13 (5184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:34:12 (3252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:34:13 (3252): No heartbeat from core client for 30 sec - exiting 12:34:14 (3252): No heartbeat from core client for 30 sec - exiting 12:40:01 (7364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:55:20 (7380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:14:28 (2796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:46:14 (8812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:46:15 (8812): No heartbeat from core client for 30 sec - exiting 15:14:53 (8108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:14:54 (8108): No heartbeat from core client for 30 sec - exiting 15:38:29 (7956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:44:30 (3172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:50:27 (8372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:57:02 (6212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:57:04 (6212): No heartbeat from core client for 30 sec - exiting 16:57:05 (6212): No heartbeat from core client for 30 sec - exiting 16:57:06 (6212): No heartbeat from core client for 30 sec - exiting 16:57:07 (6212): No heartbeat from core client for 30 sec - exiting 16:57:08 (6212): No heartbeat from core client for 30 sec - exiting 16:57:09 (6212): No heartbeat from core client for 30 sec - exiting 17:03:09 (4944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:03:10 (4944): No heartbeat from core client for 30 sec - exiting 17:06:35 (3904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:14:27 (3792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:26:13 (11748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:26:14 (11748): No heartbeat from core client for 30 sec - exiting 17:32:11 (7708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:37:56 (12180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:43:43 (632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:55:19 (3288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:01:14 (12208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:35:19 (7308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:35:20 (7308): No heartbeat from core client for 30 sec - exiting 18:35:21 (7308): No heartbeat from core client for 30 sec - exiting 18:35:22 (7308): No heartbeat from core client for 30 sec - exiting 18:52:31 (1028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:58:21 (11696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:09:53 (8276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:15:41 (7708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:15:43 (7708): No heartbeat from core client for 30 sec - exiting 19:15:44 (7708): No heartbeat from core client for 30 sec - exiting 19:27:25 (12108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:27:26 (12108): No heartbeat from core client for 30 sec - exiting 19:55:56 (12096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:55:58 (12096): No heartbeat from core client for 30 sec - exiting 19:55:59 (12096): No heartbeat from core client for 30 sec - exiting 20:13:16 (8756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:24:50 (5840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:24:51 (5840): No heartbeat from core client for 30 sec - exiting 20:24:52 (5840): No heartbeat from core client for 30 sec - exiting 20:36:26 (3172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:47:54 (208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:47:55 (208): No heartbeat from core client for 30 sec - exiting 20:47:56 (208): No heartbeat from core client for 30 sec - exiting 20:47:57 (208): No heartbeat from core client for 30 sec - exiting 20:48:46 (6540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:48:47 (6540): No heartbeat from core client for 30 sec - exiting 20:48:48 (6540): No heartbeat from core client for 30 sec - exiting 20:59:32 (8536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:05:23 (8140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:12:56 (11960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:17:02 (2964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:22:16 (13160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:28:31 (12040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:28:32 (12040): No heartbeat from core client for 30 sec - exiting 21:28:33 (12040): No heartbeat from core client for 30 sec - exiting 21:28:34 (12040): No heartbeat from core client for 30 sec - exiting 21:28:35 (12040): No heartbeat from core client for 30 sec - exiting 22:14:18 (7284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:31:26 (9152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:31:27 (9152): No heartbeat from core client for 30 sec - exiting 22:35:48 (6672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:56:20 (12128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:56:21 (12128): No heartbeat from core client for 30 sec - exiting 22:59:59 (560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:05:43 (12424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:05:44 (12424): No heartbeat from core client for 30 sec - exiting 23:05:45 (12424): No heartbeat from core client for 30 sec - exiting 23:17:20 (8208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:17:21 (8208): No heartbeat from core client for 30 sec - exiting 23:23:14 (8044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:29:02 (11700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:29:03 (11700): No heartbeat from core client for 30 sec - exiting 23:29:04 (11700): No heartbeat from core client for 30 sec - exiting 23:34:53 (2404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:34:54 (2404): No heartbeat from core client for 30 sec - exiting 23:34:55 (2404): No heartbeat from core client for 30 sec - exiting 23:40:44 (208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:07:40 (7252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:07:42 (7252): No heartbeat from core client for 30 sec - exiting 00:07:43 (7252): No heartbeat from core client for 30 sec - exiting 00:07:44 (7252): No heartbeat from core client for 30 sec - exiting 00:07:45 (7252): No heartbeat from core client for 30 sec - exiting 00:07:46 (7252): No heartbeat from core client for 30 sec - exiting 00:09:08 (13140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:15:10 (12824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:15:11 (12824): No heartbeat from core client for 30 sec - exiting 00:15:12 (12824): No heartbeat from core client for 30 sec - exiting 00:21:00 (13264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:25:18 (1844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:27:40 (11716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:32:37 (13164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:49:56 (11932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:55:48 (8092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:58:27 (1772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:01:50 (7420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:24:52 (8224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:29:31 (3188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:33:42 (12672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:39:38 (6496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:45:27 (8168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:47:14 (7484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:51:30 (10264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:57:19 (8928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:03:19 (8912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:03:20 (8912): No heartbeat from core client for 30 sec - exiting 02:15:01 (11204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:20:55 (1080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:21:48 (12976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:21:49 (12976): No heartbeat from core client for 30 sec - exiting 02:26:44 (11756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:32:38 (8276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:32:39 (8276): No heartbeat from core client for 30 sec - exiting 02:32:40 (8276): No heartbeat from core client for 30 sec - exiting 02:38:34 (8928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Aug 2013 02:43:30	1226353	15914803	hadcm3n_4i84_1940_40_008312201_2	25,920	62,540	2.4128