Task 15942316

Name	hadcm3n_o0q0_1980_40_008407478_2
Workunit	8558334
Created	28 Aug 2013, 18:33:08 UTC
Sent	28 Aug 2013, 18:33:29 UTC
Report deadline	28 Nov 2013, 2:00:40 UTC
Received	6 Oct 2013, 19:17:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	693979
Run time	28 days 12 hours 46 min 31 sec
CPU time	8 days 19 hours 3 min 8 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.02 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.5</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> 18:50:37 (5316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:50:38 (5316): No heartbeat from core client for 30 sec - exiting 20:29:08 (7420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:29:09 (7420): No heartbeat from core client for 30 sec - exiting 05:58:44 (428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:58:45 (428): No heartbeat from core client for 30 sec - exiting 07:30:46 (7440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:30:47 (7440): No heartbeat from core client for 30 sec - exiting 19:30:56 (7580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:30:58 (7580): No heartbeat from core client for 30 sec - exiting 19:30:59 (7580): No heartbeat from core client for 30 sec - exiting 20:31:03 (6580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:55:15 (6692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:55:16 (6692): No heartbeat from core client for 30 sec - exiting 01:10:14 (6408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:10:16 (6408): No heartbeat from core client for 30 sec - exiting 05:11:10 (6236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:11:11 (6236): No heartbeat from core client for 30 sec - exiting 05:11:12 (6236): No heartbeat from core client for 30 sec - exiting 09:12:34 (6844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:12:35 (6844): No heartbeat from core client for 30 sec - exiting 09:12:36 (6844): No heartbeat from core client for 30 sec - exiting 12:36:34 (5720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:36:35 (5720): No heartbeat from core client for 30 sec - exiting 17:44:48 (8068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:44:49 (8068): No heartbeat from core client for 30 sec - exiting 01:09:31 (860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:09:32 (860): No heartbeat from core client for 30 sec - exiting 01:09:33 (860): No heartbeat from core client for 30 sec - exiting 03:39:43 (5628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:39:44 (5628): No heartbeat from core client for 30 sec - exiting 10:38:57 (4300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:39:44 (5916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:39:45 (5916): No heartbeat from core client for 30 sec - exiting 18:39:46 (5916): No heartbeat from core client for 30 sec - exiting 21:11:09 (6348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:11:11 (6348): No heartbeat from core client for 30 sec - exiting 21:11:12 (6348): No heartbeat from core client for 30 sec - exiting 08:22:17 (588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:22:18 (588): No heartbeat from core client for 30 sec - exiting 22:11:22 (5012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:11:23 (5012): No heartbeat from core client for 30 sec - exiting 00:41:16 (4168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:41:17 (4168): No heartbeat from core client for 30 sec - exiting 03:11:15 (2040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:11:17 (2040): No heartbeat from core client for 30 sec - exiting 12:41:32 (2992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:41:34 (2992): No heartbeat from core client for 30 sec - exiting 12:41:35 (2992): No heartbeat from core client for 30 sec - exiting 15:29:13 (6964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:29:14 (6964): No heartbeat from core client for 30 sec - exiting 15:29:15 (6964): No heartbeat from core client for 30 sec - exiting 18:29:52 (5012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:29:54 (5012): No heartbeat from core client for 30 sec - exiting 18:49:38 (6272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:25:37 (432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:04:28 (4900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:04:30 (4900): No heartbeat from core client for 30 sec - exiting 22:06:05 (8148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:06:06 (8148): No heartbeat from core client for 30 sec - exiting 05:07:45 (3940): No heartbeat from core client for 30 sec - exiting 05:07:46 (3940): No heartbeat from core client for 30 sec - exiting 05:07:47 (3940): No heartbeat from core client for 30 sec - exiting 05:07:49 (3940): No heartbeat from core client for 30 sec - exiting 05:07:50 (3940): No heartbeat from core client for 30 sec - exiting 05:07:51 (3940): No heartbeat from core client for 30 sec - exiting 05:07:52 (3940): No heartbeat from core client for 30 sec - exiting 05:07:53 (3940): No heartbeat from core client for 30 sec - exiting 05:07:54 (3940): No heartbeat from core client for 30 sec - exiting 05:07:55 (3940): No heartbeat from core client for 30 sec - exiting 05:07:56 (3940): No heartbeat from core client for 30 sec - exiting 05:07:57 (3940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o0q0ko.pji3c10 Error converting file to netcdf: dataout/o0q0ko.pii3c10 Error converting file to netcdf: dataout/o0q0ko.pfi3c10 Error converting file to netcdf: dataout/o0q0ka.phi3c10 Error converting file to netcdf: dataout/o0q0ka.pgi3c10 Error converting file to netcdf: dataout/o0q0ka.pei3c10 Error converting file to netcdf: dataout/o0q0ka.pdi3c10 15:37:47 (3832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:37:48 (3832): No heartbeat from core client for 30 sec - exiting 15:37:50 (3832): No heartbeat from core client for 30 sec - exiting 15:37:51 (3832): No heartbeat from core client for 30 sec - exiting 05:07:57 (6844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:07:58 (6844): No heartbeat from core client for 30 sec - exiting 18:47:01 (7280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:47:02 (7280): No heartbeat from core client for 30 sec - exiting 08:19:38 (6724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:19:39 (6724): No heartbeat from core client for 30 sec - exiting 14:32:18 (5580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:57:16 (7832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:57:17 (7832): No heartbeat from core client for 30 sec - exiting 17:57:18 (7832): No heartbeat from core client for 30 sec - exiting 02:52:35 (7536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:52:36 (7536): No heartbeat from core client for 30 sec - exiting 02:52:37 (7536): No heartbeat from core client for 30 sec - exiting 20:08:19 (6248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:08:20 (6248): No heartbeat from core client for 30 sec - exiting 20:08:22 (6248): No heartbeat from core client for 30 sec - exiting 20:08:23 (6248): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 01:58:29 (7404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:58:30 (7404): No heartbeat from core client for 30 sec - exiting 14:46:36 (7836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:46:37 (7836): No heartbeat from core client for 30 sec - exiting 14:46:38 (7836): No heartbeat from core client for 30 sec - exiting 15:51:02 (1676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o0q0ko.pji5c10 Error converting file to netcdf: dataout/o0q0ko.pii5c10 Error converting file to netcdf: dataout/o0q0ko.pfi5c10 Error converting file to netcdf: dataout/o0q0ka.phi5c10 Error converting file to netcdf: dataout/o0q0ka.pgi5c10 Error converting file to netcdf: dataout/o0q0ka.pei5c10 Error converting file to netcdf: dataout/o0q0ka.pdi5c10 CPDN Monitor - Quit request from BOINC... 12:46:28 (6564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:46:30 (6564): No heartbeat from core client for 30 sec - exiting 12:46:31 (6564): No heartbeat from core client for 30 sec - exiting 09:06:26 (7356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:31:16 (6220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:44:46 (6852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:44:47 (6852): No heartbeat from core client for 30 sec - exiting 00:00:30 (6204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:00:58 (7296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:00:59 (7296): No heartbeat from core client for 30 sec - exiting 21:19:27 (6836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:19:28 (6836): No heartbeat from core client for 30 sec - exiting 21:19:29 (6836): No heartbeat from core client for 30 sec - exiting 16:38:19 (6368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:38:20 (6368): No heartbeat from core client for 30 sec - exiting 08:39:07 (5280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:39:08 (5280): No heartbeat from core client for 30 sec - exiting 22:39:41 (6360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:54:54 (7712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:15:59 (4724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:17:02 (3860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:17:03 (3860): No heartbeat from core client for 30 sec - exiting 10:17:04 (3860): No heartbeat from core client for 30 sec - exiting 10:17:05 (3860): No heartbeat from core client for 30 sec - exiting 11:57:23 (7860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:57:24 (7860): No heartbeat from core client for 30 sec - exiting 22:33:06 (496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:14:16 (4432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:14:18 (4432): No heartbeat from core client for 30 sec - exiting 01:14:19 (4432): No heartbeat from core client for 30 sec - exiting 01:14:20 (4432): No heartbeat from core client for 30 sec - exiting 17:21:55 (7364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:21:58 (7364): No heartbeat from core client for 30 sec - exiting 20:09:26 (8076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:09:28 (8076): No heartbeat from core client for 30 sec - exiting 20:09:29 (8076): No heartbeat from core client for 30 sec - exiting 06:38:54 (6056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:38:55 (6056): No heartbeat from core client for 30 sec - exiting 06:54:45 (5956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:54:47 (5956): No heartbeat from core client for 30 sec - exiting 09:12:21 (6792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:12:22 (6792): No heartbeat from core client for 30 sec - exiting 09:12:24 (6792): No heartbeat from core client for 30 sec - exiting 12:13:40 (7736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:13:42 (7736): No heartbeat from core client for 30 sec - exiting 12:13:43 (7736): No heartbeat from core client for 30 sec - exiting 16:31:17 (8112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:02:39 (7892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:02:40 (7892): No heartbeat from core client for 30 sec - exiting 08:38:04 (7184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:38:05 (7184): No heartbeat from core client for 30 sec - exiting 09:22:22 (6596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:20:13 (1240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:57:16 (3064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:57:17 (3064): No heartbeat from core client for 30 sec - exiting 02:17:57 (4324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:17:58 (4324): No heartbeat from core client for 30 sec - exiting 05:28:13 (6172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:28:15 (6172): No heartbeat from core client for 30 sec - exiting 23:06:47 (7944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:36:18 (7736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:06:26 (7916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:06:27 (7916): No heartbeat from core client for 30 sec - exiting 08:37:29 (7388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:37:31 (7388): No heartbeat from core client for 30 sec - exiting 08:37:32 (7388): No heartbeat from core client for 30 sec - exiting 12:51:44 (6992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:51:46 (6992): No heartbeat from core client for 30 sec - exiting 12:51:47 (6992): No heartbeat from core client for 30 sec - exiting 16:28:55 (8032): No heartbeat from core client for 30 sec - exiting 16:28:56 (8032): No heartbeat from core client for 30 sec - exiting 16:28:57 (8032): No heartbeat from core client for 30 sec - exiting 16:28:58 (8032): No heartbeat from core client for 30 sec - exiting 16:28:59 (8032): No heartbeat from core client for 30 sec - exiting 16:29:00 (8032): No heartbeat from core client for 30 sec - exiting 16:29:01 (8032): No heartbeat from core client for 30 sec - exiting 16:29:02 (8032): No heartbeat from core client for 30 sec - exiting 16:29:03 (8032): No heartbeat from core client for 30 sec - exiting 16:29:04 (8032): No heartbeat from core client for 30 sec - exiting 16:29:05 (8032): No heartbeat from core client for 30 sec - exiting 16:29:06 (8032): No heartbeat from core client for 30 sec - exiting 16:29:07 (8032): No heartbeat from core client for 30 sec - exiting 16:29:08 (8032): No heartbeat from core client for 30 sec - exiting 16:29:09 (8032): No heartbeat from core client for 30 sec - exiting 16:29:10 (8032): No heartbeat from core client for 30 sec - exiting 16:29:11 (8032): No heartbeat from core client for 30 sec - exiting 16:29:12 (8032): No heartbeat from core client for 30 sec - exiting 16:29:13 (8032): No heartbeat from core client for 30 sec - exiting 16:29:14 (8032): No heartbeat from core client for 30 sec - exiting 16:29:15 (8032): No heartbeat from core client for 30 sec - exiting 16:29:16 (8032): No heartbeat from core client for 30 sec - exiting 16:29:17 (8032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o0q0ko.pji9c10 Error converting file to netcdf: dataout/o0q0ko.pii9c10 Error converting file to netcdf: dataout/o0q0ko.pfi9c10 Error converting file to netcdf: dataout/o0q0ka.phi9c10 Error converting file to netcdf: dataout/o0q0ka.pgi9c10 Error converting file to netcdf: dataout/o0q0ka.pei9c10 Error converting file to netcdf: dataout/o0q0ka.pdi9c10 16:37:39 (6968): No heartbeat from core client for 30 sec - exiting 16:37:40 (6968): No heartbeat from core client for 30 sec - exiting 16:37:41 (6968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o0q0ko.pji9c10 Error converting file to netcdf: dataout/o0q0ko.pii9c10 Error converting file to netcdf: dataout/o0q0ko.pfi9c10 Error converting file to netcdf: dataout/o0q0ka.phi9c10 Error converting file to netcdf: dataout/o0q0ka.pgi9c10 Error converting file to netcdf: dataout/o0q0ka.pei9c10 Error converting file to netcdf: dataout/o0q0ka.pdi9c10 18:34:32 (7744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:34:33 (7744): No heartbeat from core client for 30 sec - exiting 20:07:34 (7776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:07:35 (7776): No heartbeat from core client for 30 sec - exiting 20:07:36 (7776): No heartbeat from core client for 30 sec - exiting 20:13:24 (4744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:13:25 (4744): No heartbeat from core client for 30 sec - exiting 21:38:51 (6056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:38:52 (6056): No heartbeat from core client for 30 sec - exiting 21:43:13 (4504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:23:52 (1748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:23:53 (1748): No heartbeat from core client for 30 sec - exiting 05:44:01 (7584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:44:02 (7584): No heartbeat from core client for 30 sec - exiting 05:44:03 (7584): No heartbeat from core client for 30 sec - exiting 05:44:04 (7584): No heartbeat from core client for 30 sec - exiting 14:57:13 (6992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:46:37 (6392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:46:39 (6392): No heartbeat from core client for 30 sec - exiting 16:48:02 (5372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:48:04 (5372): No heartbeat from core client for 30 sec - exiting 16:48:05 (5372): No heartbeat from core client for 30 sec - exiting 18:49:17 (6952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:44:14 (7864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:44:15 (7864): No heartbeat from core client for 30 sec - exiting 23:48:22 (4792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:48:24 (4792): No heartbeat from core client for 30 sec - exiting 02:48:25 (5372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:48:27 (5372): No heartbeat from core client for 30 sec - exiting 03:49:28 (5304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:49:30 (5304): No heartbeat from core client for 30 sec - exiting 03:49:32 (5304): No heartbeat from core client for 30 sec - exiting 08:29:06 (292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:29:07 (292): No heartbeat from core client for 30 sec - exiting 08:29:08 (292): No heartbeat from core client for 30 sec - exiting 15:43:45 (6856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:43:46 (6856): No heartbeat from core client for 30 sec - exiting 03:58:22 (7508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:01:59 (3192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:09:49 (7268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Oct 2013 19:17:51	693979	15942316	hadcm3n_o0q0_1980_40_008407478_2	259,200	759,784	2.9313
02 Oct 2013 20:40:17	693979	15942316	hadcm3n_o0q0_1980_40_008407478_2	233,280	683,269	2.9290
29 Sep 2013 18:53:54	693979	15942316	hadcm3n_o0q0_1980_40_008407478_2	207,360	607,380	2.9291
27 Sep 2013 00:49:44	693979	15942316	hadcm3n_o0q0_1980_40_008407478_2	181,440	531,557	2.9297
23 Sep 2013 23:09:07	693979	15942316	hadcm3n_o0q0_1980_40_008407478_2	155,520	454,598	2.9231
11 Sep 2013 19:54:20	693979	15942316	hadcm3n_o0q0_1980_40_008407478_2	129,600	378,225	2.9184
09 Sep 2013 04:17:02	693979	15942316	hadcm3n_o0q0_1980_40_008407478_2	103,680	302,448	2.9171
06 Sep 2013 09:17:17	693979	15942316	hadcm3n_o0q0_1980_40_008407478_2	77,760	226,548	2.9134
03 Sep 2013 21:36:35	693979	15942316	hadcm3n_o0q0_1980_40_008407478_2	51,840	150,565	2.9044
31 Aug 2013 20:55:20	693979	15942316	hadcm3n_o0q0_1980_40_008407478_2	25,920	75,398	2.9089