Task 15621952

Name	hadcm3n_zf2g_1880_40_008252058_2
Workunit	8407182
Created	22 Feb 2013, 18:36:09 UTC
Sent	22 Feb 2013, 18:36:38 UTC
Report deadline	25 May 2013, 2:03:49 UTC
Received	11 Mar 2013, 22:26:17 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	940519
Run time	14 days 6 hours 9 min 7 sec
CPU time	13 days 0 hours 45 min 37 sec
Validate state	Invalid
Credit	10,886.40
Device peak FLOPS	3.28 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> 03:24:48 (5859): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:25:06 (5859): No heartbeat from core client for 30 sec - exiting 03:27:36 (11579): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:28:57 (11603): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:35:18 (11613): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:57:11 (11654): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:57:12 (11654): No heartbeat from core client for 30 sec - exiting 18:57:13 (11654): No heartbeat from core client for 30 sec - exiting 18:57:14 (11654): No heartbeat from core client for 30 sec - exiting 18:57:15 (11654): No heartbeat from core client for 30 sec - exiting 18:57:16 (11654): No heartbeat from core client for 30 sec - exiting 18:57:17 (11654): No heartbeat from core client for 30 sec - exiting 18:57:18 (11654): No heartbeat from core client for 30 sec - exiting 18:57:19 (11654): No heartbeat from core client for 30 sec - exiting 18:57:20 (11654): No heartbeat from core client for 30 sec - exiting 18:57:21 (11654): No heartbeat from core client for 30 sec - exiting 18:57:22 (11654): No heartbeat from core client for 30 sec - exiting 18:57:23 (11654): No heartbeat from core client for 30 sec - exiting 18:57:24 (11654): No heartbeat from core client for 30 sec - exiting 18:57:25 (11654): No heartbeat from core client for 30 sec - exiting 18:57:26 (11654): No heartbeat from core client for 30 sec - exiting 18:57:27 (11654): No heartbeat from core client for 30 sec - exiting 18:57:28 (11654): No heartbeat from core client for 30 sec - exiting 18:57:29 (11654): No heartbeat from core client for 30 sec - exiting 18:57:30 (11654): No heartbeat from core client for 30 sec - exiting 18:57:31 (11654): No heartbeat from core client for 30 sec - exiting 18:57:32 (11654): No heartbeat from core client for 30 sec - exiting 18:57:33 (11654): No heartbeat from core client for 30 sec - exiting 18:57:34 (11654): No heartbeat from core client for 30 sec - exiting 18:57:35 (11654): No heartbeat from core client for 30 sec - exiting 18:57:36 (11654): No heartbeat from core client for 30 sec - exiting 18:57:37 (11654): No heartbeat from core client for 30 sec - exiting 18:57:38 (11654): No heartbeat from core client for 30 sec - exiting 18:57:39 (11654): No heartbeat from core client for 30 sec - exiting 18:57:40 (11654): No heartbeat from core client for 30 sec - exiting 18:57:41 (11654): No heartbeat from core client for 30 sec - exiting 18:57:42 (11654): No heartbeat from core client for 30 sec - exiting 18:57:43 (11654): No heartbeat from core client for 30 sec - exiting 18:57:44 (11654): No heartbeat from core client for 30 sec - exiting 18:57:45 (11654): No heartbeat from core client for 30 sec - exiting 18:57:46 (11654): No heartbeat from core client for 30 sec - exiting 18:57:47 (11654): No heartbeat from core client for 30 sec - exiting 18:57:48 (11654): No heartbeat from core client for 30 sec - exiting 18:57:49 (11654): No heartbeat from core client for 30 sec - exiting 18:57:50 (11654): No heartbeat from core client for 30 sec - exiting 18:57:51 (11654): No heartbeat from core client for 30 sec - exiting 18:57:52 (11654): No heartbeat from core client for 30 sec - exiting 18:57:53 (11654): No heartbeat from core client for 30 sec - exiting 18:57:54 (11654): No heartbeat from core client for 30 sec - exiting 18:57:55 (11654): No heartbeat from core client for 30 sec - exiting 18:57:56 (11654): No heartbeat from core client for 30 sec - exiting 18:57:57 (11654): No heartbeat from core client for 30 sec - exiting 18:57:58 (11654): No heartbeat from core client for 30 sec - exiting 18:57:59 (11654): No heartbeat from core client for 30 sec - exiting 18:58:00 (11654): No heartbeat from core client for 30 sec - exiting 18:58:01 (11654): No heartbeat from core client for 30 sec - exiting 18:58:02 (11654): No heartbeat from core client for 30 sec - exiting 18:58:37 (11654): No heartbeat from core client for 30 sec - exiting 18:58:38 (11654): No heartbeat from core client for 30 sec - exiting 18:58:39 (11654): No heartbeat from core client for 30 sec - exiting 19:24:35 (199): No heartbeat from core client for 30 sec - exiting 19:24:55 (199): No heartbeat from core client for 30 sec - exiting 19:24:56 (199): No heartbeat from core client for 30 sec - exiting 19:24:57 (199): No heartbeat from core client for 30 sec - exiting 19:24:58 (199): No heartbeat from core client for 30 sec - exiting 19:24:59 (199): No heartbeat from core client for 30 sec - exiting 19:25:00 (199): No heartbeat from core client for 30 sec - exiting 19:25:01 (199): No heartbeat from core client for 30 sec - exiting 19:25:02 (199): No heartbeat from core client for 30 sec - exiting 19:25:03 (199): No heartbeat from core client for 30 sec - exiting 19:25:04 (199): No heartbeat from core client for 30 sec - exiting 19:25:05 (199): No heartbeat from core client for 30 sec - exiting 19:25:06 (199): No heartbeat from core client for 30 sec - exiting 19:25:07 (199): No heartbeat from core client for 30 sec - exiting 19:25:08 (199): No heartbeat from core client for 30 sec - exiting 19:25:09 (199): No heartbeat from core client for 30 sec - exiting 19:25:10 (199): No heartbeat from core client for 30 sec - exiting 19:25:11 (199): No heartbeat from core client for 30 sec - exiting 19:25:12 (199): No heartbeat from core client for 30 sec - exiting 19:25:13 (199): No heartbeat from core client for 30 sec - exiting 19:25:14 (199): No heartbeat from core client for 30 sec - exiting 19:25:15 (199): No heartbeat from core client for 30 sec - exiting 19:25:16 (199): No heartbeat from core client for 30 sec - exiting 19:25:17 (199): No heartbeat from core client for 30 sec - exiting 19:25:18 (199): No heartbeat from core client for 30 sec - exiting 19:25:19 (199): No heartbeat from core client for 30 sec - exiting 19:25:20 (199): No heartbeat from core client for 30 sec - exiting 19:25:21 (199): No heartbeat from core client for 30 sec - exiting 19:25:22 (199): No heartbeat from core client for 30 sec - exiting 19:25:23 (199): No heartbeat from core client for 30 sec - exiting 19:25:30 (199): No heartbeat from core client for 30 sec - exiting 19:25:31 (199): No heartbeat from core client for 30 sec - exiting 19:25:32 (199): No heartbeat from core client for 30 sec - exiting 19:25:33 (199): No heartbeat from core client for 30 sec - exiting 19:25:34 (199): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... cpdnmonitor: error reading file dataout/atmos_restart.hold 20:29:58 (261): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... cpdnmonitor: error reading file dataout/atmos_restart.hold cpdnmonitor: error reading file dataout/ocean_restart.day Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:11:59 (884): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:19:51 (84844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:21:42 (96710): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:23:46 (96724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:25:56 (96744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:31:42 (96761): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:45:12 (96809): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:45:13 (96809): No heartbeat from core client for 30 sec - exiting 17:45:14 (96809): No heartbeat from core client for 30 sec - exiting 17:56:55 (8883): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:25:32 (8943): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:15:51 (9164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:15:52 (9164): No heartbeat from core client for 30 sec - exiting 01:15:53 (9164): No heartbeat from core client for 30 sec - exiting 01:15:54 (9164): No heartbeat from core client for 30 sec - exiting 01:15:55 (9164): No heartbeat from core client for 30 sec - exiting 01:15:56 (9164): No heartbeat from core client for 30 sec - exiting 01:15:57 (9164): No heartbeat from core client for 30 sec - exiting 01:15:58 (9164): No heartbeat from core client for 30 sec - exiting 01:15:59 (9164): No heartbeat from core client for 30 sec - exiting 01:16:00 (9164): No heartbeat from core client for 30 sec - exiting 01:16:01 (9164): No heartbeat from core client for 30 sec - exiting 01:16:02 (9164): No heartbeat from core client for 30 sec - exiting 01:16:03 (9164): No heartbeat from core client for 30 sec - exiting 01:16:04 (9164): No heartbeat from core client for 30 sec - exiting 01:16:05 (9164): No heartbeat from core client for 30 sec - exiting 01:16:06 (9164): No heartbeat from core client for 30 sec - exiting 01:16:07 (9164): No heartbeat from core client for 30 sec - exiting 01:16:08 (9164): No heartbeat from core client for 30 sec - exiting 01:16:09 (9164): No heartbeat from core client for 30 sec - exiting 01:16:10 (9164): No heartbeat from core client for 30 sec - exiting 01:16:11 (9164): No heartbeat from core client for 30 sec - exiting 01:16:12 (9164): No heartbeat from core client for 30 sec - exiting 01:16:13 (9164): No heartbeat from core client for 30 sec - exiting 01:16:14 (9164): No heartbeat from core client for 30 sec - exiting 01:16:15 (9164): No heartbeat from core client for 30 sec - exiting 01:16:16 (9164): No heartbeat from core client for 30 sec - exiting 01:16:17 (9164): No heartbeat from core client for 30 sec - exiting 01:16:18 (9164): No heartbeat from core client for 30 sec - exiting 01:16:19 (9164): No heartbeat from core client for 30 sec - exiting 01:16:20 (9164): No heartbeat from core client for 30 sec - exiting 01:16:21 (9164): No heartbeat from core client for 30 sec - exiting 01:16:22 (9164): No heartbeat from core client for 30 sec - exiting 01:20:52 (14020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:21:02 (14020): No heartbeat from core client for 30 sec - exiting 01:23:23 (14052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:24:24 (14069): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:24:57 (14079): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:25:44 (14085): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:26:33 (14094): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:14:27 (14102): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:49:26 (14472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:54:32 (39461): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:01:37 (39488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:06:08 (39488): No heartbeat from core client for 30 sec - exiting 17:06:09 (39488): No heartbeat from core client for 30 sec - exiting 17:06:40 (39488): No heartbeat from core client for 30 sec - exiting 17:06:41 (39488): No heartbeat from core client for 30 sec - exiting 17:10:53 (39488): No heartbeat from core client for 30 sec - exiting 17:10:54 (39488): No heartbeat from core client for 30 sec - exiting 17:10:55 (39488): No heartbeat from core client for 30 sec - exiting 17:10:56 (39488): No heartbeat from core client for 30 sec - exiting 17:10:57 (39488): No heartbeat from core client for 30 sec - exiting 17:10:58 (39488): No heartbeat from core client for 30 sec - exiting 17:10:59 (39488): No heartbeat from core client for 30 sec - exiting 17:11:00 (39488): No heartbeat from core client for 30 sec - exiting 17:11:01 (39488): No heartbeat from core client for 30 sec - exiting 17:11:02 (39488): No heartbeat from core client for 30 sec - exiting 17:11:03 (39488): No heartbeat from core client for 30 sec - exiting 17:11:04 (39488): No heartbeat from core client for 30 sec - exiting 17:11:05 (39488): No heartbeat from core client for 30 sec - exiting 17:11:06 (39488): No heartbeat from core client for 30 sec - exiting 17:11:07 (39488): No heartbeat from core client for 30 sec - exiting 17:11:08 (39488): No heartbeat from core client for 30 sec - exiting 17:11:09 (39488): No heartbeat from core client for 30 sec - exiting 17:11:10 (39488): No heartbeat from core client for 30 sec - exiting 17:11:11 (39488): No heartbeat from core client for 30 sec - exiting 17:11:12 (39488): No heartbeat from core client for 30 sec - exiting 17:11:13 (39488): No heartbeat from core client for 30 sec - exiting 17:11:14 (39488): No heartbeat from core client for 30 sec - exiting 17:11:15 (39488): No heartbeat from core client for 30 sec - exiting 17:11:16 (39488): No heartbeat from core client for 30 sec - exiting 17:11:17 (39488): No heartbeat from core client for 30 sec - exiting 17:11:18 (39488): No heartbeat from core client for 30 sec - exiting 17:11:19 (39488): No heartbeat from core client for 30 sec - exiting 17:11:20 (39488): No heartbeat from core client for 30 sec - exiting 17:11:21 (39488): No heartbeat from core client for 30 sec - exiting 17:11:22 (39488): No heartbeat from core client for 30 sec - exiting 17:11:23 (39488): No heartbeat from core client for 30 sec - exiting 17:11:24 (39488): No heartbeat from core client for 30 sec - exiting 17:11:25 (39488): No heartbeat from core client for 30 sec - exiting 17:11:26 (39488): No heartbeat from core client for 30 sec - exiting 17:11:27 (39488): No heartbeat from core client for 30 sec - exiting 17:11:28 (39488): No heartbeat from core client for 30 sec - exiting 17:11:29 (39488): No heartbeat from core client for 30 sec - exiting 17:11:30 (39488): No heartbeat from core client for 30 sec - exiting 17:11:31 (39488): No heartbeat from core client for 30 sec - exiting 17:11:32 (39488): No heartbeat from core client for 30 sec - exiting 17:11:33 (39488): No heartbeat from core client for 30 sec - exiting 17:11:34 (39488): No heartbeat from core client for 30 sec - exiting 17:11:35 (39488): No heartbeat from core client for 30 sec - exiting 17:11:36 (39488): No heartbeat from core client for 30 sec - exiting 17:11:37 (39488): No heartbeat from core client for 30 sec - exiting 17:11:38 (39488): No heartbeat from core client for 30 sec - exiting 17:11:39 (39488): No heartbeat from core client for 30 sec - exiting 17:11:40 (39488): No heartbeat from core client for 30 sec - exiting 17:11:41 (39488): No heartbeat from core client for 30 sec - exiting 17:11:42 (39488): No heartbeat from core client for 30 sec - exiting 17:11:43 (39488): No heartbeat from core client for 30 sec - exiting 17:11:44 (39488): No heartbeat from core client for 30 sec - exiting 17:11:45 (39488): No heartbeat from core client for 30 sec - exiting 17:11:46 (39488): No heartbeat from core client for 30 sec - exiting 17:11:47 (39488): No heartbeat from core client for 30 sec - exiting 17:11:48 (39488): No heartbeat from core client for 30 sec - exiting 17:11:49 (39488): No heartbeat from core client for 30 sec - exiting 17:11:50 (39488): No heartbeat from core client for 30 sec - exiting 17:11:51 (39488): No heartbeat from core client for 30 sec - exiting 17:55:33 (39488): No heartbeat from core client for 30 sec - exiting 17:55:34 (39488): No heartbeat from core client for 30 sec - exiting 17:55:35 (39488): No heartbeat from core client for 30 sec - exiting 17:55:36 (39488): No heartbeat from core client for 30 sec - exiting 17:55:37 (39488): No heartbeat from core client for 30 sec - exiting 17:58:50 (44904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:43:02 (188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:44:18 (188): No heartbeat from core client for 30 sec - exiting 16:44:19 (188): No heartbeat from core client for 30 sec - exiting 16:53:04 (18686): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:58:11 (18764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:08:53 (18807): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:49:03 (18905): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:37:06 (20472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:40:37 (20472): No heartbeat from core client for 30 sec - exiting 17:40:38 (20472): No heartbeat from core client for 30 sec - exiting 17:40:39 (20472): No heartbeat from core client for 30 sec - exiting 17:40:40 (20472): No heartbeat from core client for 30 sec - exiting 17:40:41 (20472): No heartbeat from core client for 30 sec - exiting 17:40:42 (20472): No heartbeat from core client for 30 sec - exiting 17:40:43 (20472): No heartbeat from core client for 30 sec - exiting 17:40:44 (20472): No heartbeat from core client for 30 sec - exiting 17:40:45 (20472): No heartbeat from core client for 30 sec - exiting 17:40:46 (20472): No heartbeat from core client for 30 sec - exiting 17:40:47 (20472): No heartbeat from core client for 30 sec - exiting 17:40:48 (20472): No heartbeat from core client for 30 sec - exiting 17:40:49 (20472): No heartbeat from core client for 30 sec - exiting 17:40:50 (20472): No heartbeat from core client for 30 sec - exiting 17:40:51 (20472): No heartbeat from core client for 30 sec - exiting 17:40:52 (20472): No heartbeat from core client for 30 sec - exiting 17:40:53 (20472): No heartbeat from core client for 30 sec - exiting 17:40:54 (20472): No heartbeat from core client for 30 sec - exiting 17:40:55 (20472): No heartbeat from core client for 30 sec - exiting 17:40:56 (20472): No heartbeat from core client for 30 sec - exiting 17:40:57 (20472): No heartbeat from core client for 30 sec - exiting 17:40:58 (20472): No heartbeat from core client for 30 sec - exiting 17:40:59 (20472): No heartbeat from core client for 30 sec - exiting 17:41:00 (20472): No heartbeat from core client for 30 sec - exiting 17:41:01 (20472): No heartbeat from core client for 30 sec - exiting 17:41:02 (20472): No heartbeat from core client for 30 sec - exiting 17:41:03 (20472): No heartbeat from core client for 30 sec - exiting 17:41:04 (20472): No heartbeat from core client for 30 sec - exiting 17:41:05 (20472): No heartbeat from core client for 30 sec - exiting 17:41:06 (20472): No heartbeat from core client for 30 sec - exiting 17:41:07 (20472): No heartbeat from core client for 30 sec - exiting 17:41:08 (20472): No heartbeat from core client for 30 sec - exiting 17:41:09 (20472): No heartbeat from core client for 30 sec - exiting 17:41:10 (20472): No heartbeat from core client for 30 sec - exiting 17:41:11 (20472): No heartbeat from core client for 30 sec - exiting 17:41:12 (20472): No heartbeat from core client for 30 sec - exiting 17:41:13 (20472): No heartbeat from core client for 30 sec - exiting 17:41:14 (20472): No heartbeat from core client for 30 sec - exiting 17:41:15 (20472): No heartbeat from core client for 30 sec - exiting 17:52:20 (20472): No heartbeat from core client for 30 sec - exiting 17:52:21 (20472): No heartbeat from core client for 30 sec - exiting 17:52:22 (20472): No heartbeat from core client for 30 sec - exiting 17:52:23 (20472): No heartbeat from core client for 30 sec - exiting 17:52:24 (20472): No heartbeat from core client for 30 sec - exiting 17:52:25 (20472): No heartbeat from core client for 30 sec - exiting 17:52:26 (20472): No heartbeat from core client for 30 sec - exiting 17:52:27 (20472): No heartbeat from core client for 30 sec - exiting 17:52:28 (20472): No heartbeat from core client for 30 sec - exiting 17:52:29 (20472): No heartbeat from core client for 30 sec - exiting 17:52:30 (20472): No heartbeat from core client for 30 sec - exiting 17:52:31 (20472): No heartbeat from core client for 30 sec - exiting 17:52:32 (20472): No heartbeat from core client for 30 sec - exiting 17:52:33 (20472): No heartbeat from core client for 30 sec - exiting 17:52:34 (20472): No heartbeat from core client for 30 sec - exiting 17:52:35 (20472): No heartbeat from core client for 30 sec - exiting 17:52:36 (20472): No heartbeat from core client for 30 sec - exiting 17:52:37 (20472): No heartbeat from core client for 30 sec - exiting 17:52:38 (20472): No heartbeat from core client for 30 sec - exiting 17:52:39 (20472): No heartbeat from core client for 30 sec - exiting 17:52:40 (20472): No heartbeat from core client for 30 sec - exiting 17:52:41 (20472): No heartbeat from core client for 30 sec - exiting 17:52:42 (20472): No heartbeat from core client for 30 sec - exiting 17:52:43 (20472): No heartbeat from core client for 30 sec - exiting 17:52:44 (20472): No heartbeat from core client for 30 sec - exiting 17:52:45 (20472): No heartbeat from core client for 30 sec - exiting 17:52:46 (20472): No heartbeat from core client for 30 sec - exiting 17:52:47 (20472): No heartbeat from core client for 30 sec - exiting 17:52:48 (20472): No heartbeat from core client for 30 sec - exiting 17:52:49 (20472): No heartbeat from core client for 30 sec - exiting 17:52:50 (20472): No heartbeat from core client for 30 sec - exiting 17:52:51 (20472): No heartbeat from core client for 30 sec - exiting 17:52:52 (20472): No heartbeat from core client for 30 sec - exiting 17:52:53 (20472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:04:57 (40779): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:04:58 (40779): No heartbeat from core client for 30 sec - exiting 15:04:59 (40779): No heartbeat from core client for 30 sec - exiting 15:05:00 (40779): No heartbeat from core client for 30 sec - exiting 15:05:01 (40779): No heartbeat from core client for 30 sec - exiting 15:05:02 (40779): No heartbeat from core client for 30 sec - exiting 15:05:03 (40779): No heartbeat from core client for 30 sec - exiting 15:05:04 (40779): No heartbeat from core client for 30 sec - exiting 15:05:05 (40779): No heartbeat from core client for 30 sec - exiting 15:05:06 (40779): No heartbeat from core client for 30 sec - exiting 15:05:07 (40779): No heartbeat from core client for 30 sec - exiting 15:05:08 (40779): No heartbeat from core client for 30 sec - exiting 15:05:09 (40779): No heartbeat from core client for 30 sec - exiting 15:05:10 (40779): No heartbeat from core client for 30 sec - exiting 15:05:11 (40779): No heartbeat from core client for 30 sec - exiting 15:05:12 (40779): No heartbeat from core client for 30 sec - exiting 15:05:13 (40779): No heartbeat from core client for 30 sec - exiting 15:05:14 (40779): No heartbeat from core client for 30 sec - exiting 15:05:15 (40779): No heartbeat from core client for 30 sec - exiting 15:05:16 (40779): No heartbeat from core client for 30 sec - exiting 15:05:17 (40779): No heartbeat from core client for 30 sec - exiting 17:07:44 (70623): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:28:35 (71754): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:28:42 (71754): No heartbeat from core client for 30 sec - exiting 03:28:43 (71754): No heartbeat from core client for 30 sec - exiting 03:28:44 (71754): No heartbeat from core client for 30 sec - exiting 03:28:45 (71754): No heartbeat from core client for 30 sec - exiting 03:28:46 (71754): No heartbeat from core client for 30 sec - exiting 03:28:47 (71754): No heartbeat from core client for 30 sec - exiting 03:28:48 (71754): No heartbeat from core client for 30 sec - exiting 03:28:49 (71754): No heartbeat from core client for 30 sec - exiting 03:29:21 (71754): No heartbeat from core client for 30 sec - exiting 03:29:22 (71754): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 11:26:21 (80433): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:26:22 (80433): No heartbeat from core client for 30 sec - exiting 11:26:23 (80433): No heartbeat from core client for 30 sec - exiting 11:26:24 (80433): No heartbeat from core client for 30 sec - exiting 11:26:25 (80433): No heartbeat from core client for 30 sec - exiting 11:26:26 (80433): No heartbeat from core client for 30 sec - exiting 11:26:27 (80433): No heartbeat from core client for 30 sec - exiting 11:26:28 (80433): No heartbeat from core client for 30 sec - exiting 11:26:29 (80433): No heartbeat from core client for 30 sec - exiting 11:26:30 (80433): No heartbeat from core client for 30 sec - exiting 11:26:31 (80433): No heartbeat from core client for 30 sec - exiting 11:26:32 (80433): No heartbeat from core client for 30 sec - exiting 11:26:33 (80433): No heartbeat from core client for 30 sec - exiting 11:26:34 (80433): No heartbeat from core client for 30 sec - exiting 11:26:35 (80433): No heartbeat from core client for 30 sec - exiting 11:26:36 (80433): No heartbeat from core client for 30 sec - exiting 11:26:37 (80433): No heartbeat from core client for 30 sec - exiting 11:26:38 (80433): No heartbeat from core client for 30 sec - exiting 11:26:39 (80433): No heartbeat from core client for 30 sec - exiting 11:26:40 (80433): No heartbeat from core client for 30 sec - exiting 11:26:41 (80433): No heartbeat from core client for 30 sec - exiting 11:26:42 (80433): No heartbeat from core client for 30 sec - exiting 11:26:43 (80433): No heartbeat from core client for 30 sec - exiting 11:26:44 (80433): No heartbeat from core client for 30 sec - exiting 11:26:45 (80433): No heartbeat from core client for 30 sec - exiting 11:26:46 (80433): No heartbeat from core client for 30 sec - exiting 11:26:47 (80433): No heartbeat from core client for 30 sec - exiting 11:26:48 (80433): No heartbeat from core client for 30 sec - exiting 11:26:49 (80433): No heartbeat from core client for 30 sec - exiting 11:26:50 (80433): No heartbeat from core client for 30 sec - exiting 11:26:51 (80433): No heartbeat from core client for 30 sec - exiting 11:26:52 (80433): No heartbeat from core client for 30 sec - exiting 11:26:53 (80433): No heartbeat from core client for 30 sec - exiting 11:26:54 (80433): No heartbeat from core client for 30 sec - exiting 11:26:55 (80433): No heartbeat from core client for 30 sec - exiting 11:26:56 (80433): No heartbeat from core client for 30 sec - exiting 11:26:57 (80433): No heartbeat from core client for 30 sec - exiting 11:26:58 (80433): No heartbeat from core client for 30 sec - exiting 11:26:59 (80433): No heartbeat from core client for 30 sec - exiting 11:27:00 (80433): No heartbeat from core client for 30 sec - exiting 11:27:01 (80433): No heartbeat from core client for 30 sec - exiting 11:27:02 (80433): No heartbeat from core client for 30 sec - exiting 11:27:03 (80433): No heartbeat from core client for 30 sec - exiting 11:27:04 (80433): No heartbeat from core client for 30 sec - exiting 11:27:05 (80433): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... cpdnmonitor: error reading file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_se_6.07_i686-apple-darwin.dylib 15:52:40 (125): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... cpdnmonitor: error reading file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_se_6.07_i686-apple-darwin.dylib SIGBUS: bus error Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Mon Mar 11 20:04:20 2013 Thread 0 Crashed: 0 0x8fe13179 1 0x8fe104d0 2 0x8fe0cdad 3 0x8fe0de6c 4 0x8fe056af 5 0x8fe0b240 atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin. 6 libSystem.B.dylib 0x0012e2a8 dlopen + 66 7 hadcm3n_6.07_i686-apple-darwin 0x00015c16 umtonc_wrapper(std::vector<std::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::basic_string<char, std::char_traits<char>, std::allocator<char> > > >, int, bool) + 246 8 hadcm3n_6.07_i686-apple-darwin 0x0000cdd9 convertFilesForYear(int, char const) + 155 9 hadcm3n_6.07_i686-apple-darwin 0x00011bff yearlyMeans(int, char const) + 291 10 hadcm3n_6.07_i686-apple-darwin 0x000067af doCM3Proc() + 105 11 hadcm3n_6.07_i686-apple-darwin 0x0000791c mainLoop() + 410 12 hadcm3n_6.07_i686-apple-darwin 0x000087c7 worker() + 2989 13 hadcm3n_6.07_i686-apple-darwin 0x00008aa9 main + 491 14 hadcm3n_6.07_i686-apple-darwin 0x00002676 start + 54 Thread 1: 0 libSystem.B.dylib 0x00127c0e mach_wait_until + 10 1 libSystem.B.dylib 0x001af429 nanosleep + 345 2 libSystem.B.dylib 0x001af2ca usleep + 61 3 hadcm3n_6.07_i686-apple-darwin 0x00071a7c boinc_sleep(double) + 188 4 hadcm3n_6.07_i686-apple-darwin 0x00067282 timer_thread(void*) + 78 5 libSystem.B.dylib 0x00155259 _pthread_start + 345 6 libSystem.B.dylib 0x001550de thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffbf78 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/3/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x127000 - 0x2cefff /usr/lib/libSystem.B.dylib 0x350000 - 0x35efff /usr/lib/libz.1.dylib 0x363000 - 0x3cdfff /usr/lib/libstdc++.6.dylib 0x428000 - 0x42bfff /usr/lib/system/libmathCommon.A.dylib 0x1c7b000 - 0x1d25fff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_se_6.07_i686-apple-darwin.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Mar 2013 05:15:41	940519	15621952	hadcm3n_zf2g_1880_40_008252058_2	907,200	1,094,548	1.2065
09 Mar 2013 20:01:23	940519	15621952	hadcm3n_zf2g_1880_40_008252058_2	881,280	1,062,935	1.2061
09 Mar 2013 10:37:46	940519	15621952	hadcm3n_zf2g_1880_40_008252058_2	855,360	1,031,723	1.2062
09 Mar 2013 01:05:32	940519	15621952	hadcm3n_zf2g_1880_40_008252058_2	829,440	1,000,441	1.2062
08 Mar 2013 15:45:39	940519	15621952	hadcm3n_zf2g_1880_40_008252058_2	803,520	969,287	1.2063
08 Mar 2013 06:25:45	940519	15621952	hadcm3n_zf2g_1880_40_008252058_2	777,600	937,764	1.2060
07 Mar 2013 21:11:51	940519	15621952	hadcm3n_zf2g_1880_40_008252058_2	751,680	906,522	1.2060
07 Mar 2013 07:15:13	940519	15621952	hadcm3n_zf2g_1880_40_008252058_2	725,760	875,963	1.2070
06 Mar 2013 15:50:38	940519	15621952	hadcm3n_zf2g_1880_40_008252058_2	699,840	844,712	1.2070
06 Mar 2013 06:40:19	940519	15621952	hadcm3n_zf2g_1880_40_008252058_2	673,920	813,666	1.2074
05 Mar 2013 21:32:32	940519	15621952	hadcm3n_zf2g_1880_40_008252058_2	648,000	782,286	1.2072
05 Mar 2013 08:25:48	940519	15621952	hadcm3n_zf2g_1880_40_008252058_2	622,080	750,950	1.2072
04 Mar 2013 23:17:57	940519	15621952	hadcm3n_zf2g_1880_40_008252058_2	596,160	719,294	1.2065
04 Mar 2013 12:39:33	940519	15621952	hadcm3n_zf2g_1880_40_008252058_2	570,240	687,646	1.2059
04 Mar 2013 03:16:55	940519	15621952	hadcm3n_zf2g_1880_40_008252058_2	544,320	656,283	1.2057
03 Mar 2013 16:05:45	940519	15621952	hadcm3n_zf2g_1880_40_008252058_2	518,400	625,246	1.2061
03 Mar 2013 05:50:12	940519	15621952	hadcm3n_zf2g_1880_40_008252058_2	492,480	593,874	1.2059
02 Mar 2013 20:05:02	940519	15621952	hadcm3n_zf2g_1880_40_008252058_2	466,560	562,410	1.2054
02 Mar 2013 10:03:50	940519	15621952	hadcm3n_zf2g_1880_40_008252058_2	440,640	531,243	1.2056
02 Mar 2013 00:29:41	940519	15621952	hadcm3n_zf2g_1880_40_008252058_2	414,720	499,536	1.2045