Task 13133912

Name	hadcm3n_yjbb_1900_40_007357889_2
Workunit	7555319
Created	8 Jul 2011, 21:15:21 UTC
Sent	8 Jul 2011, 21:21:12 UTC
Report deadline	8 Oct 2011, 4:48:23 UTC
Received	4 Aug 2011, 18:15:47 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	846206
Run time	8 days 22 hours 4 min 59 sec
CPU time	8 days 4 hours 6 min 40 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.14 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:00:26 (2202): No heartbeat from core client for 30 sec - exiting 21:00:27 (2202): No heartbeat from core client for 30 sec - exiting 21:00:28 (2202): No heartbeat from core client for 30 sec - exiting 21:00:29 (2202): No heartbeat from core client for 30 sec - exiting 21:00:30 (2202): No heartbeat from core client for 30 sec - exiting 21:00:31 (2202): No heartbeat from core client for 30 sec - exiting 21:00:32 (2202): No heartbeat from core client for 30 sec - exiting 21:00:33 (2202): No heartbeat from core client for 30 sec - exiting 21:00:34 (2202): No heartbeat from core client for 30 sec - exiting 21:00:35 (2202): No heartbeat from core client for 30 sec - exiting 21:00:36 (2202): No heartbeat from core client for 30 sec - exiting 21:00:37 (2202): No heartbeat from core client for 30 sec - exiting 21:00:38 (2202): No heartbeat from core client for 30 sec - exiting 21:00:39 (2202): No heartbeat from core client for 30 sec - exiting 21:00:40 (2202): No heartbeat from core client for 30 sec - exiting 21:00:41 (2202): No heartbeat from core client for 30 sec - exiting 21:00:42 (2202): No heartbeat from core client for 30 sec - exiting 21:00:43 (2202): No heartbeat from core client for 30 sec - exiting 21:00:44 (2202): No heartbeat from core client for 30 sec - exiting 21:00:45 (2202): No heartbeat from core client for 30 sec - exiting 21:00:46 (2202): No heartbeat from core client for 30 sec - exiting 21:00:47 (2202): No heartbeat from core client for 30 sec - exiting 21:00:48 (2202): No heartbeat from core client for 30 sec - exiting 21:00:49 (2202): No heartbeat from core client for 30 sec - exiting 21:00:50 (2202): No heartbeat from core client for 30 sec - exiting 21:00:51 (2202): No heartbeat from core client for 30 sec - exiting 21:00:52 (2202): No heartbeat from core client for 30 sec - exiting 21:00:53 (2202): No heartbeat from core client for 30 sec - exiting 21:00:54 (2202): No heartbeat from core client for 30 sec - exiting 21:00:55 (2202): No heartbeat from core client for 30 sec - exiting 21:00:56 (2202): No heartbeat from core client for 30 sec - exiting 21:00:57 (2202): No heartbeat from core client for 30 sec - exiting 21:00:58 (2202): No heartbeat from core client for 30 sec - exiting 21:00:59 (2202): No heartbeat from core client for 30 sec - exiting 21:01:00 (2202): No heartbeat from core client for 30 sec - exiting 21:01:01 (2202): No heartbeat from core client for 30 sec - exiting 21:01:02 (2202): No heartbeat from core client for 30 sec - exiting 21:01:03 (2202): No heartbeat from core client for 30 sec - exiting 21:01:04 (2202): No heartbeat from core client for 30 sec - exiting 21:01:05 (2202): No heartbeat from core client for 30 sec - exiting 21:01:06 (2202): No heartbeat from core client for 30 sec - exiting 21:01:07 (2202): No heartbeat from core client for 30 sec - exiting 21:01:08 (2202): No heartbeat from core client for 30 sec - exiting 21:01:09 (2202): No heartbeat from core client for 30 sec - exiting 21:01:10 (2202): No heartbeat from core client for 30 sec - exiting 21:01:11 (2202): No heartbeat from core client for 30 sec - exiting 21:01:12 (2202): No heartbeat from core client for 30 sec - exiting 21:01:13 (2202): No heartbeat from core client for 30 sec - exiting 21:01:14 (2202): No heartbeat from core client for 30 sec - exiting 21:01:15 (2202): No heartbeat from core client for 30 sec - exiting 21:01:16 (2202): No heartbeat from core client for 30 sec - exiting 21:01:17 (2202): No heartbeat from core client for 30 sec - exiting 21:01:18 (2202): No heartbeat from core client for 30 sec - exiting 21:01:19 (2202): No heartbeat from core client for 30 sec - exiting 21:01:20 (2202): No heartbeat from core client for 30 sec - exiting 21:01:21 (2202): No heartbeat from core client for 30 sec - exiting 21:01:24 (2202): No heartbeat from core client for 30 sec - exiting 21:01:25 (2202): No heartbeat from core client for 30 sec - exiting 21:01:26 (2202): No heartbeat from core client for 30 sec - exiting 21:01:27 (2202): No heartbeat from core client for 30 sec - exiting 21:01:28 (2202): No heartbeat from core client for 30 sec - exiting 21:01:29 (2202): No heartbeat from core client for 30 sec - exiting 21:01:30 (2202): No heartbeat from core client for 30 sec - exiting 21:01:31 (2202): No heartbeat from core client for 30 sec - exiting 21:01:32 (2202): No heartbeat from core client for 30 sec - exiting 21:01:33 (2202): No heartbeat from core client for 30 sec - exiting 21:01:34 (2202): No heartbeat from core client for 30 sec - exiting 21:01:35 (2202): No heartbeat from core client for 30 sec - exiting 21:01:36 (2202): No heartbeat from core client for 30 sec - exiting 21:01:37 (2202): No heartbeat from core client for 30 sec - exiting 21:01:38 (2202): No heartbeat from core client for 30 sec - exiting 21:01:39 (2202): No heartbeat from core client for 30 sec - exiting 21:01:40 (2202): No heartbeat from core client for 30 sec - exiting 21:01:41 (2202): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:36:21 (19772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:36:33 (19772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:11:04 (57906): No heartbeat from core client for 30 sec - exiting 23:11:05 (57906): No heartbeat from core client for 30 sec - exiting 23:11:06 (57906): No heartbeat from core client for 30 sec - exiting 23:11:07 (57906): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:13:56 (59338): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:41:23 (61877): No heartbeat from core client for 30 sec - exiting 04:41:24 (61877): No heartbeat from core client for 30 sec - exiting 04:41:25 (61877): No heartbeat from core client for 30 sec - exiting 04:41:26 (61877): No heartbeat from core client for 30 sec - exiting 04:41:27 (61877): No heartbeat from core client for 30 sec - exiting 04:41:28 (61877): No heartbeat from core client for 30 sec - exiting 04:41:29 (61877): No heartbeat from core client for 30 sec - exiting 04:41:30 (61877): No heartbeat from core client for 30 sec - exiting 04:41:31 (61877): No heartbeat from core client for 30 sec - exiting 04:41:32 (61877): No heartbeat from core client for 30 sec - exiting 04:41:33 (61877): No heartbeat from core client for 30 sec - exiting 04:41:34 (61877): No heartbeat from core client for 30 sec - exiting 04:41:35 (61877): No heartbeat from core client for 30 sec - exiting 04:41:36 (61877): No heartbeat from core client for 30 sec - exiting 04:41:37 (61877): No heartbeat from core client for 30 sec - exiting 04:41:38 (61877): No heartbeat from core client for 30 sec - exiting 04:41:39 (61877): No heartbeat from core client for 30 sec - exiting 04:41:40 (61877): No heartbeat from core client for 30 sec - exiting 04:41:41 (61877): No heartbeat from core client for 30 sec - exiting 04:41:42 (61877): No heartbeat from core client for 30 sec - exiting 04:41:43 (61877): No heartbeat from core client for 30 sec - exiting 04:41:44 (61877): No heartbeat from core client for 30 sec - exiting 04:41:45 (61877): No heartbeat from core client for 30 sec - exiting 04:41:46 (61877): No heartbeat from core client for 30 sec - exiting 04:41:47 (61877): No heartbeat from core client for 30 sec - exiting 04:41:48 (61877): No heartbeat from core client for 30 sec - exiting 04:41:49 (61877): No heartbeat from core client for 30 sec - exiting 04:41:50 (61877): No heartbeat from core client for 30 sec - exiting 04:41:51 (61877): No heartbeat from core client for 30 sec - exiting 04:41:52 (61877): No heartbeat from core client for 30 sec - exiting 04:41:53 (61877): No heartbeat from core client for 30 sec - exiting 04:41:55 (61877): No heartbeat from core client for 30 sec - exiting 04:41:56 (61877): No heartbeat from core client for 30 sec - exiting 04:41:57 (61877): No heartbeat from core client for 30 sec - exiting 04:41:58 (61877): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:43:31 (61892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:43:32 (61892): No heartbeat from core client for 30 sec - exiting 04:43:33 (61892): No heartbeat from core client for 30 sec - exiting 04:43:34 (61892): No heartbeat from core client for 30 sec - exiting 04:43:35 (61892): No heartbeat from core client for 30 sec - exiting 04:43:36 (61892): No heartbeat from core client for 30 sec - exiting 04:43:37 (61892): No heartbeat from core client for 30 sec - exiting 04:43:38 (61892): No heartbeat from core client for 30 sec - exiting 04:43:39 (61892): No heartbeat from core client for 30 sec - exiting 04:43:40 (61892): No heartbeat from core client for 30 sec - exiting 04:43:41 (61892): No heartbeat from core client for 30 sec - exiting 04:43:42 (61892): No heartbeat from core client for 30 sec - exiting 04:43:43 (61892): No heartbeat from core client for 30 sec - exiting 04:43:44 (61892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:55:17 (65106): No heartbeat from core client for 30 sec - exiting 08:55:18 (65106): No heartbeat from core client for 30 sec - exiting 08:55:19 (65106): No heartbeat from core client for 30 sec - exiting 08:55:20 (65106): No heartbeat from core client for 30 sec - exiting 08:55:21 (65106): No heartbeat from core client for 30 sec - exiting 08:55:22 (65106): No heartbeat from core client for 30 sec - exiting 08:55:23 (65106): No heartbeat from core client for 30 sec - exiting 08:55:24 (65106): No heartbeat from core client for 30 sec - exiting 08:55:25 (65106): No heartbeat from core client for 30 sec - exiting 08:55:26 (65106): No heartbeat from core client for 30 sec - exiting 08:55:27 (65106): No heartbeat from core client for 30 sec - exiting 08:55:28 (65106): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:39:14 (79357): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:08:58 (10832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:27:49 (1721): No heartbeat from core client for 30 sec - exiting 00:27:50 (1721): No heartbeat from core client for 30 sec - exiting 00:27:51 (1721): No heartbeat from core client for 30 sec - exiting 00:27:52 (1721): No heartbeat from core client for 30 sec - exiting 00:27:53 (1721): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:45:55 (9612): No heartbeat from core client for 30 sec - exiting 13:45:56 (9612): No heartbeat from core client for 30 sec - exiting 13:45:57 (9612): No heartbeat from core client for 30 sec - exiting 13:45:58 (9612): No heartbeat from core client for 30 sec - exiting 13:45:59 (9612): No heartbeat from core client for 30 sec - exiting 13:46:00 (9612): No heartbeat from core client for 30 sec - exiting 13:46:01 (9612): No heartbeat from core client for 30 sec - exiting 13:46:02 (9612): No heartbeat from core client for 30 sec - exiting 13:46:03 (9612): No heartbeat from core client for 30 sec - exiting 13:46:04 (9612): No heartbeat from core client for 30 sec - exiting 13:46:05 (9612): No heartbeat from core client for 30 sec - exiting 13:46:06 (9612): No heartbeat from core client for 30 sec - exiting 13:46:07 (9612): No heartbeat from core client for 30 sec - exiting 13:46:08 (9612): No heartbeat from core client for 30 sec - exiting 13:46:09 (9612): No heartbeat from core client for 30 sec - exiting 13:46:10 (9612): No heartbeat from core client for 30 sec - exiting 13:46:11 (9612): No heartbeat from core client for 30 sec - exiting 13:46:12 (9612): No heartbeat from core client for 30 sec - exiting 13:46:13 (9612): No heartbeat from core client for 30 sec - exiting 13:46:14 (9612): No heartbeat from core client for 30 sec - exiting 13:46:16 (9612): No heartbeat from core client for 30 sec - exiting 13:46:17 (9612): No heartbeat from core client for 30 sec - exiting 13:46:18 (9612): No heartbeat from core client for 30 sec - exiting 13:46:19 (9612): No heartbeat from core client for 30 sec - exiting 13:46:20 (9612): No heartbeat from core client for 30 sec - exiting 13:46:21 (9612): No heartbeat from core client for 30 sec - exiting 13:46:22 (9612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(12907,0xa06a8720) malloc: * error for object 0x806a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) hadcm3n_6.07_i686-apple-darwin(12907,0xa06a8720) malloc: * error for object 0x806a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(12907,0xa06a8720) malloc: * error for object 0x806a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug 12:03:00 (1738): No heartbeat from core client for 30 sec - exiting 12:03:01 (1738): No heartbeat from core client for 30 sec - exiting 12:03:02 (1738): No heartbeat from core client for 30 sec - exiting 12:03:03 (1738): No heartbeat from core client for 30 sec - exiting 12:03:04 (1738): No heartbeat from core client for 30 sec - exiting 12:03:05 (1738): No heartbeat from core client for 30 sec - exiting 12:03:06 (1738): No heartbeat from core client for 30 sec - exiting 12:03:07 (1738): No heartbeat from core client for 30 sec - exiting 12:03:08 (1738): No heartbeat from core client for 30 sec - exiting 12:03:09 (1738): No heartbeat from core client for 30 sec - exiting 12:03:10 (1738): No heartbeat from core client for 30 sec - exiting 12:03:11 (1738): No heartbeat from core client for 30 sec - exiting 12:03:12 (1738): No heartbeat from core client for 30 sec - exiting 12:03:13 (1738): No heartbeat from core client for 30 sec - exiting 12:03:14 (1738): No heartbeat from core client for 30 sec - exiting 12:03:15 (1738): No heartbeat from core client for 30 sec - exiting 12:03:16 (1738): No heartbeat from core client for 30 sec - exiting 12:03:17 (1738): No heartbeat from core client for 30 sec - exiting 12:03:18 (1738): No heartbeat from core client for 30 sec - exiting 12:03:19 (1738): No heartbeat from core client for 30 sec - exiting 12:03:20 (1738): No heartbeat from core client for 30 sec - exiting 12:03:21 (1738): No heartbeat from core client for 30 sec - exiting 12:03:22 (1738): No heartbeat from core client for 30 sec - exiting 12:03:23 (1738): No heartbeat from core client for 30 sec - exiting 12:03:24 (1738): No heartbeat from core client for 30 sec - exiting 12:03:25 (1738): No heartbeat from core client for 30 sec - exiting 12:03:26 (1738): No heartbeat from core client for 30 sec - exiting 12:03:27 (1738): No heartbeat from core client for 30 sec - exiting 12:03:28 (1738): No heartbeat from core client for 30 sec - exiting 12:03:29 (1738): No heartbeat from core client for 30 sec - exiting 12:03:30 (1738): No heartbeat from core client for 30 sec - exiting 12:03:31 (1738): No heartbeat from core client for 30 sec - exiting 12:03:32 (1738): No heartbeat from core client for 30 sec - exiting 12:03:33 (1738): No heartbeat from core client for 30 sec - exiting 12:03:34 (1738): No heartbeat from core client for 30 sec - exiting 12:03:36 (1738): No heartbeat from core client for 30 sec - exiting 12:03:37 (1738): No heartbeat from core client for 30 sec - exiting 12:03:38 (1738): No heartbeat from core client for 30 sec - exiting 12:03:39 (1738): No heartbeat from core client for 30 sec - exiting 12:03:40 (1738): No heartbeat from core client for 30 sec - exiting 12:03:41 (1738): No heartbeat from core client for 30 sec - exiting 12:03:42 (1738): No heartbeat from core client for 30 sec - exiting 12:03:43 (1738): No heartbeat from core client for 30 sec - exiting 12:03:44 (1738): No heartbeat from core client for 30 sec - exiting 12:03:45 (1738): No heartbeat from core client for 30 sec - exiting 12:03:46 (1738): No heartbeat from core client for 30 sec - exiting 12:03:47 (1738): No heartbeat from core client for 30 sec - exiting 12:03:48 (1738): No heartbeat from core client for 30 sec - exiting 12:03:49 (1738): No heartbeat from core client for 30 sec - exiting 12:03:50 (1738): No heartbeat from core client for 30 sec - exiting 12:03:51 (1738): No heartbeat from core client for 30 sec - exiting 12:03:52 (1738): No heartbeat from core client for 30 sec - exiting 12:03:53 (1738): No heartbeat from core client for 30 sec - exiting 12:03:54 (1738): No heartbeat from core client for 30 sec - exiting 12:03:55 (1738): No heartbeat from core client for 30 sec - exiting 12:03:56 (1738): No heartbeat from core client for 30 sec - exiting 12:03:57 (1738): No heartbeat from core client for 30 sec - exiting 12:03:58 (1738): No heartbeat from core client for 30 sec - exiting 12:03:59 (1738): No heartbeat from core client for 30 sec - exiting 12:04:00 (1738): No heartbeat from core client for 30 sec - exiting 12:04:01 (1738): No heartbeat from core client for 30 sec - exiting 12:04:02 (1738): No heartbeat from core client for 30 sec - exiting 12:04:03 (1738): No heartbeat from core client for 30 sec - exiting 12:04:04 (1738): No heartbeat from core client for 30 sec - exiting 12:04:05 (1738): No heartbeat from core client for 30 sec - exiting 12:04:06 (1738): No heartbeat from core client for 30 sec - exiting 12:04:07 (1738): No heartbeat from core client for 30 sec - exiting 12:04:08 (1738): No heartbeat from core client for 30 sec - exiting 12:04:09 (1738): No heartbeat from core client for 30 sec - exiting 12:04:10 (1738): No heartbeat from core client for 30 sec - exiting 12:04:11 (1738): No heartbeat from core client for 30 sec - exiting 12:04:12 (1738): No heartbeat from core client for 30 sec - exiting 12:04:13 (1738): No heartbeat from core client for 30 sec - exiting 12:04:14 (1738): No heartbeat from core client for 30 sec - exiting 12:04:15 (1738): No heartbeat from core client for 30 sec - exiting 12:04:16 (1738): No heartbeat from core client for 30 sec - exiting 12:04:17 (1738): No heartbeat from core client for 30 sec - exiting 12:04:18 (1738): No heartbeat from core client for 30 sec - exiting 12:04:19 (1738): No heartbeat from core client for 30 sec - exiting 12:04:20 (1738): No heartbeat from core client for 30 sec - exiting 12:04:21 (1738): No heartbeat from core client for 30 sec - exiting 12:04:22 (1738): No heartbeat from core client for 30 sec - exiting 12:04:23 (1738): No heartbeat from core client for 30 sec - exiting 12:04:24 (1738): No heartbeat from core client for 30 sec - exiting 12:04:25 (1738): No heartbeat from core client for 30 sec - exiting 12:04:26 (1738): No heartbeat from core client for 30 sec - exiting 12:04:27 (1738): No heartbeat from core client for 30 sec - exiting 12:04:28 (1738): No heartbeat from core client for 30 sec - exiting 12:04:29 (1738): No heartbeat from core client for 30 sec - exiting 12:04:30 (1738): No heartbeat from core client for 30 sec - exiting 12:04:31 (1738): No heartbeat from core client for 30 sec - exiting 12:04:32 (1738): No heartbeat from core client for 30 sec - exiting 12:04:33 (1738): No heartbeat from core client for 30 sec - exiting 12:04:34 (1738): No heartbeat from core client for 30 sec - exiting 12:04:35 (1738): No heartbeat from core client for 30 sec - exiting 12:04:37 (1738): No heartbeat from core client for 30 sec - exiting 12:04:38 (1738): No heartbeat from core client for 30 sec - exiting 12:04:39 (1738): No heartbeat from core client for 30 sec - exiting 12:04:40 (1738): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(1738,0xa06a8720) malloc: * error for object 0x805e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) hadcm3n_6.07_i686-apple-darwin(2836,0xa06a8720) malloc: * error for object 0x803800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.5.8 build 9L30 14:15:13 (3519): No heartbeat from core client for 30 sec - exiting 14:15:15 (3519): No heartbeat from core client for 30 sec - exiting 14:15:16 (3519): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(3519,0xa06a8720) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.5.8 build 9L30 Wed Aug 3 14:15:19 2011 BOINC backtrace under OS 10.5.x only shows exported (global) symbols and may not show the final location which caused a crash. For a better backtrace, either run under OS 10.4.x or run under OS 10.6.x or later. atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin. 0 hadcm3n_6.07_i686-apple-darwin 0x00074953 1 hadcm3n_6.07_i686-apple-darwin 0x0006a936 2 libSystem.B.dylib 0x964ed1cb 3 ??? 0xffffffff 4 libSystem.B.dylib 0x96487e26 5 libSystem.B.dylib 0x9648726d 6 hadcm3n_6.07_i686-apple-darwin 0x0000ba58 7 hadcm3n_6.07_i686-apple-darwin 0x0000d36b 8 hadcm3n_6.07_i686-apple-darwin 0x000067ff 9 hadcm3n_6.07_i686-apple-darwin 0x0000876a 10 hadcm3n_6.07_i686-apple-darwin 0x00008aa9 11 hadcm3n_6.07_i686-apple-darwin 0x00002676 Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x964b57c2 ecx: 0xbff903fc edx: 0x96481166 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff90438 esp: 0xbff903fc ss: 0x0000001f efl: 0x00000206 eip: 0x96481166 cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/3/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90e60000 - 0x90e6efff /usr/lib/libz.1.dylib 0x93703000 - 0x93707fff /usr/lib/system/libmathCommon.A.dylib 0x9568f000 - 0x95696fff /usr/lib/libgcc_s.1.dylib 0x963b0000 - 0x9640dfff /usr/lib/libstdc++.6.dylib 0x96480000 - 0x965e7fff /usr/lib/libSystem.B.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Aug 2011 05:52:58	846206	13133912	hadcm3n_yjbb_1900_40_007357889_2	518,400	671,235	1.2948
02 Aug 2011 19:53:00	846206	13133912	hadcm3n_yjbb_1900_40_007357889_2	492,480	633,819	1.2870
01 Aug 2011 22:13:24	846206	13133912	hadcm3n_yjbb_1900_40_007357889_2	466,560	598,482	1.2828
01 Aug 2011 12:22:07	846206	13133912	hadcm3n_yjbb_1900_40_007357889_2	440,640	563,900	1.2797
01 Aug 2011 02:26:25	846206	13133912	hadcm3n_yjbb_1900_40_007357889_2	414,720	529,159	1.2759
31 Jul 2011 05:59:10	846206	13133912	hadcm3n_yjbb_1900_40_007357889_2	388,800	494,286	1.2713
30 Jul 2011 20:09:32	846206	13133912	hadcm3n_yjbb_1900_40_007357889_2	362,880	491,095	1.3533
29 Jul 2011 22:29:23	846206	13133912	hadcm3n_yjbb_1900_40_007357889_2	336,960	455,576	1.3520
29 Jul 2011 11:09:03	846206	13133912	hadcm3n_yjbb_1900_40_007357889_2	311,040	421,326	1.3546
29 Jul 2011 01:09:04	846206	13133912	hadcm3n_yjbb_1900_40_007357889_2	285,120	386,363	1.3551
28 Jul 2011 03:04:27	846206	13133912	hadcm3n_yjbb_1900_40_007357889_2	259,200	350,134	1.3508
27 Jul 2011 04:50:23	846206	13133912	hadcm3n_yjbb_1900_40_007357889_2	233,280	315,933	1.3543
26 Jul 2011 19:16:07	846206	13133912	hadcm3n_yjbb_1900_40_007357889_2	207,360	282,416	1.3620
25 Jul 2011 23:47:07	846206	13133912	hadcm3n_yjbb_1900_40_007357889_2	181,440	247,247	1.3627
25 Jul 2011 22:56:37	846206	13133912	hadcm3n_yjbb_1900_40_007357889_2	155,520	212,949	1.3693
25 Jul 2011 21:03:12	846206	13133912	hadcm3n_yjbb_1900_40_007357889_2	129,600	178,122	1.3744
25 Jul 2011 19:19:17	846206	13133912	hadcm3n_yjbb_1900_40_007357889_2	103,680	143,628	1.3853
25 Jul 2011 19:19:17	846206	13133912	hadcm3n_yjbb_1900_40_007357889_2	77,760	108,518	1.3956
25 Jul 2011 19:19:17	846206	13133912	hadcm3n_yjbb_1900_40_007357889_2	51,840	73,285	1.4137
25 Jul 2011 19:19:17	846206	13133912	hadcm3n_yjbb_1900_40_007357889_2	25,920	37,426	1.4439