Task 14795653

Name	hadcm3n_o111_1980_40_007832571_3
Workunit	7987683
Created	18 Jun 2012, 4:51:39 UTC
Sent	18 Jun 2012, 4:51:46 UTC
Report deadline	17 Sep 2012, 12:18:57 UTC
Received	2 Aug 2012, 21:33:44 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1083329
Run time	18 days 4 hours 49 min 9 sec
CPU time	16 days 17 hours 45 min 30 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.81 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.31</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:33:56 (12432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:35:00 (13066): No heartbeat from core client for 30 sec - exiting 17:35:13 (13066): No heartbeat from core client for 30 sec - exiting 17:35:14 (13066): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:35:15 (13066): No heartbeat from core client for 30 sec - exiting 17:35:16 (13066): No heartbeat from core client for 30 sec - exiting 17:35:17 (13066): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:01:59 (19343): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:02:10 (19343): No heartbeat from core client for 30 sec - exiting 09:02:11 (19343): No heartbeat from core client for 30 sec - exiting 09:02:12 (19343): No heartbeat from core client for 30 sec - exiting 09:02:13 (19343): No heartbeat from core client for 30 sec - exiting 09:02:14 (19343): No heartbeat from core client for 30 sec - exiting 09:02:15 (19343): No heartbeat from core client for 30 sec - exiting 09:02:16 (19343): No heartbeat from core client for 30 sec - exiting 09:02:17 (19343): No heartbeat from core client for 30 sec - exiting 09:02:18 (19343): No heartbeat from core client for 30 sec - exiting 09:02:19 (19343): No heartbeat from core client for 30 sec - exiting 09:02:20 (19343): No heartbeat from core client for 30 sec - exiting 09:02:21 (19343): No heartbeat from core client for 30 sec - exiting 09:03:03 (19343): No heartbeat from core client for 30 sec - exiting 09:03:04 (19343): No heartbeat from core client for 30 sec - exiting 09:03:05 (19343): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:25:38 (1098): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... 09:54:29 (2729): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:09:09 (9857): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:46:30 (14903): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... hadcm3n_6.07_i686-apple-darwin(15399,0xac1242c0) malloc: * error for object 0x137ea04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15399,0xac1242c0) malloc: * error for object 0x137ea00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15399,0xac1242c0) malloc: * error for object 0xb55a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(15399,0xac1242c0) malloc: * error for object 0x1355a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15399,0xac1242c0) malloc: * error for object 0x1355a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16910,0xac1242c0) malloc: * error for object 0x10f0404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16910,0xac1242c0) malloc: * error for object 0x10f0400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16910,0xac1242c0) malloc: * error for object 0x8bc204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16910,0xac1242c0) malloc: * error for object 0x8bc200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16910,0xac1242c0) malloc: * error for object 0x8bc204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16910,0xac1242c0) malloc: * error for object 0x8bc200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16910,0xac1242c0) malloc: * error for object 0x8bc204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16910,0xac1242c0) malloc: * error for object 0x8bc200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16910,0xac1242c0) malloc: * error for object 0x8bc204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16910,0xac1242c0) malloc: * error for object 0x8bc200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16910,0xac1242c0) malloc: * error for object 0x8bc204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(16910,0xac1242c0) malloc: * error for object 0x8bc200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:27:23 (30623): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:52:00 (44640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:03:03 (716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:03:26 (716): No heartbeat from core client for 30 sec - exiting 11:03:27 (716): No heartbeat from core client for 30 sec - exiting 11:03:28 (716): No heartbeat from core client for 30 sec - exiting 11:03:29 (716): No heartbeat from core client for 30 sec - exiting 11:03:30 (716): No heartbeat from core client for 30 sec - exiting 11:03:31 (716): No heartbeat from core client for 30 sec - exiting 11:03:32 (716): No heartbeat from core client for 30 sec - exiting 11:03:33 (716): No heartbeat from core client for 30 sec - exiting 11:03:34 (716): No heartbeat from core client for 30 sec - exiting 11:03:35 (716): No heartbeat from core client for 30 sec - exiting 11:03:36 (716): No heartbeat from core client for 30 sec - exiting 11:03:37 (716): No heartbeat from core client for 30 sec - exiting 11:03:38 (716): No heartbeat from core client for 30 sec - exiting 11:03:39 (716): No heartbeat from core client for 30 sec - exiting 11:03:40 (716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 02:26:44 (1886): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:57:29 (8390): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:01:36 (27562): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(29411,0xac1242c0) malloc: * error for object 0x98ae00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(31450,0xac1242c0) malloc: * error for object 0xb36804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31450,0xac1242c0) malloc: * error for object 0xb36800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31450,0xac1242c0) malloc: * error for object 0xb36800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(59324,0xac1242c0) malloc: * error for object 0xa54c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59324,0xac1242c0) malloc: * error for object 0xa54c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59324,0xac1242c0) malloc: * error for object 0xa54c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59324,0xac1242c0) malloc: * error for object 0xa54c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59324,0xac1242c0) malloc: * error for object 0xa54c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59324,0xac1242c0) malloc: * error for object 0xa54c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59324,0xac1242c0) malloc: * error for object 0xa54c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59324,0xac1242c0) malloc: * error for object 0xa54c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59324,0xac1242c0) malloc: * error for object 0xa54c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59324,0xac1242c0) malloc: * error for object 0xa54c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59324,0xac1242c0) malloc: * error for object 0x121bc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59324,0xac1242c0) malloc: * error for object 0x121bc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:25:21 (65639): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:27:56 (66096): No heartbeat from core client for 30 sec - exiting 14:27:57 (66096): No heartbeat from core client for 30 sec - exiting 14:27:58 (66096): No heartbeat from core client for 30 sec - exiting 14:27:59 (66096): No heartbeat from core client for 30 sec - exiting 14:28:00 (66096): No heartbeat from core client for 30 sec - exiting 14:28:01 (66096): No heartbeat from core client for 30 sec - exiting 14:28:02 (66096): No heartbeat from core client for 30 sec - exiting 14:28:03 (66096): No heartbeat from core client for 30 sec - exiting 14:28:04 (66096): No heartbeat from core client for 30 sec - exiting 14:28:05 (66096): No heartbeat from core client for 30 sec - exiting 14:28:06 (66096): No heartbeat from core client for 30 sec - exiting 14:28:07 (66096): No heartbeat from core client for 30 sec - exiting 14:28:08 (66096): No heartbeat from core client for 30 sec - exiting 14:28:09 (66096): No heartbeat from core client for 30 sec - exiting 14:28:10 (66096): No heartbeat from core client for 30 sec - exiting 14:28:11 (66096): No heartbeat from core client for 30 sec - exiting 14:28:12 (66096): No heartbeat from core client for 30 sec - exiting 14:28:13 (66096): No heartbeat from core client for 30 sec - exiting 14:28:14 (66096): No heartbeat from core client for 30 sec - exiting 14:28:15 (66096): No heartbeat from core client for 30 sec - exiting 14:28:16 (66096): No heartbeat from core client for 30 sec - exiting 14:28:17 (66096): No heartbeat from core client for 30 sec - exiting 14:28:18 (66096): No heartbeat from core client for 30 sec - exiting 14:28:19 (66096): No heartbeat from core client for 30 sec - exiting 14:28:20 (66096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:12:30 (74812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:14:11 (74924): No heartbeat from core client for 30 sec - exiting 11:14:12 (74924): No heartbeat from core client for 30 sec - exiting 11:14:13 (74924): No heartbeat from core client for 30 sec - exiting 11:14:14 (74924): No heartbeat from core client for 30 sec - exiting 11:14:15 (74924): No heartbeat from core client for 30 sec - exiting 11:14:17 (74924): No heartbeat from core client for 30 sec - exiting 11:14:18 (74924): No heartbeat from core client for 30 sec - exiting 11:14:19 (74924): No heartbeat from core client for 30 sec - exiting 11:14:20 (74924): No heartbeat from core client for 30 sec - exiting 11:14:21 (74924): No heartbeat from core client for 30 sec - exiting 11:14:22 (74924): No heartbeat from core client for 30 sec - exiting 11:14:23 (74924): No heartbeat from core client for 30 sec - exiting 11:14:24 (74924): No heartbeat from core client for 30 sec - exiting 11:14:25 (74924): No heartbeat from core client for 30 sec - exiting 11:14:26 (74924): No heartbeat from core client for 30 sec - exiting 11:14:27 (74924): No heartbeat from core client for 30 sec - exiting 11:14:28 (74924): No heartbeat from core client for 30 sec - exiting 11:14:29 (74924): No heartbeat from core client for 30 sec - exiting 11:14:30 (74924): No heartbeat from core client for 30 sec - exiting 11:14:31 (74924): No heartbeat from core client for 30 sec - exiting 11:14:32 (74924): No heartbeat from core client for 30 sec - exiting 11:14:33 (74924): No heartbeat from core client for 30 sec - exiting 11:14:34 (74924): No heartbeat from core client for 30 sec - exiting 11:14:35 (74924): No heartbeat from core client for 30 sec - exiting 11:14:36 (74924): No heartbeat from core client for 30 sec - exiting 11:14:37 (74924): No heartbeat from core client for 30 sec - exiting 11:14:38 (74924): No heartbeat from core client for 30 sec - exiting 11:14:39 (74924): No heartbeat from core client for 30 sec - exiting 11:14:40 (74924): No heartbeat from core client for 30 sec - exiting 11:14:41 (74924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:06:09 (83760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:08:19 (84053): No heartbeat from core client for 30 sec - exiting 09:08:20 (84053): No heartbeat from core client for 30 sec - exiting 09:08:21 (84053): No heartbeat from core client for 30 sec - exiting 09:08:22 (84053): No heartbeat from core client for 30 sec - exiting 09:08:23 (84053): No heartbeat from core client for 30 sec - exiting 09:08:24 (84053): No heartbeat from core client for 30 sec - exiting 09:08:25 (84053): No heartbeat from core client for 30 sec - exiting 09:08:26 (84053): No heartbeat from core client for 30 sec - exiting 09:08:27 (84053): No heartbeat from core client for 30 sec - exiting 09:08:28 (84053): No heartbeat from core client for 30 sec - exiting 09:08:29 (84053): No heartbeat from core client for 30 sec - exiting 09:08:30 (84053): No heartbeat from core client for 30 sec - exiting 09:08:31 (84053): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:03:10 (85141): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:07:22 (85324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:08:34 (85345): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:51:50 (94728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:57:38 (23211): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:18:59 (30051): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:43:25 (42725): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:43:28 (42725): No heartbeat from core client for 30 sec - exiting 07:43:29 (42725): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:50:26 (54260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:53:52 (54346): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:49:32 (56621): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:48:54 (67595): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:12 (67595): No heartbeat from core client for 30 sec - exiting 19:49:13 (67595): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(87878,0xac1242c0) malloc: * error for object 0x96c804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87878,0xac1242c0) malloc: * error for object 0x96c800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87878,0xac1242c0) malloc: * error for object 0x1164604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87878,0xac1242c0) malloc: * error for object 0x117fc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87878,0xac1242c0) malloc: * error for object 0x117fc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87878,0xac1242c0) malloc: * error for object 0x96c804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87878,0xac1242c0) malloc: * error for object 0x96c800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87878,0xac1242c0) malloc: * error for object 0x96c804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87878,0xac1242c0) malloc: * error for object 0x96c800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87878,0xac1242c0) malloc: * error for object 0x117fc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87878,0xac1242c0) malloc: * error for object 0x117fc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87878,0xac1242c0) malloc: * error for object 0x117fc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87878,0xac1242c0) malloc: * error for object 0x117fc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87878,0xac1242c0) malloc: * error for object 0x117fc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87878,0xac1242c0) malloc: * error for object 0x117fc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87878,0xac1242c0) malloc: * error for object 0x117fc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87878,0xac1242c0) malloc: * error for object 0x117fc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87878,0xac1242c0) malloc: * error for object 0x117fc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87878,0xac1242c0) malloc: * error for object 0x117fc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87878,0xac1242c0) malloc: * error for object 0x1164604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87878,0xac1242c0) malloc: * error for object 0x111ee04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87878,0xac1242c0) malloc: * error for object 0x111ee00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(87878,0xac1242c0) malloc: * error for object 0x94aa00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(90703,0xac1242c0) malloc: * error for object 0x12d1404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(90703,0xac1242c0) malloc: * error for object 0xab7404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(90703,0xac1242c0) malloc: * error for object 0xab7400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(90703,0xac1242c0) malloc: * error for object 0xab7404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) hadcm3n_6.07_i686-apple-darwin(36784,0xac1242c0) malloc: * error for object 0xc16a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36784,0xac1242c0) malloc: * error for object 0x1404a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36784,0xac1242c0) malloc: * error for object 0x1404a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36784,0xac1242c0) malloc: * error for object 0x1404a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36784,0xac1242c0) malloc: * error for object 0x1404a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36784,0xac1242c0) malloc: * error for object 0x1404a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36784,0xac1242c0) malloc: * error for object 0x1404a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36784,0xac1242c0) malloc: * error for object 0x1404a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36784,0xac1242c0) malloc: * error for object 0x1404a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36784,0xac1242c0) malloc: * error for object 0x1404a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(38337,0xac1242c0) malloc: * error for object 0x1140804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(38337,0xac1242c0) malloc: * error for object 0x935404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(38337,0xac1242c0) malloc: * error for object 0x1140804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(38337,0xac1242c0) malloc: * error for object 0x1140804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(38337,0xac1242c0) malloc: * error for object 0x91a804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(38337,0xac1242c0) malloc: * error for object 0x91a800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(38337,0xac1242c0) malloc: * error for object 0x1111e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(38337,0xac1242c0) malloc: * error for object 0x1111e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(38337,0xac1242c0) malloc: * error for object 0x1111e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(38337,0xac1242c0) malloc: * error for object 0x1111e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(38337,0xac1242c0) malloc: * error for object 0x1111e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(38337,0xac1242c0) malloc: * error for object 0x1111e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(38337,0xac1242c0) malloc: * error for object 0x91a804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(38337,0xac1242c0) malloc: * error for object 0x91a800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(38337,0xac1242c0) malloc: * error for object 0x91a804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(38337,0xac1242c0) malloc: * error for object 0x91a800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Jul 2012 23:52:22	1083329	14795653	hadcm3n_o111_1980_40_007832571_3	1,036,800	1,445,771	1.3945
25 Jul 2012 17:52:12	1083329	14795653	hadcm3n_o111_1980_40_007832571_3	1,010,880	1,409,198	1.3940
25 Jul 2012 01:00:37	1083329	14795653	hadcm3n_o111_1980_40_007832571_3	984,960	1,373,217	1.3942
24 Jul 2012 11:44:46	1083329	14795653	hadcm3n_o111_1980_40_007832571_3	959,040	1,337,207	1.3943
23 Jul 2012 02:51:28	1083329	14795653	hadcm3n_o111_1980_40_007832571_3	933,120	1,301,146	1.3944
22 Jul 2012 06:16:25	1083329	14795653	hadcm3n_o111_1980_40_007832571_3	907,200	1,265,229	1.3947
21 Jul 2012 00:14:33	1083329	14795653	hadcm3n_o111_1980_40_007832571_3	881,280	1,229,287	1.3949
20 Jul 2012 11:02:28	1083329	14795653	hadcm3n_o111_1980_40_007832571_3	855,360	1,193,418	1.3952
18 Jul 2012 10:24:26	1083329	14795653	hadcm3n_o111_1980_40_007832571_3	829,440	1,157,091	1.3950
17 Jul 2012 02:19:00	1083329	14795653	hadcm3n_o111_1980_40_007832571_3	803,520	1,121,189	1.3953
16 Jul 2012 13:17:20	1083329	14795653	hadcm3n_o111_1980_40_007832571_3	777,600	1,085,201	1.3956
15 Jul 2012 21:23:27	1083329	14795653	hadcm3n_o111_1980_40_007832571_3	751,680	1,049,189	1.3958
15 Jul 2012 09:02:21	1083329	14795653	hadcm3n_o111_1980_40_007832571_3	725,760	1,013,142	1.3960
14 Jul 2012 09:05:05	1083329	14795653	hadcm3n_o111_1980_40_007832571_3	699,840	976,880	1.3959
13 Jul 2012 19:31:21	1083329	14795653	hadcm3n_o111_1980_40_007832571_3	673,920	940,422	1.3955
12 Jul 2012 22:12:19	1083329	14795653	hadcm3n_o111_1980_40_007832571_3	648,000	904,271	1.3955
12 Jul 2012 02:10:24	1083329	14795653	hadcm3n_o111_1980_40_007832571_3	622,080	868,584	1.3963
11 Jul 2012 09:23:47	1083329	14795653	hadcm3n_o111_1980_40_007832571_3	596,160	832,236	1.3960
10 Jul 2012 19:19:21	1083329	14795653	hadcm3n_o111_1980_40_007832571_3	570,240	794,824	1.3938
09 Jul 2012 13:15:41	1083329	14795653	hadcm3n_o111_1980_40_007832571_3	544,320	758,217	1.3930