Name | hadcm3n_n7ff_1880_40_008376807_2 |
Workunit | 8527666 |
Created | 5 Jun 2013, 20:40:35 UTC |
Sent | 5 Jun 2013, 21:06:47 UTC |
Report deadline | 5 Sep 2013, 4:33:58 UTC |
Received | 22 Jul 2013, 1:04:24 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 22 (0x00000016) Unknown error code |
Computer ID | 1259807 |
Run time | 7 days 4 hours 53 min 58 sec |
CPU time | 5 days 16 hours 28 min 49 sec |
Validate state | Invalid |
Credit | 3,110.40 |
Device peak FLOPS | 2.34 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin |
Stderr | <core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> ec - exiting 18:01:35 (40398): No heartbeat from core client for 30 sec - exiting 18:01:36 (40398): No heartbeat from core client for 30 sec - exiting 18:01:37 (40398): No heartbeat from core client for 30 sec - exiting 18:01:38 (40398): No heartbeat from core client for 30 sec - exiting 18:01:39 (40398): No heartbeat from core client for 30 sec - exiting 18:01:40 (40398): No heartbeat from core client for 30 sec - exiting 18:01:41 (40398): No heartbeat from core client for 30 sec - exiting 18:01:42 (40398): No heartbeat from core client for 30 sec - exiting 18:01:43 (40398): No heartbeat from core client for 30 sec - exiting 18:01:44 (40398): No heartbeat from core client for 30 sec - exiting 18:01:45 (40398): No heartbeat from core client for 30 sec - exiting 18:01:46 (40398): No heartbeat from core client for 30 sec - exiting 18:01:47 (40398): No heartbeat from core client for 30 sec - exiting 18:01:48 (40398): No heartbeat from core client for 30 sec - exiting 18:01:49 (40398): No heartbeat from core client for 30 sec - exiting 18:01:50 (40398): No heartbeat from core client for 30 sec - exiting 18:01:51 (40398): No heartbeat from core client for 30 sec - exiting 18:01:52 (40398): No heartbeat from core client for 30 sec - exiting 18:01:53 (40398): No heartbeat from core client for 30 sec - exiting 18:01:54 (40398): No heartbeat from core client for 30 sec - exiting 18:01:55 (40398): No heartbeat from core client for 30 sec - exiting 18:01:56 (40398): No heartbeat from core client for 30 sec - exiting 18:01:57 (40398): No heartbeat from core client for 30 sec - exiting 18:01:58 (40398): No heartbeat from core client for 30 sec - exiting 18:01:59 (40398): No heartbeat from core client for 30 sec - exiting 18:02:00 (40398): No heartbeat from core client for 30 sec - exiting 18:02:01 (40398): No heartbeat from core client for 30 sec - exiting 18:02:02 (40398): No heartbeat from core client for 30 sec - exiting 18:02:03 (40398): No heartbeat from core client for 30 sec - exiting 18:02:04 (40398): No heartbeat from core client for 30 sec - exiting 18:02:05 (40398): No heartbeat from core client for 30 sec - exiting 18:02:06 (40398): No heartbeat from core client for 30 sec - exiting 18:02:07 (40398): No heartbeat from core client for 30 sec - exiting 18:02:08 (40398): No heartbeat from core client for 30 sec - exiting 18:02:09 (40398): No heartbeat from core client for 30 sec - exiting 18:02:10 (40398): No heartbeat from core client for 30 sec - exiting 18:02:11 (40398): No heartbeat from core client for 30 sec - exiting 18:02:12 (40398): No heartbeat from core client for 30 sec - exiting 18:02:13 (40398): No heartbeat from core client for 30 sec - exiting 18:02:14 (40398): No heartbeat from core client for 30 sec - exiting 18:02:15 (40398): No heartbeat from core client for 30 sec - exiting 18:02:16 (40398): No heartbeat from core client for 30 sec - exiting 18:02:17 (40398): No heartbeat from core client for 30 sec - exiting 18:02:18 (40398): No heartbeat from core client for 30 sec - exiting 18:02:19 (40398): No heartbeat from core client for 30 sec - exiting 18:02:20 (40398): No heartbeat from core client for 30 sec - exiting 18:02:21 (40398): No heartbeat from core client for 30 sec - exiting 18:02:22 (40398): No heartbeat from core client for 30 sec - exiting 18:02:23 (40398): No heartbeat from core client for 30 sec - exiting dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:41:53 (632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:41:54 (632): No heartbeat from core client for 30 sec - exiting 19:41:55 (632): No heartbeat from core client for 30 sec - exiting 19:41:56 (632): No heartbeat from core client for 30 sec - exiting 19:41:57 (632): No heartbeat from core client for 30 sec - exiting 19:41:58 (632): No heartbeat from core client for 30 sec - exiting 19:41:59 (632): No heartbeat from core client for 30 sec - exiting 19:42:00 (632): No heartbeat from core client for 30 sec - exiting 19:42:01 (632): No heartbeat from core client for 30 sec - exiting 19:42:02 (632): No heartbeat from core client for 30 sec - exiting 19:42:03 (632): No heartbeat from core client for 30 sec - exiting 19:42:04 (632): No heartbeat from core client for 30 sec - exiting 19:42:05 (632): No heartbeat from core client for 30 sec - exiting 19:42:06 (632): No heartbeat from core client for 30 sec - exiting 19:42:07 (632): No heartbeat from core client for 30 sec - exiting 19:42:08 (632): No heartbeat from core client for 30 sec - exiting 19:42:09 (632): No heartbeat from core client for 30 sec - exiting 19:42:10 (632): No heartbeat from core client for 30 sec - exiting 19:42:11 (632): No heartbeat from core client for 30 sec - exiting 19:42:12 (632): No heartbeat from core client for 30 sec - exiting 19:42:13 (632): No heartbeat from core client for 30 sec - exiting 19:42:14 (632): No heartbeat from core client for 30 sec - exiting 19:42:15 (632): No heartbeat from core client for 30 sec - exiting 19:42:16 (632): No heartbeat from core client for 30 sec - exiting 19:42:17 (632): No heartbeat from core client for 30 sec - exiting 19:42:18 (632): No heartbeat from core client for 30 sec - exiting 19:42:19 (632): No heartbeat from core client for 30 sec - exiting 19:42:20 (632): No heartbeat from core client for 30 sec - exiting 19:42:21 (632): No heartbeat from core client for 30 sec - exiting 19:42:22 (632): No heartbeat from core client for 30 sec - exiting 19:42:23 (632): No heartbeat from core client for 30 sec - exiting 19:42:24 (632): No heartbeat from core client for 30 sec - exiting 19:42:25 (632): No heartbeat from core client for 30 sec - exiting 19:42:26 (632): No heartbeat from core client for 30 sec - exiting 19:42:27 (632): No heartbeat from core client for 30 sec - exiting 19:42:29 (632): No heartbeat from core client for 30 sec - exiting 19:42:30 (632): No heartbeat from core client for 30 sec - exiting 19:42:31 (632): No heartbeat from core client for 30 sec - exiting 19:42:32 (632): No heartbeat from core client for 30 sec - exiting 19:42:33 (632): No heartbeat from core client for 30 sec - exiting 19:42:34 (632): No heartbeat from core client for 30 sec - exiting 19:42:35 (632): No heartbeat from core client for 30 sec - exiting 19:42:36 (632): No heartbeat from core client for 30 sec - exiting 19:42:37 (632): No heartbeat from core client for 30 sec - exiting 19:42:38 (632): No heartbeat from core client for 30 sec - exiting 19:42:39 (632): No heartbeat from core client for 30 sec - exiting 19:42:40 (632): No heartbeat from core client for 30 sec - exiting 19:42:41 (632): No heartbeat from core client for 30 sec - exiting 19:42:42 (632): No heartbeat from core client for 30 sec - exiting 19:42:43 (632): No heartbeat from core client for 30 sec - exiting dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:30:11 (1052): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:28:34 (2320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:29:17 (2320): No heartbeat from core client for 30 sec - exiting 22:29:18 (2320): No heartbeat from core client for 30 sec - exiting 22:29:19 (2320): No heartbeat from core client for 30 sec - exiting 22:29:20 (2320): No heartbeat from core client for 30 sec - exiting 22:29:21 (2320): No heartbeat from core client for 30 sec - exiting 22:29:22 (2320): No heartbeat from core client for 30 sec - exiting 22:29:23 (2320): No heartbeat from core client for 30 sec - exiting 22:29:24 (2320): No heartbeat from core client for 30 sec - exiting 22:29:25 (2320): No heartbeat from core client for 30 sec - exiting 22:29:26 (2320): No heartbeat from core client for 30 sec - exiting 22:29:27 (2320): No heartbeat from core client for 30 sec - exiting 22:29:28 (2320): No heartbeat from core client for 30 sec - exiting 22:29:29 (2320): No heartbeat from core client for 30 sec - exiting 22:29:30 (2320): No heartbeat from core client for 30 sec - exiting 22:29:31 (2320): No heartbeat from core client for 30 sec - exiting 22:29:32 (2320): No heartbeat from core client for 30 sec - exiting 22:29:33 (2320): No heartbeat from core client for 30 sec - exiting 22:29:34 (2320): No heartbeat from core client for 30 sec - exiting 22:29:35 (2320): No heartbeat from core client for 30 sec - exiting 22:29:36 (2320): No heartbeat from core client for 30 sec - exiting 22:29:37 (2320): No heartbeat from core client for 30 sec - exiting 22:29:38 (2320): No heartbeat from core client for 30 sec - exiting 22:29:39 (2320): No heartbeat from core client for 30 sec - exiting 22:29:40 (2320): No heartbeat from core client for 30 sec - exiting 22:29:41 (2320): No heartbeat from core client for 30 sec - exiting 22:29:42 (2320): No heartbeat from core client for 30 sec - exiting dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:30:44 (3010): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid 00:32:42 (3895): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:32:43 (3895): No heartbeat from core client for 30 sec - exiting 00:32:44 (3895): No heartbeat from core client for 30 sec - exiting 00:32:45 (3895): No heartbeat from core client for 30 sec - exiting 00:32:46 (3895): No heartbeat from core client for 30 sec - exiting 00:32:47 (3895): No heartbeat from core client for 30 sec - exiting 00:32:48 (3895): No heartbeat from core client for 30 sec - exiting 00:32:49 (3895): No heartbeat from core client for 30 sec - exiting 00:32:50 (3895): No heartbeat from core client for 30 sec - exiting 00:32:51 (3895): No heartbeat from core client for 30 sec - exiting 00:32:52 (3895): No heartbeat from core client for 30 sec - exiting 00:32:53 (3895): No heartbeat from core client for 30 sec - exiting 00:32:54 (3895): No heartbeat from core client for 30 sec - exiting 00:32:55 (3895): No heartbeat from core client for 30 sec - exiting 00:32:56 (3895): No heartbeat from core client for 30 sec - exiting 00:32:57 (3895): No heartbeat from core client for 30 sec - exiting 00:32:58 (3895): No heartbeat from core client for 30 sec - exiting 00:32:59 (3895): No heartbeat from core client for 30 sec - exiting 00:33:00 (3895): No heartbeat from core client for 30 sec - exiting 00:33:01 (3895): No heartbeat from core client for 30 sec - exiting 00:33:02 (3895): No heartbeat from core client for 30 sec - exiting 00:33:03 (3895): No heartbeat from core client for 30 sec - exiting 00:33:04 (3895): No heartbeat from core client for 30 sec - exiting 00:33:05 (3895): No heartbeat from core client for 30 sec - exiting 00:33:06 (3895): No heartbeat from core client for 30 sec - exiting 00:33:07 (3895): No heartbeat from core client for 30 sec - exiting 00:33:08 (3895): No heartbeat from core client for 30 sec - exiting 00:33:09 (3895): No heartbeat from core client for 30 sec - exiting 00:33:10 (3895): No heartbeat from core client for 30 sec - exiting 00:33:11 (3895): No heartbeat from core client for 30 sec - exiting 00:33:12 (3895): No heartbeat from core client for 30 sec - exiting 00:33:13 (3895): No heartbeat from core client for 30 sec - exiting 00:33:14 (3895): No heartbeat from core client for 30 sec - exiting 00:33:15 (3895): No heartbeat from core client for 30 sec - exiting 00:33:16 (3895): No heartbeat from core client for 30 sec - exiting 00:33:17 (3895): No heartbeat from core client for 30 sec - exiting 00:33:18 (3895): No heartbeat from core client for 30 sec - exiting 00:33:19 (3895): No heartbeat from core client for 30 sec - exiting 00:33:20 (3895): No heartbeat from core client for 30 sec - exiting 00:33:21 (3895): No heartbeat from core client for 30 sec - exiting 00:33:22 (3895): No heartbeat from core client for 30 sec - exiting 00:33:23 (3895): No heartbeat from core client for 30 sec - exiting 00:33:24 (3895): No heartbeat from core client for 30 sec - exiting 00:33:25 (3895): No heartbeat from core client for 30 sec - exiting 00:33:26 (3895): No heartbeat from core client for 30 sec - exiting 00:33:27 (3895): No heartbeat from core client for 30 sec - exiting 00:33:28 (3895): No heartbeat from core client for 30 sec - exiting 00:33:29 (3895): No heartbeat from core client for 30 sec - exiting 00:33:30 (3895): No heartbeat from core client for 30 sec - exiting 00:33:31 (3895): No heartbeat from core client for 30 sec - exiting 00:33:32 (3895): No heartbeat from core client for 30 sec - exiting 00:33:33 (3895): No heartbeat from core client for 30 sec - exiting dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid 01:32:48 (4527): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:34:21 (4527): No heartbeat from core client for 30 sec - exiting dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid 02:34:27 (5161): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... 03:33:51 (5801): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:35:12 (5801): No heartbeat from core client for 30 sec - exiting 03:35:13 (5801): No heartbeat from core client for 30 sec - exiting 03:35:14 (5801): No heartbeat from core client for 30 sec - exiting 03:35:15 (5801): No heartbeat from core client for 30 sec - exiting 03:35:16 (5801): No heartbeat from core client for 30 sec - exiting 03:35:17 (5801): No heartbeat from core client for 30 sec - exiting 03:35:18 (5801): No heartbeat from core client for 30 sec - exiting 03:35:19 (5801): No heartbeat from core client for 30 sec - exiting 03:35:20 (5801): No heartbeat from core client for 30 sec - exiting 03:35:21 (5801): No heartbeat from core client for 30 sec - exiting 03:35:22 (5801): No heartbeat from core client for 30 sec - exiting 03:35:23 (5801): No heartbeat from core client for 30 sec - exiting 03:35:24 (5801): No heartbeat from core client for 30 sec - exiting 03:35:25 (5801): No heartbeat from core client for 30 sec - exiting 03:35:26 (5801): No heartbeat from core client for 30 sec - exiting 03:35:27 (5801): No heartbeat from core client for 30 sec - exiting 03:35:28 (5801): No heartbeat from core client for 30 sec - exiting 03:35:29 (5801): No heartbeat from core client for 30 sec - exiting 03:35:30 (5801): No heartbeat from core client for 30 sec - exiting 03:35:31 (5801): No heartbeat from core client for 30 sec - exiting 03:35:32 (5801): No heartbeat from core client for 30 sec - exiting 03:35:33 (5801): No heartbeat from core client for 30 sec - exiting 03:35:34 (5801): No heartbeat from core client for 30 sec - exiting 03:35:35 (5801): No heartbeat from core client for 30 sec - exiting 03:35:36 (5801): No heartbeat from core client for 30 sec - exiting 03:35:37 (5801): No heartbeat from core client for 30 sec - exiting 03:35:38 (5801): No heartbeat from core client for 30 sec - exiting 03:35:39 (5801): No heartbeat from core client for 30 sec - exiting 03:35:40 (5801): No heartbeat from core client for 30 sec - exiting 03:35:42 (5801): No heartbeat from core client for 30 sec - exiting 03:35:43 (5801): No heartbeat from core client for 30 sec - exiting 03:35:44 (5801): No heartbeat from core client for 30 sec - exiting 03:35:45 (5801): No heartbeat from core client for 30 sec - exiting 03:35:46 (5801): No heartbeat from core client for 30 sec - exiting 03:35:47 (5801): No heartbeat from core client for 30 sec - exiting 03:35:48 (5801): No heartbeat from core client for 30 sec - exiting 03:35:49 (5801): No heartbeat from core client for 30 sec - exiting 03:35:50 (5801): No heartbeat from core client for 30 sec - exiting 03:35:51 (5801): No heartbeat from core client for 30 sec - exiting 03:35:52 (5801): No heartbeat from core client for 30 sec - exiting 03:35:53 (5801): No heartbeat from core client for 30 sec - exiting 03:35:54 (5801): No heartbeat from core client for 30 sec - exiting 03:35:55 (5801): No heartbeat from core client for 30 sec - exiting 03:35:56 (5801): No heartbeat from core client for 30 sec - exiting 03:35:57 (5801): No heartbeat from core client for 30 sec - exiting 03:35:58 (5801): No heartbeat from core client for 30 sec - exiting dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid 04:34:56 (6503): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0x136ae04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0x136ae00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0xb92804: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0xb92800: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0x134f804: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0x136ae04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0x136ae00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0xb77204: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0xb92804: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0xb92800: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0xb92804: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0xb92800: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0xb92804: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0xb92800: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0xb92804: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0xb92800: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0xb92804: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0xb92800: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0xb92804: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0xb92800: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0xb46a04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0xb46a00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0xb46a04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0xb46a00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7095,0xac6ffa28) malloc: *** error for object 0xb46a00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation 05:36:40 (7095): No heartbeat from core client for 30 sec - exiting 05:37:35 (7095): No heartbeat from core client for 30 sec - exiting 05:37:36 (7095): No heartbeat from core client for 30 sec - exiting 05:37:37 (7095): No heartbeat from core client for 30 sec - exiting 05:37:38 (7095): No heartbeat from core client for 30 sec - exiting 05:37:39 (7095): No heartbeat from core client for 30 sec - exiting 05:37:40 (7095): No heartbeat from core client for 30 sec - exiting 05:37:41 (7095): No heartbeat from core client for 30 sec - exiting 05:37:42 (7095): No heartbeat from core client for 30 sec - exiting 05:37:43 (7095): No heartbeat from core client for 30 sec - exiting 05:37:44 (7095): No heartbeat from core client for 30 sec - exiting 05:37:45 (7095): No heartbeat from core client for 30 sec - exiting 05:37:46 (7095): No heartbeat from core client for 30 sec - exiting 05:37:47 (7095): No heartbeat from core client for 30 sec - exiting 05:37:48 (7095): No heartbeat from core client for 30 sec - exiting 05:37:49 (7095): No heartbeat from core client for 30 sec - exiting 05:37:50 (7095): No heartbeat from core client for 30 sec - exiting 05:37:51 (7095): No heartbeat from core client for 30 sec - exiting 05:37:52 (7095): No heartbeat from core client for 30 sec - exiting 05:37:53 (7095): No heartbeat from core client for 30 sec - exiting 05:37:54 (7095): No heartbeat from core client for 30 sec - exiting 05:37:55 (7095): No heartbeat from core client for 30 sec - exiting 05:37:56 (7095): No heartbeat from core client for 30 sec - exiting 05:37:57 (7095): No heartbeat from core client for 30 sec - exiting 05:37:58 (7095): No heartbeat from core client for 30 sec - exiting 05:37:59 (7095): No heartbeat from core client for 30 sec - exiting 05:38:00 (7095): No heartbeat from core client for 30 sec - exiting 05:38:01 (7095): No heartbeat from core client for 30 sec - exiting 05:38:02 (7095): No heartbeat from core client for 30 sec - exiting 05:38:03 (7095): No heartbeat from core client for 30 sec - exiting 06:37:56 (7095): No heartbeat from core client for 30 sec - exiting 06:39:24 (7095): No heartbeat from core client for 30 sec - exiting 06:39:25 (7095): No heartbeat from core client for 30 sec - exiting 06:39:26 (7095): No heartbeat from core client for 30 sec - exiting 06:39:27 (7095): No heartbeat from core client for 30 sec - exiting 06:39:28 (7095): No heartbeat from core client for 30 sec - exiting 06:39:29 (7095): No heartbeat from core client for 30 sec - exiting 06:39:30 (7095): No heartbeat from core client for 30 sec - exiting 06:39:31 (7095): No heartbeat from core client for 30 sec - exiting 06:39:32 (7095): No heartbeat from core client for 30 sec - exiting 06:39:33 (7095): No heartbeat from core client for 30 sec - exiting 06:39:34 (7095): No heartbeat from core client for 30 sec - exiting 06:39:36 (7095): No heartbeat from core client for 30 sec - exiting 06:39:37 (7095): No heartbeat from core client for 30 sec - exiting 06:39:38 (7095): No heartbeat from core client for 30 sec - exiting 06:39:39 (7095): No heartbeat from core client for 30 sec - exiting 06:39:40 (7095): No heartbeat from core client for 30 sec - exiting 06:39:41 (7095): No heartbeat from core client for 30 sec - exiting 06:39:42 (7095): No heartbeat from core client for 30 sec - exiting 06:39:43 (7095): No heartbeat from core client for 30 sec - exiting 06:39:44 (7095): No heartbeat from core client for 30 sec - exiting 06:39:45 (7095): No heartbeat from core client for 30 sec - exiting 06:39:46 (7095): No heartbeat from core client for 30 sec - exiting 06:39:47 (7095): No heartbeat from core client for 30 sec - exiting 06:39:48 (7095): No heartbeat from core client for 30 sec - exiting 06:39:49 (7095): No heartbeat from core client for 30 sec - exiting 06:39:50 (7095): No heartbeat from core client for 30 sec - exiting 06:39:51 (7095): No heartbeat from core client for 30 sec - exiting 06:39:52 (7095): No heartbeat from core client for 30 sec - exiting 06:39:53 (7095): No heartbeat from core client for 30 sec - exiting 06:39:54 (7095): No heartbeat from core client for 30 sec - exiting 06:39:55 (7095): No heartbeat from core client for 30 sec - exiting 06:39:56 (7095): No heartbeat from core client for 30 sec - exiting 06:39:57 (7095): No heartbeat from core client for 30 sec - exiting 06:39:58 (7095): No heartbeat from core client for 30 sec - exiting 06:39:59 (7095): No heartbeat from core client for 30 sec - exiting 06:40:00 (7095): No heartbeat from core client for 30 sec - exiting 06:40:01 (7095): No heartbeat from core client for 30 sec - exiting 06:40:02 (7095): No heartbeat from core client for 30 sec - exiting 06:40:03 (7095): No heartbeat from core client for 30 sec - exiting 07:39:31 (7095): No heartbeat from core client for 30 sec - exiting 07:41:00 (7095): No heartbeat from core client for 30 sec - exiting 07:41:01 (7095): No heartbeat from core client for 30 sec - exiting 07:41:02 (7095): No heartbeat from core client for 30 sec - exiting 07:41:03 (7095): No heartbeat from core client for 30 sec - exiting 07:41:04 (7095): No heartbeat from core client for 30 sec - exiting 07:41:05 (7095): No heartbeat from core client for 30 sec - exiting 07:41:06 (7095): No heartbeat from core client for 30 sec - exiting 07:41:07 (7095): No heartbeat from core client for 30 sec - exiting 07:41:08 (7095): No heartbeat from core client for 30 sec - exiting 07:41:09 (7095): No heartbeat from core client for 30 sec - exiting 07:41:10 (7095): No heartbeat from core client for 30 sec - exiting 07:41:11 (7095): No heartbeat from core client for 30 sec - exiting 07:41:12 (7095): No heartbeat from core client for 30 sec - exiting 07:41:13 (7095): No heartbeat from core client for 30 sec - exiting 07:41:14 (7095): No heartbeat from core client for 30 sec - exiting 07:41:15 (7095): No heartbeat from core client for 30 sec - exiting 07:41:16 (7095): No heartbeat from core client for 30 sec - exiting 07:41:17 (7095): No heartbeat from core client for 30 sec - exiting 07:41:18 (7095): No heartbeat from core client for 30 sec - exiting 07:41:19 (7095): No heartbeat from core client for 30 sec - exiting 08:41:15 (7095): No heartbeat from core client for 30 sec - exiting 08:43:16 (7095): No heartbeat from core client for 30 sec - exiting 08:43:17 (7095): No heartbeat from core client for 30 sec - exiting 08:43:18 (7095): No heartbeat from core client for 30 sec - exiting 08:43:19 (7095): No heartbeat from core client for 30 sec - exiting 08:43:20 (7095): No heartbeat from core client for 30 sec - exiting 08:43:21 (7095): No heartbeat from core client for 30 sec - exiting 08:43:22 (7095): No heartbeat from core client for 30 sec - exiting 08:43:23 (7095): No heartbeat from core client for 30 sec - exiting 08:43:24 (7095): No heartbeat from core client for 30 sec - exiting 08:43:25 (7095): No heartbeat from core client for 30 sec - exiting 09:40:33 (7095): No heartbeat from core client for 30 sec - exiting 09:42:00 (7095): No heartbeat from core client for 30 sec - exiting 09:42:01 (7095): No heartbeat from core client for 30 sec - exiting 09:42:02 (7095): No heartbeat from core client for 30 sec - exiting 09:42:03 (7095): No heartbeat from core client for 30 sec - exiting 09:42:04 (7095): No heartbeat from core client for 30 sec - exiting 09:42:05 (7095): No heartbeat from core client for 30 sec - exiting 09:42:06 (7095): No heartbeat from core client for 30 sec - exiting 09:42:07 (7095): No heartbeat from core client for 30 sec - exiting 09:42:08 (7095): No heartbeat from core client for 30 sec - exiting 09:42:09 (7095): No heartbeat from core client for 30 sec - exiting 09:42:10 (7095): No heartbeat from core client for 30 sec - exiting 09:42:11 (7095): No heartbeat from core client for 30 sec - exiting 09:42:12 (7095): No heartbeat from core client for 30 sec - exiting 09:42:13 (7095): No heartbeat from core client for 30 sec - exiting 09:42:14 (7095): No heartbeat from core client for 30 sec - exiting 09:42:15 (7095): No heartbeat from core client for 30 sec - exiting 09:42:16 (7095): No heartbeat from core client for 30 sec - exiting 09:42:17 (7095): No heartbeat from core client for 30 sec - exiting 09:42:19 (7095): No heartbeat from core client for 30 sec - exiting 09:42:20 (7095): No heartbeat from core client for 30 sec - exiting 09:42:21 (7095): No heartbeat from core client for 30 sec - exiting 09:42:22 (7095): No heartbeat from core client for 30 sec - exiting 09:42:23 (7095): No heartbeat from core client for 30 sec - exiting 09:42:24 (7095): No heartbeat from core client for 30 sec - exiting 09:42:25 (7095): No heartbeat from core client for 30 sec - exiting 09:42:26 (7095): No heartbeat from core client for 30 sec - exiting 09:42:27 (7095): No heartbeat from core client for 30 sec - exiting 09:42:28 (7095): No heartbeat from core client for 30 sec - exiting 09:42:29 (7095): No heartbeat from core client for 30 sec - exiting 09:42:30 (7095): No heartbeat from core client for 30 sec - exiting 09:42:31 (7095): No heartbeat from core client for 30 sec - exiting 09:42:32 (7095): No heartbeat from core client for 30 sec - exiting 09:42:33 (7095): No heartbeat from core client for 30 sec - exiting 09:42:34 (7095): No heartbeat from core client for 30 sec - exiting 09:42:35 (7095): No heartbeat from core client for 30 sec - exiting 09:42:36 (7095): No heartbeat from core client for 30 sec - exiting 09:42:37 (7095): No heartbeat from core client for 30 sec - exiting 09:42:38 (7095): No heartbeat from core client for 30 sec - exiting 09:42:39 (7095): No heartbeat from core client for 30 sec - exiting 09:42:40 (7095): No heartbeat from core client for 30 sec - exiting 09:42:41 (7095): No heartbeat from core client for 30 sec - exiting 09:42:42 (7095): No heartbeat from core client for 30 sec - exiting 09:42:43 (7095): No heartbeat from core client for 30 sec - exiting 09:42:44 (7095): No heartbeat from core client for 30 sec - exiting 09:42:45 (7095): No heartbeat from core client for 30 sec - exiting 09:42:46 (7095): No heartbeat from core client for 30 sec - exiting 09:42:47 (7095): No heartbeat from core client for 30 sec - exiting 09:42:48 (7095): No heartbeat from core client for 30 sec - exiting 10:42:03 (7095): No heartbeat from core client for 30 sec - exiting 11:45:44 (7095): No heartbeat from core client for 30 sec - exiting 12:44:10 (7095): No heartbeat from core client for 30 sec - exiting 12:44:57 (7095): No heartbeat from core client for 30 sec - exiting 12:44:58 (7095): No heartbeat from core client for 30 sec - exiting 12:44:59 (7095): No heartbeat from core client for 30 sec - exiting 12:45:00 (7095): No heartbeat from core client for 30 sec - exiting 12:45:01 (7095): No heartbeat from core client for 30 sec - exiting 12:45:02 (7095): No heartbeat from core client for 30 sec - exiting 12:45:03 (7095): No heartbeat from core client for 30 sec - exiting 12:45:04 (7095): No heartbeat from core client for 30 sec - exiting 12:45:05 (7095): No heartbeat from core client for 30 sec - exiting 12:45:06 (7095): No heartbeat from core client for 30 sec - exiting 12:45:07 (7095): No heartbeat from core client for 30 sec - exiting 12:45:08 (7095): No heartbeat from core client for 30 sec - exiting 12:45:09 (7095): No heartbeat from core client for 30 sec - exiting 12:45:10 (7095): No heartbeat from core client for 30 sec - exiting 12:45:11 (7095): No heartbeat from core client for 30 sec - exiting 12:45:12 (7095): No heartbeat from core client for 30 sec - exiting 12:45:13 (7095): No heartbeat from core client for 30 sec - exiting 12:45:14 (7095): No heartbeat from core client for 30 sec - exiting 12:45:15 (7095): No heartbeat from core client for 30 sec - exiting 12:45:16 (7095): No heartbeat from core client for 30 sec - exiting 12:45:17 (7095): No heartbeat from core client for 30 sec - exiting 12:45:18 (7095): No heartbeat from core client for 30 sec - exiting 12:45:19 (7095): No heartbeat from core client for 30 sec - exiting 12:45:20 (7095): No heartbeat from core client for 30 sec - exiting 12:45:21 (7095): No heartbeat from core client for 30 sec - exiting 12:45:22 (7095): No heartbeat from core client for 30 sec - exiting 12:45:23 (7095): No heartbeat from core client for 30 sec - exiting 12:45:24 (7095): No heartbeat from core client for 30 sec - exiting 12:45:25 (7095): No heartbeat from core client for 30 sec - exiting 12:45:26 (7095): No heartbeat from core client for 30 sec - exiting 12:45:27 (7095): No heartbeat from core client for 30 sec - exiting 12:45:28 (7095): No heartbeat from core client for 30 sec - exiting 12:45:29 (7095): No heartbeat from core client for 30 sec - exiting 12:45:30 (7095): No heartbeat from core client for 30 sec - exiting 12:45:31 (7095): No heartbeat from core client for 30 sec - exiting 12:45:32 (7095): No heartbeat from core client for 30 sec - exiting 12:45:33 (7095): No heartbeat from core client for 30 sec - exiting 12:45:34 (7095): No heartbeat from core client for 30 sec - exiting 12:45:35 (7095): No heartbeat from core client for 30 sec - exiting 12:45:36 (7095): No heartbeat from core client for 30 sec - exiting 12:45:37 (7095): No heartbeat from core client for 30 sec - exiting 12:45:38 (7095): No heartbeat from core client for 30 sec - exiting 12:45:39 (7095): No heartbeat from core client for 30 sec - exiting 12:45:40 (7095): No heartbeat from core client for 30 sec - exiting 12:45:41 (7095): No heartbeat from core client for 30 sec - exiting 12:45:42 (7095): No heartbeat from core client for 30 sec - exiting 12:45:43 (7095): No heartbeat from core client for 30 sec - exiting 12:45:44 (7095): No heartbeat from core client for 30 sec - exiting 12:45:46 (7095): No heartbeat from core client for 30 sec - exiting 12:45:47 (7095): No heartbeat from core client for 30 sec - exiting 12:45:48 (7095): No heartbeat from core client for 30 sec - exiting 12:45:49 (7095): No heartbeat from core client for 30 sec - exiting 12:45:50 (7095): No heartbeat from core client for 30 sec - exiting 12:45:51 (7095): No heartbeat from core client for 30 sec - exiting 12:45:52 (7095): No heartbeat from core client for 30 sec - exiting 12:45:53 (7095): No heartbeat from core client for 30 sec - exiting 12:45:54 (7095): No heartbeat from core client for 30 sec - exiting 13:45:05 (7095): No heartbeat from core client for 30 sec - exiting 13:45:06 (7095): No heartbeat from core client for 30 sec - exiting 13:45:07 (7095): No heartbeat from core client for 30 sec - exiting 13:45:08 (7095): No heartbeat from core client for 30 sec - exiting 13:45:09 (7095): No heartbeat from core client for 30 sec - exiting 13:45:10 (7095): No heartbeat from core client for 30 sec - exiting 13:45:11 (7095): No heartbeat from core client for 30 sec - exiting 13:45:12 (7095): No heartbeat from core client for 30 sec - exiting 13:45:13 (7095): No heartbeat from core client for 30 sec - exiting 13:45:14 (7095): No heartbeat from core client for 30 sec - exiting 13:45:15 (7095): No heartbeat from core client for 30 sec - exiting 13:45:16 (7095): No heartbeat from core client for 30 sec - exiting 13:45:17 (7095): No heartbeat from core client for 30 sec - exiting 13:45:18 (7095): No heartbeat from core client for 30 sec - exiting 13:45:19 (7095): No heartbeat from core client for 30 sec - exiting 13:45:20 (7095): No heartbeat from core client for 30 sec - exiting 13:45:21 (7095): No heartbeat from core client for 30 sec - exiting 13:45:22 (7095): No heartbeat from core client for 30 sec - exiting 13:45:23 (7095): No heartbeat from core client for 30 sec - exiting 13:45:24 (7095): No heartbeat from core client for 30 sec - exiting 13:45:25 (7095): No heartbeat from core client for 30 sec - exiting 13:45:26 (7095): No heartbeat from core client for 30 sec - exiting 13:45:27 (7095): No heartbeat from core client for 30 sec - exiting 13:45:28 (7095): No heartbeat from core client for 30 sec - exiting 13:45:29 (7095): No heartbeat from core client for 30 sec - exiting 13:45:30 (7095): No heartbeat from core client for 30 sec - exiting 13:45:31 (7095): No heartbeat from core client for 30 sec - exiting 13:45:32 (7095): No heartbeat from core client for 30 sec - exiting 13:45:33 (7095): No heartbeat from core client for 30 sec - exiting 13:45:34 (7095): No heartbeat from core client for 30 sec - exiting 13:45:35 (7095): No heartbeat from core client for 30 sec - exiting 13:45:36 (7095): No heartbeat from core client for 30 sec - exiting 13:45:37 (7095): No heartbeat from core client for 30 sec - exiting 13:45:38 (7095): No heartbeat from core client for 30 sec - exiting 13:45:39 (7095): No heartbeat from core client for 30 sec - exiting 13:45:40 (7095): No heartbeat from core client for 30 sec - exiting 13:45:41 (7095): No heartbeat from core client for 30 sec - exiting 13:45:42 (7095): No heartbeat from core client for 30 sec - exiting 13:45:43 (7095): No heartbeat from core client for 30 sec - exiting 13:45:44 (7095): No heartbeat from core client for 30 sec - exiting 13:45:45 (7095): No heartbeat from core client for 30 sec - exiting 13:45:46 (7095): No heartbeat from core client for 30 sec - exiting 13:45:47 (7095): No heartbeat from core client for 30 sec - exiting 13:45:48 (7095): No heartbeat from core client for 30 sec - exiting 13:45:49 (7095): No heartbeat from core client for 30 sec - exiting 13:45:50 (7095): No heartbeat from core client for 30 sec - exiting 13:45:51 (7095): No heartbeat from core client for 30 sec - exiting 13:45:52 (7095): No heartbeat from core client for 30 sec - exiting 13:45:53 (7095): No heartbeat from core client for 30 sec - exiting 13:45:54 (7095): No heartbeat from core client for 30 sec - exiting 13:45:55 (7095): No heartbeat from core client for 30 sec - exiting 13:45:56 (7095): No heartbeat from core client for 30 sec - exiting 13:45:57 (7095): No heartbeat from core client for 30 sec - exiting 13:45:58 (7095): No heartbeat from core client for 30 sec - exiting 13:45:59 (7095): No heartbeat from core client for 30 sec - exiting 13:46:00 (7095): No heartbeat from core client for 30 sec - exiting 13:46:01 (7095): No heartbeat from core client for 30 sec - exiting 13:46:02 (7095): No heartbeat from core client for 30 sec - exiting 13:46:03 (7095): No heartbeat from core client for 30 sec - exiting 13:46:04 (7095): No heartbeat from core client for 30 sec - exiting 14:44:48 (7095): No heartbeat from core client for 30 sec - exiting 14:44:49 (7095): No heartbeat from core client for 30 sec - exiting 14:44:50 (7095): No heartbeat from core client for 30 sec - exiting 14:44:51 (7095): No heartbeat from core client for 30 sec - exiting 14:44:52 (7095): No heartbeat from core client for 30 sec - exiting 14:44:53 (7095): No heartbeat from core client for 30 sec - exiting 14:44:54 (7095): No heartbeat from core client for 30 sec - exiting 14:44:55 (7095): No heartbeat from core client for 30 sec - exiting 14:44:56 (7095): No heartbeat from core client for 30 sec - exiting 14:44:57 (7095): No heartbeat from core client for 30 sec - exiting 14:44:58 (7095): No heartbeat from core client for 30 sec - exiting 14:44:59 (7095): No heartbeat from core client for 30 sec - exiting 14:45:00 (7095): No heartbeat from core client for 30 sec - exiting 14:45:01 (7095): No heartbeat from core client for 30 sec - exiting 14:45:02 (7095): No heartbeat from core client for 30 sec - exiting 14:45:03 (7095): No heartbeat from core client for 30 sec - exiting 14:45:04 (7095): No heartbeat from core client for 30 sec - exiting 14:45:05 (7095): No heartbeat from core client for 30 sec - exiting 14:45:06 (7095): No heartbeat from core client for 30 sec - exiting 14:45:07 (7095): No heartbeat from core client for 30 sec - exiting 14:45:08 (7095): No heartbeat from core client for 30 sec - exiting 14:45:09 (7095): No heartbeat from core client for 30 sec - exiting 14:45:10 (7095): No heartbeat from core client for 30 sec - exiting 14:45:11 (7095): No heartbeat from core client for 30 sec - exiting 14:45:12 (7095): No heartbeat from core client for 30 sec - exiting 14:45:13 (7095): No heartbeat from core client for 30 sec - exiting 14:45:14 (7095): No heartbeat from core client for 30 sec - exiting 14:45:15 (7095): No heartbeat from core client for 30 sec - exiting 14:45:17 (7095): No heartbeat from core client for 30 sec - exiting 14:45:18 (7095): No heartbeat from core client for 30 sec - exiting 14:45:19 (7095): No heartbeat from core client for 30 sec - exiting 14:45:20 (7095): No heartbeat from core client for 30 sec - exiting 14:45:21 (7095): No heartbeat from core client for 30 sec - exiting 14:45:22 (7095): No heartbeat from core client for 30 sec - exiting 14:45:23 (7095): No heartbeat from core client for 30 sec - exiting 14:45:24 (7095): No heartbeat from core client for 30 sec - exiting 14:45:25 (7095): No heartbeat from core client for 30 sec - exiting 14:45:26 (7095): No heartbeat from core client for 30 sec - exiting 14:45:27 (7095): No heartbeat from core client for 30 sec - exiting 14:45:28 (7095): No heartbeat from core client for 30 sec - exiting 14:45:29 (7095): No heartbeat from core client for 30 sec - exiting 14:45:30 (7095): No heartbeat from core client for 30 sec - exiting 14:45:31 (7095): No heartbeat from core client for 30 sec - exiting 14:45:32 (7095): No heartbeat from core client for 30 sec - exiting 14:45:33 (7095): No heartbeat from core client for 30 sec - exiting 14:45:34 (7095): No heartbeat from core client for 30 sec - exiting 14:45:35 (7095): No heartbeat from core client for 30 sec - exiting 14:45:36 (7095): No heartbeat from core client for 30 sec - exiting 14:45:37 (7095): No heartbeat from core client for 30 sec - exiting 14:45:38 (7095): No heartbeat from core client for 30 sec - exiting 14:45:39 (7095): No heartbeat from core client for 30 sec - exiting 14:45:40 (7095): No heartbeat from core client for 30 sec - exiting 14:45:41 (7095): No heartbeat from core client for 30 sec - exiting 14:45:42 (7095): No heartbeat from core client for 30 sec - exiting 14:45:43 (7095): No heartbeat from core client for 30 sec - exiting 14:45:44 (7095): No heartbeat from core client for 30 sec - exiting 14:45:45 (7095): No heartbeat from core client for 30 sec - exiting 14:45:46 (7095): No heartbeat from core client for 30 sec - exiting 14:45:47 (7095): No heartbeat from core client for 30 sec - exiting 14:45:48 (7095): No heartbeat from core client for 30 sec - exiting 14:45:49 (7095): No heartbeat from core client for 30 sec - exiting 15:48:20 (7095): No heartbeat from core client for 30 sec - exiting 15:49:12 (7095): No heartbeat from core client for 30 sec - exiting 16:48:27 (7095): No heartbeat from core client for 30 sec - exiting 16:48:44 (7095): No heartbeat from core client for 30 sec - exiting 16:48:45 (7095): No heartbeat from core client for 30 sec - exiting 16:48:46 (7095): No heartbeat from core client for 30 sec - exiting 16:48:47 (7095): No heartbeat from core client for 30 sec - exiting 16:48:48 (7095): No heartbeat from core client for 30 sec - exiting 16:48:49 (7095): No heartbeat from core client for 30 sec - exiting 16:48:50 (7095): No heartbeat from core client for 30 sec - exiting 16:48:51 (7095): No heartbeat from core client for 30 sec - exiting 16:48:52 (7095): No heartbeat from core client for 30 sec - exiting 16:48:53 (7095): No heartbeat from core client for 30 sec - exiting 16:48:54 (7095): No heartbeat from core client for 30 sec - exiting 16:48:55 (7095): No heartbeat from core client for 30 sec - exiting 16:48:56 (7095): No heartbeat from core client for 30 sec - exiting 16:48:57 (7095): No heartbeat from core client for 30 sec - exiting 16:48:58 (7095): No heartbeat from core client for 30 sec - exiting 16:48:59 (7095): No heartbeat from core client for 30 sec - exiting 16:49:00 (7095): No heartbeat from core client for 30 sec - exiting 16:49:01 (7095): No heartbeat from core client for 30 sec - exiting 16:49:02 (7095): No heartbeat from core client for 30 sec - exiting 16:49:03 (7095): No heartbeat from core client for 30 sec - exiting 16:49:04 (7095): No heartbeat from core client for 30 sec - exiting 16:49:05 (7095): No heartbeat from core client for 30 sec - exiting 16:49:06 (7095): No heartbeat from core client for 30 sec - exiting 16:49:07 (7095): No heartbeat from core client for 30 sec - exiting 16:49:08 (7095): No heartbeat from core client for 30 sec - exiting 16:49:09 (7095): No heartbeat from core client for 30 sec - exiting 16:49:10 (7095): No heartbeat from core client for 30 sec - exiting 16:49:11 (7095): No heartbeat from core client for 30 sec - exiting 16:49:12 (7095): No heartbeat from core client for 30 sec - exiting 16:49:13 (7095): No heartbeat from core client for 30 sec - exiting 16:49:14 (7095): No heartbeat from core client for 30 sec - exiting 16:49:15 (7095): No heartbeat from core client for 30 sec - exiting 16:49:16 (7095): No heartbeat from core client for 30 sec - exiting 16:49:18 (7095): No heartbeat from core client for 30 sec - exiting 16:49:19 (7095): No heartbeat from core client for 30 sec - exiting 16:49:20 (7095): No heartbeat from core client for 30 sec - exiting 16:49:21 (7095): No heartbeat from core client for 30 sec - exiting 16:49:22 (7095): No heartbeat from core client for 30 sec - exiting 16:49:23 (7095): No heartbeat from core client for 30 sec - exiting 16:49:24 (7095): No heartbeat from core client for 30 sec - exiting 16:49:25 (7095): No heartbeat from core client for 30 sec - exiting 16:49:26 (7095): No heartbeat from core client for 30 sec - exiting 16:49:27 (7095): No heartbeat from core client for 30 sec - exiting 16:49:28 (7095): No heartbeat from core client for 30 sec - exiting 16:49:29 (7095): No heartbeat from core client for 30 sec - exiting 16:49:30 (7095): No heartbeat from core client for 30 sec - exiting 16:49:31 (7095): No heartbeat from core client for 30 sec - exiting 16:49:32 (7095): No heartbeat from core client for 30 sec - exiting 16:49:33 (7095): No heartbeat from core client for 30 sec - exiting 16:49:34 (7095): No heartbeat from core client for 30 sec - exiting 16:49:35 (7095): No heartbeat from core client for 30 sec - exiting 16:49:36 (7095): No heartbeat from core client for 30 sec - exiting 16:49:37 (7095): No heartbeat from core client for 30 sec - exiting 16:49:38 (7095): No heartbeat from core client for 30 sec - exiting 16:49:39 (7095): No heartbeat from core client for 30 sec - exiting 16:49:40 (7095): No heartbeat from core client for 30 sec - exiting 16:49:41 (7095): No heartbeat from core client for 30 sec - exiting 16:49:58 (7095): No heartbeat from core client for 30 sec - exiting 16:49:59 (7095): No heartbeat from core client for 30 sec - exiting dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid hadcm3n_6.07_i686-apple-darwin(15574,0xac6ffa28) malloc: *** error for object 0x9a3004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15574,0xac6ffa28) malloc: *** error for object 0x1183404: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15574,0xac6ffa28) malloc: *** error for object 0x9a3004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15574,0xac6ffa28) malloc: *** error for object 0x988c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15574,0xac6ffa28) malloc: *** error for object 0x988c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15574,0xac6ffa28) malloc: *** error for object 0x988c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15574,0xac6ffa28) malloc: *** error for object 0x988c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15574,0xac6ffa28) malloc: *** error for object 0x988c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15574,0xac6ffa28) malloc: *** error for object 0x988c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15574,0xac6ffa28) malloc: *** error for object 0x988c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation SIGSEGV: segmentation violation dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid hadcm3n_6.07_i686-apple-darwin(26922,0xac6ffa28) malloc: *** error for object 0x9c4404: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(26922,0xac6ffa28) malloc: *** error for object 0x19a3004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(26922,0xac6ffa28) malloc: *** error for object 0x19a3004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(26922,0xac6ffa28) malloc: *** error for object 0x9c4404: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(26922,0xac6ffa28) malloc: *** error for object 0x19a3004: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(26922,0xac6ffa28) malloc: *** error for object 0x977c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(26922,0xac6ffa28) malloc: *** error for object 0x977c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(26922,0xac6ffa28) malloc: *** error for object 0x1977c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(26922,0xac6ffa28) malloc: *** error for object 0x1977c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(26922,0xac6ffa28) malloc: *** error for object 0x1977c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(26922,0xac6ffa28) malloc: *** error for object 0x1977c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(26922,0xac6ffa28) malloc: *** error for object 0x1977c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(26922,0xac6ffa28) malloc: *** error for object 0x1977c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(26922,0xac6ffa28) malloc: *** error for object 0x977c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(26922,0xac6ffa28) malloc: *** error for object 0x977c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(26922,0xac6ffa28) malloc: *** error for object 0x977c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(26922,0xac6ffa28) malloc: *** error for object 0x977c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(26922,0xac6ffa28) malloc: *** error for object 0x1978c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(26922,0xac6ffa28) malloc: *** error for object 0x1987204: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(26922,0xac6ffa28) malloc: *** error for object 0x1995c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(26922,0xac6ffa28) malloc: *** error for object 0x1995c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_n7ff_1880_40_008376807/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_n7ff_1880_40_008376807/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_n7ff_1880_40_008376807/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_n7ff_1880_40_008376807/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_n7ff_1880_40_008376807/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_n7ff_1880_40_008376807/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_n7ff_1880_40_008376807/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_n7ff_1880_40_008376807/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_n7ff_1880_40_008376807/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_n7ff_1880_40_008376807/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_n7ff_1880_40_008376807/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_n7ff_1880_40_008376807/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
23 Jul 2013 20:58:55 | 1259807 | 15831485 | hadcm3n_n7ff_1880_40_008376807_2 | 259,200 | 468,637 | 1.8080 |
23 Jul 2013 19:48:46 | 1259807 | 15831485 | hadcm3n_n7ff_1880_40_008376807_2 | 233,280 | 420,697 | 1.8034 |
23 Jul 2013 18:47:13 | 1259807 | 15831485 | hadcm3n_n7ff_1880_40_008376807_2 | 207,360 | 373,469 | 1.8011 |
23 Jul 2013 15:38:45 | 1259807 | 15831485 | hadcm3n_n7ff_1880_40_008376807_2 | 181,440 | 326,893 | 1.8017 |
23 Jul 2013 15:38:45 | 1259807 | 15831485 | hadcm3n_n7ff_1880_40_008376807_2 | 155,520 | 280,582 | 1.8042 |
23 Jul 2013 15:38:45 | 1259807 | 15831485 | hadcm3n_n7ff_1880_40_008376807_2 | 129,600 | 234,053 | 1.8060 |
23 Jul 2013 15:38:45 | 1259807 | 15831485 | hadcm3n_n7ff_1880_40_008376807_2 | 103,680 | 187,504 | 1.8085 |
23 Jul 2013 15:38:45 | 1259807 | 15831485 | hadcm3n_n7ff_1880_40_008376807_2 | 77,760 | 141,622 | 1.8213 |
23 Jul 2013 15:38:45 | 1259807 | 15831485 | hadcm3n_n7ff_1880_40_008376807_2 | 51,840 | 95,194 | 1.8363 |
23 Jun 2013 21:07:59 | 1259807 | 15831485 | hadcm3n_n7ff_1880_40_008376807_2 | 25,920 | 48,132 | 1.8569 |
©2024 cpdn.org