climateprediction.net home page
Task 19421579

Task 19421579

Name hadcm3n_sc44_198012_480_375_010415323_1
Workunit 10415323
Created 21 Mar 2016, 19:18:08 UTC
Sent 21 Mar 2016, 21:57:17 UTC
Report deadline 4 Mar 2017, 3:17:17 UTC
Received 25 Apr 2016, 4:29:15 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1389526
Run time 4 days 8 hours 18 min 24 sec
CPU time 4 days 0 hours 49 min 18 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 3.06 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>7.6.22</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
ple-darwin(23341,0xa34d8000) malloc: *** error for object 0x1001604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(23341,0xa34d8000) malloc: *** error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(23341,0xa34d8000) malloc: *** error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(23341,0xa34d8000) malloc: *** error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(23341,0xa34d8000) malloc: *** error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(23341,0xa34d8000) malloc: *** error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(23341,0xa34d8000) malloc: *** error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(23341,0xa34d8000) malloc: *** error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(23341,0xa34d8000) malloc: *** error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
07:52:21 (23341): No heartbeat from core client for 30 sec - exiting
07:52:22 (23341): No heartbeat from core client for 30 sec - exiting
07:52:23 (23341): No heartbeat from core client for 30 sec - exiting
07:52:24 (23341): No heartbeat from core client for 30 sec - exiting
07:52:25 (23341): No heartbeat from core client for 30 sec - exiting
07:52:26 (23341): No heartbeat from core client for 30 sec - exiting
07:52:27 (23341): No heartbeat from core client for 30 sec - exiting
07:52:28 (23341): No heartbeat from core client for 30 sec - exiting
07:52:29 (23341): No heartbeat from core client for 30 sec - exiting
07:52:30 (23341): No heartbeat from core client for 30 sec - exiting
07:52:32 (23341): No heartbeat from core client for 30 sec - exiting
07:52:33 (23341): No heartbeat from core client for 30 sec - exiting
07:52:34 (23341): No heartbeat from core client for 30 sec - exiting
07:52:35 (23341): No heartbeat from core client for 30 sec - exiting
07:52:36 (23341): No heartbeat from core client for 30 sec - exiting
07:52:37 (23341): No heartbeat from core client for 30 sec - exiting
07:52:38 (23341): No heartbeat from core client for 30 sec - exiting
07:52:39 (23341): No heartbeat from core client for 30 sec - exiting
07:52:40 (23341): No heartbeat from core client for 30 sec - exiting
07:52:41 (23341): No heartbeat from core client for 30 sec - exiting
07:52:42 (23341): No heartbeat from core client for 30 sec - exiting
07:52:43 (23341): No heartbeat from core client for 30 sec - exiting
07:52:44 (23341): No heartbeat from core client for 30 sec - exiting
07:52:45 (23341): No heartbeat from core client for 30 sec - exiting
07:52:46 (23341): No heartbeat from core client for 30 sec - exiting
07:52:47 (23341): No heartbeat from core client for 30 sec - exiting
07:52:48 (23341): No heartbeat from core client for 30 sec - exiting
07:52:49 (23341): No heartbeat from core client for 30 sec - exiting
07:52:51 (23341): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(63197,0xa34d8000) malloc: *** error for object 0x181e200: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(64424,0xa34d8000) malloc: *** error for object 0x1811e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
08:52:34 (64424): No heartbeat from core client for 30 sec - exiting
08:52:35 (64424): No heartbeat from core client for 30 sec - exiting
08:52:36 (64424): No heartbeat from core client for 30 sec - exiting
08:52:37 (64424): No heartbeat from core client for 30 sec - exiting
08:52:38 (64424): No heartbeat from core client for 30 sec - exiting
08:52:39 (64424): No heartbeat from core client for 30 sec - exiting
08:52:40 (64424): No heartbeat from core client for 30 sec - exiting
08:52:41 (64424): No heartbeat from core client for 30 sec - exiting
08:52:42 (64424): No heartbeat from core client for 30 sec - exiting
08:52:43 (64424): No heartbeat from core client for 30 sec - exiting
08:52:44 (64424): No heartbeat from core client for 30 sec - exiting
08:52:45 (64424): No heartbeat from core client for 30 sec - exiting
08:52:46 (64424): No heartbeat from core client for 30 sec - exiting
08:52:47 (64424): No heartbeat from core client for 30 sec - exiting
08:52:48 (64424): No heartbeat from core client for 30 sec - exiting
08:52:49 (64424): No heartbeat from core client for 30 sec - exiting
08:52:50 (64424): No heartbeat from core client for 30 sec - exiting
08:52:51 (64424): No heartbeat from core client for 30 sec - exiting
08:52:52 (64424): No heartbeat from core client for 30 sec - exiting
08:52:53 (64424): No heartbeat from core client for 30 sec - exiting
08:52:54 (64424): No heartbeat from core client for 30 sec - exiting
08:52:55 (64424): No heartbeat from core client for 30 sec - exiting
08:52:56 (64424): No heartbeat from core client for 30 sec - exiting
08:52:57 (64424): No heartbeat from core client for 30 sec - exiting
08:52:59 (64424): No heartbeat from core client for 30 sec - exiting
08:53:00 (64424): No heartbeat from core client for 30 sec - exiting
08:53:01 (64424): No heartbeat from core client for 30 sec - exiting
08:53:02 (64424): No heartbeat from core client for 30 sec - exiting
08:53:03 (64424): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(76265,0xa34d8000) malloc: *** error for object 0x2011e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(76265,0xa34d8000) malloc: *** error for object 0x2011e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(76265,0xa34d8000) malloc: *** error for object 0x812200: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
11:38:15 (76265): No heartbeat from core client for 30 sec - exiting
11:38:16 (76265): No heartbeat from core client for 30 sec - exiting
11:38:17 (76265): No heartbeat from core client for 30 sec - exiting
11:38:18 (76265): No heartbeat from core client for 30 sec - exiting
11:38:19 (76265): No heartbeat from core client for 30 sec - exiting
11:38:20 (76265): No heartbeat from core client for 30 sec - exiting
11:38:21 (76265): No heartbeat from core client for 30 sec - exiting
11:38:22 (76265): No heartbeat from core client for 30 sec - exiting
11:38:23 (76265): No heartbeat from core client for 30 sec - exiting
11:38:24 (76265): No heartbeat from core client for 30 sec - exiting
11:38:25 (76265): No heartbeat from core client for 30 sec - exiting
11:38:26 (76265): No heartbeat from core client for 30 sec - exiting
11:38:28 (76265): No heartbeat from core client for 30 sec - exiting
11:38:29 (76265): No heartbeat from core client for 30 sec - exiting
11:38:30 (76265): No heartbeat from core client for 30 sec - exiting
11:38:31 (76265): No heartbeat from core client for 30 sec - exiting
11:38:32 (76265): No heartbeat from core client for 30 sec - exiting
11:38:33 (76265): No heartbeat from core client for 30 sec - exiting
11:38:34 (76265): No heartbeat from core client for 30 sec - exiting
11:38:35 (76265): No heartbeat from core client for 30 sec - exiting
11:38:36 (76265): No heartbeat from core client for 30 sec - exiting
11:38:37 (76265): No heartbeat from core client for 30 sec - exiting
11:38:38 (76265): No heartbeat from core client for 30 sec - exiting
11:38:39 (76265): No heartbeat from core client for 30 sec - exiting
11:38:40 (76265): No heartbeat from core client for 30 sec - exiting
11:38:41 (76265): No heartbeat from core client for 30 sec - exiting
11:38:42 (76265): No heartbeat from core client for 30 sec - exiting
11:38:43 (76265): No heartbeat from core client for 30 sec - exiting
11:38:44 (76265): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(8085,0xa34d8000) malloc: *** error for object 0x2815e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(8085,0xa34d8000) malloc: *** error for object 0x2815e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(8085,0xa34d8000) malloc: *** error for object 0x2815e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel x86-64h Haswell (32-bit executable)
System version: Macintosh OS 10.11.3 build 15D21
Fri Apr 15 12:42:53 2016

12:43:22 (8085): No heartbeat from core client for 30 sec - exiting
12:43:23 (8085): No heartbeat from core client for 30 sec - exiting
12:43:24 (8085): No heartbeat from core client for 30 sec - exiting
12:43:25 (8085): No heartbeat from core client for 30 sec - exiting
12:43:26 (8085): No heartbeat from core client for 30 sec - exiting
12:43:27 (8085): No heartbeat from core client for 30 sec - exiting
12:43:28 (8085): No heartbeat from core client for 30 sec - exiting
12:43:30 (8085): No heartbeat from core client for 30 sec - exiting
12:43:31 (8085): No heartbeat from core client for 30 sec - exiting
12:43:32 (8085): No heartbeat from core client for 30 sec - exiting
12:43:33 (8085): No heartbeat from core client for 30 sec - exiting
12:43:34 (8085): No heartbeat from core client for 30 sec - exiting
12:43:35 (8085): No heartbeat from core client for 30 sec - exiting
12:43:36 (8085): No heartbeat from core client for 30 sec - exiting
12:43:37 (8085): No heartbeat from core client for 30 sec - exiting
12:43:38 (8085): No heartbeat from core client for 30 sec - exiting
12:43:39 (8085): No heartbeat from core client for 30 sec - exiting
12:43:40 (8085): No heartbeat from core client for 30 sec - exiting
12:43:41 (8085): No heartbeat from core client for 30 sec - exiting
12:43:42 (8085): No heartbeat from core client for 30 sec - exiting
12:43:43 (8085): No heartbeat from core client for 30 sec - exiting
12:43:44 (8085): No heartbeat from core client for 30 sec - exiting
12:43:45 (8085): No heartbeat from core client for 30 sec - exiting
12:43:46 (8085): No heartbeat from core client for 30 sec - exiting
12:43:47 (8085): No heartbeat from core client for 30 sec - exiting
12:43:48 (8085): No heartbeat from core client for 30 sec - exiting
12:43:49 (8085): No heartbeat from core client for 30 sec - exiting
12:43:50 (8085): No heartbeat from core client for 30 sec - exiting
12:43:51 (8085): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(9243,0xa34d8000) malloc: *** error for object 0x280e000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
12:52:31 (9243): No heartbeat from core client for 30 sec - exiting
12:52:32 (9243): No heartbeat from core client for 30 sec - exiting
12:52:33 (9243): No heartbeat from core client for 30 sec - exiting
12:52:34 (9243): No heartbeat from core client for 30 sec - exiting
12:52:35 (9243): No heartbeat from core client for 30 sec - exiting
12:52:36 (9243): No heartbeat from core client for 30 sec - exiting
12:52:37 (9243): No heartbeat from core client for 30 sec - exiting
12:52:38 (9243): No heartbeat from core client for 30 sec - exiting
12:52:39 (9243): No heartbeat from core client for 30 sec - exiting
12:52:40 (9243): No heartbeat from core client for 30 sec - exiting
12:52:42 (9243): No heartbeat from core client for 30 sec - exiting
12:52:43 (9243): No heartbeat from core client for 30 sec - exiting
12:52:44 (9243): No heartbeat from core client for 30 sec - exiting
12:52:45 (9243): No heartbeat from core client for 30 sec - exiting
12:52:46 (9243): No heartbeat from core client for 30 sec - exiting
12:52:47 (9243): No heartbeat from core client for 30 sec - exiting
12:52:48 (9243): No heartbeat from core client for 30 sec - exiting
12:52:49 (9243): No heartbeat from core client for 30 sec - exiting
12:52:50 (9243): No heartbeat from core client for 30 sec - exiting
12:52:51 (9243): No heartbeat from core client for 30 sec - exiting
12:52:52 (9243): No heartbeat from core client for 30 sec - exiting
12:52:53 (9243): No heartbeat from core client for 30 sec - exiting
12:52:54 (9243): No heartbeat from core client for 30 sec - exiting
12:52:55 (9243): No heartbeat from core client for 30 sec - exiting
12:52:56 (9243): No heartbeat from core client for 30 sec - exiting
12:52:57 (9243): No heartbeat from core client for 30 sec - exiting
12:52:58 (9243): No heartbeat from core client for 30 sec - exiting
12:52:59 (9243): No heartbeat from core client for 30 sec - exiting
12:53:00 (9243): No heartbeat from core client for 30 sec - exiting
12:53:01 (9243): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(17358,0xa34d8000) malloc: *** error for object 0x1015c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
14:19:14 (17358): No heartbeat from core client for 30 sec - exiting
14:19:15 (17358): No heartbeat from core client for 30 sec - exiting
14:19:16 (17358): No heartbeat from core client for 30 sec - exiting
14:19:17 (17358): No heartbeat from core client for 30 sec - exiting
14:19:18 (17358): No heartbeat from core client for 30 sec - exiting
14:19:19 (17358): No heartbeat from core client for 30 sec - exiting
14:19:20 (17358): No heartbeat from core client for 30 sec - exiting
14:19:21 (17358): No heartbeat from core client for 30 sec - exiting
14:19:22 (17358): No heartbeat from core client for 30 sec - exiting
14:19:23 (17358): No heartbeat from core client for 30 sec - exiting
14:19:24 (17358): No heartbeat from core client for 30 sec - exiting
14:19:25 (17358): No heartbeat from core client for 30 sec - exiting
14:19:26 (17358): No heartbeat from core client for 30 sec - exiting
14:19:27 (17358): No heartbeat from core client for 30 sec - exiting
14:19:28 (17358): No heartbeat from core client for 30 sec - exiting
14:19:29 (17358): No heartbeat from core client for 30 sec - exiting
14:19:30 (17358): No heartbeat from core client for 30 sec - exiting
14:19:31 (17358): No heartbeat from core client for 30 sec - exiting
14:19:32 (17358): No heartbeat from core client for 30 sec - exiting
14:19:33 (17358): No heartbeat from core client for 30 sec - exiting
14:19:34 (17358): No heartbeat from core client for 30 sec - exiting
14:19:35 (17358): No heartbeat from core client for 30 sec - exiting
14:19:36 (17358): No heartbeat from core client for 30 sec - exiting
14:19:37 (17358): No heartbeat from core client for 30 sec - exiting
14:19:38 (17358): No heartbeat from core client for 30 sec - exiting
14:19:39 (17358): No heartbeat from core client for 30 sec - exiting
14:19:40 (17358): No heartbeat from core client for 30 sec - exiting
14:19:41 (17358): No heartbeat from core client for 30 sec - exiting
14:19:42 (17358): No heartbeat from core client for 30 sec - exiting
14:19:43 (17358): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(90770,0xa34d8000) malloc: *** error for object 0x1026604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(90770,0xa34d8000) malloc: *** error for object 0x1026600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(90770,0xa34d8000) malloc: *** error for object 0x1026600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(99305,0xa34d8000) malloc: *** error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel x86-64h Haswell (32-bit executable)
System version: Macintosh OS 10.11.3 build 15D21
Sat Apr 16 13:05:38 2016

13:06:50 (99305): No heartbeat from core client for 30 sec - exiting
13:06:51 (99305): No heartbeat from core client for 30 sec - exiting
13:06:52 (99305): No heartbeat from core client for 30 sec - exiting
13:06:53 (99305): No heartbeat from core client for 30 sec - exiting
13:06:54 (99305): No heartbeat from core client for 30 sec - exiting
13:06:55 (99305): No heartbeat from core client for 30 sec - exiting
13:06:56 (99305): No heartbeat from core client for 30 sec - exiting
13:06:57 (99305): No heartbeat from core client for 30 sec - exiting
13:06:58 (99305): No heartbeat from core client for 30 sec - exiting
13:06:59 (99305): No heartbeat from core client for 30 sec - exiting
13:07:00 (99305): No heartbeat from core client for 30 sec - exiting
13:07:01 (99305): No heartbeat from core client for 30 sec - exiting
13:07:03 (99305): No heartbeat from core client for 30 sec - exiting
13:07:04 (99305): No heartbeat from core client for 30 sec - exiting
13:07:05 (99305): No heartbeat from core client for 30 sec - exiting
13:07:06 (99305): No heartbeat from core client for 30 sec - exiting
13:07:07 (99305): No heartbeat from core client for 30 sec - exiting
13:07:08 (99305): No heartbeat from core client for 30 sec - exiting
13:07:09 (99305): No heartbeat from core client for 30 sec - exiting
13:07:10 (99305): No heartbeat from core client for 30 sec - exiting
13:07:11 (99305): No heartbeat from core client for 30 sec - exiting
13:07:12 (99305): No heartbeat from core client for 30 sec - exiting
13:07:13 (99305): No heartbeat from core client for 30 sec - exiting
13:07:14 (99305): No heartbeat from core client for 30 sec - exiting
13:07:15 (99305): No heartbeat from core client for 30 sec - exiting
13:07:16 (99305): No heartbeat from core client for 30 sec - exiting
13:07:17 (99305): No heartbeat from core client for 30 sec - exiting
13:07:18 (99305): No heartbeat from core client for 30 sec - exiting
13:07:19 (99305): No heartbeat from core client for 30 sec - exiting
13:07:20 (99305): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(1457,0xa34d8000) malloc: *** error for object 0x1012204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1457,0xa34d8000) malloc: *** error for object 0x1012200: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1457,0xa34d8000) malloc: *** error for object 0x2005e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1457,0xa34d8000) malloc: *** error for object 0x2005e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1457,0xa34d8000) malloc: *** error for object 0x2005e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1457,0xa34d8000) malloc: *** error for object 0x2005e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1457,0xa34d8000) malloc: *** error for object 0x2005e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1457,0xa34d8000) malloc: *** error for object 0x2005e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1457,0xa34d8000) malloc: *** error for object 0x1012204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1457,0xa34d8000) malloc: *** error for object 0x1012200: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(1457,0xa34d8000) malloc: *** error for object 0x2000e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel x86-64h Haswell (32-bit executable)
System version: Macintosh OS 10.11.3 build 15D21
Sat Apr 16 13:24:00 2016

13:29:00 (1457): No heartbeat from core client for 30 sec - exiting
13:29:01 (1457): No heartbeat from core client for 30 sec - exiting
13:29:02 (1457): No heartbeat from core client for 30 sec - exiting
13:29:03 (1457): No heartbeat from core client for 30 sec - exiting
13:29:04 (1457): No heartbeat from core client for 30 sec - exiting
13:29:05 (1457): No heartbeat from core client for 30 sec - exiting
13:29:06 (1457): No heartbeat from core client for 30 sec - exiting
13:29:08 (1457): No heartbeat from core client for 30 sec - exiting
13:29:09 (1457): No heartbeat from core client for 30 sec - exiting
13:29:10 (1457): No heartbeat from core client for 30 sec - exiting
13:29:11 (1457): No heartbeat from core client for 30 sec - exiting
13:29:12 (1457): No heartbeat from core client for 30 sec - exiting
13:29:13 (1457): No heartbeat from core client for 30 sec - exiting
13:29:14 (1457): No heartbeat from core client for 30 sec - exiting
13:29:15 (1457): No heartbeat from core client for 30 sec - exiting
13:29:16 (1457): No heartbeat from core client for 30 sec - exiting
13:29:17 (1457): No heartbeat from core client for 30 sec - exiting
13:29:18 (1457): No heartbeat from core client for 30 sec - exiting
13:29:19 (1457): No heartbeat from core client for 30 sec - exiting
13:29:20 (1457): No heartbeat from core client for 30 sec - exiting
13:29:21 (1457): No heartbeat from core client for 30 sec - exiting
13:29:22 (1457): No heartbeat from core client for 30 sec - exiting
13:29:23 (1457): No heartbeat from core client for 30 sec - exiting
13:29:24 (1457): No heartbeat from core client for 30 sec - exiting
13:29:25 (1457): No heartbeat from core client for 30 sec - exiting
13:29:26 (1457): No heartbeat from core client for 30 sec - exiting
13:29:27 (1457): No heartbeat from core client for 30 sec - exiting
13:29:28 (1457): No heartbeat from core client for 30 sec - exiting
13:29:29 (1457): No heartbeat from core client for 30 sec - exiting
13:29:30 (1457): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(2343,0xa34d8000) malloc: *** error for object 0x1811c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2343,0xa34d8000) malloc: *** error for object 0x1811c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2343,0xa34d8000) malloc: *** error for object 0x819e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
16:28:49 (2343): No heartbeat from core client for 30 sec - exiting
16:28:50 (2343): No heartbeat from core client for 30 sec - exiting
16:28:51 (2343): No heartbeat from core client for 30 sec - exiting
16:28:52 (2343): No heartbeat from core client for 30 sec - exiting
16:28:53 (2343): No heartbeat from core client for 30 sec - exiting
16:28:54 (2343): No heartbeat from core client for 30 sec - exiting
16:28:55 (2343): No heartbeat from core client for 30 sec - exiting
16:28:56 (2343): No heartbeat from core client for 30 sec - exiting
16:28:57 (2343): No heartbeat from core client for 30 sec - exiting
16:28:58 (2343): No heartbeat from core client for 30 sec - exiting
16:28:59 (2343): No heartbeat from core client for 30 sec - exiting
16:29:00 (2343): No heartbeat from core client for 30 sec - exiting
16:29:01 (2343): No heartbeat from core client for 30 sec - exiting
16:29:02 (2343): No heartbeat from core client for 30 sec - exiting
16:29:03 (2343): No heartbeat from core client for 30 sec - exiting
16:29:04 (2343): No heartbeat from core client for 30 sec - exiting
16:29:05 (2343): No heartbeat from core client for 30 sec - exiting
16:29:06 (2343): No heartbeat from core client for 30 sec - exiting
16:29:07 (2343): No heartbeat from core client for 30 sec - exiting
16:29:08 (2343): No heartbeat from core client for 30 sec - exiting
16:29:09 (2343): No heartbeat from core client for 30 sec - exiting
16:29:10 (2343): No heartbeat from core client for 30 sec - exiting
16:29:11 (2343): No heartbeat from core client for 30 sec - exiting
16:29:12 (2343): No heartbeat from core client for 30 sec - exiting
16:29:13 (2343): No heartbeat from core client for 30 sec - exiting
16:29:14 (2343): No heartbeat from core client for 30 sec - exiting
16:29:15 (2343): No heartbeat from core client for 30 sec - exiting
16:29:17 (2343): No heartbeat from core client for 30 sec - exiting
16:29:18 (2343): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(14080,0xa34d8000) malloc: *** error for object 0x2005e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(21642,0xa34d8000) malloc: *** error for object 0x1011c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(21642,0xa34d8000) malloc: *** error for object 0x1011c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(21642,0xa34d8000) malloc: *** error for object 0x2019e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(21642,0xa34d8000) malloc: *** error for object 0x2019e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(21642,0xa34d8000) malloc: *** error for object 0x1010e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(21642,0xa34d8000) malloc: *** error for object 0x1011c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(21642,0xa34d8000) malloc: *** error for object 0x1011c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(21642,0xa34d8000) malloc: *** error for object 0x1011c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(21642,0xa34d8000) malloc: *** error for object 0x1011c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(21642,0xa34d8000) malloc: *** error for object 0x2000e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
10:15:55 (21642): No heartbeat from core client for 30 sec - exiting
10:15:56 (21642): No heartbeat from core client for 30 sec - exiting
10:15:57 (21642): No heartbeat from core client for 30 sec - exiting
10:15:58 (21642): No heartbeat from core client for 30 sec - exiting
10:15:59 (21642): No heartbeat from core client for 30 sec - exiting
10:16:00 (21642): No heartbeat from core client for 30 sec - exiting
10:16:01 (21642): No heartbeat from core client for 30 sec - exiting
10:16:03 (21642): No heartbeat from core client for 30 sec - exiting
10:16:04 (21642): No heartbeat from core client for 30 sec - exiting
10:16:05 (21642): No heartbeat from core client for 30 sec - exiting
10:16:06 (21642): No heartbeat from core client for 30 sec - exiting
10:16:07 (21642): No heartbeat from core client for 30 sec - exiting
10:16:08 (21642): No heartbeat from core client for 30 sec - exiting
10:16:09 (21642): No heartbeat from core client for 30 sec - exiting
10:16:10 (21642): No heartbeat from core client for 30 sec - exiting
10:16:11 (21642): No heartbeat from core client for 30 sec - exiting
10:16:12 (21642): No heartbeat from core client for 30 sec - exiting
10:16:13 (21642): No heartbeat from core client for 30 sec - exiting
10:16:14 (21642): No heartbeat from core client for 30 sec - exiting
10:16:15 (21642): No heartbeat from core client for 30 sec - exiting
10:16:16 (21642): No heartbeat from core client for 30 sec - exiting
10:16:17 (21642): No heartbeat from core client for 30 sec - exiting
10:16:18 (21642): No heartbeat from core client for 30 sec - exiting
10:16:19 (21642): No heartbeat from core client for 30 sec - exiting
10:16:20 (21642): No heartbeat from core client for 30 sec - exiting
10:16:21 (21642): No heartbeat from core client for 30 sec - exiting
10:16:22 (21642): No heartbeat from core client for 30 sec - exiting
10:16:23 (21642): No heartbeat from core client for 30 sec - exiting
10:16:24 (21642): No heartbeat from core client for 30 sec - exiting
10:16:25 (21642): No heartbeat from core client for 30 sec - exiting
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(24690,0xb0005000) malloc: *** error for object 0x815204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
17:36:25 (24690): No heartbeat from core client for 30 sec - exiting
17:36:26 (24690): No heartbeat from core client for 30 sec - exiting
17:36:27 (24690): No heartbeat from core client for 30 sec - exiting
17:36:28 (24690): No heartbeat from core client for 30 sec - exiting
17:36:29 (24690): No heartbeat from core client for 30 sec - exiting
17:36:30 (24690): No heartbeat from core client for 30 sec - exiting
17:36:31 (24690): No heartbeat from core client for 30 sec - exiting
17:36:32 (24690): No heartbeat from core client for 30 sec - exiting
17:36:33 (24690): No heartbeat from core client for 30 sec - exiting
17:36:34 (24690): No heartbeat from core client for 30 sec - exiting
17:36:35 (24690): No heartbeat from core client for 30 sec - exiting
17:36:36 (24690): No heartbeat from core client for 30 sec - exiting
17:36:37 (24690): No heartbeat from core client for 30 sec - exiting
17:36:38 (24690): No heartbeat from core client for 30 sec - exiting
17:36:39 (24690): No heartbeat from core client for 30 sec - exiting
17:36:40 (24690): No heartbeat from core client for 30 sec - exiting
17:36:41 (24690): No heartbeat from core client for 30 sec - exiting
17:36:42 (24690): No heartbeat from core client for 30 sec - exiting
17:36:43 (24690): No heartbeat from core client for 30 sec - exiting
17:36:44 (24690): No heartbeat from core client for 30 sec - exiting
17:36:45 (24690): No heartbeat from core client for 30 sec - exiting
17:36:46 (24690): No heartbeat from core client for 30 sec - exiting
17:36:47 (24690): No heartbeat from core client for 30 sec - exiting
17:36:48 (24690): No heartbeat from core client for 30 sec - exiting
17:36:49 (24690): No heartbeat from core client for 30 sec - exiting
17:36:50 (24690): No heartbeat from core client for 30 sec - exiting
17:36:51 (24690): No heartbeat from core client for 30 sec - exiting
17:36:52 (24690): No heartbeat from core client for 30 sec - exiting
17:36:53 (24690): No heartbeat from core client for 30 sec - exiting
17:36:54 (24690): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(92701,0xa34d8000) malloc: *** error for object 0x1004e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(92701,0xa34d8000) malloc: *** error for object 0x1004e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(11156,0xa34d8000) malloc: *** error for object 0x280d204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(11156,0xa34d8000) malloc: *** error for object 0x280e004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(11156,0xa34d8000) malloc: *** error for object 0x280e000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
20:04:47 (11156): No heartbeat from core client for 30 sec - exiting
20:04:48 (11156): No heartbeat from core client for 30 sec - exiting
20:04:49 (11156): No heartbeat from core client for 30 sec - exiting
20:04:50 (11156): No heartbeat from core client for 30 sec - exiting
20:04:52 (11156): No heartbeat from core client for 30 sec - exiting
20:04:53 (11156): No heartbeat from core client for 30 sec - exiting
20:04:54 (11156): No heartbeat from core client for 30 sec - exiting
20:04:55 (11156): No heartbeat from core client for 30 sec - exiting
20:04:56 (11156): No heartbeat from core client for 30 sec - exiting
20:04:57 (11156): No heartbeat from core client for 30 sec - exiting
20:04:58 (11156): No heartbeat from core client for 30 sec - exiting
20:04:59 (11156): No heartbeat from core client for 30 sec - exiting
20:05:00 (11156): No heartbeat from core client for 30 sec - exiting
20:05:01 (11156): No heartbeat from core client for 30 sec - exiting
20:05:02 (11156): No heartbeat from core client for 30 sec - exiting
20:05:03 (11156): No heartbeat from core client for 30 sec - exiting
20:05:04 (11156): No heartbeat from core client for 30 sec - exiting
20:05:05 (11156): No heartbeat from core client for 30 sec - exiting
20:05:06 (11156): No heartbeat from core client for 30 sec - exiting
20:05:07 (11156): No heartbeat from core client for 30 sec - exiting
20:05:08 (11156): No heartbeat from core client for 30 sec - exiting
20:05:09 (11156): No heartbeat from core client for 30 sec - exiting
20:05:10 (11156): No heartbeat from core client for 30 sec - exiting
20:05:11 (11156): No heartbeat from core client for 30 sec - exiting
20:05:12 (11156): No heartbeat from core client for 30 sec - exiting
20:05:13 (11156): No heartbeat from core client for 30 sec - exiting
20:05:14 (11156): No heartbeat from core client for 30 sec - exiting
20:05:15 (11156): No heartbeat from core client for 30 sec - exiting
20:05:16 (11156): No heartbeat from core client for 30 sec - exiting
20:05:17 (11156): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(20538,0xa34d8000) malloc: *** error for object 0x81de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel x86-64h Haswell (32-bit executable)
System version: Macintosh OS 10.11.3 build 15D21
Thu Apr 21 09:45:12 2016

09:46:23 (20538): No heartbeat from core client for 30 sec - exiting
09:46:24 (20538): No heartbeat from core client for 30 sec - exiting
09:46:25 (20538): No heartbeat from core client for 30 sec - exiting
09:46:26 (20538): No heartbeat from core client for 30 sec - exiting
09:46:27 (20538): No heartbeat from core client for 30 sec - exiting
09:46:28 (20538): No heartbeat from core client for 30 sec - exiting
09:46:29 (20538): No heartbeat from core client for 30 sec - exiting
09:46:30 (20538): No heartbeat from core client for 30 sec - exiting
09:46:31 (20538): No heartbeat from core client for 30 sec - exiting
09:46:32 (20538): No heartbeat from core client for 30 sec - exiting
09:46:33 (20538): No heartbeat from core client for 30 sec - exiting
09:46:34 (20538): No heartbeat from core client for 30 sec - exiting
09:46:35 (20538): No heartbeat from core client for 30 sec - exiting
09:46:36 (20538): No heartbeat from core client for 30 sec - exiting
09:46:37 (20538): No heartbeat from core client for 30 sec - exiting
09:46:38 (20538): No heartbeat from core client for 30 sec - exiting
09:46:39 (20538): No heartbeat from core client for 30 sec - exiting
09:46:40 (20538): No heartbeat from core client for 30 sec - exiting
09:46:41 (20538): No heartbeat from core client for 30 sec - exiting
09:46:42 (20538): No heartbeat from core client for 30 sec - exiting
09:46:43 (20538): No heartbeat from core client for 30 sec - exiting
09:46:44 (20538): No heartbeat from core client for 30 sec - exiting
09:46:45 (20538): No heartbeat from core client for 30 sec - exiting
09:46:46 (20538): No heartbeat from core client for 30 sec - exiting
09:46:47 (20538): No heartbeat from core client for 30 sec - exiting
09:46:48 (20538): No heartbeat from core client for 30 sec - exiting
09:46:49 (20538): No heartbeat from core client for 30 sec - exiting
09:46:50 (20538): No heartbeat from core client for 30 sec - exiting
09:46:51 (20538): No heartbeat from core client for 30 sec - exiting
09:46:52 (20538): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(60480,0xa34d8000) malloc: *** error for object 0x2800e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(60480,0xa34d8000) malloc: *** error for object 0x2801c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel x86-64h Haswell (32-bit executable)
System version: Macintosh OS 10.11.3 build 15D21
hadcm3n_6.07_i686-apple-darwin(27748,0xa34d8000) malloc: *** error for object 0x280f004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(27748,0xa34d8000) malloc: *** error for object 0x280f000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(27748,0xa34d8000) malloc: *** error for object 0x2800e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
21:06:07 (27748): No heartbeat from core client for 30 sec - exiting
21:06:08 (27748): No heartbeat from core client for 30 sec - exiting
21:06:09 (27748): No heartbeat from core client for 30 sec - exiting
21:06:11 (27748): No heartbeat from core client for 30 sec - exiting
21:06:12 (27748): No heartbeat from core client for 30 sec - exiting
21:06:13 (27748): No heartbeat from core client for 30 sec - exiting
21:06:14 (27748): No heartbeat from core client for 30 sec - exiting
21:06:15 (27748): No heartbeat from core client for 30 sec - exiting
21:06:16 (27748): No heartbeat from core client for 30 sec - exiting
21:06:17 (27748): No heartbeat from core client for 30 sec - exiting
21:06:18 (27748): No heartbeat from core client for 30 sec - exiting
21:06:19 (27748): No heartbeat from core client for 30 sec - exiting
21:06:20 (27748): No heartbeat from core client for 30 sec - exiting
21:06:21 (27748): No heartbeat from core client for 30 sec - exiting
21:06:22 (27748): No heartbeat from core client for 30 sec - exiting
21:06:23 (27748): No heartbeat from core client for 30 sec - exiting
21:06:24 (27748): No heartbeat from core client for 30 sec - exiting
21:06:25 (27748): No heartbeat from core client for 30 sec - exiting
21:06:26 (27748): No heartbeat from core client for 30 sec - exiting
21:06:27 (27748): No heartbeat from core client for 30 sec - exiting
21:06:28 (27748): No heartbeat from core client for 30 sec - exiting
21:06:29 (27748): No heartbeat from core client for 30 sec - exiting
21:06:30 (27748): No heartbeat from core client for 30 sec - exiting
21:06:31 (27748): No heartbeat from core client for 30 sec - exiting
21:06:32 (27748): No heartbeat from core client for 30 sec - exiting
21:06:33 (27748): No heartbeat from core client for 30 sec - exiting
21:06:34 (27748): No heartbeat from core client for 30 sec - exiting
21:06:35 (27748): No heartbeat from core client for 30 sec - exiting
21:06:36 (27748): No heartbeat from core client for 30 sec - exiting
21:06:37 (27748): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(37567,0xa34d8000) malloc: *** error for object 0x2000e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(37567,0xa34d8000) malloc: *** error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
23:33:17 (37567): No heartbeat from core client for 30 sec - exiting
23:33:18 (37567): No heartbeat from core client for 30 sec - exiting
23:33:19 (37567): No heartbeat from core client for 30 sec - exiting
23:33:20 (37567): No heartbeat from core client for 30 sec - exiting
23:33:21 (37567): No heartbeat from core client for 30 sec - exiting
23:33:22 (37567): No heartbeat from core client for 30 sec - exiting
23:33:23 (37567): No heartbeat from core client for 30 sec - exiting
23:33:24 (37567): No heartbeat from core client for 30 sec - exiting
23:33:25 (37567): No heartbeat from core client for 30 sec - exiting
23:33:26 (37567): No heartbeat from core client for 30 sec - exiting
23:33:27 (37567): No heartbeat from core client for 30 sec - exiting
23:33:28 (37567): No heartbeat from core client for 30 sec - exiting
23:33:29 (37567): No heartbeat from core client for 30 sec - exiting
23:33:30 (37567): No heartbeat from core client for 30 sec - exiting
23:33:31 (37567): No heartbeat from core client for 30 sec - exiting
23:33:32 (37567): No heartbeat from core client for 30 sec - exiting
23:33:33 (37567): No heartbeat from core client for 30 sec - exiting
23:33:34 (37567): No heartbeat from core client for 30 sec - exiting
23:33:35 (37567): No heartbeat from core client for 30 sec - exiting
23:33:36 (37567): No heartbeat from core client for 30 sec - exiting
23:33:37 (37567): No heartbeat from core client for 30 sec - exiting
23:33:38 (37567): No heartbeat from core client for 30 sec - exiting
23:33:39 (37567): No heartbeat from core client for 30 sec - exiting
23:33:40 (37567): No heartbeat from core client for 30 sec - exiting
23:33:41 (37567): No heartbeat from core client for 30 sec - exiting
23:33:42 (37567): No heartbeat from core client for 30 sec - exiting
23:33:43 (37567): No heartbeat from core client for 30 sec - exiting
23:33:44 (37567): No heartbeat from core client for 30 sec - exiting
23:33:45 (37567): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(39696,0xa34d8000) malloc: *** error for object 0x1801c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(39696,0xa34d8000) malloc: *** error for object 0x2800e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(39696,0xa34d8000) malloc: *** error for object 0x2800e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(48058,0xa34d8000) malloc: *** error for object 0x1016804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(48058,0xa34d8000) malloc: *** error for object 0x1016800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(48058,0xa34d8000) malloc: *** error for object 0x1016800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel x86-64h Haswell (32-bit executable)
12:30:53 (48058): No heartbeat from core client for 30 sec - exiting
12:30:54 (48058): No heartbeat from core client for 30 sec - exiting
12:30:55 (48058): No heartbeat from core client for 30 sec - exiting
12:30:56 (48058): No heartbeat from core client for 30 sec - exiting
12:30:57 (48058): No heartbeat from core client for 30 sec - exiting
12:30:58 (48058): No heartbeat from core client for 30 sec - exiting
12:30:59 (48058): No heartbeat from core client for 30 sec - exiting
12:31:00 (48058): No heartbeat from core client for 30 sec - exiting
12:31:01 (48058): No heartbeat from core client for 30 sec - exiting
12:31:02 (48058): No heartbeat from core client for 30 sec - exiting
12:31:03 (48058): No heartbeat from core client for 30 sec - exiting
12:31:04 (48058): No heartbeat from core client for 30 sec - exiting
12:31:05 (48058): No heartbeat from core client for 30 sec - exiting
12:31:06 (48058): No heartbeat from core client for 30 sec - exiting
12:31:07 (48058): No heartbeat from core client for 30 sec - exiting
12:31:08 (48058): No heartbeat from core client for 30 sec - exiting
12:31:09 (48058): No heartbeat from core client for 30 sec - exiting
12:31:10 (48058): No heartbeat from core client for 30 sec - exiting
12:31:11 (48058): No heartbeat from core client for 30 sec - exiting
12:31:12 (48058): No heartbeat from core client for 30 sec - exiting
12:31:13 (48058): No heartbeat from core client for 30 sec - exiting
12:31:15 (48058): No heartbeat from core client for 30 sec - exiting
12:31:16 (48058): No heartbeat from core client for 30 sec - exiting
12:31:17 (48058): No heartbeat from core client for 30 sec - exiting
12:31:18 (48058): No heartbeat from core client for 30 sec - exiting
12:31:19 (48058): No heartbeat from core client for 30 sec - exiting
12:31:20 (48058): No heartbeat from core client for 30 sec - exiting
12:31:21 (48058): No heartbeat from core client for 30 sec - exiting
12:31:22 (48058): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(50759,0xa34d8000) malloc: *** error for object 0x280f204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(50759,0xa34d8000) malloc: *** error for object 0x280f200: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(50759,0xa34d8000) malloc: *** error for object 0x2801c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(66546,0xa34d8000) malloc: *** error for object 0x807204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(66546,0xa34d8000) malloc: *** error for object 0x807200: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(66546,0xa34d8000) malloc: *** error for object 0x801c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
15:28:18 (66546): No heartbeat from core client for 30 sec - exiting
15:28:19 (66546): No heartbeat from core client for 30 sec - exiting
15:28:20 (66546): No heartbeat from core client for 30 sec - exiting
15:28:21 (66546): No heartbeat from core client for 30 sec - exiting
15:28:22 (66546): No heartbeat from core client for 30 sec - exiting
15:28:23 (66546): No heartbeat from core client for 30 sec - exiting
15:28:25 (66546): No heartbeat from core client for 30 sec - exiting
15:28:26 (66546): No heartbeat from core client for 30 sec - exiting
15:28:27 (66546): No heartbeat from core client for 30 sec - exiting
15:28:28 (66546): No heartbeat from core client for 30 sec - exiting
15:28:29 (66546): No heartbeat from core client for 30 sec - exiting
15:28:30 (66546): No heartbeat from core client for 30 sec - exiting
15:28:31 (66546): No heartbeat from core client for 30 sec - exiting
15:28:32 (66546): No heartbeat from core client for 30 sec - exiting
15:28:33 (66546): No heartbeat from core client for 30 sec - exiting
15:28:34 (66546): No heartbeat from core client for 30 sec - exiting
15:28:35 (66546): No heartbeat from core client for 30 sec - exiting
15:28:36 (66546): No heartbeat from core client for 30 sec - exiting
15:28:37 (66546): No heartbeat from core client for 30 sec - exiting
15:28:38 (66546): No heartbeat from core client for 30 sec - exiting
15:28:39 (66546): No heartbeat from core client for 30 sec - exiting
15:28:40 (66546): No heartbeat from core client for 30 sec - exiting
15:28:41 (66546): No heartbeat from core client for 30 sec - exiting
15:28:42 (66546): No heartbeat from core client for 30 sec - exiting
15:28:43 (66546): No heartbeat from core client for 30 sec - exiting
15:28:44 (66546): No heartbeat from core client for 30 sec - exiting
15:28:45 (66546): No heartbeat from core client for 30 sec - exiting
15:28:46 (66546): No heartbeat from core client for 30 sec - exiting
15:28:47 (66546): No heartbeat from core client for 30 sec - exiting
15:28:48 (66546): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(89431,0xa34d8000) malloc: *** error for object 0x801204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(89431,0xa34d8000) malloc: *** error for object 0x802004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(89431,0xa34d8000) malloc: *** error for object 0x802000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(89431,0xa34d8000) malloc: *** error for object 0x1029e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(89431,0xa34d8000) malloc: *** error for object 0x1029e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(89431,0xa34d8000) malloc: *** error for object 0x1029e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(89431,0xa34d8000) malloc: *** error for object 0x1029e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(89431,0xa34d8000) malloc: *** error for object 0x1029e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(89431,0xa34d8000) malloc: *** error for object 0x1029e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(89431,0xa34d8000) malloc: *** error for object 0x1029e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(89431,0xa34d8000) malloc: *** error for object 0x1029e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(89431,0xa34d8000) malloc: *** error for object 0x101ce00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(940,0xa34d8000) malloc: *** error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(940,0xa34d8000) malloc: *** error for object 0x1800e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(940,0xa34d8000) malloc: *** error for object 0x1800e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
19:59:01 (940): No heartbeat from core client for 30 sec - exiting
19:59:02 (940): No heartbeat from core client for 30 sec - exiting
19:59:03 (940): No heartbeat from core client for 30 sec - exiting
19:59:04 (940): No heartbeat from core client for 30 sec - exiting
19:59:05 (940): No heartbeat from core client for 30 sec - exiting
19:59:06 (940): No heartbeat from core client for 30 sec - exiting
19:59:07 (940): No heartbeat from core client for 30 sec - exiting
19:59:08 (940): No heartbeat from core client for 30 sec - exiting
19:59:09 (940): No heartbeat from core client for 30 sec - exiting
19:59:10 (940): No heartbeat from core client for 30 sec - exiting
19:59:11 (940): No heartbeat from core client for 30 sec - exiting
19:59:12 (940): No heartbeat from core client for 30 sec - exiting
19:59:13 (940): No heartbeat from core client for 30 sec - exiting
19:59:14 (940): No heartbeat from core client for 30 sec - exiting
19:59:15 (940): No heartbeat from core client for 30 sec - exiting
19:59:16 (940): No heartbeat from core client for 30 sec - exiting
19:59:17 (940): No heartbeat from core client for 30 sec - exiting
19:59:18 (940): No heartbeat from core client for 30 sec - exiting
19:59:19 (940): No heartbeat from core client for 30 sec - exiting
19:59:20 (940): No heartbeat from core client for 30 sec - exiting
19:59:21 (940): No heartbeat from core client for 30 sec - exiting
19:59:22 (940): No heartbeat from core client for 30 sec - exiting
19:59:23 (940): No heartbeat from core client for 30 sec - exiting
19:59:24 (940): No heartbeat from core client for 30 sec - exiting
19:59:25 (940): No heartbeat from core client for 30 sec - exiting
19:59:26 (940): No heartbeat from core client for 30 sec - exiting
19:59:27 (940): No heartbeat from core client for 30 sec - exiting
19:59:28 (940): No heartbeat from core client for 30 sec - exiting
19:59:29 (940): No heartbeat from core client for 30 sec - exiting
19:59:31 (940): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(5440,0xa34d8000) malloc: *** error for object 0x200f004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(5440,0xa34d8000) malloc: *** error for object 0x200f000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(5440,0xa34d8000) malloc: *** error for object 0x1025e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(51064,0xa34d8000) malloc: *** error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(51064,0xa34d8000) malloc: *** error for object 0x2810e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(51064,0xa34d8000) malloc: *** error for object 0x2811804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(51064,0xa34d8000) malloc: *** error for object 0x2811800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel x86-64h Haswell (32-bit executable)
Signal 1 received, exiting...
Called boinc_finish
hadcm3n_6.07_i686-apple-darwin(58134,0xa34d8000) malloc: *** error for object 0x101ac04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58134,0xa34d8000) malloc: *** error for object 0x101ac00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(58134,0xa34d8000) malloc: *** error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel x86-64h Haswell (32-bit executable)
System version: Macintosh OS 10.11.3 build 15D21
Mon Apr 25 12:29:38 2016

Thread 0 Crashed:

Thread 1:

atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386.
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fd38 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -    0x93fff /Library/Application Support/BOINC Data/slots/0/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin
0x904c1000 - 0x904c3fff /usr/lib/system/libquarantine.dylib
0x90647000 - 0x90658fff /usr/lib/system/libsystem_trace.dylib
0x90bca000 - 0x90c33fff /usr/lib/system/libsystem_network.dylib
0x92141000 - 0x92145fff /usr/lib/system/libcache.dylib
0x92146000 - 0x92199fff /usr/lib/libstdc++.6.dylib
0x92782000 - 0x9278afff /usr/lib/system/libsystem_pthread.dylib
0x92975000 - 0x92977fff /usr/lib/system/libsystem_configuration.dylib
0x93206000 - 0x93239fff /usr/lib/system/libsystem_m.dylib
0x93620000 - 0x93625fff /usr/lib/system/libmacho.dylib
0x93f6f000 - 0x93f70fff /usr/lib/system/libremovefile.dylib
0x951ca000 - 0x951cbfff /usr/lib/libSystem.B.dylib
0x95615000 - 0x95638fff /usr/lib/libc++abi.dylib
0x96ce7000 - 0x96cf0fff /usr/lib/system/libsystem_networkextension.dylib
0x96cf1000 - 0x96d19fff /usr/lib/system/libxpc.dylib
0x96db1000 - 0x96e46fff /usr/lib/system/libsystem_c.dylib
0x96e51000 - 0x96e5bfff /usr/lib/system/libsystem_notify.dylib
0x97b55000 - 0x97b55fff /usr/lib/system/libkeymgr.dylib
0x97b56000 - 0x97b6dfff /usr/lib/system/libsystem_coretls.dylib
0x97d0d000 - 0x97d12fff /usr/lib/system/libcompiler_rt.dylib
0x97d5c000 - 0x97d5cfff /usr/lib/system/libunc.dylib
0x97d5d000 - 0x97d87fff /usr/lib/system/libdispatch.dylib
0x97f2f000 - 0x97f3dfff /usr/lib/libz.1.dylib
0x9a0b9000 - 0x9a0c2fff /usr/lib/system/libcopyfile.dylib
0x9a9d6000 - 0x9a9d9fff /usr/lib/system/libsystem_sandbox.dylib
0x9ac2e000 - 0x9ac47fff /usr/lib/system/libsystem_malloc.dylib
0x9ae5b000 - 0x9ae5bfff /usr/lib/system/liblaunch.dylib
0x9aeaf000 - 0x9aecffff /usr/lib/system/libsystem_kernel.dylib
0x9afb6000 - 0x9afb8fff /usr/lib/system/libsystem_coreservices.dylib
0x9b7b4000 - 0x9b7cdfff /usr/lib/system/libsystem_asl.dylib
0x9b7f2000 - 0x9b7f4fff /usr/lib/system/libsystem_secinit.dylib
0x9ca99000 - 0x9ca99fff /usr/lib/system/libsystem_blocks.dylib
0x9caf6000 - 0x9cafcfff /usr/lib/system/libsystem_platform.dylib
0x9d4f1000 - 0x9d4fcfff /usr/lib/system/libcommonCrypto.dylib
0x9da4f000 - 0x9da55fff /usr/lib/system/libunwind.dylib
0x9da56000 - 0x9da80fff /usr/lib/system/libsystem_info.dylib
0x9db05000 - 0x9db08fff /usr/lib/system/libdyld.dylib
0x9dbab000 - 0x9dbb3fff /usr/lib/system/libsystem_dnssd.dylib
0x9ecfa000 - 0x9ed61fff /usr/lib/system/libcorecrypto.dylib


Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
15 Apr 2016 12:10:41 1389526 19421579 hadcm3n_sc44_198012_480_375_010415323_1 259,200 326,119 1.2582
08 Apr 2016 01:07:34 1389526 19421579 hadcm3n_sc44_198012_480_375_010415323_1 233,280 289,079 1.2392
06 Apr 2016 15:13:07 1389526 19421579 hadcm3n_sc44_198012_480_375_010415323_1 207,360 259,554 1.2517
05 Apr 2016 20:54:26 1389526 19421579 hadcm3n_sc44_198012_480_375_010415323_1 181,440 232,015 1.2787
05 Apr 2016 12:02:37 1389526 19421579 hadcm3n_sc44_198012_480_375_010415323_1 155,520 202,907 1.3047
30 Mar 2016 14:44:09 1389526 19421579 hadcm3n_sc44_198012_480_375_010415323_1 129,600 172,615 1.3319
29 Mar 2016 17:11:16 1389526 19421579 hadcm3n_sc44_198012_480_375_010415323_1 103,680 142,364 1.3731
29 Mar 2016 03:52:55 1389526 19421579 hadcm3n_sc44_198012_480_375_010415323_1 77,760 106,766 1.3730
28 Mar 2016 15:05:38 1389526 19421579 hadcm3n_sc44_198012_480_375_010415323_1 51,840 71,256 1.3745
24 Mar 2016 02:44:53 1389526 19421579 hadcm3n_sc44_198012_480_375_010415323_1 25,920 35,518 1.3703


©2024 cpdn.org