climateprediction.net home page
Task 18739046

Task 18739046

Name hadcm3n_xam2_1980_40_010022222_1
Workunit 10020292
Created 25 Jul 2015, 16:37:01 UTC
Sent 25 Jul 2015, 16:38:33 UTC
Report deadline 25 Oct 2015, 0:05:44 UTC
Received 18 Sep 2015, 13:45:50 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1235736
Run time 13 days 1 hours 57 min 18 sec
CPU time 11 days 15 hours 8 min 18 sec
Validate state Invalid
Credit 8,709.12
Device peak FLOPS 3.38 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>7.6.11</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
23:34:27 (98666): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
00:05:07 (32093): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
SIGSEGV: segmentation violation
Suspended CPDN Monitor - Suspend request from BOINC...
00:18:08 (32578): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:20:36 (32578): No heartbeat from core client for 30 sec - exiting
00:42:35 (32673): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:45:17 (32866): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:46:46 (34632): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
hadcm3n_6.07_i686-apple-darwin(2721,0xa11621d4) malloc: *** error for object 0x2821604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2721,0xa11621d4) malloc: *** error for object 0x2821600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2721,0xa11621d4) malloc: *** error for object 0x1846e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2721,0xa11621d4) malloc: *** error for object 0x1846e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2721,0xa11621d4) malloc: *** error for object 0x1862404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2721,0xa11621d4) malloc: *** error for object 0x1862400: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2721,0xa11621d4) malloc: *** error for object 0x283cc04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2721,0xa11621d4) malloc: *** error for object 0x283cc00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2721,0xa11621d4) malloc: *** error for object 0x1862404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2721,0xa11621d4) malloc: *** error for object 0x1862400: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2721,0xa11621d4) malloc: *** error for object 0x1028a04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2721,0xa11621d4) malloc: *** error for object 0x824604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2721,0xa11621d4) malloc: *** error for object 0x280fc04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(8602,0xa11621d4) malloc: *** error for object 0x1034604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(8602,0xa11621d4) malloc: *** error for object 0x2020604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(8602,0xa11621d4) malloc: *** error for object 0x2823604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(8602,0xa11621d4) malloc: *** error for object 0x1001c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(14795,0xa11621d4) malloc: *** error for object 0x102c204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(14795,0xa11621d4) malloc: *** error for object 0x2830604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(14795,0xa11621d4) malloc: *** error for object 0x1825e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(14795,0xa11621d4) malloc: *** error for object 0x1825e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(14795,0xa11621d4) malloc: *** error for object 0x805c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(3163,0xa11621d4) malloc: *** error for object 0x202c604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3163,0xa11621d4) malloc: *** error for object 0x202c604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3163,0xa11621d4) malloc: *** error for object 0x103c204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3163,0xa11621d4) malloc: *** error for object 0x82c604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3163,0xa11621d4) malloc: *** error for object 0x2820604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3163,0xa11621d4) malloc: *** error for object 0x481c404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3163,0xa11621d4) malloc: *** error for object 0x481d200: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
00:15:29 (3163): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(2028,0xa0d621d4) malloc: *** error for object 0x302c604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2028,0xa0d621d4) malloc: *** error for object 0x302c604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2028,0xa0d621d4) malloc: *** error for object 0x282c204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2028,0xa0d621d4) malloc: *** error for object 0x828604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(2028,0xa0d621d4) malloc: *** error for object 0x80e004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(12088,0xa0d621d4) malloc: *** error for object 0x1035204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(12088,0xa0d621d4) malloc: *** error for object 0x820604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(12088,0xa0d621d4) malloc: *** error for object 0x1035204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(12088,0xa0d621d4) malloc: *** error for object 0x3000e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(18029,0xa0d621d4) malloc: *** error for object 0x202c204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(18029,0xa0d621d4) malloc: *** error for object 0x202c204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(18029,0xa0d621d4) malloc: *** error for object 0x182c604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(18029,0xa0d621d4) malloc: *** error for object 0x202c204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(18029,0xa0d621d4) malloc: *** error for object 0x1028604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(18029,0xa0d621d4) malloc: *** error for object 0x182c604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(18029,0xa0d621d4) malloc: *** error for object 0x82c604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(18029,0xa0d621d4) malloc: *** error for object 0x811e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(18029,0xa0d621d4) malloc: *** error for object 0x1000e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(18029,0xa0d621d4) malloc: *** error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
hadcm3n_6.07_i686-apple-darwin(20494,0xa0d621d4) malloc: *** error for object 0x834204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(20494,0xa0d621d4) malloc: *** error for object 0x2024604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(20494,0xa0d621d4) malloc: *** error for object 0x834204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(20494,0xa0d621d4) malloc: *** error for object 0x1034604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(20494,0xa0d621d4) malloc: *** error for object 0x300e604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(20494,0xa0d621d4) malloc: *** error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(32293,0xa0d621d4) malloc: *** error for object 0x1048204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(32293,0xa0d621d4) malloc: *** error for object 0x1048204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(32293,0xa0d621d4) malloc: *** error for object 0x828604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(32293,0xa0d621d4) malloc: *** error for object 0x803004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(32293,0xa0d621d4) malloc: *** error for object 0x2800e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(32293,0xa0d621d4) malloc: *** error for object 0x2800e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
hadcm3n_6.07_i686-apple-darwin(39046,0xa0d621d4) malloc: *** error for object 0x402c604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(39046,0xa0d621d4) malloc: *** error for object 0x402c604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(39046,0xa0d621d4) malloc: *** error for object 0x828604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(39046,0xa0d621d4) malloc: *** error for object 0x302c204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(39046,0xa0d621d4) malloc: *** error for object 0x3000e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(44588,0xa0d621d4) malloc: *** error for object 0x82c204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(44588,0xa0d621d4) malloc: *** error for object 0x82c204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(44588,0xa0d621d4) malloc: *** error for object 0x103c604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(44588,0xa0d621d4) malloc: *** error for object 0x1824604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(44588,0xa0d621d4) malloc: *** error for object 0x103c604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(44588,0xa0d621d4) malloc: *** error for object 0x82c204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(44588,0xa0d621d4) malloc: *** error for object 0x103c604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(44588,0xa0d621d4) malloc: *** error for object 0x3001c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(44588,0xa0d621d4) malloc: *** error for object 0x808e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(44588,0xa0d621d4) malloc: *** error for object 0x808e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.10.5 build 14F27
hadcm3n_6.07_i686-apple-darwin(7389,0xa06431d4) malloc: *** error for object 0x2830604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7389,0xa06431d4) malloc: *** error for object 0x103c204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7389,0xa06431d4) malloc: *** error for object 0x820604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7389,0xa06431d4) malloc: *** error for object 0x1828604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7389,0xa06431d4) malloc: *** error for object 0x103c204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7389,0xa06431d4) malloc: *** error for object 0x1015e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7389,0xa06431d4) malloc: *** error for object 0x1015e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7389,0xa06431d4) malloc: *** error for object 0x801c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(17359,0xa06431d4) malloc: *** error for object 0x1854204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(17359,0xa06431d4) malloc: *** error for object 0x1854204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(17359,0xa06431d4) malloc: *** error for object 0x1854204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(17359,0xa06431d4) malloc: *** error for object 0x1854204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(17359,0xa06431d4) malloc: *** error for object 0x824604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(17359,0xa06431d4) malloc: *** error for object 0x80de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(7403,0xa06431d4) malloc: *** error for object 0x102c604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7403,0xa06431d4) malloc: *** error for object 0x834604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7403,0xa06431d4) malloc: *** error for object 0x1828604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7403,0xa06431d4) malloc: *** error for object 0x1011e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7403,0xa06431d4) malloc: *** error for object 0x1011e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(7403,0xa06431d4) malloc: *** error for object 0x1011e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(20950,0xa06431d4) malloc: *** error for object 0x3828604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(20950,0xa06431d4) malloc: *** error for object 0x3028604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(20950,0xa06431d4) malloc: *** error for object 0x402b604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(20950,0xa06431d4) malloc: *** error for object 0x301de04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(20950,0xa06431d4) malloc: *** error for object 0x301de00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(20950,0xa06431d4) malloc: *** error for object 0x3812604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(26077,0xa06431d4) malloc: *** error for object 0x202c204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(26077,0xa06431d4) malloc: *** error for object 0x82c604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(26077,0xa06431d4) malloc: *** error for object 0x1828604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(26077,0xa06431d4) malloc: *** error for object 0x816604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(32105,0xa06431d4) malloc: *** error for object 0x834204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(32105,0xb0005000) malloc: *** error for object 0x302f604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
23:02:58 (32105): No heartbeat from core client for 30 sec - exiting
23:04:14 (32105): No heartbeat from core client for 30 sec - exiting
23:04:15 (32105): No heartbeat from core client for 30 sec - exiting
23:04:16 (32105): No heartbeat from core client for 30 sec - exiting
23:04:17 (32105): No heartbeat from core client for 30 sec - exiting
23:04:19 (32105): No heartbeat from core client for 30 sec - exiting
23:04:20 (32105): No heartbeat from core client for 30 sec - exiting
23:04:22 (32105): No heartbeat from core client for 30 sec - exiting
23:04:23 (32105): No heartbeat from core client for 30 sec - exiting
23:04:24 (32105): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(32105,0xa06431d4) malloc: *** error for object 0x180b604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(32105,0xa06431d4) malloc: *** error for object 0x180b600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(32105,0xa06431d4) malloc: *** error for object 0x1802004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
23:10:16 (32105): No heartbeat from core client for 30 sec - exiting
23:10:17 (32105): No heartbeat from core client for 30 sec - exiting
23:10:18 (32105): No heartbeat from core client for 30 sec - exiting
23:10:19 (32105): No heartbeat from core client for 30 sec - exiting
23:10:20 (32105): No heartbeat from core client for 30 sec - exiting
23:10:21 (32105): No heartbeat from core client for 30 sec - exiting
23:10:22 (32105): No heartbeat from core client for 30 sec - exiting
23:10:23 (32105): No heartbeat from core client for 30 sec - exiting
23:10:24 (32105): No heartbeat from core client for 30 sec - exiting
23:10:25 (32105): No heartbeat from core client for 30 sec - exiting
23:10:26 (32105): No heartbeat from core client for 30 sec - exiting
23:10:27 (32105): No heartbeat from core client for 30 sec - exiting
23:10:28 (32105): No heartbeat from core client for 30 sec - exiting
23:10:29 (32105): No heartbeat from core client for 30 sec - exiting
23:10:30 (32105): No heartbeat from core client for 30 sec - exiting
23:10:31 (32105): No heartbeat from core client for 30 sec - exiting
23:10:32 (32105): No heartbeat from core client for 30 sec - exiting
23:10:33 (32105): No heartbeat from core client for 30 sec - exiting
23:10:34 (32105): No heartbeat from core client for 30 sec - exiting
23:10:36 (32105): No heartbeat from core client for 30 sec - exiting
04:12:11 (32105): No heartbeat from core client for 30 sec - exiting
04:12:13 (32105): No heartbeat from core client for 30 sec - exiting
04:12:14 (32105): No heartbeat from core client for 30 sec - exiting
04:12:15 (32105): No heartbeat from core client for 30 sec - exiting
04:12:16 (32105): No heartbeat from core client for 30 sec - exiting
04:12:17 (32105): No heartbeat from core client for 30 sec - exiting
04:12:18 (32105): No heartbeat from core client for 30 sec - exiting
04:12:19 (32105): No heartbeat from core client for 30 sec - exiting
04:12:20 (32105): No heartbeat from core client for 30 sec - exiting
04:12:21 (32105): No heartbeat from core client for 30 sec - exiting
04:12:22 (32105): No heartbeat from core client for 30 sec - exiting
04:12:23 (32105): No heartbeat from core client for 30 sec - exiting
04:12:25 (32105): No heartbeat from core client for 30 sec - exiting
04:12:26 (32105): No heartbeat from core client for 30 sec - exiting
04:12:27 (32105): No heartbeat from core client for 30 sec - exiting
04:12:28 (32105): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(44513,0xa06431d4) malloc: *** error for object 0x2820604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(44513,0xa06431d4) malloc: *** error for object 0x830604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
23:01:25 (44513): No heartbeat from core client for 30 sec - exiting
23:01:26 (44513): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(44513,0xa06431d4) malloc: *** error for object 0x821e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
23:00:48 (54530): No heartbeat from core client for 30 sec - exiting
23:00:50 (54530): No heartbeat from core client for 30 sec - exiting
23:00:51 (54530): No heartbeat from core client for 30 sec - exiting
23:00:52 (54530): No heartbeat from core client for 30 sec - exiting
23:00:53 (54530): No heartbeat from core client for 30 sec - exiting
23:00:54 (54530): No heartbeat from core client for 30 sec - exiting
23:00:55 (54530): No heartbeat from core client for 30 sec - exiting
23:00:56 (54530): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(54530,0xa06431d4) malloc: *** error for object 0x834204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
23:00:57 (54530): No heartbeat from core client for 30 sec - exiting
23:00:58 (54530): No heartbeat from core client for 30 sec - exiting
23:00:59 (54530): No heartbeat from core client for 30 sec - exiting
23:01:00 (54530): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(54530,0xa06431d4) malloc: *** error for object 0x834204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(54530,0xa06431d4) malloc: *** error for object 0x202a604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(54530,0xa06431d4) malloc: *** error for object 0x826e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(54530,0xa06431d4) malloc: *** error for object 0x826e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(54530,0xa06431d4) malloc: *** error for object 0x826e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
23:01:04 (64616): No heartbeat from core client for 30 sec - exiting
23:01:05 (64616): No heartbeat from core client for 30 sec - exiting
23:01:06 (64616): No heartbeat from core client for 30 sec - exiting
23:01:07 (64616): No heartbeat from core client for 30 sec - exiting
23:01:08 (64616): No heartbeat from core client for 30 sec - exiting
23:01:09 (64616): No heartbeat from core client for 30 sec - exiting
23:01:10 (64616): No heartbeat from core client for 30 sec - exiting
23:01:11 (64616): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(64616,0xa06431d4) malloc: *** error for object 0x182c604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(64616,0xa06431d4) malloc: *** error for object 0x82c204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(64616,0xa06431d4) malloc: *** error for object 0x1022c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(64616,0xa06431d4) malloc: *** error for object 0x2804e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(64616,0xa06431d4) malloc: *** error for object 0x2804e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
23:09:55 (64616): No heartbeat from core client for 30 sec - exiting
23:09:57 (64616): No heartbeat from core client for 30 sec - exiting
23:09:58 (64616): No heartbeat from core client for 30 sec - exiting
23:09:59 (64616): No heartbeat from core client for 30 sec - exiting
23:10:00 (64616): No heartbeat from core client for 30 sec - exiting
23:10:01 (64616): No heartbeat from core client for 30 sec - exiting
23:10:02 (64616): No heartbeat from core client for 30 sec - exiting
23:10:03 (64616): No heartbeat from core client for 30 sec - exiting
23:10:04 (64616): No heartbeat from core client for 30 sec - exiting
23:10:05 (64616): No heartbeat from core client for 30 sec - exiting
23:10:06 (64616): No heartbeat from core client for 30 sec - exiting
23:10:07 (64616): No heartbeat from core client for 30 sec - exiting
23:10:08 (64616): No heartbeat from core client for 30 sec - exiting
23:10:09 (64616): No heartbeat from core client for 30 sec - exiting
23:10:10 (64616): No heartbeat from core client for 30 sec - exiting
23:10:11 (64616): No heartbeat from core client for 30 sec - exiting
23:10:12 (64616): No heartbeat from core client for 30 sec - exiting
23:10:13 (64616): No heartbeat from core client for 30 sec - exiting
23:10:14 (64616): No heartbeat from core client for 30 sec - exiting
23:10:15 (64616): No heartbeat from core client for 30 sec - exiting
23:10:16 (64616): No heartbeat from core client for 30 sec - exiting
23:10:17 (64616): No heartbeat from core client for 30 sec - exiting
23:10:18 (64616): No heartbeat from core client for 30 sec - exiting
23:10:19 (64616): No heartbeat from core client for 30 sec - exiting
23:10:20 (64616): No heartbeat from core client for 30 sec - exiting
23:10:21 (64616): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(69961,0xa06431d4) malloc: *** error for object 0x828604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(69961,0xa06431d4) malloc: *** error for object 0x828604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(69961,0xa06431d4) malloc: *** error for object 0x1038604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(69961,0xa06431d4) malloc: *** error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.10.5 build 14F27
Mon Sep  7 10:19:33 2015

hadcm3n_6.07_i686-apple-darwin(74549,0xa06431d4) malloc: *** error for object 0x828604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
21:27:27 (74549): No heartbeat from core client for 30 sec - exiting
21:27:28 (74549): No heartbeat from core client for 30 sec - exiting
21:27:29 (74549): No heartbeat from core client for 30 sec - exiting
21:27:30 (74549): No heartbeat from core client for 30 sec - exiting
21:27:31 (74549): No heartbeat from core client for 30 sec - exiting
21:27:32 (74549): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(74549,0xa06431d4) malloc: *** error for object 0x828604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
21:27:33 (74549): No heartbeat from core client for 30 sec - exiting
21:27:34 (74549): No heartbeat from core client for 30 sec - exiting
21:27:35 (74549): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(74549,0xa06431d4) malloc: *** error for object 0x1028604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(74549,0xa06431d4) malloc: *** error for object 0x828604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(74549,0xa06431d4) malloc: *** error for object 0x828604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(74549,0xa06431d4) malloc: *** error for object 0x182c204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(74549,0xa06431d4) malloc: *** error for object 0x81b204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(74549,0xa06431d4) malloc: *** error for object 0x81b200: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(74549,0xa06431d4) malloc: *** error for object 0x801c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
23:01:02 (85134): No heartbeat from core client for 30 sec - exiting
23:01:04 (85134): No heartbeat from core client for 30 sec - exiting
23:01:05 (85134): No heartbeat from core client for 30 sec - exiting
23:01:06 (85134): No heartbeat from core client for 30 sec - exiting
23:01:07 (85134): No heartbeat from core client for 30 sec - exiting
23:01:09 (85134): No heartbeat from core client for 30 sec - exiting
23:01:10 (85134): No heartbeat from core client for 30 sec - exiting
23:01:11 (85134): No heartbeat from core client for 30 sec - exiting
23:01:12 (85134): No heartbeat from core client for 30 sec - exiting
23:01:13 (85134): No heartbeat from core client for 30 sec - exiting
23:01:14 (85134): No heartbeat from core client for 30 sec - exiting
23:01:15 (85134): No heartbeat from core client for 30 sec - exiting
23:01:16 (85134): No heartbeat from core client for 30 sec - exiting
hadcm3n_6.07_i686-apple-darwin(85134,0xa06431d4) malloc: *** error for object 0x1820604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(85134,0xa06431d4) malloc: *** error for object 0x83c204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(85134,0xa06431d4) malloc: *** error for object 0x2030604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(85134,0xa06431d4) malloc: *** error for object 0x1820604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(85134,0xa06431d4) malloc: *** error for object 0x2019e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(85134,0xa06431d4) malloc: *** error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3652,0xa06431d4) malloc: *** error for object 0x282c604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3652,0xa06431d4) malloc: *** error for object 0x182c204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3652,0xa06431d4) malloc: *** error for object 0x282c604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3652,0xa06431d4) malloc: *** error for object 0x824604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3652,0xa06431d4) malloc: *** error for object 0x1010e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3652,0xa06431d4) malloc: *** error for object 0x1011c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3652,0xa06431d4) malloc: *** error for object 0x1011c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3652,0xa06431d4) malloc: *** error for object 0x1010e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3652,0xa06431d4) malloc: *** error for object 0x101f404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3652,0xa06431d4) malloc: *** error for object 0x1805204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3652,0xa06431d4) malloc: *** error for object 0x2800e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3652,0xa06431d4) malloc: *** error for object 0x2800e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3652,0xa06431d4) malloc: *** error for object 0x401c404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3652,0xa06431d4) malloc: *** error for object 0x102da04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3652,0xa06431d4) malloc: *** error for object 0x102da00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3652,0xa06431d4) malloc: *** error for object 0x1813804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3652,0xa06431d4) malloc: *** error for object 0x1822204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(3652,0xa06431d4) malloc: *** error for object 0x1822200: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
00:08:43 (3652): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
23:02:11 (91777): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:19:11 (91847): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:19:15 (91847): No heartbeat from core client for 30 sec - exiting
23:19:16 (91847): No heartbeat from core client for 30 sec - exiting
23:19:17 (91847): No heartbeat from core client for 30 sec - exiting
23:19:19 (91847): No heartbeat from core client for 30 sec - exiting
23:19:20 (91847): No heartbeat from core client for 30 sec - exiting
23:19:21 (91847): No heartbeat from core client for 30 sec - exiting
23:19:22 (91847): No heartbeat from core client for 30 sec - exiting
SIGSEGV: segmentation violation
Suspended CPDN Monitor - Suspend request from BOINC...
00:34:21 (92071): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:45:31 (92789): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:57:28 (92900): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:57:38 (92900): No heartbeat from core client for 30 sec - exiting
00:57:39 (92900): No heartbeat from core client for 30 sec - exiting
00:57:40 (92900): No heartbeat from core client for 30 sec - exiting
00:57:41 (92900): No heartbeat from core client for 30 sec - exiting
00:57:42 (92900): No heartbeat from core client for 30 sec - exiting
00:57:43 (92900): No heartbeat from core client for 30 sec - exiting
00:57:44 (92900): No heartbeat from core client for 30 sec - exiting
00:57:45 (92900): No heartbeat from core client for 30 sec - exiting
00:57:46 (92900): No heartbeat from core client for 30 sec - exiting
00:57:47 (92900): No heartbeat from core client for 30 sec - exiting
00:57:48 (92900): No heartbeat from core client for 30 sec - exiting
00:57:49 (92900): No heartbeat from core client for 30 sec - exiting
00:57:50 (92900): No heartbeat from core client for 30 sec - exiting
00:57:51 (92900): No heartbeat from core client for 30 sec - exiting
01:10:34 (93117): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:10:44 (93117): No heartbeat from core client for 30 sec - exiting
01:10:45 (93117): No heartbeat from core client for 30 sec - exiting
01:21:50 (93274): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:22:01 (93274): No heartbeat from core client for 30 sec - exiting
01:22:02 (93274): No heartbeat from core client for 30 sec - exiting
01:22:03 (93274): No heartbeat from core client for 30 sec - exiting
01:22:04 (93274): No heartbeat from core client for 30 sec - exiting
01:22:05 (93274): No heartbeat from core client for 30 sec - exiting
01:22:06 (93274): No heartbeat from core client for 30 sec - exiting
01:22:07 (93274): No heartbeat from core client for 30 sec - exiting
01:22:08 (93274): No heartbeat from core client for 30 sec - exiting
01:22:10 (93274): No heartbeat from core client for 30 sec - exiting
01:22:11 (93274): No heartbeat from core client for 30 sec - exiting
01:22:12 (93274): No heartbeat from core client for 30 sec - exiting
01:22:13 (93274): No heartbeat from core client for 30 sec - exiting
01:22:14 (93274): No heartbeat from core client for 30 sec - exiting
01:22:15 (93274): No heartbeat from core client for 30 sec - exiting
01:22:16 (93274): No heartbeat from core client for 30 sec - exiting
01:22:17 (93274): No heartbeat from core client for 30 sec - exiting
01:22:18 (93274): No heartbeat from core client for 30 sec - exiting
01:22:19 (93274): No heartbeat from core client for 30 sec - exiting
SIGSEGV: segmentation violation
Suspended CPDN Monitor - Suspend request from BOINC...
03:21:01 (93441): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:21:20 (93441): No heartbeat from core client for 30 sec - exiting
03:21:21 (93441): No heartbeat from core client for 30 sec - exiting
03:21:22 (93441): No heartbeat from core client for 30 sec - exiting
03:25:10 (94748): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:37:36 (94787): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:41:24 (95765): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
SIGSEGV: segmentation violation
Suspended CPDN Monitor - Suspend request from BOINC...
04:53:16 (95823): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:58:19 (95949): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
SIGSEGV: segmentation violation
05:52:49 (95996): No heartbeat from core client for 30 sec - exiting
05:52:59 (95996): No heartbeat from core client for 30 sec - exiting
05:53:00 (95996): No heartbeat from core client for 30 sec - exiting
05:53:02 (95996): No heartbeat from core client for 30 sec - exiting
05:53:03 (95996): No heartbeat from core client for 30 sec - exiting
05:53:04 (95996): No heartbeat from core client for 30 sec - exiting
05:53:05 (95996): No heartbeat from core client for 30 sec - exiting
05:53:06 (95996): No heartbeat from core client for 30 sec - exiting
05:53:07 (95996): No heartbeat from core client for 30 sec - exiting
05:53:08 (95996): No heartbeat from core client for 30 sec - exiting
05:53:09 (95996): No heartbeat from core client for 30 sec - exiting
05:53:10 (95996): No heartbeat from core client for 30 sec - exiting
05:53:11 (95996): No heartbeat from core client for 30 sec - exiting
05:53:12 (95996): No heartbeat from core client for 30 sec - exiting
05:53:13 (95996): No heartbeat from core client for 30 sec - exiting
05:53:14 (95996): No heartbeat from core client for 30 sec - exiting
05:53:15 (95996): No heartbeat from core client for 30 sec - exiting
05:53:17 (95996): No heartbeat from core client for 30 sec - exiting
05:53:18 (95996): No heartbeat from core client for 30 sec - exiting
05:53:19 (95996): No heartbeat from core client for 30 sec - exiting
05:53:20 (95996): No heartbeat from core client for 30 sec - exiting
05:53:21 (95996): No heartbeat from core client for 30 sec - exiting
05:53:22 (95996): No heartbeat from core client for 30 sec - exiting
05:53:23 (95996): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:06:42 (96653): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1
06:10:53 (96771): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:11:01 (96771): No heartbeat from core client for 30 sec - exiting

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
06:14:27 (96864): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
SIGSEGV: segmentation violation

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
06:33:21 (96901): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:39:00 (97105): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:39:24 (97105): No heartbeat from core client for 30 sec - exiting

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
CPDN Monitor - Quit request from BOINC...
13:44:54 (3771): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1

BUFFIN: Read Failed: Result too large
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1

BUFFIN: Read Failed: Result too large
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1

BUFFIN: Read Failed: Result too large
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1

BUFFIN: Read Failed: Result too large
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1

BUFFIN: Read Failed: Result too large
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1

BUFFIN: Read Failed: Result too large
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
16 Sep 2015 05:18:11 1235736 18739046 hadcm3n_xam2_1980_40_010022222_1 725,760 958,793 1.3211
14 Sep 2015 22:33:28 1235736 18739046 hadcm3n_xam2_1980_40_010022222_1 699,840 910,737 1.3014
13 Sep 2015 13:01:13 1235736 18739046 hadcm3n_xam2_1980_40_010022222_1 673,920 862,745 1.2802
12 Sep 2015 22:32:49 1235736 18739046 hadcm3n_xam2_1980_40_010022222_1 648,000 815,072 1.2578
12 Sep 2015 09:35:02 1235736 18739046 hadcm3n_xam2_1980_40_010022222_1 622,080 771,854 1.2408
11 Sep 2015 20:13:27 1235736 18739046 hadcm3n_xam2_1980_40_010022222_1 596,160 728,007 1.2212
11 Sep 2015 07:58:36 1235736 18739046 hadcm3n_xam2_1980_40_010022222_1 570,240 684,700 1.2007
10 Sep 2015 04:19:35 1235736 18739046 hadcm3n_xam2_1980_40_010022222_1 544,320 641,060 1.1777
12 Aug 2015 01:10:34 1235736 18739046 hadcm3n_xam2_1980_40_010022222_1 518,400 607,781 1.1724
11 Aug 2015 02:22:17 1235736 18739046 hadcm3n_xam2_1980_40_010022222_1 492,480 582,009 1.1818
10 Aug 2015 02:10:24 1235736 18739046 hadcm3n_xam2_1980_40_010022222_1 466,560 555,886 1.1915
09 Aug 2015 14:41:24 1235736 18739046 hadcm3n_xam2_1980_40_010022222_1 440,640 529,966 1.2027
09 Aug 2015 05:38:50 1235736 18739046 hadcm3n_xam2_1980_40_010022222_1 414,720 504,071 1.2154
08 Aug 2015 19:09:26 1235736 18739046 hadcm3n_xam2_1980_40_010022222_1 388,800 477,881 1.2291
08 Aug 2015 10:47:50 1235736 18739046 hadcm3n_xam2_1980_40_010022222_1 362,880 451,386 1.2439
07 Aug 2015 22:49:00 1235736 18739046 hadcm3n_xam2_1980_40_010022222_1 336,960 424,555 1.2600
07 Aug 2015 10:31:21 1235736 18739046 hadcm3n_xam2_1980_40_010022222_1 311,040 398,110 1.2799
06 Aug 2015 14:59:17 1235736 18739046 hadcm3n_xam2_1980_40_010022222_1 285,120 371,474 1.3029
06 Aug 2015 00:03:33 1235736 18739046 hadcm3n_xam2_1980_40_010022222_1 259,200 345,165 1.3317
04 Aug 2015 23:09:21 1235736 18739046 hadcm3n_xam2_1980_40_010022222_1 233,280 318,729 1.3663


©2024 climateprediction.net