Task 19161601

Name	hadcm3n_xdmh_198012_480_010221159_1
Workunit	10221159
Created	15 Dec 2015, 17:52:37 UTC
Sent	15 Dec 2015, 17:52:43 UTC
Report deadline	26 Nov 2016, 23:12:43 UTC
Received	26 Feb 2016, 22:30:05 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1358420
Run time	23 days 19 hours 52 min 31 sec
CPU time	21 days 22 hours 45 min 39 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	3.37 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:12:07 (524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(14619,0xa06511d4) malloc: * error for object 0x844604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(14619,0xa06511d4) malloc: * error for object 0x201f604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(14619,0xa06511d4) malloc: * error for object 0x481b604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(14619,0xa06511d4) malloc: * error for object 0x401f604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(14619,0xa06511d4) malloc: * error for object 0x844604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(14619,0xa06511d4) malloc: * error for object 0x844600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(14619,0xa06511d4) malloc: * error for object 0x382e204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(14619,0xa06511d4) malloc: * error for object 0x382e200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(14619,0xa06511d4) malloc: * error for object 0x382e204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(14619,0xa06511d4) malloc: * error for object 0x382e200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(14619,0xa06511d4) malloc: * error for object 0x382e200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-apple-darwin(447,0xa06511d4) malloc: * error for object 0x182c204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(447,0xa06511d4) malloc: * error for object 0x820604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(447,0xa06511d4) malloc: * error for object 0x4020604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(447,0xa06511d4) malloc: * error for object 0x4000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(447,0xa06511d4) malloc: * error for object 0x4000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(447,0xa06511d4) malloc: * error for object 0x4000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(447,0xa06511d4) malloc: * error for object 0x4000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(447,0xa06511d4) malloc: * error for object 0x4000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.5 build 14F1605 Fri Feb 19 08:50:53 2016 hadcm3n_6.07_i686-apple-darwin(447,0xa06511d4) malloc: * error for object 0x1020604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-apple-darwin(479,0xa06511d4) malloc: * error for object 0x1850204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(479,0xa06511d4) malloc: * error for object 0x1024604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(479,0xa06511d4) malloc: * error for object 0x3023604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(479,0xa06511d4) malloc: * error for object 0x1024604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(479,0xa06511d4) malloc: * error for object 0x3015c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(479,0xa06511d4) malloc: * error for object 0x3015c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(479,0xa06511d4) malloc: * error for object 0x3015c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(479,0xa06511d4) malloc: * error for object 0x3015c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(479,0xa06511d4) malloc: * error for object 0x3015c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(473,0xa06511d4) malloc: * error for object 0x3044604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(473,0xa06511d4) malloc: * error for object 0x1019c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(473,0xa06511d4) malloc: * error for object 0x1019c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(473,0xa06511d4) malloc: * error for object 0x1019c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(473,0xa06511d4) malloc: * error for object 0x1019c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(473,0xa06511d4) malloc: * error for object 0x1019c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(473,0xa06511d4) malloc: * error for object 0x1019c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(473,0xa06511d4) malloc: * error for object 0x1019c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.5 build 14F1605 Fri Feb 26 13:29:58 2016 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fd88 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/5/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90034000 - 0x90038fff /usr/lib/system/libcache.dylib 0x902d5000 - 0x902dbfff /usr/lib/system/libsystem_platform.dylib 0x904d6000 - 0x90529fff /usr/lib/libstdc++.6.dylib 0x905ac000 - 0x905bdfff /usr/lib/system/libsystem_coretls.dylib 0x905ce000 - 0x90601fff /usr/lib/system/libsystem_m.dylib 0x907ae000 - 0x907b1fff /usr/lib/system/libdyld.dylib 0x91a28000 - 0x91a36fff /usr/lib/libz.1.dylib 0x91bf3000 - 0x91c12fff /usr/lib/system/libsystem_kernel.dylib 0x91c42000 - 0x91c4afff /usr/lib/system/libsystem_dnssd.dylib 0x921bc000 - 0x921c4fff /usr/lib/system/libsystem_pthread.dylib 0x92af2000 - 0x92af4fff /usr/lib/system/libsystem_sandbox.dylib 0x940cc000 - 0x94109fff /usr/lib/system/libsystem_network.dylib 0x948c1000 - 0x948e7fff /usr/lib/libc++abi.dylib 0x94924000 - 0x94924fff /usr/lib/system/libunc.dylib 0x94c4b000 - 0x94c4dfff /usr/lib/system/libsystem_coreservices.dylib 0x94c77000 - 0x94c9efff /usr/lib/system/libdispatch.dylib 0x95667000 - 0x9566dfff /usr/lib/system/libsystem_trace.dylib 0x963df000 - 0x963ebfff /usr/lib/system/libcommonCrypto.dylib 0x96c05000 - 0x96c06fff /usr/lib/system/libremovefile.dylib 0x96c16000 - 0x96c3cfff /usr/lib/system/libxpc.dylib 0x97333000 - 0x9739ffff /usr/lib/system/libcorecrypto.dylib 0x973a0000 - 0x973a1fff /usr/lib/system/libsystem_blocks.dylib 0x98466000 - 0x98468fff /usr/lib/system/libquarantine.dylib 0x98648000 - 0x9864dfff /usr/lib/system/libmacho.dylib 0x98770000 - 0x98787fff /usr/lib/system/libsystem_asl.dylib 0x9878c000 - 0x98821fff /usr/lib/system/libsystem_c.dylib 0x99130000 - 0x99135fff /usr/lib/system/libcompiler_rt.dylib 0x99988000 - 0x999b1fff /usr/lib/system/libsystem_info.dylib 0x9ac46000 - 0x9ac4cfff /usr/lib/system/libsystem_networkextension.dylib 0x9af14000 - 0x9af2dfff /usr/lib/system/libsystem_malloc.dylib 0x9b17b000 - 0x9b184fff /usr/lib/system/libcopyfile.dylib 0x9b1b9000 - 0x9b1bbfff /usr/lib/system/libsystem_configuration.dylib 0x9b374000 - 0x9b374fff /usr/lib/system/libkeymgr.dylib 0x9b381000 - 0x9b38afff /usr/lib/system/libsystem_notify.dylib 0x9bf33000 - 0x9bf33fff /usr/lib/system/liblaunch.dylib 0x9bf61000 - 0x9bf68fff /usr/lib/system/libunwind.dylib 0x9bf96000 - 0x9bf98fff /usr/lib/system/libsystem_secinit.dylib 0x9c07f000 - 0x9c080fff /usr/lib/libSystem.B.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Feb 2016 23:08:03	1358420	19161601	hadcm3n_xdmh_198012_480_010221159_1	1,036,800	1,896,096	1.8288
16 Feb 2016 22:00:06	1358420	19161601	hadcm3n_xdmh_198012_480_010221159_1	1,010,880	1,847,685	1.8278
11 Feb 2016 20:05:25	1358420	19161601	hadcm3n_xdmh_198012_480_010221159_1	984,960	1,799,716	1.8272
10 Feb 2016 17:35:48	1358420	19161601	hadcm3n_xdmh_198012_480_010221159_1	959,040	1,751,226	1.8260
09 Feb 2016 09:57:17	1358420	19161601	hadcm3n_xdmh_198012_480_010221159_1	933,120	1,703,721	1.8258
05 Feb 2016 23:39:30	1358420	19161601	hadcm3n_xdmh_198012_480_010221159_1	907,200	1,655,573	1.8249
04 Feb 2016 17:25:21	1358420	19161601	hadcm3n_xdmh_198012_480_010221159_1	881,280	1,606,952	1.8234
02 Feb 2016 19:38:41	1358420	19161601	hadcm3n_xdmh_198012_480_010221159_1	855,360	1,556,830	1.8201
29 Jan 2016 20:02:40	1358420	19161601	hadcm3n_xdmh_198012_480_010221159_1	829,440	1,509,891	1.8204
29 Jan 2016 05:47:02	1358420	19161601	hadcm3n_xdmh_198012_480_010221159_1	803,520	1,460,699	1.8179
28 Jan 2016 15:01:06	1358420	19161601	hadcm3n_xdmh_198012_480_010221159_1	777,600	1,411,688	1.8154
28 Jan 2016 00:29:12	1358420	19161601	hadcm3n_xdmh_198012_480_010221159_1	751,680	1,362,492	1.8126
26 Jan 2016 17:12:44	1358420	19161601	hadcm3n_xdmh_198012_480_010221159_1	725,760	1,313,761	1.8102
22 Jan 2016 22:11:03	1358420	19161601	hadcm3n_xdmh_198012_480_010221159_1	699,840	1,269,341	1.8138
21 Jan 2016 15:23:03	1358420	19161601	hadcm3n_xdmh_198012_480_010221159_1	673,920	1,223,531	1.8155
19 Jan 2016 16:32:49	1358420	19161601	hadcm3n_xdmh_198012_480_010221159_1	648,000	1,177,701	1.8174
18 Jan 2016 10:06:09	1358420	19161601	hadcm3n_xdmh_198012_480_010221159_1	622,080	1,131,855	1.8195
17 Jan 2016 20:37:15	1358420	19161601	hadcm3n_xdmh_198012_480_010221159_1	596,160	1,088,139	1.8252
17 Jan 2016 07:03:57	1358420	19161601	hadcm3n_xdmh_198012_480_010221159_1	570,240	1,044,181	1.8311
16 Jan 2016 17:09:12	1358420	19161601	hadcm3n_xdmh_198012_480_010221159_1	544,320	999,105	1.8355