Task 19134699

Name	hadcm3n_sata_198012_480_010221507_1
Workunit	10221507
Created	4 Dec 2015, 20:22:27 UTC
Sent	5 Dec 2015, 2:05:10 UTC
Report deadline	16 Nov 2016, 7:25:10 UTC
Received	5 Jan 2016, 9:34:08 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1381778
Run time	16 days 10 hours 45 min 10 sec
CPU time	14 days 10 hours 11 min 54 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	3.69 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.12</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(13308,0xa4266000) malloc: * error for object 0x2028a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13308,0xa4266000) malloc: * error for object 0x83c604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13308,0xa4266000) malloc: * error for object 0x83c600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13308,0xa4266000) malloc: * error for object 0x815e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13308,0xa4266000) malloc: * error for object 0x815e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13308,0xa4266000) malloc: * error for object 0x815e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(21599,0xa4266000) malloc: * error for object 0x824604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(21599,0xa4266000) malloc: * error for object 0x2028604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(21599,0xa4266000) malloc: * error for object 0x2001c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(21599,0xa4266000) malloc: * error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(21599,0xa4266000) malloc: * error for object 0x2001c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(21599,0xa4266000) malloc: * error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(21599,0xa4266000) malloc: * error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.2 build 15C50 Mon Jan 4 18:34:08 2016 hadcm3n_6.07_i686-apple-darwin(31628,0xa4266000) malloc: * error for object 0x103c204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31628,0xa4266000) malloc: * error for object 0x2827604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31628,0xa4266000) malloc: * error for object 0x2001c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31628,0xa4266000) malloc: * error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31628,0xa4266000) malloc: * error for object 0x2001c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31628,0xa4266000) malloc: * error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31628,0xa4266000) malloc: * error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(31755,0xa4266000) malloc: * error for object 0x282de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31755,0xa4266000) malloc: * error for object 0x282de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31755,0xa4266000) malloc: * error for object 0x282de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31755,0xa4266000) malloc: * error for object 0x282de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31755,0xa4266000) malloc: * error for object 0x282de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(31787,0xa4266000) malloc: * error for object 0x202de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31787,0xa4266000) malloc: * error for object 0x202de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31787,0xa4266000) malloc: * error for object 0x202de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31787,0xa4266000) malloc: * error for object 0x202de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31787,0xa4266000) malloc: * error for object 0x202de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(31885,0xa4266000) malloc: * error for object 0x83de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31885,0xa4266000) malloc: * error for object 0x83de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31885,0xa4266000) malloc: * error for object 0x83de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31885,0xa4266000) malloc: * error for object 0x83de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31885,0xa4266000) malloc: * error for object 0x83de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.2 build 15C50 Tue Jan 5 19:33:44 2016 Thread 0 Crashed: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fd48 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/6/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90396000 - 0x903c9fff /usr/lib/system/libsystem_m.dylib 0x903d0000 - 0x903e7fff /usr/lib/system/libsystem_coretls.dylib 0x90e1b000 - 0x90e1efff /usr/lib/system/libsystem_sandbox.dylib 0x91cb9000 - 0x91cd2fff /usr/lib/system/libsystem_malloc.dylib 0x91f89000 - 0x91f93fff /usr/lib/system/libsystem_notify.dylib 0x91f94000 - 0x91f94fff /usr/lib/system/libkeymgr.dylib 0x92135000 - 0x92146fff /usr/lib/system/libsystem_trace.dylib 0x9276e000 - 0x92773fff /usr/lib/system/libmacho.dylib 0x92a71000 - 0x92a79fff /usr/lib/system/libsystem_dnssd.dylib 0x92d33000 - 0x92d9cfff /usr/lib/system/libsystem_network.dylib 0x92d9d000 - 0x92da3fff /usr/lib/system/libsystem_platform.dylib 0x92dbd000 - 0x92dc0fff /usr/lib/system/libdyld.dylib 0x939bf000 - 0x93a12fff /usr/lib/libstdc++.6.dylib 0x93a13000 - 0x93a13fff /usr/lib/system/liblaunch.dylib 0x93af8000 - 0x93b06fff /usr/lib/libz.1.dylib 0x93db9000 - 0x93dbbfff /usr/lib/system/libquarantine.dylib 0x941a2000 - 0x941bbfff /usr/lib/system/libsystem_asl.dylib 0x94220000 - 0x94222fff /usr/lib/system/libsystem_coreservices.dylib 0x9587c000 - 0x9587efff /usr/lib/system/libsystem_configuration.dylib 0x9615d000 - 0x96163fff /usr/lib/system/libunwind.dylib 0x9616b000 - 0x9616cfff /usr/lib/system/libremovefile.dylib 0x964f3000 - 0x964f3fff /usr/lib/system/libsystem_blocks.dylib 0x965b9000 - 0x9664efff /usr/lib/system/libsystem_c.dylib 0x96ab5000 - 0x96adffff /usr/lib/system/libsystem_info.dylib 0x96d02000 - 0x96d0bfff /usr/lib/system/libsystem_networkextension.dylib 0x97b40000 - 0x97b42fff /usr/lib/system/libsystem_secinit.dylib 0x9827b000 - 0x9827bfff /usr/lib/system/libunc.dylib 0x98d57000 - 0x98d58fff /usr/lib/libSystem.B.dylib 0x98d59000 - 0x98d81fff /usr/lib/system/libxpc.dylib 0x98d99000 - 0x98db9fff /usr/lib/system/libsystem_kernel.dylib 0x99d2a000 - 0x99d2efff /usr/lib/system/libcache.dylib 0x9a471000 - 0x9a47afff /usr/lib/system/libcopyfile.dylib 0x9a854000 - 0x9a877fff /usr/lib/libc++abi.dylib 0x9c7bd000 - 0x9c7c8fff /usr/lib/system/libcommonCrypto.dylib 0x9cbd0000 - 0x9cbd8fff /usr/lib/system/libsystem_pthread.dylib 0x9dee8000 - 0x9df12fff /usr/lib/system/libdispatch.dylib 0x9df13000 - 0x9df7afff /usr/lib/system/libcorecrypto.dylib 0x9e4cc000 - 0x9e4d1fff /usr/lib/system/libcompiler_rt.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Jan 2016 16:47:16	1381778	19134699	hadcm3n_sata_198012_480_010221507_1	1,036,800	1,245,796	1.2016
31 Dec 2015 13:36:17	1381778	19134699	hadcm3n_sata_198012_480_010221507_1	1,010,880	1,215,449	1.2024
30 Dec 2015 22:53:49	1381778	19134699	hadcm3n_sata_198012_480_010221507_1	984,960	1,185,070	1.2032
30 Dec 2015 13:57:49	1381778	19134699	hadcm3n_sata_198012_480_010221507_1	959,040	1,154,488	1.2038
30 Dec 2015 04:45:24	1381778	19134699	hadcm3n_sata_198012_480_010221507_1	933,120	1,123,533	1.2041
29 Dec 2015 18:26:09	1381778	19134699	hadcm3n_sata_198012_480_010221507_1	907,200	1,092,885	1.2047
29 Dec 2015 08:24:33	1381778	19134699	hadcm3n_sata_198012_480_010221507_1	881,280	1,061,804	1.2048
28 Dec 2015 20:26:05	1381778	19134699	hadcm3n_sata_198012_480_010221507_1	855,360	1,030,563	1.2048
28 Dec 2015 11:24:49	1381778	19134699	hadcm3n_sata_198012_480_010221507_1	829,440	999,722	1.2053
28 Dec 2015 02:30:40	1381778	19134699	hadcm3n_sata_198012_480_010221507_1	803,520	968,671	1.2055
27 Dec 2015 17:22:29	1381778	19134699	hadcm3n_sata_198012_480_010221507_1	777,600	938,018	1.2063
27 Dec 2015 08:30:51	1381778	19134699	hadcm3n_sata_198012_480_010221507_1	751,680	907,670	1.2075
26 Dec 2015 23:20:39	1381778	19134699	hadcm3n_sata_198012_480_010221507_1	725,760	876,805	1.2081
26 Dec 2015 14:19:31	1381778	19134699	hadcm3n_sata_198012_480_010221507_1	699,840	846,049	1.2089
26 Dec 2015 04:31:45	1381778	19134699	hadcm3n_sata_198012_480_010221507_1	673,920	816,287	1.2113
25 Dec 2015 19:04:21	1381778	19134699	hadcm3n_sata_198012_480_010221507_1	648,000	785,879	1.2128
25 Dec 2015 09:12:48	1381778	19134699	hadcm3n_sata_198012_480_010221507_1	622,080	754,854	1.2134
22 Dec 2015 07:57:57	1381778	19134699	hadcm3n_sata_198012_480_010221507_1	596,160	723,741	1.2140
20 Dec 2015 00:45:03	1381778	19134699	hadcm3n_sata_198012_480_010221507_1	570,240	692,589	1.2146
19 Dec 2015 15:38:24	1381778	19134699	hadcm3n_sata_198012_480_010221507_1	544,320	662,129	1.2164