Task 15840783

Name	hadcm3n_o6qp_1980_40_008384415_1
Workunit	8535274
Created	13 Jun 2013, 0:24:06 UTC
Sent	13 Jun 2013, 0:40:37 UTC
Report deadline	12 Sep 2013, 8:07:48 UTC
Received	6 Jul 2013, 0:08:35 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1218556
Run time	12 days 18 hours 16 min 57 sec
CPU time	11 days 9 hours 53 min 29 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.79 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(27798,0xad1b52c0) malloc: * error for object 0x3a6c004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27798,0xad1b52c0) malloc: * error for object 0x3a6c000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27798,0xad1b52c0) malloc: * error for object 0x4266e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27798,0xad1b52c0) malloc: * error for object 0x4266e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27798,0xad1b52c0) malloc: * error for object 0x4266e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27798,0xad1b52c0) malloc: * error for object 0x4266e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27798,0xad1b52c0) malloc: * error for object 0x4266e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27798,0xad1b52c0) malloc: * error for object 0x4266e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27798,0xad1b52c0) malloc: * error for object 0x4266e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27798,0xad1b52c0) malloc: * error for object 0x4266e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27798,0xad1b52c0) malloc: * error for object 0x4266e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27798,0xad1b52c0) malloc: * error for object 0x4266e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(72571,0xad1b52c0) malloc: * error for object 0x2232600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(77439,0xad1b52c0) malloc: * error for object 0xb03804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(77439,0xad1b52c0) malloc: * error for object 0xb03800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(77439,0xad1b52c0) malloc: * error for object 0x22eb404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(77439,0xad1b52c0) malloc: * error for object 0x22eb400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(77439,0xad1b52c0) malloc: * error for object 0x22e9604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(77439,0xad1b52c0) malloc: * error for object 0x22e9600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(77439,0xad1b52c0) malloc: * error for object 0x22e9604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(77439,0xad1b52c0) malloc: * error for object 0x22e9600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(77439,0xad1b52c0) malloc: * error for object 0x22e9604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(77439,0xad1b52c0) malloc: * error for object 0x22e9600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(77439,0xad1b52c0) malloc: * error for object 0x12e9600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Fri Jul 5 18:39:27 2013 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fce8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/15/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90f53000 - 0x90f69fff /usr/lib/system/libxpc.dylib 0x92097000 - 0x920f9fff /usr/lib/libstdc++.6.dylib 0x936f6000 - 0x936f7fff /usr/lib/system/libsystem_blocks.dylib 0x9479f000 - 0x947a3fff /usr/lib/system/libsystem_network.dylib 0x949af000 - 0x949b0fff /usr/lib/system/libunc.dylib 0x949b2000 - 0x949bafff /usr/lib/system/liblaunch.dylib 0x952fe000 - 0x95301fff /usr/lib/system/libmathCommon.A.dylib 0x95512000 - 0x95513fff /usr/lib/system/libremovefile.dylib 0x9573f000 - 0x9576efff /usr/lib/system/libsystem_info.dylib 0x968e2000 - 0x968e3fff /usr/lib/system/libsystem_sandbox.dylib 0x968e4000 - 0x968ebfff /usr/lib/system/libsystem_notify.dylib 0x969b4000 - 0x969bcfff /usr/lib/system/libunwind.dylib 0x96f3b000 - 0x96f3cfff /usr/lib/system/libquarantine.dylib 0x97c49000 - 0x97c51fff /usr/lib/system/libcopyfile.dylib 0x98ed4000 - 0x98ed6fff /usr/lib/system/libdyld.dylib 0x98f4c000 - 0x98f8ffff /usr/lib/system/libcommonCrypto.dylib 0x9969b000 - 0x996a9fff /usr/lib/system/libdispatch.dylib 0x998b1000 - 0x998b6fff /usr/lib/system/libmacho.dylib 0x9a64b000 - 0x9a64bfff /usr/lib/system/libkeymgr.dylib 0x9a680000 - 0x9a689fff /usr/lib/libc++abi.dylib 0x9a7d3000 - 0x9a7dafff /usr/lib/system/libsystem_dnssd.dylib 0x9a966000 - 0x9a994fff /usr/lib/libSystem.B.dylib 0x9a995000 - 0x9a998fff /usr/lib/system/libcompiler_rt.dylib 0x9a999000 - 0x9a999fff /usr/lib/system/libdnsinfo.dylib 0x9ae8d000 - 0x9aeabfff /usr/lib/system/libsystem_kernel.dylib 0x9bdb2000 - 0x9bdc0fff /usr/lib/libz.1.dylib 0x9c344000 - 0x9c348fff /usr/lib/system/libcache.dylib 0x9c4e2000 - 0x9c5adfff /usr/lib/system/libsystem_c.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Jul 2013 05:06:16	1218556	15840783	hadcm3n_o6qp_1980_40_008384415_1	518,400	984,388	1.8989
04 Jul 2013 14:20:19	1218556	15840783	hadcm3n_o6qp_1980_40_008384415_1	492,480	937,329	1.9033
02 Jul 2013 11:12:30	1218556	15840783	hadcm3n_o6qp_1980_40_008384415_1	466,560	890,865	1.9094
02 Jul 2013 10:15:50	1218556	15840783	hadcm3n_o6qp_1980_40_008384415_1	440,640	843,728	1.9148
28 Jun 2013 13:10:26	1218556	15840783	hadcm3n_o6qp_1980_40_008384415_1	414,720	795,663	1.9186
27 Jun 2013 21:06:16	1218556	15840783	hadcm3n_o6qp_1980_40_008384415_1	388,800	744,811	1.9157
26 Jun 2013 22:03:33	1218556	15840783	hadcm3n_o6qp_1980_40_008384415_1	362,880	695,810	1.9175
26 Jun 2013 01:40:52	1218556	15840783	hadcm3n_o6qp_1980_40_008384415_1	336,960	646,032	1.9172
25 Jun 2013 08:41:09	1218556	15840783	hadcm3n_o6qp_1980_40_008384415_1	311,040	596,081	1.9164
24 Jun 2013 09:30:15	1218556	15840783	hadcm3n_o6qp_1980_40_008384415_1	285,120	546,957	1.9183
23 Jun 2013 02:24:01	1218556	15840783	hadcm3n_o6qp_1980_40_008384415_1	259,200	496,719	1.9164
21 Jun 2013 22:23:28	1218556	15840783	hadcm3n_o6qp_1980_40_008384415_1	233,280	446,064	1.9121
20 Jun 2013 23:18:08	1218556	15840783	hadcm3n_o6qp_1980_40_008384415_1	207,360	396,459	1.9119
20 Jun 2013 07:27:24	1218556	15840783	hadcm3n_o6qp_1980_40_008384415_1	181,440	345,670	1.9051
19 Jun 2013 15:34:25	1218556	15840783	hadcm3n_o6qp_1980_40_008384415_1	155,520	294,868	1.8960
18 Jun 2013 07:08:01	1218556	15840783	hadcm3n_o6qp_1980_40_008384415_1	129,600	244,369	1.8856
17 Jun 2013 12:27:27	1218556	15840783	hadcm3n_o6qp_1980_40_008384415_1	103,680	194,568	1.8766
16 Jun 2013 14:18:12	1218556	15840783	hadcm3n_o6qp_1980_40_008384415_1	77,760	145,093	1.8659
15 Jun 2013 14:37:06	1218556	15840783	hadcm3n_o6qp_1980_40_008384415_1	51,840	97,310	1.8771
13 Jun 2013 18:45:55	1218556	15840783	hadcm3n_o6qp_1980_40_008384415_1	25,920	49,128	1.8954