Task 14102671

Name	hadcm3n_o773_1980_40_007752991_0
Workunit	7908100
Created	16 Feb 2012, 22:29:44 UTC
Sent	16 Feb 2012, 22:29:49 UTC
Report deadline	18 May 2012, 5:57:00 UTC
Received	28 Feb 2012, 9:46:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1244925
Run time	8 days 20 hours 46 min 13 sec
CPU time	7 days 18 hours 27 min 21 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.83 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.12.35</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0xb67004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0xb82604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0xb82600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0xb67004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0xb82604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0xb82600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0x3368804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0x3368800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0x4b69c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0x4b85204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0x4b85200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0x4b85204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0x4b85200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0x137d604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0xb67004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0xb82604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0xb82600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0x137a804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0x137a800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0xb58804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0xb58800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0xb58804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0xb58800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0xb58804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0xb58800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36388,0xacfbb2c0) malloc: * error for object 0xb58800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.3 build 11D50b Tue Feb 28 04:45:01 2012 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fab8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/4/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x127000 - 0x155fff /usr/lib/libSystem.B.dylib 0x162000 - 0x166fff /usr/lib/system/libsystem_network.dylib 0x9012a000 - 0x90131fff /usr/lib/system/libsystem_dnssd.dylib 0x909d6000 - 0x90a19fff /usr/lib/system/libcommonCrypto.dylib 0x90a1a000 - 0x90a28fff /usr/lib/system/libdispatch.dylib 0x90a29000 - 0x90a31fff /usr/lib/system/liblaunch.dylib 0x91456000 - 0x91457fff /usr/lib/system/libsystem_blocks.dylib 0x91a6d000 - 0x91a83fff /usr/lib/system/libxpc.dylib 0x91ad4000 - 0x91ad4fff /usr/lib/system/libkeymgr.dylib 0x931e6000 - 0x931ebfff /usr/lib/system/libmacho.dylib 0x931ec000 - 0x931eefff /usr/lib/system/libdyld.dylib 0x9347c000 - 0x9347cfff /usr/lib/system/libdnsinfo.dylib 0x93942000 - 0x93945fff /usr/lib/system/libmathCommon.A.dylib 0x94017000 - 0x9401ffff /usr/lib/system/libcopyfile.dylib 0x94326000 - 0x94327fff /usr/lib/system/libunc.dylib 0x94353000 - 0x94354fff /usr/lib/system/libsystem_sandbox.dylib 0x94663000 - 0x94666fff /usr/lib/system/libcompiler_rt.dylib 0x94d0e000 - 0x94d16fff /usr/lib/system/libunwind.dylib 0x96b2b000 - 0x96b49fff /usr/lib/system/libsystem_kernel.dylib 0x9867e000 - 0x986e0fff /usr/lib/libstdc++.6.dylib 0x992e4000 - 0x992e8fff /usr/lib/system/libcache.dylib 0x99731000 - 0x99760fff /usr/lib/system/libsystem_info.dylib 0x99a14000 - 0x99adffff /usr/lib/system/libsystem_c.dylib 0x9ae7b000 - 0x9ae89fff /usr/lib/libz.1.dylib 0x9b203000 - 0x9b204fff /usr/lib/system/libremovefile.dylib 0x9b7d4000 - 0x9b7dbfff /usr/lib/system/libsystem_notify.dylib 0x9baf5000 - 0x9bafefff /usr/lib/libc++abi.dylib 0x9bd30000 - 0x9bd31fff /usr/lib/system/libquarantine.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Feb 2012 09:47:41	1191540	14102671	hadcm3n_o773_1980_40_007752991_0	518,400	671,238	1.2948
27 Feb 2012 19:05:23	1191540	14102671	hadcm3n_o773_1980_40_007752991_0	492,480	637,980	1.2954
26 Feb 2012 22:20:06	1191540	14102671	hadcm3n_o773_1980_40_007752991_0	466,560	606,682	1.3003
26 Feb 2012 12:22:15	1191540	14102671	hadcm3n_o773_1980_40_007752991_0	440,640	575,434	1.3059
26 Feb 2012 03:31:49	1191540	14102671	hadcm3n_o773_1980_40_007752991_0	414,720	543,174	1.3097
25 Feb 2012 09:46:32	1191540	14102671	hadcm3n_o773_1980_40_007752991_0	388,800	509,237	1.3098
24 Feb 2012 10:25:33	1191540	14102671	hadcm3n_o773_1980_40_007752991_0	362,880	475,313	1.3098
23 Feb 2012 22:21:14	1191540	14102671	hadcm3n_o773_1980_40_007752991_0	336,960	441,379	1.3099
23 Feb 2012 10:21:40	1191540	14102671	hadcm3n_o773_1980_40_007752991_0	311,040	407,597	1.3104
22 Feb 2012 16:47:53	1191540	14102671	hadcm3n_o773_1980_40_007752991_0	285,120	373,655	1.3105
22 Feb 2012 05:59:44	1191540	14102671	hadcm3n_o773_1980_40_007752991_0	259,200	339,743	1.3107
21 Feb 2012 19:53:49	1191540	14102671	hadcm3n_o773_1980_40_007752991_0	233,280	305,740	1.3106
21 Feb 2012 08:16:37	1191540	14102671	hadcm3n_o773_1980_40_007752991_0	207,360	271,842	1.3110
20 Feb 2012 20:30:10	1191540	14102671	hadcm3n_o773_1980_40_007752991_0	181,440	237,824	1.3108
20 Feb 2012 05:32:20	1191540	14102671	hadcm3n_o773_1980_40_007752991_0	155,520	203,889	1.3110
19 Feb 2012 14:46:47	1191540	14102671	hadcm3n_o773_1980_40_007752991_0	129,600	169,784	1.3101
19 Feb 2012 04:32:44	1191540	14102671	hadcm3n_o773_1980_40_007752991_0	103,680	136,093	1.3126
18 Feb 2012 15:22:59	1191540	14102671	hadcm3n_o773_1980_40_007752991_0	77,760	101,974	1.3114
18 Feb 2012 04:36:34	1191540	14102671	hadcm3n_o773_1980_40_007752991_0	51,840	68,106	1.3138
17 Feb 2012 11:23:43	1191540	14102671	hadcm3n_o773_1980_40_007752991_0	25,920	34,032	1.3130