Task 15442804

Name	hadcm3n_zkur_1880_40_008246621_1
Workunit	8401745
Created	21 Nov 2012, 2:29:28 UTC
Sent	21 Nov 2012, 2:29:38 UTC
Report deadline	20 Feb 2013, 9:56:49 UTC
Received	16 Dec 2012, 5:04:18 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1176125
Run time	21 days 7 hours 10 min 20 sec
CPU time	19 days 22 hours 31 min
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.22 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(74463,0xac72d2c0) malloc: * error for object 0x4858a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74463,0xac72d2c0) malloc: * error for object 0x4858a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74463,0xac72d2c0) malloc: * error for object 0x2858a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74463,0xac72d2c0) malloc: * error for object 0x2858a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74463,0xac72d2c0) malloc: * error for object 0x2858a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74463,0xac72d2c0) malloc: * error for object 0x2858a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74463,0xac72d2c0) malloc: * error for object 0x2858a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74463,0xac72d2c0) malloc: * error for object 0x2858a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74463,0xac72d2c0) malloc: * error for object 0x2858a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74463,0xac72d2c0) malloc: * error for object 0x2858a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74463,0xac72d2c0) malloc: * error for object 0x2858a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74463,0xac72d2c0) malloc: * error for object 0x2858a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(63429,0xac72d2c0) malloc: * error for object 0x22dba04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(63429,0xac72d2c0) malloc: * error for object 0x22dba00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(63429,0xac72d2c0) malloc: * error for object 0x22dba04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Sun Dec 16 05:29:31 2012 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8f9a8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/6/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x9040c000 - 0x90413fff /usr/lib/system/libsystem_dnssd.dylib 0x90414000 - 0x90422fff /usr/lib/system/libdispatch.dylib 0x90423000 - 0x90424fff /usr/lib/system/libsystem_sandbox.dylib 0x90428000 - 0x9042cfff /usr/lib/system/libcache.dylib 0x90509000 - 0x90509fff /usr/lib/system/libkeymgr.dylib 0x908b5000 - 0x908cbfff /usr/lib/system/libxpc.dylib 0x9099d000 - 0x909a1fff /usr/lib/system/libsystem_network.dylib 0x90a0b000 - 0x90a10fff /usr/lib/system/libmacho.dylib 0x90d8d000 - 0x90d8efff /usr/lib/system/libunc.dylib 0x910d0000 - 0x910d3fff /usr/lib/system/libcompiler_rt.dylib 0x917f4000 - 0x917f6fff /usr/lib/system/libdyld.dylib 0x91974000 - 0x91982fff /usr/lib/libz.1.dylib 0x91983000 - 0x919b1fff /usr/lib/libSystem.B.dylib 0x91d36000 - 0x91d3efff /usr/lib/system/liblaunch.dylib 0x92461000 - 0x92469fff /usr/lib/system/libunwind.dylib 0x92784000 - 0x92785fff /usr/lib/system/libsystem_blocks.dylib 0x9328e000 - 0x9328efff /usr/lib/system/libdnsinfo.dylib 0x933e3000 - 0x933ecfff /usr/lib/libc++abi.dylib 0x93d12000 - 0x93d13fff /usr/lib/system/libremovefile.dylib 0x945fb000 - 0x945fefff /usr/lib/system/libmathCommon.A.dylib 0x962f0000 - 0x963bbfff /usr/lib/system/libsystem_c.dylib 0x97934000 - 0x97996fff /usr/lib/libstdc++.6.dylib 0x97997000 - 0x979dafff /usr/lib/system/libcommonCrypto.dylib 0x9b00f000 - 0x9b016fff /usr/lib/system/libsystem_notify.dylib 0x9c1c9000 - 0x9c1e7fff /usr/lib/system/libsystem_kernel.dylib 0x9c68f000 - 0x9c690fff /usr/lib/system/libquarantine.dylib 0x9c9d6000 - 0x9c9defff /usr/lib/system/libcopyfile.dylib 0x9cb8e000 - 0x9cbbdfff /usr/lib/system/libsystem_info.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Dec 2012 05:08:52	1176125	15442804	hadcm3n_zkur_1880_40_008246621_1	777,600	1,722,652	2.2153
15 Dec 2012 13:15:20	1176125	15442804	hadcm3n_zkur_1880_40_008246621_1	751,680	1,668,853	2.2202
14 Dec 2012 12:25:23	1176125	15442804	hadcm3n_zkur_1880_40_008246621_1	725,760	1,612,258	2.2215
14 Dec 2012 05:41:49	1176125	15442804	hadcm3n_zkur_1880_40_008246621_1	699,840	1,556,766	2.2245
14 Dec 2012 05:41:49	1176125	15442804	hadcm3n_zkur_1880_40_008246621_1	673,920	1,501,305	2.2277
14 Dec 2012 05:41:49	1176125	15442804	hadcm3n_zkur_1880_40_008246621_1	648,000	1,445,283	2.2304
14 Dec 2012 05:41:49	1176125	15442804	hadcm3n_zkur_1880_40_008246621_1	622,080	1,385,638	2.2274
14 Dec 2012 05:41:49	1176125	15442804	hadcm3n_zkur_1880_40_008246621_1	596,160	1,325,891	2.2241
14 Dec 2012 05:41:49	1176125	15442804	hadcm3n_zkur_1880_40_008246621_1	570,240	1,265,784	2.2197
14 Dec 2012 05:41:49	1176125	15442804	hadcm3n_zkur_1880_40_008246621_1	544,320	1,205,785	2.2152
07 Dec 2012 14:37:59	1176125	15442804	hadcm3n_zkur_1880_40_008246621_1	518,400	1,145,647	2.2100
06 Dec 2012 20:28:58	1176125	15442804	hadcm3n_zkur_1880_40_008246621_1	492,480	1,085,536	2.2042
06 Dec 2012 02:47:17	1176125	15442804	hadcm3n_zkur_1880_40_008246621_1	466,560	1,025,987	2.1990
05 Dec 2012 03:08:17	1176125	15442804	hadcm3n_zkur_1880_40_008246621_1	440,640	966,647	2.1937
04 Dec 2012 06:01:36	1176125	15442804	hadcm3n_zkur_1880_40_008246621_1	414,720	907,375	2.1879
03 Dec 2012 07:09:03	1176125	15442804	hadcm3n_zkur_1880_40_008246621_1	388,800	850,807	2.1883
02 Dec 2012 15:39:54	1176125	15442804	hadcm3n_zkur_1880_40_008246621_1	362,880	798,388	2.2001
01 Dec 2012 22:31:29	1176125	15442804	hadcm3n_zkur_1880_40_008246621_1	336,960	742,083	2.2023
01 Dec 2012 05:00:27	1176125	15442804	hadcm3n_zkur_1880_40_008246621_1	311,040	682,096	2.1930
30 Nov 2012 05:06:01	1176125	15442804	hadcm3n_zkur_1880_40_008246621_1	285,120	622,278	2.1825