Task 16075489

Name	hadcm3n_ofaj_1900_40_008474942_2
Workunit	8625781
Created	29 Oct 2013, 14:07:51 UTC
Sent	29 Oct 2013, 14:08:04 UTC
Report deadline	28 Jan 2014, 21:35:15 UTC
Received	15 Nov 2013, 18:26:24 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1176682
Run time	11 days 13 hours 34 min 30 sec
CPU time	10 days 12 hours 35 min 23 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.46 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/ofajko.pja1c10 is not a valid UM file. Error converting file to netcdf: dataout/ofajko.pja1c10 Error: Input file: dataout/ofajko.pia1c10 is not a valid UM file. Error converting file to netcdf: dataout/ofajko.pia1c10 Error: Input file: dataout/ofajko.pfa1c10 is not a valid UM file. Error converting file to netcdf: dataout/ofajko.pfa1c10 Error: Input file: dataout/ofajka.pha1c10 is not a valid UM file. Error converting file to netcdf: dataout/ofajka.pha1c10 Error: Input file: dataout/ofajka.pga1c10 is not a valid UM file. Error converting file to netcdf: dataout/ofajka.pga1c10 Error: Input file: dataout/ofajka.pea1c10 is not a valid UM file. Error converting file to netcdf: dataout/ofajka.pea1c10 Error: Input file: dataout/ofajka.pda1c10 is not a valid UM file. Error converting file to netcdf: dataout/ofajka.pda1c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(33216,0xaca4a2c0) malloc: * error for object 0x11d2404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33216,0xaca4a2c0) malloc: * error for object 0x11d2400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33216,0xaca4a2c0) malloc: * error for object 0x29e6e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33216,0xaca4a2c0) malloc: * error for object 0x29e6e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33216,0xaca4a2c0) malloc: * error for object 0x39c0404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33216,0xaca4a2c0) malloc: * error for object 0x39c0400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33216,0xaca4a2c0) malloc: * error for object 0x9cae04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33216,0xaca4a2c0) malloc: * error for object 0x41e0c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(33216,0xaca4a2c0) malloc: * error for object 0x29cb804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33216,0xaca4a2c0) malloc: * error for object 0x29cb800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33216,0xaca4a2c0) malloc: * error for object 0x21c8404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Fri Nov 15 12:25:43 2013 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fa58 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/9/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90139000 - 0x9014ffff /usr/lib/system/libxpc.dylib 0x90b63000 - 0x90b81fff /usr/lib/system/libsystem_kernel.dylib 0x90ec9000 - 0x90ef7fff /usr/lib/libSystem.B.dylib 0x9185c000 - 0x918befff /usr/lib/libstdc++.6.dylib 0x91b47000 - 0x91b47fff /usr/lib/system/libkeymgr.dylib 0x92a05000 - 0x92a06fff /usr/lib/system/libsystem_blocks.dylib 0x93f37000 - 0x93f7afff /usr/lib/system/libcommonCrypto.dylib 0x94460000 - 0x94465fff /usr/lib/system/libmacho.dylib 0x95ce0000 - 0x95ceefff /usr/lib/libz.1.dylib 0x96c6f000 - 0x96c76fff /usr/lib/system/libsystem_notify.dylib 0x96f07000 - 0x96f08fff /usr/lib/system/libquarantine.dylib 0x96f80000 - 0x96f83fff /usr/lib/system/libmathCommon.A.dylib 0x96fc1000 - 0x96fc4fff /usr/lib/system/libcompiler_rt.dylib 0x97a13000 - 0x97a42fff /usr/lib/system/libsystem_info.dylib 0x98661000 - 0x98669fff /usr/lib/system/liblaunch.dylib 0x9866a000 - 0x9866bfff /usr/lib/system/libremovefile.dylib 0x98dad000 - 0x98db5fff /usr/lib/system/libcopyfile.dylib 0x98e40000 - 0x98e4efff /usr/lib/system/libdispatch.dylib 0x98e4f000 - 0x98f1afff /usr/lib/system/libsystem_c.dylib 0x9933f000 - 0x99346fff /usr/lib/system/libsystem_dnssd.dylib 0x9b3fd000 - 0x9b3fefff /usr/lib/system/libsystem_sandbox.dylib 0x9b927000 - 0x9b929fff /usr/lib/system/libdyld.dylib 0x9b92a000 - 0x9b92afff /usr/lib/system/libdnsinfo.dylib 0x9c01b000 - 0x9c023fff /usr/lib/system/libunwind.dylib 0x9c046000 - 0x9c04afff /usr/lib/system/libcache.dylib 0x9c04b000 - 0x9c04cfff /usr/lib/system/libunc.dylib 0x9c08b000 - 0x9c08ffff /usr/lib/system/libsystem_network.dylib 0x9c6a4000 - 0x9c6adfff /usr/lib/libc++abi.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Nov 2013 17:25:54	1176682	16075489	hadcm3n_ofaj_1900_40_008474942_2	777,600	909,313	1.1694
15 Nov 2013 08:25:42	1176682	16075489	hadcm3n_ofaj_1900_40_008474942_2	751,680	879,394	1.1699
14 Nov 2013 19:22:49	1176682	16075489	hadcm3n_ofaj_1900_40_008474942_2	725,760	848,928	1.1697
14 Nov 2013 10:08:41	1176682	16075489	hadcm3n_ofaj_1900_40_008474942_2	699,840	818,910	1.1701
13 Nov 2013 23:51:17	1176682	16075489	hadcm3n_ofaj_1900_40_008474942_2	673,920	789,041	1.1708
13 Nov 2013 14:47:47	1176682	16075489	hadcm3n_ofaj_1900_40_008474942_2	648,000	758,926	1.1712
13 Nov 2013 05:15:35	1176682	16075489	hadcm3n_ofaj_1900_40_008474942_2	622,080	728,239	1.1707
12 Nov 2013 19:58:03	1176682	16075489	hadcm3n_ofaj_1900_40_008474942_2	596,160	697,811	1.1705
12 Nov 2013 10:32:17	1176682	16075489	hadcm3n_ofaj_1900_40_008474942_2	570,240	667,832	1.1711
11 Nov 2013 21:19:14	1176682	16075489	hadcm3n_ofaj_1900_40_008474942_2	544,320	637,653	1.1715
07 Nov 2013 03:24:05	1176682	16075489	hadcm3n_ofaj_1900_40_008474942_2	518,400	607,504	1.1719
06 Nov 2013 17:35:25	1176682	16075489	hadcm3n_ofaj_1900_40_008474942_2	492,480	577,238	1.1721
06 Nov 2013 08:17:22	1176682	16075489	hadcm3n_ofaj_1900_40_008474942_2	466,560	547,078	1.1726
05 Nov 2013 20:48:36	1176682	16075489	hadcm3n_ofaj_1900_40_008474942_2	440,640	516,019	1.1711
05 Nov 2013 18:42:45	1176682	16075489	hadcm3n_ofaj_1900_40_008474942_2	414,720	486,958	1.1742
05 Nov 2013 02:46:13	1176682	16075489	hadcm3n_ofaj_1900_40_008474942_2	388,800	456,751	1.1748
04 Nov 2013 17:21:24	1176682	16075489	hadcm3n_ofaj_1900_40_008474942_2	362,880	426,317	1.1748
04 Nov 2013 07:54:01	1176682	16075489	hadcm3n_ofaj_1900_40_008474942_2	336,960	396,007	1.1752
03 Nov 2013 23:30:58	1176682	16075489	hadcm3n_ofaj_1900_40_008474942_2	311,040	365,586	1.1754
03 Nov 2013 13:14:10	1176682	16075489	hadcm3n_ofaj_1900_40_008474942_2	285,120	335,481	1.1766