Task 15596607

Name	hadcm3n_4hcj_1940_40_008309510_0
Workunit	8460645
Created	7 Feb 2013, 21:23:24 UTC
Sent	7 Feb 2013, 21:29:12 UTC
Report deadline	10 May 2013, 4:56:23 UTC
Received	25 Apr 2013, 6:40:06 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	752977
Run time	21 days 1 hours 38 min 26 sec
CPU time	19 days 16 hours 53 min 35 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	3.25 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.31</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(81034,0xac3ad2c0) malloc: * error for object 0x13e5004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81034,0xac3ad2c0) malloc: * error for object 0x13e5000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81034,0xac3ad2c0) malloc: * error for object 0x4bc8204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81034,0xac3ad2c0) malloc: * error for object 0x4bc8200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81034,0xac3ad2c0) malloc: * error for object 0x13e5004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81034,0xac3ad2c0) malloc: * error for object 0x13e5000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) hadcm3n_6.07_i686-apple-darwin(6107,0xacd292c0) malloc: * error for object 0x23c4c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6107,0xacd292c0) malloc: * error for object 0x23c4c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6107,0xacd292c0) malloc: * error for object 0xbe8804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6107,0xacd292c0) malloc: * error for object 0xbe8800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6107,0xacd292c0) malloc: * error for object 0xbe8804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6107,0xacd292c0) malloc: * error for object 0xbe8800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6107,0xacd292c0) malloc: * error for object 0xbe8804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6107,0xacd292c0) malloc: * error for object 0xbe8800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6107,0xacd292c0) malloc: * error for object 0xbe8804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6107,0xacd292c0) malloc: * error for object 0xbe8800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6107,0xacd292c0) malloc: * error for object 0x23bb800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63b Wed Apr 24 20:14:25 2013 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fd08 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/9/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x907b8000 - 0x907bbfff /usr/lib/system/libcompiler_rt.dylib 0x9121a000 - 0x91221fff /usr/lib/system/libsystem_dnssd.dylib 0x9190e000 - 0x9190efff /usr/lib/system/libdnsinfo.dylib 0x9240d000 - 0x92411fff /usr/lib/system/libcache.dylib 0x92774000 - 0x92774fff /usr/lib/system/libkeymgr.dylib 0x92a9e000 - 0x92acdfff /usr/lib/system/libsystem_info.dylib 0x92cb0000 - 0x92cb1fff /usr/lib/system/libsystem_sandbox.dylib 0x93332000 - 0x93333fff /usr/lib/system/libremovefile.dylib 0x9473c000 - 0x9473dfff /usr/lib/system/libquarantine.dylib 0x94df3000 - 0x94df8fff /usr/lib/system/libmacho.dylib 0x94e62000 - 0x94e6bfff /usr/lib/libc++abi.dylib 0x94fe2000 - 0x94ff0fff /usr/lib/system/libdispatch.dylib 0x9661c000 - 0x96624fff /usr/lib/system/libcopyfile.dylib 0x97980000 - 0x97987fff /usr/lib/system/libsystem_notify.dylib 0x97988000 - 0x9798cfff /usr/lib/system/libsystem_network.dylib 0x98143000 - 0x9820efff /usr/lib/system/libsystem_c.dylib 0x98c6c000 - 0x98c7afff /usr/lib/libz.1.dylib 0x990ec000 - 0x990edfff /usr/lib/system/libunc.dylib 0x990ef000 - 0x990f2fff /usr/lib/system/libmathCommon.A.dylib 0x992f8000 - 0x992f9fff /usr/lib/system/libsystem_blocks.dylib 0x9b4ea000 - 0x9b4ecfff /usr/lib/system/libdyld.dylib 0x9b855000 - 0x9b873fff /usr/lib/system/libsystem_kernel.dylib 0x9c050000 - 0x9c066fff /usr/lib/system/libxpc.dylib 0x9c0c1000 - 0x9c0c9fff /usr/lib/system/libunwind.dylib 0x9c271000 - 0x9c2d3fff /usr/lib/libstdc++.6.dylib 0x9c996000 - 0x9c9c4fff /usr/lib/libSystem.B.dylib 0x9cdba000 - 0x9cdfdfff /usr/lib/system/libcommonCrypto.dylib 0x9ceb9000 - 0x9cec1fff /usr/lib/system/liblaunch.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Mar 2013 01:14:07	752977	15596607	hadcm3n_4hcj_1940_40_008309510_0	1,036,800	1,701,762	1.6414
07 Mar 2013 11:56:55	752977	15596607	hadcm3n_4hcj_1940_40_008309510_0	1,010,880	1,656,746	1.6389
06 Mar 2013 22:26:03	752977	15596607	hadcm3n_4hcj_1940_40_008309510_0	984,960	1,611,671	1.6363
06 Mar 2013 08:50:49	752977	15596607	hadcm3n_4hcj_1940_40_008309510_0	959,040	1,565,845	1.6327
05 Mar 2013 19:34:58	752977	15596607	hadcm3n_4hcj_1940_40_008309510_0	933,120	1,520,788	1.6298
05 Mar 2013 06:00:05	752977	15596607	hadcm3n_4hcj_1940_40_008309510_0	907,200	1,476,066	1.6271
04 Mar 2013 17:27:22	752977	15596607	hadcm3n_4hcj_1940_40_008309510_0	881,280	1,431,361	1.6242
03 Mar 2013 20:27:24	752977	15596607	hadcm3n_4hcj_1940_40_008309510_0	855,360	1,386,908	1.6214
03 Mar 2013 00:53:58	752977	15596607	hadcm3n_4hcj_1940_40_008309510_0	829,440	1,340,819	1.6165
02 Mar 2013 01:09:58	752977	15596607	hadcm3n_4hcj_1940_40_008309510_0	803,520	1,289,309	1.6046
01 Mar 2013 01:45:47	752977	15596607	hadcm3n_4hcj_1940_40_008309510_0	777,600	1,236,487	1.5901
28 Feb 2013 02:16:03	752977	15596607	hadcm3n_4hcj_1940_40_008309510_0	751,680	1,183,719	1.5748
27 Feb 2013 08:51:50	752977	15596607	hadcm3n_4hcj_1940_40_008309510_0	725,760	1,143,716	1.5759
26 Feb 2013 14:25:34	752977	15596607	hadcm3n_4hcj_1940_40_008309510_0	699,840	1,103,538	1.5768
25 Feb 2013 21:15:50	752977	15596607	hadcm3n_4hcj_1940_40_008309510_0	673,920	1,064,268	1.5792
25 Feb 2013 03:37:55	752977	15596607	hadcm3n_4hcj_1940_40_008309510_0	648,000	1,023,900	1.5801
24 Feb 2013 09:25:37	752977	15596607	hadcm3n_4hcj_1940_40_008309510_0	622,080	983,780	1.5814
23 Feb 2013 19:41:42	752977	15596607	hadcm3n_4hcj_1940_40_008309510_0	596,160	943,117	1.5820
23 Feb 2013 07:31:53	752977	15596607	hadcm3n_4hcj_1940_40_008309510_0	570,240	902,738	1.5831
22 Feb 2013 19:47:11	752977	15596607	hadcm3n_4hcj_1940_40_008309510_0	544,320	862,402	1.5844