Task 14648686

Name	hadcm3n_209u_1980_40_007957342_1
Workunit	8112454
Created	9 May 2012, 13:20:50 UTC
Sent	9 May 2012, 13:40:24 UTC
Report deadline	8 Aug 2012, 21:07:35 UTC
Received	11 Jul 2012, 14:58:09 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1217230
Run time	4 days 3 hours 46 min 53 sec
CPU time	3 days 20 hours 20 min
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.06 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:55:18 (30579): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:55:20 (30579): No heartbeat from core client for 30 sec - exiting 20:55:21 (30579): No heartbeat from core client for 30 sec - exiting 20:55:22 (30579): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 16:40:59 (2665): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:06:08 (2198): No heartbeat from core client for 30 sec - exiting 16:06:09 (2198): No heartbeat from core client for 30 sec - exiting 16:06:10 (2198): No heartbeat from core client for 30 sec - exiting 16:06:11 (2198): No heartbeat from core client for 30 sec - exiting 16:06:12 (2198): No heartbeat from core client for 30 sec - exiting 16:06:13 (2198): No heartbeat from core client for 30 sec - exiting 16:06:14 (2198): No heartbeat from core client for 30 sec - exiting 16:06:15 (2198): No heartbeat from core client for 30 sec - exiting 16:06:16 (2198): No heartbeat from core client for 30 sec - exiting 16:06:17 (2198): No heartbeat from core client for 30 sec - exiting 16:06:18 (2198): No heartbeat from core client for 30 sec - exiting 16:06:19 (2198): No heartbeat from core client for 30 sec - exiting 16:06:20 (2198): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(8050,0xac6062c0) malloc: * error for object 0x238e204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8050,0xac6062c0) malloc: * error for object 0x238e200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8050,0xac6062c0) malloc: * error for object 0x238e204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8050,0xac6062c0) malloc: * error for object 0x238e200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8050,0xac6062c0) malloc: * error for object 0x238e204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(8050,0xac6062c0) malloc: * error for object 0x2b71204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8050,0xac6062c0) malloc: * error for object 0x2b71200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.4 build 11E53 Tue Jul 10 16:22:36 2012 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fa98 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/5/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x906c2000 - 0x906c3fff /usr/lib/system/libsystem_sandbox.dylib 0x9083b000 - 0x9083dfff /usr/lib/system/libdyld.dylib 0x91047000 - 0x9104ffff /usr/lib/system/liblaunch.dylib 0x91466000 - 0x91467fff /usr/lib/system/libsystem_blocks.dylib 0x91468000 - 0x91468fff /usr/lib/system/libkeymgr.dylib 0x9166b000 - 0x91672fff /usr/lib/system/libsystem_notify.dylib 0x918d7000 - 0x918d8fff /usr/lib/system/libremovefile.dylib 0x91db7000 - 0x91dc5fff /usr/lib/system/libdispatch.dylib 0x921dd000 - 0x921e5fff /usr/lib/system/libcopyfile.dylib 0x9254d000 - 0x9256bfff /usr/lib/system/libsystem_kernel.dylib 0x92e2b000 - 0x92e2efff /usr/lib/system/libcompiler_rt.dylib 0x934f6000 - 0x934fafff /usr/lib/system/libcache.dylib 0x93641000 - 0x93645fff /usr/lib/system/libsystem_network.dylib 0x93646000 - 0x93649fff /usr/lib/system/libmathCommon.A.dylib 0x93ea3000 - 0x93ea3fff /usr/lib/system/libdnsinfo.dylib 0x94d3e000 - 0x94e09fff /usr/lib/system/libsystem_c.dylib 0x95386000 - 0x9538ffff /usr/lib/libc++abi.dylib 0x95390000 - 0x95398fff /usr/lib/system/libunwind.dylib 0x956ba000 - 0x9571cfff /usr/lib/libstdc++.6.dylib 0x95932000 - 0x95940fff /usr/lib/libz.1.dylib 0x95bb6000 - 0x95bbbfff /usr/lib/system/libmacho.dylib 0x97baa000 - 0x97bedfff /usr/lib/system/libcommonCrypto.dylib 0x987fb000 - 0x98811fff /usr/lib/system/libxpc.dylib 0x9aab7000 - 0x9aae6fff /usr/lib/system/libsystem_info.dylib 0x9ab67000 - 0x9ab6efff /usr/lib/system/libsystem_dnssd.dylib 0x9b68d000 - 0x9b68efff /usr/lib/system/libquarantine.dylib 0x9baf7000 - 0x9bb25fff /usr/lib/libSystem.B.dylib 0x9c0f1000 - 0x9c0f2fff /usr/lib/system/libunc.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Jul 2012 14:26:38	1217230	14648686	hadcm3n_209u_1980_40_007957342_1	259,200	332,391	1.2824
09 Jul 2012 15:26:05	1217230	14648686	hadcm3n_209u_1980_40_007957342_1	233,280	306,449	1.3137
04 Jul 2012 19:09:08	1217230	14648686	hadcm3n_209u_1980_40_007957342_1	207,360	280,795	1.3541
02 Jul 2012 17:42:35	1217230	14648686	hadcm3n_209u_1980_40_007957342_1	181,440	255,840	1.4101
17 Jun 2012 20:29:20	1217230	14648686	hadcm3n_209u_1980_40_007957342_1	155,520	219,168	1.4093
12 Jun 2012 17:55:48	1217230	14648686	hadcm3n_209u_1980_40_007957342_1	129,600	182,414	1.4075
10 Jun 2012 15:41:07	1217230	14648686	hadcm3n_209u_1980_40_007957342_1	103,680	145,533	1.4037
29 May 2012 19:06:52	1217230	14648686	hadcm3n_209u_1980_40_007957342_1	77,760	108,508	1.3954
24 May 2012 15:59:32	1217230	14648686	hadcm3n_209u_1980_40_007957342_1	51,840	72,275	1.3942
15 May 2012 08:58:04	1217230	14648686	hadcm3n_209u_1980_40_007957342_1	25,920	35,904	1.3852