Task 15918149

Name	hadcm3n_n62z_1960_40_008401182_3
Workunit	8552038
Created	14 Aug 2013, 15:59:30 UTC
Sent	14 Aug 2013, 16:06:18 UTC
Report deadline	13 Nov 2013, 23:33:29 UTC
Received	30 Aug 2013, 1:21:42 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1197259
Run time	8 days 3 hours 15 min 19 sec
CPU time	5 days 0 hours 59 min 57 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.19 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> 01:28:29 (75603): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGSEGV: segmentation violation CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:29:23 (54999): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:30:40 (14118): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(33307,0xac96e2c0) malloc: * error for object 0x8304204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33307,0xac96e2c0) malloc: * error for object 0x4316804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33307,0xac96e2c0) malloc: * error for object 0x3319204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33307,0xac96e2c0) malloc: * error for object 0x2b19204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33307,0xac96e2c0) malloc: * error for object 0x7316e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33307,0xac96e2c0) malloc: * error for object 0x7316e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33307,0xac96e2c0) malloc: * error for object 0x5ae5a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33307,0xac96e2c0) malloc: * error for object 0x5ae5a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33307,0xac96e2c0) malloc: * error for object 0x32e5a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33307,0xac96e2c0) malloc: * error for object 0x32e5a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33307,0xac96e2c0) malloc: * error for object 0x32e5a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Thu Aug 29 19:20:21 2013 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fa58 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/4/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90df4000 - 0x90dfcfff /usr/lib/system/libunwind.dylib 0x90ea0000 - 0x90ea8fff /usr/lib/system/liblaunch.dylib 0x90ea9000 - 0x90eb0fff /usr/lib/system/libsystem_dnssd.dylib 0x91136000 - 0x91144fff /usr/lib/libz.1.dylib 0x9115e000 - 0x91167fff /usr/lib/libc++abi.dylib 0x91f04000 - 0x91f66fff /usr/lib/libstdc++.6.dylib 0x95cc3000 - 0x95cc5fff /usr/lib/system/libdyld.dylib 0x95cc6000 - 0x95cc7fff /usr/lib/system/libsystem_blocks.dylib 0x966f0000 - 0x966f0fff /usr/lib/system/libkeymgr.dylib 0x97585000 - 0x97586fff /usr/lib/system/libquarantine.dylib 0x97d13000 - 0x97d14fff /usr/lib/system/libremovefile.dylib 0x97e80000 - 0x97e96fff /usr/lib/system/libxpc.dylib 0x97ec3000 - 0x97ec6fff /usr/lib/system/libcompiler_rt.dylib 0x98367000 - 0x98385fff /usr/lib/system/libsystem_kernel.dylib 0x98582000 - 0x9864dfff /usr/lib/system/libsystem_c.dylib 0x98b1c000 - 0x98b1ffff /usr/lib/system/libmathCommon.A.dylib 0x99242000 - 0x99246fff /usr/lib/system/libsystem_network.dylib 0x992a6000 - 0x992aefff /usr/lib/system/libcopyfile.dylib 0x999ba000 - 0x999c1fff /usr/lib/system/libsystem_notify.dylib 0x9a1df000 - 0x9a1e3fff /usr/lib/system/libcache.dylib 0x9a33b000 - 0x9a349fff /usr/lib/system/libdispatch.dylib 0x9a728000 - 0x9a76bfff /usr/lib/system/libcommonCrypto.dylib 0x9a97f000 - 0x9a980fff /usr/lib/system/libunc.dylib 0x9a99d000 - 0x9a99dfff /usr/lib/system/libdnsinfo.dylib 0x9b71c000 - 0x9b721fff /usr/lib/system/libmacho.dylib 0x9c2d6000 - 0x9c2d7fff /usr/lib/system/libsystem_sandbox.dylib 0x9c33e000 - 0x9c36cfff /usr/lib/libSystem.B.dylib 0x9cee8000 - 0x9cf17fff /usr/lib/system/libsystem_info.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Aug 2013 00:22:35	1197259	15918149	hadcm3n_n62z_1960_40_008401182_3	259,200	435,593	1.6805
25 Aug 2013 03:37:05	1197259	15918149	hadcm3n_n62z_1960_40_008401182_3	233,280	395,064	1.6935
23 Aug 2013 20:49:27	1197259	15918149	hadcm3n_n62z_1960_40_008401182_3	207,360	354,254	1.7084
23 Aug 2013 10:00:55	1197259	15918149	hadcm3n_n62z_1960_40_008401182_3	181,440	312,912	1.7246
20 Aug 2013 21:37:34	1197259	15918149	hadcm3n_n62z_1960_40_008401182_3	155,520	268,553	1.7268
19 Aug 2013 22:59:16	1197259	15918149	hadcm3n_n62z_1960_40_008401182_3	129,600	223,729	1.7263
18 Aug 2013 23:37:41	1197259	15918149	hadcm3n_n62z_1960_40_008401182_3	103,680	178,993	1.7264
18 Aug 2013 00:37:49	1197259	15918149	hadcm3n_n62z_1960_40_008401182_3	77,760	134,100	1.7245
16 Aug 2013 12:30:23	1197259	15918149	hadcm3n_n62z_1960_40_008401182_3	51,840	89,877	1.7337
15 Aug 2013 13:32:22	1197259	15918149	hadcm3n_n62z_1960_40_008401182_3	25,920	42,831	1.6524