Task 15858035

Name	hadcm3n_zey3_1960_40_008363507_4
Workunit	8514366
Created	22 Jun 2013, 16:27:35 UTC
Sent	22 Jun 2013, 17:20:23 UTC
Report deadline	22 Sep 2013, 0:47:34 UTC
Received	4 Jul 2013, 12:57:19 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1197259
Run time	10 days 7 hours 1 min 22 sec
CPU time	5 days 11 hours 56 min 53 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.19 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> 01:54:43 (64205): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:58:40 (78490): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:58:41 (78490): No heartbeat from core client for 30 sec - exiting 00:58:42 (78490): No heartbeat from core client for 30 sec - exiting 00:58:43 (78490): No heartbeat from core client for 30 sec - exiting 00:58:44 (78490): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:09:06 (97910): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:35:01 (74212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:28:07 (3439): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:37:10 (51790): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:38:27 (61511): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... hadcm3n_6.07_i686-apple-darwin(62872,0xad2402c0) malloc: * error for object 0x48a5e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(62872,0xad2402c0) malloc: * error for object 0x48a5e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(62872,0xad2402c0) malloc: * error for object 0x609de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Thu Jul 4 07:55:27 2013 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fa58 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/6/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x900c3000 - 0x900f1fff /usr/lib/libSystem.B.dylib 0x904c4000 - 0x904d2fff /usr/lib/libz.1.dylib 0x9062b000 - 0x9062ffff /usr/lib/system/libcache.dylib 0x91e6f000 - 0x91e6ffff /usr/lib/system/libdnsinfo.dylib 0x9321b000 - 0x93223fff /usr/lib/system/libcopyfile.dylib 0x93228000 - 0x9322afff /usr/lib/system/libdyld.dylib 0x9330e000 - 0x93316fff /usr/lib/system/libunwind.dylib 0x93323000 - 0x93324fff /usr/lib/system/libsystem_sandbox.dylib 0x95606000 - 0x9561cfff /usr/lib/system/libxpc.dylib 0x9595a000 - 0x95963fff /usr/lib/libc++abi.dylib 0x96303000 - 0x9630bfff /usr/lib/system/liblaunch.dylib 0x96431000 - 0x96431fff /usr/lib/system/libkeymgr.dylib 0x975d6000 - 0x975d7fff /usr/lib/system/libremovefile.dylib 0x979bf000 - 0x979c6fff /usr/lib/system/libsystem_dnssd.dylib 0x97acd000 - 0x97afcfff /usr/lib/system/libsystem_info.dylib 0x97d49000 - 0x97d4cfff /usr/lib/system/libcompiler_rt.dylib 0x982b6000 - 0x982b7fff /usr/lib/system/libquarantine.dylib 0x98376000 - 0x9837afff /usr/lib/system/libsystem_network.dylib 0x9838c000 - 0x983eefff /usr/lib/libstdc++.6.dylib 0x98ba4000 - 0x98ba9fff /usr/lib/system/libmacho.dylib 0x992cf000 - 0x992d0fff /usr/lib/system/libsystem_blocks.dylib 0x9964f000 - 0x99650fff /usr/lib/system/libunc.dylib 0x99651000 - 0x99694fff /usr/lib/system/libcommonCrypto.dylib 0x99940000 - 0x9995efff /usr/lib/system/libsystem_kernel.dylib 0x9b3bb000 - 0x9b3befff /usr/lib/system/libmathCommon.A.dylib 0x9cca7000 - 0x9cd72fff /usr/lib/system/libsystem_c.dylib 0x9cd7a000 - 0x9cd81fff /usr/lib/system/libsystem_notify.dylib 0x9cdad000 - 0x9cdbbfff /usr/lib/system/libdispatch.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Jul 2013 14:28:22	1197259	15858035	hadcm3n_zey3_1960_40_008363507_4	259,200	475,005	1.8326
03 Jul 2013 11:56:46	1197259	15858035	hadcm3n_zey3_1960_40_008363507_4	233,280	426,149	1.8268
02 Jul 2013 12:07:13	1197259	15858035	hadcm3n_zey3_1960_40_008363507_4	207,360	378,841	1.8270
02 Jul 2013 10:32:32	1197259	15858035	hadcm3n_zey3_1960_40_008363507_4	181,440	331,483	1.8270
02 Jul 2013 09:58:24	1197259	15858035	hadcm3n_zey3_1960_40_008363507_4	155,520	286,861	1.8445
28 Jun 2013 00:09:00	1197259	15858035	hadcm3n_zey3_1960_40_008363507_4	129,600	239,296	1.8464
26 Jun 2013 23:59:52	1197259	15858035	hadcm3n_zey3_1960_40_008363507_4	103,680	191,332	1.8454
25 Jun 2013 22:57:42	1197259	15858035	hadcm3n_zey3_1960_40_008363507_4	77,760	143,584	1.8465
24 Jun 2013 22:30:43	1197259	15858035	hadcm3n_zey3_1960_40_008363507_4	51,840	95,785	1.8477
23 Jun 2013 21:28:33	1197259	15858035	hadcm3n_zey3_1960_40_008363507_4	25,920	47,394	1.8285