Task 14358400

Name	hadcm3n_o5ys_2020_40_007856675_0
Workunit	8011787
Created	4 Apr 2012, 18:24:53 UTC
Sent	4 Apr 2012, 18:27:49 UTC
Report deadline	5 Jul 2012, 1:55:00 UTC
Received	10 Apr 2012, 18:19:02 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1195305
Run time	5 days 10 hours 32 min
CPU time	4 days 22 hours 9 min 28 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.98 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.12.35</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:17:16 (234): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... hadcm3n_6.07_i686-apple-darwin(234,0xac0c82c0) malloc: * error for object 0x1a03804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(234,0xac0c82c0) malloc: * error for object 0x1a03800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(234,0xac0c82c0) malloc: * error for object 0x2a00204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(234,0xac0c82c0) malloc: * error for object 0x2a00200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(234,0xac0c82c0) malloc: * error for object 0x11e7804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(234,0xac0c82c0) malloc: * error for object 0x29e4c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(234,0xac0c82c0) malloc: * error for object 0x1202e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(234,0xac0c82c0) malloc: * error for object 0x1202e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.3 build 11D50 Tue Apr 10 19:12:15 2012 hadcm3n_6.07_i686-apple-darwin(234,0xac0c82c0) malloc: * error for object 0x9e1c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(234,0xac0c82c0) malloc: * error for object 0x9e1c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fa28 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/1/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x905fc000 - 0x9061afff /usr/lib/system/libsystem_kernel.dylib 0x9061b000 - 0x90623fff /usr/lib/system/liblaunch.dylib 0x909fd000 - 0x90a5ffff /usr/lib/libstdc++.6.dylib 0x90ab5000 - 0x90b80fff /usr/lib/system/libsystem_c.dylib 0x90bef000 - 0x90bf0fff /usr/lib/system/libsystem_sandbox.dylib 0x918fe000 - 0x9190cfff /usr/lib/libz.1.dylib 0x91fe9000 - 0x91fedfff /usr/lib/system/libcache.dylib 0x92800000 - 0x9282efff /usr/lib/libSystem.B.dylib 0x9326f000 - 0x93278fff /usr/lib/libc++abi.dylib 0x94287000 - 0x94288fff /usr/lib/system/libremovefile.dylib 0x942a9000 - 0x942bffff /usr/lib/system/libxpc.dylib 0x94c89000 - 0x94c91fff /usr/lib/system/libunwind.dylib 0x96057000 - 0x9605bfff /usr/lib/system/libsystem_network.dylib 0x9614d000 - 0x9614efff /usr/lib/system/libunc.dylib 0x97ecc000 - 0x97f0ffff /usr/lib/system/libcommonCrypto.dylib 0x98772000 - 0x98774fff /usr/lib/system/libdyld.dylib 0x9aaf5000 - 0x9aaf5fff /usr/lib/system/libdnsinfo.dylib 0x9aef1000 - 0x9aef9fff /usr/lib/system/libcopyfile.dylib 0x9be0f000 - 0x9be16fff /usr/lib/system/libsystem_notify.dylib 0x9be71000 - 0x9be74fff /usr/lib/system/libmathCommon.A.dylib 0x9bf68000 - 0x9bf69fff /usr/lib/system/libquarantine.dylib 0x9c548000 - 0x9c577fff /usr/lib/system/libsystem_info.dylib 0x9c578000 - 0x9c57ffff /usr/lib/system/libsystem_dnssd.dylib 0x9c580000 - 0x9c580fff /usr/lib/system/libkeymgr.dylib 0x9cb1b000 - 0x9cb20fff /usr/lib/system/libmacho.dylib 0x9cb21000 - 0x9cb2ffff /usr/lib/system/libdispatch.dylib 0x9cd63000 - 0x9cd64fff /usr/lib/system/libsystem_blocks.dylib 0x9cde2000 - 0x9cde5fff /usr/lib/system/libcompiler_rt.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Apr 2012 18:21:33	1195305	14358400	hadcm3n_o5ys_2020_40_007856675_0	259,200	425,365	1.6411
10 Apr 2012 03:40:43	1195305	14358400	hadcm3n_o5ys_2020_40_007856675_0	233,280	380,337	1.6304
09 Apr 2012 14:05:28	1195305	14358400	hadcm3n_o5ys_2020_40_007856675_0	207,360	337,038	1.6254
08 Apr 2012 22:58:42	1195305	14358400	hadcm3n_o5ys_2020_40_007856675_0	181,440	294,655	1.6240
08 Apr 2012 10:00:10	1195305	14358400	hadcm3n_o5ys_2020_40_007856675_0	155,520	252,596	1.6242
07 Apr 2012 17:29:56	1195305	14358400	hadcm3n_o5ys_2020_40_007856675_0	129,600	209,741	1.6184
07 Apr 2012 02:30:18	1195305	14358400	hadcm3n_o5ys_2020_40_007856675_0	103,680	167,444	1.6150
06 Apr 2012 11:23:54	1195305	14358400	hadcm3n_o5ys_2020_40_007856675_0	77,760	124,779	1.6047
05 Apr 2012 20:06:53	1195305	14358400	hadcm3n_o5ys_2020_40_007856675_0	51,840	81,915	1.5802
05 Apr 2012 05:57:52	1195305	14358400	hadcm3n_o5ys_2020_40_007856675_0	25,920	39,177	1.5115