Task 15548951

Name	hadcm3n_n0e5_1880_40_008286037_1
Workunit	8437172
Created	17 Jan 2013, 18:28:18 UTC
Sent	17 Jan 2013, 18:28:29 UTC
Report deadline	19 Apr 2013, 1:55:40 UTC
Received	30 Jan 2013, 15:17:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1289096
Run time	4 days 0 hours 18 min 58 sec
CPU time	3 days 20 hours 5 min 20 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.35 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.31</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:49:17 (14573): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:59:59 (15402): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:04:22 (15489): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:14:43 (15567): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:20:04 (15667): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:26:42 (15747): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:04:06 (54344): No heartbeat from core client for 30 sec - exiting 08:04:08 (54344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:26:59 (8162): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:05:01 (10191): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:15:13 (10425): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:04:40 (10516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:14:59 (10761): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:53:44 (10835): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:15:07 (11037): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... hadcm3n_6.07_i686-apple-darwin(11137,0xacbef2c0) malloc: * error for object 0x104a004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11137,0xacbef2c0) malloc: * error for object 0x1065604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11137,0xacbef2c0) malloc: * error for object 0x1065600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11137,0xacbef2c0) malloc: * error for object 0x104a004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11137,0xacbef2c0) malloc: * error for object 0x4836004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.4 build 11E53 Wed Jan 30 01:24:42 2013 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fa98 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/6/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90207000 - 0x90209fff /usr/lib/system/libdyld.dylib 0x902e3000 - 0x90326fff /usr/lib/system/libcommonCrypto.dylib 0x90fad000 - 0x90faefff /usr/lib/system/libunc.dylib 0x910e7000 - 0x910e8fff /usr/lib/system/libremovefile.dylib 0x913d3000 - 0x913d7fff /usr/lib/system/libsystem_network.dylib 0x9165e000 - 0x9167cfff /usr/lib/system/libsystem_kernel.dylib 0x9375e000 - 0x9375efff /usr/lib/system/libdnsinfo.dylib 0x93bcc000 - 0x93bcdfff /usr/lib/system/libsystem_blocks.dylib 0x93bcf000 - 0x93bfefff /usr/lib/system/libsystem_info.dylib 0x954e9000 - 0x9554bfff /usr/lib/libstdc++.6.dylib 0x96760000 - 0x96765fff /usr/lib/system/libmacho.dylib 0x97181000 - 0x9724cfff /usr/lib/system/libsystem_c.dylib 0x97e86000 - 0x97e87fff /usr/lib/system/libquarantine.dylib 0x989b8000 - 0x989bffff /usr/lib/system/libsystem_notify.dylib 0x98e7e000 - 0x98e7efff /usr/lib/system/libkeymgr.dylib 0x98fac000 - 0x98fb4fff /usr/lib/system/libunwind.dylib 0x99325000 - 0x9932efff /usr/lib/libc++abi.dylib 0x9a01b000 - 0x9a023fff /usr/lib/system/liblaunch.dylib 0x9a85e000 - 0x9a86cfff /usr/lib/libz.1.dylib 0x9a87a000 - 0x9a882fff /usr/lib/system/libcopyfile.dylib 0x9a883000 - 0x9a88afff /usr/lib/system/libsystem_dnssd.dylib 0x9b6d8000 - 0x9b6dbfff /usr/lib/system/libmathCommon.A.dylib 0x9b7aa000 - 0x9b7aefff /usr/lib/system/libcache.dylib 0x9c0e6000 - 0x9c0f4fff /usr/lib/system/libdispatch.dylib 0x9c101000 - 0x9c117fff /usr/lib/system/libxpc.dylib 0x9c9f1000 - 0x9ca1ffff /usr/lib/libSystem.B.dylib 0x9ca20000 - 0x9ca23fff /usr/lib/system/libcompiler_rt.dylib 0x9ca5e000 - 0x9ca5ffff /usr/lib/system/libsystem_sandbox.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Jan 2013 15:20:30	1216073	15548951	hadcm3n_n0e5_1880_40_008286037_1	259,200	331,485	1.2789
29 Jan 2013 22:16:47	1216073	15548951	hadcm3n_n0e5_1880_40_008286037_1	233,280	305,530	1.3097
29 Jan 2013 08:09:25	1216073	15548951	hadcm3n_n0e5_1880_40_008286037_1	207,360	279,253	1.3467
28 Jan 2013 13:50:19	1216073	15548951	hadcm3n_n0e5_1880_40_008286037_1	181,440	248,193	1.3679
28 Jan 2013 04:28:50	1216073	15548951	hadcm3n_n0e5_1880_40_008286037_1	155,520	215,633	1.3865
25 Jan 2013 23:43:22	1216073	15548951	hadcm3n_n0e5_1880_40_008286037_1	129,600	180,414	1.3921
24 Jan 2013 23:08:20	1216073	15548951	hadcm3n_n0e5_1880_40_008286037_1	103,680	144,775	1.3964
24 Jan 2013 11:16:31	1216073	15548951	hadcm3n_n0e5_1880_40_008286037_1	77,760	108,697	1.3979
23 Jan 2013 14:55:30	1216073	15548951	hadcm3n_n0e5_1880_40_008286037_1	51,840	71,617	1.3815
23 Jan 2013 05:42:42	1216073	15548951	hadcm3n_n0e5_1880_40_008286037_1	25,920	38,885	1.5002