Task 17250003

Name	hadcm3n_safy_1940_40_009108428_0
Workunit	9238764
Created	22 Oct 2014, 14:02:09 UTC
Sent	27 Oct 2014, 15:44:57 UTC
Report deadline	26 Jan 2015, 23:12:08 UTC
Received	26 Dec 2014, 2:13:10 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1123890
Run time	38 days 10 hours 32 min 20 sec
CPU time	37 days 7 hours 38 min 29 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.11 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:32:22 (2478): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:29:55 (2791): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:41:55 (1204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:14:24 (422): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:27:09 (27964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... hadcm3n_6.07_i686-apple-darwin(20638,0xa0c4f1d4) malloc: * error for object 0xa801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20638,0xa0c4f1d4) malloc: * error for object 0xa801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20638,0xa0c4f1d4) malloc: * error for object 0xa801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20638,0xa0c4f1d4) malloc: * error for object 0xa801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20638,0xa0c4f1d4) malloc: * error for object 0xa801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.1 build 14B25 Thu Dec 25 21:10:18 2014 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8f988 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/18/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90008000 - 0x90008fff /usr/lib/system/liblaunch.dylib 0x906eb000 - 0x906ecfff /usr/lib/system/libsystem_blocks.dylib 0x906ed000 - 0x906f2fff /usr/lib/system/libmacho.dylib 0x90b39000 - 0x90b5ffff /usr/lib/system/libxpc.dylib 0x91c22000 - 0x91c28fff /usr/lib/system/libsystem_trace.dylib 0x91c29000 - 0x91c2ffff /usr/lib/system/libsystem_platform.dylib 0x92242000 - 0x92242fff /usr/lib/system/libunc.dylib 0x930e7000 - 0x930f0fff /usr/lib/system/libcopyfile.dylib 0x93a5e000 - 0x93a61fff /usr/lib/system/libdyld.dylib 0x93c80000 - 0x93ca9fff /usr/lib/system/libsystem_info.dylib 0x94657000 - 0x94663fff /usr/lib/system/libcommonCrypto.dylib 0x94677000 - 0x94680fff /usr/lib/system/libsystem_notify.dylib 0x94a29000 - 0x94a50fff /usr/lib/system/libdispatch.dylib 0x94a55000 - 0x94a57fff /usr/lib/system/libsystem_coreservices.dylib 0x954fa000 - 0x9558ffff /usr/lib/system/libsystem_c.dylib 0x95b0a000 - 0x95b0cfff /usr/lib/system/libquarantine.dylib 0x95fe7000 - 0x95febfff /usr/lib/system/libcache.dylib 0x96f36000 - 0x96f3efff /usr/lib/system/libsystem_dnssd.dylib 0x96fa3000 - 0x96fbafff /usr/lib/system/libsystem_asl.dylib 0x96fcf000 - 0x97038fff /usr/lib/system/libcorecrypto.dylib 0x97039000 - 0x9705ffff /usr/lib/libc++abi.dylib 0x972b8000 - 0x972bafff /usr/lib/system/libsystem_configuration.dylib 0x972bb000 - 0x972bcfff /usr/lib/system/libremovefile.dylib 0x9819c000 - 0x981a4fff /usr/lib/system/libsystem_pthread.dylib 0x981fb000 - 0x98201fff /usr/lib/system/libsystem_networkextension.dylib 0x98256000 - 0x9826ffff /usr/lib/system/libsystem_malloc.dylib 0x98479000 - 0x9847afff /usr/lib/libSystem.B.dylib 0x98e0a000 - 0x98e1bfff /usr/lib/system/libsystem_coretls.dylib 0x98e1c000 - 0x98e2afff /usr/lib/libz.1.dylib 0x98f5d000 - 0x98f5dfff /usr/lib/system/libkeymgr.dylib 0x99036000 - 0x99073fff /usr/lib/system/libsystem_network.dylib 0x9918d000 - 0x991c0fff /usr/lib/system/libsystem_m.dylib 0x9af24000 - 0x9af43fff /usr/lib/system/libsystem_kernel.dylib 0x9b2c7000 - 0x9b2c9fff /usr/lib/system/libsystem_secinit.dylib 0x9b64a000 - 0x9b64cfff /usr/lib/system/libsystem_sandbox.dylib 0x9ba75000 - 0x9ba7afff /usr/lib/system/libcompiler_rt.dylib 0x9c043000 - 0x9c096fff /usr/lib/libstdc++.6.dylib 0x9c349000 - 0x9c350fff /usr/lib/system/libunwind.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Dec 2014 02:15:56	1123890	17250003	hadcm3n_safy_1940_40_009108428_0	777,600	3,224,300	4.1465
16 Dec 2014 14:51:25	1123890	17250003	hadcm3n_safy_1940_40_009108428_0	751,680	3,098,987	4.1227
15 Dec 2014 02:48:11	1123890	17250003	hadcm3n_safy_1940_40_009108428_0	725,760	2,974,932	4.0991
13 Dec 2014 15:29:06	1123890	17250003	hadcm3n_safy_1940_40_009108428_0	699,840	2,851,065	4.0739
10 Dec 2014 03:43:43	1123890	17250003	hadcm3n_safy_1940_40_009108428_0	673,920	2,726,346	4.0455
01 Dec 2014 10:29:22	1123890	17250003	hadcm3n_safy_1940_40_009108428_0	648,000	2,604,883	4.0199
29 Nov 2014 22:02:17	1123890	17250003	hadcm3n_safy_1940_40_009108428_0	622,080	2,485,554	3.9956
28 Nov 2014 14:19:25	1123890	17250003	hadcm3n_safy_1940_40_009108428_0	596,160	2,374,578	3.9831
27 Nov 2014 04:16:12	1123890	17250003	hadcm3n_safy_1940_40_009108428_0	570,240	2,255,744	3.9558
25 Nov 2014 16:04:08	1123890	17250003	hadcm3n_safy_1940_40_009108428_0	544,320	2,135,932	3.9240
22 Nov 2014 22:58:09	1123890	17250003	hadcm3n_safy_1940_40_009108428_0	518,400	2,015,791	3.8885
21 Nov 2014 10:49:26	1123890	17250003	hadcm3n_safy_1940_40_009108428_0	492,480	1,895,093	3.8481
19 Nov 2014 23:23:51	1123890	17250003	hadcm3n_safy_1940_40_009108428_0	466,560	1,772,913	3.8000
18 Nov 2014 12:23:17	1123890	17250003	hadcm3n_safy_1940_40_009108428_0	440,640	1,650,727	3.7462
16 Nov 2014 21:16:05	1123890	17250003	hadcm3n_safy_1940_40_009108428_0	414,720	1,533,480	3.6976
15 Nov 2014 11:24:18	1123890	17250003	hadcm3n_safy_1940_40_009108428_0	388,800	1,419,023	3.6498
14 Nov 2014 02:18:14	1123890	17250003	hadcm3n_safy_1940_40_009108428_0	362,880	1,304,584	3.5951
12 Nov 2014 17:56:28	1123890	17250003	hadcm3n_safy_1940_40_009108428_0	336,960	1,190,034	3.5317
11 Nov 2014 09:34:27	1123890	17250003	hadcm3n_safy_1940_40_009108428_0	311,040	1,075,405	3.4574
08 Nov 2014 19:03:41	1123890	17250003	hadcm3n_safy_1940_40_009108428_0	285,120	959,308	3.3646