Task 19547994

Name	hadcm3n_sc2b_198012_480_375_010413765_2
Workunit	10413765
Created	15 Apr 2016, 10:13:31 UTC
Sent	15 Apr 2016, 10:13:45 UTC
Report deadline	28 Mar 2017, 15:33:45 UTC
Received	6 Jun 2016, 7:28:48 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1377076
Run time	11 days 15 hours 26 min 42 sec
CPU time	10 days 6 hours 42 min 8 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	3.72 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... hadcm3n_6.07_i686-apple-darwin(699,0xa422e000) malloc: * error for object 0x1021e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(699,0xa422e000) malloc: * error for object 0x1021e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(699,0xa422e000) malloc: * error for object 0x802204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(699,0xa422e000) malloc: * error for object 0x802200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(699,0xa422e000) malloc: * error for object 0x802204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation 14:38:10 (699): No heartbeat from core client for 30 sec - exiting 14:38:11 (699): No heartbeat from core client for 30 sec - exiting 14:38:12 (699): No heartbeat from core client for 30 sec - exiting 14:38:13 (699): No heartbeat from core client for 30 sec - exiting 14:38:14 (699): No heartbeat from core client for 30 sec - exiting 14:38:15 (699): No heartbeat from core client for 30 sec - exiting 14:38:16 (699): No heartbeat from core client for 30 sec - exiting 14:38:17 (699): No heartbeat from core client for 30 sec - exiting 14:38:18 (699): No heartbeat from core client for 30 sec - exiting 14:38:19 (699): No heartbeat from core client for 30 sec - exiting 14:38:20 (699): No heartbeat from core client for 30 sec - exiting 14:38:21 (699): No heartbeat from core client for 30 sec - exiting 14:38:22 (699): No heartbeat from core client for 30 sec - exiting 14:38:23 (699): No heartbeat from core client for 30 sec - exiting 14:38:24 (699): No heartbeat from core client for 30 sec - exiting 14:38:25 (699): No heartbeat from core client for 30 sec - exiting 14:38:26 (699): No heartbeat from core client for 30 sec - exiting 14:38:27 (699): No heartbeat from core client for 30 sec - exiting 14:38:28 (699): No heartbeat from core client for 30 sec - exiting 14:38:29 (699): No heartbeat from core client for 30 sec - exiting 14:38:30 (699): No heartbeat from core client for 30 sec - exiting 14:38:31 (699): No heartbeat from core client for 30 sec - exiting 14:38:32 (699): No heartbeat from core client for 30 sec - exiting 14:38:33 (699): No heartbeat from core client for 30 sec - exiting 14:38:34 (699): No heartbeat from core client for 30 sec - exiting 14:38:35 (699): No heartbeat from core client for 30 sec - exiting 14:38:36 (699): No heartbeat from core client for 30 sec - exiting 14:38:37 (699): No heartbeat from core client for 30 sec - exiting 14:38:38 (699): No heartbeat from core client for 30 sec - exiting 14:38:39 (699): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(564,0xa3242000) malloc: * error for object 0x1819e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(564,0xa3242000) malloc: * error for object 0x1819e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(564,0xa3242000) malloc: * error for object 0x1819e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(564,0xa3242000) malloc: * error for object 0x1819e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(564,0xa3242000) malloc: * error for object 0x1819e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.5 build 15F34 Mon Jun 6 07:27:54 2016 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fd98 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/5/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x91344000 - 0x9135dfff /usr/lib/system/libsystem_malloc.dylib 0x913f6000 - 0x913fffff /usr/lib/system/libcopyfile.dylib 0x92220000 - 0x92222fff /usr/lib/system/libsystem_configuration.dylib 0x9269a000 - 0x9269ffff /usr/lib/system/libcompiler_rt.dylib 0x926a0000 - 0x926b7fff /usr/lib/system/libsystem_coretls.dylib 0x92d35000 - 0x92d9cfff /usr/lib/system/libcorecrypto.dylib 0x930cd000 - 0x930eefff /usr/lib/system/libsystem_kernel.dylib 0x93153000 - 0x93156fff /usr/lib/system/libdyld.dylib 0x931ca000 - 0x931cbfff /usr/lib/libSystem.B.dylib 0x93262000 - 0x9326cfff /usr/lib/system/libsystem_notify.dylib 0x94666000 - 0x9466cfff /usr/lib/system/libsystem_platform.dylib 0x94c47000 - 0x94c4ffff /usr/lib/system/libsystem_pthread.dylib 0x954f1000 - 0x954fffff /usr/lib/libz.1.dylib 0x96372000 - 0x9639cfff /usr/lib/system/libdispatch.dylib 0x96550000 - 0x965befff /usr/lib/system/libsystem_network.dylib 0x965bf000 - 0x965c4fff /usr/lib/system/libmacho.dylib 0x965c5000 - 0x965edfff /usr/lib/system/libxpc.dylib 0x967b8000 - 0x967b8fff /usr/lib/system/libkeymgr.dylib 0x97fa0000 - 0x97fa2fff /usr/lib/system/libsystem_coreservices.dylib 0x980bc000 - 0x980bcfff /usr/lib/system/liblaunch.dylib 0x980c7000 - 0x980cffff /usr/lib/system/libsystem_dnssd.dylib 0x987ba000 - 0x987c3fff /usr/lib/system/libsystem_networkextension.dylib 0x99492000 - 0x9949dfff /usr/lib/system/libcommonCrypto.dylib 0x994e9000 - 0x9957efff /usr/lib/system/libsystem_c.dylib 0x9aa99000 - 0x9aa9dfff /usr/lib/system/libcache.dylib 0x9bd98000 - 0x9bd9bfff /usr/lib/system/libsystem_sandbox.dylib 0x9bf6c000 - 0x9bf6efff /usr/lib/system/libquarantine.dylib 0x9c3a3000 - 0x9c3a5fff /usr/lib/system/libsystem_secinit.dylib 0x9c6b9000 - 0x9c6b9fff /usr/lib/system/libsystem_blocks.dylib 0x9cbe2000 - 0x9cc0cfff /usr/lib/system/libsystem_info.dylib 0x9cd2d000 - 0x9cd80fff /usr/lib/libstdc++.6.dylib 0x9d686000 - 0x9d686fff /usr/lib/system/libunc.dylib 0x9d6cb000 - 0x9d6e4fff /usr/lib/system/libsystem_asl.dylib 0x9d91b000 - 0x9d91cfff /usr/lib/system/libremovefile.dylib 0x9dbbd000 - 0x9dbc3fff /usr/lib/system/libunwind.dylib 0x9dc66000 - 0x9dc99fff /usr/lib/system/libsystem_m.dylib 0x9dca8000 - 0x9dccbfff /usr/lib/libc++abi.dylib 0x9e9e1000 - 0x9e9f2fff /usr/lib/system/libsystem_trace.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 May 2016 02:48:56	1377076	19547994	hadcm3n_sc2b_198012_480_375_010413765_2	1,036,800	887,779	0.8563
17 May 2016 20:30:29	1377076	19547994	hadcm3n_sc2b_198012_480_375_010413765_2	1,010,880	865,860	0.8565
01 May 2016 04:19:11	1377076	19547994	hadcm3n_sc2b_198012_480_375_010413765_2	984,960	843,792	0.8567
30 Apr 2016 19:38:08	1377076	19547994	hadcm3n_sc2b_198012_480_375_010413765_2	959,040	821,804	0.8569
30 Apr 2016 10:18:25	1377076	19547994	hadcm3n_sc2b_198012_480_375_010413765_2	933,120	799,784	0.8571
30 Apr 2016 02:55:01	1377076	19547994	hadcm3n_sc2b_198012_480_375_010413765_2	907,200	777,759	0.8573
29 Apr 2016 20:16:38	1377076	19547994	hadcm3n_sc2b_198012_480_375_010413765_2	881,280	755,707	0.8575
29 Apr 2016 13:44:04	1377076	19547994	hadcm3n_sc2b_198012_480_375_010413765_2	855,360	733,740	0.8578
29 Apr 2016 07:20:50	1377076	19547994	hadcm3n_sc2b_198012_480_375_010413765_2	829,440	711,712	0.8581
29 Apr 2016 01:57:44	1377076	19547994	hadcm3n_sc2b_198012_480_375_010413765_2	803,520	689,663	0.8583
28 Apr 2016 18:40:59	1377076	19547994	hadcm3n_sc2b_198012_480_375_010413765_2	777,600	667,583	0.8585
24 Apr 2016 12:45:33	1377076	19547994	hadcm3n_sc2b_198012_480_375_010413765_2	751,680	645,480	0.8587
24 Apr 2016 05:15:32	1377076	19547994	hadcm3n_sc2b_198012_480_375_010413765_2	725,760	623,423	0.8590
23 Apr 2016 21:49:37	1377076	19547994	hadcm3n_sc2b_198012_480_375_010413765_2	699,840	601,186	0.8590
23 Apr 2016 15:23:08	1377076	19547994	hadcm3n_sc2b_198012_480_375_010413765_2	673,920	578,893	0.8590
23 Apr 2016 06:48:24	1377076	19547994	hadcm3n_sc2b_198012_480_375_010413765_2	648,000	556,828	0.8593
22 Apr 2016 23:13:02	1377076	19547994	hadcm3n_sc2b_198012_480_375_010413765_2	622,080	534,683	0.8595
22 Apr 2016 13:46:44	1377076	19547994	hadcm3n_sc2b_198012_480_375_010413765_2	596,160	512,498	0.8597
22 Apr 2016 05:47:17	1377076	19547994	hadcm3n_sc2b_198012_480_375_010413765_2	570,240	490,283	0.8598
21 Apr 2016 22:32:52	1377076	19547994	hadcm3n_sc2b_198012_480_375_010413765_2	544,320	468,099	0.8600