Task 19420647

Name	hadcm3n_xd8p_198012_480_374_010413215_1
Workunit	10413215
Created	21 Mar 2016, 16:50:36 UTC
Sent	22 Mar 2016, 9:27:37 UTC
Report deadline	4 Mar 2017, 14:47:37 UTC
Received	3 Apr 2016, 6:54:03 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1346900
Run time	10 days 12 hours 26 min 50 sec
CPU time	9 days 22 hours 44 min 31 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.68 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(22415,0xa0d581d4) malloc: * error for object 0x683fc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(22415,0xa0d581d4) malloc: * error for object 0x683fc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(22415,0xa0d581d4) malloc: * error for object 0x501f604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(22415,0xa0d581d4) malloc: * error for object 0x501f600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(22415,0xa0d581d4) malloc: * error for object 0x851e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(22415,0xa0d581d4) malloc: * error for object 0xa033204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(22415,0xa0d581d4) malloc: * error for object 0x184bc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(22415,0xa0d581d4) malloc: * error for object 0x184bc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(22415,0xa0d581d4) malloc: * error for object 0x5838204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(22415,0xa0d581d4) malloc: * error for object 0x1801204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(22415,0xa0d581d4) malloc: * error for object 0x1802004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(22415,0xa0d581d4) malloc: * error for object 0x1802000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(22415,0xa0d581d4) malloc: * error for object 0x1802004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(22415,0xa0d581d4) malloc: * error for object 0x1802000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(22415,0xa0d581d4) malloc: * error for object 0x1802004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(35386,0xa0d581d4) malloc: * error for object 0x401b604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(35386,0xa0d581d4) malloc: * error for object 0x302b604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(35386,0xa0d581d4) malloc: * error for object 0x282b204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(35386,0xa0d581d4) malloc: * error for object 0x829e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(35386,0xa0d581d4) malloc: * error for object 0x829e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(35386,0xa0d581d4) malloc: * error for object 0x829e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(35386,0xa0d581d4) malloc: * error for object 0x829e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(35386,0xa0d581d4) malloc: * error for object 0x829e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(35386,0xa0d581d4) malloc: * error for object 0x829e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(35386,0xa0d581d4) malloc: * error for object 0x829e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(29907,0xa0d641d4) malloc: * error for object 0x4000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29907,0xa0d641d4) malloc: * error for object 0x4000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29907,0xa0d641d4) malloc: * error for object 0x811e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29907,0xa0d641d4) malloc: * error for object 0x811e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29907,0xa0d641d4) malloc: * error for object 0x811e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.5 build 14F1713 Sun Apr 3 00:53:24 2016 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8f9f8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/7/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90012000 - 0x9001efff /usr/lib/system/libcommonCrypto.dylib 0x902bd000 - 0x902bffff /usr/lib/system/libsystem_coreservices.dylib 0x9064c000 - 0x9065dfff /usr/lib/system/libsystem_coretls.dylib 0x9080e000 - 0x90841fff /usr/lib/system/libsystem_m.dylib 0x90d28000 - 0x90d29fff /usr/lib/system/libsystem_blocks.dylib 0x90f1a000 - 0x90f1ffff /usr/lib/system/libmacho.dylib 0x90fe9000 - 0x9100ffff /usr/lib/system/libxpc.dylib 0x91010000 - 0x91037fff /usr/lib/system/libdispatch.dylib 0x91326000 - 0x91326fff /usr/lib/system/libkeymgr.dylib 0x91327000 - 0x9133efff /usr/lib/system/libsystem_asl.dylib 0x91d39000 - 0x91d5ffff /usr/lib/libc++abi.dylib 0x92043000 - 0x92047fff /usr/lib/system/libcache.dylib 0x92203000 - 0x92298fff /usr/lib/system/libsystem_c.dylib 0x9231e000 - 0x9231efff /usr/lib/system/libunc.dylib 0x92f88000 - 0x92f8ffff /usr/lib/system/libunwind.dylib 0x936cb000 - 0x936d0fff /usr/lib/system/libcompiler_rt.dylib 0x940ab000 - 0x940b1fff /usr/lib/system/libsystem_platform.dylib 0x9451a000 - 0x9451cfff /usr/lib/system/libsystem_sandbox.dylib 0x9451d000 - 0x94546fff /usr/lib/system/libsystem_info.dylib 0x94887000 - 0x94890fff /usr/lib/system/libcopyfile.dylib 0x94891000 - 0x94892fff /usr/lib/system/libremovefile.dylib 0x94ae8000 - 0x94b01fff /usr/lib/system/libsystem_malloc.dylib 0x94baa000 - 0x94bc9fff /usr/lib/system/libsystem_kernel.dylib 0x957df000 - 0x957e7fff /usr/lib/system/libsystem_dnssd.dylib 0x96232000 - 0x96234fff /usr/lib/system/libsystem_secinit.dylib 0x96245000 - 0x96245fff /usr/lib/system/liblaunch.dylib 0x9786a000 - 0x97872fff /usr/lib/system/libsystem_pthread.dylib 0x97a61000 - 0x97a9efff /usr/lib/system/libsystem_network.dylib 0x98ae4000 - 0x98af2fff /usr/lib/libz.1.dylib 0x98af3000 - 0x98b5ffff /usr/lib/system/libcorecrypto.dylib 0x98ec2000 - 0x98ecbfff /usr/lib/system/libsystem_notify.dylib 0x98f61000 - 0x98f67fff /usr/lib/system/libsystem_trace.dylib 0x9a0ce000 - 0x9a121fff /usr/lib/libstdc++.6.dylib 0x9a7bd000 - 0x9a7bffff /usr/lib/system/libquarantine.dylib 0x9a827000 - 0x9a828fff /usr/lib/libSystem.B.dylib 0x9aadf000 - 0x9aae5fff /usr/lib/system/libsystem_networkextension.dylib 0x9bfde000 - 0x9bfe1fff /usr/lib/system/libdyld.dylib 0x9c43d000 - 0x9c43ffff /usr/lib/system/libsystem_configuration.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Apr 2016 05:55:56	1346900	19420647	hadcm3n_xd8p_198012_480_374_010413215_1	518,400	859,467	1.6579
02 Apr 2016 16:12:46	1346900	19420647	hadcm3n_xd8p_198012_480_374_010413215_1	492,480	817,085	1.6591
02 Apr 2016 03:43:51	1346900	19420647	hadcm3n_xd8p_198012_480_374_010413215_1	466,560	774,582	1.6602
01 Apr 2016 13:04:26	1346900	19420647	hadcm3n_xd8p_198012_480_374_010413215_1	440,640	732,297	1.6619
31 Mar 2016 23:41:38	1346900	19420647	hadcm3n_xd8p_198012_480_374_010413215_1	414,720	689,959	1.6637
31 Mar 2016 09:57:51	1346900	19420647	hadcm3n_xd8p_198012_480_374_010413215_1	388,800	646,407	1.6626
30 Mar 2016 20:01:32	1346900	19420647	hadcm3n_xd8p_198012_480_374_010413215_1	362,880	603,068	1.6619
30 Mar 2016 05:08:38	1346900	19420647	hadcm3n_xd8p_198012_480_374_010413215_1	336,960	559,922	1.6617
29 Mar 2016 13:32:08	1346900	19420647	hadcm3n_xd8p_198012_480_374_010413215_1	311,040	516,982	1.6621
28 Mar 2016 21:08:20	1346900	19420647	hadcm3n_xd8p_198012_480_374_010413215_1	285,120	474,058	1.6627
28 Mar 2016 03:06:42	1346900	19420647	hadcm3n_xd8p_198012_480_374_010413215_1	259,200	429,960	1.6588
27 Mar 2016 13:18:38	1346900	19420647	hadcm3n_xd8p_198012_480_374_010413215_1	233,280	388,942	1.6673
26 Mar 2016 23:37:00	1346900	19420647	hadcm3n_xd8p_198012_480_374_010413215_1	207,360	346,527	1.6711
26 Mar 2016 08:43:35	1346900	19420647	hadcm3n_xd8p_198012_480_374_010413215_1	181,440	303,599	1.6733
25 Mar 2016 16:55:18	1346900	19420647	hadcm3n_xd8p_198012_480_374_010413215_1	155,520	260,403	1.6744
25 Mar 2016 01:49:43	1346900	19420647	hadcm3n_xd8p_198012_480_374_010413215_1	129,600	217,911	1.6814
24 Mar 2016 12:36:49	1346900	19420647	hadcm3n_xd8p_198012_480_374_010413215_1	103,680	173,726	1.6756
23 Mar 2016 23:48:24	1346900	19420647	hadcm3n_xd8p_198012_480_374_010413215_1	77,760	130,151	1.6738
23 Mar 2016 11:15:52	1346900	19420647	hadcm3n_xd8p_198012_480_374_010413215_1	51,840	86,884	1.6760
22 Mar 2016 22:26:21	1346900	19420647	hadcm3n_xd8p_198012_480_374_010413215_1	25,920	43,275	1.6696