Task 19133310

Name	hadcm3n_sda9_198012_480_010221903_0
Workunit	10221903
Created	4 Dec 2015, 19:24:41 UTC
Sent	5 Dec 2015, 4:35:44 UTC
Report deadline	16 Nov 2016, 9:55:44 UTC
Received	16 Dec 2015, 14:38:07 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1311974
Run time	10 days 5 hours 7 min 3 sec
CPU time	9 days 17 hours 4 min 51 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.68 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.12</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(27272,0xa0a9d1d4) malloc: * error for object 0x4039c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27272,0xa0a9d1d4) malloc: * error for object 0x4039c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27272,0xa0a9d1d4) malloc: * error for object 0x4039c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27272,0xa0a9d1d4) malloc: * error for object 0x4039c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27272,0xa0a9d1d4) malloc: * error for object 0x481f604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27272,0xa0a9d1d4) malloc: * error for object 0x281f604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27272,0xa0a9d1d4) malloc: * error for object 0x681f604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27272,0xa0a9d1d4) malloc: * error for object 0x681f600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27272,0xa0a9d1d4) malloc: * error for object 0x401e604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27272,0xa0a9d1d4) malloc: * error for object 0x181ac04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27272,0xa0a9d1d4) malloc: * error for object 0x181ac00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27272,0xa0a9d1d4) malloc: * error for object 0x181ac00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.5 build 14F1505 Thu Dec 10 15:35:31 2015 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(85443,0xa0a9d1d4) malloc: * error for object 0x2005c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(85443,0xa0a9d1d4) malloc: * error for object 0x2005c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(85443,0xa0a9d1d4) malloc: * error for object 0x2005c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(85443,0xa0a9d1d4) malloc: * error for object 0x2005c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(85443,0xa0a9d1d4) malloc: * error for object 0x2005c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.5 build 14F1505 Wed Dec 16 07:01:32 2015 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fa78 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/16/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x91013000 - 0x91019fff /usr/lib/system/libsystem_platform.dylib 0x913cf000 - 0x913e8fff /usr/lib/system/libsystem_malloc.dylib 0x91518000 - 0x9153ffff /usr/lib/system/libdispatch.dylib 0x918b4000 - 0x918bbfff /usr/lib/system/libunwind.dylib 0x9191f000 - 0x91924fff /usr/lib/system/libcompiler_rt.dylib 0x92459000 - 0x9245ffff /usr/lib/system/libsystem_trace.dylib 0x924ea000 - 0x924ebfff /usr/lib/libSystem.B.dylib 0x926c5000 - 0x926cbfff /usr/lib/system/libsystem_networkextension.dylib 0x926cc000 - 0x926d0fff /usr/lib/system/libcache.dylib 0x92703000 - 0x92706fff /usr/lib/system/libdyld.dylib 0x92736000 - 0x92747fff /usr/lib/system/libsystem_coretls.dylib 0x9483f000 - 0x94841fff /usr/lib/system/libsystem_coreservices.dylib 0x94a65000 - 0x94a66fff /usr/lib/system/libsystem_blocks.dylib 0x94a67000 - 0x94a69fff /usr/lib/system/libsystem_sandbox.dylib 0x9511f000 - 0x95127fff /usr/lib/system/libsystem_dnssd.dylib 0x95d55000 - 0x95d57fff /usr/lib/system/libsystem_secinit.dylib 0x95d58000 - 0x95d6ffff /usr/lib/system/libsystem_asl.dylib 0x95d70000 - 0x95d78fff /usr/lib/system/libsystem_pthread.dylib 0x95f39000 - 0x95f5ffff /usr/lib/system/libxpc.dylib 0x96110000 - 0x96119fff /usr/lib/system/libsystem_notify.dylib 0x9611d000 - 0x9611dfff /usr/lib/system/libunc.dylib 0x96132000 - 0x96185fff /usr/lib/libstdc++.6.dylib 0x961e7000 - 0x96210fff /usr/lib/system/libsystem_info.dylib 0x96576000 - 0x96578fff /usr/lib/system/libquarantine.dylib 0x96579000 - 0x9657efff /usr/lib/system/libmacho.dylib 0x96fa1000 - 0x96fa3fff /usr/lib/system/libsystem_configuration.dylib 0x96faf000 - 0x96faffff /usr/lib/system/libkeymgr.dylib 0x972aa000 - 0x972ddfff /usr/lib/system/libsystem_m.dylib 0x97913000 - 0x97914fff /usr/lib/system/libremovefile.dylib 0x9815c000 - 0x9816afff /usr/lib/libz.1.dylib 0x98614000 - 0x98633fff /usr/lib/system/libsystem_kernel.dylib 0x98846000 - 0x988dbfff /usr/lib/system/libsystem_c.dylib 0x9a01d000 - 0x9a05afff /usr/lib/system/libsystem_network.dylib 0x9b01d000 - 0x9b043fff /usr/lib/libc++abi.dylib 0x9b189000 - 0x9b189fff /usr/lib/system/liblaunch.dylib 0x9c06d000 - 0x9c0d9fff /usr/lib/system/libcorecrypto.dylib 0x9c457000 - 0x9c460fff /usr/lib/system/libcopyfile.dylib 0x9c488000 - 0x9c494fff /usr/lib/system/libcommonCrypto.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Dec 2015 14:41:12	1311974	19133310	hadcm3n_sda9_198012_480_010221903_0	518,400	839,084	1.6186
15 Dec 2015 23:52:30	1311974	19133310	hadcm3n_sda9_198012_480_010221903_0	492,480	797,554	1.6195
15 Dec 2015 10:33:52	1311974	19133310	hadcm3n_sda9_198012_480_010221903_0	466,560	755,900	1.6202
14 Dec 2015 18:03:43	1311974	19133310	hadcm3n_sda9_198012_480_010221903_0	440,640	713,428	1.6191
14 Dec 2015 04:34:17	1311974	19133310	hadcm3n_sda9_198012_480_010221903_0	414,720	671,814	1.6199
13 Dec 2015 15:18:24	1311974	19133310	hadcm3n_sda9_198012_480_010221903_0	388,800	630,250	1.6210
13 Dec 2015 01:55:22	1311974	19133310	hadcm3n_sda9_198012_480_010221903_0	362,880	588,675	1.6222
12 Dec 2015 12:19:43	1311974	19133310	hadcm3n_sda9_198012_480_010221903_0	336,960	546,686	1.6224
11 Dec 2015 23:14:59	1311974	19133310	hadcm3n_sda9_198012_480_010221903_0	311,040	504,716	1.6227
11 Dec 2015 10:11:02	1311974	19133310	hadcm3n_sda9_198012_480_010221903_0	285,120	462,865	1.6234
10 Dec 2015 21:36:03	1311974	19133310	hadcm3n_sda9_198012_480_010221903_0	259,200	421,137	1.6248
10 Dec 2015 12:36:28	1311974	19133310	hadcm3n_sda9_198012_480_010221903_0	233,280	379,346	1.6261
10 Dec 2015 12:36:28	1311974	19133310	hadcm3n_sda9_198012_480_010221903_0	207,360	337,067	1.6255
09 Dec 2015 05:23:13	1311974	19133310	hadcm3n_sda9_198012_480_010221903_0	181,440	294,375	1.6224
08 Dec 2015 16:02:25	1311974	19133310	hadcm3n_sda9_198012_480_010221903_0	155,520	252,524	1.6237
08 Dec 2015 01:29:55	1311974	19133310	hadcm3n_sda9_198012_480_010221903_0	129,600	210,398	1.6234
07 Dec 2015 11:30:39	1311974	19133310	hadcm3n_sda9_198012_480_010221903_0	103,680	168,285	1.6231
06 Dec 2015 20:49:30	1311974	19133310	hadcm3n_sda9_198012_480_010221903_0	77,760	126,404	1.6256
06 Dec 2015 07:48:21	1311974	19133310	hadcm3n_sda9_198012_480_010221903_0	51,840	84,506	1.6301
05 Dec 2015 17:59:32	1311974	19133310	hadcm3n_sda9_198012_480_010221903_0	25,920	43,086	1.6623