Task 18700996

Name	hadcm3n_xdhk_1940_40_010021263_1
Workunit	10019334
Created	14 Jul 2015, 17:02:47 UTC
Sent	14 Jul 2015, 21:57:04 UTC
Report deadline	14 Oct 2015, 5:24:15 UTC
Received	28 Jul 2015, 1:51:51 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1092109
Run time	3 days 5 hours 36 min 31 sec
CPU time	3 days 5 hours 36 min 31 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	4.23 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(75090,0xa075e1d4) malloc: * error for object 0x1011c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(75090,0xa075e1d4) malloc: * error for object 0x1011c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(75090,0xa075e1d4) malloc: * error for object 0x4005e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(75090,0xa075e1d4) malloc: * error for object 0x4005e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(75090,0xa075e1d4) malloc: * error for object 0x4001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.10.4 build 14E46 Mon Jul 27 00:11:23 2015 hadcm3n_6.07_i686-apple-darwin(8850,0xa075e1d4) malloc: * error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8850,0xa075e1d4) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8850,0xa075e1d4) malloc: * error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8850,0xa075e1d4) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8850,0xa075e1d4) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.10.4 build 14E46 hadcm3n_6.07_i686-apple-darwin(9788,0xa075e1d4) malloc: * error for object 0x829e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(9788,0xa075e1d4) malloc: * error for object 0x829e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(9788,0xa075e1d4) malloc: * error for object 0x1002004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(9788,0xa075e1d4) malloc: * error for object 0x1002000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(9788,0xa075e1d4) malloc: * error for object 0x1810e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(9788,0xa075e1d4) malloc: * error for object 0x1811c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(11911,0xa075e1d4) malloc: * error for object 0x1014e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11911,0xa075e1d4) malloc: * error for object 0x1015c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11911,0xa075e1d4) malloc: * error for object 0x1015c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11911,0xa075e1d4) malloc: * error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11911,0xa075e1d4) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11911,0xa075e1d4) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.10.4 build 14E46 Mon Jul 27 20:25:46 2015 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fdb8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/1/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90008000 - 0x9002efff /usr/lib/libc++abi.dylib 0x90258000 - 0x90295fff /usr/lib/system/libsystem_network.dylib 0x90363000 - 0x90371fff /usr/lib/libz.1.dylib 0x90e50000 - 0x90e61fff /usr/lib/system/libsystem_coretls.dylib 0x90e62000 - 0x90e65fff /usr/lib/system/libdyld.dylib 0x92856000 - 0x9285bfff /usr/lib/system/libcompiler_rt.dylib 0x9285c000 - 0x9285efff /usr/lib/system/libquarantine.dylib 0x931c5000 - 0x931cdfff /usr/lib/system/libsystem_dnssd.dylib 0x935c6000 - 0x935ecfff /usr/lib/system/libxpc.dylib 0x93610000 - 0x9367cfff /usr/lib/system/libcorecrypto.dylib 0x9367d000 - 0x93685fff /usr/lib/system/libsystem_pthread.dylib 0x93686000 - 0x93687fff /usr/lib/libSystem.B.dylib 0x939bc000 - 0x939c1fff /usr/lib/system/libmacho.dylib 0x941b6000 - 0x941bcfff /usr/lib/system/libsystem_networkextension.dylib 0x941e9000 - 0x941eafff /usr/lib/system/libsystem_blocks.dylib 0x9579e000 - 0x957a0fff /usr/lib/system/libsystem_secinit.dylib 0x95b87000 - 0x95b88fff /usr/lib/system/libremovefile.dylib 0x95b89000 - 0x95b89fff /usr/lib/system/libunc.dylib 0x95d3b000 - 0x95dd0fff /usr/lib/system/libsystem_c.dylib 0x9671a000 - 0x96723fff /usr/lib/system/libsystem_notify.dylib 0x96f38000 - 0x96f3afff /usr/lib/system/libsystem_coreservices.dylib 0x96f8a000 - 0x96f8efff /usr/lib/system/libcache.dylib 0x979ec000 - 0x979f5fff /usr/lib/system/libcopyfile.dylib 0x979f6000 - 0x97a02fff /usr/lib/system/libcommonCrypto.dylib 0x97dfb000 - 0x97e12fff /usr/lib/system/libsystem_asl.dylib 0x97f82000 - 0x97f84fff /usr/lib/system/libsystem_configuration.dylib 0x981af000 - 0x981d8fff /usr/lib/system/libsystem_info.dylib 0x99234000 - 0x99287fff /usr/lib/libstdc++.6.dylib 0x9a20c000 - 0x9a22bfff /usr/lib/system/libsystem_kernel.dylib 0x9a448000 - 0x9a44efff /usr/lib/system/libsystem_platform.dylib 0x9a48b000 - 0x9a4a4fff /usr/lib/system/libsystem_malloc.dylib 0x9a7fa000 - 0x9a7fcfff /usr/lib/system/libsystem_sandbox.dylib 0x9b4c2000 - 0x9b4c9fff /usr/lib/system/libunwind.dylib 0x9bfef000 - 0x9c022fff /usr/lib/system/libsystem_m.dylib 0x9c120000 - 0x9c126fff /usr/lib/system/libsystem_trace.dylib 0x9c20f000 - 0x9c20ffff /usr/lib/system/liblaunch.dylib 0x9c382000 - 0x9c382fff /usr/lib/system/libkeymgr.dylib 0x9c390000 - 0x9c3b7fff /usr/lib/system/libdispatch.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Jul 2015 05:05:01	1092109	18700996	hadcm3n_xdhk_1940_40_010021263_1	259,200	277,085	1.0690
26 Jul 2015 11:26:35	1092109	18700996	hadcm3n_xdhk_1940_40_010021263_1	233,280	250,781	1.0750
25 Jul 2015 19:53:14	1092109	18700996	hadcm3n_xdhk_1940_40_010021263_1	207,360	224,024	1.0804
25 Jul 2015 05:17:51	1092109	18700996	hadcm3n_xdhk_1940_40_010021263_1	181,440	197,400	1.0880
23 Jul 2015 14:47:37	1092109	18700996	hadcm3n_xdhk_1940_40_010021263_1	155,520	169,239	1.0882
23 Jul 2015 04:48:54	1092109	18700996	hadcm3n_xdhk_1940_40_010021263_1	129,600	143,680	1.1086
22 Jul 2015 12:59:30	1092109	18700996	hadcm3n_xdhk_1940_40_010021263_1	103,680	117,834	1.1365
22 Jul 2015 04:55:56	1092109	18700996	hadcm3n_xdhk_1940_40_010021263_1	77,760	92,634	1.1913
21 Jul 2015 20:47:07	1092109	18700996	hadcm3n_xdhk_1940_40_010021263_1	51,840	67,352	1.2992
15 Jul 2015 09:52:34	1092109	18700996	hadcm3n_xdhk_1940_40_010021263_1	25,920	27,698	1.0686