Task 17907648

Name	hadcm3n_xbt4_1940_40_009151598_3
Workunit	9281934
Created	7 Feb 2015, 6:55:28 UTC
Sent	7 Feb 2015, 7:06:23 UTC
Report deadline	9 May 2015, 14:33:34 UTC
Received	7 Mar 2015, 17:13:59 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1239340
Run time	4 days 4 hours 16 min 26 sec
CPU time	3 days 15 hours 45 min 14 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	4.09 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.4.36</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(52156,0xa04681d4) malloc: * error for object 0x4829e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(52156,0xa04681d4) malloc: * error for object 0x4829e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(52156,0xa04681d4) malloc: * error for object 0x1011c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(52156,0xa04681d4) malloc: * error for object 0x1011c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(52156,0xa04681d4) malloc: * error for object 0x1011c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(52156,0xa04681d4) malloc: * error for object 0x1011c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(52156,0xa04681d4) malloc: * error for object 0x1011c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(52156,0xa04681d4) malloc: * error for object 0x1011c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(52156,0xa04681d4) malloc: * error for object 0x1011c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(52156,0xa04681d4) malloc: * error for object 0x1011c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(52156,0xa04681d4) malloc: * error for object 0x4800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.3 build 14D87p Fri Mar 6 21:27:21 2015 hadcm3n_6.07_i686-apple-darwin(70972,0xa04681d4) malloc: * error for object 0x302de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(74376,0xa04681d4) malloc: * error for object 0x82b204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.3 build 14D87p Fri Mar 6 22:32:55 2015 hadcm3n_6.07_i686-apple-darwin(58454,0xa04681d4) malloc: * error for object 0x80a804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(97284,0xa04681d4) malloc: * error for object 0x2801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.3 build 14D87p Sat Mar 7 11:38:55 2015 hadcm3n_6.07_i686-apple-darwin(13355,0xa04681d4) malloc: * error for object 0x302a204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(18569,0xa04681d4) malloc: * error for object 0x4001c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(40480,0xa04681d4) malloc: * error for object 0x2000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(40480,0xa04681d4) malloc: * error for object 0x2001c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.3 build 14D87p Sat Mar 7 16:13:53 2015 hadcm3n_6.07_i686-apple-darwin(40480,0xa04681d4) malloc: * error for object 0x3000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Thread 0 Crashed: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fcf8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/3/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x902b2000 - 0x902b4fff /usr/lib/system/libsystem_sandbox.dylib 0x90344000 - 0x9034cfff /usr/lib/system/libsystem_pthread.dylib 0x903b6000 - 0x903b7fff /usr/lib/libSystem.B.dylib 0x90d7e000 - 0x90d85fff /usr/lib/system/libunwind.dylib 0x9133a000 - 0x91360fff /usr/lib/libc++abi.dylib 0x92b7c000 - 0x92b9bfff /usr/lib/system/libsystem_kernel.dylib 0x938aa000 - 0x938aefff /usr/lib/system/libcache.dylib 0x938af000 - 0x938affff /usr/lib/system/libkeymgr.dylib 0x93a70000 - 0x93a79fff /usr/lib/system/libcopyfile.dylib 0x93ae0000 - 0x93aeefff /usr/lib/libz.1.dylib 0x93f57000 - 0x93f7efff /usr/lib/system/libdispatch.dylib 0x94a65000 - 0x94a6efff /usr/lib/system/libsystem_notify.dylib 0x94bbe000 - 0x94bf1fff /usr/lib/system/libsystem_m.dylib 0x94f97000 - 0x95000fff /usr/lib/system/libcorecrypto.dylib 0x95001000 - 0x95096fff /usr/lib/system/libsystem_c.dylib 0x9509c000 - 0x950a8fff /usr/lib/system/libcommonCrypto.dylib 0x95437000 - 0x95437fff /usr/lib/system/liblaunch.dylib 0x96595000 - 0x9659dfff /usr/lib/system/libsystem_dnssd.dylib 0x96925000 - 0x9694efff /usr/lib/system/libsystem_info.dylib 0x96983000 - 0x96984fff /usr/lib/system/libsystem_blocks.dylib 0x96a84000 - 0x96a8afff /usr/lib/system/libsystem_trace.dylib 0x97172000 - 0x97174fff /usr/lib/system/libsystem_coreservices.dylib 0x9835e000 - 0x98360fff /usr/lib/system/libquarantine.dylib 0x989a6000 - 0x989e3fff /usr/lib/system/libsystem_network.dylib 0x98d3f000 - 0x98d58fff /usr/lib/system/libsystem_malloc.dylib 0x995b6000 - 0x995bcfff /usr/lib/system/libsystem_platform.dylib 0x995f4000 - 0x99647fff /usr/lib/libstdc++.6.dylib 0x99cb0000 - 0x99cb5fff /usr/lib/system/libmacho.dylib 0x99cc9000 - 0x99ccbfff /usr/lib/system/libsystem_configuration.dylib 0x9a2fc000 - 0x9a313fff /usr/lib/system/libsystem_asl.dylib 0x9a321000 - 0x9a324fff /usr/lib/system/libdyld.dylib 0x9a325000 - 0x9a32bfff /usr/lib/system/libsystem_networkextension.dylib 0x9a400000 - 0x9a426fff /usr/lib/system/libxpc.dylib 0x9a427000 - 0x9a429fff /usr/lib/system/libsystem_secinit.dylib 0x9a62b000 - 0x9a62cfff /usr/lib/system/libremovefile.dylib 0x9aa74000 - 0x9aa79fff /usr/lib/system/libcompiler_rt.dylib 0x9ab2b000 - 0x9ab3cfff /usr/lib/system/libsystem_coretls.dylib 0x9aefd000 - 0x9aefdfff /usr/lib/system/libunc.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Mar 2015 16:23:48	1239340	17907648	hadcm3n_xbt4_1940_40_009151598_3	259,200	314,119	1.2119
10 Mar 2015 16:08:19	1239340	17907648	hadcm3n_xbt4_1940_40_009151598_3	233,280	279,865	1.1997
10 Mar 2015 16:02:31	1239340	17907648	hadcm3n_xbt4_1940_40_009151598_3	207,360	246,351	1.1880
12 Feb 2015 17:29:30	1239340	17907648	hadcm3n_xbt4_1940_40_009151598_3	181,440	213,317	1.1757
12 Feb 2015 07:06:15	1239340	17907648	hadcm3n_xbt4_1940_40_009151598_3	155,520	180,210	1.1588
09 Feb 2015 06:32:32	1239340	17907648	hadcm3n_xbt4_1940_40_009151598_3	129,600	147,547	1.1385
08 Feb 2015 20:46:48	1239340	17907648	hadcm3n_xbt4_1940_40_009151598_3	103,680	117,433	1.1326
08 Feb 2015 10:59:31	1239340	17907648	hadcm3n_xbt4_1940_40_009151598_3	77,760	87,302	1.1227
08 Feb 2015 01:15:50	1239340	17907648	hadcm3n_xbt4_1940_40_009151598_3	51,840	57,123	1.1019
07 Feb 2015 15:48:28	1239340	17907648	hadcm3n_xbt4_1940_40_009151598_3	25,920	26,849	1.0358