Task 15764662

Name	hadcm3n_zn49_1960_40_008282452_2
Workunit	8433587
Created	7 May 2013, 3:59:18 UTC
Sent	7 May 2013, 3:59:28 UTC
Report deadline	6 Aug 2013, 11:26:39 UTC
Received	17 May 2013, 7:43:43 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1155438
Run time	6 days 2 hours 8 min 57 sec
CPU time	5 days 18 hours 21 min 25 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.92 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.31</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(36817,0xacfb92c0) malloc: * error for object 0x3822404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36817,0xacfb92c0) malloc: * error for object 0x3822400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36817,0xacfb92c0) malloc: * error for object 0x9032604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36817,0xacfb92c0) malloc: * error for object 0x824e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36817,0xacfb92c0) malloc: * error for object 0x824e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36817,0xacfb92c0) malloc: * error for object 0x1005204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(55002,0xacfb92c0) malloc: * error for object 0x6a5f604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(55002,0xacfb92c0) malloc: * error for object 0x2260604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(55002,0xacfb92c0) malloc: * error for object 0x6a5f604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(55002,0xacfb92c0) malloc: * error for object 0x6a5f600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(55002,0xacfb92c0) malloc: * error for object 0xba5d204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(55002,0xacfb92c0) malloc: * error for object 0xba5d200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(55002,0xacfb92c0) malloc: * error for object 0xba5d204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(55002,0xacfb92c0) malloc: * error for object 0xba5d200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(55002,0xacfb92c0) malloc: * error for object 0xba5d204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(55002,0xacfb92c0) malloc: * error for object 0xba5d200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(55002,0xacfb92c0) malloc: * error for object 0xba5d200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) hadcm3n_6.07_i686-apple-darwin(61549,0xacfb92c0) malloc: * error for object 0x9895a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61549,0xacfb92c0) malloc: * error for object 0x28a2a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61549,0xacfb92c0) malloc: * error for object 0x28a2a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61549,0xacfb92c0) malloc: * error for object 0xa07c004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61549,0xacfb92c0) malloc: * error for object 0xa07c000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61549,0xacfb92c0) malloc: * error for object 0xa07c004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61549,0xacfb92c0) malloc: * error for object 0xa07c000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61549,0xacfb92c0) malloc: * error for object 0xa07c004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61549,0xacfb92c0) malloc: * error for object 0xa07c000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61549,0xacfb92c0) malloc: * error for object 0xa07c004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61549,0xacfb92c0) malloc: * error for object 0xa07c000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61549,0xacfb92c0) malloc: * error for object 0xa07c004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61549,0xacfb92c0) malloc: * error for object 0xa07c000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Thu May 16 20:59:55 2013 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbffec278 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/25/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90005000 - 0x90009fff /usr/lib/system/libsystem_network.dylib 0x90439000 - 0x9043afff /usr/lib/system/libsystem_sandbox.dylib 0x90671000 - 0x90671fff /usr/lib/system/libdnsinfo.dylib 0x9069a000 - 0x906a8fff /usr/lib/system/libdispatch.dylib 0x90940000 - 0x9096efff /usr/lib/libSystem.B.dylib 0x90d48000 - 0x90d77fff /usr/lib/system/libsystem_info.dylib 0x91126000 - 0x91129fff /usr/lib/system/libcompiler_rt.dylib 0x91b9c000 - 0x91ba4fff /usr/lib/system/libcopyfile.dylib 0x92a77000 - 0x92a7bfff /usr/lib/system/libcache.dylib 0x92a86000 - 0x92a86fff /usr/lib/system/libkeymgr.dylib 0x93cb3000 - 0x93cbbfff /usr/lib/system/libunwind.dylib 0x945a3000 - 0x945b1fff /usr/lib/libz.1.dylib 0x95950000 - 0x95957fff /usr/lib/system/libsystem_dnssd.dylib 0x95a60000 - 0x95a63fff /usr/lib/system/libmathCommon.A.dylib 0x95a64000 - 0x95a6bfff /usr/lib/system/libsystem_notify.dylib 0x96c7b000 - 0x96c7cfff /usr/lib/system/libremovefile.dylib 0x96ecc000 - 0x96ee2fff /usr/lib/system/libxpc.dylib 0x97b70000 - 0x97bd2fff /usr/lib/libstdc++.6.dylib 0x9814d000 - 0x9814efff /usr/lib/system/libsystem_blocks.dylib 0x990d9000 - 0x990e2fff /usr/lib/libc++abi.dylib 0x9b471000 - 0x9b53cfff /usr/lib/system/libsystem_c.dylib 0x9b53d000 - 0x9b53ffff /usr/lib/system/libdyld.dylib 0x9c224000 - 0x9c242fff /usr/lib/system/libsystem_kernel.dylib 0x9c777000 - 0x9c778fff /usr/lib/system/libunc.dylib 0x9c9c7000 - 0x9c9c8fff /usr/lib/system/libquarantine.dylib 0x9cacd000 - 0x9cad5fff /usr/lib/system/liblaunch.dylib 0x9cb9b000 - 0x9cba0fff /usr/lib/system/libmacho.dylib 0x9ceea000 - 0x9cf2dfff /usr/lib/system/libcommonCrypto.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 May 2013 08:17:09	1155438	15764662	hadcm3n_zn49_1960_40_008282452_2	259,200	479,062	1.8482
15 May 2013 09:50:53	1155438	15764662	hadcm3n_zn49_1960_40_008282452_2	233,280	432,579	1.8543
14 May 2013 11:19:38	1155438	15764662	hadcm3n_zn49_1960_40_008282452_2	207,360	384,697	1.8552
13 May 2013 12:41:25	1155438	15764662	hadcm3n_zn49_1960_40_008282452_2	181,440	332,449	1.8323
12 May 2013 14:35:21	1155438	15764662	hadcm3n_zn49_1960_40_008282452_2	155,520	285,932	1.8386
11 May 2013 13:50:01	1155438	15764662	hadcm3n_zn49_1960_40_008282452_2	129,600	238,486	1.8402
10 May 2013 20:03:47	1155438	15764662	hadcm3n_zn49_1960_40_008282452_2	103,680	189,529	1.8280
09 May 2013 12:02:19	1155438	15764662	hadcm3n_zn49_1960_40_008282452_2	77,760	140,606	1.8082
08 May 2013 11:04:46	1155438	15764662	hadcm3n_zn49_1960_40_008282452_2	51,840	93,025	1.7945
07 May 2013 17:36:50	1155438	15764662	hadcm3n_zn49_1960_40_008282452_2	25,920	46,451	1.7921