Task 16273225

Name	hadcm3n_7vqv_1980_40_008452426_3
Workunit	8603282
Created	17 Jan 2014, 9:34:41 UTC
Sent	17 Jan 2014, 9:35:03 UTC
Report deadline	18 Apr 2014, 17:02:14 UTC
Received	24 Jan 2014, 13:35:50 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1082116
Run time	4 days 0 hours 48 min 8 sec
CPU time	3 days 16 hours 2 min 12 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.49 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.31</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(66553,0xad26a2c0) malloc: * error for object 0x890804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(66553,0xad26a2c0) malloc: * error for object 0x890800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(66553,0xad26a2c0) malloc: * error for object 0x890804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(66553,0xad26a2c0) malloc: * error for object 0x890800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(66553,0xad26a2c0) malloc: * error for object 0x890804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(66553,0xad26a2c0) malloc: * error for object 0x890800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(75136,0xad26a2c0) malloc: * error for object 0x12c6c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(75136,0xad26a2c0) malloc: * error for object 0x12c6c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(75136,0xad26a2c0) malloc: * error for object 0xacac04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(75136,0xad26a2c0) malloc: * error for object 0xacac00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(75136,0xad26a2c0) malloc: * error for object 0xacac04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(75136,0xad26a2c0) malloc: * error for object 0xacac00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(75136,0xad26a2c0) malloc: * error for object 0xacac00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation SIGSEGV: segmentation violation SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(18369,0xad26a2c0) malloc: * error for object 0x13dae04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18369,0xad26a2c0) malloc: * error for object 0xbb2a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18369,0xad26a2c0) malloc: * error for object 0xbb2a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18369,0xad26a2c0) malloc: * error for object 0x13c1004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18369,0xad26a2c0) malloc: * error for object 0x13c1000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18369,0xad26a2c0) malloc: * error for object 0x13c1000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(32147,0xad26a2c0) malloc: * error for object 0x875204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32147,0xad26a2c0) malloc: * error for object 0x184be04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32147,0xad26a2c0) malloc: * error for object 0x875204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32147,0xad26a2c0) malloc: * error for object 0x821a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32147,0xad26a2c0) malloc: * error for object 0x821a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32147,0xad26a2c0) malloc: * error for object 0x821a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32147,0xad26a2c0) malloc: * error for object 0x821a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32147,0xad26a2c0) malloc: * error for object 0x821a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32147,0xad26a2c0) malloc: * error for object 0x821a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32147,0xad26a2c0) malloc: * error for object 0x821a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32147,0xad26a2c0) malloc: * error for object 0x821a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(32147,0xad26a2c0) malloc: * error for object 0x821a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Thu Jan 23 16:24:34 2014 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fdb8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/2/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90aea000 - 0x90aeefff /usr/lib/system/libcache.dylib 0x914bd000 - 0x914c2fff /usr/lib/system/libmacho.dylib 0x9154f000 - 0x91552fff /usr/lib/system/libcompiler_rt.dylib 0x92641000 - 0x92649fff /usr/lib/system/libcopyfile.dylib 0x92650000 - 0x92651fff /usr/lib/system/libsystem_sandbox.dylib 0x92975000 - 0x92978fff /usr/lib/system/libmathCommon.A.dylib 0x92c40000 - 0x92c41fff /usr/lib/system/libsystem_blocks.dylib 0x9319b000 - 0x931a3fff /usr/lib/system/liblaunch.dylib 0x93559000 - 0x9355afff /usr/lib/system/libquarantine.dylib 0x935f9000 - 0x935fafff /usr/lib/system/libunc.dylib 0x936ee000 - 0x936eefff /usr/lib/system/libkeymgr.dylib 0x95f31000 - 0x95f38fff /usr/lib/system/libsystem_dnssd.dylib 0x964e4000 - 0x96527fff /usr/lib/system/libcommonCrypto.dylib 0x967ae000 - 0x967b0fff /usr/lib/system/libdyld.dylib 0x967b1000 - 0x967b2fff /usr/lib/system/libremovefile.dylib 0x96c38000 - 0x96c66fff /usr/lib/libSystem.B.dylib 0x97627000 - 0x9762bfff /usr/lib/system/libsystem_network.dylib 0x9762c000 - 0x9768efff /usr/lib/libstdc++.6.dylib 0x97795000 - 0x9779efff /usr/lib/libc++abi.dylib 0x99000000 - 0x9902ffff /usr/lib/system/libsystem_info.dylib 0x999e9000 - 0x999f7fff /usr/lib/libz.1.dylib 0x9a0fb000 - 0x9a119fff /usr/lib/system/libsystem_kernel.dylib 0x9b477000 - 0x9b47efff /usr/lib/system/libsystem_notify.dylib 0x9bb0d000 - 0x9bb0dfff /usr/lib/system/libdnsinfo.dylib 0x9cb01000 - 0x9cb0ffff /usr/lib/system/libdispatch.dylib 0x9ccee000 - 0x9ccf6fff /usr/lib/system/libunwind.dylib 0x9cda6000 - 0x9cdbcfff /usr/lib/system/libxpc.dylib 0x9ce87000 - 0x9cf52fff /usr/lib/system/libsystem_c.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jan 2014 05:24:37	1082116	16273225	hadcm3n_7vqv_1980_40_008452426_3	259,200	314,243	1.2124
22 Jan 2014 12:59:16	1082116	16273225	hadcm3n_7vqv_1980_40_008452426_3	233,280	282,367	1.2104
22 Jan 2014 02:52:17	1082116	16273225	hadcm3n_7vqv_1980_40_008452426_3	207,360	250,803	1.2095
21 Jan 2014 01:08:26	1082116	16273225	hadcm3n_7vqv_1980_40_008452426_3	181,440	219,443	1.2095
20 Jan 2014 09:00:21	1082116	16273225	hadcm3n_7vqv_1980_40_008452426_3	155,520	188,570	1.2125
19 Jan 2014 17:26:19	1082116	16273225	hadcm3n_7vqv_1980_40_008452426_3	129,600	157,449	1.2149
19 Jan 2014 07:54:56	1082116	16273225	hadcm3n_7vqv_1980_40_008452426_3	103,680	125,497	1.2104
18 Jan 2014 17:26:14	1082116	16273225	hadcm3n_7vqv_1980_40_008452426_3	77,760	94,272	1.2123
18 Jan 2014 07:51:50	1082116	16273225	hadcm3n_7vqv_1980_40_008452426_3	51,840	62,432	1.2043
17 Jan 2014 20:39:11	1082116	16273225	hadcm3n_7vqv_1980_40_008452426_3	25,920	31,191	1.2034