Task 13828944

Name	hadcm3n_ylzu_1900_40_007513767_3
Workunit	7711242
Created	29 Dec 2011, 7:12:27 UTC
Sent	29 Dec 2011, 7:12:41 UTC
Report deadline	29 Mar 2012, 14:39:52 UTC
Received	29 Jan 2012, 23:13:13 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	931635
Run time	19 days 6 hours 41 min 7 sec
CPU time	16 days 22 hours 44 min 19 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.18 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:21:30 (44045): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:52:15 (82682): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:08:11 (14056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:11:01 (47719): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:59:42 (63755): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:11:40 (73044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x19a4404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x19a4400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x987004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x987000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x117fc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x96ba04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x987004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x987000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x119b204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x119b200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x119b204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x119b200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x96ba04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x2988a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x95e204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x95e200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x95e204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x95e200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x95e204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x95e200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x95e204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x95e200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x95e204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x95e200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x114dc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11554,0xad2482c0) malloc: * error for object 0x114dc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:51:15 (65832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:05:23 (374): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:15:27 (390): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:21:35 (1758): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:09:15 (242): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:11:01 (242): No heartbeat from core client for 30 sec - exiting 09:11:02 (242): No heartbeat from core client for 30 sec - exiting 09:11:03 (242): No heartbeat from core client for 30 sec - exiting 09:11:04 (242): No heartbeat from core client for 30 sec - exiting 09:11:05 (242): No heartbeat from core client for 30 sec - exiting 09:11:06 (242): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:41:30 (248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(253,0xad2482c0) malloc: * error for object 0x872604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(253,0xad2482c0) malloc: * error for object 0x88dc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(253,0xad2482c0) malloc: * error for object 0x88dc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(253,0xad2482c0) malloc: * error for object 0x1063604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(253,0xad2482c0) malloc: * error for object 0x107ec04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(253,0xad2482c0) malloc: * error for object 0x107ec00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(253,0xad2482c0) malloc: * error for object 0x1063604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(253,0xad2482c0) malloc: * error for object 0x107ec04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(253,0xad2482c0) malloc: * error for object 0x107ec00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=261, selfPID=261, iMonCtr=1 hadcm3n_6.07_i686-apple-darwin(44167,0xad2482c0) malloc: * error for object 0x2bd6004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44167,0xad2482c0) malloc: * error for object 0x13f7004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44167,0xad2482c0) malloc: * error for object 0x2bb4804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44167,0xad2482c0) malloc: * error for object 0x2bb4800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44167,0xad2482c0) malloc: * error for object 0x2bb4804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44167,0xad2482c0) malloc: * error for object 0x2bb4800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44167,0xad2482c0) malloc: * error for object 0x2bb4804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44167,0xad2482c0) malloc: * error for object 0x2bb4800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44167,0xad2482c0) malloc: * error for object 0x2bb4804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44167,0xad2482c0) malloc: * error for object 0x2bb4800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44167,0xad2482c0) malloc: * error for object 0x2bb4804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44167,0xad2482c0) malloc: * error for object 0x2bb4800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44167,0xad2482c0) malloc: * error for object 0x13bfc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44167,0xad2482c0) malloc: * error for object 0x13ce204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44167,0xad2482c0) malloc: * error for object 0x13dcc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44167,0xad2482c0) malloc: * error for object 0x13eb604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.2 build 11C74 Fri Jan 27 15:29:22 2012 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fdf8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/4/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90005000 - 0x90006fff /usr/lib/system/libsystem_sandbox.dylib 0x904f7000 - 0x90515fff /usr/lib/system/libsystem_kernel.dylib 0x906a5000 - 0x906a7fff /usr/lib/system/libdyld.dylib 0x9083e000 - 0x90854fff /usr/lib/system/libxpc.dylib 0x90927000 - 0x90928fff /usr/lib/system/libunc.dylib 0x90929000 - 0x90957fff /usr/lib/libSystem.B.dylib 0x90dcb000 - 0x90dd3fff /usr/lib/system/liblaunch.dylib 0x90ed4000 - 0x90eddfff /usr/lib/libc++abi.dylib 0x91079000 - 0x9107afff /usr/lib/system/libremovefile.dylib 0x91100000 - 0x91108fff /usr/lib/system/libunwind.dylib 0x9321d000 - 0x9321dfff /usr/lib/system/libdnsinfo.dylib 0x93943000 - 0x93947fff /usr/lib/system/libsystem_network.dylib 0x93a1c000 - 0x93a1dfff /usr/lib/system/libquarantine.dylib 0x94077000 - 0x9407afff /usr/lib/system/libcompiler_rt.dylib 0x94646000 - 0x94646fff /usr/lib/system/libkeymgr.dylib 0x94ba7000 - 0x94baffff /usr/lib/system/libcopyfile.dylib 0x960ed000 - 0x9611cfff /usr/lib/system/libsystem_info.dylib 0x96608000 - 0x96616fff /usr/lib/system/libdispatch.dylib 0x96aa3000 - 0x96aa4fff /usr/lib/system/libsystem_blocks.dylib 0x96dd5000 - 0x96de3fff /usr/lib/libz.1.dylib 0x972a6000 - 0x972e9fff /usr/lib/system/libcommonCrypto.dylib 0x98876000 - 0x9887bfff /usr/lib/system/libmacho.dylib 0x9941a000 - 0x99421fff /usr/lib/system/libsystem_notify.dylib 0x9a308000 - 0x9a30bfff /usr/lib/system/libmathCommon.A.dylib 0x9ba9c000 - 0x9baa3fff /usr/lib/system/libsystem_dnssd.dylib 0x9bc6f000 - 0x9bc73fff /usr/lib/system/libcache.dylib 0x9c767000 - 0x9c832fff /usr/lib/system/libsystem_c.dylib 0x9ca84000 - 0x9cae6fff /usr/lib/libstdc++.6.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Jan 2012 11:21:34	931635	13828944	hadcm3n_ylzu_1900_40_007513767_3	777,600	1,427,319	1.8355
26 Jan 2012 19:43:47	931635	13828944	hadcm3n_ylzu_1900_40_007513767_3	751,680	1,377,917	1.8331
26 Jan 2012 04:02:29	931635	13828944	hadcm3n_ylzu_1900_40_007513767_3	725,760	1,325,887	1.8269
25 Jan 2012 09:52:03	931635	13828944	hadcm3n_ylzu_1900_40_007513767_3	699,840	1,274,124	1.8206
24 Jan 2012 10:25:10	931635	13828944	hadcm3n_ylzu_1900_40_007513767_3	673,920	1,226,583	1.8201
23 Jan 2012 20:04:32	931635	13828944	hadcm3n_ylzu_1900_40_007513767_3	648,000	1,179,532	1.8203
20 Jan 2012 09:34:59	931635	13828944	hadcm3n_ylzu_1900_40_007513767_3	622,080	1,120,598	1.8014
17 Jan 2012 12:39:05	931635	13828944	hadcm3n_ylzu_1900_40_007513767_3	596,160	1,073,143	1.8001
16 Jan 2012 11:10:15	931635	13828944	hadcm3n_ylzu_1900_40_007513767_3	570,240	1,027,463	1.8018
15 Jan 2012 19:45:19	931635	13828944	hadcm3n_ylzu_1900_40_007513767_3	544,320	980,269	1.8009
14 Jan 2012 18:09:33	931635	13828944	hadcm3n_ylzu_1900_40_007513767_3	518,400	934,257	1.8022
14 Jan 2012 02:50:53	931635	13828944	hadcm3n_ylzu_1900_40_007513767_3	492,480	887,906	1.8029
13 Jan 2012 11:23:15	931635	13828944	hadcm3n_ylzu_1900_40_007513767_3	466,560	840,644	1.8018
12 Jan 2012 19:44:10	931635	13828944	hadcm3n_ylzu_1900_40_007513767_3	440,640	792,882	1.7994
11 Jan 2012 09:19:04	931635	13828944	hadcm3n_ylzu_1900_40_007513767_3	414,720	740,567	1.7857
10 Jan 2012 11:23:59	931635	13828944	hadcm3n_ylzu_1900_40_007513767_3	388,800	684,789	1.7613
09 Jan 2012 20:40:00	931635	13828944	hadcm3n_ylzu_1900_40_007513767_3	362,880	636,880	1.7551
09 Jan 2012 06:27:44	931635	13828944	hadcm3n_ylzu_1900_40_007513767_3	336,960	590,215	1.7516
08 Jan 2012 16:26:39	931635	13828944	hadcm3n_ylzu_1900_40_007513767_3	311,040	544,157	1.7495
07 Jan 2012 12:02:53	931635	13828944	hadcm3n_ylzu_1900_40_007513767_3	285,120	498,069	1.7469