Task 15631486

Name	hadcm3n_zjpr_1960_40_008317684_0
Workunit	8468819
Created	24 Feb 2013, 2:13:25 UTC
Sent	24 Feb 2013, 2:13:31 UTC
Report deadline	26 May 2013, 9:40:42 UTC
Received	26 Mar 2013, 20:47:06 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1197259
Run time	27 days 22 hours 13 min 48 sec
CPU time	15 days 17 hours 46 min 13 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.18 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.31</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(3933,0xacee62c0) malloc: * error for object 0x69dc604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3933,0xacee62c0) malloc: * error for object 0x69dc600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3933,0xacee62c0) malloc: * error for object 0x11d9004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3933,0xacee62c0) malloc: * error for object 0x11d9000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3933,0xacee62c0) malloc: * error for object 0x11d8604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3933,0xacee62c0) malloc: * error for object 0x11d8600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3933,0xacee62c0) malloc: * error for object 0x11d8604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3933,0xacee62c0) malloc: * error for object 0x11d8600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3933,0xacee62c0) malloc: * error for object 0x11d8604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3933,0xacee62c0) malloc: * error for object 0x11d8600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3933,0xacee62c0) malloc: * error for object 0x61df804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3933,0xacee62c0) malloc: * error for object 0x61ede04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3933,0xacee62c0) malloc: * error for object 0x61ede00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... hadcm3n_6.07_i686-apple-darwin(76098,0xac28f2c0) malloc: * error for object 0x4345c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76098,0xac28f2c0) malloc: * error for object 0x7349204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76098,0xac28f2c0) malloc: * error for object 0x7349200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76098,0xac28f2c0) malloc: * error for object 0x7b67404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76098,0xac28f2c0) malloc: * error for object 0x7b67400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76098,0xac28f2c0) malloc: * error for object 0x1346004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76098,0xac28f2c0) malloc: * error for object 0x1346000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76098,0xac28f2c0) malloc: * error for object 0x1361604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76098,0xac28f2c0) malloc: * error for object 0x1361600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76098,0xac28f2c0) malloc: * error for object 0x834fe04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76098,0xac28f2c0) malloc: * error for object 0x834fe00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76098,0xac28f2c0) malloc: * error for object 0x2357204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76098,0xac28f2c0) malloc: * error for object 0x7349204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76098,0xac28f2c0) malloc: * error for object 0x7349200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76098,0xac28f2c0) malloc: * error for object 0x1325604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76098,0xac28f2c0) malloc: * error for object 0x1325600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76098,0xac28f2c0) malloc: * error for object 0x8b26404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76098,0xac28f2c0) malloc: * error for object 0x8b26400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76098,0xac28f2c0) malloc: * error for object 0x8b26404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76098,0xac28f2c0) malloc: * error for object 0x8b26400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76098,0xac28f2c0) malloc: * error for object 0x8b26404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76098,0xac28f2c0) malloc: * error for object 0x8b26400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76098,0xac28f2c0) malloc: * error for object 0x8b26400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Tue Mar 26 15:01:28 2013 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fa58 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/7/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x910ff000 - 0x91107fff /usr/lib/system/liblaunch.dylib 0x914b7000 - 0x914b8fff /usr/lib/system/libunc.dylib 0x91cd8000 - 0x91da3fff /usr/lib/system/libsystem_c.dylib 0x922c7000 - 0x922f5fff /usr/lib/libSystem.B.dylib 0x93efd000 - 0x93efffff /usr/lib/system/libdyld.dylib 0x94ecb000 - 0x94ed3fff /usr/lib/system/libunwind.dylib 0x94ed4000 - 0x94eeafff /usr/lib/system/libxpc.dylib 0x94f0f000 - 0x94f52fff /usr/lib/system/libcommonCrypto.dylib 0x94f53000 - 0x94f53fff /usr/lib/system/libdnsinfo.dylib 0x9539b000 - 0x9539cfff /usr/lib/system/libsystem_blocks.dylib 0x956da000 - 0x956e3fff /usr/lib/libc++abi.dylib 0x95860000 - 0x95861fff /usr/lib/system/libquarantine.dylib 0x96539000 - 0x96547fff /usr/lib/system/libdispatch.dylib 0x96548000 - 0x96549fff /usr/lib/system/libsystem_sandbox.dylib 0x967d0000 - 0x967d7fff /usr/lib/system/libsystem_dnssd.dylib 0x96df9000 - 0x96e17fff /usr/lib/system/libsystem_kernel.dylib 0x96f93000 - 0x96fc2fff /usr/lib/system/libsystem_info.dylib 0x97a23000 - 0x97a24fff /usr/lib/system/libremovefile.dylib 0x97c4b000 - 0x97c52fff /usr/lib/system/libsystem_notify.dylib 0x97f2c000 - 0x97f2ffff /usr/lib/system/libcompiler_rt.dylib 0x98663000 - 0x9866bfff /usr/lib/system/libcopyfile.dylib 0x9866f000 - 0x98674fff /usr/lib/system/libmacho.dylib 0x986ac000 - 0x986b0fff /usr/lib/system/libsystem_network.dylib 0x98898000 - 0x988a6fff /usr/lib/libz.1.dylib 0x99069000 - 0x9906cfff /usr/lib/system/libmathCommon.A.dylib 0x990b2000 - 0x99114fff /usr/lib/libstdc++.6.dylib 0x99281000 - 0x99281fff /usr/lib/system/libkeymgr.dylib 0x9bc80000 - 0x9bc84fff /usr/lib/system/libcache.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Mar 2013 20:49:15	1197259	15631486	hadcm3n_zjpr_1960_40_008317684_0	777,600	1,359,965	1.7489
25 Mar 2013 20:55:21	1197259	15631486	hadcm3n_zjpr_1960_40_008317684_0	751,680	1,313,582	1.7475
24 Mar 2013 23:04:37	1197259	15631486	hadcm3n_zjpr_1960_40_008317684_0	725,760	1,268,775	1.7482
24 Mar 2013 01:34:42	1197259	15631486	hadcm3n_zjpr_1960_40_008317684_0	699,840	1,224,973	1.7504
21 Mar 2013 20:38:47	1197259	15631486	hadcm3n_zjpr_1960_40_008317684_0	673,920	1,178,846	1.7492
20 Mar 2013 20:18:34	1197259	15631486	hadcm3n_zjpr_1960_40_008317684_0	648,000	1,132,043	1.7470
19 Mar 2013 21:54:04	1197259	15631486	hadcm3n_zjpr_1960_40_008317684_0	622,080	1,087,119	1.7476
18 Mar 2013 21:15:37	1197259	15631486	hadcm3n_zjpr_1960_40_008317684_0	596,160	1,041,096	1.7463
17 Mar 2013 22:00:18	1197259	15631486	hadcm3n_zjpr_1960_40_008317684_0	570,240	995,841	1.7464
17 Mar 2013 00:17:06	1197259	15631486	hadcm3n_zjpr_1960_40_008317684_0	544,320	950,242	1.7457
16 Mar 2013 01:35:46	1197259	15631486	hadcm3n_zjpr_1960_40_008317684_0	518,400	904,673	1.7451
14 Mar 2013 18:41:09	1197259	15631486	hadcm3n_zjpr_1960_40_008317684_0	492,480	860,281	1.7468
13 Mar 2013 19:42:12	1197259	15631486	hadcm3n_zjpr_1960_40_008317684_0	466,560	814,839	1.7465
12 Mar 2013 20:14:04	1197259	15631486	hadcm3n_zjpr_1960_40_008317684_0	440,640	768,474	1.7440
11 Mar 2013 21:07:20	1197259	15631486	hadcm3n_zjpr_1960_40_008317684_0	414,720	722,341	1.7418
10 Mar 2013 21:59:11	1197259	15631486	hadcm3n_zjpr_1960_40_008317684_0	388,800	676,802	1.7407
09 Mar 2013 23:54:26	1197259	15631486	hadcm3n_zjpr_1960_40_008317684_0	362,880	632,417	1.7428
08 Mar 2013 10:11:53	1197259	15631486	hadcm3n_zjpr_1960_40_008317684_0	336,960	587,902	1.7447
07 Mar 2013 10:46:32	1197259	15631486	hadcm3n_zjpr_1960_40_008317684_0	311,040	542,740	1.7449
06 Mar 2013 14:20:19	1197259	15631486	hadcm3n_zjpr_1960_40_008317684_0	285,120	500,808	1.7565