Task 15489624

Name	hadcm3n_3e67_1940_40_008261425_0
Workunit	8416549
Created	20 Dec 2012, 22:01:54 UTC
Sent	20 Dec 2012, 22:03:11 UTC
Report deadline	22 Mar 2013, 5:30:22 UTC
Received	5 Jul 2013, 0:42:02 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1214227
Run time	16 days 20 hours 48 min 6 sec
CPU time	12 days 20 hours 38 min 7 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.34 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(20070,0xac1122c0) malloc: * error for object 0x4ae3e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20070,0xac1122c0) malloc: * error for object 0x4ae3e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20070,0xac1122c0) malloc: * error for object 0x2ac9204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20070,0xac1122c0) malloc: * error for object 0x2ae4804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(20070,0xac1122c0) malloc: * error for object 0x2ae4800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Thu Jul 4 19:41:37 2013 hadcm3n_6.07_i686-apple-darwin(20070,0xac1122c0) malloc: * error for object 0x3acb804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fa98 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/1/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x91d6a000 - 0x91e35fff /usr/lib/system/libsystem_c.dylib 0x92925000 - 0x92926fff /usr/lib/system/libquarantine.dylib 0x92abe000 - 0x92abffff /usr/lib/system/libsystem_sandbox.dylib 0x92ac0000 - 0x92ac5fff /usr/lib/system/libmacho.dylib 0x92f8e000 - 0x92f9cfff /usr/lib/libz.1.dylib 0x93ab6000 - 0x93b18fff /usr/lib/libstdc++.6.dylib 0x93c8d000 - 0x93c8dfff /usr/lib/system/libdnsinfo.dylib 0x943cc000 - 0x943ccfff /usr/lib/system/libkeymgr.dylib 0x943cf000 - 0x943d3fff /usr/lib/system/libsystem_network.dylib 0x9515f000 - 0x95166fff /usr/lib/system/libsystem_dnssd.dylib 0x95e8c000 - 0x95e8dfff /usr/lib/system/libunc.dylib 0x95ee1000 - 0x95f24fff /usr/lib/system/libcommonCrypto.dylib 0x96c81000 - 0x96c8ffff /usr/lib/system/libdispatch.dylib 0x96c90000 - 0x96c99fff /usr/lib/libc++abi.dylib 0x985bc000 - 0x985bdfff /usr/lib/system/libremovefile.dylib 0x98cb6000 - 0x98cbefff /usr/lib/system/liblaunch.dylib 0x99e5a000 - 0x99e88fff /usr/lib/libSystem.B.dylib 0x99e8d000 - 0x99e95fff /usr/lib/system/libunwind.dylib 0x99ef3000 - 0x99ef5fff /usr/lib/system/libdyld.dylib 0x9aa6f000 - 0x9aa9efff /usr/lib/system/libsystem_info.dylib 0x9aa9f000 - 0x9aaa2fff /usr/lib/system/libcompiler_rt.dylib 0x9aaa7000 - 0x9aaabfff /usr/lib/system/libcache.dylib 0x9b269000 - 0x9b27ffff /usr/lib/system/libxpc.dylib 0x9b527000 - 0x9b545fff /usr/lib/system/libsystem_kernel.dylib 0x9b546000 - 0x9b549fff /usr/lib/system/libmathCommon.A.dylib 0x9b575000 - 0x9b57dfff /usr/lib/system/libcopyfile.dylib 0x9c8be000 - 0x9c8bffff /usr/lib/system/libsystem_blocks.dylib 0x9cc5d000 - 0x9cc64fff /usr/lib/system/libsystem_notify.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Jul 2013 04:23:42	1214227	15489624	hadcm3n_3e67_1940_40_008261425_0	777,600	1,111,071	1.4288
04 Jul 2013 14:27:19	1214227	15489624	hadcm3n_3e67_1940_40_008261425_0	751,680	1,073,775	1.4285
02 Jul 2013 14:40:27	1214227	15489624	hadcm3n_3e67_1940_40_008261425_0	725,760	1,036,041	1.4275
02 Jul 2013 12:04:37	1214227	15489624	hadcm3n_3e67_1940_40_008261425_0	699,840	998,700	1.4270
28 Jun 2013 00:29:12	1214227	15489624	hadcm3n_3e67_1940_40_008261425_0	673,920	954,920	1.4170
26 Jun 2013 01:35:46	1214227	15489624	hadcm3n_3e67_1940_40_008261425_0	648,000	917,106	1.4153
25 Jun 2013 03:59:00	1214227	15489624	hadcm3n_3e67_1940_40_008261425_0	622,080	879,775	1.4142
24 Jun 2013 09:25:12	1214227	15489624	hadcm3n_3e67_1940_40_008261425_0	596,160	842,234	1.4128
23 Jun 2013 09:42:08	1214227	15489624	hadcm3n_3e67_1940_40_008261425_0	570,240	804,328	1.4105
22 Jun 2013 19:23:41	1214227	15489624	hadcm3n_3e67_1940_40_008261425_0	544,320	767,013	1.4091
22 Jun 2013 04:34:03	1214227	15489624	hadcm3n_3e67_1940_40_008261425_0	518,400	728,802	1.4059
21 Jun 2013 07:52:59	1214227	15489624	hadcm3n_3e67_1940_40_008261425_0	492,480	691,328	1.4038
19 Jun 2013 12:58:17	1214227	15489624	hadcm3n_3e67_1940_40_008261425_0	466,560	654,539	1.4029
15 Jun 2013 00:56:27	1214227	15489624	hadcm3n_3e67_1940_40_008261425_0	440,640	616,589	1.3993
14 Jun 2013 07:06:53	1214227	15489624	hadcm3n_3e67_1940_40_008261425_0	414,720	577,347	1.3921
13 Jun 2013 11:19:47	1214227	15489624	hadcm3n_3e67_1940_40_008261425_0	388,800	538,780	1.3858
12 Jun 2013 12:55:20	1214227	15489624	hadcm3n_3e67_1940_40_008261425_0	362,880	500,611	1.3795
11 Jun 2013 23:36:18	1214227	15489624	hadcm3n_3e67_1940_40_008261425_0	336,960	462,789	1.3734
11 Jun 2013 05:11:42	1214227	15489624	hadcm3n_3e67_1940_40_008261425_0	311,040	425,629	1.3684
16 May 2013 14:09:21	1214227	15489624	hadcm3n_3e67_1940_40_008261425_0	285,120	389,356	1.3656