Task 15341242

Name	hadcm3n_o4xt_2060_40_008203307_3
Workunit	8358431
Created	6 Oct 2012, 3:15:33 UTC
Sent	6 Oct 2012, 3:15:39 UTC
Report deadline	5 Jan 2013, 10:42:50 UTC
Received	24 Oct 2012, 16:18:32 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1222511
Run time	7 days 17 hours 52 min 17 sec
CPU time	6 days 17 hours 23 min 36 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.53 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.31</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(29381,0xacbe82c0) malloc: * error for object 0x2823404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29381,0xacbe82c0) malloc: * error for object 0x283ea04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29381,0xacbe82c0) malloc: * error for object 0x283ea00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29381,0xacbe82c0) malloc: * error for object 0x81fa04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29381,0xacbe82c0) malloc: * error for object 0x81fa00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29381,0xacbe82c0) malloc: * error for object 0x81fa04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29381,0xacbe82c0) malloc: * error for object 0x3020004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29381,0xacbe82c0) malloc: * error for object 0x303b604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29381,0xacbe82c0) malloc: * error for object 0x303b600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29381,0xacbe82c0) malloc: * error for object 0x303b604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29381,0xacbe82c0) malloc: * error for object 0x303b600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29381,0xacbe82c0) malloc: * error for object 0x2025004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29381,0xacbe82c0) malloc: * error for object 0x3020004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29381,0xacbe82c0) malloc: * error for object 0x303b604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29381,0xacbe82c0) malloc: * error for object 0x303b600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29381,0xacbe82c0) malloc: * error for object 0x381e604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29381,0xacbe82c0) malloc: * error for object 0x381e600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29381,0xacbe82c0) malloc: * error for object 0x381e604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29381,0xacbe82c0) malloc: * error for object 0x381e600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29381,0xacbe82c0) malloc: * error for object 0x381e604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29381,0xacbe82c0) malloc: * error for object 0x381e600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29381,0xacbe82c0) malloc: * error for object 0x381e600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G56 Fri Oct 12 01:44:22 2012 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(30684,0xacbe82c0) malloc: * error for object 0x222b204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30684,0xacbe82c0) malloc: * error for object 0x222c004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30684,0xacbe82c0) malloc: * error for object 0x222c000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30684,0xacbe82c0) malloc: * error for object 0x422b204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30684,0xacbe82c0) malloc: * error for object 0x422c004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30684,0xacbe82c0) malloc: * error for object 0x422c000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30684,0xacbe82c0) malloc: * error for object 0x422c000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G56 Wed Oct 24 16:52:21 2012 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8faa8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/10/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90e5a000 - 0x90e88fff /usr/lib/libSystem.B.dylib 0x90ead000 - 0x90eaffff /usr/lib/system/libdyld.dylib 0x91556000 - 0x9155efff /usr/lib/system/libcopyfile.dylib 0x91be7000 - 0x91bf0fff /usr/lib/libc++abi.dylib 0x91c00000 - 0x91c07fff /usr/lib/system/libsystem_notify.dylib 0x91d5b000 - 0x91d69fff /usr/lib/system/libdispatch.dylib 0x93537000 - 0x9353cfff /usr/lib/system/libmacho.dylib 0x9353d000 - 0x9354bfff /usr/lib/libz.1.dylib 0x93fc5000 - 0x93fc6fff /usr/lib/system/libsystem_sandbox.dylib 0x957fe000 - 0x95802fff /usr/lib/system/libsystem_network.dylib 0x95983000 - 0x9598bfff /usr/lib/system/liblaunch.dylib 0x959eb000 - 0x95a1afff /usr/lib/system/libsystem_info.dylib 0x95a1b000 - 0x95a1cfff /usr/lib/system/libremovefile.dylib 0x95aff000 - 0x95b00fff /usr/lib/system/libsystem_blocks.dylib 0x962fe000 - 0x96301fff /usr/lib/system/libmathCommon.A.dylib 0x96921000 - 0x96983fff /usr/lib/libstdc++.6.dylib 0x96d5c000 - 0x96d60fff /usr/lib/system/libcache.dylib 0x9752e000 - 0x9752efff /usr/lib/system/libkeymgr.dylib 0x97754000 - 0x97757fff /usr/lib/system/libcompiler_rt.dylib 0x978a7000 - 0x978bdfff /usr/lib/system/libxpc.dylib 0x9846c000 - 0x9846dfff /usr/lib/system/libunc.dylib 0x99852000 - 0x9991dfff /usr/lib/system/libsystem_c.dylib 0x99949000 - 0x99949fff /usr/lib/system/libdnsinfo.dylib 0x99963000 - 0x99964fff /usr/lib/system/libquarantine.dylib 0x9a1e3000 - 0x9a226fff /usr/lib/system/libcommonCrypto.dylib 0x9a839000 - 0x9a840fff /usr/lib/system/libsystem_dnssd.dylib 0x9c696000 - 0x9c6b4fff /usr/lib/system/libsystem_kernel.dylib 0x9ce85000 - 0x9ce8dfff /usr/lib/system/libunwind.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Oct 2012 14:52:31	1222511	15341242	hadcm3n_o4xt_2060_40_008203307_3	518,400	581,014	1.1208
24 Oct 2012 04:00:55	1222511	15341242	hadcm3n_o4xt_2060_40_008203307_3	492,480	552,972	1.1228
23 Oct 2012 18:37:39	1222511	15341242	hadcm3n_o4xt_2060_40_008203307_3	466,560	525,267	1.1258
23 Oct 2012 08:03:01	1222511	15341242	hadcm3n_o4xt_2060_40_008203307_3	440,640	496,729	1.1273
22 Oct 2012 07:12:28	1222511	15341242	hadcm3n_o4xt_2060_40_008203307_3	414,720	468,495	1.1297
18 Oct 2012 03:31:10	1222511	15341242	hadcm3n_o4xt_2060_40_008203307_3	388,800	439,929	1.1315
17 Oct 2012 09:19:58	1222511	15341242	hadcm3n_o4xt_2060_40_008203307_3	362,880	411,442	1.1338
16 Oct 2012 17:31:42	1222511	15341242	hadcm3n_o4xt_2060_40_008203307_3	336,960	383,912	1.1393
15 Oct 2012 20:52:12	1222511	15341242	hadcm3n_o4xt_2060_40_008203307_3	311,040	355,826	1.1440
12 Oct 2012 15:01:21	1222511	15341242	hadcm3n_o4xt_2060_40_008203307_3	285,120	326,626	1.1456
11 Oct 2012 23:48:32	1222511	15341242	hadcm3n_o4xt_2060_40_008203307_3	259,200	296,461	1.1438
11 Oct 2012 13:36:36	1222511	15341242	hadcm3n_o4xt_2060_40_008203307_3	233,280	266,496	1.1424
10 Oct 2012 23:38:53	1222511	15341242	hadcm3n_o4xt_2060_40_008203307_3	207,360	237,956	1.1476
10 Oct 2012 00:49:37	1222511	15341242	hadcm3n_o4xt_2060_40_008203307_3	181,440	209,721	1.1559
09 Oct 2012 00:48:50	1222511	15341242	hadcm3n_o4xt_2060_40_008203307_3	155,520	181,352	1.1661
08 Oct 2012 05:55:22	1222511	15341242	hadcm3n_o4xt_2060_40_008203307_3	129,600	151,446	1.1686
07 Oct 2012 19:46:46	1222511	15341242	hadcm3n_o4xt_2060_40_008203307_3	103,680	119,901	1.1565
07 Oct 2012 08:19:40	1222511	15341242	hadcm3n_o4xt_2060_40_008203307_3	77,760	88,830	1.1424
06 Oct 2012 21:26:40	1222511	15341242	hadcm3n_o4xt_2060_40_008203307_3	51,840	58,963	1.1374
06 Oct 2012 12:23:26	1222511	15341242	hadcm3n_o4xt_2060_40_008203307_3	25,920	29,830	1.1508