Task 16084326

Name	hadcm3n_o6l1_1940_40_008380705_3
Workunit	8531564
Created	25 Nov 2013, 22:21:41 UTC
Sent	26 Nov 2013, 0:32:02 UTC
Report deadline	25 Feb 2014, 7:59:13 UTC
Received	18 Dec 2013, 18:05:38 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1176682
Run time	14 days 1 hours 55 min 32 sec
CPU time	12 days 22 hours 47 min 17 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	3.47 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(51704,0xaca4a2c0) malloc: * error for object 0x12d7404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(54572,0xaca4a2c0) malloc: * error for object 0x1158604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54572,0xaca4a2c0) malloc: * error for object 0x1158600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54572,0xaca4a2c0) malloc: * error for object 0x3158404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54572,0xaca4a2c0) malloc: * error for object 0x3158400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54572,0xaca4a2c0) malloc: * error for object 0x3158400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 hadcm3n_6.07_i686-apple-darwin(54841,0xaca4a2c0) malloc: * error for object 0x2ad9604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54841,0xaca4a2c0) malloc: * error for object 0x3ad5604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54841,0xaca4a2c0) malloc: * error for object 0x3ad5600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54841,0xaca4a2c0) malloc: * error for object 0x3ad5604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54841,0xaca4a2c0) malloc: * error for object 0x3ad5600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54841,0xaca4a2c0) malloc: * error for object 0x3ad5604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54841,0xaca4a2c0) malloc: * error for object 0x3ad5600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54841,0xaca4a2c0) malloc: * error for object 0x3af4c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54841,0xaca4a2c0) malloc: * error for object 0x3b03204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54841,0xaca4a2c0) malloc: * error for object 0x3b03200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(831,0xaca4a2c0) malloc: * error for object 0x22bf604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(831,0xaca4a2c0) malloc: * error for object 0x22bf600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(831,0xaca4a2c0) malloc: * error for object 0x22bf604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(831,0xaca4a2c0) malloc: * error for object 0x22bf600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(831,0xaca4a2c0) malloc: * error for object 0x22bf604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(831,0xaca4a2c0) malloc: * error for object 0x22bf600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(831,0xaca4a2c0) malloc: * error for object 0x22bf600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(5274,0xaca4a2c0) malloc: * error for object 0x39b4004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5274,0xaca4a2c0) malloc: * error for object 0x39b4000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5274,0xaca4a2c0) malloc: * error for object 0x11a8c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5274,0xaca4a2c0) malloc: * error for object 0x11a8c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5274,0xaca4a2c0) malloc: * error for object 0x11a4a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Wed Dec 18 12:50:24 2013 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fdb8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/8/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90139000 - 0x9014ffff /usr/lib/system/libxpc.dylib 0x90b63000 - 0x90b81fff /usr/lib/system/libsystem_kernel.dylib 0x90ec9000 - 0x90ef7fff /usr/lib/libSystem.B.dylib 0x9185c000 - 0x918befff /usr/lib/libstdc++.6.dylib 0x91b47000 - 0x91b47fff /usr/lib/system/libkeymgr.dylib 0x92a05000 - 0x92a06fff /usr/lib/system/libsystem_blocks.dylib 0x93f37000 - 0x93f7afff /usr/lib/system/libcommonCrypto.dylib 0x94460000 - 0x94465fff /usr/lib/system/libmacho.dylib 0x95ce0000 - 0x95ceefff /usr/lib/libz.1.dylib 0x96c6f000 - 0x96c76fff /usr/lib/system/libsystem_notify.dylib 0x96f07000 - 0x96f08fff /usr/lib/system/libquarantine.dylib 0x96f80000 - 0x96f83fff /usr/lib/system/libmathCommon.A.dylib 0x96fc1000 - 0x96fc4fff /usr/lib/system/libcompiler_rt.dylib 0x97a13000 - 0x97a42fff /usr/lib/system/libsystem_info.dylib 0x98661000 - 0x98669fff /usr/lib/system/liblaunch.dylib 0x9866a000 - 0x9866bfff /usr/lib/system/libremovefile.dylib 0x98dad000 - 0x98db5fff /usr/lib/system/libcopyfile.dylib 0x98e40000 - 0x98e4efff /usr/lib/system/libdispatch.dylib 0x98e4f000 - 0x98f1afff /usr/lib/system/libsystem_c.dylib 0x9933f000 - 0x99346fff /usr/lib/system/libsystem_dnssd.dylib 0x9b3fd000 - 0x9b3fefff /usr/lib/system/libsystem_sandbox.dylib 0x9b927000 - 0x9b929fff /usr/lib/system/libdyld.dylib 0x9b92a000 - 0x9b92afff /usr/lib/system/libdnsinfo.dylib 0x9c01b000 - 0x9c023fff /usr/lib/system/libunwind.dylib 0x9c046000 - 0x9c04afff /usr/lib/system/libcache.dylib 0x9c04b000 - 0x9c04cfff /usr/lib/system/libunc.dylib 0x9c08b000 - 0x9c08ffff /usr/lib/system/libsystem_network.dylib 0x9c6a4000 - 0x9c6adfff /usr/lib/libc++abi.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Dec 2013 11:27:41	1176682	16084326	hadcm3n_o6l1_1940_40_008380705_3	1,036,800	1,118,379	1.0787
11 Dec 2013 17:26:08	1176682	16084326	hadcm3n_o6l1_1940_40_008380705_3	1,010,880	1,088,548	1.0768
11 Dec 2013 11:24:05	1176682	16084326	hadcm3n_o6l1_1940_40_008380705_3	984,960	1,068,719	1.0850
11 Dec 2013 04:01:31	1176682	16084326	hadcm3n_o6l1_1940_40_008380705_3	959,040	1,045,971	1.0906
10 Dec 2013 14:51:10	1176682	16084326	hadcm3n_o6l1_1940_40_008380705_3	933,120	1,015,838	1.0886
09 Dec 2013 23:07:55	1176682	16084326	hadcm3n_o6l1_1940_40_008380705_3	907,200	986,081	1.0869
09 Dec 2013 12:39:47	1176682	16084326	hadcm3n_o6l1_1940_40_008380705_3	881,280	956,268	1.0851
09 Dec 2013 00:32:03	1176682	16084326	hadcm3n_o6l1_1940_40_008380705_3	855,360	926,810	1.0835
08 Dec 2013 15:01:46	1176682	16084326	hadcm3n_o6l1_1940_40_008380705_3	829,440	897,130	1.0816
08 Dec 2013 01:46:50	1176682	16084326	hadcm3n_o6l1_1940_40_008380705_3	803,520	865,578	1.0772
07 Dec 2013 15:29:12	1176682	16084326	hadcm3n_o6l1_1940_40_008380705_3	777,600	834,066	1.0726
07 Dec 2013 01:33:18	1176682	16084326	hadcm3n_o6l1_1940_40_008380705_3	751,680	802,427	1.0675
06 Dec 2013 14:16:16	1176682	16084326	hadcm3n_o6l1_1940_40_008380705_3	725,760	770,931	1.0622
06 Dec 2013 02:14:57	1176682	16084326	hadcm3n_o6l1_1940_40_008380705_3	699,840	739,076	1.0561
05 Dec 2013 16:17:02	1176682	16084326	hadcm3n_o6l1_1940_40_008380705_3	673,920	707,448	1.0498
05 Dec 2013 06:36:54	1176682	16084326	hadcm3n_o6l1_1940_40_008380705_3	648,000	675,902	1.0431
04 Dec 2013 20:23:24	1176682	16084326	hadcm3n_o6l1_1940_40_008380705_3	622,080	644,230	1.0356
04 Dec 2013 09:50:31	1176682	16084326	hadcm3n_o6l1_1940_40_008380705_3	596,160	612,980	1.0282
03 Dec 2013 20:21:13	1176682	16084326	hadcm3n_o6l1_1940_40_008380705_3	570,240	583,143	1.0226
03 Dec 2013 10:43:44	1176682	16084326	hadcm3n_o6l1_1940_40_008380705_3	544,320	555,015	1.0196