Task 16369015

Name	hadcm3n_7690_1980_40_008419383_3
Workunit	8570239
Created	14 Mar 2014, 8:55:50 UTC
Sent	14 Mar 2014, 8:56:04 UTC
Report deadline	13 Jun 2014, 16:23:15 UTC
Received	12 Apr 2014, 22:47:13 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1176125
Run time	25 days 3 hours 26 min 26 sec
CPU time	23 days 7 hours 50 min 3 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	3.25 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(13020,0xacd392c0) malloc: * error for object 0x1304604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13020,0xacd392c0) malloc: * error for object 0x131fc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13020,0xacd392c0) malloc: * error for object 0x131fc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13020,0xacd392c0) malloc: * error for object 0x4af2a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13020,0xacd392c0) malloc: * error for object 0x4b0e004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13020,0xacd392c0) malloc: * error for object 0x4b0e000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13020,0xacd392c0) malloc: * error for object 0x3af1604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13020,0xacd392c0) malloc: * error for object 0x3b0cc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13020,0xacd392c0) malloc: * error for object 0x3b0cc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13020,0xacd392c0) malloc: * error for object 0x3308c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13020,0xacd392c0) malloc: * error for object 0x3308c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13020,0xacd392c0) malloc: * error for object 0xaf2a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13020,0xacd392c0) malloc: * error for object 0xaf2a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13020,0xacd392c0) malloc: * error for object 0x2b15c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13020,0xacd392c0) malloc: * error for object 0x2b15c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13020,0xacd392c0) malloc: * error for object 0x42d2e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Sat Apr 12 15:24:48 2014 hadcm3n_6.07_i686-apple-darwin(13020,0xacd392c0) malloc: * error for object 0x2301404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(13020,0xacd392c0) malloc: * error for object 0x2301400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8f9b8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/7/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90db6000 - 0x90db9fff /usr/lib/system/libmathCommon.A.dylib 0x9182b000 - 0x91832fff /usr/lib/system/libsystem_dnssd.dylib 0x91f9e000 - 0x91fa6fff /usr/lib/system/liblaunch.dylib 0x920d6000 - 0x920dafff /usr/lib/system/libcache.dylib 0x925b8000 - 0x925bbfff /usr/lib/system/libcompiler_rt.dylib 0x925fd000 - 0x92640fff /usr/lib/system/libcommonCrypto.dylib 0x94d5c000 - 0x94d6afff /usr/lib/system/libdispatch.dylib 0x94f17000 - 0x94f46fff /usr/lib/system/libsystem_info.dylib 0x95045000 - 0x95045fff /usr/lib/system/libdnsinfo.dylib 0x95046000 - 0x9504afff /usr/lib/system/libsystem_network.dylib 0x95502000 - 0x95503fff /usr/lib/system/libquarantine.dylib 0x95dae000 - 0x95db0fff /usr/lib/system/libdyld.dylib 0x96cff000 - 0x96cfffff /usr/lib/system/libkeymgr.dylib 0x96d00000 - 0x96d16fff /usr/lib/system/libxpc.dylib 0x975ae000 - 0x97610fff /usr/lib/libstdc++.6.dylib 0x977d9000 - 0x977e1fff /usr/lib/system/libunwind.dylib 0x98b33000 - 0x98bfefff /usr/lib/system/libsystem_c.dylib 0x98ed8000 - 0x98ee6fff /usr/lib/libz.1.dylib 0x98ee7000 - 0x98ef0fff /usr/lib/libc++abi.dylib 0x98ef1000 - 0x98f0ffff /usr/lib/system/libsystem_kernel.dylib 0x99354000 - 0x99355fff /usr/lib/system/libremovefile.dylib 0x99c23000 - 0x99c24fff /usr/lib/system/libsystem_blocks.dylib 0x99d0a000 - 0x99d12fff /usr/lib/system/libcopyfile.dylib 0x9b4a1000 - 0x9b4a2fff /usr/lib/system/libsystem_sandbox.dylib 0x9c065000 - 0x9c06cfff /usr/lib/system/libsystem_notify.dylib 0x9ca75000 - 0x9caa3fff /usr/lib/libSystem.B.dylib 0x9cd4d000 - 0x9cd4efff /usr/lib/system/libunc.dylib 0x9cd4f000 - 0x9cd54fff /usr/lib/system/libmacho.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Apr 2014 13:27:24	1176125	16369015	hadcm3n_7690_1980_40_008419383_3	1,036,800	2,015,399	1.9439
11 Apr 2014 23:43:44	1176125	16369015	hadcm3n_7690_1980_40_008419383_3	1,010,880	1,966,635	1.9455
11 Apr 2014 05:32:34	1176125	16369015	hadcm3n_7690_1980_40_008419383_3	984,960	1,918,317	1.9476
10 Apr 2014 08:00:43	1176125	16369015	hadcm3n_7690_1980_40_008419383_3	959,040	1,867,914	1.9477
09 Apr 2014 17:52:20	1176125	16369015	hadcm3n_7690_1980_40_008419383_3	933,120	1,819,020	1.9494
09 Apr 2014 00:48:12	1176125	16369015	hadcm3n_7690_1980_40_008419383_3	907,200	1,770,117	1.9512
08 Apr 2014 05:00:16	1176125	16369015	hadcm3n_7690_1980_40_008419383_3	881,280	1,719,062	1.9506
07 Apr 2014 10:36:13	1176125	16369015	hadcm3n_7690_1980_40_008419383_3	855,360	1,665,757	1.9474
06 Apr 2014 18:30:04	1176125	16369015	hadcm3n_7690_1980_40_008419383_3	829,440	1,613,089	1.9448
06 Apr 2014 02:43:04	1176125	16369015	hadcm3n_7690_1980_40_008419383_3	803,520	1,558,999	1.9402
05 Apr 2014 10:45:36	1176125	16369015	hadcm3n_7690_1980_40_008419383_3	777,600	1,504,879	1.9353
04 Apr 2014 18:47:03	1176125	16369015	hadcm3n_7690_1980_40_008419383_3	751,680	1,450,471	1.9296
04 Apr 2014 03:48:59	1176125	16369015	hadcm3n_7690_1980_40_008419383_3	725,760	1,396,636	1.9244
03 Apr 2014 10:31:20	1176125	16369015	hadcm3n_7690_1980_40_008419383_3	699,840	1,340,688	1.9157
02 Apr 2014 18:20:23	1176125	16369015	hadcm3n_7690_1980_40_008419383_3	673,920	1,285,422	1.9074
02 Apr 2014 02:05:46	1176125	16369015	hadcm3n_7690_1980_40_008419383_3	648,000	1,230,149	1.8984
01 Apr 2014 09:51:10	1176125	16369015	hadcm3n_7690_1980_40_008419383_3	622,080	1,178,196	1.8940
31 Mar 2014 08:17:11	1176125	16369015	hadcm3n_7690_1980_40_008419383_3	596,160	1,119,954	1.8786
30 Mar 2014 16:16:16	1176125	16369015	hadcm3n_7690_1980_40_008419383_3	570,240	1,066,140	1.8696
30 Mar 2014 01:25:51	1176125	16369015	hadcm3n_7690_1980_40_008419383_3	544,320	1,015,999	1.8665