Task 16591289

Name	hadcm3n_8d45_1980_40_008726416_0
Workunit	8872394
Created	23 Apr 2014, 13:40:42 UTC
Sent	29 Apr 2014, 10:59:49 UTC
Report deadline	29 Jul 2014, 18:27:00 UTC
Received	20 May 2014, 22:06:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1316971
Run time	19 days 21 hours 15 min 6 sec
CPU time	18 days 23 hours 42 min 25 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	3.25 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(59048,0xa18a81a8) malloc: * error for object 0x4912e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59048,0xa18a81a8) malloc: * error for object 0x492e404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59048,0xa18a81a8) malloc: * error for object 0x492e400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59048,0xa18a81a8) malloc: * error for object 0x492e404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59048,0xa18a81a8) malloc: * error for object 0x492e400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59048,0xa18a81a8) malloc: * error for object 0x610be04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59048,0xa18a81a8) malloc: * error for object 0x711ec04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59048,0xa18a81a8) malloc: * error for object 0x91ce04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59048,0xa18a81a8) malloc: * error for object 0x91ce00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59048,0xa18a81a8) malloc: * error for object 0x890be04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59048,0xa18a81a8) malloc: * error for object 0x30f6404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59048,0xa18a81a8) malloc: * error for object 0x30f6400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59048,0xa18a81a8) malloc: * error for object 0x70f8604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59048,0xa18a81a8) malloc: * error for object 0x70f8600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59048,0xa18a81a8) malloc: * error for object 0x70f8604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59048,0xa18a81a8) malloc: * error for object 0x70f8600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59048,0xa18a81a8) malloc: * error for object 0x70f8604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59048,0xa18a81a8) malloc: * error for object 0x70f8600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59048,0xa18a81a8) malloc: * error for object 0x70f8604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59048,0xa18a81a8) malloc: * error for object 0x70f8600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(59048,0xa18a81a8) malloc: * error for object 0x610cc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.9.3 build 13D65 Tue May 20 16:05:57 2014 Thread 0 Crashed: Thread 1: -- Warning: /usr/bin/atos is moving and will be removed from a future OS X release. It is now available in the Xcode developer tools to be invoked via: `xcrun atos` To silence this warning, pass the '-d' command-line flag to this tool. -- atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fa38 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/17/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90008000 - 0x90013fff /usr/lib/system/libcommonCrypto.dylib 0x90447000 - 0x90478fff /usr/lib/system/libsystem_m.dylib 0x90652000 - 0x90653fff /usr/lib/system/libremovefile.dylib 0x90654000 - 0x906e6fff /usr/lib/system/libsystem_c.dylib 0x90aa3000 - 0x90aa7fff /usr/lib/system/libcache.dylib 0x90aa8000 - 0x90aaafff /usr/lib/system/libsystem_configuration.dylib 0x911a4000 - 0x911ccfff /usr/lib/system/libsystem_info.dylib 0x916df000 - 0x916e0fff /usr/lib/libSystem.B.dylib 0x91c37000 - 0x91c37fff /usr/lib/system/libkeymgr.dylib 0x91c40000 - 0x91c58fff /usr/lib/system/libdispatch.dylib 0x91c5a000 - 0x91c62fff /usr/lib/system/libsystem_dnssd.dylib 0x91fd8000 - 0x91fddfff /usr/lib/system/libsystem_platform.dylib 0x9272d000 - 0x92751fff /usr/lib/system/libxpc.dylib 0x928a6000 - 0x928aefff /usr/lib/system/libcopyfile.dylib 0x928b4000 - 0x928b6fff /usr/lib/system/libquarantine.dylib 0x94aa0000 - 0x94ab8fff /usr/lib/system/libsystem_malloc.dylib 0x956b7000 - 0x956c0fff /usr/lib/system/libsystem_notify.dylib 0x95862000 - 0x95867fff /usr/lib/system/libcompiler_rt.dylib 0x95868000 - 0x95869fff /usr/lib/system/libsystem_blocks.dylib 0x95944000 - 0x95945fff /usr/lib/system/libunc.dylib 0x95946000 - 0x95947fff /usr/lib/system/libsystem_sandbox.dylib 0x95e5e000 - 0x95e70fff /usr/lib/system/libsystem_asl.dylib 0x965c5000 - 0x965d3fff /usr/lib/libz.1.dylib 0x9665d000 - 0x96688fff /usr/lib/system/libsystem_network.dylib 0x96ee7000 - 0x96f04fff /usr/lib/system/libsystem_kernel.dylib 0x97dea000 - 0x97e3bfff /usr/lib/libstdc++.6.dylib 0x98eb7000 - 0x98ebffff /usr/lib/system/liblaunch.dylib 0x98f6e000 - 0x98f71fff /usr/lib/system/libdyld.dylib 0x99ac4000 - 0x99ac8fff /usr/lib/system/libmacho.dylib 0x99d9a000 - 0x99deafff /usr/lib/system/libcorecrypto.dylib 0x99deb000 - 0x99df1fff /usr/lib/system/libunwind.dylib 0x9c159000 - 0x9c17dfff /usr/lib/libc++abi.dylib 0x9c204000 - 0x9c20bfff /usr/lib/system/libsystem_pthread.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 May 2014 21:10:53	1316971	16591289	hadcm3n_8d45_1980_40_008726416_0	1,036,800	1,640,533	1.5823
20 May 2014 08:16:47	1316971	16591289	hadcm3n_8d45_1980_40_008726416_0	1,010,880	1,598,783	1.5816
19 May 2014 19:08:22	1316971	16591289	hadcm3n_8d45_1980_40_008726416_0	984,960	1,557,006	1.5808
19 May 2014 07:03:05	1316971	16591289	hadcm3n_8d45_1980_40_008726416_0	959,040	1,515,842	1.5806
18 May 2014 19:34:08	1316971	16591289	hadcm3n_8d45_1980_40_008726416_0	933,120	1,474,372	1.5800
18 May 2014 04:43:38	1316971	16591289	hadcm3n_8d45_1980_40_008726416_0	907,200	1,432,708	1.5793
17 May 2014 16:24:18	1316971	16591289	hadcm3n_8d45_1980_40_008726416_0	881,280	1,391,357	1.5788
17 May 2014 04:10:31	1316971	16591289	hadcm3n_8d45_1980_40_008726416_0	855,360	1,350,743	1.5792
16 May 2014 15:21:16	1316971	16591289	hadcm3n_8d45_1980_40_008726416_0	829,440	1,310,041	1.5794
16 May 2014 03:08:58	1316971	16591289	hadcm3n_8d45_1980_40_008726416_0	803,520	1,269,309	1.5797
15 May 2014 14:58:15	1316971	16591289	hadcm3n_8d45_1980_40_008726416_0	777,600	1,228,671	1.5801
15 May 2014 02:22:13	1316971	16591289	hadcm3n_8d45_1980_40_008726416_0	751,680	1,188,102	1.5806
14 May 2014 13:46:12	1316971	16591289	hadcm3n_8d45_1980_40_008726416_0	725,760	1,147,357	1.5809
14 May 2014 02:05:20	1316971	16591289	hadcm3n_8d45_1980_40_008726416_0	699,840	1,106,696	1.5814
13 May 2014 13:45:38	1316971	16591289	hadcm3n_8d45_1980_40_008726416_0	673,920	1,066,087	1.5819
13 May 2014 01:34:58	1316971	16591289	hadcm3n_8d45_1980_40_008726416_0	648,000	1,025,552	1.5826
12 May 2014 13:45:44	1316971	16591289	hadcm3n_8d45_1980_40_008726416_0	622,080	984,817	1.5831
12 May 2014 01:09:26	1316971	16591289	hadcm3n_8d45_1980_40_008726416_0	596,160	943,933	1.5834
11 May 2014 11:08:33	1316971	16591289	hadcm3n_8d45_1980_40_008726416_0	570,240	902,748	1.5831
10 May 2014 21:48:48	1316971	16591289	hadcm3n_8d45_1980_40_008726416_0	544,320	861,924	1.5835