Task 16586920

Name	hadcm3n_89su_1980_40_008722121_0
Workunit	8868099
Created	23 Apr 2014, 12:43:56 UTC
Sent	4 May 2014, 18:07:16 UTC
Report deadline	4 Aug 2014, 1:34:27 UTC
Received	16 May 2014, 8:23:33 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1233059
Run time	10 days 7 hours 24 min 26 sec
CPU time	9 days 12 hours 12 min 16 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	3.78 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(91589,0xa0dd61a8) malloc: * error for object 0x2a46804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91589,0xa0dd61a8) malloc: * error for object 0x2a46800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91589,0xa0dd61a8) malloc: * error for object 0x422d204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91589,0xa0dd61a8) malloc: * error for object 0x422e004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91589,0xa0dd61a8) malloc: * error for object 0x422e000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91589,0xa0dd61a8) malloc: * error for object 0x422e004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91589,0xa0dd61a8) malloc: * error for object 0x422e000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91589,0xa0dd61a8) malloc: * error for object 0x422e004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91589,0xa0dd61a8) malloc: * error for object 0x422e000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91589,0xa0dd61a8) malloc: * error for object 0x422e004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91589,0xa0dd61a8) malloc: * error for object 0x422e000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(17600,0xa0dd61a8) malloc: * error for object 0x12b8204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17600,0xa0dd61a8) malloc: * error for object 0x12b8200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17600,0xa0dd61a8) malloc: * error for object 0xace404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17600,0xa0dd61a8) malloc: * error for object 0x12b8204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17600,0xa0dd61a8) malloc: * error for object 0x12b8200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17600,0xa0dd61a8) malloc: * error for object 0x3aac004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.9.2 build 13C1021 Fri May 16 03:22:52 2014 Thread 0 Crashed: Thread 1: -- Warning: /usr/bin/atos is moving and will be removed from a future OS X release. It is now available in the Xcode developer tools to be invoked via: `xcrun atos` To silence this warning, pass the '-d' command-line flag to this tool. -- atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fa88 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/5/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x91290000 - 0x912adfff /usr/lib/system/libsystem_kernel.dylib 0x9137a000 - 0x9139efff /usr/lib/system/libxpc.dylib 0x91b9f000 - 0x91beffff /usr/lib/system/libcorecrypto.dylib 0x93266000 - 0x9326afff /usr/lib/system/libcache.dylib 0x9336e000 - 0x9339ffff /usr/lib/system/libsystem_m.dylib 0x938c5000 - 0x938c7fff /usr/lib/system/libsystem_configuration.dylib 0x94021000 - 0x94026fff /usr/lib/system/libcompiler_rt.dylib 0x94ef8000 - 0x94ef9fff /usr/lib/system/libunc.dylib 0x95442000 - 0x9544bfff /usr/lib/system/libsystem_notify.dylib 0x954a0000 - 0x954a4fff /usr/lib/system/libmacho.dylib 0x95612000 - 0x95617fff /usr/lib/system/libsystem_platform.dylib 0x9662d000 - 0x9663bfff /usr/lib/libz.1.dylib 0x968f1000 - 0x968f3fff /usr/lib/system/libquarantine.dylib 0x96970000 - 0x9697bfff /usr/lib/system/libcommonCrypto.dylib 0x975ae000 - 0x97640fff /usr/lib/system/libsystem_c.dylib 0x97c31000 - 0x97c34fff /usr/lib/system/libdyld.dylib 0x97c64000 - 0x97c76fff /usr/lib/system/libsystem_asl.dylib 0x97cb1000 - 0x97cb9fff /usr/lib/system/libsystem_dnssd.dylib 0x97ccf000 - 0x97ce7fff /usr/lib/system/libsystem_malloc.dylib 0x97ce8000 - 0x97ce9fff /usr/lib/system/libsystem_blocks.dylib 0x98090000 - 0x98097fff /usr/lib/system/libsystem_pthread.dylib 0x98399000 - 0x983a1fff /usr/lib/system/libcopyfile.dylib 0x983a2000 - 0x983a3fff /usr/lib/libSystem.B.dylib 0x9884d000 - 0x98865fff /usr/lib/system/libdispatch.dylib 0x98cd9000 - 0x98cdffff /usr/lib/system/libunwind.dylib 0x98daf000 - 0x98e00fff /usr/lib/libstdc++.6.dylib 0x99579000 - 0x99581fff /usr/lib/system/liblaunch.dylib 0x99a80000 - 0x99a81fff /usr/lib/system/libremovefile.dylib 0x99e2b000 - 0x99e2cfff /usr/lib/system/libsystem_sandbox.dylib 0x9a849000 - 0x9a871fff /usr/lib/system/libsystem_info.dylib 0x9b881000 - 0x9b8acfff /usr/lib/system/libsystem_network.dylib 0x9b8eb000 - 0x9b8ebfff /usr/lib/system/libkeymgr.dylib 0x9c147000 - 0x9c16bfff /usr/lib/libc++abi.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 May 2014 07:25:42	1233059	16586920	hadcm3n_89su_1980_40_008722121_0	1,036,800	821,531	0.7924
16 May 2014 00:43:16	1233059	16586920	hadcm3n_89su_1980_40_008722121_0	1,010,880	800,171	0.7916
15 May 2014 15:03:25	1233059	16586920	hadcm3n_89su_1980_40_008722121_0	984,960	778,817	0.7907
15 May 2014 06:18:00	1233059	16586920	hadcm3n_89su_1980_40_008722121_0	959,040	757,779	0.7901
14 May 2014 20:21:22	1233059	16586920	hadcm3n_89su_1980_40_008722121_0	933,120	735,605	0.7883
14 May 2014 14:27:29	1233059	16586920	hadcm3n_89su_1980_40_008722121_0	907,200	715,908	0.7891
14 May 2014 05:41:16	1233059	16586920	hadcm3n_89su_1980_40_008722121_0	881,280	696,141	0.7899
13 May 2014 22:18:56	1233059	16586920	hadcm3n_89su_1980_40_008722121_0	855,360	673,624	0.7875
13 May 2014 15:35:35	1233059	16586920	hadcm3n_89su_1980_40_008722121_0	829,440	652,504	0.7867
13 May 2014 09:19:11	1233059	16586920	hadcm3n_89su_1980_40_008722121_0	803,520	631,822	0.7863
13 May 2014 02:35:20	1233059	16586920	hadcm3n_89su_1980_40_008722121_0	777,600	610,476	0.7851
12 May 2014 20:13:26	1233059	16586920	hadcm3n_89su_1980_40_008722121_0	751,680	589,219	0.7839
12 May 2014 13:45:45	1233059	16586920	hadcm3n_89su_1980_40_008722121_0	725,760	567,720	0.7822
12 May 2014 07:32:09	1233059	16586920	hadcm3n_89su_1980_40_008722121_0	699,840	547,149	0.7818
12 May 2014 00:59:24	1233059	16586920	hadcm3n_89su_1980_40_008722121_0	673,920	526,074	0.7806
11 May 2014 17:16:46	1233059	16586920	hadcm3n_89su_1980_40_008722121_0	648,000	505,048	0.7794
11 May 2014 08:12:46	1233059	16586920	hadcm3n_89su_1980_40_008722121_0	622,080	483,669	0.7775
10 May 2014 23:39:18	1233059	16586920	hadcm3n_89su_1980_40_008722121_0	596,160	462,239	0.7754
10 May 2014 16:36:47	1233059	16586920	hadcm3n_89su_1980_40_008722121_0	570,240	441,036	0.7734
10 May 2014 10:05:20	1233059	16586920	hadcm3n_89su_1980_40_008722121_0	544,320	420,243	0.7721