Task 18707164

Name	hadcm3n_sal4_1980_40_010021687_1
Workunit	10019758
Created	17 Jul 2015, 13:41:17 UTC
Sent	17 Jul 2015, 13:49:11 UTC
Report deadline	16 Oct 2015, 21:16:22 UTC
Received	6 Aug 2015, 16:22:57 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1290184
Run time	6 days 3 hours 32 min 10 sec
CPU time	5 days 13 hours 58 min 20 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.08 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(74256,0xac9672c0) malloc: * error for object 0x1240a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74256,0xac9672c0) malloc: * error for object 0x1240a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74256,0xac9672c0) malloc: * error for object 0xa46204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74256,0xac9672c0) malloc: * error for object 0xa46200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74256,0xac9672c0) malloc: * error for object 0xa46204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74256,0xac9672c0) malloc: * error for object 0xa46200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74256,0xac9672c0) malloc: * error for object 0xa46204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74256,0xac9672c0) malloc: * error for object 0xa46200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74256,0xac9672c0) malloc: * error for object 0xa46204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74256,0xac9672c0) malloc: * error for object 0xa46200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74256,0xac9672c0) malloc: * error for object 0x123da04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74256,0xac9672c0) malloc: * error for object 0x123da00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(23886,0xac9672c0) malloc: * error for object 0x22ebe04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23886,0xac9672c0) malloc: * error for object 0x22ebe00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23886,0xac9672c0) malloc: * error for object 0x12ea404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23886,0xac9672c0) malloc: * error for object 0x12ea400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23886,0xac9672c0) malloc: * error for object 0x12ea404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23886,0xac9672c0) malloc: * error for object 0x12ea400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23886,0xac9672c0) malloc: * error for object 0x22d0804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23886,0xac9672c0) malloc: * error for object 0x22ebe04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23886,0xac9672c0) malloc: * error for object 0x22ebe00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23886,0xac9672c0) malloc: * error for object 0xad8804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23886,0xac9672c0) malloc: * error for object 0xad8800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23886,0xac9672c0) malloc: * error for object 0x12cee04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23886,0xac9672c0) malloc: * error for object 0x22d0804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23886,0xac9672c0) malloc: * error for object 0xac2204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63b Wed Aug 5 18:22:46 2015 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fab8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/2/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x9022c000 - 0x90234fff /usr/lib/system/libunwind.dylib 0x90422000 - 0x90425fff /usr/lib/system/libcompiler_rt.dylib 0x904c8000 - 0x904cbfff /usr/lib/system/libmathCommon.A.dylib 0x908be000 - 0x908c5fff /usr/lib/system/libsystem_notify.dylib 0x918d2000 - 0x918dafff /usr/lib/system/liblaunch.dylib 0x91ae1000 - 0x91ae2fff /usr/lib/system/libsystem_sandbox.dylib 0x91b2b000 - 0x91b2cfff /usr/lib/system/libunc.dylib 0x91b30000 - 0x91b34fff /usr/lib/system/libsystem_network.dylib 0x921ce000 - 0x921cefff /usr/lib/system/libdnsinfo.dylib 0x92cf4000 - 0x92cf8fff /usr/lib/system/libcache.dylib 0x935f5000 - 0x93623fff /usr/lib/libSystem.B.dylib 0x937d9000 - 0x937e1fff /usr/lib/system/libcopyfile.dylib 0x93dfc000 - 0x93e1afff /usr/lib/system/libsystem_kernel.dylib 0x9471d000 - 0x94760fff /usr/lib/system/libcommonCrypto.dylib 0x951ab000 - 0x95276fff /usr/lib/system/libsystem_c.dylib 0x95277000 - 0x95277fff /usr/lib/system/libkeymgr.dylib 0x95f36000 - 0x95f37fff /usr/lib/system/libquarantine.dylib 0x95f38000 - 0x95f4efff /usr/lib/system/libxpc.dylib 0x95ffe000 - 0x95ffffff /usr/lib/system/libremovefile.dylib 0x97550000 - 0x97557fff /usr/lib/system/libsystem_dnssd.dylib 0x975da000 - 0x9763cfff /usr/lib/libstdc++.6.dylib 0x976ad000 - 0x976aefff /usr/lib/system/libsystem_blocks.dylib 0x97b8b000 - 0x97b99fff /usr/lib/system/libdispatch.dylib 0x9bc33000 - 0x9bc38fff /usr/lib/system/libmacho.dylib 0x9cab5000 - 0x9cae4fff /usr/lib/system/libsystem_info.dylib 0x9ce27000 - 0x9ce30fff /usr/lib/libc++abi.dylib 0x9ce31000 - 0x9ce33fff /usr/lib/system/libdyld.dylib 0x9ce45000 - 0x9ce53fff /usr/lib/libz.1.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Aug 2015 16:26:42	1290184	18707164	hadcm3n_sal4_1980_40_010021687_1	518,400	482,295	0.9304
03 Aug 2015 05:43:24	1290184	18707164	hadcm3n_sal4_1980_40_010021687_1	492,480	458,078	0.9301
31 Jul 2015 18:38:23	1290184	18707164	hadcm3n_sal4_1980_40_010021687_1	466,560	433,791	0.9298
30 Jul 2015 16:01:37	1290184	18707164	hadcm3n_sal4_1980_40_010021687_1	440,640	409,674	0.9297
26 Jul 2015 10:21:13	1290184	18707164	hadcm3n_sal4_1980_40_010021687_1	414,720	385,504	0.9296
26 Jul 2015 01:35:42	1290184	18707164	hadcm3n_sal4_1980_40_010021687_1	388,800	361,363	0.9294
25 Jul 2015 15:11:40	1290184	18707164	hadcm3n_sal4_1980_40_010021687_1	362,880	337,194	0.9292
23 Jul 2015 18:44:34	1290184	18707164	hadcm3n_sal4_1980_40_010021687_1	336,960	313,065	0.9291
22 Jul 2015 18:01:23	1290184	18707164	hadcm3n_sal4_1980_40_010021687_1	311,040	288,922	0.9289
21 Jul 2015 11:27:42	1290184	18707164	hadcm3n_sal4_1980_40_010021687_1	285,120	264,769	0.9286
21 Jul 2015 03:39:01	1290184	18707164	hadcm3n_sal4_1980_40_010021687_1	259,200	240,624	0.9283
20 Jul 2015 20:14:53	1290184	18707164	hadcm3n_sal4_1980_40_010021687_1	233,280	216,517	0.9281
20 Jul 2015 10:01:36	1290184	18707164	hadcm3n_sal4_1980_40_010021687_1	207,360	192,559	0.9286
20 Jul 2015 02:17:51	1290184	18707164	hadcm3n_sal4_1980_40_010021687_1	181,440	168,561	0.9290
19 Jul 2015 18:59:00	1290184	18707164	hadcm3n_sal4_1980_40_010021687_1	155,520	144,530	0.9293
19 Jul 2015 11:37:08	1290184	18707164	hadcm3n_sal4_1980_40_010021687_1	129,600	120,489	0.9297
19 Jul 2015 04:14:03	1290184	18707164	hadcm3n_sal4_1980_40_010021687_1	103,680	96,410	0.9299
18 Jul 2015 12:02:36	1290184	18707164	hadcm3n_sal4_1980_40_010021687_1	77,760	72,337	0.9303
18 Jul 2015 04:49:27	1290184	18707164	hadcm3n_sal4_1980_40_010021687_1	51,840	48,226	0.9303
17 Jul 2015 21:35:25	1290184	18707164	hadcm3n_sal4_1980_40_010021687_1	25,920	24,117	0.9304