Task 15674836

Name	hadcm3n_38yg_1940_40_008257394_2
Workunit	8412518
Created	21 Mar 2013, 15:38:05 UTC
Sent	21 Mar 2013, 15:38:18 UTC
Report deadline	20 Jun 2013, 23:05:29 UTC
Received	5 Apr 2013, 23:32:28 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1159137
Run time	10 days 8 hours 0 min 28 sec
CPU time	9 days 5 hours 51 min 46 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.28 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.31</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(13851,0xac5262c0) malloc: * error for object 0x13dee04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(15356,0xac5262c0) malloc: * error for object 0x1390e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15356,0xac5262c0) malloc: * error for object 0x1390e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15356,0xac5262c0) malloc: * error for object 0x2b2e604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15356,0xac5262c0) malloc: * error for object 0x2b2e600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15356,0xac5262c0) malloc: * error for object 0x2b2e604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15356,0xac5262c0) malloc: * error for object 0x2b2e600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15356,0xac5262c0) malloc: * error for object 0x2b2e604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15356,0xac5262c0) malloc: * error for object 0x2b2e600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15356,0xac5262c0) malloc: * error for object 0x2b2e604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15356,0xac5262c0) malloc: * error for object 0x2b2e600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15356,0xac5262c0) malloc: * error for object 0x2b2e604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Thu Mar 28 19:16:22 2013 hadcm3n_6.07_i686-apple-darwin(18411,0xac5262c0) malloc: * error for object 0x1262804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18411,0xac5262c0) malloc: * error for object 0x1262800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18411,0xac5262c0) malloc: * error for object 0x1262804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18411,0xac5262c0) malloc: * error for object 0x1262800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18411,0xac5262c0) malloc: * error for object 0x1262804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18411,0xac5262c0) malloc: * error for object 0x1262800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18411,0xac5262c0) malloc: * error for object 0x1262804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18411,0xac5262c0) malloc: * error for object 0x1262800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18411,0xac5262c0) malloc: * error for object 0x1262804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18411,0xac5262c0) malloc: * error for object 0x1262800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18411,0xac5262c0) malloc: * error for object 0x1262804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(23548,0xac5262c0) malloc: * error for object 0x20dbe04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23548,0xac5262c0) malloc: * error for object 0x20dbe00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23548,0xac5262c0) malloc: * error for object 0x20dbe04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23548,0xac5262c0) malloc: * error for object 0x20dbe00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23548,0xac5262c0) malloc: * error for object 0x20dbe04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23548,0xac5262c0) malloc: * error for object 0x20dbe00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23548,0xac5262c0) malloc: * error for object 0x20dbe04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23548,0xac5262c0) malloc: * error for object 0x20dbe00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23548,0xac5262c0) malloc: * error for object 0x20dbe04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23548,0xac5262c0) malloc: * error for object 0x20dbe00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23548,0xac5262c0) malloc: * error for object 0x20dbe04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23548,0xac5262c0) malloc: * error for object 0x20dbe00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0x2281e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0x2a8a604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0x12a1c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0x12a1c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0x12a1c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0x12a1c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0x12a1c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0x12a1c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0xa95004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0xab0604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0xab0600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0x12a1c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0x12a1c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0x229d404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0x229d400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0x229d404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0x229d400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0xa95004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0xa95000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0x2b0cd14: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0x2b0cd10: pointer being freed was not allocated * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0xa8f604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0xa8f600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0xa8f604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0xa8f600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2184,0xac5262c0) malloc: * error for object 0xa8f604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(3631,0xac5262c0) malloc: * error for object 0x91d000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(4553,0xac5262c0) malloc: * error for object 0xa3f400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Fri Apr 5 15:48:21 2013 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fd78 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/1/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90a24000 - 0x90a2cfff /usr/lib/system/liblaunch.dylib 0x90afe000 - 0x90b60fff /usr/lib/libstdc++.6.dylib 0x91a42000 - 0x91a45fff /usr/lib/system/libmathCommon.A.dylib 0x921b3000 - 0x921b3fff /usr/lib/system/libdnsinfo.dylib 0x92219000 - 0x9221afff /usr/lib/system/libsystem_sandbox.dylib 0x923de000 - 0x9240dfff /usr/lib/system/libsystem_info.dylib 0x92ac0000 - 0x92ac4fff /usr/lib/system/libcache.dylib 0x9303b000 - 0x93040fff /usr/lib/system/libmacho.dylib 0x93277000 - 0x93280fff /usr/lib/libc++abi.dylib 0x932d2000 - 0x932d2fff /usr/lib/system/libkeymgr.dylib 0x93c35000 - 0x93c43fff /usr/lib/system/libdispatch.dylib 0x93e52000 - 0x93e53fff /usr/lib/system/libunc.dylib 0x93eae000 - 0x93eaffff /usr/lib/system/libsystem_blocks.dylib 0x94154000 - 0x94158fff /usr/lib/system/libsystem_network.dylib 0x94cab000 - 0x94d76fff /usr/lib/system/libsystem_c.dylib 0x94faa000 - 0x94fb1fff /usr/lib/system/libsystem_notify.dylib 0x95d75000 - 0x95d7dfff /usr/lib/system/libunwind.dylib 0x96102000 - 0x96120fff /usr/lib/system/libsystem_kernel.dylib 0x97c8f000 - 0x97c90fff /usr/lib/system/libremovefile.dylib 0x97f3f000 - 0x97f6dfff /usr/lib/libSystem.B.dylib 0x983c2000 - 0x983c4fff /usr/lib/system/libdyld.dylib 0x9868e000 - 0x98696fff /usr/lib/system/libcopyfile.dylib 0x9940c000 - 0x9940dfff /usr/lib/system/libquarantine.dylib 0x99b5f000 - 0x99b66fff /usr/lib/system/libsystem_dnssd.dylib 0x99b67000 - 0x99b75fff /usr/lib/libz.1.dylib 0x9a7fb000 - 0x9a7fefff /usr/lib/system/libcompiler_rt.dylib 0x9abce000 - 0x9ac11fff /usr/lib/system/libcommonCrypto.dylib 0x9ad16000 - 0x9ad2cfff /usr/lib/system/libxpc.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Apr 2013 19:50:16	1159137	15674836	hadcm3n_38yg_1940_40_008257394_2	518,400	795,762	1.5350
05 Apr 2013 03:42:42	1159137	15674836	hadcm3n_38yg_1940_40_008257394_2	492,480	756,082	1.5353
04 Apr 2013 13:50:15	1159137	15674836	hadcm3n_38yg_1940_40_008257394_2	466,560	716,350	1.5354
03 Apr 2013 22:56:40	1159137	15674836	hadcm3n_38yg_1940_40_008257394_2	440,640	677,320	1.5371
03 Apr 2013 04:03:38	1159137	15674836	hadcm3n_38yg_1940_40_008257394_2	414,720	637,901	1.5381
02 Apr 2013 05:47:29	1159137	15674836	hadcm3n_38yg_1940_40_008257394_2	388,800	598,721	1.5399
01 Apr 2013 07:34:01	1159137	15674836	hadcm3n_38yg_1940_40_008257394_2	362,880	559,203	1.5410
31 Mar 2013 10:59:48	1159137	15674836	hadcm3n_38yg_1940_40_008257394_2	336,960	519,604	1.5420
30 Mar 2013 21:35:34	1159137	15674836	hadcm3n_38yg_1940_40_008257394_2	311,040	480,026	1.5433
30 Mar 2013 07:54:06	1159137	15674836	hadcm3n_38yg_1940_40_008257394_2	285,120	440,009	1.5432
29 Mar 2013 00:51:37	1159137	15674836	hadcm3n_38yg_1940_40_008257394_2	259,200	401,405	1.5486
28 Mar 2013 03:11:48	1159137	15674836	hadcm3n_38yg_1940_40_008257394_2	233,280	361,476	1.5495
26 Mar 2013 19:26:33	1159137	15674836	hadcm3n_38yg_1940_40_008257394_2	207,360	321,318	1.5496
26 Mar 2013 04:59:39	1159137	15674836	hadcm3n_38yg_1940_40_008257394_2	181,440	281,056	1.5490
25 Mar 2013 16:52:05	1159137	15674836	hadcm3n_38yg_1940_40_008257394_2	155,520	240,912	1.5491
25 Mar 2013 04:36:12	1159137	15674836	hadcm3n_38yg_1940_40_008257394_2	129,600	200,814	1.5495
24 Mar 2013 14:20:12	1159137	15674836	hadcm3n_38yg_1940_40_008257394_2	103,680	160,559	1.5486
24 Mar 2013 02:24:59	1159137	15674836	hadcm3n_38yg_1940_40_008257394_2	77,760	120,507	1.5497
23 Mar 2013 09:38:34	1159137	15674836	hadcm3n_38yg_1940_40_008257394_2	51,840	80,397	1.5509
22 Mar 2013 14:25:17	1159137	15674836	hadcm3n_38yg_1940_40_008257394_2	25,920	40,012	1.5437