Task 15797352

Name	hadcm3n_zcz7_1920_40_008371552_0
Workunit	8522411
Created	26 May 2013, 20:05:42 UTC
Sent	26 May 2013, 20:07:14 UTC
Report deadline	26 Aug 2013, 3:34:25 UTC
Received	19 Jun 2013, 13:17:24 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1244925
Run time	20 days 13 hours 46 min 32 sec
CPU time	16 days 1 hours 36 min 41 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	3.55 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(42285,0xacf982c0) malloc: * error for object 0x4b2c000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(53491,0xacf982c0) malloc: * error for object 0x2a55c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(31854,0xacf982c0) malloc: * error for object 0x126be04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31854,0xacf982c0) malloc: * error for object 0x126be00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(38679,0xacf982c0) malloc: * error for object 0x21aac04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(38679,0xacf982c0) malloc: * error for object 0x2188200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(38679,0xacf982c0) malloc: * error for object 0x1183404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(38679,0xacf982c0) malloc: * error for object 0x1183400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Wed Jun 19 09:12:01 2013 hadcm3n_6.07_i686-apple-darwin(38679,0xacf982c0) malloc: * error for object 0x318c404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(38679,0xacf982c0) malloc: * error for object 0x318d604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(38679,0xacf982c0) malloc: * error for object 0x318d600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fd98 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/8/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90169000 - 0x90187fff /usr/lib/system/libsystem_kernel.dylib 0x9086d000 - 0x90872fff /usr/lib/system/libmacho.dylib 0x90f94000 - 0x90fc2fff /usr/lib/libSystem.B.dylib 0x911c4000 - 0x911cdfff /usr/lib/libc++abi.dylib 0x912e8000 - 0x912ebfff /usr/lib/system/libcompiler_rt.dylib 0x924db000 - 0x924e2fff /usr/lib/system/libsystem_dnssd.dylib 0x92605000 - 0x92606fff /usr/lib/system/libquarantine.dylib 0x93b24000 - 0x93b2cfff /usr/lib/system/libcopyfile.dylib 0x93cf3000 - 0x93cf7fff /usr/lib/system/libsystem_network.dylib 0x93cfc000 - 0x93d04fff /usr/lib/system/libunwind.dylib 0x93e05000 - 0x93e13fff /usr/lib/libz.1.dylib 0x941d2000 - 0x941d2fff /usr/lib/system/libkeymgr.dylib 0x942b0000 - 0x942b1fff /usr/lib/system/libsystem_blocks.dylib 0x95852000 - 0x95855fff /usr/lib/system/libmathCommon.A.dylib 0x95d42000 - 0x95d43fff /usr/lib/system/libsystem_sandbox.dylib 0x968f6000 - 0x968f8fff /usr/lib/system/libdyld.dylib 0x968fd000 - 0x9695ffff /usr/lib/libstdc++.6.dylib 0x96ad1000 - 0x96b00fff /usr/lib/system/libsystem_info.dylib 0x972cd000 - 0x972cdfff /usr/lib/system/libdnsinfo.dylib 0x97598000 - 0x975aefff /usr/lib/system/libxpc.dylib 0x97ffa000 - 0x97ffbfff /usr/lib/system/libremovefile.dylib 0x98d82000 - 0x98d90fff /usr/lib/system/libdispatch.dylib 0x99a4c000 - 0x99a4dfff /usr/lib/system/libunc.dylib 0x99a4e000 - 0x99a55fff /usr/lib/system/libsystem_notify.dylib 0x99e65000 - 0x99e69fff /usr/lib/system/libcache.dylib 0x9ae5d000 - 0x9af28fff /usr/lib/system/libsystem_c.dylib 0x9c9aa000 - 0x9c9b2fff /usr/lib/system/liblaunch.dylib 0x9c9b3000 - 0x9c9f6fff /usr/lib/system/libcommonCrypto.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Jun 2013 06:05:11	1244925	15797352	hadcm3n_zcz7_1920_40_008371552_0	1,036,800	1,387,697	1.3384
18 Jun 2013 18:41:24	1244925	15797352	hadcm3n_zcz7_1920_40_008371552_0	1,010,880	1,353,769	1.3392
18 Jun 2013 06:12:39	1244925	15797352	hadcm3n_zcz7_1920_40_008371552_0	984,960	1,319,440	1.3396
17 Jun 2013 18:28:13	1244925	15797352	hadcm3n_zcz7_1920_40_008371552_0	959,040	1,285,264	1.3402
17 Jun 2013 05:09:26	1244925	15797352	hadcm3n_zcz7_1920_40_008371552_0	933,120	1,250,742	1.3404
16 Jun 2013 15:33:43	1244925	15797352	hadcm3n_zcz7_1920_40_008371552_0	907,200	1,216,460	1.3409
16 Jun 2013 03:23:29	1244925	15797352	hadcm3n_zcz7_1920_40_008371552_0	881,280	1,182,121	1.3414
15 Jun 2013 15:12:25	1244925	15797352	hadcm3n_zcz7_1920_40_008371552_0	855,360	1,147,909	1.3420
14 Jun 2013 23:25:24	1244925	15797352	hadcm3n_zcz7_1920_40_008371552_0	829,440	1,113,957	1.3430
14 Jun 2013 09:02:38	1244925	15797352	hadcm3n_zcz7_1920_40_008371552_0	803,520	1,079,629	1.3436
13 Jun 2013 18:07:54	1244925	15797352	hadcm3n_zcz7_1920_40_008371552_0	777,600	1,045,099	1.3440
13 Jun 2013 05:37:38	1244925	15797352	hadcm3n_zcz7_1920_40_008371552_0	751,680	1,010,287	1.3440
12 Jun 2013 12:04:50	1244925	15797352	hadcm3n_zcz7_1920_40_008371552_0	725,760	975,922	1.3447
11 Jun 2013 21:44:59	1244925	15797352	hadcm3n_zcz7_1920_40_008371552_0	699,840	940,527	1.3439
11 Jun 2013 07:42:47	1244925	15797352	hadcm3n_zcz7_1920_40_008371552_0	673,920	905,045	1.3430
10 Jun 2013 11:59:06	1244925	15797352	hadcm3n_zcz7_1920_40_008371552_0	648,000	870,162	1.3428
09 Jun 2013 22:27:35	1244925	15797352	hadcm3n_zcz7_1920_40_008371552_0	622,080	834,657	1.3417
09 Jun 2013 04:33:04	1244925	15797352	hadcm3n_zcz7_1920_40_008371552_0	596,160	800,155	1.3422
08 Jun 2013 10:39:26	1244925	15797352	hadcm3n_zcz7_1920_40_008371552_0	570,240	765,117	1.3417
07 Jun 2013 16:52:27	1244925	15797352	hadcm3n_zcz7_1920_40_008371552_0	544,320	730,374	1.3418