Task 15675010

Name	hadcm3n_3dqo_1940_40_008258249_1
Workunit	8413373
Created	21 Mar 2013, 17:40:01 UTC
Sent	21 Mar 2013, 17:40:13 UTC
Report deadline	21 Jun 2013, 1:07:24 UTC
Received	14 May 2013, 8:36:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1265582
Run time	13 days 10 hours 1 min 5 sec
CPU time	12 days 12 hours 48 min 50 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.75 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.31</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(248,0xac9e02c0) malloc: * error for object 0x13fcc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(248,0xac9e02c0) malloc: * error for object 0x13fcc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(248,0xac9e02c0) malloc: * error for object 0x93bf604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(248,0xac9e02c0) malloc: * error for object 0x93bf600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(248,0xac9e02c0) malloc: * error for object 0x23e9204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(248,0xac9e02c0) malloc: * error for object 0x23e9200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(248,0xac9e02c0) malloc: * error for object 0x3bca404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(248,0xac9e02c0) malloc: * error for object 0x63c4604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(248,0xac9e02c0) malloc: * error for object 0x63c4600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(248,0xac9e02c0) malloc: * error for object 0x63caa04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(248,0xac9e02c0) malloc: * error for object 0x63d0604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(248,0xac9e02c0) malloc: * error for object 0x63d0600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(248,0xac9e02c0) malloc: * error for object 0x63d0604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(248,0xac9e02c0) malloc: * error for object 0x63d0600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(248,0xac9e02c0) malloc: * error for object 0x63d0604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(248,0xac9e02c0) malloc: * error for object 0x63d0600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(248,0xac9e02c0) malloc: * error for object 0x63d0604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(248,0xac9e02c0) malloc: * error for object 0x63d0600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(248,0xac9e02c0) malloc: * error for object 0x63d0604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(248,0xac9e02c0) malloc: * error for object 0x63d0600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(248,0xac9e02c0) malloc: * error for object 0xba4e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Mon May 13 09:04:53 2013 hadcm3n_6.07_i686-apple-darwin(214,0xac9e02c0) malloc: * error for object 0x51c6004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(214,0xac9e02c0) malloc: * error for object 0x11d2c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(214,0xac9e02c0) malloc: * error for object 0x31cf004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(214,0xac9e02c0) malloc: * error for object 0x39c7004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(214,0xac9e02c0) malloc: * error for object 0x41c7004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Tue May 14 08:41:29 2013 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fd28 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/0/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90b46000 - 0x90b54fff /usr/lib/libz.1.dylib 0x92930000 - 0x92934fff /usr/lib/system/libsystem_network.dylib 0x9371c000 - 0x9371dfff /usr/lib/system/libunc.dylib 0x9419c000 - 0x9419dfff /usr/lib/system/libsystem_sandbox.dylib 0x941b8000 - 0x941b9fff /usr/lib/system/libsystem_blocks.dylib 0x94269000 - 0x9426cfff /usr/lib/system/libcompiler_rt.dylib 0x94604000 - 0x9460cfff /usr/lib/system/liblaunch.dylib 0x94b72000 - 0x94ba1fff /usr/lib/system/libsystem_info.dylib 0x94c66000 - 0x94cc8fff /usr/lib/libstdc++.6.dylib 0x95794000 - 0x9585ffff /usr/lib/system/libsystem_c.dylib 0x96413000 - 0x96431fff /usr/lib/system/libsystem_kernel.dylib 0x96458000 - 0x9645ffff /usr/lib/system/libsystem_notify.dylib 0x96496000 - 0x9649efff /usr/lib/system/libunwind.dylib 0x96efc000 - 0x96efffff /usr/lib/system/libmathCommon.A.dylib 0x97295000 - 0x97299fff /usr/lib/system/libcache.dylib 0x976ea000 - 0x976f3fff /usr/lib/libc++abi.dylib 0x977b3000 - 0x977f6fff /usr/lib/system/libcommonCrypto.dylib 0x977f7000 - 0x977f8fff /usr/lib/system/libquarantine.dylib 0x987f3000 - 0x987f3fff /usr/lib/system/libdnsinfo.dylib 0x9882d000 - 0x9883bfff /usr/lib/system/libdispatch.dylib 0x9889f000 - 0x988a1fff /usr/lib/system/libdyld.dylib 0x988b8000 - 0x988bdfff /usr/lib/system/libmacho.dylib 0x989dc000 - 0x989f2fff /usr/lib/system/libxpc.dylib 0x98a0a000 - 0x98a0afff /usr/lib/system/libkeymgr.dylib 0x99a05000 - 0x99a0dfff /usr/lib/system/libcopyfile.dylib 0x99e34000 - 0x99e62fff /usr/lib/libSystem.B.dylib 0x9a111000 - 0x9a112fff /usr/lib/system/libremovefile.dylib 0x9c2c0000 - 0x9c2c7fff /usr/lib/system/libsystem_dnssd.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 May 2013 08:08:28	1265582	15675010	hadcm3n_3dqo_1940_40_008258249_1	777,600	1,055,377	1.3572
09 May 2013 15:30:56	1265582	15675010	hadcm3n_3dqo_1940_40_008258249_1	751,680	1,020,037	1.3570
08 May 2013 11:29:52	1265582	15675010	hadcm3n_3dqo_1940_40_008258249_1	725,760	985,645	1.3581
07 May 2013 09:36:48	1265582	15675010	hadcm3n_3dqo_1940_40_008258249_1	699,840	950,296	1.3579
03 May 2013 08:18:28	1265582	15675010	hadcm3n_3dqo_1940_40_008258249_1	673,920	915,423	1.3584
02 May 2013 08:10:37	1265582	15675010	hadcm3n_3dqo_1940_40_008258249_1	648,000	881,339	1.3601
01 May 2013 07:48:32	1265582	15675010	hadcm3n_3dqo_1940_40_008258249_1	622,080	846,957	1.3615
29 Apr 2013 15:25:41	1265582	15675010	hadcm3n_3dqo_1940_40_008258249_1	596,160	812,339	1.3626
26 Apr 2013 13:35:05	1265582	15675010	hadcm3n_3dqo_1940_40_008258249_1	570,240	778,338	1.3649
26 Apr 2013 03:16:10	1265582	15675010	hadcm3n_3dqo_1940_40_008258249_1	544,320	743,268	1.3655
25 Apr 2013 18:02:01	1265582	15675010	hadcm3n_3dqo_1940_40_008258249_1	518,400	710,136	1.3699
24 Apr 2013 16:00:46	1265582	15675010	hadcm3n_3dqo_1940_40_008258249_1	492,480	674,815	1.3702
23 Apr 2013 14:05:29	1265582	15675010	hadcm3n_3dqo_1940_40_008258249_1	466,560	639,441	1.3705
22 Apr 2013 14:20:34	1265582	15675010	hadcm3n_3dqo_1940_40_008258249_1	440,640	603,759	1.3702
19 Apr 2013 12:19:52	1265582	15675010	hadcm3n_3dqo_1940_40_008258249_1	414,720	568,187	1.3700
18 Apr 2013 09:56:42	1265582	15675010	hadcm3n_3dqo_1940_40_008258249_1	388,800	532,056	1.3685
17 Apr 2013 09:26:59	1265582	15675010	hadcm3n_3dqo_1940_40_008258249_1	362,880	496,572	1.3684
15 Apr 2013 13:18:21	1265582	15675010	hadcm3n_3dqo_1940_40_008258249_1	336,960	460,717	1.3673
12 Apr 2013 12:50:47	1265582	15675010	hadcm3n_3dqo_1940_40_008258249_1	311,040	425,991	1.3696
11 Apr 2013 10:49:39	1265582	15675010	hadcm3n_3dqo_1940_40_008258249_1	285,120	390,687	1.3703