Task 14283620

Name	hadcm3n_u1tp_1980_40_007832292_0
Workunit	7987404
Created	18 Mar 2012, 16:31:18 UTC
Sent	18 Mar 2012, 16:33:31 UTC
Report deadline	18 Jun 2012, 0:00:42 UTC
Received	4 Apr 2012, 23:03:57 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1244925
Run time	13 days 4 hours 37 min 10 sec
CPU time	11 days 10 hours 46 min 2 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.83 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.12.35</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(97038,0xac68b2c0) malloc: * error for object 0x2bca404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(97038,0xac68b2c0) malloc: * error for object 0x2bca400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(97038,0xac68b2c0) malloc: * error for object 0x23e8a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(97038,0xac68b2c0) malloc: * error for object 0x23e8a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(97038,0xac68b2c0) malloc: * error for object 0x3bcbe04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(97038,0xac68b2c0) malloc: * error for object 0x4bdd404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(97038,0xac68b2c0) malloc: * error for object 0x43d2a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(97038,0xac68b2c0) malloc: * error for object 0x43d2a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(97038,0xac68b2c0) malloc: * error for object 0xbad404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(97038,0xac68b2c0) malloc: * error for object 0xbad400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.3 build 11D50b Wed Apr 4 18:33:51 2012 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fa28 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/6/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x9015a000 - 0x9015dfff /usr/lib/system/libcompiler_rt.dylib 0x90291000 - 0x90299fff /usr/lib/system/libunwind.dylib 0x90363000 - 0x90364fff /usr/lib/system/libquarantine.dylib 0x9039a000 - 0x903a8fff /usr/lib/system/libdispatch.dylib 0x90960000 - 0x90969fff /usr/lib/libc++abi.dylib 0x925fb000 - 0x9262afff /usr/lib/system/libsystem_info.dylib 0x9267e000 - 0x92682fff /usr/lib/system/libcache.dylib 0x926af000 - 0x926b4fff /usr/lib/system/libmacho.dylib 0x9282f000 - 0x92845fff /usr/lib/system/libxpc.dylib 0x929db000 - 0x929dcfff /usr/lib/system/libremovefile.dylib 0x934c3000 - 0x934c4fff /usr/lib/system/libsystem_sandbox.dylib 0x93aab000 - 0x93b0dfff /usr/lib/libstdc++.6.dylib 0x93ec0000 - 0x93ec7fff /usr/lib/system/libsystem_dnssd.dylib 0x949fa000 - 0x949fbfff /usr/lib/system/libsystem_blocks.dylib 0x94b32000 - 0x94b39fff /usr/lib/system/libsystem_notify.dylib 0x94d20000 - 0x94d22fff /usr/lib/system/libdyld.dylib 0x95ba2000 - 0x95ba2fff /usr/lib/system/libdnsinfo.dylib 0x960ac000 - 0x96177fff /usr/lib/system/libsystem_c.dylib 0x996eb000 - 0x9972efff /usr/lib/system/libcommonCrypto.dylib 0x99735000 - 0x99743fff /usr/lib/libz.1.dylib 0x99853000 - 0x9985bfff /usr/lib/system/libcopyfile.dylib 0x998f4000 - 0x998f8fff /usr/lib/system/libsystem_network.dylib 0x99926000 - 0x99927fff /usr/lib/system/libunc.dylib 0x9996d000 - 0x9996dfff /usr/lib/system/libkeymgr.dylib 0x9b34c000 - 0x9b34ffff /usr/lib/system/libmathCommon.A.dylib 0x9b354000 - 0x9b35cfff /usr/lib/system/liblaunch.dylib 0x9b50f000 - 0x9b52dfff /usr/lib/system/libsystem_kernel.dylib 0x9cda7000 - 0x9cdd5fff /usr/lib/libSystem.B.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Apr 2012 23:05:34	1191540	14283620	hadcm3n_u1tp_1980_40_007832292_0	777,600	989,159	1.2721
04 Apr 2012 08:57:22	1191540	14283620	hadcm3n_u1tp_1980_40_007832292_0	751,680	955,932	1.2717
03 Apr 2012 19:46:57	1191540	14283620	hadcm3n_u1tp_1980_40_007832292_0	725,760	922,444	1.2710
03 Apr 2012 06:26:44	1191540	14283620	hadcm3n_u1tp_1980_40_007832292_0	699,840	889,329	1.2708
02 Apr 2012 14:54:51	1191540	14283620	hadcm3n_u1tp_1980_40_007832292_0	673,920	856,067	1.2703
02 Apr 2012 04:13:52	1191540	14283620	hadcm3n_u1tp_1980_40_007832292_0	648,000	823,135	1.2703
01 Apr 2012 16:59:29	1191540	14283620	hadcm3n_u1tp_1980_40_007832292_0	622,080	790,303	1.2704
01 Apr 2012 06:27:22	1191540	14283620	hadcm3n_u1tp_1980_40_007832292_0	596,160	756,936	1.2697
31 Mar 2012 19:40:58	1191540	14283620	hadcm3n_u1tp_1980_40_007832292_0	570,240	723,668	1.2691
31 Mar 2012 04:45:42	1191540	14283620	hadcm3n_u1tp_1980_40_007832292_0	544,320	690,629	1.2688
30 Mar 2012 12:10:12	1191540	14283620	hadcm3n_u1tp_1980_40_007832292_0	518,400	657,329	1.2680
30 Mar 2012 01:17:45	1191540	14283620	hadcm3n_u1tp_1980_40_007832292_0	492,480	624,273	1.2676
29 Mar 2012 14:27:55	1191540	14283620	hadcm3n_u1tp_1980_40_007832292_0	466,560	590,810	1.2663
29 Mar 2012 04:36:11	1191540	14283620	hadcm3n_u1tp_1980_40_007832292_0	440,640	557,358	1.2649
28 Mar 2012 18:30:57	1191540	14283620	hadcm3n_u1tp_1980_40_007832292_0	414,720	524,420	1.2645
28 Mar 2012 07:41:17	1191540	14283620	hadcm3n_u1tp_1980_40_007832292_0	388,800	491,210	1.2634
27 Mar 2012 20:42:27	1191540	14283620	hadcm3n_u1tp_1980_40_007832292_0	362,880	457,885	1.2618
27 Mar 2012 11:02:16	1191540	14283620	hadcm3n_u1tp_1980_40_007832292_0	336,960	424,695	1.2604
26 Mar 2012 19:00:06	1191540	14283620	hadcm3n_u1tp_1980_40_007832292_0	311,040	391,286	1.2580
26 Mar 2012 07:19:36	1191540	14283620	hadcm3n_u1tp_1980_40_007832292_0	285,120	357,942	1.2554