Task 15541281

Name	hadcm3n_zj4y_1960_40_008282221_0
Workunit	8433356
Created	14 Jan 2013, 1:52:13 UTC
Sent	14 Jan 2013, 1:52:17 UTC
Report deadline	15 Apr 2013, 9:19:28 UTC
Received	26 Jan 2013, 11:04:15 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1190785
Run time	9 days 10 hours 0 min 33 sec
CPU time	7 days 21 hours 51 min 13 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.32 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.31</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(42396,0xac1bd2c0) malloc: * error for object 0x2971204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42396,0xac1bd2c0) malloc: * error for object 0x2971200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42396,0xac1bd2c0) malloc: * error for object 0x2168c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42396,0xac1bd2c0) malloc: * error for object 0x2168c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42396,0xac1bd2c0) malloc: * error for object 0x2184204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42396,0xac1bd2c0) malloc: * error for object 0x2184200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42396,0xac1bd2c0) malloc: * error for object 0x2184204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42396,0xac1bd2c0) malloc: * error for object 0x2184200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42396,0xac1bd2c0) malloc: * error for object 0x1164804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42396,0xac1bd2c0) malloc: * error for object 0x117fe04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42396,0xac1bd2c0) malloc: * error for object 0x117fe00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42396,0xac1bd2c0) malloc: * error for object 0x963a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:03:12 (57019): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(48234,0xac1bd2c0) malloc: * error for object 0x1923604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48234,0xac1bd2c0) malloc: * error for object 0x1923600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48234,0xac1bd2c0) malloc: * error for object 0x948c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48234,0xac1bd2c0) malloc: * error for object 0x948c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48234,0xac1bd2c0) malloc: * error for object 0x948c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48234,0xac1bd2c0) malloc: * error for object 0x948c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48234,0xac1bd2c0) malloc: * error for object 0x948c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48234,0xac1bd2c0) malloc: * error for object 0x948c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48234,0xac1bd2c0) malloc: * error for object 0x948c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(48234,0xac1bd2c0) malloc: * error for object 0x191f804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48234,0xac1bd2c0) malloc: * error for object 0x191f800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Sat Jan 26 10:05:05 2013 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8faa8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/0/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90295000 - 0x902b3fff /usr/lib/system/libsystem_kernel.dylib 0x90cb1000 - 0x90cb3fff /usr/lib/system/libdyld.dylib 0x9163e000 - 0x91709fff /usr/lib/system/libsystem_c.dylib 0x91b06000 - 0x91b07fff /usr/lib/system/libsystem_sandbox.dylib 0x91bcb000 - 0x91bd2fff /usr/lib/system/libsystem_notify.dylib 0x9262e000 - 0x92636fff /usr/lib/system/libcopyfile.dylib 0x92648000 - 0x92677fff /usr/lib/system/libsystem_info.dylib 0x939c4000 - 0x939c7fff /usr/lib/system/libmathCommon.A.dylib 0x94e1b000 - 0x94e1ffff /usr/lib/system/libcache.dylib 0x94e20000 - 0x94e21fff /usr/lib/system/libremovefile.dylib 0x95dbd000 - 0x95dcbfff /usr/lib/system/libdispatch.dylib 0x95f26000 - 0x95f27fff /usr/lib/system/libunc.dylib 0x95fe5000 - 0x96028fff /usr/lib/system/libcommonCrypto.dylib 0x96877000 - 0x9687efff /usr/lib/system/libsystem_dnssd.dylib 0x96dab000 - 0x96db3fff /usr/lib/system/libunwind.dylib 0x97773000 - 0x9777bfff /usr/lib/system/liblaunch.dylib 0x97b42000 - 0x97b70fff /usr/lib/libSystem.B.dylib 0x97bb7000 - 0x97bb8fff /usr/lib/system/libsystem_blocks.dylib 0x986c9000 - 0x986cafff /usr/lib/system/libquarantine.dylib 0x98d83000 - 0x98d83fff /usr/lib/system/libkeymgr.dylib 0x98de6000 - 0x98e48fff /usr/lib/libstdc++.6.dylib 0x99e2c000 - 0x99e35fff /usr/lib/libc++abi.dylib 0x99e85000 - 0x99e89fff /usr/lib/system/libsystem_network.dylib 0x99e8a000 - 0x99ea0fff /usr/lib/system/libxpc.dylib 0x99f16000 - 0x99f24fff /usr/lib/libz.1.dylib 0x99f9e000 - 0x99f9efff /usr/lib/system/libdnsinfo.dylib 0x9bc89000 - 0x9bc8cfff /usr/lib/system/libcompiler_rt.dylib 0x9c4b3000 - 0x9c4b8fff /usr/lib/system/libmacho.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Jan 2013 11:05:15	1190785	15541281	hadcm3n_zj4y_1960_40_008282221_0	777,600	683,467	0.8789
26 Jan 2013 04:29:15	1190785	15541281	hadcm3n_zj4y_1960_40_008282221_0	751,680	664,960	0.8846
25 Jan 2013 21:37:33	1190785	15541281	hadcm3n_zj4y_1960_40_008282221_0	725,760	644,525	0.8881
25 Jan 2013 12:40:07	1190785	15541281	hadcm3n_zj4y_1960_40_008282221_0	699,840	624,118	0.8918
25 Jan 2013 05:39:47	1190785	15541281	hadcm3n_zj4y_1960_40_008282221_0	673,920	603,701	0.8958
24 Jan 2013 23:33:27	1190785	15541281	hadcm3n_zj4y_1960_40_008282221_0	648,000	582,907	0.8995
24 Jan 2013 15:05:34	1190785	15541281	hadcm3n_zj4y_1960_40_008282221_0	622,080	559,281	0.8990
24 Jan 2013 06:45:48	1190785	15541281	hadcm3n_zj4y_1960_40_008282221_0	596,160	535,753	0.8987
23 Jan 2013 22:49:12	1190785	15541281	hadcm3n_zj4y_1960_40_008282221_0	570,240	512,279	0.8984
23 Jan 2013 15:05:31	1190785	15541281	hadcm3n_zj4y_1960_40_008282221_0	544,320	488,679	0.8978
23 Jan 2013 07:27:59	1190785	15541281	hadcm3n_zj4y_1960_40_008282221_0	518,400	465,109	0.8972
22 Jan 2013 23:51:31	1190785	15541281	hadcm3n_zj4y_1960_40_008282221_0	492,480	441,635	0.8968
22 Jan 2013 13:10:17	1190785	15541281	hadcm3n_zj4y_1960_40_008282221_0	466,560	417,990	0.8959
22 Jan 2013 04:29:43	1190785	15541281	hadcm3n_zj4y_1960_40_008282221_0	440,640	394,493	0.8953
21 Jan 2013 20:52:25	1190785	15541281	hadcm3n_zj4y_1960_40_008282221_0	414,720	370,977	0.8945
21 Jan 2013 13:15:14	1190785	15541281	hadcm3n_zj4y_1960_40_008282221_0	388,800	347,484	0.8937
21 Jan 2013 05:35:39	1190785	15541281	hadcm3n_zj4y_1960_40_008282221_0	362,880	323,984	0.8928
20 Jan 2013 22:03:39	1190785	15541281	hadcm3n_zj4y_1960_40_008282221_0	336,960	300,547	0.8919
20 Jan 2013 14:35:40	1190785	15541281	hadcm3n_zj4y_1960_40_008282221_0	311,040	277,087	0.8908
19 Jan 2013 18:01:40	1190785	15541281	hadcm3n_zj4y_1960_40_008282221_0	285,120	253,450	0.8889