Task 16649515

Name	hadcm3n_zdr1_1960_40_008410550_4
Workunit	8561406
Created	28 May 2014, 4:27:05 UTC
Sent	28 May 2014, 4:27:20 UTC
Report deadline	27 Aug 2014, 11:54:31 UTC
Received	20 Jun 2014, 4:34:11 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1197259
Run time	18 days 13 hours 24 min 25 sec
CPU time	14 days 13 hours 55 min 5 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.18 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:26:21 (15984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:35:57 (7481): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:20:33 (82904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:20:34 (82904): No heartbeat from core client for 30 sec - exiting 00:20:35 (82904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 00:37:19 (84403): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(91724,0xacc182c0) malloc: * error for object 0x7a4f204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91724,0xacc182c0) malloc: * error for object 0x4a3c204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91724,0xacc182c0) malloc: * error for object 0x4252004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91724,0xacc182c0) malloc: * error for object 0x8a3e204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91724,0xacc182c0) malloc: * error for object 0x2a1da04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91724,0xacc182c0) malloc: * error for object 0x2a1da00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91724,0xacc182c0) malloc: * error for object 0x621e804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91724,0xacc182c0) malloc: * error for object 0x621e800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91724,0xacc182c0) malloc: * error for object 0x621e804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91724,0xacc182c0) malloc: * error for object 0x621e800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91724,0xacc182c0) malloc: * error for object 0x621e804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91724,0xacc182c0) malloc: * error for object 0x621e800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91724,0xacc182c0) malloc: * error for object 0x621e804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91724,0xacc182c0) malloc: * error for object 0x621e800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(91724,0xacc182c0) malloc: * error for object 0x621e800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Thu Jun 19 23:05:59 2014 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fa58 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/1/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90574000 - 0x90574fff /usr/lib/system/libdnsinfo.dylib 0x90614000 - 0x90618fff /usr/lib/system/libsystem_network.dylib 0x90625000 - 0x90654fff /usr/lib/system/libsystem_info.dylib 0x913dc000 - 0x913e4fff /usr/lib/system/libcopyfile.dylib 0x91776000 - 0x9177bfff /usr/lib/system/libmacho.dylib 0x9207c000 - 0x9207cfff /usr/lib/system/libkeymgr.dylib 0x92c58000 - 0x92c59fff /usr/lib/system/libremovefile.dylib 0x92c8f000 - 0x92c96fff /usr/lib/system/libsystem_dnssd.dylib 0x92cec000 - 0x92cfafff /usr/lib/system/libdispatch.dylib 0x93bdf000 - 0x93be7fff /usr/lib/system/liblaunch.dylib 0x946a3000 - 0x946b9fff /usr/lib/system/libxpc.dylib 0x9684a000 - 0x96852fff /usr/lib/system/libunwind.dylib 0x96856000 - 0x96857fff /usr/lib/system/libsystem_sandbox.dylib 0x969b1000 - 0x969b5fff /usr/lib/system/libcache.dylib 0x96b37000 - 0x96b3afff /usr/lib/system/libmathCommon.A.dylib 0x972e3000 - 0x972e4fff /usr/lib/system/libquarantine.dylib 0x9835c000 - 0x9835efff /usr/lib/system/libdyld.dylib 0x99742000 - 0x99770fff /usr/lib/libSystem.B.dylib 0x99dcb000 - 0x99e96fff /usr/lib/system/libsystem_c.dylib 0x9a8fc000 - 0x9a905fff /usr/lib/libc++abi.dylib 0x9a99a000 - 0x9a99bfff /usr/lib/system/libsystem_blocks.dylib 0x9b23d000 - 0x9b23efff /usr/lib/system/libunc.dylib 0x9b86c000 - 0x9b8cefff /usr/lib/libstdc++.6.dylib 0x9b917000 - 0x9b925fff /usr/lib/libz.1.dylib 0x9c607000 - 0x9c60afff /usr/lib/system/libcompiler_rt.dylib 0x9c975000 - 0x9c9b8fff /usr/lib/system/libcommonCrypto.dylib 0x9c9b9000 - 0x9c9c0fff /usr/lib/system/libsystem_notify.dylib 0x9caeb000 - 0x9cb09fff /usr/lib/system/libsystem_kernel.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Jun 2014 04:35:42	1197259	16649515	hadcm3n_zdr1_1960_40_008410550_4	777,600	1,259,700	1.6200
19 Jun 2014 07:41:12	1197259	16649515	hadcm3n_zdr1_1960_40_008410550_4	751,680	1,211,448	1.6117
18 Jun 2014 15:18:02	1197259	16649515	hadcm3n_zdr1_1960_40_008410550_4	725,760	1,164,201	1.6041
17 Jun 2014 22:17:44	1197259	16649515	hadcm3n_zdr1_1960_40_008410550_4	699,840	1,116,815	1.5958
16 Jun 2014 23:24:48	1197259	16649515	hadcm3n_zdr1_1960_40_008410550_4	673,920	1,068,541	1.5856
16 Jun 2014 09:23:26	1197259	16649515	hadcm3n_zdr1_1960_40_008410550_4	648,000	1,026,887	1.5847
15 Jun 2014 20:07:14	1197259	16649515	hadcm3n_zdr1_1960_40_008410550_4	622,080	991,131	1.5933
15 Jun 2014 06:31:05	1197259	16649515	hadcm3n_zdr1_1960_40_008410550_4	596,160	953,261	1.5990
14 Jun 2014 17:19:57	1197259	16649515	hadcm3n_zdr1_1960_40_008410550_4	570,240	914,893	1.6044
13 Jun 2014 01:46:16	1197259	16649515	hadcm3n_zdr1_1960_40_008410550_4	544,320	874,329	1.6063
11 Jun 2014 12:07:18	1197259	16649515	hadcm3n_zdr1_1960_40_008410550_4	518,400	834,026	1.6088
10 Jun 2014 21:10:51	1197259	16649515	hadcm3n_zdr1_1960_40_008410550_4	492,480	793,519	1.6113
10 Jun 2014 09:04:25	1197259	16649515	hadcm3n_zdr1_1960_40_008410550_4	466,560	752,780	1.6135
10 Jun 2014 09:03:35	1197259	16649515	hadcm3n_zdr1_1960_40_008410550_4	440,640	711,780	1.6153
10 Jun 2014 09:02:40	1197259	16649515	hadcm3n_zdr1_1960_40_008410550_4	414,720	671,233	1.6185
10 Jun 2014 09:01:48	1197259	16649515	hadcm3n_zdr1_1960_40_008410550_4	388,800	633,264	1.6288
10 Jun 2014 09:00:53	1197259	16649515	hadcm3n_zdr1_1960_40_008410550_4	362,880	597,263	1.6459
09 Jun 2014 15:26:44	1197259	16649515	hadcm3n_zdr1_1960_40_008410550_4	336,960	557,815	1.6554
06 Jun 2014 12:08:16	1197259	16649515	hadcm3n_zdr1_1960_40_008410550_4	311,040	518,189	1.6660
05 Jun 2014 12:45:16	1197259	16649515	hadcm3n_zdr1_1960_40_008410550_4	285,120	478,119	1.6769