Task 16145354

Name	hadcm3n_n2ob_1880_40_008374433_4
Workunit	8525292
Created	15 Dec 2013, 22:30:44 UTC
Sent	15 Dec 2013, 22:31:10 UTC
Report deadline	17 Mar 2014, 5:58:21 UTC
Received	11 Jan 2014, 20:43:48 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1197259
Run time	25 days 23 hours 52 min 29 sec
CPU time	14 days 22 hours 8 min 14 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.19 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:44:35 (59274): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGSEGV: segmentation violation Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:21:58 (90673): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:26:16 (11498): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:28:23 (18694): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:29:36 (21647): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:29:42 (21647): No heartbeat from core client for 30 sec - exiting 00:29:43 (21647): No heartbeat from core client for 30 sec - exiting 00:29:44 (21647): No heartbeat from core client for 30 sec - exiting 00:29:45 (21647): No heartbeat from core client for 30 sec - exiting 00:29:46 (21647): No heartbeat from core client for 30 sec - exiting 00:29:47 (21647): No heartbeat from core client for 30 sec - exiting 00:29:48 (21647): No heartbeat from core client for 30 sec - exiting 00:29:49 (21647): No heartbeat from core client for 30 sec - exiting 00:29:50 (21647): No heartbeat from core client for 30 sec - exiting 00:29:51 (21647): No heartbeat from core client for 30 sec - exiting 00:29:52 (21647): No heartbeat from core client for 30 sec - exiting 01:31:08 (23490): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:18:22 (24980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:18:23 (24980): No heartbeat from core client for 30 sec - exiting 01:18:24 (24980): No heartbeat from core client for 30 sec - exiting 01:18:25 (24980): No heartbeat from core client for 30 sec - exiting 01:18:26 (24980): No heartbeat from core client for 30 sec - exiting 01:18:27 (24980): No heartbeat from core client for 30 sec - exiting 01:18:28 (24980): No heartbeat from core client for 30 sec - exiting 01:18:29 (24980): No heartbeat from core client for 30 sec - exiting 01:18:30 (24980): No heartbeat from core client for 30 sec - exiting 00:06:14 (87022): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:47:00 (30014): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:50:39 (30966): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:17:31 (98431): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:22:54 (57206): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:08:40 (65422): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:08:42 (65422): No heartbeat from core client for 30 sec - exiting 19:08:43 (65422): No heartbeat from core client for 30 sec - exiting 19:08:44 (65422): No heartbeat from core client for 30 sec - exiting 00:47:16 (96025): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:47:18 (96025): No heartbeat from core client for 30 sec - exiting 00:47:19 (96025): No heartbeat from core client for 30 sec - exiting 00:47:20 (96025): No heartbeat from core client for 30 sec - exiting 00:47:22 (96025): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 15:45:21 (55583): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:45:59 (61847): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:28:19 (68770): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:28:21 (68770): No heartbeat from core client for 30 sec - exiting 01:28:22 (68770): No heartbeat from core client for 30 sec - exiting 01:28:23 (68770): No heartbeat from core client for 30 sec - exiting 01:28:24 (68770): No heartbeat from core client for 30 sec - exiting 01:28:25 (68770): No heartbeat from core client for 30 sec - exiting 01:28:26 (68770): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 00:34:32 (96355): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:35:30 (58888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:53:51 (68996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:53:36 (17745): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:32:25 (21882): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:37:33 (28836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:54:53 (37356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:59:58 (76011): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:00:00 (76011): No heartbeat from core client for 30 sec - exiting 01:00:01 (76011): No heartbeat from core client for 30 sec - exiting 01:00:02 (76011): No heartbeat from core client for 30 sec - exiting 01:00:03 (76011): No heartbeat from core client for 30 sec - exiting 01:00:04 (76011): No heartbeat from core client for 30 sec - exiting 01:00:05 (76011): No heartbeat from core client for 30 sec - exiting 01:00:06 (76011): No heartbeat from core client for 30 sec - exiting 01:00:07 (76011): No heartbeat from core client for 30 sec - exiting 01:11:51 (96390): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:27:12 (98351): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:40:15 (21405): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:08:47 (89977): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:08:49 (89977): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:27:53 (88587): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(61440,0xac36d2c0) malloc: * error for object 0x741dc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61440,0xac36d2c0) malloc: * error for object 0x843d204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61440,0xac36d2c0) malloc: * error for object 0x843d200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61440,0xac36d2c0) malloc: * error for object 0x441dc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61440,0xac36d2c0) malloc: * error for object 0x441dc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61440,0xac36d2c0) malloc: * error for object 0x4c1dc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61440,0xac36d2c0) malloc: * error for object 0x541dc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61440,0xac36d2c0) malloc: * error for object 0x541dc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61440,0xac36d2c0) malloc: * error for object 0x7404204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61440,0xac36d2c0) malloc: * error for object 0x7404200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61440,0xac36d2c0) malloc: * error for object 0x7404204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Sat Jan 11 14:42:04 2014 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fa58 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/14/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x92a03000 - 0x92a04fff /usr/lib/system/libsystem_blocks.dylib 0x92d55000 - 0x92d56fff /usr/lib/system/libunc.dylib 0x9378f000 - 0x9385afff /usr/lib/system/libsystem_c.dylib 0x938b4000 - 0x938b6fff /usr/lib/system/libdyld.dylib 0x9404f000 - 0x9407dfff /usr/lib/libSystem.B.dylib 0x94e48000 - 0x94e4ffff /usr/lib/system/libsystem_notify.dylib 0x94f41000 - 0x94f46fff /usr/lib/system/libmacho.dylib 0x954d5000 - 0x954ddfff /usr/lib/system/libunwind.dylib 0x96066000 - 0x96067fff /usr/lib/system/libremovefile.dylib 0x97092000 - 0x970a0fff /usr/lib/libz.1.dylib 0x975c4000 - 0x975f3fff /usr/lib/system/libsystem_info.dylib 0x977df000 - 0x977e3fff /usr/lib/system/libsystem_network.dylib 0x977e4000 - 0x977e7fff /usr/lib/system/libmathCommon.A.dylib 0x977e8000 - 0x97806fff /usr/lib/system/libsystem_kernel.dylib 0x9780c000 - 0x9780cfff /usr/lib/system/libkeymgr.dylib 0x9780d000 - 0x9781bfff /usr/lib/system/libdispatch.dylib 0x97b64000 - 0x97b65fff /usr/lib/system/libsystem_sandbox.dylib 0x97c05000 - 0x97c0efff /usr/lib/libc++abi.dylib 0x98d04000 - 0x98d0cfff /usr/lib/system/liblaunch.dylib 0x99639000 - 0x99640fff /usr/lib/system/libsystem_dnssd.dylib 0x9a11b000 - 0x9a11ffff /usr/lib/system/libcache.dylib 0x9a45d000 - 0x9a4bffff /usr/lib/libstdc++.6.dylib 0x9a578000 - 0x9a58efff /usr/lib/system/libxpc.dylib 0x9a58f000 - 0x9a597fff /usr/lib/system/libcopyfile.dylib 0x9a695000 - 0x9a696fff /usr/lib/system/libquarantine.dylib 0x9b698000 - 0x9b698fff /usr/lib/system/libdnsinfo.dylib 0x9b715000 - 0x9b758fff /usr/lib/system/libcommonCrypto.dylib 0x9b928000 - 0x9b92bfff /usr/lib/system/libcompiler_rt.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Jan 2014 20:45:31	1197259	16145354	hadcm3n_n2ob_1880_40_008374433_4	777,600	1,289,287	1.6580
11 Jan 2014 05:51:57	1197259	16145354	hadcm3n_n2ob_1880_40_008374433_4	751,680	1,253,106	1.6671
10 Jan 2014 10:02:44	1197259	16145354	hadcm3n_n2ob_1880_40_008374433_4	725,760	1,219,011	1.6796
09 Jan 2014 18:17:25	1197259	16145354	hadcm3n_n2ob_1880_40_008374433_4	699,840	1,183,446	1.6910
08 Jan 2014 23:34:33	1197259	16145354	hadcm3n_n2ob_1880_40_008374433_4	673,920	1,143,972	1.6975
08 Jan 2014 01:58:49	1197259	16145354	hadcm3n_n2ob_1880_40_008374433_4	648,000	1,100,425	1.6982
07 Jan 2014 01:56:12	1197259	16145354	hadcm3n_n2ob_1880_40_008374433_4	622,080	1,053,861	1.6941
06 Jan 2014 05:12:41	1197259	16145354	hadcm3n_n2ob_1880_40_008374433_4	596,160	1,010,980	1.6958
05 Jan 2014 12:45:48	1197259	16145354	hadcm3n_n2ob_1880_40_008374433_4	570,240	975,178	1.7101
04 Jan 2014 11:12:41	1197259	16145354	hadcm3n_n2ob_1880_40_008374433_4	544,320	937,341	1.7220
03 Jan 2014 14:02:10	1197259	16145354	hadcm3n_n2ob_1880_40_008374433_4	518,400	897,421	1.7311
02 Jan 2014 19:07:13	1197259	16145354	hadcm3n_n2ob_1880_40_008374433_4	492,480	856,375	1.7389
01 Jan 2014 22:52:46	1197259	16145354	hadcm3n_n2ob_1880_40_008374433_4	466,560	814,936	1.7467
01 Jan 2014 01:27:35	1197259	16145354	hadcm3n_n2ob_1880_40_008374433_4	440,640	771,728	1.7514
31 Dec 2013 05:14:07	1197259	16145354	hadcm3n_n2ob_1880_40_008374433_4	414,720	728,639	1.7569
30 Dec 2013 07:56:45	1197259	16145354	hadcm3n_n2ob_1880_40_008374433_4	388,800	684,317	1.7601
29 Dec 2013 08:42:16	1197259	16145354	hadcm3n_n2ob_1880_40_008374433_4	362,880	639,113	1.7612
28 Dec 2013 08:55:37	1197259	16145354	hadcm3n_n2ob_1880_40_008374433_4	336,960	593,613	1.7617
27 Dec 2013 09:11:30	1197259	16145354	hadcm3n_n2ob_1880_40_008374433_4	311,040	546,396	1.7567
26 Dec 2013 07:53:36	1197259	16145354	hadcm3n_n2ob_1880_40_008374433_4	285,120	499,220	1.7509