Task 15699956

Name	hadcm3n_zdcl_1920_40_008316602_2
Workunit	8467737
Created	2 Apr 2013, 16:44:56 UTC
Sent	2 Apr 2013, 16:45:07 UTC
Report deadline	3 Jul 2013, 0:12:18 UTC
Received	28 Apr 2013, 8:17:48 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1242102
Run time	2 days 15 hours 18 min 55 sec
CPU time	2 days 12 hours 50 min 47 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.31 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.31</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:31:36 (17386): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:31:37 (17386): No heartbeat from core client for 30 sec - exiting 01:31:38 (17386): No heartbeat from core client for 30 sec - exiting 01:31:39 (17386): No heartbeat from core client for 30 sec - exiting 01:31:40 (17386): No heartbeat from core client for 30 sec - exiting 01:31:41 (17386): No heartbeat from core client for 30 sec - exiting 02:16:49 (18616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:28:56 (18767): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:13:25 (18818): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:17:28 (18992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:27:28 (19077): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:29:22 (19122): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:38:27 (19135): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:38:29 (19135): No heartbeat from core client for 30 sec - exiting 03:39:35 (19178): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:39:36 (19178): No heartbeat from core client for 30 sec - exiting 03:54:55 (19188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:11:55 (19247): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:11:57 (19247): No heartbeat from core client for 30 sec - exiting 04:11:58 (19247): No heartbeat from core client for 30 sec - exiting 04:11:59 (19247): No heartbeat from core client for 30 sec - exiting 04:12:00 (19247): No heartbeat from core client for 30 sec - exiting 04:24:58 (19301): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:04:10 (19359): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:04:11 (19359): No heartbeat from core client for 30 sec - exiting 05:04:12 (19359): No heartbeat from core client for 30 sec - exiting 05:05:00 (19504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:18:06 (19508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:18:07 (19508): No heartbeat from core client for 30 sec - exiting 05:49:07 (19564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:49:09 (19564): No heartbeat from core client for 30 sec - exiting 05:49:10 (19564): No heartbeat from core client for 30 sec - exiting 05:51:19 (19678): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:55:17 (19693): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:59:59 (19712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:00:00 (19712): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 06:00:40 (19731): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 06:12:38 (19736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:12:39 (19736): No heartbeat from core client for 30 sec - exiting 06:12:40 (19736): No heartbeat from core client for 30 sec - exiting 06:12:41 (19736): No heartbeat from core client for 30 sec - exiting 06:13:49 (19792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:32:25 (19799): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:33:39 (19889): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:49:41 (19898): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:49:42 (19898): No heartbeat from core client for 30 sec - exiting 06:49:43 (19898): No heartbeat from core client for 30 sec - exiting 06:49:44 (19898): No heartbeat from core client for 30 sec - exiting 06:49:45 (19898): No heartbeat from core client for 30 sec - exiting 06:49:46 (19898): No heartbeat from core client for 30 sec - exiting 07:09:42 (19961): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:28:25 (20033): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:36:21 (20105): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:41:31 (20151): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:08:26 (20170): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:09:33 (20276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:09:34 (20276): No heartbeat from core client for 30 sec - exiting 08:12:13 (20281): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:18:59 (20300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:20:14 (20325): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:37:05 (20339): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:37:06 (20339): No heartbeat from core client for 30 sec - exiting 08:37:07 (20339): No heartbeat from core client for 30 sec - exiting 08:37:08 (20339): No heartbeat from core client for 30 sec - exiting 08:37:09 (20339): No heartbeat from core client for 30 sec - exiting 08:49:31 (20404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:51:44 (20448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:51:45 (20448): No heartbeat from core client for 30 sec - exiting 08:51:46 (20448): No heartbeat from core client for 30 sec - exiting 08:51:47 (20448): No heartbeat from core client for 30 sec - exiting 08:52:26 (20466): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:52:27 (20466): No heartbeat from core client for 30 sec - exiting 08:52:28 (20466): No heartbeat from core client for 30 sec - exiting 09:53:26 (20471): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:10:04 (22053): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:13:45 (22767): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:35:33 (22785): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:35:35 (22785): No heartbeat from core client for 30 sec - exiting 15:35:36 (22785): No heartbeat from core client for 30 sec - exiting 16:09:39 (22876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:09:40 (22876): No heartbeat from core client for 30 sec - exiting 16:09:41 (22876): No heartbeat from core client for 30 sec - exiting 16:25:27 (22996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:29:37 (23051): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:29:38 (23051): No heartbeat from core client for 30 sec - exiting 16:29:39 (23051): No heartbeat from core client for 30 sec - exiting 16:32:39 (23079): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:10:49 (25722): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:16:18 (26889): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:33:38 (26908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:33:39 (26908): No heartbeat from core client for 30 sec - exiting 03:33:41 (26908): No heartbeat from core client for 30 sec - exiting 03:33:42 (26908): No heartbeat from core client for 30 sec - exiting 04:14:33 (27193): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:16:51 (27307): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:20:09 (27317): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:25:57 (27335): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:25:58 (27335): No heartbeat from core client for 30 sec - exiting 04:25:59 (27335): No heartbeat from core client for 30 sec - exiting 04:26:00 (27335): No heartbeat from core client for 30 sec - exiting 04:26:01 (27335): No heartbeat from core client for 30 sec - exiting 04:27:09 (27352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:27:10 (27352): No heartbeat from core client for 30 sec - exiting 04:27:11 (27352): No heartbeat from core client for 30 sec - exiting 04:44:16 (27365): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:47:46 (27413): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:52:16 (27431): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:52:17 (27431): No heartbeat from core client for 30 sec - exiting 04:52:18 (27431): No heartbeat from core client for 30 sec - exiting 04:57:04 (27449): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:57:06 (27449): No heartbeat from core client for 30 sec - exiting 05:17:09 (27471): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:33:18 (27524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:48:58 (27580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:52:58 (27632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:00:54 (27650): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:06:38 (27679): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:20:17 (27696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:22:35 (27739): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:22:36 (27739): No heartbeat from core client for 30 sec - exiting 06:22:37 (27739): No heartbeat from core client for 30 sec - exiting 06:23:15 (27744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:01:56 (27750): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:11:35 (27878): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:23:37 (27905): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:38:03 (27946): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:38:04 (27946): No heartbeat from core client for 30 sec - exiting 07:38:05 (27946): No heartbeat from core client for 30 sec - exiting 07:38:06 (27946): No heartbeat from core client for 30 sec - exiting 07:44:08 (27992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:44:09 (27992): No heartbeat from core client for 30 sec - exiting 07:44:10 (27992): No heartbeat from core client for 30 sec - exiting 07:44:11 (27992): No heartbeat from core client for 30 sec - exiting 07:44:12 (27992): No heartbeat from core client for 30 sec - exiting 07:44:50 (28015): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:51:24 (28022): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:14:32 (28048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:36:24 (28116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:03:07 (28187): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:03:08 (28187): No heartbeat from core client for 30 sec - exiting 09:13:15 (28267): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:14:03 (28303): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:23:30 (28307): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:24:09 (28344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:25:12 (28348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:36:02 (28358): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:50:46 (28407): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... hadcm3n_6.07_i686-apple-darwin(33837,0xace3c2c0) malloc: * error for object 0x29e7404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33837,0xace3c2c0) malloc: * error for object 0x29e8200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Fri Apr 12 18:53:44 2013 hadcm3n_6.07_i686-apple-darwin(34541,0xace3c2c0) malloc: * error for object 0x1128c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34541,0xace3c2c0) malloc: * error for object 0x1128c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34541,0xace3c2c0) malloc: * error for object 0x20ed404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34541,0xace3c2c0) malloc: * error for object 0x20ed400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34541,0xace3c2c0) malloc: * error for object 0x20eca04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34541,0xace3c2c0) malloc: * error for object 0x20eca00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(34541,0xace3c2c0) malloc: * error for object 0x20eca04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation 02:55:35 (34541): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(4606,0xace3c2c0) malloc: * error for object 0x297fc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Sun Apr 28 04:02:23 2013 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fd88 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/1/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x911c6000 - 0x91228fff /usr/lib/libstdc++.6.dylib 0x9239c000 - 0x923a4fff /usr/lib/system/libunwind.dylib 0x934c0000 - 0x934cefff /usr/lib/system/libdispatch.dylib 0x95620000 - 0x95627fff /usr/lib/system/libsystem_notify.dylib 0x96462000 - 0x96465fff /usr/lib/system/libmathCommon.A.dylib 0x965a4000 - 0x965abfff /usr/lib/system/libsystem_dnssd.dylib 0x9682c000 - 0x9682dfff /usr/lib/system/libsystem_sandbox.dylib 0x9683a000 - 0x9683dfff /usr/lib/system/libcompiler_rt.dylib 0x96b77000 - 0x96b85fff /usr/lib/libz.1.dylib 0x97625000 - 0x97643fff /usr/lib/system/libsystem_kernel.dylib 0x979e4000 - 0x97a13fff /usr/lib/system/libsystem_info.dylib 0x97a14000 - 0x97a15fff /usr/lib/system/libunc.dylib 0x97e6b000 - 0x97eaefff /usr/lib/system/libcommonCrypto.dylib 0x9848b000 - 0x984b9fff /usr/lib/libSystem.B.dylib 0x984ba000 - 0x984c2fff /usr/lib/system/libcopyfile.dylib 0x984c3000 - 0x9858efff /usr/lib/system/libsystem_c.dylib 0x988a8000 - 0x988acfff /usr/lib/system/libcache.dylib 0x98b47000 - 0x98b48fff /usr/lib/system/libquarantine.dylib 0x98cfe000 - 0x98cfefff /usr/lib/system/libdnsinfo.dylib 0x997d5000 - 0x997dafff /usr/lib/system/libmacho.dylib 0x9a1e3000 - 0x9a1e3fff /usr/lib/system/libkeymgr.dylib 0x9a1e4000 - 0x9a1e8fff /usr/lib/system/libsystem_network.dylib 0x9a2fb000 - 0x9a303fff /usr/lib/system/liblaunch.dylib 0x9b337000 - 0x9b338fff /usr/lib/system/libremovefile.dylib 0x9c05e000 - 0x9c074fff /usr/lib/system/libxpc.dylib 0x9c41c000 - 0x9c41efff /usr/lib/system/libdyld.dylib 0x9c421000 - 0x9c42afff /usr/lib/libc++abi.dylib 0x9cee1000 - 0x9cee2fff /usr/lib/system/libsystem_blocks.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Apr 2013 17:37:29	1242102	15699956	hadcm3n_zdcl_1920_40_008316602_2	259,200	218,149	0.8416
11 Apr 2013 08:44:01	1242102	15699956	hadcm3n_zdcl_1920_40_008316602_2	233,280	198,257	0.8499
10 Apr 2013 22:20:34	1242102	15699956	hadcm3n_zdcl_1920_40_008316602_2	207,360	177,889	0.8579
10 Apr 2013 15:00:30	1242102	15699956	hadcm3n_zdcl_1920_40_008316602_2	181,440	155,792	0.8586
10 Apr 2013 08:07:58	1242102	15699956	hadcm3n_zdcl_1920_40_008316602_2	155,520	134,930	0.8676
09 Apr 2013 21:23:33	1242102	15699956	hadcm3n_zdcl_1920_40_008316602_2	129,600	114,372	0.8825
07 Apr 2013 21:27:41	1242102	15699956	hadcm3n_zdcl_1920_40_008316602_2	103,680	91,841	0.8858
07 Apr 2013 09:58:17	1242102	15699956	hadcm3n_zdcl_1920_40_008316602_2	77,760	69,035	0.8878
04 Apr 2013 07:55:20	1242102	15699956	hadcm3n_zdcl_1920_40_008316602_2	51,840	45,924	0.8859
03 Apr 2013 04:48:56	1242102	15699956	hadcm3n_zdcl_1920_40_008316602_2	25,920	23,137	0.8926