Task 19132159

Name	hadcm3n_xasb_198012_480_010221136_0
Workunit	10221136
Created	4 Dec 2015, 15:05:00 UTC
Sent	4 Dec 2015, 15:14:22 UTC
Report deadline	15 Nov 2016, 20:34:22 UTC
Received	30 Jan 2016, 15:15:15 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1381327
Run time	13 days 8 hours 38 min 11 sec
CPU time	12 days 10 hours 2 min 21 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	4.60 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.12</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(36692,0xa0b1b1d4) malloc: * error for object 0x280a604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36692,0xa0b1b1d4) malloc: * error for object 0x280a600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36692,0xa0b1b1d4) malloc: * error for object 0x280a604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36692,0xa0b1b1d4) malloc: * error for object 0x280a600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36692,0xa0b1b1d4) malloc: * error for object 0x280a604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36692,0xa0b1b1d4) malloc: * error for object 0x280a600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36692,0xa0b1b1d4) malloc: * error for object 0x280a604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36692,0xa0b1b1d4) malloc: * error for object 0x280a600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(36692,0xa0b1b1d4) malloc: * error for object 0x280a604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(40141,0xa0b1b1d4) malloc: * error for object 0x3001c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(40141,0xa0b1b1d4) malloc: * error for object 0x3001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(40141,0xa0b1b1d4) malloc: * error for object 0x2009e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(40141,0xa0b1b1d4) malloc: * error for object 0x2009e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(40141,0xa0b1b1d4) malloc: * error for object 0x2009e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(40141,0xa0b1b1d4) malloc: * error for object 0x2009e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(40141,0xa0b1b1d4) malloc: * error for object 0x2009e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(40141,0xa0b1b1d4) malloc: * error for object 0x2009e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(40141,0xa0b1b1d4) malloc: * error for object 0x2009e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(40141,0xa0b1b1d4) malloc: * error for object 0x2009e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(40141,0xa0b1b1d4) malloc: * error for object 0x2009e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) hadcm3n_6.07_i686-apple-darwin(46655,0xa0b1b1d4) malloc: * error for object 0x3005e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(46655,0xa0b1b1d4) malloc: * error for object 0x3005e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(46655,0xa0b1b1d4) malloc: * error for object 0x4800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(46655,0xa0b1b1d4) malloc: * error for object 0x4800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(46655,0xa0b1b1d4) malloc: * error for object 0x4800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(46655,0xa0b1b1d4) malloc: * error for object 0x4800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(46655,0xa0b1b1d4) malloc: * error for object 0x4800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(46655,0xa0b1b1d4) malloc: * error for object 0x4800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(46655,0xa0b1b1d4) malloc: * error for object 0x4800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(46655,0xa0b1b1d4) malloc: * error for object 0x4800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(46655,0xa0b1b1d4) malloc: * error for object 0x4800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.10.5 build 14F1605 Sat Jan 30 08:23:48 2016 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fd98 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/9/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x9023e000 - 0x90267fff /usr/lib/system/libsystem_info.dylib 0x902c9000 - 0x902d2fff /usr/lib/system/libcopyfile.dylib 0x9081e000 - 0x90820fff /usr/lib/system/libsystem_configuration.dylib 0x90821000 - 0x9085efff /usr/lib/system/libsystem_network.dylib 0x9085f000 - 0x908b2fff /usr/lib/libstdc++.6.dylib 0x90931000 - 0x90939fff /usr/lib/system/libsystem_dnssd.dylib 0x90f2a000 - 0x90f30fff /usr/lib/system/libsystem_networkextension.dylib 0x91516000 - 0x9151cfff /usr/lib/system/libsystem_trace.dylib 0x91cb6000 - 0x91ccdfff /usr/lib/system/libsystem_asl.dylib 0x922ef000 - 0x922effff /usr/lib/system/liblaunch.dylib 0x9231f000 - 0x92345fff /usr/lib/system/libxpc.dylib 0x927bd000 - 0x927befff /usr/lib/system/libremovefile.dylib 0x927bf000 - 0x927c4fff /usr/lib/system/libcompiler_rt.dylib 0x93120000 - 0x93120fff /usr/lib/system/libkeymgr.dylib 0x93121000 - 0x931b6fff /usr/lib/system/libsystem_c.dylib 0x93c48000 - 0x93c6ffff /usr/lib/system/libdispatch.dylib 0x93cb1000 - 0x93cb5fff /usr/lib/system/libcache.dylib 0x9438a000 - 0x94393fff /usr/lib/system/libsystem_notify.dylib 0x94394000 - 0x94394fff /usr/lib/system/libunc.dylib 0x95465000 - 0x9547efff /usr/lib/system/libsystem_malloc.dylib 0x9547f000 - 0x95480fff /usr/lib/system/libsystem_blocks.dylib 0x957d1000 - 0x957d2fff /usr/lib/libSystem.B.dylib 0x96851000 - 0x96854fff /usr/lib/system/libdyld.dylib 0x96d01000 - 0x96d09fff /usr/lib/system/libsystem_pthread.dylib 0x97d70000 - 0x97d8ffff /usr/lib/system/libsystem_kernel.dylib 0x98e08000 - 0x98e0efff /usr/lib/system/libsystem_platform.dylib 0x9923d000 - 0x9923ffff /usr/lib/system/libsystem_sandbox.dylib 0x99555000 - 0x99563fff /usr/lib/libz.1.dylib 0x99564000 - 0x99575fff /usr/lib/system/libsystem_coretls.dylib 0x998d8000 - 0x998ddfff /usr/lib/system/libmacho.dylib 0x9b20d000 - 0x9b240fff /usr/lib/system/libsystem_m.dylib 0x9b3b1000 - 0x9b3b8fff /usr/lib/system/libunwind.dylib 0x9b6e4000 - 0x9b750fff /usr/lib/system/libcorecrypto.dylib 0x9b7f5000 - 0x9b7f7fff /usr/lib/system/libquarantine.dylib 0x9b7f8000 - 0x9b7fafff /usr/lib/system/libsystem_secinit.dylib 0x9b9d2000 - 0x9b9defff /usr/lib/system/libcommonCrypto.dylib 0x9b9e0000 - 0x9ba06fff /usr/lib/libc++abi.dylib 0x9c497000 - 0x9c499fff /usr/lib/system/libsystem_coreservices.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Jan 2016 23:23:21	1381327	19132159	hadcm3n_xasb_198012_480_010221136_0	1,036,800	1,072,511	1.0344
28 Jan 2016 23:57:49	1381327	19132159	hadcm3n_xasb_198012_480_010221136_0	1,010,880	1,045,000	1.0338
28 Jan 2016 15:21:11	1381327	19132159	hadcm3n_xasb_198012_480_010221136_0	984,960	1,017,480	1.0330
28 Jan 2016 01:59:51	1381327	19132159	hadcm3n_xasb_198012_480_010221136_0	959,040	991,207	1.0335
27 Jan 2016 18:22:43	1381327	19132159	hadcm3n_xasb_198012_480_010221136_0	933,120	965,483	1.0347
25 Jan 2016 07:43:49	1381327	19132159	hadcm3n_xasb_198012_480_010221136_0	907,200	938,577	1.0346
24 Jan 2016 17:40:34	1381327	19132159	hadcm3n_xasb_198012_480_010221136_0	881,280	911,872	1.0347
23 Jan 2016 14:52:51	1381327	19132159	hadcm3n_xasb_198012_480_010221136_0	855,360	883,714	1.0331
21 Jan 2016 06:29:09	1381327	19132159	hadcm3n_xasb_198012_480_010221136_0	829,440	856,043	1.0321
19 Jan 2016 04:18:49	1381327	19132159	hadcm3n_xasb_198012_480_010221136_0	803,520	830,771	1.0339
18 Jan 2016 13:22:41	1381327	19132159	hadcm3n_xasb_198012_480_010221136_0	777,600	807,107	1.0379
18 Jan 2016 02:03:27	1381327	19132159	hadcm3n_xasb_198012_480_010221136_0	751,680	784,438	1.0436
17 Jan 2016 18:31:50	1381327	19132159	hadcm3n_xasb_198012_480_010221136_0	725,760	759,919	1.0471
20 Dec 2015 01:10:07	1381327	19132159	hadcm3n_xasb_198012_480_010221136_0	699,840	734,144	1.0490
19 Dec 2015 17:43:46	1381327	19132159	hadcm3n_xasb_198012_480_010221136_0	673,920	708,118	1.0507
19 Dec 2015 00:45:54	1381327	19132159	hadcm3n_xasb_198012_480_010221136_0	648,000	681,683	1.0520
18 Dec 2015 17:29:45	1381327	19132159	hadcm3n_xasb_198012_480_010221136_0	622,080	656,315	1.0550
18 Dec 2015 05:36:34	1381327	19132159	hadcm3n_xasb_198012_480_010221136_0	596,160	631,033	1.0585
17 Dec 2015 22:23:04	1381327	19132159	hadcm3n_xasb_198012_480_010221136_0	570,240	605,630	1.0621
17 Dec 2015 15:11:42	1381327	19132159	hadcm3n_xasb_198012_480_010221136_0	544,320	580,389	1.0663