Task 19419966

Name	hadcm3n_sakj_198012_480_375_010414311_0
Workunit	10414311
Created	21 Mar 2016, 16:35:34 UTC
Sent	21 Mar 2016, 16:51:54 UTC
Report deadline	3 Mar 2017, 22:11:54 UTC
Received	24 May 2016, 17:24:05 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1356098
Run time	10 days 15 hours 28 min 11 sec
CPU time	9 days 22 hours 4 min 16 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	4.46 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/sakjko.pjj9c10 is not a valid UM file. Error converting file to netcdf: dataout/sakjko.pjj9c10 Error: Input file: dataout/sakjko.pij9c10 is not a valid UM file. Error converting file to netcdf: dataout/sakjko.pij9c10 Error: Input file: dataout/sakjko.pfj9c10 is not a valid UM file. Error converting file to netcdf: dataout/sakjko.pfj9c10 Error: Input file: dataout/sakjka.phj9c10 is not a valid UM file. Error converting file to netcdf: dataout/sakjka.phj9c10 Error: Input file: dataout/sakjka.pgj9c10 is not a valid UM file. Error converting file to netcdf: dataout/sakjka.pgj9c10 Error: Input file: dataout/sakjka.pej9c10 is not a valid UM file. Error converting file to netcdf: dataout/sakjka.pej9c10 Error: Input file: dataout/sakjka.pdj9c10 is not a valid UM file. Error converting file to netcdf: dataout/sakjka.pdj9c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(276,0xa0fdb1d4) malloc: * error for object 0x302fc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(276,0xa0fdb1d4) malloc: * error for object 0x302fc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(276,0xa0fdb1d4) malloc: * error for object 0x4021204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(276,0xa0fdb1d4) malloc: * error for object 0x4021200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(276,0xa0fdb1d4) malloc: * error for object 0x4004e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.10.5 build 14F27 Tue May 17 11:39:02 2016 hadcm3n_6.07_i686-apple-darwin(65369,0xa0fdb1d4) malloc: * error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(65369,0xa0fdb1d4) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(65369,0xa0fdb1d4) malloc: * error for object 0x3802004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(65369,0xa0fdb1d4) malloc: * error for object 0x809e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15848,0xa0fdb1d4) malloc: * error for object 0x4811e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15848,0xa0fdb1d4) malloc: * error for object 0x4811e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15848,0xa0fdb1d4) malloc: * error for object 0x3000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(31670,0xa0fdb1d4) malloc: * error for object 0x382de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31670,0xa0fdb1d4) malloc: * error for object 0x382de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31670,0xa0fdb1d4) malloc: * error for object 0x3002004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31670,0xa0fdb1d4) malloc: * error for object 0x3002000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(31670,0xa0fdb1d4) malloc: * error for object 0x3002004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(83254,0xa0fdb1d4) malloc: * error for object 0x1014e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(83254,0xa0fdb1d4) malloc: * error for object 0x1015c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(83254,0xa0fdb1d4) malloc: * error for object 0x1015c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(83254,0xa0fdb1d4) malloc: * error for object 0x803004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(29540,0xa0fdb1d4) malloc: * error for object 0x3011e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29540,0xa0fdb1d4) malloc: * error for object 0x3011e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(29540,0xa0fdb1d4) malloc: * error for object 0x1012404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(29540,0xa0fdb1d4) malloc: * error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.10.5 build 14F27 hadcm3n_6.07_i686-apple-darwin(50104,0xa0fdb1d4) malloc: * error for object 0x3800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(50104,0xa0fdb1d4) malloc: * error for object 0x3800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(50104,0xa0fdb1d4) malloc: * error for object 0x4801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(64827,0xa0fdb1d4) malloc: * error for object 0x3805e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(64827,0xa0fdb1d4) malloc: * error for object 0x3805e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(64827,0xa0fdb1d4) malloc: * error for object 0x80a404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(64827,0xa0fdb1d4) malloc: * error for object 0x80a400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(64827,0xa0fdb1d4) malloc: * error for object 0x80a404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.10.5 build 14F27 Tue May 24 10:22:19 2016 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fdc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/3/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x9060b000 - 0x9060cfff /usr/lib/system/libsystem_blocks.dylib 0x90e55000 - 0x90ea8fff /usr/lib/libstdc++.6.dylib 0x9112f000 - 0x9112ffff /usr/lib/system/liblaunch.dylib 0x91ba7000 - 0x91ba9fff /usr/lib/system/libsystem_secinit.dylib 0x92229000 - 0x9222bfff /usr/lib/system/libquarantine.dylib 0x92d7c000 - 0x92d7cfff /usr/lib/system/libkeymgr.dylib 0x92d7d000 - 0x92d82fff /usr/lib/system/libcompiler_rt.dylib 0x93e5b000 - 0x93e5dfff /usr/lib/system/libsystem_configuration.dylib 0x93e67000 - 0x93e80fff /usr/lib/system/libsystem_malloc.dylib 0x94c4e000 - 0x94c65fff /usr/lib/system/libsystem_asl.dylib 0x95c45000 - 0x95c51fff /usr/lib/system/libcommonCrypto.dylib 0x95f2b000 - 0x95f31fff /usr/lib/system/libsystem_platform.dylib 0x95fa9000 - 0x95fb2fff /usr/lib/system/libsystem_notify.dylib 0x96441000 - 0x9644afff /usr/lib/system/libcopyfile.dylib 0x966c2000 - 0x966e8fff /usr/lib/system/libxpc.dylib 0x966e9000 - 0x966ecfff /usr/lib/system/libdyld.dylib 0x96ee8000 - 0x96f7dfff /usr/lib/system/libsystem_c.dylib 0x97599000 - 0x9759ffff /usr/lib/system/libsystem_trace.dylib 0x975a0000 - 0x975a2fff /usr/lib/system/libsystem_sandbox.dylib 0x975a6000 - 0x975a6fff /usr/lib/system/libunc.dylib 0x9763e000 - 0x97644fff /usr/lib/system/libsystem_networkextension.dylib 0x976ab000 - 0x976defff /usr/lib/system/libsystem_m.dylib 0x98b5a000 - 0x98b6bfff /usr/lib/system/libsystem_coretls.dylib 0x98c32000 - 0x98c39fff /usr/lib/system/libunwind.dylib 0x98d30000 - 0x98d31fff /usr/lib/libSystem.B.dylib 0x98d3b000 - 0x98d78fff /usr/lib/system/libsystem_network.dylib 0x99e0c000 - 0x99e14fff /usr/lib/system/libsystem_dnssd.dylib 0x9a112000 - 0x9a120fff /usr/lib/libz.1.dylib 0x9a121000 - 0x9a122fff /usr/lib/system/libremovefile.dylib 0x9a334000 - 0x9a336fff /usr/lib/system/libsystem_coreservices.dylib 0x9a337000 - 0x9a33ffff /usr/lib/system/libsystem_pthread.dylib 0x9a7e5000 - 0x9a80bfff /usr/lib/libc++abi.dylib 0x9ad07000 - 0x9ad26fff /usr/lib/system/libsystem_kernel.dylib 0x9add0000 - 0x9ae3cfff /usr/lib/system/libcorecrypto.dylib 0x9b3df000 - 0x9b406fff /usr/lib/system/libdispatch.dylib 0x9b407000 - 0x9b40cfff /usr/lib/system/libmacho.dylib 0x9bf17000 - 0x9bf40fff /usr/lib/system/libsystem_info.dylib 0x9bf41000 - 0x9bf45fff /usr/lib/system/libcache.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 May 2016 19:25:41	1356098	19419966	hadcm3n_sakj_198012_480_375_010414311_0	777,600	843,228	1.0844
12 May 2016 16:31:00	1356098	19419966	hadcm3n_sakj_198012_480_375_010414311_0	751,680	814,235	1.0832
11 May 2016 15:32:47	1356098	19419966	hadcm3n_sakj_198012_480_375_010414311_0	725,760	785,419	1.0822
03 May 2016 20:00:37	1356098	19419966	hadcm3n_sakj_198012_480_375_010414311_0	699,840	756,786	1.0814
02 May 2016 08:36:00	1356098	19419966	hadcm3n_sakj_198012_480_375_010414311_0	673,920	728,508	1.0810
27 Apr 2016 22:07:02	1356098	19419966	hadcm3n_sakj_198012_480_375_010414311_0	648,000	700,984	1.0818
27 Apr 2016 02:54:32	1356098	19419966	hadcm3n_sakj_198012_480_375_010414311_0	622,080	674,449	1.0842
25 Apr 2016 17:52:58	1356098	19419966	hadcm3n_sakj_198012_480_375_010414311_0	596,160	647,092	1.0854
24 Apr 2016 17:14:05	1356098	19419966	hadcm3n_sakj_198012_480_375_010414311_0	570,240	619,186	1.0858
22 Apr 2016 21:01:32	1356098	19419966	hadcm3n_sakj_198012_480_375_010414311_0	544,320	590,327	1.0845
21 Apr 2016 19:31:52	1356098	19419966	hadcm3n_sakj_198012_480_375_010414311_0	518,400	561,993	1.0841
19 Apr 2016 21:41:13	1356098	19419966	hadcm3n_sakj_198012_480_375_010414311_0	492,480	533,392	1.0831
19 Apr 2016 09:56:16	1356098	19419966	hadcm3n_sakj_198012_480_375_010414311_0	466,560	504,484	1.0813
15 Apr 2016 12:16:07	1356098	19419966	hadcm3n_sakj_198012_480_375_010414311_0	440,640	476,142	1.0806
15 Apr 2016 12:13:38	1356098	19419966	hadcm3n_sakj_198012_480_375_010414311_0	414,720	447,846	1.0799
15 Apr 2016 12:10:57	1356098	19419966	hadcm3n_sakj_198012_480_375_010414311_0	388,800	419,943	1.0801
15 Apr 2016 12:09:08	1356098	19419966	hadcm3n_sakj_198012_480_375_010414311_0	362,880	392,250	1.0809
15 Apr 2016 12:07:29	1356098	19419966	hadcm3n_sakj_198012_480_375_010414311_0	336,960	364,516	1.0818
11 Apr 2016 00:10:50	1356098	19419966	hadcm3n_sakj_198012_480_375_010414311_0	311,040	338,339	1.0878
07 Apr 2016 22:28:57	1356098	19419966	hadcm3n_sakj_198012_480_375_010414311_0	285,120	310,163	1.0878