Task 19588982

Name	hadcm3n_sd5x_198012_480_010222035_2
Workunit	10222035
Created	8 May 2016, 21:54:07 UTC
Sent	8 May 2016, 21:55:25 UTC
Report deadline	21 Apr 2017, 3:15:25 UTC
Received	18 May 2016, 4:23:47 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1043583
Run time	7 days 10 hours 23 min 3 sec
CPU time	6 days 21 hours 32 min 21 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.74 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.12</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:17:30 (69789): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 05:45:02 (72168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:55:18 (81045): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:55:20 (81045): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:08:05 (82105): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:00:50 (83442): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:01:59 (84250): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:03:01 (84676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:03:55 (85090): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:03:23 (85512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:03:28 (85512): No heartbeat from core client for 30 sec - exiting 16:03:29 (85512): No heartbeat from core client for 30 sec - exiting 16:03:30 (85512): No heartbeat from core client for 30 sec - exiting 16:03:31 (85512): No heartbeat from core client for 30 sec - exiting 18:02:40 (86858): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:02:41 (86858): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 18:17:06 (87724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:02:52 (87818): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:03:14 (90133): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:21:20 (90170): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:46:48 (99459): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:13:21 (523): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:04:48 (15068): No heartbeat from core client for 30 sec - exiting 06:04:49 (15068): No heartbeat from core client for 30 sec - exiting 06:04:50 (15068): No heartbeat from core client for 30 sec - exiting 06:04:51 (15068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 21:28:40 (22123): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:28:41 (22123): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 02:31:51 (23910): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:32:05 (28919): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:32:06 (28919): No heartbeat from core client for 30 sec - exiting 13:32:07 (28919): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 15:33:34 (29434): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:33:35 (29434): No heartbeat from core client for 30 sec - exiting 15:33:36 (29434): No heartbeat from core client for 30 sec - exiting 15:33:37 (29434): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 18:36:55 (30574): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:37:29 (31296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:37:34 (33664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:37:36 (33664): No heartbeat from core client for 30 sec - exiting 01:37:37 (33664): No heartbeat from core client for 30 sec - exiting 01:37:38 (33664): No heartbeat from core client for 30 sec - exiting 01:37:39 (33664): No heartbeat from core client for 30 sec - exiting 01:37:40 (33664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 06:39:25 (35760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:39:26 (35760): No heartbeat from core client for 30 sec - exiting 06:43:09 (36172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:38:14 (36186): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:43:18 (36574): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:38:24 (36987): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:38:25 (36987): No heartbeat from core client for 30 sec - exiting 09:43:24 (37355): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:43:25 (37355): No heartbeat from core client for 30 sec - exiting 09:43:26 (37355): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:31:15 (41206): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:48:08 (41620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:50:49 (45316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:50:50 (45316): No heartbeat from core client for 30 sec - exiting 08:50:51 (45316): No heartbeat from core client for 30 sec - exiting 08:50:53 (45316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:56:18 (50545): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:57:53 (56323): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:57:57 (56979): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:58:01 (57371): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:58:03 (57371): No heartbeat from core client for 30 sec - exiting 09:58:05 (57371): No heartbeat from core client for 30 sec - exiting 09:58:06 (57371): No heartbeat from core client for 30 sec - exiting 09:58:07 (57371): No heartbeat from core client for 30 sec - exiting 09:58:08 (57371): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:46:07 (57791): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:23:12 (61179): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... hadcm3n_6.07_i686-apple-darwin(61453,0xa3cd6000) malloc: * error for object 0x4804e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61453,0xa3cd6000) malloc: * error for object 0x4804e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61453,0xa3cd6000) malloc: * error for object 0x1026e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61453,0xa3cd6000) malloc: * error for object 0x1026e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61453,0xa3cd6000) malloc: * error for object 0x1026e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61453,0xa3cd6000) malloc: * error for object 0x1026e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61453,0xa3cd6000) malloc: * error for object 0x3006604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61453,0xa3cd6000) malloc: * error for object 0x3006600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61453,0xa3cd6000) malloc: * error for object 0x3006604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61453,0xa3cd6000) malloc: * error for object 0x3006600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61453,0xa3cd6000) malloc: * error for object 0x383f204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.4 build 15E65 Tue May 17 20:22:42 2016 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fa78 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/5/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x127000 - 0x17afff /usr/lib/libstdc++.6.dylib 0x91a6e000 - 0x91a8ffff /usr/lib/system/libsystem_kernel.dylib 0x93a20000 - 0x93a43fff /usr/lib/libc++abi.dylib 0x93a44000 - 0x93a44fff /usr/lib/system/libkeymgr.dylib 0x93a45000 - 0x93aacfff /usr/lib/system/libcorecrypto.dylib 0x93aad000 - 0x93ad7fff /usr/lib/system/libsystem_info.dylib 0x93b83000 - 0x93b85fff /usr/lib/system/libsystem_configuration.dylib 0x9456c000 - 0x94571fff /usr/lib/system/libmacho.dylib 0x94887000 - 0x94890fff /usr/lib/system/libcopyfile.dylib 0x95235000 - 0x9524efff /usr/lib/system/libsystem_asl.dylib 0x9524f000 - 0x95260fff /usr/lib/system/libsystem_trace.dylib 0x953cc000 - 0x953d7fff /usr/lib/system/libcommonCrypto.dylib 0x95841000 - 0x95849fff /usr/lib/system/libsystem_dnssd.dylib 0x968bb000 - 0x968c9fff /usr/lib/libz.1.dylib 0x97004000 - 0x9702cfff /usr/lib/system/libxpc.dylib 0x970e6000 - 0x970fdfff /usr/lib/system/libsystem_coretls.dylib 0x97d4d000 - 0x97d4efff /usr/lib/libSystem.B.dylib 0x97f30000 - 0x97f35fff /usr/lib/system/libcompiler_rt.dylib 0x9819c000 - 0x981b5fff /usr/lib/system/libsystem_malloc.dylib 0x98a84000 - 0x98a87fff /usr/lib/system/libsystem_sandbox.dylib 0x999d9000 - 0x999dbfff /usr/lib/system/libsystem_secinit.dylib 0x99a40000 - 0x99a48fff /usr/lib/system/libsystem_pthread.dylib 0x99d71000 - 0x99d74fff /usr/lib/system/libdyld.dylib 0x99f18000 - 0x99f1afff /usr/lib/system/libquarantine.dylib 0x9af4e000 - 0x9af57fff /usr/lib/system/libsystem_networkextension.dylib 0x9b83a000 - 0x9b83afff /usr/lib/system/liblaunch.dylib 0x9bdbf000 - 0x9bdbffff /usr/lib/system/libsystem_blocks.dylib 0x9c702000 - 0x9c797fff /usr/lib/system/libsystem_c.dylib 0x9cb7e000 - 0x9cb7efff /usr/lib/system/libunc.dylib 0x9cc80000 - 0x9ccaafff /usr/lib/system/libdispatch.dylib 0x9ce62000 - 0x9ce66fff /usr/lib/system/libcache.dylib 0x9cfd1000 - 0x9cfd2fff /usr/lib/system/libremovefile.dylib 0x9d193000 - 0x9d201fff /usr/lib/system/libsystem_network.dylib 0x9d2a8000 - 0x9d2b2fff /usr/lib/system/libsystem_notify.dylib 0x9d3ae000 - 0x9d3b4fff /usr/lib/system/libsystem_platform.dylib 0x9d7f9000 - 0x9d7fbfff /usr/lib/system/libsystem_coreservices.dylib 0x9e617000 - 0x9e64afff /usr/lib/system/libsystem_m.dylib 0x9e672000 - 0x9e678fff /usr/lib/system/libunwind.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 May 2016 03:31:25	1043583	19588982	hadcm3n_sd5x_198012_480_010222035_2	518,400	595,936	1.1496
17 May 2016 17:22:00	1043583	19588982	hadcm3n_sd5x_198012_480_010222035_2	492,480	565,138	1.1475
17 May 2016 06:14:03	1043583	19588982	hadcm3n_sd5x_198012_480_010222035_2	466,560	536,023	1.1489
16 May 2016 21:03:43	1043583	19588982	hadcm3n_sd5x_198012_480_010222035_2	440,640	506,129	1.1486
16 May 2016 11:47:38	1043583	19588982	hadcm3n_sd5x_198012_480_010222035_2	414,720	477,399	1.1511
16 May 2016 00:08:55	1043583	19588982	hadcm3n_sd5x_198012_480_010222035_2	388,800	447,382	1.1507
15 May 2016 14:00:59	1043583	19588982	hadcm3n_sd5x_198012_480_010222035_2	362,880	416,362	1.1474
15 May 2016 04:23:19	1043583	19588982	hadcm3n_sd5x_198012_480_010222035_2	336,960	386,382	1.1467
14 May 2016 18:44:57	1043583	19588982	hadcm3n_sd5x_198012_480_010222035_2	311,040	356,848	1.1473
14 May 2016 04:52:09	1043583	19588982	hadcm3n_sd5x_198012_480_010222035_2	285,120	327,141	1.1474
13 May 2016 13:12:07	1043583	19588982	hadcm3n_sd5x_198012_480_010222035_2	259,200	294,428	1.1359
13 May 2016 02:19:22	1043583	19588982	hadcm3n_sd5x_198012_480_010222035_2	233,280	265,660	1.1388
12 May 2016 16:51:25	1043583	19588982	hadcm3n_sd5x_198012_480_010222035_2	207,360	235,766	1.1370
12 May 2016 08:07:12	1043583	19588982	hadcm3n_sd5x_198012_480_010222035_2	181,440	207,255	1.1423
11 May 2016 21:42:27	1043583	19588982	hadcm3n_sd5x_198012_480_010222035_2	155,520	176,544	1.1352
11 May 2016 12:47:32	1043583	19588982	hadcm3n_sd5x_198012_480_010222035_2	129,600	146,982	1.1341
11 May 2016 03:13:28	1043583	19588982	hadcm3n_sd5x_198012_480_010222035_2	103,680	117,640	1.1346
10 May 2016 17:44:54	1043583	19588982	hadcm3n_sd5x_198012_480_010222035_2	77,760	87,146	1.1207
10 May 2016 08:19:25	1043583	19588982	hadcm3n_sd5x_198012_480_010222035_2	51,840	58,201	1.1227
09 May 2016 10:38:28	1043583	19588982	hadcm3n_sd5x_198012_480_010222035_2	25,920	29,270	1.1292