Task 16648719

Name	hadcm3n_8e01_1980_40_008727564_2
Workunit	8873542
Created	25 May 2014, 22:41:29 UTC
Sent	25 May 2014, 22:41:34 UTC
Report deadline	25 Aug 2014, 6:08:45 UTC
Received	1 Jul 2014, 17:42:12 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1322748
Run time	17 days 21 hours 16 min 52 sec
CPU time	17 days 5 hours 49 min 53 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.83 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> 22:33:27 (17544): No heartbeat from core client for 30 sec - exiting 22:33:28 (17544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7064, selfPID=7064, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13228, selfPID=13228, iMonCtr=1 Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2752, selfPID=2752, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5236, selfPID=5236, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10116, selfPID=10116, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:49:03 (8796): No heartbeat from core client for 30 sec - exiting 07:49:05 (8796): No heartbeat from core client for 30 sec - exiting 07:49:06 (8796): No heartbeat from core client for 30 sec - exiting 07:49:07 (8796): No heartbeat from core client for 30 sec - exiting 07:49:08 (8796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=19532, selfPID=19532, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16072, selfPID=16072, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7504, selfPID=7504, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=19400, selfPID=19400, iMonCtr=1 00:52:08 (1216): No heartbeat from core client for 30 sec - exiting 00:52:09 (1216): No heartbeat from core client for 30 sec - exiting 00:52:10 (1216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=19092, selfPID=19092, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2672, selfPID=2672, iMonCtr=1 Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=19004, selfPID=19004, iMonCtr=1 NSuspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16100, selfPID=16100, iMonCtr=1 22:39:24 (1332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Skipping gmts_generator due to netcdf error 13 - Permission denied Suspended CPDN Monitor - Suspend request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5932, selfPID=5932, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:37:40 (21260): No heartbeat from core client for 30 sec - exiting 15:37:41 (21260): No heartbeat from core client for 30 sec - exiting 15:37:43 (21260): No heartbeat from core client for 30 sec - exiting 15:37:44 (21260): No heartbeat from core client for 30 sec - exiting 15:37:45 (21260): No heartbeat from core client for 30 sec - exiting 15:37:46 (21260): No heartbeat from core client for 30 sec - exiting 15:37:47 (21260): No heartbeat from core client for 30 sec - exiting 15:37:48 (21260): No heartbeat from core client for 30 sec - exiting 15:37:49 (21260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Skipping gmts_generator due to netcdf error 13 - Permission denied Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied 15:28:15 (11600): No heartbeat from core client for 30 sec - exiting 15:28:17 (11600): No heartbeat from core client for 30 sec - exiting 15:28:18 (11600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:14:06 (12636): No heartbeat from core client for 30 sec - exiting 11:14:13 (12636): No heartbeat from core client for 30 sec - exiting 11:14:14 (12636): No heartbeat from core client for 30 sec - exiting 11:14:54 (12636): No heartbeat from core client for 30 sec - exiting 11:14:55 (12636): No heartbeat from core client for 30 sec - exiting 11:14:56 (12636): No heartbeat from core client for 30 sec - exiting 11:14:57 (12636): No heartbeat from core client for 30 sec - exiting 11:14:58 (12636): No heartbeat from core client for 30 sec - exiting 11:14:59 (12636): No heartbeat from core client for 30 sec - exiting 11:15:00 (12636): No heartbeat from core client for 30 sec - exiting 11:15:01 (12636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:06:11 (6088): No heartbeat from core client for 30 sec - exiting 12:06:12 (6088): No heartbeat from core client for 30 sec - exiting 12:06:13 (6088): No heartbeat from core client for 30 sec - exiting 12:06:14 (6088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:49:57 (9716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:09:13 (6360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4076, selfPID=4076, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13588, selfPID=13588, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... 13:21:43 (10020): No heartbeat from core client for 30 sec - exiting 13:21:44 (10020): No heartbeat from core client for 30 sec - exiting 13:21:46 (10020): No heartbeat from core client for 30 sec - exiting 13:21:47 (10020): No heartbeat from core client for 30 sec - exiting 13:21:48 (10020): No heartbeat from core client for 30 sec - exiting 13:21:49 (10020): No heartbeat from core client for 30 sec - exiting 13:21:50 (10020): No heartbeat from core client for 30 sec - exiting 13:21:51 (10020): No heartbeat from core client for 30 sec - exiting 13:21:52 (10020): No heartbeat from core client for 30 sec - exiting 13:21:53 (10020): No heartbeat from core client for 30 sec - exiting 13:21:54 (10020): No heartbeat from core client for 30 sec - exiting 13:21:55 (10020): No heartbeat from core client for 30 sec - exiting 13:21:56 (10020): No heartbeat from core client for 30 sec - exiting 13:21:58 (10020): No heartbeat from core client for 30 sec - exiting 13:21:59 (10020): No heartbeat from core client for 30 sec - exiting 13:22:00 (10020): No heartbeat from core client for 30 sec - exiting 13:22:01 (10020): No heartbeat from core client for 30 sec - exiting 13:22:02 (10020): No heartbeat from core client for 30 sec - exiting 13:22:03 (10020): No heartbeat from core client for 30 sec - exiting 13:22:04 (10020): No heartbeat from core client for 30 sec - exiting 13:22:05 (10020): No heartbeat from core client for 30 sec - exiting 13:22:06 (10020): No heartbeat from core client for 30 sec - exiting 13:22:07 (10020): No heartbeat from core client for 30 sec - exiting 13:22:09 (10020): No heartbeat from core client for 30 sec - exiting 13:22:10 (10020): No heartbeat from core client for 30 sec - exiting 13:22:11 (10020): No heartbeat from core client for 30 sec - exiting 13:22:12 (10020): No heartbeat from core client for 30 sec - exiting 13:22:13 (10020): No heartbeat from core client for 30 sec - exiting 13:22:14 (10020): No heartbeat from core client for 30 sec - exiting 13:22:15 (10020): No heartbeat from core client for 30 sec - exiting 13:22:16 (10020): No heartbeat from core client for 30 sec - exiting 13:22:17 (10020): No heartbeat from core client for 30 sec - exiting 13:22:18 (10020): No heartbeat from core client for 30 sec - exiting 13:22:19 (10020): No heartbeat from core client for 30 sec - exiting 13:22:21 (10020): No heartbeat from core client for 30 sec - exiting 13:22:22 (10020): No heartbeat from core client for 30 sec - exiting 13:22:23 (10020): No heartbeat from core client for 30 sec - exiting 13:22:24 (10020): No heartbeat from core client for 30 sec - exiting 13:22:25 (10020): No heartbeat from core client for 30 sec - exiting 13:22:26 (10020): No heartbeat from core client for 30 sec - exiting 13:22:27 (10020): No heartbeat from core client for 30 sec - exiting 13:22:28 (10020): No heartbeat from core client for 30 sec - exiting 13:22:29 (10020): No heartbeat from core client for 30 sec - exiting 13:22:30 (10020): No heartbeat from core client for 30 sec - exiting 13:22:31 (10020): No heartbeat from core client for 30 sec - exiting 13:22:33 (10020): No heartbeat from core client for 30 sec - exiting 13:22:34 (10020): No heartbeat from core client for 30 sec - exiting 13:22:35 (10020): No heartbeat from core client for 30 sec - exiting 13:22:36 (10020): No heartbeat from core client for 30 sec - exiting 13:22:37 (10020): No heartbeat from core client for 30 sec - exiting 13:22:38 (10020): No heartbeat from core client for 30 sec - exiting 13:22:39 (10020): No heartbeat from core client for 30 sec - exiting 13:22:40 (10020): No heartbeat from core client for 30 sec - exiting 13:22:41 (10020): No heartbeat from core client for 30 sec - exiting 13:22:42 (10020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1536, selfPID=1536, iMonCtr=1 No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4164, selfPID=4164, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Jul 2014 16:43:00	1322748	16648719	hadcm3n_8e01_1980_40_008727564_2	1,036,800	1,489,347	1.4365
01 Jul 2014 07:51:07	1322748	16648719	hadcm3n_8e01_1980_40_008727564_2	1,010,880	1,462,471	1.4467
01 Jul 2014 07:51:07	1322748	16648719	hadcm3n_8e01_1980_40_008727564_2	984,960	1,428,580	1.4504
01 Jul 2014 07:51:07	1322748	16648719	hadcm3n_8e01_1980_40_008727564_2	959,040	1,392,818	1.4523
28 Jun 2014 05:48:49	1322748	16648719	hadcm3n_8e01_1980_40_008727564_2	933,120	1,355,766	1.4529
27 Jun 2014 09:18:00	1322748	16648719	hadcm3n_8e01_1980_40_008727564_2	907,200	1,324,091	1.4595
26 Jun 2014 11:45:26	1322748	16648719	hadcm3n_8e01_1980_40_008727564_2	881,280	1,286,325	1.4596
25 Jun 2014 08:57:27	1322748	16648719	hadcm3n_8e01_1980_40_008727564_2	855,360	1,240,680	1.4505
24 Jun 2014 08:32:24	1322748	16648719	hadcm3n_8e01_1980_40_008727564_2	829,440	1,196,831	1.4429
24 Jun 2014 04:31:42	1322748	16648719	hadcm3n_8e01_1980_40_008727564_2	803,520	1,156,897	1.4398
21 Jun 2014 05:25:01	1322748	16648719	hadcm3n_8e01_1980_40_008727564_2	777,600	1,113,904	1.4325
20 Jun 2014 03:30:30	1322748	16648719	hadcm3n_8e01_1980_40_008727564_2	751,680	1,069,419	1.4227
19 Jun 2014 04:35:39	1322748	16648719	hadcm3n_8e01_1980_40_008727564_2	725,760	1,026,372	1.4142
18 Jun 2014 07:09:02	1322748	16648719	hadcm3n_8e01_1980_40_008727564_2	699,840	982,755	1.4043
17 Jun 2014 12:56:29	1322748	16648719	hadcm3n_8e01_1980_40_008727564_2	673,920	946,123	1.4039
17 Jun 2014 06:35:42	1322748	16648719	hadcm3n_8e01_1980_40_008727564_2	648,000	924,646	1.4269
17 Jun 2014 00:14:52	1322748	16648719	hadcm3n_8e01_1980_40_008727564_2	622,080	903,208	1.4519
16 Jun 2014 18:49:21	1322748	16648719	hadcm3n_8e01_1980_40_008727564_2	596,160	880,829	1.4775
16 Jun 2014 11:48:39	1322748	16648719	hadcm3n_8e01_1980_40_008727564_2	570,240	857,056	1.5030
15 Jun 2014 19:17:09	1322748	16648719	hadcm3n_8e01_1980_40_008727564_2	544,320	832,855	1.5301