Task 15814491

Name	hadcm3n_o16e_1940_40_008382887_0
Workunit	8533746
Created	1 Jun 2013, 6:27:25 UTC
Sent	2 Jun 2013, 10:02:36 UTC
Report deadline	1 Sep 2013, 17:29:47 UTC
Received	1 Sep 2013, 8:28:53 UTC
Server state	Over
Outcome	Computation error
Client state	Aborted by user
Exit status	203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID	1271993
Run time	13 days 15 hours 34 min 15 sec
CPU time	11 days 15 hours 43 min 28 sec
Validate state	Invalid
Credit	3,732.48
Device peak FLOPS	1.37 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6320, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4672, iMonCtr=1 Model crash detected, will try to restart... 03:45:53 (4916): No heartbeat from core client for 30 sec - exiting 03:45:54 (4916): No heartbeat from core client for 30 sec - exiting 03:45:55 (4916): No heartbeat from core client for 30 sec - exiting 03:45:56 (4916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:13:44 (4608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:13:45 (4608): No heartbeat from core client for 30 sec - exiting 09:13:46 (4608): No heartbeat from core client for 30 sec - exiting 09:13:47 (4608): No heartbeat from core client for 30 sec - exiting 09:13:48 (4608): No heartbeat from core client for 30 sec - exiting 09:13:49 (4608): No heartbeat from core client for 30 sec - exiting 09:13:50 (4608): No heartbeat from core client for 30 sec - exiting 09:13:51 (4608): No heartbeat from core client for 30 sec - exiting 09:13:52 (4608): No heartbeat from core client for 30 sec - exiting 09:13:53 (4608): No heartbeat from core client for 30 sec - exiting 09:13:54 (4608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:08:47 (6512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:12:15 (4768): No heartbeat from core client for 30 sec - exiting 21:12:16 (4768): No heartbeat from core client for 30 sec - exiting 21:12:17 (4768): No heartbeat from core client for 30 sec - exiting 21:12:18 (4768): No heartbeat from core client for 30 sec - exiting 21:12:19 (4768): No heartbeat from core client for 30 sec - exiting 21:12:20 (4768): No heartbeat from core client for 30 sec - exiting 21:12:21 (4768): No heartbeat from core client for 30 sec - exiting 21:12:22 (4768): No heartbeat from core client for 30 sec - exiting 21:12:23 (4768): No heartbeat from core client for 30 sec - exiting 21:12:24 (4768): No heartbeat from core client for 30 sec - exiting 21:12:25 (4768): No heartbeat from core client for 30 sec - exiting 21:12:26 (4768): No heartbeat from core client for 30 sec - exiting 21:12:27 (4768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:47:53 (4664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:45:44 (2180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4524, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 00:34:35 (1164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:31:49 (4920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:27:52 (6724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:27:53 (6724): No heartbeat from core client for 30 sec - exiting 16:27:54 (6724): No heartbeat from core client for 30 sec - exiting 16:27:56 (6724): No heartbeat from core client for 30 sec - exiting 16:27:57 (6724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3920, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3920, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1348, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4640, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:00:48 (2364): No heartbeat from core client for 30 sec - exiting 23:00:49 (2364): No heartbeat from core client for 30 sec - exiting 23:00:50 (2364): No heartbeat from core client for 30 sec - exiting 23:00:51 (2364): No heartbeat from core client for 30 sec - exiting 23:00:52 (2364): No heartbeat from core client for 30 sec - exiting 23:00:53 (2364): No heartbeat from core client for 30 sec - exiting 23:00:54 (2364): No heartbeat from core client for 30 sec - exiting 23:00:55 (2364): No heartbeat from core client for 30 sec - exiting 23:00:56 (2364): No heartbeat from core client for 30 sec - exiting 23:00:57 (2364): No heartbeat from core client for 30 sec - exiting 23:00:58 (2364): No heartbeat from core client for 30 sec - exiting 23:00:59 (2364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:01:14 (7024): No heartbeat from core client for 30 sec - exiting 01:01:15 (7024): No heartbeat from core client for 30 sec - exiting 01:01:16 (7024): No heartbeat from core client for 30 sec - exiting 01:01:17 (7024): No heartbeat from core client for 30 sec - exiting 01:01:18 (7024): No heartbeat from core client for 30 sec - exiting 01:01:19 (7024): No heartbeat from core client for 30 sec - exiting 01:01:20 (7024): No heartbeat from core client for 30 sec - exiting 01:01:21 (7024): No heartbeat from core client for 30 sec - exiting 01:01:22 (7024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4880, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4920, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4776, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5504, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6044, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4808, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4864, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6472, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5360, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5036, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4936, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4576, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4504, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4436, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4680, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3984, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4652, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4744, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4648, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4648, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3292, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4712, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4088, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4688, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4796, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4772, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4772, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4648, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4772, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5472, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4784, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4600, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1188, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5044, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3284, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5128, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4884, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4884, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4816, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4644, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4276, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12908, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4400, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4400, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5300, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3544, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4612, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:18:00 (7312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:53:34 (4544): No heartbeat from core client for 30 sec - exiting 23:53:35 (4544): No heartbeat from core client for 30 sec - exiting 23:53:36 (4544): No heartbeat from core client for 30 sec - exiting 23:53:37 (4544): No heartbeat from core client for 30 sec - exiting 23:53:38 (4544): No heartbeat from core client for 30 sec - exiting 23:53:39 (4544): No heartbeat from core client for 30 sec - exiting 23:53:40 (4544): No heartbeat from core client for 30 sec - exiting 23:53:41 (4544): No heartbeat from core client for 30 sec - exiting 23:53:42 (4544): No heartbeat from core client for 30 sec - exiting 23:53:43 (4544): No heartbeat from core client for 30 sec - exiting 23:53:45 (4544): No heartbeat from core client for 30 sec - exiting 23:53:46 (4544): No heartbeat from core client for 30 sec - exiting 23:53:47 (4544): No heartbeat from core client for 30 sec - exiting 23:53:48 (4544): No heartbeat from core client for 30 sec - exiting 23:53:49 (4544): No heartbeat from core client for 30 sec - exiting 23:53:50 (4544): No heartbeat from core client for 30 sec - exiting 23:53:51 (4544): No heartbeat from core client for 30 sec - exiting 23:53:52 (4544): No heartbeat from core client for 30 sec - exiting 23:53:53 (4544): No heartbeat from core client for 30 sec - exiting 23:53:54 (4544): No heartbeat from core client for 30 sec - exiting 23:53:55 (4544): No heartbeat from core client for 30 sec - exiting 23:53:56 (4544): No heartbeat from core client for 30 sec - exiting 23:53:57 (4544): No heartbeat from core client for 30 sec - exiting 23:53:58 (4544): No heartbeat from core client for 30 sec - exiting 23:53:59 (4544): No heartbeat from core client for 30 sec - exiting 23:54:00 (4544): No heartbeat from core client for 30 sec - exiting 23:54:01 (4544): No heartbeat from core client for 30 sec - exiting 23:54:02 (4544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3596, iMonCtr=1 Model crash detected, will try to restart... 23:05:59 (4048): No heartbeat from core client for 30 sec - exiting 23:06:00 (4048): No heartbeat from core client for 30 sec - exiting 23:06:01 (4048): No heartbeat from core client for 30 sec - exiting 23:06:02 (4048): No heartbeat from core client for 30 sec - exiting 23:06:03 (4048): No heartbeat from core client for 30 sec - exiting 23:06:04 (4048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4700, iMonCtr=1 Model crash detected, will try to restart... 16:23:33 (5668): No heartbeat from core client for 30 sec - exiting 16:23:35 (5668): No heartbeat from core client for 30 sec - exiting 16:23:36 (5668): No heartbeat from core client for 30 sec - exiting 16:23:37 (5668): No heartbeat from core client for 30 sec - exiting 16:23:38 (5668): No heartbeat from core client for 30 sec - exiting 16:23:39 (5668): No heartbeat from core client for 30 sec - exiting 16:23:40 (5668): No heartbeat from core client for 30 sec - exiting 16:23:41 (5668): No heartbeat from core client for 30 sec - exiting 16:23:42 (5668): No heartbeat from core client for 30 sec - exiting 16:23:43 (5668): No heartbeat from core client for 30 sec - exiting 16:23:44 (5668): No heartbeat from core client for 30 sec - exiting 16:23:45 (5668): No heartbeat from core client for 30 sec - exiting 16:23:46 (5668): No heartbeat from core client for 30 sec - exiting 16:23:47 (5668): No heartbeat from core client for 30 sec - exiting 16:23:48 (5668): No heartbeat from core client for 30 sec - exiting 16:23:49 (5668): No heartbeat from core client for 30 sec - exiting 16:23:50 (5668): No heartbeat from core client for 30 sec - exiting 16:23:51 (5668): No heartbeat from core client for 30 sec - exiting 16:23:52 (5668): No heartbeat from core client for 30 sec - exiting 16:23:53 (5668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=524, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3412, iMonCtr=1 Model crash detected, will try to restart... 13:12:16 (860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:25:20 (1612): No heartbeat from core client for 30 sec - exiting 17:25:22 (1612): No heartbeat from core client for 30 sec - exiting 17:25:23 (1612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Abort request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Aug 2013 12:43:49	1271993	15814491	hadcm3n_o16e_1940_40_008382887_0	311,040	951,699	3.0597
15 Aug 2013 13:12:19	1271993	15814491	hadcm3n_o16e_1940_40_008382887_0	285,120	861,771	3.0225
15 Aug 2013 13:12:19	1271993	15814491	hadcm3n_o16e_1940_40_008382887_0	259,200	780,656	3.0118
23 Jul 2013 22:12:34	1271993	15814491	hadcm3n_o16e_1940_40_008382887_0	233,280	697,830	2.9914
23 Jul 2013 17:45:08	1271993	15814491	hadcm3n_o16e_1940_40_008382887_0	207,360	616,632	2.9737
06 Jul 2013 13:43:51	1271993	15814491	hadcm3n_o16e_1940_40_008382887_0	181,440	536,300	2.9558
26 Jun 2013 12:46:27	1271993	15814491	hadcm3n_o16e_1940_40_008382887_0	155,520	460,816	2.9631
22 Jun 2013 00:45:32	1271993	15814491	hadcm3n_o16e_1940_40_008382887_0	129,600	382,729	2.9532
16 Jun 2013 13:12:43	1271993	15814491	hadcm3n_o16e_1940_40_008382887_0	103,680	307,320	2.9641
11 Jun 2013 15:05:57	1271993	15814491	hadcm3n_o16e_1940_40_008382887_0	77,760	233,358	3.0010
09 Jun 2013 10:55:32	1271993	15814491	hadcm3n_o16e_1940_40_008382887_0	51,840	153,351	2.9582
06 Jun 2013 13:30:01	1271993	15814491	hadcm3n_o16e_1940_40_008382887_0	25,920	77,527	2.9910