Task 12791468

Name	hadcm3n_o32h_1900_40_007199308_2
Workunit	7397588
Created	10 Apr 2011, 15:09:12 UTC
Sent	10 Apr 2011, 15:10:22 UTC
Report deadline	10 Jul 2011, 22:37:33 UTC
Received	22 Jul 2011, 12:42:33 UTC
Server state	Over
Outcome	Computation error
Client state	Aborted by user
Exit status	-197 (0xFFFFFF3B) ERR_ABORTED_VIA_GUI
Computer ID	1119495
Run time	11 days 18 hours 22 min 2 sec
CPU time	10 days 6 hours 6 min 38 sec
Validate state	Invalid
Credit	7,776.00
Device peak FLOPS	3.20 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:15:52 (7204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:23:07 (7316): No heartbeat from core client for 30 sec - exiting 22:23:08 (7316): No heartbeat from core client for 30 sec - exiting 22:23:09 (7316): No heartbeat from core client for 30 sec - exiting 22:23:10 (7316): No heartbeat from core client for 30 sec - exiting 22:23:11 (7316): No heartbeat from core client for 30 sec - exiting 22:23:12 (7316): No heartbeat from core client for 30 sec - exiting 22:23:13 (7316): No heartbeat from core client for 30 sec - exiting 22:23:14 (7316): No heartbeat from core client for 30 sec - exiting 22:23:15 (7316): No heartbeat from core client for 30 sec - exiting 22:23:16 (7316): No heartbeat from core client for 30 sec - exiting 22:23:17 (7316): No heartbeat from core client for 30 sec - exiting 22:23:18 (7316): No heartbeat from core client for 30 sec - exiting 22:23:19 (7316): No heartbeat from core client for 30 sec - exiting 22:23:20 (7316): No heartbeat from core client for 30 sec - exiting 22:23:21 (7316): No heartbeat from core client for 30 sec - exiting 22:23:22 (7316): No heartbeat from core client for 30 sec - exiting 22:23:23 (7316): No heartbeat from core client for 30 sec - exiting 22:23:24 (7316): No heartbeat from core client for 30 sec - exiting 22:23:25 (7316): No heartbeat from core client for 30 sec - exiting 22:23:26 (7316): No heartbeat from core client for 30 sec - exiting 22:23:27 (7316): No heartbeat from core client for 30 sec - exiting 22:23:28 (7316): No heartbeat from core client for 30 sec - exiting 22:23:29 (7316): No heartbeat from core client for 30 sec - exiting 22:23:30 (7316): No heartbeat from core client for 30 sec - exiting 22:23:31 (7316): No heartbeat from core client for 30 sec - exiting 22:23:32 (7316): No heartbeat from core client for 30 sec - exiting 22:23:33 (7316): No heartbeat from core client for 30 sec - exiting 22:23:34 (7316): No heartbeat from core client for 30 sec - exiting 22:23:35 (7316): No heartbeat from core client for 30 sec - exiting 22:23:36 (7316): No heartbeat from core client for 30 sec - exiting 22:23:37 (7316): No heartbeat from core client for 30 sec - exiting 22:23:38 (7316): No heartbeat from core client for 30 sec - exiting 22:23:39 (7316): No heartbeat from core client for 30 sec - exiting 22:23:40 (7316): No heartbeat from core client for 30 sec - exiting 22:23:41 (7316): No heartbeat from core client for 30 sec - exiting 22:23:43 (7316): No heartbeat from core client for 30 sec - exiting 22:23:44 (7316): No heartbeat from core client for 30 sec - exiting 22:23:45 (7316): No heartbeat from core client for 30 sec - exiting 22:23:46 (7316): No heartbeat from core client for 30 sec - exiting 22:23:47 (7316): No heartbeat from core client for 30 sec - exiting 22:23:48 (7316): No heartbeat from core client for 30 sec - exiting 22:23:49 (7316): No heartbeat from core client for 30 sec - exiting 22:23:50 (7316): No heartbeat from core client for 30 sec - exiting 22:23:51 (7316): No heartbeat from core client for 30 sec - exiting 22:23:52 (7316): No heartbeat from core client for 30 sec - exiting 22:23:53 (7316): No heartbeat from core client for 30 sec - exiting 22:23:54 (7316): No heartbeat from core client for 30 sec - exiting 22:23:55 (7316): No heartbeat from core client for 30 sec - exiting 22:23:56 (7316): No heartbeat from core client for 30 sec - exiting 22:23:57 (7316): No heartbeat from core client for 30 sec - exiting 22:23:58 (7316): No heartbeat from core client for 30 sec - exiting 22:23:59 (7316): No heartbeat from core client for 30 sec - exiting 22:24:00 (7316): No heartbeat from core client for 30 sec - exiting 22:24:01 (7316): No heartbeat from core client for 30 sec - exiting 22:24:02 (7316): No heartbeat from core client for 30 sec - exiting 22:24:03 (7316): No heartbeat from core client for 30 sec - exiting 22:24:04 (7316): No heartbeat from core client for 30 sec - exiting 22:24:05 (7316): No heartbeat from core client for 30 sec - exiting 22:24:06 (7316): No heartbeat from core client for 30 sec - exiting 22:24:07 (7316): No heartbeat from core client for 30 sec - exiting 22:24:08 (7316): No heartbeat from core client for 30 sec - exiting 22:24:09 (7316): No heartbeat from core client for 30 sec - exiting 22:24:10 (7316): No heartbeat from core client for 30 sec - exiting 22:24:11 (7316): No heartbeat from core client for 30 sec - exiting 22:24:12 (7316): No heartbeat from core client for 30 sec - exiting 22:24:13 (7316): No heartbeat from core client for 30 sec - exiting 22:24:14 (7316): No heartbeat from core client for 30 sec - exiting 22:24:15 (7316): No heartbeat from core client for 30 sec - exiting 22:24:16 (7316): No heartbeat from core client for 30 sec - exiting 22:24:17 (7316): No heartbeat from core client for 30 sec - exiting 22:24:19 (7316): No heartbeat from core client for 30 sec - exiting 22:24:20 (7316): No heartbeat from core client for 30 sec - exiting 22:24:21 (7316): No heartbeat from core client for 30 sec - exiting 22:24:22 (7316): No heartbeat from core client for 30 sec - exiting 22:24:23 (7316): No heartbeat from core client for 30 sec - exiting 22:24:24 (7316): No heartbeat from core client for 30 sec - exiting 22:24:25 (7316): No heartbeat from core client for 30 sec - exiting 22:24:26 (7316): No heartbeat from core client for 30 sec - exiting 22:24:27 (7316): No heartbeat from core client for 30 sec - exiting 22:24:28 (7316): No heartbeat from core client for 30 sec - exiting 22:24:29 (7316): No heartbeat from core client for 30 sec - exiting 22:24:30 (7316): No heartbeat from core client for 30 sec - exiting 22:24:31 (7316): No heartbeat from core client for 30 sec - exiting 22:24:32 (7316): No heartbeat from core client for 30 sec - exiting 22:24:33 (7316): No heartbeat from core client for 30 sec - exiting 22:24:34 (7316): No heartbeat from core client for 30 sec - exiting 22:24:35 (7316): No heartbeat from core client for 30 sec - exiting 22:24:36 (7316): No heartbeat from core client for 30 sec - exiting 22:24:37 (7316): No heartbeat from core client for 30 sec - exiting 22:24:38 (7316): No heartbeat from core client for 30 sec - exiting 22:24:39 (7316): No heartbeat from core client for 30 sec - exiting 22:24:40 (7316): No heartbeat from core client for 30 sec - exiting 22:24:41 (7316): No heartbeat from core client for 30 sec - exiting 22:24:42 (7316): No heartbeat from core client for 30 sec - exiting 22:24:43 (7316): No heartbeat from core client for 30 sec - exiting 22:24:44 (7316): No heartbeat from core client for 30 sec - exiting 22:24:45 (7316): No heartbeat from core client for 30 sec - exiting 22:24:46 (7316): No heartbeat from core client for 30 sec - exiting 22:24:47 (7316): No heartbeat from core client for 30 sec - exiting 22:24:48 (7316): No heartbeat from core client for 30 sec - exiting 22:24:49 (7316): No heartbeat from core client for 30 sec - exiting 22:24:50 (7316): No heartbeat from core client for 30 sec - exiting 22:24:51 (7316): No heartbeat from core client for 30 sec - exiting 22:24:52 (7316): No heartbeat from core client for 30 sec - exiting 22:24:53 (7316): No heartbeat from core client for 30 sec - exiting 22:24:54 (7316): No heartbeat from core client for 30 sec - exiting 22:24:55 (7316): No heartbeat from core client for 30 sec - exiting 22:24:56 (7316): No heartbeat from core client for 30 sec - exiting 22:24:57 (7316): No heartbeat from core client for 30 sec - exiting 22:24:58 (7316): No heartbeat from core client for 30 sec - exiting 22:24:59 (7316): No heartbeat from core client for 30 sec - exiting 22:25:00 (7316): No heartbeat from core client for 30 sec - exiting 22:25:01 (7316): No heartbeat from core client for 30 sec - exiting 22:25:03 (7316): No heartbeat from core client for 30 sec - exiting 22:25:04 (7316): No heartbeat from core client for 30 sec - exiting 22:25:05 (7316): No heartbeat from core client for 30 sec - exiting 22:25:06 (7316): No heartbeat from core client for 30 sec - exiting 22:25:07 (7316): No heartbeat from core client for 30 sec - exiting 22:25:08 (7316): No heartbeat from core client for 30 sec - exiting 22:25:09 (7316): No heartbeat from core client for 30 sec - exiting 22:25:10 (7316): No heartbeat from core client for 30 sec - exiting 22:25:11 (7316): No heartbeat from core client for 30 sec - exiting 22:25:12 (7316): No heartbeat from core client for 30 sec - exiting 22:25:13 (7316): No heartbeat from core client for 30 sec - exiting 22:25:14 (7316): No heartbeat from core client for 30 sec - exiting 22:25:15 (7316): No heartbeat from core client for 30 sec - exiting 22:25:16 (7316): No heartbeat from core client for 30 sec - exiting 22:25:17 (7316): No heartbeat from core client for 30 sec - exiting 22:25:18 (7316): No heartbeat from core client for 30 sec - exiting 22:25:19 (7316): No heartbeat from core client for 30 sec - exiting 22:25:20 (7316): No heartbeat from core client for 30 sec - exiting 22:25:21 (7316): No heartbeat from core client for 30 sec - exiting 22:25:22 (7316): No heartbeat from core client for 30 sec - exiting 22:25:23 (7316): No heartbeat from core client for 30 sec - exiting 22:25:24 (7316): No heartbeat from core client for 30 sec - exiting 22:25:25 (7316): No heartbeat from core client for 30 sec - exiting 22:25:26 (7316): No heartbeat from core client for 30 sec - exiting 22:25:27 (7316): No heartbeat from core client for 30 sec - exiting 22:25:28 (7316): No heartbeat from core client for 30 sec - exiting 22:25:29 (7316): No heartbeat from core client for 30 sec - exiting 22:25:30 (7316): No heartbeat from core client for 30 sec - exiting 22:25:31 (7316): No heartbeat from core client for 30 sec - exiting 22:25:32 (7316): No heartbeat from core client for 30 sec - exiting 22:25:34 (7316): No heartbeat from core client for 30 sec - exiting 22:25:35 (7316): No heartbeat from core client for 30 sec - exiting 22:25:36 (7316): No heartbeat from core client for 30 sec - exiting 22:25:37 (7316): No heartbeat from core client for 30 sec - exiting 22:25:38 (7316): No heartbeat from core client for 30 sec - exiting 22:25:39 (7316): No heartbeat from core client for 30 sec - exiting 22:25:40 (7316): No heartbeat from core client for 30 sec - exiting 22:25:41 (7316): No heartbeat from core client for 30 sec - exiting 22:25:42 (7316): No heartbeat from core client for 30 sec - exiting 22:25:43 (7316): No heartbeat from core client for 30 sec - exiting 22:25:44 (7316): No heartbeat from core client for 30 sec - exiting 22:25:45 (7316): No heartbeat from core client for 30 sec - exiting 22:26:17 (7316): No heartbeat from core client for 30 sec - exiting 22:26:18 (7316): No heartbeat from core client for 30 sec - exiting 22:26:19 (7316): No heartbeat from core client for 30 sec - exiting 22:26:20 (7316): No heartbeat from core client for 30 sec - exiting 22:26:21 (7316): No heartbeat from core client for 30 sec - exiting 22:26:22 (7316): No heartbeat from core client for 30 sec - exiting 22:26:23 (7316): No heartbeat from core client for 30 sec - exiting 22:26:24 (7316): No heartbeat from core client for 30 sec - exiting 22:26:25 (7316): No heartbeat from core client for 30 sec - exiting 22:26:26 (7316): No heartbeat from core client for 30 sec - exiting 22:26:27 (7316): No heartbeat from core client for 30 sec - exiting 22:26:28 (7316): No heartbeat from core client for 30 sec - exiting 22:26:29 (7316): No heartbeat from core client for 30 sec - exiting 22:26:30 (7316): No heartbeat from core client for 30 sec - exiting 22:26:31 (7316): No heartbeat from core client for 30 sec - exiting 22:26:32 (7316): No heartbeat from core client for 30 sec - exiting 22:26:34 (7316): No heartbeat from core client for 30 sec - exiting 22:26:35 (7316): No heartbeat from core client for 30 sec - exiting 22:26:36 (7316): No heartbeat from core client for 30 sec - exiting 22:26:37 (7316): No heartbeat from core client for 30 sec - exiting 22:26:38 (7316): No heartbeat from core client for 30 sec - exiting 22:26:39 (7316): No heartbeat from core client for 30 sec - exiting 22:26:40 (7316): No heartbeat from core client for 30 sec - exiting 22:26:41 (7316): No heartbeat from core client for 30 sec - exiting 22:26:42 (7316): No heartbeat from core client for 30 sec - exiting 22:26:43 (7316): No heartbeat from core client for 30 sec - exiting 22:26:44 (7316): No heartbeat from core client for 30 sec - exiting 22:26:45 (7316): No heartbeat from core client for 30 sec - exiting 22:26:46 (7316): No heartbeat from core client for 30 sec - exiting 22:26:47 (7316): No heartbeat from core client for 30 sec - exiting 22:26:48 (7316): No heartbeat from core client for 30 sec - exiting 22:26:49 (7316): No heartbeat from core client for 30 sec - exiting 22:26:50 (7316): No heartbeat from core client for 30 sec - exiting 22:26:51 (7316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:32:08 (6656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6776, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2012, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3424, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6280, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9656, iMonCtr=1 Model crash detected, will try to restart... CSuspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6372, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7416, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5580, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4700, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4892, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5592, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5592, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6160, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Abort request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jul 2011 13:01:47	1119495	12791468	hadcm3n_o32h_1900_40_007199308_2	648,000	856,245	1.3214
07 Jul 2011 17:54:43	1119495	12791468	hadcm3n_o32h_1900_40_007199308_2	622,080	821,992	1.3214
04 Jul 2011 20:01:50	1119495	12791468	hadcm3n_o32h_1900_40_007199308_2	596,160	787,927	1.3217
03 Jul 2011 14:52:43	1119495	12791468	hadcm3n_o32h_1900_40_007199308_2	570,240	753,333	1.3211
02 Jul 2011 08:05:42	1119495	12791468	hadcm3n_o32h_1900_40_007199308_2	544,320	718,905	1.3207
30 Jun 2011 01:11:36	1119495	12791468	hadcm3n_o32h_1900_40_007199308_2	518,400	685,493	1.3223
25 Jun 2011 10:53:49	1119495	12791468	hadcm3n_o32h_1900_40_007199308_2	492,480	651,987	1.3239
23 Jun 2011 20:28:18	1119495	12791468	hadcm3n_o32h_1900_40_007199308_2	466,560	618,922	1.3266
21 Jun 2011 09:19:35	1119495	12791468	hadcm3n_o32h_1900_40_007199308_2	440,640	585,865	1.3296
20 Jun 2011 00:06:21	1119495	12791468	hadcm3n_o32h_1900_40_007199308_2	414,720	552,197	1.3315
16 Jun 2011 18:52:36	1119495	12791468	hadcm3n_o32h_1900_40_007199308_2	388,800	519,076	1.3351
04 Jun 2011 15:47:57	1119495	12791468	hadcm3n_o32h_1900_40_007199308_2	362,880	485,915	1.3391
03 Jun 2011 11:13:49	1119495	12791468	hadcm3n_o32h_1900_40_007199308_2	336,960	452,101	1.3417
24 May 2011 05:12:16	1119495	12791468	hadcm3n_o32h_1900_40_007199308_2	311,040	417,623	1.3427
22 May 2011 14:17:18	1119495	12791468	hadcm3n_o32h_1900_40_007199308_2	285,120	382,963	1.3432
21 May 2011 07:09:54	1119495	12791468	hadcm3n_o32h_1900_40_007199308_2	259,200	347,514	1.3407
20 May 2011 20:00:37	1119495	12791468	hadcm3n_o32h_1900_40_007199308_2	233,280	311,375	1.3348
18 May 2011 16:58:11	1119495	12791468	hadcm3n_o32h_1900_40_007199308_2	207,360	275,623	1.3292
08 May 2011 05:12:40	1119495	12791468	hadcm3n_o32h_1900_40_007199308_2	181,440	241,218	1.3295
04 May 2011 14:21:46	1119495	12791468	hadcm3n_o32h_1900_40_007199308_2	155,520	206,013	1.3247