Task 13127608

Name	hadcm3n_ymdu_1900_40_007361868_1
Workunit	7559298
Created	6 Jul 2011, 15:22:00 UTC
Sent	7 Jul 2011, 9:15:12 UTC
Report deadline	6 Oct 2011, 16:42:23 UTC
Received	9 Oct 2011, 6:35:14 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1149318
Run time	35 days 16 hours 19 min 51 sec
CPU time	34 days 5 hours 14 min 12 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	1.98 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.59</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:54:01 (12374): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:54:02 (12374): No heartbeat from core client for 30 sec - exiting 05:57:24 (13200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:01:36 (16024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:18:46 (3766): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:55:21 (3793): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:56:30 (20083): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:51:57 (1024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:10:52 (11224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:15:30 (25054): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:14:03 (3632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:17:33 (4504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:14:31 (15312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:14:48 (22214): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:19:00 (3061): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 04:17:03 (7774): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:22:54 (14393): No heartbeat from core client for 30 sec - exiting 17:23:01 (14393): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:55:49 (28608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:57:19 (1786): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:21:57 (11266): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:26:56 (13599): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:01:19 (20467): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:50:53 (4847): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:05:40 (9590): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9614, selfPID=9614, iMonCtr=1 17:58:24 (10707): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:54:38 (14058): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:05:46 (25632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:30:34 (15469): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:15:29 (18746): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:33:22 (23712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:34:10 (28256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:14:07 (29184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:24:59 (29860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:13:35 (5628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:13:13 (9675): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:13:49 (11432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:14:25 (19459): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:16:49 (27692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:15:53 (31591): No heartbeat from core client for 30 sec - exiting 04:16:39 (31591): No heartbeat from core client for 30 sec - exiting 04:16:40 (31591): No heartbeat from core client for 30 sec - exiting 04:16:41 (31591): No heartbeat from core client for 30 sec - exiting 04:16:42 (31591): No heartbeat from core client for 30 sec - exiting 04:16:43 (31591): No heartbeat from core client for 30 sec - exiting 04:16:44 (31591): No heartbeat from core client for 30 sec - exiting 04:16:45 (31591): No heartbeat from core client for 30 sec - exiting 04:16:46 (31591): No heartbeat from core client for 30 sec - exiting 04:16:47 (31591): No heartbeat from core client for 30 sec - exiting 04:16:48 (31591): No heartbeat from core client for 30 sec - exiting 04:16:49 (31591): No heartbeat from core client for 30 sec - exiting 04:16:50 (31591): No heartbeat from core client for 30 sec - exiting 04:16:51 (31591): No heartbeat from core client for 30 sec - exiting 04:16:52 (31591): No heartbeat from core client for 30 sec - exiting 04:16:53 (31591): No heartbeat from core client for 30 sec - exiting 04:16:56 (31591): No heartbeat from core client for 30 sec - exiting 04:16:57 (31591): No heartbeat from core client for 30 sec - exiting 04:16:58 (31591): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:17:11 (17480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=25010, selfPID=25010, iMonCtr=1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/ymduko.pjc1c10 is not a valid UM file. Error converting file to netcdf: dataout/ymduko.pjc1c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:18:09 (5898): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:32:12 (19911): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:31:58 (27923): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:32:43 (28802): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:32:52 (5777): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:34:08 (15995): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:33:20 (18766): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:35:35 (22526): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:35:40 (23362): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:20:41 (22104): No heartbeat from core client for 30 sec - exiting 20:20:45 (22104): No heartbeat from core client for 30 sec - exiting 20:20:46 (22104): No heartbeat from core client for 30 sec - exiting 20:20:47 (22104): No heartbeat from core client for 30 sec - exiting 20:20:48 (22104): No heartbeat from core client for 30 sec - exiting 20:20:49 (22104): No heartbeat from core client for 30 sec - exiting 20:20:50 (22104): No heartbeat from core client for 30 sec - exiting 20:20:51 (22104): No heartbeat from core client for 30 sec - exiting 20:20:52 (22104): No heartbeat from core client for 30 sec - exiting 20:20:53 (22104): No heartbeat from core client for 30 sec - exiting 20:20:54 (22104): No heartbeat from core client for 30 sec - exiting 20:20:55 (22104): No heartbeat from core client for 30 sec - exiting 20:20:56 (22104): No heartbeat from core client for 30 sec - exiting 20:20:57 (22104): No heartbeat from core client for 30 sec - exiting 20:20:58 (22104): No heartbeat from core client for 30 sec - exiting 20:20:59 (22104): No heartbeat from core client for 30 sec - exiting 20:21:00 (22104): No heartbeat from core client for 30 sec - exiting 20:21:01 (22104): No heartbeat from core client for 30 sec - exiting 20:21:02 (22104): No heartbeat from core client for 30 sec - exiting 20:21:03 (22104): No heartbeat from core client for 30 sec - exiting 20:21:04 (22104): No heartbeat from core client for 30 sec - exiting 20:21:05 (22104): No heartbeat from core client for 30 sec - exiting 20:21:06 (22104): No heartbeat from core client for 30 sec - exiting 20:21:07 (22104): No heartbeat from core client for 30 sec - exiting 20:21:08 (22104): No heartbeat from core client for 30 sec - exiting 20:21:09 (22104): No heartbeat from core client for 30 sec - exiting 20:21:10 (22104): No heartbeat from core client for 30 sec - exiting 20:21:11 (22104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:30:56 (969): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:37:45 (1136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:49:12 (1261): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:39:44 (11881): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:39:44 (20836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:39:21 (24431): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:35:34 (28882): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:35:53 (28882): No heartbeat from core client for 30 sec - exiting 07:35:54 (28882): No heartbeat from core client for 30 sec - exiting 07:35:55 (28882): No heartbeat from core client for 30 sec - exiting 07:35:56 (28882): No heartbeat from core client for 30 sec - exiting 07:35:59 (28882): No heartbeat from core client for 30 sec - exiting 07:36:00 (28882): No heartbeat from core client for 30 sec - exiting 07:36:01 (28882): No heartbeat from core client for 30 sec - exiting 07:36:02 (28882): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:23:19 (23687): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:31:26 (24002): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:42:54 (24085): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:57:18 (24286): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:32:31 (24886): No heartbeat from core client for 30 sec - exiting 19:33:03 (24886): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:58:52 (25152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:03:05 (6195): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:03:06 (6195): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:06:21 (9576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:32:42 (10076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:04:41 (10892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:12:39 (10930): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:25:57 (11081): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:44:14 (11612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11651, iMonCtr=1 Model crash detected, will try to restart... 21:01:21 (11651): No heartbeat from core client for 30 sec - exiting 21:01:31 (11651): No heartbeat from core client for 30 sec - exiting 21:03:38 (12022): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:28:40 (12054): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:43:44 (12497): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:54:43 (12783): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12963, iMonCtr=1 Model crash detected, will try to restart... 22:57:28 (12963): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:01:13 (14046): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:05:55 (14114): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14203, iMonCtr=1 Model crash detected, will try to restart... 23:22:32 (14203): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:45:42 (14520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14928, iMonCtr=1 Model crash detected, will try to restart... 23:58:27 (14928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:01:54 (15144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:06:12 (12762): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:06:27 (25400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... 10:06:26 (2076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:06:15 (4221): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:08:15 (23718): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:08:20 (30258): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:08:45 (30258): No heartbeat from core client for 30 sec - exiting 22:08:46 (30258): No heartbeat from core client for 30 sec - exiting 22:08:47 (30258): No heartbeat from core client for 30 sec - exiting 22:08:48 (30258): No heartbeat from core client for 30 sec - exiting 22:08:49 (30258):00:10:24 (4421): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:10:57 (4421): No heartbeat from core client for 30 sec - exiting 00:11:00 (4421): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=23972, selfPID=23972, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Oct 2011 05:33:46	1149318	13127608	hadcm3n_ymdu_1900_40_007361868_1	1,036,800	2,955,291	2.8504
08 Oct 2011 09:03:57	1149318	13127608	hadcm3n_ymdu_1900_40_007361868_1	1,010,880	2,885,180	2.8541
07 Oct 2011 13:20:13	1149318	13127608	hadcm3n_ymdu_1900_40_007361868_1	984,960	2,816,798	2.8598
06 Oct 2011 16:28:22	1149318	13127608	hadcm3n_ymdu_1900_40_007361868_1	959,040	2,743,823	2.8610
05 Oct 2011 19:14:29	1149318	13127608	hadcm3n_ymdu_1900_40_007361868_1	933,120	2,673,287	2.8649
04 Oct 2011 21:33:28	1149318	13127608	hadcm3n_ymdu_1900_40_007361868_1	907,200	2,598,483	2.8643
03 Oct 2011 23:38:08	1149318	13127608	hadcm3n_ymdu_1900_40_007361868_1	881,280	2,523,900	2.8639
03 Oct 2011 01:40:30	1149318	13127608	hadcm3n_ymdu_1900_40_007361868_1	855,360	2,449,603	2.8638
02 Oct 2011 04:02:06	1149318	13127608	hadcm3n_ymdu_1900_40_007361868_1	829,440	2,375,053	2.8634
23 Sep 2011 00:29:08	1149318	13127608	hadcm3n_ymdu_1900_40_007361868_1	803,520	2,300,979	2.8636
22 Sep 2011 03:09:02	1149318	13127608	hadcm3n_ymdu_1900_40_007361868_1	777,600	2,225,947	2.8626
21 Sep 2011 05:59:44	1149318	13127608	hadcm3n_ymdu_1900_40_007361868_1	751,680	2,151,372	2.8621
11 Sep 2011 22:21:33	1149318	13127608	hadcm3n_ymdu_1900_40_007361868_1	725,760	2,080,815	2.8671
11 Sep 2011 01:56:29	1149318	13127608	hadcm3n_ymdu_1900_40_007361868_1	699,840	2,010,144	2.8723
10 Sep 2011 04:08:42	1149318	13127608	hadcm3n_ymdu_1900_40_007361868_1	673,920	1,935,226	2.8716
09 Sep 2011 06:17:27	1149318	13127608	hadcm3n_ymdu_1900_40_007361868_1	648,000	1,860,832	2.8717
08 Sep 2011 08:41:53	1149318	13127608	hadcm3n_ymdu_1900_40_007361868_1	622,080	1,786,128	2.8712
07 Sep 2011 09:32:23	1149318	13127608	hadcm3n_ymdu_1900_40_007361868_1	596,160	1,711,958	2.8716
06 Sep 2011 11:55:22	1149318	13127608	hadcm3n_ymdu_1900_40_007361868_1	570,240	1,637,923	2.8723
26 Aug 2011 05:19:00	1149318	13127608	hadcm3n_ymdu_1900_40_007361868_1	544,320	1,563,306	2.8720