Task 15992496

Name	hadcm3n_80ik_1980_40_008458607_0
Workunit	8609463
Created	30 Aug 2013, 20:21:45 UTC
Sent	7 Sep 2013, 21:47:46 UTC
Report deadline	8 Dec 2013, 5:14:57 UTC
Received	30 Oct 2013, 20:24:50 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1154356
Run time	23 days 7 hours 9 min 26 sec
CPU time	21 days 0 hours 19 min 16 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.19 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <stderr_txt> 17:21:08 (3300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... C19:43:24 (4024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:42:25 (4224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2828, iMonCtr=1 Model crash detected, wi22:52:38 (3148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:47:05 (3308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:43:47 (4152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:40:09 (5036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:00:18 (4636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:27:50 (2784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:13:46 (1380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:08:00 (4172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3976, iMonCtr=1 Model crash detected, will try to restart... 19:32:23 (1528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:26:25 (1132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:24:08 (3700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:30:03 (3200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:18:08 (172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:09:56 (4548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:40:35 (3092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:37:39 (3252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:29:23 (3428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:27:23 (2228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:17:33 (3352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:03:07 (3840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:23:34 (3152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:19:28 (2404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:14:04 (1120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:48:46 (3492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:35:44 (2116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:33:11 (3760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:30:15 (2396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:37:13 (3444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:36:05 (808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:08:00 (3796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:55:57 (4788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:54:49 (1760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:52:49 (4084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:51:10 (2452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:49:52 (4964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:48:00 (1760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:46:06 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:23:40 (3240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:19:11 (3656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Suspended CPDN Monitor - Suspend request from BOINC... Error converting file to netcdf: dataout/80ikko.pjk3c10 Error converting file to netcdf: dataout/80ikko.pik3c10 Error converting file to netcdf: dataout/80ikko.pfk3c10 Error converting file to netcdf: dataout/80ikka.phk3c10 Error converting file to netcdf: dataout/80ikka.pgk3c10 Error converting file to netcdf: dataout/80ikka.pek3c10 Error converting file to netcdf: dataout/80ikka.pdk3c10 20:44:39 (1948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:01:37 (3908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:53:11 (4596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:02:22 (3788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:51:47 (3456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:44:43 (3160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:29:19 (1156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:16:25 (1648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:15:11 (3136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:06:21 (3844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:03:37 (3028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:59:23 (3504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:54:08 (2196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:38:13 (760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:33:16 (4668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:12:28 (3448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:07:38 (2168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:02:11 (5036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:36:23 (3664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:33:24 (2848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:30:44 (2092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:27:16 (3772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:27:06 (3760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:25:30 (4572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:51:05 (4080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:48:51 (4768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:47:50 (4964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:43:51 (3720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:38:35 (4048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:37:32 (4856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:33:55 (2104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:31:22 (2476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:28:54 (4028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:22:33 (3280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:20:10 (4476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:13:23 (3892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:10:36 (3956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:00:20 (5056): No heartbeat from core client for 30 sec - exiting 12:00:21 (5056): No heartbeat from core client for 30 sec - exiting 12:00:22 (5056): No heartbeat from core client for 30 sec - exiting 12:00:23 (5056): No heartbeat from core client for 30 sec - exiting 12:00:24 (5056): No heartbeat from core client for 30 sec - exiting 12:00:25 (5056): No heartbeat from core client for 30 sec - exiting 12:00:26 (5056): No heartbeat from core client for 30 sec - exiting 12:00:27 (5056): No heartbeat from core client for 30 sec - exiting 12:00:28 (5056): No heartbeat from core client for 30 sec - exiting 12:00:29 (5056): No heartbeat from core client for 30 sec - exiting 12:00:30 (5056): No heartbeat from core client for 30 sec - exiting 12:00:31 (5056): No heartbeat from core client for 30 sec - exiting 12:00:32 (5056): No heartbeat from core client for 30 sec - exiting 12:00:33 (5056): No heartbeat from core client for 30 sec - exiting 12:00:34 (5056): No heartbeat from core client for 30 sec - exiting 12:00:35 (5056): No heartbeat from core client for 30 sec - exiting 12:00:36 (5056): No heartbeat from core client for 30 sec - exiting 12:00:37 (5056): No heartbeat from core client for 30 sec - exiting 12:00:38 (5056): No heartbeat from core client for 30 sec - exiting 12:00:39 (5056): No heartbeat from core client for 30 sec - exiting 12:00:40 (5056): No heartbeat from core client for 30 sec - exiting 12:00:42 (5056): No heartbeat from core client for 30 sec - exiting 12:00:43 (5056): No heartbeat from core client for 30 sec - exiting 12:00:44 (5056): No heartbeat from core client for 30 sec - exiting 12:00:45 (5056): No heartbeat from core client for 30 sec - exiting 12:00:46 (5056): No heartbeat from core client for 30 sec - exiting 12:00:47 (5056): No heartbeat from core client for 30 sec - exiting 12:00:48 (5056): No heartbeat from core client for 30 sec - exiting 12:00:49 (5056): No heartbeat from core client for 30 sec - exiting 12:00:50 (5056): No heartbeat from core client for 30 sec - exiting 12:00:51 (5056): No heartbeat from core client for 30 sec - exiting 12:00:52 (5056): No heartbeat from core client for 30 sec - exiting 12:00:53 (5056): No heartbeat from core client for 30 sec - exiting 12:00:54 (5056): No heartbeat from core client for 30 sec - exiting 12:00:55 (5056): No heartbeat from core client for 30 sec - exiting 12:00:56 (5056): No heartbeat from core client for 30 sec - exiting 12:00:57 (5056): No heartbeat from core client for 30 sec - exiting 12:00:58 (5056): No heartbeat from core client for 30 sec - exiting 12:00:59 (5056): No heartbeat from core client for 30 sec - exiting 12:01:00 (5056): No heartbeat from core client for 30 sec - exiting 12:01:01 (5056): No heartbeat from core client for 30 sec - exiting 12:01:02 (5056): No heartbeat from core client for 30 sec - exiting 12:01:03 (5056): No heartbeat from core client for 30 sec - exiting 12:01:04 (5056): No heartbeat from core client for 30 sec - exiting 12:01:05 (5056): No heartbeat from core client for 30 sec - exiting 12:01:06 (5056): No heartbeat from core client for 30 sec - exiting 12:01:07 (5056): No heartbeat from core client for 30 sec - exiting 12:01:08 (5056): No heartbeat from core client for 30 sec - exiting 12:01:10 (5056): No heartbeat from core client for 30 sec - exiting 12:01:11 (5056): No heartbeat from core client for 30 sec - exiting 12:01:12 (5056): No heartbeat from core client for 30 sec - exiting 12:01:13 (5056): No heartbeat from core client for 30 sec - exiting 12:01:14 (5056): No heartbeat from core client for 30 sec - exiting 12:01:15 (5056): No heartbeat from core client for 30 sec - exiting 12:01:16 (5056): No heartbeat from core client for 30 sec - exiting 12:01:17 (5056): No heartbeat from core client for 30 sec - exiting 12:01:18 (5056): No heartbeat from core client for 30 sec - exiting 12:01:19 (5056): No heartbeat from core client for 30 sec - exiting 12:01:20 (5056): No heartbeat from core client for 30 sec - exiting 12:01:21 (5056): No heartbeat from core client for 30 sec - exiting 12:01:22 (5056): No heartbeat from core client for 30 sec - exiting 12:01:23 (5056): No heartbeat from core client for 30 sec - exiting 12:01:24 (5056): No heartbeat from core client for 30 sec - exiting 12:01:25 (5056): No heartbeat from core client for 30 sec - exiting 12:01:26 (5056): No heartbeat from core client for 30 sec - exiting 12:01:27 (5056): No heartbeat from core client for 30 sec - exiting 12:01:28 (5056): No heartbeat from core client for 30 sec - exiting 12:01:29 (5056): No heartbeat from core client for 30 sec - exiting 12:01:30 (5056): No heartbeat from core client for 30 sec - exiting 12:01:31 (5056): No heartbeat from core client for 30 sec - exiting 12:01:32 (5056): No heartbeat from core client for 30 sec - exiting 12:01:33 (5056): No heartbeat from core client for 30 sec - exiting 12:01:34 (5056): No heartbeat from core client for 30 sec - exiting 12:01:35 (5056): No heartbeat from core client for 30 sec - exiting 12:01:36 (5056): No heartbeat from core client for 30 sec - exiting 12:01:37 (5056): No heartbeat from core client for 30 sec - exiting 12:01:39 (5056): No heartbeat from core client for 30 sec - exiting 12:01:40 (5056): No heartbeat from core client for 30 sec - exiting 12:01:41 (5056): No heartbeat from core client for 30 sec - exiting 12:01:42 (5056): No heartbeat from core client for 30 sec - exiting 12:01:43 (5056): No heartbeat from core client for 30 sec - exiting 12:01:44 (5056): No heartbeat from core client for 30 sec - exiting 12:01:45 (5056): No heartbeat from core client for 30 sec - exiting 12:01:46 (5056): No heartbeat from core client for 30 sec - exiting 12:01:47 (5056): No heartbeat from core client for 30 sec - exiting 12:01:48 (5056): No heartbeat from core client for 30 sec - exiting 12:01:49 (5056): No heartbeat from core client for 30 sec - exiting 12:01:50 (5056): No heartbeat from core client for 30 sec - exiting 12:01:51 (5056): No heartbeat from core client for 30 sec - exiting 12:01:52 (5056): No heartbeat from core client for 30 sec - exiting 12:01:53 (5056): No heartbeat from core client for 30 sec - exiting 12:01:54 (5056): No heartbeat from core client for 30 sec - exiting 12:01:55 (5056): No heartbeat from core client for 30 sec - exiting 12:01:56 (5056): No heartbeat from core client for 30 sec - exiting 12:01:57 (5056): No heartbeat from core client for 30 sec - exiting 12:01:58 (5056): No heartbeat from core client for 30 sec - exiting 12:01:59 (5056): No heartbeat from core client for 30 sec - exiting 12:02:00 (5056): No heartbeat from core client for 30 sec - exiting 12:02:01 (5056): No heartbeat from core client for 30 sec - exiting 12:02:02 (5056): No heartbeat from core client for 30 sec - exiting 12:02:03 (5056): No heartbeat from core client for 30 sec - exiting 12:02:04 (5056): No heartbeat from core client for 30 sec - exiting 12:02:05 (5056): No heartbeat from core client for 30 sec - exiting 12:02:06 (5056): No heartbeat from core client for 30 sec - exiting 12:02:07 (5056): No heartbeat from core client for 30 sec - exiting 12:02:08 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... zip error: Could not create output file (was replacing the original zip file) Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Oct 2013 11:04:11	1154356	15992496	hadcm3n_80ik_1980_40_008458607_0	1,036,800	1,814,842	1.7504
29 Oct 2013 21:29:29	1154356	15992496	hadcm3n_80ik_1980_40_008458607_0	1,010,880	1,769,682	1.7506
28 Oct 2013 19:46:03	1154356	15992496	hadcm3n_80ik_1980_40_008458607_0	984,960	1,724,324	1.7507
27 Oct 2013 17:15:52	1154356	15992496	hadcm3n_80ik_1980_40_008458607_0	959,040	1,674,219	1.7457
27 Oct 2013 03:51:32	1154356	15992496	hadcm3n_80ik_1980_40_008458607_0	933,120	1,629,822	1.7466
26 Oct 2013 01:23:49	1154356	15992496	hadcm3n_80ik_1980_40_008458607_0	907,200	1,585,296	1.7475
25 Oct 2013 01:24:37	1154356	15992496	hadcm3n_80ik_1980_40_008458607_0	881,280	1,541,772	1.7495
23 Oct 2013 02:44:11	1154356	15992496	hadcm3n_80ik_1980_40_008458607_0	855,360	1,498,410	1.7518
22 Oct 2013 02:05:26	1154356	15992496	hadcm3n_80ik_1980_40_008458607_0	829,440	1,453,269	1.7521
21 Oct 2013 11:29:16	1154356	15992496	hadcm3n_80ik_1980_40_008458607_0	803,520	1,406,630	1.7506
20 Oct 2013 20:38:54	1154356	15992496	hadcm3n_80ik_1980_40_008458607_0	777,600	1,360,897	1.7501
05 Oct 2013 06:58:19	1154356	15992496	hadcm3n_80ik_1980_40_008458607_0	751,680	1,317,380	1.7526
04 Oct 2013 17:26:15	1154356	15992496	hadcm3n_80ik_1980_40_008458607_0	725,760	1,272,993	1.7540
04 Oct 2013 00:32:08	1154356	15992496	hadcm3n_80ik_1980_40_008458607_0	699,840	1,224,973	1.7504
03 Oct 2013 11:07:20	1154356	15992496	hadcm3n_80ik_1980_40_008458607_0	673,920	1,179,349	1.7500
02 Oct 2013 21:40:47	1154356	15992496	hadcm3n_80ik_1980_40_008458607_0	648,000	1,132,829	1.7482
01 Oct 2013 21:36:02	1154356	15992496	hadcm3n_80ik_1980_40_008458607_0	622,080	1,088,232	1.7493
30 Sep 2013 20:24:58	1154356	15992496	hadcm3n_80ik_1980_40_008458607_0	596,160	1,043,034	1.7496
29 Sep 2013 20:14:31	1154356	15992496	hadcm3n_80ik_1980_40_008458607_0	570,240	997,599	1.7494
29 Sep 2013 02:41:45	1154356	15992496	hadcm3n_80ik_1980_40_008458607_0	544,320	952,033	1.7490