Task 15444018

Name	hadcm3n_zn3w_1880_40_008247153_0
Workunit	8402277
Created	21 Nov 2012, 5:49:38 UTC
Sent	21 Nov 2012, 5:49:56 UTC
Report deadline	20 Feb 2013, 13:17:07 UTC
Received	17 Dec 2012, 13:06:24 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	996482
Run time	25 days 5 hours 1 min 28 sec
CPU time	22 days 12 hours 17 min 31 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.34 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 21:38:37 (3836): No heartbeat from core client for 30 sec - exiting 21:38:38 (3836): No heartbeat from core client for 30 sec - exiting 21:38:39 (3836): No heartbeat from core client for 30 sec - exiting 21:38:40 (3836): No heartbeat from core client for 30 sec - exiting 21:38:41 (3836): No heartbeat from core client for 30 sec - exiting 21:38:42 (3836): No heartbeat from core client for 30 sec - exiting 21:38:43 (3836): No heartbeat from core client for 30 sec - exiting 21:38:44 (3836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:29:17 (3604): No heartbeat from core client for 30 sec - exiting 22:29:19 (3604): No heartbeat from core client for 30 sec - exiting 22:29:20 (3604): No heartbeat from core client for 30 sec - exiting 22:29:21 (3604): No heartbeat from core client for 30 sec - exiting 22:29:22 (3604): No heartbeat from core client for 30 sec - exiting 22:29:23 (3604): No heartbeat from core client for 30 sec - exiting 22:29:24 (3604): No heartbeat from core client for 30 sec - exiting 22:29:25 (3604): No heartbeat from core client for 30 sec - exiting 22:29:26 (3604): No heartbeat from core client for 30 sec - exiting 22:29:27 (3604): No heartbeat from core client for 30 sec - exiting 22:29:28 (3604): No heartbeat from core client for 30 sec - exiting 22:29:29 (3604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The file or directory is corrupted and unreadable. 23:40:58 (3116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... forrtl: The file or directory is corrupted and unreadable. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3108, iMonCtr=1 Model crash detected, will try to restart... forrtl: The file or directory is corrupted and unreadable. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3108, iMonCtr=1 Model crash detected, will try to restart... forrtl: The file or directory is corrupted and unreadable. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3108, iMonCtr=1 Model crash detected, will try to restart... forrtl: The file or directory is corrupted and unreadable. CPDN Monitor - Quit request from BOINC... 00:00:21 (4452): No heartbeat from core client for 30 sec - exiting 00:00:22 (4452): No heartbeat from core client for 30 sec - exiting 00:00:23 (4452): No heartbeat from core client for 30 sec - exiting 00:00:24 (4452): No heartbeat from core client for 30 sec - exiting 00:00:25 (4452): No heartbeat from core client for 30 sec - exiting 00:00:27 (4452): No heartbeat from core client for 30 sec - exiting 00:00:28 (4452): No heartbeat from core client for 30 sec - exiting 00:00:29 (4452): No heartbeat from core client for 30 sec - exiting 00:00:30 (4452): No heartbeat from core client for 30 sec - exiting 00:00:31 (4452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3804, iMonCtr=1 Model crash detected, will try to restart... Ocean Restart file copy failed on zn3wko.da899e0 Suspended CPDN Monitor - Suspend request from BOINC... 04:38:55 (1968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4540, iMonCtr=1 Model crash detected, will try to restart... 22:05:36 (4020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:34:33 (4084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Restart file copy failed on zn3wka.da992a0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on zn3wka.da992b0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on zn3wka.da992c0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on zn3wka.da992d0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on zn3wka.da992e0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on zn3wka.da992f0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on zn3wka.da992g0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on zn3wka.da992h0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on zn3wka.da992i0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on zn3wka.da992j0 Ocean Restart file copy failed on zn3wko.da992k0 Ocean Restart file copy failed on zn3wko.da992l0 Ocean Restart file copy failed on zn3wko.da992m0 Ocean Restart file copy failed on zn3wko.da992n0 Ocean Restart file copy failed on zn3wko.da992o0 Ocean Restart file copy failed on zn3wko.da992p0 Ocean Restart file copy failed on zn3wko.da992q0 Ocean Restart file copy failed on zn3wko.da992r0 Ocean Restart file copy failed on zn3wko.da992s0 Ocean Restart file copy failed on zn3wko.da992t0 Ocean Restart file copy failed on zn3wko.da992u0 Ocean Restart file copy failed on zn3wko.da99310 Ocean Restart file copy failed on zn3wko.da99320 Ocean Restart file copy failed on zn3wko.da99340 Ocean Restart file copy failed on zn3wko.da99350 Ocean Restart file copy failed on zn3wko.da99360 Ocean Restart file copy failed on zn3wko.da99370 Ocean Restart file copy failed on zn3wko.da99380 Ocean Restart file copy failed on zn3wko.da99390 Ocean Restart file copy failed on zn3wko.da993a0 Ocean Restart file copy failed on zn3wko.da993b0 Ocean Restart file copy failed on zn3wko.da993c0 Ocean Restart file copy failed on zn3wko.da993d0 Ocean Restart file copy failed on zn3wko.da993e0 Ocean Restart file copy failed on zn3wko.da993f0 Ocean Restart file copy failed on zn3wko.da993h0 Ocean Restart file copy failed on zn3wko.da993i0 Ocean Restart file copy failed on zn3wko.da993j0 Ocean Restart file copy failed on zn3wko.da993k0 Ocean Restart file copy failed on zn3wko.da993l0 Ocean Restart file copy failed on zn3wko.da993m0 Ocean Restart file copy failed on zn3wko.da993n0 Ocean Restart file copy failed on zn3wko.da993p0 Ocean Restart file copy failed on zn3wko.da993q0 Ocean Restart file copy failed on zn3wko.da993r0 Ocean Restart file copy failed on zn3wko.da993s0 Ocean Restart file copy failed on zn3wko.da993t0 Ocean Restart file copy failed on zn3wko.da993u0 Ocean Restart file copy failed on zn3wko.da99410 Ocean Restart file copy failed on zn3wko.da99420 Ocean Restart file copy failed on zn3wko.da99430 Ocean Restart file copy failed on zn3wko.da99440 Ocean Restart file copy failed on zn3wko.da99450 Ocean Restart file copy failed on zn3wko.da99460 Ocean Restart file copy failed on zn3wko.da99470 Ocean Restart file copy failed on zn3wko.da99480 Ocean Restart file copy failed on zn3wko.da99490 Ocean Restart file copy failed on zn3wko.da994a0 Ocean Restart file copy failed on zn3wko.da994b0 Ocean Restart file copy failed on zn3wko.da994c0 Ocean Restart file copy failed on zn3wko.da994d0 Ocean Restart file copy failed on zn3wko.da994e0 Ocean Restart file copy failed on zn3wko.da994f0 Ocean Restart file copy failed on zn3wko.da994g0 Ocean Restart file copy failed on zn3wko.da994h0 Ocean Restart file copy failed on zn3wko.da994i0 Ocean Restart file copy failed on zn3wko.da994j0 Ocean Restart file copy failed on zn3wko.da994k0 Ocean Restart file copy failed on zn3wko.da994l0 Ocean Restart file copy failed on zn3wko.da994m0 Ocean Restart file copy failed on zn3wko.da994n0 Ocean Restart file copy failed on zn3wko.da994o0 Ocean Restart file copy failed on zn3wko.da994p0 Ocean Restart file copy failed on zn3wko.da994q0 Ocean Restart file copy failed on zn3wko.da994s0 Ocean Restart file copy failed on zn3wko.da994t0 Ocean Restart file copy failed on zn3wko.da994u0 Ocean Restart file copy failed on zn3wko.da99510 Ocean Restart file copy failed on zn3wko.da99520 Ocean Restart file copy failed on zn3wko.da99530 Ocean Restart file copy failed on zn3wko.da99540 Ocean Restart file copy failed on zn3wko.da99550 Ocean Restart file copy failed on zn3wko.da99560 Ocean Restart file copy failed on zn3wko.da99570 Ocean Restart file copy failed on zn3wko.da99590 Ocean Restart file copy failed on zn3wko.da995a0 Ocean Restart file copy failed on zn3wko.da995b0 Ocean Restart file copy failed on zn3wko.da995d0 Ocean Restart file copy failed on zn3wko.da995e0 Ocean Restart file copy failed on zn3wko.da995f0 Ocean Restart file copy failed on zn3wko.da995g0 Ocean Restart file copy failed on zn3wko.da995h0 Ocean Restart file copy failed on zn3wko.da995i0 Ocean Restart file copy failed on zn3wko.da995k0 Ocean Restart file copy failed on zn3wko.da995l0 Ocean Restart file copy failed on zn3wko.da995n0 Ocean Restart file copy failed on zn3wko.da995o0 Ocean Restart file copy failed on zn3wko.da995p0 Ocean Restart file copy failed on zn3wko.da995q0 Ocean Restart file copy failed on zn3wko.da995r0 Ocean Restart file copy failed on zn3wko.da995s0 Ocean Restart file copy failed on zn3wko.da995t0 Ocean Restart file copy failed on zn3wko.da995u0 Ocean Restart file copy failed on zn3wko.da99610 Ocean Restart file copy failed on zn3wko.da99620 Ocean Restart file copy failed on zn3wko.da99630 Ocean Restart file copy failed on zn3wko.da99640 Ocean Restart file copy failed on zn3wko.da99650 Ocean Restart file copy failed on zn3wko.da99660 Ocean Restart file copy failed on zn3wko.da99680 Suspended CPDN Monitor - Suspend request from BOINC... 13:22:36 (3384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:26:05 (1808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:26:06 (1808): No heartbeat from core client for 30 sec - exiting 13:26:07 (1808): No heartbeat from core client for 30 sec - exiting 13:26:08 (1808): No heartbeat from core client for 30 sec - exiting 13:26:09 (1808): No heartbeat from core client for 30 sec - exiting 13:26:10 (1808): No heartbeat from core client for 30 sec - exiting 13:26:11 (1808): No heartbeat from core client for 30 sec - exiting 13:26:12 (1808): No heartbeat from core client for 30 sec - exiting 13:26:13 (1808): No heartbeat from core client for 30 sec - exiting 13:26:14 (1808): No heartbeat from core client for 30 sec - exiting Ocean Restart file copy failed on zn3wko.daa1cu0 Ocean Restart file copy failed on zn3wko.daa24h0 Ocean Restart file copy failed on zn3wko.daa25m0 12:51:42 (4024): No heartbeat from core client for 30 sec - exiting 12:51:43 (4024): No heartbeat from core client for 30 sec - exiting 12:51:44 (4024): No heartbeat from core client for 30 sec - exiting 12:51:45 (4024): No heartbeat from core client for 30 sec - exiting 12:51:46 (4024): No heartbeat from core client for 30 sec - exiting 12:51:47 (4024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:20:32 (3892): No heartbeat from core client for 30 sec - exiting 21:20:33 (3892): No heartbeat from core client for 30 sec - exiting 21:20:34 (3892): No heartbeat from core client for 30 sec - exiting 21:20:35 (3892): No heartbeat from core client for 30 sec - exiting 21:20:36 (3892): No heartbeat from core client for 30 sec - exiting 21:20:37 (3892): No heartbeat from core client for 30 sec - exiting 21:20:38 (3892): No heartbeat from core client for 30 sec - exiting 21:20:39 (3892): No heartbeat from core client for 30 sec - exiting 21:20:40 (3892): No heartbeat from core client for 30 sec - exiting 21:20:41 (3892): No heartbeat from core client for 30 sec - exiting 21:20:42 (3892): No heartbeat from core client for 30 sec - exiting 21:20:43 (3892): No heartbeat from core client for 30 sec - exiting 21:20:44 (3892): No heartbeat from core client for 30 sec - exiting 21:20:45 (3892): No heartbeat from core client for 30 sec - exiting 21:20:46 (3892): No heartbeat from core client for 30 sec - exiting 21:20:47 (3892): No heartbeat from core client for 30 sec - exiting 21:20:48 (3892): No heartbeat from core client for 30 sec - exiting 21:20:49 (3892): No heartbeat from core client for 30 sec - exiting 21:20:50 (3892): No heartbeat from core client for 30 sec - exiting 21:20:51 (3892): No heartbeat from core client for 30 sec - exiting 21:20:52 (3892): No heartbeat from core client for 30 sec - exiting 21:20:53 (3892): No heartbeat from core client for 30 sec - exiting 21:20:54 (3892): No heartbeat from core client for 30 sec - exiting 21:20:55 (3892): No heartbeat from core client for 30 sec - exiting 21:20:56 (3892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Ocean Restart file copy failed on zn3wko.dab2550 Ocean Restart file copy failed on zn3wko.dab27l0 14:00:03 (1988): No heartbeat from core client for 30 sec - exiting 14:00:04 (1988): No heartbeat from core client for 30 sec - exiting 14:00:05 (1988): No heartbeat from core client for 30 sec - exiting 14:00:06 (1988): No heartbeat from core client for 30 sec - exiting 14:00:07 (1988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:01:04 (3692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Ocean Restart file copy failed on zn3wko.dab37i0 Suspended CPDN Monitor - Suspend request from BOINC... 13:43:16 (392): No heartbeat from core client for 30 sec - exiting 13:43:17 (392): No heartbeat from core client for 30 sec - exiting 13:43:18 (392): No heartbeat from core client for 30 sec - exiting 13:43:19 (392): No heartbeat from core client for 30 sec - exiting 13:43:20 (392): No heartbeat from core client for 30 sec - exiting 13:43:21 (392): No heartbeat from core client for 30 sec - exiting 13:43:23 (392): No heartbeat from core client for 30 sec - exiting 13:43:24 (392): No heartbeat from core client for 30 sec - exiting 13:43:25 (392): No heartbeat from core client for 30 sec - exiting 13:43:26 (392): No heartbeat from core client for 30 sec - exiting 13:43:27 (392): No heartbeat from core client for 30 sec - exiting 13:43:28 (392): No heartbeat from core client for 30 sec - exiting 13:43:29 (392): No heartbeat from core client for 30 sec - exiting 13:43:30 (392): No heartbeat from core client for 30 sec - exiting 13:43:31 (392): No heartbeat from core client for 30 sec - exiting 13:43:32 (392): No heartbeat from core client for 30 sec - exiting 13:43:33 (392): No heartbeat from core client for 30 sec - exiting 13:43:35 (392): No heartbeat from core client for 30 sec - exiting 13:43:36 (392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2448, iMonCtr=1 Model crash detected, will try to restart... 15:39:36 (2664): No heartbeat from core client for 30 sec - exiting 15:39:37 (2664): No heartbeat from core client for 30 sec - exiting 15:39:38 (2664): No heartbeat from core client for 30 sec - exiting 15:39:39 (2664): No heartbeat from core client for 30 sec - exiting 15:39:40 (2664): No heartbeat from core client for 30 sec - exiting 15:39:41 (2664): No heartbeat from core client for 30 sec - exiting 15:39:42 (2664): No heartbeat from core client for 30 sec - exiting 15:39:43 (2664): No heartbeat from core client for 30 sec - exiting 15:39:44 (2664): No heartbeat from core client for 30 sec - exiting 15:39:46 (2664): No heartbeat from core client for 30 sec - exiting 15:39:47 (2664): No heartbeat from core client for 30 sec - exiting 15:39:48 (2664): No heartbeat from core client for 30 sec - exiting 15:39:49 (2664): No heartbeat from core client for 30 sec - exiting 15:39:50 (2664): No heartbeat from core client for 30 sec - exiting 15:39:51 (2664): No heartbeat from core client for 30 sec - exiting 15:39:52 (2664): No heartbeat from core client for 30 sec - exiting 15:39:53 (2664): No heartbeat from core client for 30 sec - exiting 15:39:54 (2664): No heartbeat from core client for 30 sec - exiting 15:39:55 (2664): No heartbeat from core client for 30 sec - exiting 15:39:56 (2664): No heartbeat from core client for 30 sec - exiting 15:39:58 (2664): No heartbeat from core client for 30 sec - exiting 15:39:59 (2664): No heartbeat from core client for 30 sec - exiting 15:40:00 (2664): No heartbeat from core client for 30 sec - exiting 15:40:01 (2664): No heartbeat from core client for 30 sec - exiting 15:40:02 (2664): No heartbeat from core client for 30 sec - exiting 15:40:03 (2664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:52:43 (2984): No heartbeat from core client for 30 sec - exiting 15:52:44 (2984): No heartbeat from core client for 30 sec - exiting 15:52:45 (2984): No heartbeat from core client for 30 sec - exiting 15:52:46 (2984): No heartbeat from core client for 30 sec - exiting 15:52:47 (2984): No heartbeat from core client for 30 sec - exiting 15:52:48 (2984): No heartbeat from core client for 30 sec - exiting 15:52:49 (2984): No heartbeat from core client for 30 sec - exiting 15:52:51 (2984): No heartbeat from core client for 30 sec - exiting 15:52:52 (2984): No heartbeat from core client for 30 sec - exiting 15:52:53 (2984): No heartbeat from core client for 30 sec - exiting 15:52:54 (2984): No heartbeat from core client for 30 sec - exiting 15:52:55 (2984): No heartbeat from core client for 30 sec - exiting 15:52:56 (2984): No heartbeat from core client for 30 sec - exiting 15:52:57 (2984): No heartbeat from core client for 30 sec - exiting 15:52:58 (2984): No heartbeat from core client for 30 sec - exiting 15:52:59 (2984): No heartbeat from core client for 30 sec - exiting 15:53:00 (2984): No heartbeat from core client for 30 sec - exiting 15:53:01 (2984): No heartbeat from core client for 30 sec - exiting 15:53:02 (2984): No heartbeat from core client for 30 sec - exiting 15:53:03 (2984): No heartbeat from core client for 30 sec - exiting 15:53:04 (2984): No heartbeat from core client for 30 sec - exiting 15:53:05 (2984): No heartbeat from core client for 30 sec - exiting 15:53:06 (2984): No heartbeat from core client for 30 sec - exiting 15:53:07 (2984): No heartbeat from core client for 30 sec - exiting 15:53:08 (2984): No heartbeat from core client for 30 sec - exiting 15:53:09 (2984): No heartbeat from core client for 30 sec - exiting 15:53:10 (2984): No heartbeat from core client for 30 sec - exiting 15:53:11 (2984): No heartbeat from core client for 30 sec - exiting 15:53:12 (2984): No heartbeat from core client for 30 sec - exiting 15:53:13 (2984): No heartbeat from core client for 30 sec - exiting 15:53:14 (2984): No heartbeat from core client for 30 sec - exiting 15:53:15 (2984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:09:13 (3212): No heartbeat from core client for 30 sec - exiting 16:09:14 (3212): No heartbeat from core client for 30 sec - exiting 16:09:16 (3212): No heartbeat from core client for 30 sec - exiting 16:09:17 (3212): No heartbeat from core client for 30 sec - exiting 16:09:18 (3212): No heartbeat from core client for 30 sec - exiting 16:09:19 (3212): No heartbeat from core client for 30 sec - exiting 16:09:20 (3212): No heartbeat from core client for 30 sec - exiting 16:09:21 (3212): No heartbeat from core client for 30 sec - exiting 16:09:22 (3212): No heartbeat from core client for 30 sec - exiting 16:09:23 (3212): No heartbeat from core client for 30 sec - exiting 16:09:24 (3212): No heartbeat from core client for 30 sec - exiting 16:09:25 (3212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1544, iMonCtr=1 Model crash detected, will try to restart... 17:28:25 (1820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Dec 2012 07:34:27	996482	15444018	hadcm3n_zn3w_1880_40_008247153_0	1,036,800	1,944,325	1.8753
16 Dec 2012 16:06:06	996482	15444018	hadcm3n_zn3w_1880_40_008247153_0	1,010,880	1,894,857	1.8745
16 Dec 2012 00:27:52	996482	15444018	hadcm3n_zn3w_1880_40_008247153_0	984,960	1,847,637	1.8758
15 Dec 2012 09:53:47	996482	15444018	hadcm3n_zn3w_1880_40_008247153_0	959,040	1,799,927	1.8768
14 Dec 2012 19:04:12	996482	15444018	hadcm3n_zn3w_1880_40_008247153_0	933,120	1,751,522	1.8771
14 Dec 2012 13:41:33	996482	15444018	hadcm3n_zn3w_1880_40_008247153_0	907,200	1,705,681	1.8802
14 Dec 2012 13:41:33	996482	15444018	hadcm3n_zn3w_1880_40_008247153_0	881,280	1,661,201	1.8850
14 Dec 2012 13:41:33	996482	15444018	hadcm3n_zn3w_1880_40_008247153_0	855,360	1,616,822	1.8902
14 Dec 2012 13:41:33	996482	15444018	hadcm3n_zn3w_1880_40_008247153_0	829,440	1,572,022	1.8953
14 Dec 2012 13:41:33	996482	15444018	hadcm3n_zn3w_1880_40_008247153_0	803,520	1,527,833	1.9014
14 Dec 2012 13:41:33	996482	15444018	hadcm3n_zn3w_1880_40_008247153_0	777,600	1,483,391	1.9077
14 Dec 2012 13:41:33	996482	15444018	hadcm3n_zn3w_1880_40_008247153_0	751,680	1,439,141	1.9146
14 Dec 2012 13:41:33	996482	15444018	hadcm3n_zn3w_1880_40_008247153_0	725,760	1,395,080	1.9222
14 Dec 2012 13:41:33	996482	15444018	hadcm3n_zn3w_1880_40_008247153_0	699,840	1,350,808	1.9302
14 Dec 2012 13:41:33	996482	15444018	hadcm3n_zn3w_1880_40_008247153_0	673,920	1,306,060	1.9380
14 Dec 2012 13:41:33	996482	15444018	hadcm3n_zn3w_1880_40_008247153_0	648,000	1,261,356	1.9465
07 Dec 2012 17:13:33	996482	15444018	hadcm3n_zn3w_1880_40_008247153_0	622,080	1,217,263	1.9568
07 Dec 2012 03:56:11	996482	15444018	hadcm3n_zn3w_1880_40_008247153_0	596,160	1,174,028	1.9693
06 Dec 2012 14:40:11	996482	15444018	hadcm3n_zn3w_1880_40_008247153_0	570,240	1,130,221	1.9820
06 Dec 2012 01:16:58	996482	15444018	hadcm3n_zn3w_1880_40_008247153_0	544,320	1,087,456	1.9978