Task 16295508

Name	hadcm3n_86r4_1980_40_008515255_0
Workunit	8662767
Created	26 Feb 2014, 16:09:53 UTC
Sent	26 Feb 2014, 16:59:25 UTC
Report deadline	29 May 2014, 0:26:36 UTC
Received	18 Mar 2014, 19:35:33 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1285716
Run time	19 days 5 hours 34 min 49 sec
CPU time	19 days 0 hours 52 min 47 sec
Validate state	Invalid
Credit	11,508.48
Device peak FLOPS	2.87 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> Das Gerät erkennt den Befehl nicht. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:54:32 (5420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:54:33 (5420): No heartbeat from core client for 30 sec - exiting 02:57:59 (5536): No heartbeat from core client for 30 sec - exiting 02:58:00 (5536): No heartbeat from core client for 30 sec - exiting 02:58:01 (5536): No heartbeat from core client for 30 sec - exiting 02:58:02 (5536): No heartbeat from core client for 30 sec - exiting 02:58:03 (5536): No heartbeat from core client for 30 sec - exiting 02:58:04 (5536): No heartbeat from core client for 30 sec - exiting 02:58:05 (5536): No heartbeat from core client for 30 sec - exiting 02:58:06 (5536): No heartbeat from core client for 30 sec - exiting 02:58:07 (5536): No heartbeat from core client for 30 sec - exiting 02:58:08 (5536): No heartbeat from core client for 30 sec - exiting 02:58:09 (5536): No heartbeat from core client for 30 sec - exiting 02:58:10 (5536): No heartbeat from core client for 30 sec - exiting 02:58:11 (5536): No heartbeat from core client for 30 sec - exiting 02:58:12 (5536): No heartbeat from core client for 30 sec - exiting 02:58:13 (5536): No heartbeat from core client for 30 sec - exiting 02:58:14 (5536): No heartbeat from core client for 30 sec - exiting 02:58:15 (5536): No heartbeat from core client for 30 sec - exiting 02:58:16 (5536): No heartbeat from core client for 30 sec - exiting 02:58:17 (5536): No heartbeat from core client for 30 sec - exiting 02:58:18 (5536): No heartbeat from core client for 30 sec - exiting 02:58:19 (5536): No heartbeat from core client for 30 sec - exiting 02:58:20 (5536): No heartbeat from core client for 30 sec - exiting 02:58:21 (5536): No heartbeat from core client for 30 sec - exiting 02:58:22 (5536): No heartbeat from core client for 30 sec - exiting 02:58:23 (5536): No heartbeat from core client for 30 sec - exiting 02:58:24 (5536): No heartbeat from core client for 30 sec - exiting 02:58:25 (5536): No heartbeat from core client for 30 sec - exiting 02:58:26 (5536): No heartbeat from core client for 30 sec - exiting 02:58:27 (5536): No heartbeat from core client for 30 sec - exiting 02:58:28 (5536): No heartbeat from core client for 30 sec - exiting 02:58:59 (5536): No heartbeat from core client for 30 sec - exiting 02:59:04 (5536): No heartbeat from core client for 30 sec - exiting 02:59:05 (5536): No heartbeat from core client for 30 sec - exiting 02:59:06 (5536): No heartbeat from core client for 30 sec - exiting 02:59:07 (5536): No heartbeat from core client for 30 sec - exiting 02:59:08 (5536): No heartbeat from core client for 30 sec - exiting 02:59:09 (5536): No heartbeat from core client for 30 sec - exiting 02:59:10 (5536): No heartbeat from core client for 30 sec - exiting 02:59:11 (5536): No heartbeat from core client for 30 sec - exiting 02:59:12 (5536): No heartbeat from core client for 30 sec - exiting 02:59:13 (5536): No heartbeat from core client for 30 sec - exiting 02:59:14 (5536): No heartbeat from core client for 30 sec - exiting 02:59:15 (5536): No heartbeat from core client for 30 sec - exiting 02:59:16 (5536): No heartbeat from core client for 30 sec - exiting 02:59:17 (5536): No heartbeat from core client for 30 sec - exiting 02:59:18 (5536): No heartbeat from core client for 30 sec - exiting 02:59:19 (5536): No heartbeat from core client for 30 sec - exiting 02:59:20 (5536): No heartbeat from core client for 30 sec - exiting 02:59:21 (5536): No heartbeat from core client for 30 sec - exiting 02:59:22 (5536): No heartbeat from core client for 30 sec - exiting 02:59:23 (5536): No heartbeat from core client for 30 sec - exiting 02:59:24 (5536): No heartbeat from core client for 30 sec - exiting 02:59:25 (5536): No heartbeat from core client for 30 sec - exiting 02:59:26 (5536): No heartbeat from core client for 30 sec - exiting 02:59:27 (5536): No heartbeat from core client for 30 sec - exiting 02:59:28 (5536): No heartbeat from core client for 30 sec - exiting 02:59:29 (5536): No heartbeat from core client for 30 sec - exiting 02:59:30 (5536): No heartbeat from core client for 30 sec - exiting 02:59:31 (5536): No heartbeat from core client for 30 sec - exiting 02:59:32 (5536): No heartbeat from core client for 30 sec - exiting 02:59:33 (5536): No heartbeat from core client for 30 sec - exiting 02:59:34 (5536): No heartbeat from core client for 30 sec - exiting 02:59:35 (5536): No heartbeat from core client for 30 sec - exiting 02:59:36 (5536): No heartbeat from core client for 30 sec - exiting 02:59:37 (5536): No heartbeat from core client for 30 sec - exiting 02:59:38 (5536): No heartbeat from core client for 30 sec - exiting 02:59:39 (5536): No heartbeat from core client for 30 sec - exiting 03:00:10 (5536): No heartbeat from core client for 30 sec - exiting 03:00:11 (5536): No heartbeat from core client for 30 sec - exiting 03:00:12 (5536): No heartbeat from core client for 30 sec - exiting 03:00:13 (5536): No heartbeat from core client for 30 sec - exiting 03:00:14 (5536): No heartbeat from core client for 30 sec - exiting 03:00:15 (5536): No heartbeat from core client for 30 sec - exiting 03:00:16 (5536): No heartbeat from core client for 30 sec - exiting 03:00:17 (5536): No heartbeat from core client for 30 sec - exiting 03:00:18 (5536): No heartbeat from core client for 30 sec - exiting 03:00:19 (5536): No heartbeat from core client for 30 sec - exiting 03:00:20 (5536): No heartbeat from core client for 30 sec - exiting 03:00:21 (5536): No heartbeat from core client for 30 sec - exiting 03:00:22 (5536): No heartbeat from core client for 30 sec - exiting 03:00:23 (5536): No heartbeat from core client for 30 sec - exiting 03:00:24 (5536): No heartbeat from core client for 30 sec - exiting 03:00:25 (5536): No heartbeat from core client for 30 sec - exiting 03:00:26 (5536): No heartbeat from core client for 30 sec - exiting 03:00:27 (5536): No heartbeat from core client for 30 sec - exiting 03:00:28 (5536): No heartbeat from core client for 30 sec - exiting 03:00:29 (5536): No heartbeat from core client for 30 sec - exiting 03:00:30 (5536): No heartbeat from core client for 30 sec - exiting 03:00:31 (5536): No heartbeat from core client for 30 sec - exiting 03:00:32 (5536): No heartbeat from core client for 30 sec - exiting 03:00:33 (5536): No heartbeat from core client for 30 sec - exiting 03:00:34 (5536): No heartbeat from core client for 30 sec - exiting 03:00:35 (5536): No heartbeat from core client for 30 sec - exiting 03:00:36 (5536): No heartbeat from core client for 30 sec - exiting 03:00:37 (5536): No heartbeat from core client for 30 sec - exiting 03:00:38 (5536): No heartbeat from core client for 30 sec - exiting 03:00:39 (5536): No heartbeat from core client for 30 sec - exiting 03:00:40 (5536): No heartbeat from core client for 30 sec - exiting 03:00:41 (5536): No heartbeat from core client for 30 sec - exiting 03:00:42 (5536): No heartbeat from core client for 30 sec - exiting 03:00:43 (5536): No heartbeat from core client for 30 sec - exiting 03:00:44 (5536): No heartbeat from core client for 30 sec - exiting 03:00:45 (5536): No heartbeat from core client for 30 sec - exiting 03:00:46 (5536): No heartbeat from core client for 30 sec - exiting 03:00:47 (5536): No heartbeat from core client for 30 sec - exiting 03:00:48 (5536): No heartbeat from core client for 30 sec - exiting 03:00:49 (5536): No heartbeat from core client for 30 sec - exiting 03:00:50 (5536): No heartbeat from core client for 30 sec - exiting 03:00:51 (5536): No heartbeat from core client for 30 sec - exiting 03:00:52 (5536): No heartbeat from core client for 30 sec - exiting 03:00:53 (5536): No heartbeat from core client for 30 sec - exiting 03:00:54 (5536): No heartbeat from core client for 30 sec - exiting 03:00:55 (5536): No heartbeat from core client for 30 sec - exiting 03:00:56 (5536): No heartbeat from core client for 30 sec - exiting 03:00:57 (5536): No heartbeat from core client for 30 sec - exiting 03:00:58 (5536): No heartbeat from core client for 30 sec - exiting 03:00:59 (5536): No heartbeat from core client for 30 sec - exiting 03:01:00 (5536): No heartbeat from core client for 30 sec - exiting 03:01:01 (5536): No heartbeat from core client for 30 sec - exiting 03:01:02 (5536): No heartbeat from core client for 30 sec - exiting 03:01:03 (5536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:02:52 (5556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:03:13 (5556): No heartbeat from core client for 30 sec - exiting 03:03:14 (5556): No heartbeat from core client for 30 sec - exiting 03:03:15 (5556): No heartbeat from core client for 30 sec - exiting 03:04:23 (9248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:04:24 (9248): No heartbeat from core client for 30 sec - exiting 03:04:25 (9248): No heartbeat from core client for 30 sec - exiting 03:04:26 (9248): No heartbeat from core client for 30 sec - exiting 03:04:27 (9248): No heartbeat from core client for 30 sec - exiting 03:04:28 (9248): No heartbeat from core client for 30 sec - exiting 03:04:29 (9248): No heartbeat from core client for 30 sec - exiting 03:04:30 (9248): No heartbeat from core client for 30 sec - exiting 03:04:31 (9248): No heartbeat from core client for 30 sec - exiting 03:04:32 (9248): No heartbeat from core client for 30 sec - exiting 03:06:16 (10016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:06:31 (10016): No heartbeat from core client for 30 sec - exiting 03:06:32 (10016): No heartbeat from core client for 30 sec - exiting 03:06:33 (10016): No heartbeat from core client for 30 sec - exiting 03:07:41 (5644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:07:44 (5644): No heartbeat from core client for 30 sec - exiting 03:07:45 (5644): No heartbeat from core client for 30 sec - exiting 03:07:46 (5644): No heartbeat from core client for 30 sec - exiting 03:07:47 (5644): No heartbeat from core client for 30 sec - exiting 03:07:48 (5644): No heartbeat from core client for 30 sec - exiting 03:07:49 (5644): No heartbeat from core client for 30 sec - exiting 03:09:48 (4996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:09:56 (4996): No heartbeat from core client for 30 sec - exiting 03:09:57 (4996): No heartbeat from core client for 30 sec - exiting 03:09:58 (4996): No heartbeat from core client for 30 sec - exiting 03:12:33 (6260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:12:38 (6260): No heartbeat from core client for 30 sec - exiting 03:12:39 (6260): No heartbeat from core client for 30 sec - exiting 03:12:40 (6260): No heartbeat from core client for 30 sec - exiting 03:15:20 (2664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:15:35 (2664): No heartbeat from core client for 30 sec - exiting 03:15:36 (2664): No heartbeat from core client for 30 sec - exiting 03:15:37 (2664): No heartbeat from core client for 30 sec - exiting 03:20:24 (10928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:21:07 (6092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:22:22 (6884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:25:13 (9648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:29:37 (8692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:30:10 (8692): No heartbeat from core client for 30 sec - exiting 03:30:11 (8692): No heartbeat from core client for 30 sec - exiting 03:30:12 (8692): No heartbeat from core client for 30 sec - exiting 03:30:13 (8692): No heartbeat from core client for 30 sec - exiting 03:30:14 (8692): No heartbeat from core client for 30 sec - exiting 03:30:15 (8692): No heartbeat from core client for 30 sec - exiting 03:30:16 (8692): No heartbeat from core client for 30 sec - exiting 03:30:17 (8692): No heartbeat from core client for 30 sec - exiting 03:30:18 (8692): No heartbeat from core client for 30 sec - exiting 03:30:19 (8692): No heartbeat from core client for 30 sec - exiting 03:31:03 (3012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:32:26 (5088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:33:37 (4248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:36:21 (8692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:01:10 (6668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:01:17 (6668): No heartbeat from core client for 30 sec - exiting 04:01:18 (6668): No heartbeat from core client for 30 sec - exiting 04:01:19 (6668): No heartbeat from core client for 30 sec - exiting 04:01:20 (6668): No heartbeat from core client for 30 sec - exiting 04:01:21 (6668): No heartbeat from core client for 30 sec - exiting 04:01:22 (6668): No heartbeat from core client for 30 sec - exiting 04:35:36 (6244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:35:46 (6244): No heartbeat from core client for 30 sec - exiting 04:35:47 (6244): No heartbeat from core client for 30 sec - exiting 04:35:48 (6244): No heartbeat from core client for 30 sec - exiting 04:36:41 (10312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:38:48 (9252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:39:21 (404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:58:01 (9800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:39:35 (5144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:49:01 (10836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:50:50 (10536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:50:58 (10536): No heartbeat from core client for 30 sec - exiting 05:50:59 (10536): No heartbeat from core client for 30 sec - exiting 05:51:00 (10536): No heartbeat from core client for 30 sec - exiting 06:12:27 (1028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:12:28 (1028): No heartbeat from core client for 30 sec - exiting 06:12:29 (1028): No heartbeat from core client for 30 sec - exiting 06:12:30 (1028): No heartbeat from core client for 30 sec - exiting 06:33:54 (10716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:50:46 (8692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:11:54 (8224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:11:58 (8224): No heartbeat from core client for 30 sec - exiting 07:11:59 (8224): No heartbeat from core client for 30 sec - exiting 07:12:00 (8224): No heartbeat from core client for 30 sec - exiting 07:13:43 (10936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:50:50 (6980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:50:52 (6980): No heartbeat from core client for 30 sec - exiting 07:50:53 (6980): No heartbeat from core client for 30 sec - exiting 07:50:54 (6980): No heartbeat from core client for 30 sec - exiting 07:50:55 (6980): No heartbeat from core client for 30 sec - exiting 07:50:56 (6980): No heartbeat from core client for 30 sec - exiting 07:50:57 (6980): No heartbeat from core client for 30 sec - exiting 07:50:58 (6980): No heartbeat from core client for 30 sec - exiting 07:50:59 (6980): No heartbeat from core client for 30 sec - exiting 07:51:00 (6980): No heartbeat from core client for 30 sec - exiting 07:51:01 (6980): No heartbeat from core client for 30 sec - exiting 08:11:57 (6084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:53:00 (208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:59:42 (6408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:04:24 (9884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:51:00 (3768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:51:04 (3768): No heartbeat from core client for 30 sec - exiting 09:51:05 (3768): No heartbeat from core client for 30 sec - exiting 09:51:06 (3768): No heartbeat from core client for 30 sec - exiting 09:51:38 (4548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:52:45 (11240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:53:41 (1676): No heartbeat from core client for 30 sec - exiting tmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - No 'heartbeat' from BOINC... 09:53:48 (1676): No heartbeat from core client for 30 sec - exiting 09:53:49 (1676): No heartbeat from core client for 30 sec - exiting 09:53:50 (1676): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9688, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9688, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9688, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4340, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4340, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2508, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Mar 2014 22:47:32	1285716	16295508	hadcm3n_86r4_1980_40_008515255_0	959,040	1,625,208	1.6946
17 Mar 2014 09:40:31	1285716	16295508	hadcm3n_86r4_1980_40_008515255_0	933,120	1,581,708	1.6951
16 Mar 2014 21:32:38	1285716	16295508	hadcm3n_86r4_1980_40_008515255_0	907,200	1,538,273	1.6956
16 Mar 2014 09:32:08	1285716	16295508	hadcm3n_86r4_1980_40_008515255_0	881,280	1,495,224	1.6967
15 Mar 2014 21:30:11	1285716	16295508	hadcm3n_86r4_1980_40_008515255_0	855,360	1,452,136	1.6977
15 Mar 2014 09:35:56	1285716	16295508	hadcm3n_86r4_1980_40_008515255_0	829,440	1,409,234	1.6990
14 Mar 2014 21:33:26	1285716	16295508	hadcm3n_86r4_1980_40_008515255_0	803,520	1,366,235	1.7003
14 Mar 2014 09:39:05	1285716	16295508	hadcm3n_86r4_1980_40_008515255_0	777,600	1,323,370	1.7019
13 Mar 2014 21:41:45	1285716	16295508	hadcm3n_86r4_1980_40_008515255_0	751,680	1,280,401	1.7034
13 Mar 2014 09:08:05	1285716	16295508	hadcm3n_86r4_1980_40_008515255_0	725,760	1,236,223	1.7033
12 Mar 2014 20:45:14	1285716	16295508	hadcm3n_86r4_1980_40_008515255_0	699,840	1,192,027	1.7033
12 Mar 2014 07:22:29	1285716	16295508	hadcm3n_86r4_1980_40_008515255_0	673,920	1,147,755	1.7031
11 Mar 2014 17:36:34	1285716	16295508	hadcm3n_86r4_1980_40_008515255_0	648,000	1,102,838	1.7019
11 Mar 2014 05:13:51	1285716	16295508	hadcm3n_86r4_1980_40_008515255_0	622,080	1,058,700	1.7019
10 Mar 2014 14:35:46	1285716	16295508	hadcm3n_86r4_1980_40_008515255_0	596,160	1,014,007	1.7009
10 Mar 2014 02:18:27	1285716	16295508	hadcm3n_86r4_1980_40_008515255_0	570,240	970,027	1.7011
09 Mar 2014 13:58:38	1285716	16295508	hadcm3n_86r4_1980_40_008515255_0	544,320	926,001	1.7012
09 Mar 2014 01:43:41	1285716	16295508	hadcm3n_86r4_1980_40_008515255_0	518,400	882,013	1.7014
08 Mar 2014 13:01:10	1285716	16295508	hadcm3n_86r4_1980_40_008515255_0	492,480	836,899	1.6994
08 Mar 2014 00:21:58	1285716	16295508	hadcm3n_86r4_1980_40_008515255_0	466,560	791,902	1.6973