Task 16037368

Name	hadcm3n_o8xy_1900_40_008466713_0
Workunit	8617552
Created	27 Sep 2013, 9:25:40 UTC
Sent	7 Oct 2013, 18:07:21 UTC
Report deadline	7 Jan 2014, 1:34:32 UTC
Received	17 Oct 2013, 1:14:15 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	731465
Run time	4 days 0 hours 46 min 13 sec
CPU time	3 days 4 hours 44 min 38 sec
Validate state	Invalid
Credit	2,177.28
Device peak FLOPS	2.54 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 18:57:00 (6340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:29:33 (8132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:29:34 (8132): No heartbeat from core client for 30 sec - exiting 16:29:36 (8132): No heartbeat from core client for 30 sec - exiting 16:29:37 (8132): No heartbeat from core client for 30 sec - exiting 16:29:38 (8132): No heartbeat from core client for 30 sec - exiting 16:29:39 (8132): No heartbeat from core client for 30 sec - exiting 16:29:41 (8132): No heartbeat from core client for 30 sec - exiting 16:29:42 (8132): No heartbeat from core client for 30 sec - exiting 16:29:43 (8132): No heartbeat from core client for 30 sec - exiting 16:29:44 (8132): No heartbeat from core client for 30 sec - exiting 16:29:45 (8132): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:36:41 (3700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:37:57 (8000): No heartbeat from core client for 30 sec - exiting 09:37:58 (8000): No heartbeat from core client for 30 sec - exiting 09:37:59 (8000): No heartbeat from core client for 30 sec - exiting 09:38:01 (8000): No heartbeat from core client for 30 sec - exiting 09:38:02 (8000): No heartbeat from core client for 30 sec - exiting 09:38:03 (8000): No heartbeat from core client for 30 sec - exiting 09:38:04 (8000): No heartbeat from core client for 30 sec - exiting 09:38:05 (8000): No heartbeat from core client for 30 sec - exiting 09:38:07 (8000): No heartbeat from core client for 30 sec - exiting 09:38:08 (8000): No heartbeat from core client for 30 sec - exiting 09:38:09 (8000): No heartbeat from core client for 30 sec - exiting 09:38:10 (8000): No heartbeat from core client for 30 sec - exiting 09:38:11 (8000): No heartbeat from core client for 30 sec - exiting 09:38:12 (8000): No heartbeat from core client for 30 sec - exiting 09:38:14 (8000): No heartbeat from core client for 30 sec - exiting 09:38:15 (8000): No heartbeat from core client for 30 sec - exiting 09:38:16 (8000): No heartbeat from core client for 30 sec - exiting 09:38:17 (8000): No heartbeat from core client for 30 sec - exiting 09:38:18 (8000): No heartbeat from core client for 30 sec - exiting 09:38:19 (8000): No heartbeat from core client for 30 sec - exiting 09:38:20 (8000): No heartbeat from core client for 30 sec - exiting 09:38:22 (8000): No heartbeat from core client for 30 sec - exiting 09:38:23 (8000): No heartbeat from core client for 30 sec - exiting 09:38:24 (8000): No heartbeat from core client for 30 sec - exiting 09:38:25 (8000): No heartbeat from core client for 30 sec - exiting 09:38:26 (8000): No heartbeat from core client for 30 sec - exiting 09:38:27 (8000): No heartbeat from core client for 30 sec - exiting 09:38:28 (8000): No heartbeat from core client for 30 sec - exiting 09:38:29 (8000): No heartbeat from core client for 30 sec - exiting 09:38:34 (8000): No heartbeat from core client for 30 sec - exiting 09:38:35 (8000): No heartbeat from core client for 30 sec - exiting 09:38:36 (8000): No heartbeat from core client for 30 sec - exiting 09:38:37 (8000): No heartbeat from core client for 30 sec - exiting 09:38:38 (8000): No heartbeat from core client for 30 sec - exiting 09:38:39 (8000): No heartbeat from core client for 30 sec - exiting 09:38:40 (8000): No heartbeat from core client for 30 sec - exiting 09:38:41 (8000): No heartbeat from core client for 30 sec - exiting 09:38:42 (8000): No heartbeat from core client for 30 sec - exiting 09:38:44 (8000): No heartbeat from core client for 30 sec - exiting 09:38:46 (8000): No heartbeat from core client for 30 sec - exiting 09:38:47 (8000): No heartbeat from core client for 30 sec - exiting 09:38:48 (8000): No heartbeat from core client for 30 sec - exiting 09:38:49 (8000): No heartbeat from core client for 30 sec - exiting 09:38:50 (8000): No heartbeat from core client for 30 sec - exiting 09:38:51 (8000): No heartbeat from core client for 30 sec - exiting 09:38:52 (8000): No heartbeat from core client for 30 sec - exiting 09:38:54 (8000): No heartbeat from core client for 30 sec - exiting 09:38:55 (8000): No heartbeat from core client for 30 sec - exiting 09:38:56 (8000): No heartbeat from core client for 30 sec - exiting 09:38:57 (8000): No heartbeat from core client for 30 sec - exiting 09:38:58 (8000): No heartbeat from core client for 30 sec - exiting 09:38:59 (8000): No heartbeat from core client for 30 sec - exiting 09:39:00 (8000): No heartbeat from core client for 30 sec - exiting 09:39:01 (8000): No heartbeat from core client for 30 sec - exiting 09:39:02 (8000): No heartbeat from core client for 30 sec - exiting 09:39:03 (8000): No heartbeat from core client for 30 sec - exiting 09:39:04 (8000): No heartbeat from core client for 30 sec - exiting 09:39:06 (8000): No heartbeat from core client for 30 sec - exiting 09:39:07 (8000): No heartbeat from core client for 30 sec - exiting 09:39:08 (8000): No heartbeat from core client for 30 sec - exiting 09:39:09 (8000): No heartbeat from core client for 30 sec - exiting 09:39:10 (8000): No heartbeat from core client for 30 sec - exiting 09:39:11 (8000): No heartbeat from core client for 30 sec - exiting 09:39:13 (8000): No heartbeat from core client for 30 sec - exiting 09:39:14 (8000): No heartbeat from core client for 30 sec - exiting 09:39:15 (8000): No heartbeat from core client for 30 sec - exiting 09:39:16 (8000): No heartbeat from core client for 30 sec - exiting 09:39:17 (8000): No heartbeat from core client for 30 sec - exiting 09:39:18 (8000): No heartbeat from core client for 30 sec - exiting 09:39:19 (8000): No heartbeat from core client for 30 sec - exiting 09:39:21 (8000): No heartbeat from core client for 30 sec - exiting 09:39:22 (8000): No heartbeat from core client for 30 sec - exiting 09:39:23 (8000): No heartbeat from core client for 30 sec - exiting 09:39:24 (8000): No heartbeat from core client for 30 sec - exiting 09:39:25 (8000): No heartbeat from core client for 30 sec - exiting 09:39:26 (8000): No heartbeat from core client for 30 sec - exiting 09:39:28 (8000): No heartbeat from core client for 30 sec - exiting 09:39:29 (8000): No heartbeat from core client for 30 sec - exiting 09:39:30 (8000): No heartbeat from core client for 30 sec - exiting 09:39:31 (8000): No heartbeat from core client for 30 sec - exiting 09:39:33 (8000): No heartbeat from core client for 30 sec - exiting 09:39:34 (8000): No heartbeat from core client for 30 sec - exiting 09:39:36 (8000): No heartbeat from core client for 30 sec - exiting 09:39:37 (8000): No heartbeat from core client for 30 sec - exiting 09:39:38 (8000): No heartbeat from core client for 30 sec - exiting 09:39:39 (8000): No heartbeat from core client for 30 sec - exiting 09:39:40 (8000): No heartbeat from core client for 30 sec - exiting 09:39:42 (8000): No heartbeat from core client for 30 sec - exiting 09:39:43 (8000): No heartbeat from core client for 30 sec - exiting 09:39:44 (8000): No heartbeat from core client for 30 sec - exiting 09:39:45 (8000): No heartbeat from core client for 30 sec - exiting 09:39:47 (8000): No heartbeat from core client for 30 sec - exiting 09:39:48 (8000): No heartbeat from core client for 30 sec - exiting 09:39:49 (8000): No heartbeat from core client for 30 sec - exiting 09:39:50 (8000): No heartbeat from core client for 30 sec - exiting 09:39:51 (8000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:39:53 (8000): No heartbeat from core client for 30 sec - exiting 09:39:54 (8000): No heartbeat from core client for 30 sec - exiting 09:39:55 (8000): No heartbeat from core client for 30 sec - exiting 09:39:56 (8000): No heartbeat from core client for 30 sec - exiting 09:39:57 (8000): No heartbeat from core client for 30 sec - exiting 09:39:58 (8000): No heartbeat from core client for 30 sec - exiting 09:40:00 (8000): No heartbeat from core client for 30 sec - exiting 09:40:01 (8000): No heartbeat from core client for 30 sec - exiting 09:40:03 (8000): No heartbeat from core client for 30 sec - exiting 09:40:04 (8000): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... OPEN: Unable to Open File dataout/o8xyko.pia4c10 for Read/Write Model crashed: STWORK : Error opening output PP file on unit 68 tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:34:33 (5764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:42:23 (7040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:40:38 (4520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:40:40 (4520): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:18:06 (7608): No heartbeat from core client for 30 sec - exiting 15:18:07 (7608): No heartbeat from core client for 30 sec - exiting 15:18:09 (7608): No heartbeat from core client for 30 sec - exiting 15:18:10 (7608): No heartbeat from core client for 30 sec - exiting 15:18:11 (7608): No heartbeat from core client for 30 sec - exiting 15:18:12 (7608): No heartbeat from core client for 30 sec - exiting 15:18:13 (7608): No heartbeat from core client for 30 sec - exiting 15:18:14 (7608): No heartbeat from core client for 30 sec - exiting 15:18:15 (7608): No heartbeat from core client for 30 sec - exiting 15:18:16 (7608): No heartbeat from core client for 30 sec - exiting 15:18:17 (7608): No heartbeat from core client for 30 sec - exiting 15:18:19 (7608): No heartbeat from core client for 30 sec - exiting 15:18:20 (7608): No heartbeat from core client for 30 sec - exiting 15:18:21 (7608): No heartbeat from core client for 30 sec - exiting 15:18:22 (7608): No heartbeat from core client for 30 sec - exiting 15:18:23 (7608): No heartbeat from core client for 30 sec - exiting 15:18:24 (7608): No heartbeat from core client for 30 sec - exiting 15:18:25 (7608): No heartbeat from core client for 30 sec - exiting 15:18:26 (7608): No heartbeat from core client for 30 sec - exiting 15:18:27 (7608): No heartbeat from core client for 30 sec - exiting 15:18:28 (7608): No heartbeat from core client for 30 sec - exiting 15:18:30 (7608): No heartbeat from core client for 30 sec - exiting 15:18:31 (7608): No heartbeat from core client for 30 sec - exiting 15:18:32 (7608): No heartbeat from core client for 30 sec - exiting 15:18:33 (7608): No heartbeat from core client for 30 sec - exiting 15:18:34 (7608): No heartbeat from core client for 30 sec - exiting 15:18:35 (7608): No heartbeat from core client for 30 sec - exiting 15:18:36 (7608): No heartbeat from core client for 30 sec - exiting 15:18:37 (7608): No heartbeat from core client for 30 sec - exiting 15:18:38 (7608): No heartbeat from core client for 30 sec - exiting 15:18:39 (7608): No heartbeat from core client for 30 sec - exiting 15:18:41 (7608): No heartbeat from core client for 30 sec - exiting 15:18:42 (7608): No heartbeat from core client for 30 sec - exiting 15:18:43 (7608): No heartbeat from core client for 30 sec - exiting 15:18:44 (7608): No heartbeat from core client for 30 sec - exiting 15:18:45 (7608): No heartbeat from core client for 30 sec - exiting 15:18:46 (7608): No heartbeat from core client for 30 sec - exiting 15:18:47 (7608): No heartbeat from core client for 30 sec - exiting 15:18:48 (7608): No heartbeat from core client for 30 sec - exiting 15:18:49 (7608): No heartbeat from core client for 30 sec - exiting 15:18:50 (7608): No heartbeat from core client for 30 sec - exiting 15:18:52 (7608): No heartbeat from core client for 30 sec - exiting 15:18:53 (7608): No heartbeat from core client for 30 sec - exiting 15:18:54 (7608): No heartbeat from core client for 30 sec - exiting 15:18:55 (7608): No heartbeat from core client for 30 sec - exiting 15:18:56 (7608): No heartbeat from core client for 30 sec - exiting 15:18:57 (7608): No heartbeat from core client for 30 sec - exiting 15:18:58 (7608): No heartbeat from core client for 30 sec - exiting 15:19:00 (7608): No heartbeat from core client for 30 sec - exiting 15:19:01 (7608): No heartbeat from core client for 30 sec - exiting 15:19:02 (7608): No heartbeat from core client for 30 sec - exiting 15:19:03 (7608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:19:04 (7608): No heartbeat from core client for 30 sec - exiting 15:19:06 (7608): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5348, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5348, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5348, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5348, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5348, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5348, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Oct 2013 14:16:06	731465	16037368	hadcm3n_o8xy_1900_40_008466713_0	181,440	250,424	1.3802
14 Oct 2013 13:55:43	731465	16037368	hadcm3n_o8xy_1900_40_008466713_0	155,520	214,650	1.3802
13 Oct 2013 15:04:44	731465	16037368	hadcm3n_o8xy_1900_40_008466713_0	129,600	178,250	1.3754
12 Oct 2013 14:32:20	731465	16037368	hadcm3n_o8xy_1900_40_008466713_0	103,680	142,757	1.3769
11 Oct 2013 13:56:40	731465	16037368	hadcm3n_o8xy_1900_40_008466713_0	77,760	112,908	1.4520
10 Oct 2013 03:53:29	731465	16037368	hadcm3n_o8xy_1900_40_008466713_0	51,840	75,232	1.4512
08 Oct 2013 20:06:28	731465	16037368	hadcm3n_o8xy_1900_40_008466713_0	25,920	37,639	1.4521