Task 13349200

Name	hadcm3n_o4ev_1940_40_007443551_0
Workunit	7641054
Created	9 Sep 2011, 0:07:28 UTC
Sent	9 Sep 2011, 0:08:50 UTC
Report deadline	9 Dec 2011, 7:36:01 UTC
Received	25 Sep 2011, 18:34:26 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1158773
Run time	12 days 16 hours 11 min 8 sec
CPU time	10 days 9 hours 59 min 12 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.31 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:36:44 (4064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:16:20 (768): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:12:49 (4584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:12:59 (4584): No heartbeat from core client for 30 sec - exiting 14:13:02 (4584): No heartbeat from core client for 30 sec - exiting 14:13:03 (4584): No heartbeat from core client for 30 sec - exiting 14:13:04 (4584): No heartbeat from core client for 30 sec - exiting 14:13:05 (4584): No heartbeat from core client for 30 sec - exiting 14:13:06 (4584): No heartbeat from core client for 30 sec - exiting 14:13:07 (4584): No heartbeat from core client for 30 sec - exiting 14:13:08 (4584): No heartbeat from core client for 30 sec - exiting 14:13:09 (4584): No heartbeat from core client for 30 sec - exiting 14:13:10 (4584): No heartbeat from core client for 30 sec - exiting 14:13:11 (4584): No heartbeat from core client for 30 sec - exiting 14:13:12 (4584): No heartbeat from core client for 30 sec - exiting 14:13:13 (4584): No heartbeat from core client for 30 sec - exiting 14:13:14 (4584): No heartbeat from core client for 30 sec - exiting 14:13:15 (4584): No heartbeat from core client for 30 sec - exiting 14:28:23 (5692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:28:35 (5692): No heartbeat from core client for 30 sec - exiting 14:28:37 (5692): No heartbeat from core client for 30 sec - exiting 14:28:38 (5692): No heartbeat from core client for 30 sec - exiting 14:28:39 (5692): No heartbeat from core client for 30 sec - exiting 14:28:40 (5692): No heartbeat from core client for 30 sec - exiting 14:28:41 (5692): No heartbeat from core client for 30 sec - exiting 14:28:42 (5692): No heartbeat from core client for 30 sec - exiting 14:28:43 (5692): No heartbeat from core client for 30 sec - exiting 14:28:44 (5692): No heartbeat from core client for 30 sec - exiting 16:22:14 (2796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:22:22 (2796): No heartbeat from core client for 30 sec - exiting 16:22:24 (2796): No heartbeat from core client for 30 sec - exiting 16:22:25 (2796): No heartbeat from core client for 30 sec - exiting 16:22:27 (2796): No heartbeat from core client for 30 sec - exiting 16:22:28 (2796): No heartbeat from core client for 30 sec - exiting 16:22:29 (2796): No heartbeat from core client for 30 sec - exiting 16:22:30 (2796): No heartbeat from core client for 30 sec - exiting 16:22:31 (2796): No heartbeat from core client for 30 sec - exiting 16:22:32 (2796): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=216, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3768, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3732, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3844, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2380, iMonCtr=1 Model crash detected, will try to restart... 06:47:55 (3292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:20:37 (3404): No heartbeat from core client for 30 sec - exiting 15:20:38 (3404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:46:28 (3700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:46:29 (3700): No heartbeat from core client for 30 sec - exiting 17:46:43 (3616): No heartbeat from core client for 30 sec - exiting 17:46:44 (3616): No heartbeat from core client for 30 sec - exiting 17:46:45 (3616): No heartbeat from core client for 30 sec - exiting 17:46:46 (3616): No heartbeat from core client for 30 sec - exiting 17:46:47 (3616): No heartbeat from core client for 30 sec - exiting 17:46:48 (3616): No heartbeat from core client for 30 sec - exiting 17:46:49 (3616): No heartbeat from core client for 30 sec - exiting 17:46:50 (3616): No heartbeat from core client for 30 sec - exiting 17:46:52 (3616): No heartbeat from core client for 30 sec - exiting 17:46:53 (3616): No heartbeat from core client for 30 sec - exiting 17:46:54 (3616): No heartbeat from core client for 30 sec - exiting 17:46:55 (3616): No heartbeat from core client for 30 sec - exiting 17:46:56 (3616): No heartbeat from core client for 30 sec - exiting 17:46:57 (3616): No heartbeat from core client for 30 sec - exiting 17:46:58 (3616): No heartbeat from core client for 30 sec - exiting 17:46:59 (3616): No heartbeat from core client for 30 sec - exiting 17:47:00 (3616): No heartbeat from core client for 30 sec - exiting 17:47:01 (3616): No heartbeat from core client for 30 sec - exiting 17:47:02 (3616): No heartbeat from core client for 30 sec - exiting 17:47:04 (3616): No heartbeat from core client for 30 sec - exiting 17:47:05 (3616): No heartbeat from core client for 30 sec - exiting 17:47:06 (3616): No heartbeat from core client for 30 sec - exiting 17:47:07 (3616): No heartbeat from core client for 30 sec - exiting 17:47:08 (3616): No heartbeat from core client for 30 sec - exiting 17:47:09 (3616): No heartbeat from core client for 30 sec - exiting 17:47:10 (3616): No heartbeat from core client for 30 sec - exiting 17:47:11 (3616): No heartbeat from core client for 30 sec - exiting 17:47:12 (3616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:42:55 (4420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:42:56 (4420): No heartbeat from core client for 30 sec - exiting 19:43:58 (4996): No heartbeat from core client for 30 sec - exiting 19:44:00 (4996): No heartbeat from core client for 30 sec - exiting 19:44:01 (4996): No heartbeat from core client for 30 sec - exiting 19:44:02 (4996): No heartbeat from core client for 30 sec - exiting 19:44:03 (4996): No heartbeat from core client for 30 sec - exiting 19:44:04 (4996): No heartbeat from core client for 30 sec - exiting 19:44:05 (4996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:44:06 (4996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 02:58:08 (3340): No heartbeat from core client for 30 sec - exiting 02:58:09 (3340): No heartbeat from core client for 30 sec - exiting 02:58:10 (3340): No heartbeat from core client for 30 sec - exiting 02:58:11 (3340): No heartbeat from core client for 30 sec - exiting 02:58:12 (3340): No heartbeat from core client for 30 sec - exiting 02:58:13 (3340): No heartbeat from core client for 30 sec - exiting 02:58:14 (3340): No heartbeat from core client for 30 sec - exiting 02:58:15 (3340): No heartbeat from core client for 30 sec - exiting 02:58:16 (3340): No heartbeat from core client for 30 sec - exiting 02:58:17 (3340): No heartbeat from core client for 30 sec - exiting 02:58:18 (3340): No heartbeat from core client for 30 sec - exiting 02:58:19 (3340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3676, iMonCtr=1 Model crash detected, will try to restart... 03:50:59 (4408): No heartbeat from core client for 30 sec - exiting 03:51:00 (4408): No heartbeat from core client for 30 sec - exiting 03:51:01 (4408): No heartbeat from core client for 30 sec - exiting 03:51:03 (4408): No heartbeat from core client for 30 sec - exiting 03:51:04 (4408): No heartbeat from core client for 30 sec - exiting 03:51:05 (4408): No heartbeat from core client for 30 sec - exiting 03:51:06 (4408): No heartbeat from core client for 30 sec - exiting 03:51:07 (4408): No heartbeat from core client for 30 sec - exiting 03:51:08 (4408): No heartbeat from core client for 30 sec - exiting 03:51:09 (4408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Sep 2011 17:33:00	1158773	13349200	hadcm3n_o4ev_1940_40_007443551_0	518,400	899,933	1.7360
24 Sep 2011 21:20:48	1158773	13349200	hadcm3n_o4ev_1940_40_007443551_0	492,480	855,068	1.7362
24 Sep 2011 01:16:29	1158773	13349200	hadcm3n_o4ev_1940_40_007443551_0	466,560	810,210	1.7366
23 Sep 2011 06:04:49	1158773	13349200	hadcm3n_o4ev_1940_40_007443551_0	440,640	765,339	1.7369
22 Sep 2011 13:31:56	1158773	13349200	hadcm3n_o4ev_1940_40_007443551_0	414,720	720,784	1.7380
21 Sep 2011 21:15:15	1158773	13349200	hadcm3n_o4ev_1940_40_007443551_0	388,800	676,449	1.7398
21 Sep 2011 07:05:22	1158773	13349200	hadcm3n_o4ev_1940_40_007443551_0	362,880	630,630	1.7378
20 Sep 2011 16:56:54	1158773	13349200	hadcm3n_o4ev_1940_40_007443551_0	336,960	583,720	1.7323
20 Sep 2011 03:13:43	1158773	13349200	hadcm3n_o4ev_1940_40_007443551_0	311,040	539,086	1.7332
19 Sep 2011 10:39:36	1158773	13349200	hadcm3n_o4ev_1940_40_007443551_0	285,120	494,647	1.7349
18 Sep 2011 21:03:36	1158773	13349200	hadcm3n_o4ev_1940_40_007443551_0	259,200	450,687	1.7388
17 Sep 2011 17:41:49	1158773	13349200	hadcm3n_o4ev_1940_40_007443551_0	233,280	404,841	1.7354
15 Sep 2011 11:40:19	1158773	13349200	hadcm3n_o4ev_1940_40_007443551_0	207,360	358,928	1.7309
13 Sep 2011 11:46:22	1158773	13349200	hadcm3n_o4ev_1940_40_007443551_0	181,440	313,471	1.7277
12 Sep 2011 20:24:18	1158773	13349200	hadcm3n_o4ev_1940_40_007443551_0	155,520	268,267	1.7250
12 Sep 2011 05:26:00	1158773	13349200	hadcm3n_o4ev_1940_40_007443551_0	129,600	222,806	1.7192
11 Sep 2011 09:16:52	1158773	13349200	hadcm3n_o4ev_1940_40_007443551_0	103,680	177,298	1.7101
10 Sep 2011 17:14:19	1158773	13349200	hadcm3n_o4ev_1940_40_007443551_0	77,760	129,367	1.6637
10 Sep 2011 02:26:12	1158773	13349200	hadcm3n_o4ev_1940_40_007443551_0	51,840	84,869	1.6371
09 Sep 2011 13:05:22	1158773	13349200	hadcm3n_o4ev_1940_40_007443551_0	25,920	42,160	1.6265