Task 15182122

Name	hadcm3n_o31d_2100_40_008049609_4
Workunit	8204723
Created	24 Aug 2012, 8:30:34 UTC
Sent	24 Aug 2012, 8:31:05 UTC
Report deadline	23 Nov 2012, 15:58:16 UTC
Received	16 Sep 2012, 16:51:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1231079
Run time	4 days 11 hours 37 min 26 sec
CPU time	4 days 11 hours 37 min 26 sec
Validate state	Invalid
Credit	3,421.44
Device peak FLOPS	3.25 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>5.10.45</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 15:18:42 (5140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:19:34 (604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:19:10 (4796): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 19:19:12 (4796): No heartbeat from core client for 30 sec - exiting 19:19:13 (4796): No heartbeat from core client for 30 sec - exiting 19:19:14 (4796): No heartbeat from core client for 30 sec - exiting 19:19:15 (4796): No heartbeat from core client for 30 sec - exiting 19:19:16 (4796): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 22:49:57 (4492): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 00:52:34 (5860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:52:36 (5860): No heartbeat from core client for 30 sec - exiting 00:52:37 (5860): No heartbeat from core client for 30 sec - exiting 00:52:38 (5860): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 03:49:20 (4932): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 03:49:23 (4932): No heartbeat from core client for 30 sec - exiting 03:49:24 (4932): No heartbeat from core client for 30 sec - exiting 03:49:25 (4932): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 13:21:47 (6036): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 13:21:50 (6036): No heartbeat from core client for 30 sec - exiting 13:21:51 (6036): No heartbeat from core client for 30 sec - exiting 15:15:55 (5792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:15:57 (5792): No heartbeat from core client for 30 sec - exiting 15:15:58 (5792): No heartbeat from core client for 30 sec - exiting 15:15:59 (5792): No heartbeat from core client for 30 sec - exiting 15:16:00 (5792): No heartbeat from core client for 30 sec - exiting 15:16:01 (5792): No heartbeat from core client for 30 sec - exiting 15:16:02 (5792): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 18:25:15 (1380): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 18:25:17 (1380): No heartbeat from core client for 30 sec - exiting 18:25:18 (1380): No heartbeat from core client for 30 sec - exiting 18:25:19 (1380): No heartbeat from core client for 30 sec - exiting 18:25:20 (1380): No heartbeat from core client for 30 sec - exiting 18:25:21 (1380): No heartbeat from core client for 30 sec - exiting 18:25:22 (1380): No heartbeat from core client for 30 sec - exiting 13:01:18 (3492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:01:20 (3492): No heartbeat from core client for 30 sec - exiting 13:01:21 (3492): No heartbeat from core client for 30 sec - exiting 13:01:22 (3492): No heartbeat from core client for 30 sec - exiting 13:01:23 (3492): No heartbeat from core client for 30 sec - exiting 13:01:24 (3492): No heartbeat from core client for 30 sec - exiting 13:02:18 (3140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:50:57 (1204): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 15:51:02 (1204): No heartbeat from core client for 30 sec - exiting 15:51:03 (1204): No heartbeat from core client for 30 sec - exiting 15:51:04 (1204): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 02:17:00 (1008): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 02:17:02 (1008): No heartbeat from core client for 30 sec - exiting 02:17:03 (1008): No heartbeat from core client for 30 sec - exiting 02:17:04 (1008): No heartbeat from core client for 30 sec - exiting 02:17:05 (1008): No heartbeat from core client for 30 sec - exiting 02:17:06 (1008): No heartbeat from core client for 30 sec - exiting 04:12:37 (4456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:08:24 (4700): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 07:08:25 (4700): No heartbeat from core client for 30 sec - exiting 16:15:03 (4500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:37:12 (2000): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:57:28 (2512): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 20:57:30 (2512): No heartbeat from core client for 30 sec - exiting 20:57:31 (2512): No heartbeat from core client for 30 sec - exiting 20:57:32 (2512): No heartbeat from core client for 30 sec - exiting 20:57:33 (2512): No heartbeat from core client for 30 sec - exiting 20:57:34 (2512): No heartbeat from core client for 30 sec - exiting 20:57:35 (2512): No heartbeat from core client for 30 sec - exiting 20:57:36 (2512): No heartbeat from core client for 30 sec - exiting 23:13:40 (3604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:13:43 (3604): No heartbeat from core client for 30 sec - exiting 23:13:44 (3604): No heartbeat from core client for 30 sec - exiting 23:13:45 (3604): No heartbeat from core client for 30 sec - exiting CreateProcess failed: 'The system cannot find the path specified. (0x3)' Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:01:13 (6876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:01:14 (6876): No heartbeat from core client for 30 sec - exiting 12:01:16 (6876): No heartbeat from core client for 30 sec - exiting 12:01:17 (6876): No heartbeat from core client for 30 sec - exiting 12:01:18 (6876): No heartbeat from core client for 30 sec - exiting 12:01:19 (6876): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:52:29 (7168): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 09:52:30 (7168): No heartbeat from core client for 30 sec - exiting 09:52:31 (7168): No heartbeat from core client for 30 sec - exiting 09:52:32 (7168): No heartbeat from core client for 30 sec - exiting 09:52:33 (7168): No heartbeat from core client for 30 sec - exiting 09:52:34 (7168): No heartbeat from core client for 30 sec - exiting 02:20:28 (7360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:20:30 (7360): No heartbeat from core client for 30 sec - exiting 03:11:16 (6380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:11:17 (6380): No heartbeat from core client for 30 sec - exiting 03:11:18 (6380): No heartbeat from core client for 30 sec - exiting 03:11:19 (6380): No heartbeat from core client for 30 sec - exiting 03:11:20 (6380): No heartbeat from core client for 30 sec - exiting 03:11:21 (6380): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 04:13:57 (5716): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 04:13:58 (5716): No heartbeat from core client for 30 sec - exiting 04:13:59 (5716): No heartbeat from core client for 30 sec - exiting 04:14:00 (5716): No heartbeat from core client for 30 sec - exiting 04:14:01 (5716): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:36:00 (7596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:36:02 (7596): No heartbeat from core client for 30 sec - exiting 19:36:03 (7596): No heartbeat from core client for 30 sec - exiting 19:36:04 (7596): No heartbeat from core client for 30 sec - exiting 19:36:05 (7596): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:01:16 (7812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:01:18 (7812): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:28:16 (6868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:28:18 (6868): No heartbeat from core client for 30 sec - exiting 23:28:19 (6868): No heartbeat from core client for 30 sec - exiting 23:28:20 (6868): No heartbeat from core client for 30 sec - exiting 23:28:21 (6868): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:34:47 (5468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:34:50 (5468): No heartbeat from core client for 30 sec - exiting 08:34:51 (5468): No heartbeat from core client for 30 sec - exiting 08:34:52 (5468): No heartbeat from core client for 30 sec - exiting 08:34:53 (5468): No heartbeat from core client for 30 sec - exiting 08:34:54 (5468): No heartbeat from core client for 30 sec - exiting 08:34:55 (5468): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:58:01 (6768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:58:04 (6768): No heartbeat from core client for 30 sec - exiting 02:58:05 (6768): No heartbeat from core client for 30 sec - exiting 02:58:06 (6768): No heartbeat from core client for 30 sec - exiting 02:58:07 (6768): No heartbeat from core client for 30 sec - exiting 02:58:08 (6768): No heartbeat from core client for 30 sec - exiting 02:58:09 (6768): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 11:25:27 (7720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:25:28 (7720): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 20:57:00 (7064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:57:01 (7064): No heartbeat from core client for 30 sec - exiting 20:57:02 (7064): No heartbeat from core client for 30 sec - exiting 20:57:03 (7064): No heartbeat from core client for 30 sec - exiting 20:57:04 (7064): No heartbeat from core client for 30 sec - exiting 20:57:05 (7064): No heartbeat from core client for 30 sec - exiting 21:12:10 (5696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:01:12 (6412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:01:13 (6412): No heartbeat from core client for 30 sec - exiting 10:01:14 (6412): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 12:47:17 (5336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:47:19 (5336): No heartbeat from core client for 30 sec - exiting 12:47:20 (5336): No heartbeat from core client for 30 sec - exiting 12:48:30 (2728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:24:45 (6688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:24:47 (6688): No heartbeat from core client for 30 sec - exiting 18:24:48 (6688): No heartbeat from core client for 30 sec - exiting 18:24:49 (6688): No heartbeat from core client for 30 sec - exiting 18:24:50 (6688): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 22:34:45 (3872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:34:47 (3872): No heartbeat from core client for 30 sec - exiting 22:34:48 (3872): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 23:56:41 (8148): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 23:56:46 (8148): No heartbeat from core client for 30 sec - exiting 23:56:48 (8148): No heartbeat from core client for 30 sec - exiting 23:56:49 (8148): No heartbeat from core client for 30 sec - exiting 23:56:50 (8148): No heartbeat from core client for 30 sec - exiting 23:56:51 (8148): No heartbeat from core client for 30 sec - exiting 23:56:52 (8148): No heartbeat from core client for 30 sec - exiting 08:43:18 (6320): No heartbeat from core client for 30 sec - exiting 08:43:19 (6320): No heartbeat from core client for 30 sec - exiting 08:43:20 (6320): No heartbeat from core client for 30 sec - exiting 08:43:21 (6320): No heartbeat from core client for 30 sec - exiting 08:43:22 (6320): No heartbeat from core client for 30 sec - exiting 08:43:23 (6320): No heartbeat from core client for 30 sec - exiting 08:43:24 (6320): No heartbeat from core client for 30 sec - exiting 08:43:25 (6320): No heartbeat from core client for 30 sec - exiting 08:43:26 (6320): No heartbeat from core client for 30 sec - exiting 08:43:27 (6320): No heartbeat from core client for 30 sec - exiting 08:43:28 (6320): No heartbeat from core client for 30 sec - exiting 08:43:29 (6320): No heartbeat from core client for 30 sec - exiting 08:43:30 (6320): No heartbeat from core client for 30 sec - exiting 08:43:31 (6320): No heartbeat from core client for 30 sec - exiting 08:43:32 (6320): No heartbeat from core client for 30 sec - exiting 08:43:33 (6320): No heartbeat from core client for 30 sec - exiting 08:43:34 (6320): No heartbeat from core client for 30 sec - exiting 08:43:35 (6320): No heartbeat from core client for 30 sec - exiting 08:43:37 (6320): No heartbeat from core client for 30 sec - exiting 08:43:38 (6320): No heartbeat from core client for 30 sec - exiting 08:43:39 (6320): No heartbeat from core client for 30 sec - exiting 08:43:40 (6320): No heartbeat from core client for 30 sec - exiting 08:43:41 (6320): No heartbeat from core client for 30 sec - exiting 08:43:42 (6320): No heartbeat from core client for 30 sec - exiting 08:43:43 (6320): No heartbeat from core client for 30 sec - exiting 08:43:44 (6320): No heartbeat from core client for 30 sec - exiting 08:43:45 (6320): No heartbeat from core client for 30 sec - exiting 08:43:46 (6320): No heartbeat from core client for 30 sec - exiting 08:43:47 (6320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:43:49 (6320): No heartbeat from core client for 30 sec - exiting 09:10:02 (6224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:10:05 (6224): No heartbeat from core client for 30 sec - exiting 09:10:06 (6224): No heartbeat from core client for 30 sec - exiting 09:10:07 (6224): No heartbeat from core client for 30 sec - exiting 09:10:08 (6224): No heartbeat from core client for 30 sec - exiting 09:10:09 (6224): No heartbeat from core client for 30 sec - exiting 09:10:10 (6224): No heartbeat from core client for 30 sec - exiting 09:10:11 (6224): No heartbeat from core client for 30 sec - exiting Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7188, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7188, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7188, iMonCtr=1 Model crash detected, will try to restart... 09:44:16 (7188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:44:18 (7188): No heartbeat from core client for 30 sec - exiting Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7148, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7148, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7148, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Sep 2012 01:10:20	1231079	15182122	hadcm3n_o31d_2100_40_008049609_4	285,120	362,152	1.2702
12 Sep 2012 00:52:44	1231079	15182122	hadcm3n_o31d_2100_40_008049609_4	259,200	329,831	1.2725
10 Sep 2012 15:03:46	1231079	15182122	hadcm3n_o31d_2100_40_008049609_4	233,280	297,059	1.2734
09 Sep 2012 17:29:38	1231079	15182122	hadcm3n_o31d_2100_40_008049609_4	207,360	264,909	1.2775
08 Sep 2012 17:10:37	1231079	15182122	hadcm3n_o31d_2100_40_008049609_4	181,440	232,968	1.2840
07 Sep 2012 17:40:32	1231079	15182122	hadcm3n_o31d_2100_40_008049609_4	155,520	200,627	1.2900
06 Sep 2012 19:18:36	1231079	15182122	hadcm3n_o31d_2100_40_008049609_4	129,600	167,612	1.2933
05 Sep 2012 07:40:16	1231079	15182122	hadcm3n_o31d_2100_40_008049609_4	103,680	134,355	1.2959
04 Sep 2012 10:41:29	1231079	15182122	hadcm3n_o31d_2100_40_008049609_4	77,760	100,979	1.2986
03 Sep 2012 12:22:03	1231079	15182122	hadcm3n_o31d_2100_40_008049609_4	51,840	67,898	1.3098
27 Aug 2012 11:42:03	1231079	15182122	hadcm3n_o31d_2100_40_008049609_4	25,920	33,974	1.3107