Task 13370917

Name	hadcm3n_t2dv_1940_40_007452164_1
Workunit	7649667
Created	10 Sep 2011, 12:45:07 UTC
Sent	11 Sep 2011, 13:33:07 UTC
Report deadline	11 Dec 2011, 21:00:18 UTC
Received	4 Dec 2011, 8:32:42 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	990394
Run time	76 days 5 hours 51 min 54 sec
CPU time	61 days 16 hours 43 min 34 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.32 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:08:55 (1864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:14:36 (1064): Can't acquire lockfile (32) - waiting 35s 01:15:09 (5880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:51:42 (1064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:53:53 (5496): No heartbeat from core client for 30 sec - exiting 13:53:54 (5496): No heartbeat from core client for 30 sec - exiting 13:53:55 (5496): No heartbeat from core client for 30 sec - exiting 13:53:56 (5496): No heartbeat from core client for 30 sec - exiting 13:53:57 (5496): No heartbeat from core client for 30 sec - exiting 13:53:58 (5496): No heartbeat from core client for 30 sec - exiting 13:53:59 (5496): No heartbeat from core client for 30 sec - exiting 13:54:00 (5496): No heartbeat from core client for 30 sec - exiting 13:54:01 (5496): No heartbeat from core client for 30 sec - exiting 13:54:02 (5496): No heartbeat from core client for 30 sec - exiting 13:54:03 (5496): No heartbeat from core client for 30 sec - exiting 13:54:04 (5496): No heartbeat from core client for 30 sec - exiting 13:54:05 (5496): No heartbeat from core client for 30 sec - exiting 13:54:06 (5496): No heartbeat from core client for 30 sec - exiting 13:54:07 (5496): No heartbeat from core client for 30 sec - exiting 13:54:08 (5496): No heartbeat from core client for 30 sec - exiting 13:54:09 (5496): No heartbeat from core client for 30 sec - exiting 13:54:10 (5496): No heartbeat from core client for 30 sec - exiting 13:54:11 (5496): No heartbeat from core client for 30 sec - exiting 13:54:12 (5496): No heartbeat from core client for 30 sec - exiting 13:54:13 (5496): No heartbeat from core client for 30 sec - exiting 13:54:14 (5496): No heartbeat from core client for 30 sec - exiting 13:54:15 (5496): No heartbeat from core client for 30 sec - exiting 13:54:16 (5496): No heartbeat from core client for 30 sec - exiting 13:54:17 (5496): No heartbeat from core client for 30 sec - exiting 13:54:18 (5496): No heartbeat from core client for 30 sec - exiting 13:54:19 (5496): No heartbeat from core client for 30 sec - exiting 13:54:20 (5496): No heartbeat from core client for 30 sec - exiting 13:54:21 (5496): No heartbeat from core client for 30 sec - exiting 13:54:22 (5496): No heartbeat from core client for 30 sec - exiting 13:54:23 (5496): No heartbeat from core client for 30 sec - exiting 13:54:24 (5496): No heartbeat from core client for 30 sec - exiting 13:54:25 (5496): No heartbeat from core client for 30 sec - exiting 13:54:26 (5496): No heartbeat from core client for 30 sec - exiting 13:54:27 (5496): No heartbeat from core client for 30 sec - exiting 13:54:28 (5496): No heartbeat from core client for 30 sec - exiting 13:54:29 (5496): No heartbeat from core client for 30 sec - exiting 13:54:30 (5496): No heartbeat from core client for 30 sec - exiting 13:54:31 (5496): No heartbeat from core client for 30 sec - exiting 13:54:32 (5496): No heartbeat from core client for 30 sec - exiting 13:54:33 (5496): No heartbeat from core client for 30 sec - exiting 13:54:34 (5496): No heartbeat from core client for 30 sec - exiting 13:54:35 (5496): No heartbeat from core client for 30 sec - exiting 13:54:36 (5496): No heartbeat from core client for 30 sec - exiting 13:54:37 (5496): No heartbeat from core client for 30 sec - exiting 13:54:38 (5496): No heartbeat from core client for 30 sec - exiting 13:54:39 (5496): No heartbeat from core client for 30 sec - exiting 13:54:40 (5496): No heartbeat from core client for 30 sec - exiting 13:54:41 (5496): No heartbeat from core client for 30 sec - exiting 13:54:42 (5496): No heartbeat from core client for 30 sec - exiting 13:54:43 (5496): No heartbeat from core client for 30 sec - exiting 13:54:44 (5496): No heartbeat from core client for 30 sec - exiting 13:54:45 (5496): No heartbeat from core client for 30 sec - exiting 13:54:46 (5496): No heartbeat from core client for 30 sec - exiting 13:54:47 (5496): No heartbeat from core client for 30 sec - exiting 13:54:48 (5496): No heartbeat from core client for 30 sec - exiting 13:54:49 (5496): No heartbeat from core client for 30 sec - exiting 13:54:50 (5496): No heartbeat from core client for 30 sec - exiting 13:54:51 (5496): No heartbeat from core client for 30 sec - exiting 13:54:52 (5496): No heartbeat from core client for 30 sec - exiting 13:54:53 (5496): No heartbeat from core client for 30 sec - exiting 13:54:54 (5496): No heartbeat from core client for 30 sec - exiting 13:54:55 (5496): No heartbeat from core client for 30 sec - exiting 13:54:56 (5496): No heartbeat from core client for 30 sec - exiting 13:54:57 (5496): No heartbeat from core client for 30 sec - exiting 13:54:58 (5496): No heartbeat from core client for 30 sec - exiting 13:54:59 (5496): No heartbeat from core client for 30 sec - exiting 13:55:00 (5496): No heartbeat from core client for 30 sec - exiting 13:55:01 (5496): No heartbeat from core client for 30 sec - exiting 13:55:02 (5496): No heartbeat from core client for 30 sec - exiting 13:55:03 (5496): No heartbeat from core client for 30 sec - exiting 13:55:04 (5496): No heartbeat from core client for 30 sec - exiting 13:55:05 (5496): No heartbeat from core client for 30 sec - exiting 13:55:06 (5496): No heartbeat from core client for 30 sec - exiting 13:55:07 (5496): No heartbeat from core client for 30 sec - exiting 13:55:08 (5496): No heartbeat from core client for 30 sec - exiting 13:55:09 (5496): No heartbeat from core client for 30 sec - exiting 13:55:10 (5496): No heartbeat from core client for 30 sec - exiting 13:55:11 (5496): No heartbeat from core client for 30 sec - exiting 13:55:12 (5496): No heartbeat from core client for 30 sec - exiting 13:55:14 (5496): No heartbeat from core client for 30 sec - exiting 13:55:15 (5496): No heartbeat from core client for 30 sec - exiting 13:55:16 (5496): No heartbeat from core client for 30 sec - exiting 13:55:17 (5496): No heartbeat from core client for 30 sec - exiting 13:55:18 (5496): No heartbeat from core client for 30 sec - exiting 13:55:19 (5496): No heartbeat from core client for 30 sec - exiting 13:55:20 (5496): No heartbeat from core client for 30 sec - exiting 13:55:21 (5496): No heartbeat from core client for 30 sec - exiting 13:55:22 (5496): No heartbeat from core client for 30 sec - exiting 13:55:23 (5496): No heartbeat from core client for 30 sec - exiting 13:55:24 (5496): No heartbeat from core client for 30 sec - exiting 13:55:25 (5496): No heartbeat from core client for 30 sec - exiting 13:55:26 (5496): No heartbeat from core client for 30 sec - exiting 13:55:27 (5496): No heartbeat from core client for 30 sec - exiting 13:55:28 (5496): No heartbeat from core client for 30 sec - exiting 13:55:29 (5496): No heartbeat from core client for 30 sec - exiting 13:55:30 (5496): No heartbeat from core client for 30 sec - exiting 13:55:31 (5496): No heartbeat from core client for 30 sec - exiting 13:55:32 (5496): No heartbeat from core client for 30 sec - exiting 13:55:33 (5496): No heartbeat from core client for 30 sec - exiting 13:55:34 (5496): No heartbeat from core client for 30 sec - exiting 13:55:35 (5496): No heartbeat from core client for 30 sec - exiting 13:55:36 (5496): No heartbeat from core client for 30 sec - exiting 13:55:37 (5496): No heartbeat from core client for 30 sec - exiting 13:55:38 (5496): No heartbeat from core client for 30 sec - exiting 13:55:39 (5496): No heartbeat from core client for 30 sec - exiting 13:55:40 (5496): No heartbeat from core client for 30 sec - exiting 13:55:41 (5496): No heartbeat from core client for 30 sec - exiting 13:55:42 (5496): No heartbeat from core client for 30 sec - exiting 13:55:43 (5496): No heartbeat from core client for 30 sec - exiting 13:55:44 (5496): No heartbeat from core client for 30 sec - exiting 13:55:45 (5496): No heartbeat from core client for 30 sec - exiting 13:55:46 (5496): No heartbeat from core client for 30 sec - exiting 13:55:47 (5496): No heartbeat from core client for 30 sec - exiting 13:55:48 (5496): No heartbeat from core client for 30 sec - exiting 13:55:49 (5496): No heartbeat from core client for 30 sec - exiting 13:55:50 (5496): No heartbeat from core client for 30 sec - exiting 13:55:51 (5496): No heartbeat from core client for 30 sec - exiting 13:55:52 (5496): No heartbeat from core client for 30 sec - exiting 13:55:53 (5496): No heartbeat from core client for 30 sec - exiting 13:55:54 (5496): No heartbeat from core client for 30 sec - exiting 13:55:55 (5496): No heartbeat from core client for 30 sec - exiting 13:55:56 (5496): No heartbeat from core client for 30 sec - exiting 13:55:57 (5496): No heartbeat from core client for 30 sec - exiting 13:55:58 (5496): No heartbeat from core client for 30 sec - exiting 13:55:59 (5496): No heartbeat from core client for 30 sec - exiting 13:56:00 (5496): No heartbeat from core client for 30 sec - exiting 13:56:01 (5496): No heartbeat from core client for 30 sec - exiting 13:56:02 (5496): No heartbeat from core client for 30 sec - exiting 13:56:03 (5496): No heartbeat from core client for 30 sec - exiting 13:56:04 (5496): No heartbeat from core client for 30 sec - exiting 13:56:05 (5496): No heartbeat from core client for 30 sec - exiting 13:56:06 (5496): No heartbeat from core client for 30 sec - exiting 13:56:07 (5496): No heartbeat from core client for 30 sec - exiting 13:56:08 (5496): No heartbeat from core client for 30 sec - exiting 13:56:09 (5496): No heartbeat from core client for 30 sec - exiting 13:56:10 (5496): No heartbeat from core client for 30 sec - exiting 13:56:11 (5496): No heartbeat from core client for 30 sec - exiting 13:56:12 (5496): No heartbeat from core client for 30 sec - exiting 13:56:13 (5496): No heartbeat from core client for 30 sec - exiting 13:56:14 (5496): No heartbeat from core client for 30 sec - exiting 13:56:15 (5496): No heartbeat from core client for 30 sec - exiting 13:56:16 (5496): No heartbeat from core client for 30 sec - exiting 13:56:17 (5496): No heartbeat from core client for 30 sec - exiting 13:56:18 (5496): No heartbeat from core client for 30 sec - exiting 13:56:19 (5496): No heartbeat from core client for 30 sec - exiting 13:56:20 (5496): No heartbeat from core client for 30 sec - exiting 13:56:21 (5496): No heartbeat from core client for 30 sec - exiting 13:56:22 (5496): No heartbeat from core client for 30 sec - exiting 13:56:23 (5496): No heartbeat from core client for 30 sec - exiting 13:56:24 (5496): No heartbeat from core client for 30 sec - exiting 13:56:25 (5496): No heartbeat from core client for 30 sec - exiting 13:56:26 (5496): No heartbeat from core client for 30 sec - exiting 13:56:27 (5496): No heartbeat from core client for 30 sec - exiting 13:56:28 (5496): No heartbeat from core client for 30 sec - exiting 13:56:29 (5496): No heartbeat from core client for 30 sec - exiting 13:56:30 (5496): No heartbeat from core client for 30 sec - exiting 13:56:31 (5496): No heartbeat from core client for 30 sec - exiting 13:56:32 (5496): No heartbeat from core client for 30 sec - exiting 13:56:33 (5496): No heartbeat from core client for 30 sec - exiting 13:56:34 (5496): No heartbeat from core client for 30 sec - exiting 13:56:35 (5496): No heartbeat from core client for 30 sec - exiting 13:56:36 (5496): No heartbeat from core client for 30 sec - exiting 13:56:37 (5496): No heartbeat from core client for 30 sec - exiting 13:56:38 (5496): No heartbeat from core client for 30 sec - exiting 13:56:39 (5496): No heartbeat from core client for 30 sec - exiting 13:56:40 (5496): No heartbeat from core client for 30 sec - exiting 13:56:41 (5496): No heartbeat from core client for 30 sec - exiting 13:56:42 (5496): No heartbeat from core client for 30 sec - exiting 13:56:43 (5496): No heartbeat from core client for 30 sec - exiting 13:56:44 (5496): No heartbeat from core client for 30 sec - exiting 13:56:45 (5496): No heartbeat from core client for 30 sec - exiting 13:56:46 (5496): No heartbeat from core client for 30 sec - exiting 13:56:47 (5496): No heartbeat from core client for 30 sec - exiting 13:56:48 (5496): No heartbeat from core client for 30 sec - exiting 13:56:49 (5496): No heartbeat from core client for 30 sec - exiting 13:56:50 (5496): No heartbeat from core client for 30 sec - exiting 13:56:51 (5496): No heartbeat from core client for 30 sec - exiting 13:56:52 (5496): No heartbeat from core client for 30 sec - exiting 13:56:53 (5496): No heartbeat from core client for 30 sec - exiting 13:56:54 (5496): No heartbeat from core client for 30 sec - exiting 13:56:55 (5496): No heartbeat from core client for 30 sec - exiting 13:56:56 (5496): No heartbeat from core client for 30 sec - exiting 13:56:57 (5496): No heartbeat from core client for 30 sec - exiting 13:56:58 (5496): No heartbeat from core client for 30 sec - exiting 13:56:59 (5496): No heartbeat from core client for 30 sec - exiting 13:57:00 (5496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:29:53 (5228): Can't acquire lockfile (32) - waiting 35s 00:30:05 (3964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5228, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5228, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:54:36 (2456): Can't acquire lockfile (32) - waiting 35s 12:54:54 (5128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:16:10 (2764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:54:33 (748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:50:43 (1964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6032, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:14:54 (2256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:10:59 (524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:41:19 (4072): Can't acquire lockfile (32) - waiting 35s 09:41:20 (2888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:30:14 (4996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2276, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2716, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:39:20 (2116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:30:20 (5472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Dec 2011 07:34:39	990394	13370917	hadcm3n_t2dv_1940_40_007452164_1	1,036,800	5,328,768	5.1396
02 Dec 2011 00:54:49	990394	13370917	hadcm3n_t2dv_1940_40_007452164_1	1,010,880	5,187,114	5.1313
29 Nov 2011 21:42:59	990394	13370917	hadcm3n_t2dv_1940_40_007452164_1	984,960	5,044,580	5.1216
27 Nov 2011 19:50:44	990394	13370917	hadcm3n_t2dv_1940_40_007452164_1	959,040	4,908,286	5.1179
25 Nov 2011 21:21:16	990394	13370917	hadcm3n_t2dv_1940_40_007452164_1	933,120	4,777,997	5.1205
23 Nov 2011 14:38:41	990394	13370917	hadcm3n_t2dv_1940_40_007452164_1	907,200	4,652,581	5.1285
21 Nov 2011 17:15:45	990394	13370917	hadcm3n_t2dv_1940_40_007452164_1	881,280	4,525,211	5.1348
19 Nov 2011 16:45:49	990394	13370917	hadcm3n_t2dv_1940_40_007452164_1	855,360	4,397,190	5.1407
17 Nov 2011 22:21:09	990394	13370917	hadcm3n_t2dv_1940_40_007452164_1	829,440	4,270,812	5.1490
15 Nov 2011 23:55:53	990394	13370917	hadcm3n_t2dv_1940_40_007452164_1	803,520	4,146,034	5.1598
15 Nov 2011 20:07:38	990394	13370917	hadcm3n_t2dv_1940_40_007452164_1	777,600	4,025,073	5.1763
15 Nov 2011 20:07:38	990394	13370917	hadcm3n_t2dv_1940_40_007452164_1	751,680	3,896,475	5.1837
15 Nov 2011 20:07:38	990394	13370917	hadcm3n_t2dv_1940_40_007452164_1	725,760	3,771,110	5.1961
08 Nov 2011 14:12:46	990394	13370917	hadcm3n_t2dv_1940_40_007452164_1	699,840	3,642,625	5.2049
06 Nov 2011 20:03:36	990394	13370917	hadcm3n_t2dv_1940_40_007452164_1	673,920	3,519,414	5.2223
04 Nov 2011 20:37:23	990394	13370917	hadcm3n_t2dv_1940_40_007452164_1	648,000	3,382,407	5.2198
02 Nov 2011 18:48:18	990394	13370917	hadcm3n_t2dv_1940_40_007452164_1	622,080	3,244,857	5.2161
31 Oct 2011 20:03:32	990394	13370917	hadcm3n_t2dv_1940_40_007452164_1	596,160	3,106,786	5.2113
31 Oct 2011 18:42:29	990394	13370917	hadcm3n_t2dv_1940_40_007452164_1	570,240	2,971,044	5.2102
31 Oct 2011 17:15:36	990394	13370917	hadcm3n_t2dv_1940_40_007452164_1	544,320	2,829,598	5.1984