Task 12887933

Name	hadcm3n_p1sb_1900_40_007219899_2
Workunit	7418139
Created	16 May 2011, 13:58:22 UTC
Sent	16 May 2011, 13:58:31 UTC
Report deadline	15 Aug 2011, 21:25:42 UTC
Received	3 Aug 2011, 5:12:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	355916
Run time	51 days 4 hours 26 min 57 sec
CPU time	51 days 4 hours 26 min 57 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	1.59 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>5.2.13</core_client_version> <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:51:59 (3456): No heartbeat from core client for 30 sec - exiting 14:52:00 (3456): No heartbeat from core client for 30 sec - exiting 14:52:02 (3456): No heartbeat from core client for 30 sec - exiting 14:52:03 (3456): No heartbeat from core client for 30 sec - exiting 14:52:04 (3456): No heartbeat from core client for 30 sec - exiting 14:52:05 (3456): No heartbeat from core client for 30 sec - exiting 14:52:06 (3456): No heartbeat from core client for 30 sec - exiting 14:52:07 (3456): No heartbeat from core client for 30 sec - exiting 14:52:08 (3456): No heartbeat from core client for 30 sec - exiting 14:52:09 (3456): No heartbeat from core client for 30 sec - exiting 14:52:10 (3456): No heartbeat from core client for 30 sec - exiting 14:52:11 (3456): No heartbeat from core client for 30 sec - exiting 14:52:12 (3456): No heartbeat from core client for 30 sec - exiting 14:52:13 (3456): No heartbeat from core client for 30 sec - exiting 14:52:15 (3456): No heartbeat from core client for 30 sec - exiting 14:52:16 (3456): No heartbeat from core client for 30 sec - exiting 14:52:17 (3456): No heartbeat from core client for 30 sec - exiting 14:52:18 (3456): No heartbeat from core client for 30 sec - exiting 14:52:19 (3456): No heartbeat from core client for 30 sec - exiting 14:52:20 (3456): No heartbeat from core client for 30 sec - exiting 14:52:21 (3456): No heartbeat from core client for 30 sec - exiting 14:52:22 (3456): No heartbeat from core client for 30 sec - exiting 14:52:23 (3456): No heartbeat from core client for 30 sec - exiting 14:52:24 (3456): No heartbeat from core client for 30 sec - exiting 14:52:25 (3456): No heartbeat from core client for 30 sec - exiting 14:52:26 (3456): No heartbeat from core client for 30 sec - exiting 14:52:27 (3456): No heartbeat from core client for 30 sec - exiting 14:52:28 (3456): No heartbeat from core client for 30 sec - exiting 14:52:29 (3456): No heartbeat from core client for 30 sec - exiting 14:52:30 (3456): No heartbeat from core client for 30 sec - exiting 14:52:31 (3456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:52:32 (3456): No heartbeat from core client for 30 sec - exiting 14:52:33 (3456): No heartbeat from core client for 30 sec - exiting 14:52:34 (3456): No heartbeat from core client for 30 sec - exiting 14:52:35 (3456): No heartbeat from core client for 30 sec - exiting 14:52:37 (3456): No heartbeat from core client for 30 sec - exiting 14:52:38 (3456): No heartbeat from core client for 30 sec - exiting 14:52:39 (3456): No heartbeat from core client for 30 sec - exiting 14:52:40 (3456): No heartbeat from core client for 30 sec - exiting 14:52:42 (3456): No heartbeat from core client for 30 sec - exiting 14:52:43 (3456): No heartbeat from core client for 30 sec - exiting 22:53:27 (2744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3868, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 22:34:57 (1752): No heartbeat from core client for 30 sec - exiting 22:34:58 (1752): No heartbeat from core client for 30 sec - exiting 22:34:59 (1752): No heartbeat from core client for 30 sec - exiting 22:35:00 (1752): No heartbeat from core client for 30 sec - exiting 22:35:02 (1752): No heartbeat from core client for 30 sec - exiting 22:35:03 (1752): No heartbeat from core client for 30 sec - exiting 22:35:04 (1752): No heartbeat from core client for 30 sec - exiting 22:35:05 (1752): No heartbeat from core client for 30 sec - exiting 22:35:06 (1752): No heartbeat from core client for 30 sec - exiting 22:35:07 (1752): No heartbeat from core client for 30 sec - exiting 22:35:08 (1752): No heartbeat from core client for 30 sec - exiting 22:35:10 (1752): No heartbeat from core client for 30 sec - exiting 22:35:11 (1752): No heartbeat from core client for 30 sec - exiting 22:35:12 (1752): No heartbeat from core client for 30 sec - exiting 22:35:13 (1752): No heartbeat from core client for 30 sec - exiting 22:35:14 (1752): No heartbeat from core client for 30 sec - exiting 22:35:15 (1752): No heartbeat from core client for 30 sec - exiting 22:35:16 (1752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:25:35 (5880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:05:49 (3572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:07:23 (796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:13:11 (3636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:58:25 (3856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:04:53 (1144): No heartbeat from core client for 30 sec - exiting 15:04:54 (1144): No heartbeat from core client for 30 sec - exiting 15:04:55 (1144): No heartbeat from core client for 30 sec - exiting 15:04:56 (1144): No heartbeat from core client for 30 sec - exiting 15:04:57 (1144): No heartbeat from core client for 30 sec - exiting 15:04:58 (1144): No heartbeat from core client for 30 sec - exiting 15:04:59 (1144): No heartbeat from core client for 30 sec - exiting 15:05:00 (1144): No heartbeat from core client for 30 sec - exiting 15:05:01 (1144): No heartbeat from core client for 30 sec - exiting 15:05:02 (1144): No heartbeat from core client for 30 sec - exiting 15:05:03 (1144): No heartbeat from core client for 30 sec - exiting 15:05:04 (1144): No heartbeat from core client for 30 sec - exiting 15:05:05 (1144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:05:07 (1144):CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:41:04 (3228): No heartbeat from core client for 30 sec - exiting 15:41:05 (3228): No heartbeat from core client for 30 sec - exiting 15:41:06 (3228): No heartbeat from core client for 30 sec - exiting 15:41:07 (3228): No heartbeat from core client for 30 sec - exiting 15:41:08 (3228): No heartbeat from core client for 30 sec - exiting 15:41:09 (3228): No heartbeat from core client for 30 sec - exiting 15:41:10 (3228): No heartbeat from core client for 30 sec - exiting 15:41:11 (3228): No heartbeat from core client for 30 sec - exiting 15:41:12 (3228): No heartbeat from core client for 30 sec - exiting 15:41:13 (3228): No heartbeat from core client for 30 sec - exiting 15:41:14 (3228): No heartbeat from core client for 30 sec - exiting 15:41:15 (3228): No heartbeat from core client for 30 sec - exiting 15:41:16 (3228): No heartbeat from core client for 30 sec - exiting 15:41:17 (3228): No heartbeat from core client for 30 sec - exiting 15:41:18 (3228): No heartbeat from core client for 30 sec - exiting 15:41:19 (3228): No heartbeat from core client for 30 sec - exiting 15:41:20 (3228): No heartbeat from core client for 30 sec - exiting 15:41:21 (3228): No heartbeat from core client for 30 sec - exiting 15:41:23 (3228): No heartbeat from core client for 30 sec - exiting 15:41:24 (3228): No heartbeat from core client for 30 sec - exiting 15:41:25 (3228): No heartbeat from core client for 30 sec - exiting 15:41:26 (3228): No heartbeat from core client for 30 sec - exiting 15:41:27 (3228): No heartbeat from core client for 30 sec - exiting 15:41:28 (3228): No heartbeat from core client for 30 sec - exiting 15:41:29 (3228): No heartbeat from core client for 30 sec - exiting 15:41:30 (3228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:41:31 (3228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... 00:16:57 (3980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:39:33 (2460): No heartbeat from core client for 30 sec - exiting 22:39:34 (2460): No heartbeat from core client for 30 sec - exiting 22:39:35 (2460): No heartbeat from core client for 30 sec - exiting 22:39:36 (2460): No heartbeat from core client for 30 sec - exiting 22:39:37 (2460): No heartbeat from core client for 30 sec - exiting 22:39:38 (2460): No heartbeat from core client for 30 sec - exiting 22:39:39 (2460): No heartbeat from core client for 30 sec - exiting 22:39:40 (2460): No heartbeat from core client for 30 sec - exiting 22:39:41 (2460): No heartbeat from core client for 30 sec - exiting 22:39:42 (2460): No heartbeat from core client for 30 sec - exiting 22:39:43 (2460): No heartbeat from core client for 30 sec - exiting 22:39:44 (2460): No heartbeat from core client for 30 sec - exiting 22:39:45 (2460): No heartbeat from core client for 30 sec - exiting 22:39:46 (2460): No heartbeat from core client for 30 sec - exiting 22:39:47 (2460): No heartbeat from core client for 30 sec - exiting 22:39:48 (2460): No heartbeat from core client for 30 sec - exiting 22:39:49 (2460): No heartbeat from core client for 30 sec - exiting 22:39:50 (2460): No heartbeat from core client for 30 sec - exiting 22:39:51 (2460): No heartbeat from core client for 30 sec - exiting 22:39:52 (2460): No heartbeat from core client for 30 sec - exiting 22:39:53 (2460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:39:54 (2460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4120, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1612, selfPID=1612, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:31:58 (2892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4320, selfPID=4320, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Aug 2011 04:06:43	355916	12887933	hadcm3n_p1sb_1900_40_007219899_2	1,036,800	4,422,381	4.2654
31 Jul 2011 03:53:30	355916	12887933	hadcm3n_p1sb_1900_40_007219899_2	1,010,880	4,300,845	4.2546
27 Jul 2011 11:31:21	355916	12887933	hadcm3n_p1sb_1900_40_007219899_2	984,960	4,181,806	4.2457
25 Jul 2011 21:43:11	355916	12887933	hadcm3n_p1sb_1900_40_007219899_2	959,040	4,059,851	4.2332
25 Jul 2011 19:05:05	355916	12887933	hadcm3n_p1sb_1900_40_007219899_2	933,120	3,945,506	4.2283
25 Jul 2011 18:52:46	355916	12887933	hadcm3n_p1sb_1900_40_007219899_2	907,200	3,831,318	4.2232
25 Jul 2011 17:24:37	355916	12887933	hadcm3n_p1sb_1900_40_007219899_2	881,280	3,716,820	4.2175
25 Jul 2011 15:36:44	355916	12887933	hadcm3n_p1sb_1900_40_007219899_2	855,360	3,593,706	4.2014
25 Jul 2011 14:04:16	355916	12887933	hadcm3n_p1sb_1900_40_007219899_2	829,440	3,474,919	4.1895
25 Jul 2011 14:04:16	355916	12887933	hadcm3n_p1sb_1900_40_007219899_2	803,520	3,355,718	4.1763
25 Jul 2011 14:04:16	355916	12887933	hadcm3n_p1sb_1900_40_007219899_2	777,600	3,241,408	4.1685
09 Jul 2011 19:41:24	355916	12887933	hadcm3n_p1sb_1900_40_007219899_2	751,680	3,222,268	4.2868
08 Jul 2011 07:58:38	355916	12887933	hadcm3n_p1sb_1900_40_007219899_2	725,760	3,107,743	4.2821
07 Jul 2011 15:37:01	355916	12887933	hadcm3n_p1sb_1900_40_007219899_2	699,840	2,991,200	4.2741
04 Jul 2011 22:38:11	355916	12887933	hadcm3n_p1sb_1900_40_007219899_2	673,920	2,873,708	4.2642
03 Jul 2011 03:48:54	355916	12887933	hadcm3n_p1sb_1900_40_007219899_2	648,000	2,756,824	4.2544
01 Jul 2011 11:09:39	355916	12887933	hadcm3n_p1sb_1900_40_007219899_2	622,080	2,637,654	4.2401
29 Jun 2011 17:20:05	355916	12887933	hadcm3n_p1sb_1900_40_007219899_2	596,160	2,514,829	4.2184
28 Jun 2011 04:31:35	355916	12887933	hadcm3n_p1sb_1900_40_007219899_2	570,240	2,395,517	4.2009
26 Jun 2011 11:10:27	355916	12887933	hadcm3n_p1sb_1900_40_007219899_2	544,320	2,274,900	4.1793