Task 15880716

Name	hadcm3n_u1a3_2020_40_008339820_3
Workunit	8490681
Created	4 Jul 2013, 12:25:27 UTC
Sent	4 Jul 2013, 12:59:03 UTC
Report deadline	3 Oct 2013, 20:26:14 UTC
Received	25 Aug 2013, 1:11:14 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1129647
Run time	23 days 2 hours 12 min 56 sec
CPU time	21 days 19 hours 55 min 8 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.91 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:56:28 (3352): No heartbeat from core client for 30 sec - exiting 07:56:29 (3352): No heartbeat from core client for 30 sec - exiting 07:56:30 (3352): No heartbeat from core client for 30 sec - exiting 07:56:31 (3352): No heartbeat from core client for 30 sec - exiting 07:56:32 (3352): No heartbeat from core client for 30 sec - exiting 07:56:33 (3352): No heartbeat from core client for 30 sec - exiting 07:56:34 (3352): No heartbeat from core client for 30 sec - exiting 07:56:35 (3352): No heartbeat from core client for 30 sec - exiting 07:56:36 (3352): No heartbeat from core client for 30 sec - exiting 07:56:37 (3352): No heartbeat from core client for 30 sec - exiting 07:56:38 (3352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:56:39 (3352): No heartbeat from core client for 30 sec - exiting 05:53:28 (5648): No heartbeat from core client for 30 sec - exiting 05:53:29 (5648): No heartbeat from core client for 30 sec - exiting 05:53:30 (5648): No heartbeat from core client for 30 sec - exiting 05:53:31 (5648): No heartbeat from core client for 30 sec - exiting 05:53:32 (5648): No heartbeat from core client for 30 sec - exiting 05:53:33 (5648): No heartbeat from core client for 30 sec - exiting 05:53:34 (5648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:08:19 (5576): No heartbeat from core client for 30 sec - exiting 17:08:21 (5576): No heartbeat from core client for 30 sec - exiting 17:08:22 (5576): No heartbeat from core client for 30 sec - exiting 17:08:23 (5576): No heartbeat from core client for 30 sec - exiting 17:08:24 (5576): No heartbeat from core client for 30 sec - exiting 17:08:25 (5576): No heartbeat from core client for 30 sec - exiting 17:08:26 (5576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5124, iMonCtr=1 Model crash detected, will try to restart... 05:35:55 (5620): No heartbeat from core client for 30 sec - exiting 05:35:57 (5620): No heartbeat from core client for 30 sec - exiting 05:35:58 (5620): No heartbeat from core client for 30 sec - exiting 05:35:59 (5620): No heartbeat from core client for 30 sec - exiting 05:36:00 (5620): No heartbeat from core client for 30 sec - exiting 05:36:01 (5620): No heartbeat from core client for 30 sec - exiting 05:36:02 (5620): No heartbeat from core client for 30 sec - exiting 05:36:03 (5620): No heartbeat from core client for 30 sec - exiting 05:36:04 (5620): No heartbeat from core client for 30 sec - exiting 05:36:05 (5620): No heartbeat from core client for 30 sec - exiting 05:36:06 (5620): No heartbeat from core client for 30 sec - exiting 05:36:07 (5620): No heartbeat from core client for 30 sec - exiting 05:36:08 (5620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:30:41 (6040): No heartbeat from core client for 30 sec - exiting 16:30:42 (6040): No heartbeat from core client for 30 sec - exiting 16:30:43 (6040): No heartbeat from core client for 30 sec - exiting 16:30:44 (6040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:53:40 (6000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5536, iMonCtr=1 Model crash detected, will try to restart... 05:42:29 (5660): No heartbeat from core client for 30 sec - exiting 05:42:31 (5660): No heartbeat from core client for 30 sec - exiting 05:42:32 (5660): No heartbeat from core client for 30 sec - exiting 05:42:33 (5660): No heartbeat from core client for 30 sec - exiting 05:42:34 (5660): No heartbeat from core client for 30 sec - exiting 05:42:35 (5660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:43:38 (5108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5892, iMonCtr=1 Model crash detected, will try to restart... 05:37:42 (4724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:47:16 (5228): No heartbeat from core client for 30 sec - exiting 16:47:17 (5228): No heartbeat from core client for 30 sec - exiting 16:47:18 (5228): No heartbeat from core client for 30 sec - exiting 16:47:19 (5228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:13:14 (9616): No heartbeat from core client for 30 sec - exiting 16:13:15 (9616): No heartbeat from core client for 30 sec - exiting 16:13:16 (9616): No heartbeat from core client for 30 sec - exiting 16:13:17 (9616): No heartbeat from core client for 30 sec - exiting 16:13:18 (9616): No heartbeat from core client for 30 sec - exiting 16:13:19 (9616): No heartbeat from core client for 30 sec - exiting 16:13:20 (9616): No heartbeat from core client for 30 sec - exiting 16:13:21 (9616): No heartbeat from core client for 30 sec - exiting 16:13:22 (9616): No heartbeat from core client for 30 sec - exiting 16:13:23 (9616): No heartbeat from core client for 30 sec - exiting 16:13:24 (9616): No heartbeat from core client for 30 sec - exiting 16:13:25 (9616): No heartbeat from core client for 30 sec - exiting 16:13:26 (9616): No heartbeat from core client for 30 sec - exiting 16:13:27 (9616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:13:59 (9956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:44:37 (4516): No heartbeat from core client for 30 sec - exiting 16:44:38 (4516): No heartbeat from core client for 30 sec - exiting 16:44:39 (4516): No heartbeat from core client for 30 sec - exiting 16:44:40 (4516): No heartbeat from core client for 30 sec - exiting 16:44:41 (4516): No heartbeat from core client for 30 sec - exiting 16:44:42 (4516): No heartbeat from core client for 30 sec - exiting 16:44:43 (4516): No heartbeat from core client for 30 sec - exiting 16:44:44 (4516): No heartbeat from core client for 30 sec - exiting 16:44:45 (4516): No heartbeat from core client for 30 sec - exiting 16:44:46 (4516): No heartbeat from core client for 30 sec - exiting 16:44:47 (4516): No heartbeat from core client for 30 sec - exiting 16:44:48 (4516): No heartbeat from core client for 30 sec - exiting 16:44:49 (4516): No heartbeat from core client for 30 sec - exiting 16:44:50 (4516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:44:51 (4516): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:43:58 (3000): No heartbeat from core client for 30 sec - exiting 16:43:59 (3000): No heartbeat from core client for 30 sec - exiting 16:44:00 (3000): No heartbeat from core client for 30 sec - exiting 16:44:01 (3000): No heartbeat from core client for 30 sec - exiting 16:44:02 (3000): No heartbeat from core client for 30 sec - exiting 16:44:03 (3000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:37:19 (5300): No heartbeat from core client for 30 sec - exiting 16:37:20 (5300): No heartbeat from core client for 30 sec - exiting 16:37:21 (5300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:08:43 (5620): No heartbeat from core client for 30 sec - exiting 13:08:44 (5620): No heartbeat from core client for 30 sec - exiting 13:08:45 (5620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:33:14 (5392): No heartbeat from core client for 30 sec - exiting 05:33:15 (5392): No heartbeat from core client for 30 sec - exiting 05:33:16 (5392): No heartbeat from core client for 30 sec - exiting 05:33:17 (5392): No heartbeat from core client for 30 sec - exiting 05:33:18 (5392): No heartbeat from core client for 30 sec - exiting 05:33:19 (5392): No heartbeat from core client for 30 sec - exiting 05:33:20 (5392): No heartbeat from core client for 30 sec - exiting 05:33:21 (5392): No heartbeat from core client for 30 sec - exiting 05:33:22 (5392): No heartbeat from core client for 30 sec - exiting 05:33:23 (5392): No heartbeat from core client for 30 sec - exiting 05:33:24 (5392): No heartbeat from core client for 30 sec - exiting 05:33:25 (5392): No heartbeat from core client for 30 sec - exiting 05:33:26 (5392): No heartbeat from core client for 30 sec - exiting 05:33:27 (5392): No heartbeat from core client for 30 sec - exiting 05:33:28 (5392): No heartbeat from core client for 30 sec - exiting 05:33:29 (5392): No heartbeat from core client for 30 sec - exiting 05:33:30 (5392): No heartbeat from core client for 30 sec - exiting 05:33:31 (5392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:43:59 (5436): No heartbeat from core client for 30 sec - exiting 16:44:01 (5436): No heartbeat from core client for 30 sec - exiting 16:44:02 (5436): No heartbeat from core client for 30 sec - exiting 16:44:03 (5436): No heartbeat from core client for 30 sec - exiting 16:44:04 (5436): No heartbeat from core client for 30 sec - exiting 16:44:05 (5436): No heartbeat from core client for 30 sec - exiting 16:44:06 (5436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:44:07 (5436): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6108, iMonCtr=1 Model crash detected, will try to restart... 05:31:19 (5388): No heartbeat from core client for 30 sec - exiting 05:31:20 (5388): No heartbeat from core client for 30 sec - exiting 05:31:21 (5388): No heartbeat from core client for 30 sec - exiting 05:31:22 (5388): No heartbeat from core client for 30 sec - exiting 05:31:23 (5388): No heartbeat from core client for 30 sec - exiting 05:31:24 (5388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:31:47 (4708): No heartbeat from core client for 30 sec - exiting 16:31:48 (4708): No heartbeat from core client for 30 sec - exiting 16:31:49 (4708): No heartbeat from core client for 30 sec - exiting 16:31:51 (4708): No heartbeat from core client for 30 sec - exiting 16:31:52 (4708): No heartbeat from core client for 30 sec - exiting 16:31:53 (4708): No heartbeat from core client for 30 sec - exiting 16:31:54 (4708): No heartbeat from core client for 30 sec - exiting 16:31:55 (4708): No heartbeat from core client for 30 sec - exiting 16:31:56 (4708): No heartbeat from core client for 30 sec - exiting 16:31:57 (4708): No heartbeat from core client for 30 sec - exiting 16:31:58 (4708): No heartbeat from core client for 30 sec - exiting 16:31:59 (4708): No heartbeat from core client for 30 sec - exiting 16:32:00 (4708): No heartbeat from core client for 30 sec - exiting 16:32:01 (4708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:31:10 (5336): No heartbeat from core client for 30 sec - exiting 05:31:11 (5336): No heartbeat from core client for 30 sec - exiting 05:31:12 (5336): No heartbeat from core client for 30 sec - exiting 05:31:13 (5336): No heartbeat from core client for 30 sec - exiting 05:31:14 (5336): No heartbeat from core client for 30 sec - exiting 05:31:15 (5336): No heartbeat from core client for 30 sec - exiting 05:31:16 (5336): No heartbeat from core client for 30 sec - exiting 05:31:17 (5336): No heartbeat from core client for 30 sec - exiting 05:31:18 (5336): No heartbeat from core client for 30 sec - exiting 05:31:19 (5336): No heartbeat from core client for 30 sec - exiting 05:31:20 (5336): No heartbeat from core client for 30 sec - exiting 05:31:21 (5336): No heartbeat from core client for 30 sec - exiting 05:31:22 (5336): No heartbeat from core client for 30 sec - exiting 05:31:23 (5336): No heartbeat from core client for 30 sec - exiting 05:31:24 (5336): No heartbeat from core client for 30 sec - exiting 05:31:25 (5336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4992, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5200, iMonCtr=1 Model crash detected, will try to restart... 07:54:31 (10016): No heartbeat from core client for 30 sec - exiting 07:54:32 (10016): No heartbeat from core client for 30 sec - exiting 07:54:33 (10016): No heartbeat from core client for 30 sec - exiting 07:54:34 (10016): No heartbeat from core client for 30 sec - exiting 07:54:35 (10016): No heartbeat from core client for 30 sec - exiting 07:54:36 (10016): No heartbeat from core client for 30 sec - exiting 07:54:37 (10016): No heartbeat from core client for 30 sec - exiting 07:54:38 (10016): No heartbeat from core client for 30 sec - exiting 07:54:39 (10016): No heartbeat from core client for 30 sec - exiting 07:54:40 (10016): No heartbeat from core client for 30 sec - exiting 07:54:41 (10016): No heartbeat from core client for 30 sec - exiting 07:54:42 (10016): No heartbeat from core client for 30 sec - exiting 07:54:43 (10016): No heartbeat from core client for 30 sec - exiting 07:54:44 (10016): No heartbeat from core client for 30 sec - exiting 07:54:45 (10016): No heartbeat from core client for 30 sec - exiting 07:54:46 (10016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Aug 2013 01:11:40	1129647	15880716	hadcm3n_u1a3_2020_40_008339820_3	1,036,800	1,885,401	1.8185
24 Aug 2013 00:41:00	1129647	15880716	hadcm3n_u1a3_2020_40_008339820_3	1,010,880	1,834,136	1.8144
23 Aug 2013 10:43:33	1129647	15880716	hadcm3n_u1a3_2020_40_008339820_3	984,960	1,783,529	1.8108
21 Aug 2013 22:10:16	1129647	15880716	hadcm3n_u1a3_2020_40_008339820_3	959,040	1,732,554	1.8066
20 Aug 2013 04:27:09	1129647	15880716	hadcm3n_u1a3_2020_40_008339820_3	933,120	1,681,463	1.8020
18 Aug 2013 20:22:02	1129647	15880716	hadcm3n_u1a3_2020_40_008339820_3	907,200	1,630,986	1.7978
17 Aug 2013 20:06:53	1129647	15880716	hadcm3n_u1a3_2020_40_008339820_3	881,280	1,579,885	1.7927
16 Aug 2013 20:32:03	1129647	15880716	hadcm3n_u1a3_2020_40_008339820_3	855,360	1,528,779	1.7873
16 Aug 2013 01:32:51	1129647	15880716	hadcm3n_u1a3_2020_40_008339820_3	829,440	1,478,761	1.7828
15 Aug 2013 04:39:05	1129647	15880716	hadcm3n_u1a3_2020_40_008339820_3	803,520	1,428,394	1.7777
14 Aug 2013 20:50:12	1129647	15880716	hadcm3n_u1a3_2020_40_008339820_3	777,600	1,385,226	1.7814
14 Aug 2013 20:50:12	1129647	15880716	hadcm3n_u1a3_2020_40_008339820_3	751,680	1,340,808	1.7837
14 Aug 2013 20:50:12	1129647	15880716	hadcm3n_u1a3_2020_40_008339820_3	725,760	1,296,786	1.7868
14 Aug 2013 20:50:12	1129647	15880716	hadcm3n_u1a3_2020_40_008339820_3	699,840	1,253,314	1.7909
14 Aug 2013 20:50:12	1129647	15880716	hadcm3n_u1a3_2020_40_008339820_3	673,920	1,209,685	1.7950
14 Aug 2013 20:50:12	1129647	15880716	hadcm3n_u1a3_2020_40_008339820_3	648,000	1,164,473	1.7970
14 Aug 2013 20:50:12	1129647	15880716	hadcm3n_u1a3_2020_40_008339820_3	622,080	1,119,420	1.7995
14 Aug 2013 20:50:12	1129647	15880716	hadcm3n_u1a3_2020_40_008339820_3	596,160	1,075,233	1.8036
14 Aug 2013 20:50:12	1129647	15880716	hadcm3n_u1a3_2020_40_008339820_3	570,240	1,030,592	1.8073
14 Aug 2013 20:50:12	1129647	15880716	hadcm3n_u1a3_2020_40_008339820_3	544,320	985,664	1.8108