Task 15454127

Name	hadcm3n_zdt5_1880_40_008251363_0
Workunit	8406487
Created	22 Nov 2012, 16:34:49 UTC
Sent	22 Nov 2012, 16:36:04 UTC
Report deadline	22 Feb 2013, 0:03:15 UTC
Received	4 Dec 2012, 12:11:53 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1224676
Run time	7 days 0 hours 39 min 17 sec
CPU time	6 days 19 hours 10 min 7 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.33 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> 21:24:37 (7040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:24:38 (7040): No heartbeat from core client for 30 sec - exiting 21:24:39 (7040): No heartbeat from core client for 30 sec - exiting 21:24:40 (7040): No heartbeat from core client for 30 sec - exiting 21:24:41 (7040): No heartbeat from core client for 30 sec - exiting 21:24:42 (7040): No heartbeat from core client for 30 sec - exiting 21:24:43 (7040): No heartbeat from core client for 30 sec - exiting 21:24:44 (7040): No heartbeat from core client for 30 sec - exiting 21:28:38 (5980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:28:39 (5980): No heartbeat from core client for 30 sec - exiting 21:28:40 (5980): No heartbeat from core client for 30 sec - exiting 21:28:41 (5980): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6760, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 14:04:52 (4904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:06:39 (7040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:29:21 (1956): No heartbeat from core client for 30 sec - exiting 11:29:22 (1956): No heartbeat from core client for 30 sec - exiting 11:29:23 (1956): No heartbeat from core client for 30 sec - exiting 11:29:24 (1956): No heartbeat from core client for 30 sec - exiting 11:29:25 (1956): No heartbeat from core client for 30 sec - exiting 11:29:26 (1956): No heartbeat from core client for 30 sec - exiting 11:29:27 (1956): No heartbeat from core client for 30 sec - exiting 11:29:28 (1956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:54:39 (4268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:29:51 (1112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:56:38 (3752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:34:38 (3668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:34:40 (3668): No heartbeat from core client for 30 sec - exiting 10:14:36 (3832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:16:38 (3556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:56:44 (7156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:56:45 (7156): No heartbeat from core client for 30 sec - exiting 15:56:46 (7156): No heartbeat from core client for 30 sec - exiting 15:56:47 (7156): No heartbeat from core client for 30 sec - exiting 15:56:48 (7156): No heartbeat from core client for 30 sec - exiting 15:56:49 (7156): No heartbeat from core client for 30 sec - exiting 15:58:41 (7948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:58:42 (7948): No heartbeat from core client for 30 sec - exiting 15:58:43 (7948): No heartbeat from core client for 30 sec - exiting 15:58:44 (7948): No heartbeat from core client for 30 sec - exiting 15:58:45 (7948): No heartbeat from core client for 30 sec - exiting 16:14:40 (7408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:14:41 (7408): No heartbeat from core client for 30 sec - exiting 16:14:42 (7408): No heartbeat from core client for 30 sec - exiting 16:14:43 (7408): No heartbeat from core client for 30 sec - exiting 16:14:44 (7408): No heartbeat from core client for 30 sec - exiting 16:14:45 (7408): No heartbeat from core client for 30 sec - exiting 11:42:37 (3532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:46:37 (3172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:50:39 (3568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5496, iMonCtr=1 Model crash detected, will try to restart... 10:26:38 (3952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:20:42 (6052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 14:56:43 (3588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:56:44 (3588): No heartbeat from core client for 30 sec - exiting 14:56:45 (3588): No heartbeat from core client for 30 sec - exiting 14:56:46 (3588): No heartbeat from core client for 30 sec - exiting 15:00:39 (7280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:00:40 (7280): No heartbeat from core client for 30 sec - exiting 15:00:41 (7280): No heartbeat from core client for 30 sec - exiting 15:00:42 (7280): No heartbeat from core client for 30 sec - exiting 15:00:43 (7280): No heartbeat from core client for 30 sec - exiting 18:28:39 (2636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:28:41 (2636): No heartbeat from core client for 30 sec - exiting 18:30:43 (7160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:30:44 (7160): No heartbeat from core client for 30 sec - exiting 18:30:45 (7160): No heartbeat from core client for 30 sec - exiting 18:30:46 (7160): No heartbeat from core client for 30 sec - exiting 18:30:47 (7160): No heartbeat from core client for 30 sec - exiting 18:30:48 (7160): No heartbeat from core client for 30 sec - exiting 18:30:49 (7160): No heartbeat from core client for 30 sec - exiting 18:30:51 (7160): No heartbeat from core client for 30 sec - exiting 18:32:41 (1964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:32:42 (1964): No heartbeat from core client for 30 sec - exiting 18:32:43 (1964): No heartbeat from core client for 30 sec - exiting 18:32:44 (1964): No heartbeat from core client for 30 sec - exiting 18:32:45 (1964): No heartbeat from core client for 30 sec - exiting 18:34:42 (6784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:34:43 (6784): No heartbeat from core client for 30 sec - exiting 18:34:44 (6784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 21:24:41 (2836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:24:42 (2836): No heartbeat from core client for 30 sec - exiting 21:26:42 (5088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:26:44 (5088): No heartbeat from core client for 30 sec - exiting 21:26:45 (5088): No heartbeat from core client for 30 sec - exiting 21:26:46 (5088): No heartbeat from core client for 30 sec - exiting 21:26:47 (5088): No heartbeat from core client for 30 sec - exiting 21:26:48 (5088): No heartbeat from core client for 30 sec - exiting 21:26:49 (5088): No heartbeat from core client for 30 sec - exiting 21:26:50 (5088): No heartbeat from core client for 30 sec - exiting 21:26:51 (5088): No heartbeat from core client for 30 sec - exiting 21:26:52 (5088): No heartbeat from core client for 30 sec - exiting 21:26:53 (5088): No heartbeat from core client for 30 sec - exiting 21:28:43 (3584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:28:44 (3584): No heartbeat from core client for 30 sec - exiting 21:28:45 (3584): No heartbeat from core client for 30 sec - exiting 21:28:47 (3584): No heartbeat from core client for 30 sec - exiting 21:28:48 (3584): No heartbeat from core client for 30 sec - exiting 21:28:49 (3584): No heartbeat from core client for 30 sec - exiting 21:28:50 (3584): No heartbeat from core client for 30 sec - exiting 21:28:51 (3584): No heartbeat from core client for 30 sec - exiting 21:28:52 (3584): No heartbeat from core client for 30 sec - exiting 21:28:53 (3584): No heartbeat from core client for 30 sec - exiting 21:28:54 (3584): No heartbeat from core client for 30 sec - exiting 21:30:49 (1064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:30:50 (1064): No heartbeat from core client for 30 sec - exiting 21:30:51 (1064): No heartbeat from core client for 30 sec - exiting 21:30:52 (1064): No heartbeat from core client for 30 sec - exiting 21:30:53 (1064): No heartbeat from core client for 30 sec - exiting 21:30:55 (1064): No heartbeat from core client for 30 sec - exiting 21:30:56 (1064): No heartbeat from core client for 30 sec - exiting 21:30:57 (1064): No heartbeat from core client for 30 sec - exiting 21:30:58 (1064): No heartbeat from core client for 30 sec - exiting 21:30:59 (1064): No heartbeat from core client for 30 sec - exiting 21:31:00 (1064): No heartbeat from core client for 30 sec - exiting 12:55:22 (3740): No heartbeat from core client for 30 sec - exiting 12:55:23 (3740): No heartbeat from core client for 30 sec - exiting 12:55:24 (3740): No heartbeat from core client for 30 sec - exiting 12:55:25 (3740): No heartbeat from core client for 30 sec - exiting 12:55:26 (3740): No heartbeat from core client for 30 sec - exiting 12:55:27 (3740): No heartbeat from core client for 30 sec - exiting 12:55:28 (3740): No heartbeat from core client for 30 sec - exiting 12:55:29 (3740): No heartbeat from core client for 30 sec - exiting 12:55:30 (3740): No heartbeat from core client for 30 sec - exiting 12:55:31 (3740): No heartbeat from core client for 30 sec - exiting 12:55:33 (3740): No heartbeat from core client for 30 sec - exiting 12:55:34 (3740): No heartbeat from core client for 30 sec - exiting 12:55:35 (3740): No heartbeat from core client for 30 sec - exiting 12:55:36 (3740): No heartbeat from core client for 30 sec - exiting 12:55:37 (3740): No heartbeat from core client for 30 sec - exiting 12:55:38 (3740): No heartbeat from core client for 30 sec - exiting 12:55:39 (3740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:38:38 (6224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:38:39 (6224): No heartbeat from core client for 30 sec - exiting 18:38:40 (6224): No heartbeat from core client for 30 sec - exiting 18:38:41 (6224): No heartbeat from core client for 30 sec - exiting 11:34:44 (3388): No heartbeat from core client for 30 sec - exiting 11:34:45 (3388): No heartbeat from core client for 30 sec - exiting 11:34:46 (3388): No heartbeat from core client for 30 sec - exiting 11:34:47 (3388): No heartbeat from core client for 30 sec - exiting 11:34:48 (3388): No heartbeat from core client for 30 sec - exiting 11:34:49 (3388): No heartbeat from core client for 30 sec - exiting 11:34:50 (3388): No heartbeat from core client for 30 sec - exiting 11:34:51 (3388): No heartbeat from core client for 30 sec - exiting 11:34:52 (3388): No heartbeat from core client for 30 sec - exiting 11:34:53 (3388): No heartbeat from core client for 30 sec - exiting 11:34:54 (3388): No heartbeat from core client for 30 sec - exiting 11:34:55 (3388): No heartbeat from core client for 30 sec - exiting 11:34:56 (3388): No heartbeat from core client for 30 sec - exiting 11:34:58 (3388): No heartbeat from core client for 30 sec - exiting 11:34:59 (3388): No heartbeat from core client for 30 sec - exiting 11:35:00 (3388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:58:40 (2972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:58:41 (2972): No heartbeat from core client for 30 sec - exiting 12:10:42 (3812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:10:43 (3812): No heartbeat from core client for 30 sec - exiting 12:10:44 (3812): No heartbeat from core client for 30 sec - exiting 12:10:45 (3812): No heartbeat from core client for 30 sec - exiting 12:10:46 (3812): No heartbeat from core client for 30 sec - exiting 12:10:47 (3812): No heartbeat from core client for 30 sec - exiting 12:12:40 (5764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:12:41 (5764): No heartbeat from core client for 30 sec - exiting 12:12:43 (5764): No heartbeat from core client for 30 sec - exiting 12:12:44 (5764): No heartbeat from core client for 30 sec - exiting 12:12:45 (5764): No heartbeat from core client for 30 sec - exiting 12:12:46 (5764): No heartbeat from core client for 30 sec - exiting 12:12:47 (5764): No heartbeat from core client for 30 sec - exiting 12:12:48 (5764): No heartbeat from core client for 30 sec - exiting 12:12:49 (5764): No heartbeat from core client for 30 sec - exiting 12:12:50 (5764): No heartbeat from core client for 30 sec - exiting 12:14:45 (5848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:16:40 (3436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... 08:17:04 (3552): No heartbeat from core client for 30 sec - exiting 08:17:05 (3552): No heartbeat from core client for 30 sec - exiting 08:17:06 (3552): No heartbeat from core client for 30 sec - exiting 08:17:07 (3552): No heartbeat from core client for 30 sec - exiting 08:17:08 (3552): No heartbeat from core client for 30 sec - exiting 08:17:09 (3552): No heartbeat from core client for 30 sec - exiting 08:17:11 (3552): No heartbeat from core client for 30 sec - exiting 08:17:12 (3552): No heartbeat from core client for 30 sec - exiting 08:17:13 (3552): No heartbeat from core client for 30 sec - exiting 08:17:14 (3552): No heartbeat from core client for 30 sec - exiting 08:17:15 (3552): No heartbeat from core client for 30 sec - exiting 08:17:16 (3552): No heartbeat from core client for 30 sec - exiting 08:17:17 (3552): No heartbeat from core client for 30 sec - exiting 08:17:18 (3552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:38:39 (4916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:14:42 (6704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:14:43 (6704): No heartbeat from core client for 30 sec - exiting 09:14:44 (6704): No heartbeat from core client for 30 sec - exiting 09:14:45 (6704): No heartbeat from core client for 30 sec - exiting 09:14:46 (6704): No heartbeat from core client for 30 sec - exiting 09:16:41 (5880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:30:43 (7076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:30:44 (7076): No heartbeat from core client for 30 sec - exiting 01:30:45 (7076): No heartbeat from core client for 30 sec - exiting 01:30:46 (7076): No heartbeat from core client for 30 sec - exiting 01:30:47 (7076): No heartbeat from core client for 30 sec - exiting 01:30:48 (7076): No heartbeat from core client for 30 sec - exiting 01:30:49 (7076): No heartbeat from core client for 30 sec - exiting 01:30:50 (7076): No heartbeat from core client for 30 sec - exiting 01:30:51 (7076): No heartbeat from core client for 30 sec - exiting 01:30:52 (7076): No heartbeat from core client for 30 sec - exiting 01:30:54 (7076): No heartbeat from core client for 30 sec - exiting 01:32:41 (3772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:32:42 (3772): No heartbeat from core client for 30 sec - exiting 01:34:39 (6400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:34:40 (6400): No heartbeat from core client for 30 sec - exiting 01:34:41 (6400): No heartbeat from core client for 30 sec - exiting 01:34:42 (6400): No heartbeat from core client for 30 sec - exiting 08:22:49 (3476): No heartbeat from core client for 30 sec - exiting 08:22:50 (3476): No heartbeat from core client for 30 sec - exiting 08:22:51 (3476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:40:43 (4876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:40:44 (4876): No heartbeat from core client for 30 sec - exiting 08:42:40 (5296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:42:42 (5296): No heartbeat from core client for 30 sec - exiting 08:42:43 (5296): No heartbeat from core client for 30 sec - exiting 08:42:44 (5296): No heartbeat from core client for 30 sec - exiting 08:42:45 (5296): No heartbeat from core client for 30 sec - exiting 08:42:46 (5296): No heartbeat from core client for 30 sec - exiting 08:42:47 (5296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:24:02 (3284): No heartbeat from core client for 30 sec - exiting 07:24:03 (3284): No heartbeat from core client for 30 sec - exiting 07:24:04 (3284): No heartbeat from core client for 30 sec - exiting 07:24:05 (3284): No heartbeat from core client for 30 sec - exiting 07:24:06 (3284): No heartbeat from core client for 30 sec - exiting 07:24:07 (3284): No heartbeat from core client for 30 sec - exiting 07:24:08 (3284): No heartbeat from core client for 30 sec - exiting 07:24:09 (3284): No heartbeat from core client for 30 sec - exiting 07:24:10 (3284): No heartbeat from core client for 30 sec - exiting 07:24:11 (3284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:58:37 (4252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:58:38 (4252): No heartbeat from core client for 30 sec - exiting 08:58:39 (4252): No heartbeat from core client for 30 sec - exiting 08:58:40 (4252): No heartbeat from core client for 30 sec - exiting 08:58:41 (4252): No heartbeat from core client for 30 sec - exiting 09:00:40 (2768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:00:41 (2768): No heartbeat from core client for 30 sec - exiting 09:00:42 (2768): No heartbeat from core client for 30 sec - exiting 09:00:43 (2768): No heartbeat from core client for 30 sec - exiting 09:00:44 (2768): No heartbeat from core client for 30 sec - exiting 09:00:45 (2768): No heartbeat from core client for 30 sec - exiting 09:00:46 (2768): No heartbeat from core client for 30 sec - exiting 09:00:47 (2768): No heartbeat from core client for 30 sec - exiting 09:00:48 (2768): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77943AB3 read attempt to address 0x40AF8B4E Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77943AB3 read attempt to address 0x40AF8B4E Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Dec 2012 09:57:29	1224676	15454127	hadcm3n_zdt5_1880_40_008251363_0	518,400	585,907	1.1302
03 Dec 2012 19:16:26	1224676	15454127	hadcm3n_zdt5_1880_40_008251363_0	492,480	556,313	1.1296
03 Dec 2012 09:59:36	1224676	15454127	hadcm3n_zdt5_1880_40_008251363_0	466,560	526,723	1.1290
02 Dec 2012 18:41:57	1224676	15454127	hadcm3n_zdt5_1880_40_008251363_0	440,640	497,177	1.1283
02 Dec 2012 09:43:48	1224676	15454127	hadcm3n_zdt5_1880_40_008251363_0	414,720	467,992	1.1285
01 Dec 2012 19:38:20	1224676	15454127	hadcm3n_zdt5_1880_40_008251363_0	388,800	438,581	1.1280
01 Dec 2012 10:41:38	1224676	15454127	hadcm3n_zdt5_1880_40_008251363_0	362,880	409,241	1.1278
30 Nov 2012 18:11:46	1224676	15454127	hadcm3n_zdt5_1880_40_008251363_0	336,960	379,698	1.1268
29 Nov 2012 19:37:09	1224676	15454127	hadcm3n_zdt5_1880_40_008251363_0	311,040	350,173	1.1258
28 Nov 2012 22:55:10	1224676	15454127	hadcm3n_zdt5_1880_40_008251363_0	285,120	320,870	1.1254
28 Nov 2012 14:23:08	1224676	15454127	hadcm3n_zdt5_1880_40_008251363_0	259,200	291,408	1.1243
27 Nov 2012 19:31:47	1224676	15454127	hadcm3n_zdt5_1880_40_008251363_0	233,280	261,844	1.1224
27 Nov 2012 10:29:00	1224676	15454127	hadcm3n_zdt5_1880_40_008251363_0	207,360	232,505	1.1213
26 Nov 2012 17:48:07	1224676	15454127	hadcm3n_zdt5_1880_40_008251363_0	181,440	203,343	1.1207
25 Nov 2012 22:17:48	1224676	15454127	hadcm3n_zdt5_1880_40_008251363_0	155,520	174,293	1.1207
25 Nov 2012 13:31:25	1224676	15454127	hadcm3n_zdt5_1880_40_008251363_0	129,600	145,250	1.1208
24 Nov 2012 19:22:16	1224676	15454127	hadcm3n_zdt5_1880_40_008251363_0	103,680	116,170	1.1205
24 Nov 2012 00:26:31	1224676	15454127	hadcm3n_zdt5_1880_40_008251363_0	77,760	87,010	1.1190
23 Nov 2012 16:15:05	1224676	15454127	hadcm3n_zdt5_1880_40_008251363_0	51,840	58,191	1.1225
23 Nov 2012 01:03:50	1224676	15454127	hadcm3n_zdt5_1880_40_008251363_0	25,920	29,017	1.1195