Task 15749495

Name	hadcm3n_zkj3_1960_40_008322038_1
Workunit	8473173
Created	24 Apr 2013, 19:04:22 UTC
Sent	24 Apr 2013, 19:04:32 UTC
Report deadline	25 Jul 2013, 2:31:43 UTC
Received	5 May 2013, 14:44:07 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1277438
Run time	3 days 3 hours 34 min 8 sec
CPU time	2 days 21 hours 52 min 37 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.91 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 19:36:04 (6004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:36:05 (6004): No heartbeat from core client for 30 sec - exiting 19:36:06 (6004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:43:53 (5672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:50:35 (3612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5700, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:46:48 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:46:53 (4380): No heartbeat from core client for 30 sec - exiting 16:46:54 (4380): No heartbeat from core client for 30 sec - exiting 16:46:55 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:49:15 (1728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:32:12 (1224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:32:28 (1224): No heartbeat from core client for 30 sec - exiting 15:32:29 (1224): No heartbeat from core client for 30 sec - exiting 15:32:30 (1224): No heartbeat from core client for 30 sec - exiting 15:32:31 (1224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:00:54 (676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:14:47 (3532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:14:50 (3532): No heartbeat from core client for 30 sec - exiting 12:14:51 (3532): No heartbeat from core client for 30 sec - exiting 12:14:52 (3532): No heartbeat from core client for 30 sec - exiting 12:14:53 (3532): No heartbeat from core client for 30 sec - exiting 12:14:54 (3532): No heartbeat from core client for 30 sec - exiting 12:14:55 (3532): No heartbeat from core client for 30 sec - exiting 12:14:56 (3532): No heartbeat from core client for 30 sec - exiting 12:14:57 (3532): No heartbeat from core client for 30 sec - exiting 12:14:58 (3532): No heartbeat from core client for 30 sec - exiting 12:14:59 (3532): No heartbeat from core client for 30 sec - exiting 12:16:30 (6068): No heartbeat from core client for 30 sec - exiting 12:16:31 (6068): No heartbeat from core client for 30 sec - exiting 12:16:32 (6068): No heartbeat from core client for 30 sec - exiting 12:16:33 (6068): No heartbeat from core client for 30 sec - exiting 12:16:34 (6068): No heartbeat from core client for 30 sec - exiting 12:16:35 (6068): No heartbeat from core client for 30 sec - exiting 12:16:36 (6068): No heartbeat from core client for 30 sec - exiting 12:16:37 (6068): No heartbeat from core client for 30 sec - exiting 12:16:38 (6068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:38:16 (4908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:38:20 (4908): No heartbeat from core client for 30 sec - exiting 06:38:21 (4908): No heartbeat from core client for 30 sec - exiting 06:38:22 (4908): No heartbeat from core client for 30 sec - exiting 06:38:24 (4908): No heartbeat from core client for 30 sec - exiting 06:38:25 (4908): No heartbeat from core client for 30 sec - exiting 06:38:26 (4908): No heartbeat from core client for 30 sec - exiting 06:38:27 (4908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:28:23 (4756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:28:35 (4756): No heartbeat from core client for 30 sec - exiting 11:28:36 (4756): No heartbeat from core client for 30 sec - exiting 11:28:37 (4756): No heartbeat from core client for 30 sec - exiting 11:28:38 (4756): No heartbeat from core client for 30 sec - exiting 11:28:39 (4756): No heartbeat from core client for 30 sec - exiting 11:28:40 (4756): No heartbeat from core client for 30 sec - exiting 11:28:41 (4756): No heartbeat from core client for 30 sec - exiting 11:28:42 (4756): No heartbeat from core client for 30 sec - exiting 11:28:43 (4756): No heartbeat from core client for 30 sec - exiting 11:28:44 (4756): No heartbeat from core client for 30 sec - exiting 11:28:46 (4756): No heartbeat from core client for 30 sec - exiting 11:28:47 (4756): No heartbeat from core client for 30 sec - exiting 11:28:48 (4756): No heartbeat from core client for 30 sec - exiting 11:28:49 (4756): No heartbeat from core client for 30 sec - exiting 11:28:50 (4756): No heartbeat from core client for 30 sec - exiting 11:28:51 (4756): No heartbeat from core client for 30 sec - exiting 11:28:52 (4756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:59:41 (4304): No heartbeat from core client for 30 sec - exiting 09:59:42 (4304): No heartbeat from core client for 30 sec - exiting 09:59:43 (4304): No heartbeat from core client for 30 sec - exiting 09:59:44 (4304): No heartbeat from core client for 30 sec - exiting 09:59:45 (4304): No heartbeat from core client for 30 sec - exiting 09:59:46 (4304): No heartbeat from core client for 30 sec - exiting 09:59:47 (4304): No heartbeat from core client for 30 sec - exiting 09:59:48 (4304): No heartbeat from core client for 30 sec - exiting 09:59:49 (4304): No heartbeat from core client for 30 sec - exiting 09:59:50 (4304): No heartbeat from core client for 30 sec - exiting 09:59:51 (4304): No heartbeat from core client for 30 sec - exiting 09:59:52 (4304): No heartbeat from core client for 30 sec - exiting 09:59:53 (4304): No heartbeat from core client for 30 sec - exiting 09:59:54 (4304): No heartbeat from core client for 30 sec - exiting 09:59:55 (4304): No heartbeat from core client for 30 sec - exiting 09:59:56 (4304): No heartbeat from core client for 30 sec - exiting 09:59:57 (4304): No heartbeat from core client for 30 sec - exiting 09:59:58 (4304): No heartbeat from core client for 30 sec - exiting 09:59:59 (4304): No heartbeat from core client for 30 sec - exiting 10:00:00 (4304): No heartbeat from core client for 30 sec - exiting 10:00:01 (4304): No heartbeat from core client for 30 sec - exiting 10:00:02 (4304): No heartbeat from core client for 30 sec - exiting 10:00:03 (4304): No heartbeat from core client for 30 sec - exiting 10:00:04 (4304): No heartbeat from core client for 30 sec - exiting 10:00:05 (4304): No heartbeat from core client for 30 sec - exiting 10:00:06 (4304): No heartbeat from core client for 30 sec - exiting 10:00:07 (4304): No heartbeat from core client for 30 sec - exiting 10:00:08 (4304): No heartbeat from core client for 30 sec - exiting 10:00:09 (4304): No heartbeat from core client for 30 sec - exiting 10:00:10 (4304): No heartbeat from core client for 30 sec - exiting 10:00:11 (4304): No heartbeat from core client for 30 sec - exiting 10:00:12 (4304): No heartbeat from core client for 30 sec - exiting 10:00:13 (4304): No heartbeat from core client for 30 sec - exiting 10:00:14 (4304): No heartbeat from core client for 30 sec - exiting 10:00:15 (4304): No heartbeat from core client for 30 sec - exiting 10:00:16 (4304): No heartbeat from core client for 30 sec - exiting 10:00:17 (4304): No heartbeat from core client for 30 sec - exiting 10:00:18 (4304): No heartbeat from core client for 30 sec - exiting 10:00:19 (4304): No heartbeat from core client for 30 sec - exiting 10:00:20 (4304): No heartbeat from core client for 30 sec - exiting 10:00:21 (4304): No heartbeat from core client for 30 sec - exiting 10:00:22 (4304): No heartbeat from core client for 30 sec - exiting 10:00:23 (4304): No heartbeat from core client for 30 sec - exiting 10:00:24 (4304): No heartbeat from core client for 30 sec - exiting 10:00:25 (4304): No heartbeat from core client for 30 sec - exiting 10:00:26 (4304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:02:37 (3696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:15:06 (4568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:15:14 (4568): No heartbeat from core client for 30 sec - exiting 09:15:15 (4568): No heartbeat from core client for 30 sec - exiting 09:15:16 (4568): No heartbeat from core client for 30 sec - exiting 09:15:17 (4568): No heartbeat from core client for 30 sec - exiting 09:15:18 (4568): No heartbeat from core client for 30 sec - exiting 09:15:19 (4568): No heartbeat from core client for 30 sec - exiting 09:15:20 (4568): No heartbeat from core client for 30 sec - exiting 09:15:21 (4568): No heartbeat from core client for 30 sec - exiting 09:15:22 (4568): No heartbeat from core client for 30 sec - exiting 09:15:23 (4568): No heartbeat from core client for 30 sec - exiting 09:15:24 (4568): No heartbeat from core client for 30 sec - exiting 09:15:26 (4568): No heartbeat from core client for 30 sec - exiting 09:18:49 (5516): No heartbeat from core client for 30 sec - exiting 09:18:50 (5516): No heartbeat from core client for 30 sec - exiting 09:18:51 (5516): No heartbeat from core client for 30 sec - exiting 09:18:52 (5516): No heartbeat from core client for 30 sec - exiting 09:18:53 (5516): No heartbeat from core client for 30 sec - exiting 09:18:54 (5516): No heartbeat from core client for 30 sec - exiting 09:18:55 (5516): No heartbeat from core client for 30 sec - exiting 09:18:56 (5516): No heartbeat from core client for 30 sec - exiting 09:18:57 (5516): No heartbeat from core client for 30 sec - exiting 09:18:58 (5516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:18:59 (5516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:12:11 (4588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:12:15 (4588): No heartbeat from core client for 30 sec - exiting 10:12:17 (4588): No heartbeat from core client for 30 sec - exiting 10:12:18 (4588): No heartbeat from core client for 30 sec - exiting 10:12:19 (4588): No heartbeat from core client for 30 sec - exiting 10:12:20 (4588): No heartbeat from core client for 30 sec - exiting 10:12:21 (4588): No heartbeat from core client for 30 sec - exiting 10:12:22 (4588): No heartbeat from core client for 30 sec - exiting 10:12:23 (4588): No heartbeat from core client for 30 sec - exiting 10:12:25 (4588): No heartbeat from core client for 30 sec - exiting 10:12:26 (4588): No heartbeat from core client for 30 sec - exiting 10:12:27 (4588): No heartbeat from core client for 30 sec - exiting 10:12:28 (4588): No heartbeat from core client for 30 sec - exiting 10:12:29 (4588): No heartbeat from core client for 30 sec - exiting 10:12:30 (4588): No heartbeat from core client for 30 sec - exiting 10:12:32 (4588): No heartbeat from core client for 30 sec - exiting 10:17:27 (5136): No heartbeat from core client for 30 sec - exiting 10:17:28 (5136): No heartbeat from core client for 30 sec - exiting 10:17:29 (5136): No heartbeat from core client for 30 sec - exiting 10:17:30 (5136): No heartbeat from core client for 30 sec - exiting 10:17:31 (5136): No heartbeat from core client for 30 sec - exiting 10:17:32 (5136): No heartbeat from core client for 30 sec - exiting 10:17:33 (5136): No heartbeat from core client for 30 sec - exiting 10:17:34 (5136): No heartbeat from core client for 30 sec - exiting 10:17:35 (5136): No heartbeat from core client for 30 sec - exiting 10:17:36 (5136): No heartbeat from core client for 30 sec - exiting 10:17:37 (5136): No heartbeat from core client for 30 sec - exiting 10:17:38 (5136): No heartbeat from core client for 30 sec - exiting 10:17:39 (5136): No heartbeat from core client for 30 sec - exiting 10:17:40 (5136): No heartbeat from core client for 30 sec - exiting 10:17:41 (5136): No heartbeat from core client for 30 sec - exiting 10:17:42 (5136): No heartbeat from core client for 30 sec - exiting 10:17:43 (5136): No heartbeat from core client for 30 sec - exiting 10:17:44 (5136): No heartbeat from core client for 30 sec - exiting 10:17:45 (5136): No heartbeat from core client for 30 sec - exiting 10:17:46 (5136): No heartbeat from core client for 30 sec - exiting 10:17:47 (5136): No heartbeat from core client for 30 sec - exiting 10:17:48 (5136): No heartbeat from core client for 30 sec - exiting 10:17:49 (5136): No heartbeat from core client for 30 sec - exiting 10:17:50 (5136): No heartbeat from core client for 30 sec - exiting 10:17:51 (5136): No heartbeat from core client for 30 sec - exiting 10:17:52 (5136): No heartbeat from core client for 30 sec - exiting 10:17:53 (5136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:18:27 (4216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 May 2013 14:45:24	1277438	15749495	hadcm3n_zkj3_1960_40_008322038_1	259,200	251,555	0.9705
03 May 2013 03:52:08	1277438	15749495	hadcm3n_zkj3_1960_40_008322038_1	233,280	222,737	0.9548
01 May 2013 20:36:14	1277438	15749495	hadcm3n_zkj3_1960_40_008322038_1	207,360	196,626	0.9482
01 May 2013 14:35:38	1277438	15749495	hadcm3n_zkj3_1960_40_008322038_1	181,440	175,596	0.9678
30 Apr 2013 11:31:19	1277438	15749495	hadcm3n_zkj3_1960_40_008322038_1	155,520	149,699	0.9626
29 Apr 2013 18:43:24	1277438	15749495	hadcm3n_zkj3_1960_40_008322038_1	129,600	123,536	0.9532
28 Apr 2013 15:20:50	1277438	15749495	hadcm3n_zkj3_1960_40_008322038_1	103,680	95,785	0.9239
27 Apr 2013 20:51:47	1277438	15749495	hadcm3n_zkj3_1960_40_008322038_1	77,760	72,812	0.9364
26 Apr 2013 21:44:06	1277438	15749495	hadcm3n_zkj3_1960_40_008322038_1	51,840	51,514	0.9937
25 Apr 2013 21:13:28	1277438	15749495	hadcm3n_zkj3_1960_40_008322038_1	25,920	26,606	1.0265