Task 15689837

Name	hadcm3n_u4r9_2020_40_008339325_0
Workunit	8490186
Created	28 Mar 2013, 17:56:25 UTC
Sent	28 Mar 2013, 21:31:28 UTC
Report deadline	28 Jun 2013, 4:58:39 UTC
Received	18 May 2013, 9:49:07 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1116570
Run time	6 days 2 hours 21 min 10 sec
CPU time	5 days 23 hours 18 min 32 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.65 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> 07:32:59 (4744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:50:23 (1440): No heartbeat from core client for 30 sec - exiting 13:50:24 (1440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:50:25 (1440): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:49:43 (4064): No heartbeat from core client for 30 sec - exiting 08:49:44 (4064): No heartbeat from core client for 30 sec - exiting 08:49:45 (4064): No heartbeat from core client for 30 sec - exiting 08:49:46 (4064): No heartbeat from core client for 30 sec - exiting 08:49:47 (4064): No heartbeat from core client for 30 sec - exiting 08:49:49 (4064): No heartbeat from core client for 30 sec - exiting 08:49:50 (4064): No heartbeat from core client for 30 sec - exiting 08:49:51 (4064): No heartbeat from core client for 30 sec - exiting 08:49:52 (4064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:18:07 (5796): No heartbeat from core client for 30 sec - exiting 08:18:08 (5796): No heartbeat from core client for 30 sec - exiting 08:18:09 (5796): No heartbeat from core client for 30 sec - exiting 08:18:10 (5796): No heartbeat from core client for 30 sec - exiting 08:18:11 (5796): No heartbeat from core client for 30 sec - exiting 08:18:12 (5796): No heartbeat from core client for 30 sec - exiting 08:18:13 (5796): No heartbeat from core client for 30 sec - exiting 08:18:15 (5796): No heartbeat from core client for 30 sec - exiting 08:18:16 (5796): No heartbeat from core client for 30 sec - exiting 08:18:17 (5796): No heartbeat from core client for 30 sec - exiting 08:18:18 (5796): No heartbeat from core client for 30 sec - exiting 08:18:19 (5796): No heartbeat from core client for 30 sec - exiting 08:18:20 (5796): No heartbeat from core client for 30 sec - exiting 08:18:21 (5796): No heartbeat from core client for 30 sec - exiting 08:18:22 (5796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4600, iMonCtr=1 Model crash detected, will try to restart... 18:13:02 (5268): No heartbeat from core client for 30 sec - exiting 18:13:03 (5268): No heartbeat from core client for 30 sec - exiting 18:13:04 (5268): No heartbeat from core client for 30 sec - exiting 18:13:05 (5268): No heartbeat from core client for 30 sec - exiting 18:13:07 (5268): No heartbeat from core client for 30 sec - exiting 18:13:08 (5268): No heartbeat from core client for 30 sec - exiting 18:13:09 (5268): No heartbeat from core client for 30 sec - exiting 18:13:10 (5268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2880, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2568, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=820, iMonCtr=1 Model crash detected, will try to restart... 07:40:20 (5596): No heartbeat from core client for 30 sec - exiting 07:40:21 (5596): No heartbeat from core client for 30 sec - exiting 07:40:22 (5596): No heartbeat from core client for 30 sec - exiting 07:40:23 (5596): No heartbeat from core client for 30 sec - exiting 07:40:24 (5596): No heartbeat from core client for 30 sec - exiting 07:40:26 (5596): No heartbeat from core client for 30 sec - exiting 07:40:27 (5596): No heartbeat from core client for 30 sec - exiting 07:40:28 (5596): No heartbeat from core client for 30 sec - exiting 07:40:29 (5596): No heartbeat from core client for 30 sec - exiting 07:40:30 (5596): No heartbeat from core client for 30 sec - exiting 07:40:31 (5596): No heartbeat from core client for 30 sec - exiting 07:40:32 (5596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:41:08 (5916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:54:26 (1892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6008, iMonCtr=1 Model crash detected, will try to restart... 07:58:54 (4952): No heartbeat from core client for 30 sec - exiting 07:58:56 (4952): No heartbeat from core client for 30 sec - exiting 07:58:57 (4952): No heartbeat from core client for 30 sec - exiting 07:58:58 (4952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:14:02 (4356): No heartbeat from core client for 30 sec - exiting 18:14:03 (4356): No heartbeat from core client for 30 sec - exiting 18:14:05 (4356): No heartbeat from core client for 30 sec - exiting 18:14:06 (4356): No heartbeat from core client for 30 sec - exiting 18:14:07 (4356): No heartbeat from core client for 30 sec - exiting 18:14:08 (4356): No heartbeat from core client for 30 sec - exiting 18:14:09 (4356): No heartbeat from core client for 30 sec - exiting 18:14:10 (4356): No heartbeat from core client for 30 sec - exiting 18:14:11 (4356): No heartbeat from core client for 30 sec - exiting 18:14:12 (4356): No heartbeat from core client for 30 sec - exiting 18:14:13 (4356): No heartbeat from core client for 30 sec - exiting 18:14:14 (4356): No heartbeat from core client for 30 sec - exiting 18:14:15 (4356): No heartbeat from core client for 30 sec - exiting 18:14:17 (4356): No heartbeat from core client for 30 sec - exiting 18:14:18 (4356): No heartbeat from core client for 30 sec - exiting 18:14:19 (4356): No heartbeat from core client for 30 sec - exiting 18:14:20 (4356): No heartbeat from core client for 30 sec - exiting 18:14:21 (4356): No heartbeat from core client for 30 sec - exiting 18:14:22 (4356): No heartbeat from core client for 30 sec - exiting 18:14:23 (4356): No heartbeat from core client for 30 sec - exiting 18:14:24 (4356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:03:59 (3304): No heartbeat from core client for 30 sec - exiting 18:04:00 (3304): No heartbeat from core client for 30 sec - exiting 18:04:01 (3304): No heartbeat from core client for 30 sec - exiting 18:04:02 (3304): No heartbeat from core client for 30 sec - exiting 18:04:03 (3304): No heartbeat from core client for 30 sec - exiting 18:04:04 (3304): No heartbeat from core client for 30 sec - exiting 18:04:05 (3304): No heartbeat from core client for 30 sec - exiting 18:04:07 (3304): No heartbeat from core client for 30 sec - exiting 18:04:08 (3304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:48:05 (3508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:59:54 (4944): No heartbeat from core client for 30 sec - exiting 17:59:56 (4944): No heartbeat from core client for 30 sec - exiting 17:59:57 (4944): No heartbeat from core client for 30 sec - exiting 17:59:58 (4944): No heartbeat from core client for 30 sec - exiting 17:59:59 (4944): No heartbeat from core client for 30 sec - exiting 18:00:00 (4944): No heartbeat from core client for 30 sec - exiting 18:00:01 (4944): No heartbeat from core client for 30 sec - exiting 18:00:02 (4944): No heartbeat from core client for 30 sec - exiting 18:00:03 (4944): No heartbeat from core client for 30 sec - exiting 18:00:04 (4944): No heartbeat from core client for 30 sec - exiting 18:00:05 (4944): No heartbeat from core client for 30 sec - exiting 18:00:06 (4944): No heartbeat from core client for 30 sec - exiting 18:00:08 (4944): No heartbeat from core client for 30 sec - exiting 18:00:09 (4944): No heartbeat from core client for 30 sec - exiting 18:00:10 (4944): No heartbeat from core client for 30 sec - exiting 18:00:11 (4944): No heartbeat from core client for 30 sec - exiting 18:00:12 (4944): No heartbeat from core client for 30 sec - exiting 18:00:13 (4944): No heartbeat from core client for 30 sec - exiting 18:00:14 (4944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:54:29 (3676): No heartbeat from core client for 30 sec - exiting 17:54:30 (3676): No heartbeat from core client for 30 sec - exiting 17:54:31 (3676): No heartbeat from core client for 30 sec - exiting 17:54:32 (3676): No heartbeat from core client for 30 sec - exiting 17:54:33 (3676): No heartbeat from core client for 30 sec - exiting 17:54:34 (3676): No heartbeat from core client for 30 sec - exiting 17:54:35 (3676): No heartbeat from core client for 30 sec - exiting 17:54:36 (3676): No heartbeat from core client for 30 sec - exiting 17:54:37 (3676): No heartbeat from core client for 30 sec - exiting 17:54:38 (3676): No heartbeat from core client for 30 sec - exiting 17:54:40 (3676): No heartbeat from core client for 30 sec - exiting 17:54:41 (3676): No heartbeat from core client for 30 sec - exiting 17:54:42 (3676): No heartbeat from core client for 30 sec - exiting 17:54:43 (3676): No heartbeat from core client for 30 sec - exiting 17:54:44 (3676): No heartbeat from core client for 30 sec - exiting 17:54:45 (3676): No heartbeat from core client for 30 sec - exiting 17:54:46 (3676): No heartbeat from core client for 30 sec - exiting 17:54:47 (3676): No heartbeat from core client for 30 sec - exiting 17:54:48 (3676): No heartbeat from core client for 30 sec - exiting 17:54:49 (3676): No heartbeat from core client for 30 sec - exiting 17:54:50 (3676): No heartbeat from core client for 30 sec - exiting 17:54:52 (3676): No heartbeat from core client for 30 sec - exiting 17:54:53 (3676): No heartbeat from core client for 30 sec - exiting 17:54:54 (3676): No heartbeat from core client for 30 sec - exiting 17:54:55 (3676): No heartbeat from core client for 30 sec - exiting 17:54:56 (3676): No heartbeat from core client for 30 sec - exiting 17:54:57 (3676): No heartbeat from core client for 30 sec - exiting 17:54:58 (3676): No heartbeat from core client for 30 sec - exiting 17:54:59 (3676): No heartbeat from core client for 30 sec - exiting 17:55:00 (3676): No heartbeat from core client for 30 sec - exiting 17:55:01 (3676): No heartbeat from core client for 30 sec - exiting 17:55:02 (3676): No heartbeat from core client for 30 sec - exiting 17:55:04 (3676): No heartbeat from core client for 30 sec - exiting 17:55:05 (3676): No heartbeat from core client for 30 sec - exiting 17:55:06 (3676): No heartbeat from core client for 30 sec - exiting 17:55:07 (3676): No heartbeat from core client for 30 sec - exiting 17:55:08 (3676): No heartbeat from core client for 30 sec - exiting 17:55:09 (3676): No heartbeat from core client for 30 sec - exiting 17:55:10 (3676): No heartbeat from core client for 30 sec - exiting 17:55:11 (3676): No heartbeat from core client for 30 sec - exiting 17:55:12 (3676): No heartbeat from core client for 30 sec - exiting 17:55:13 (3676): No heartbeat from core client for 30 sec - exiting 17:55:14 (3676): No heartbeat from core client for 30 sec - exiting 17:55:16 (3676): No heartbeat from core client for 30 sec - exiting 17:55:17 (3676): No heartbeat from core client for 30 sec - exiting 17:55:18 (3676): No heartbeat from core client for 30 sec - exiting 17:55:19 (3676): No heartbeat from core client for 30 sec - exiting 17:55:20 (3676): No heartbeat from core client for 30 sec - exiting 17:55:21 (3676): No heartbeat from core client for 30 sec - exiting 17:55:22 (3676): No heartbeat from core client for 30 sec - exiting 17:55:23 (3676): No heartbeat from core client for 30 sec - exiting 17:55:24 (3676): No heartbeat from core client for 30 sec - exiting 17:55:25 (3676): No heartbeat from core client for 30 sec - exiting 17:55:27 (3676): No heartbeat from core client for 30 sec - exiting 17:55:28 (3676): No heartbeat from core client for 30 sec - exiting 17:55:29 (3676): No heartbeat from core client for 30 sec - exiting 17:55:30 (3676): No heartbeat from core client for 30 sec - exiting 17:55:31 (3676): No heartbeat from core client for 30 sec - exiting 17:55:32 (3676): No heartbeat from core client for 30 sec - exiting 17:55:33 (3676): No heartbeat from core client for 30 sec - exiting 17:55:34 (3676): No heartbeat from core client for 30 sec - exiting 17:55:35 (3676): No heartbeat from core client for 30 sec - exiting 17:55:36 (3676): No heartbeat from core client for 30 sec - exiting 17:55:37 (3676): No heartbeat from core client for 30 sec - exiting 17:55:39 (3676): No heartbeat from core client for 30 sec - exiting 17:55:40 (3676): No heartbeat from core client for 30 sec - exiting 17:55:41 (3676): No heartbeat from core client for 30 sec - exiting 17:55:42 (3676): No heartbeat from core client for 30 sec - exiting 17:55:43 (3676): No heartbeat from core client for 30 sec - exiting 17:55:44 (3676): No heartbeat from core client for 30 sec - exiting 17:55:45 (3676): No heartbeat from core client for 30 sec - exiting 17:55:46 (3676): No heartbeat from core client for 30 sec - exiting 17:55:47 (3676): No heartbeat from core client for 30 sec - exiting 17:55:48 (3676): No heartbeat from core client for 30 sec - exiting 17:55:49 (3676): No heartbeat from core client for 30 sec - exiting 17:55:51 (3676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:04:52 (804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:06:33 (5884): No heartbeat from core client for 30 sec - exiting 18:06:34 (5884): No heartbeat from core client for 30 sec - exiting 18:06:35 (5884): No heartbeat from core client for 30 sec - exiting 18:06:36 (5884): No heartbeat from core client for 30 sec - exiting 18:06:37 (5884): No heartbeat from core client for 30 sec - exiting 18:06:39 (5884): No heartbeat from core client for 30 sec - exiting 18:06:40 (5884): No heartbeat from core client for 30 sec - exiting 18:06:41 (5884): No heartbeat from core client for 30 sec - exiting 18:06:42 (5884): No heartbeat from core client for 30 sec - exiting 18:06:43 (5884): No heartbeat from core client for 30 sec - exiting 18:06:44 (5884): No heartbeat from core client for 30 sec - exiting 18:06:45 (5884): No heartbeat from core client for 30 sec - exiting 18:06:46 (5884): No heartbeat from core client for 30 sec - exiting 18:06:47 (5884): No heartbeat from core client for 30 sec - exiting 18:06:48 (5884): No heartbeat from core client for 30 sec - exiting 18:06:49 (5884): No heartbeat from core client for 30 sec - exiting 18:06:51 (5884): No heartbeat from core client for 30 sec - exiting 18:06:52 (5884): No heartbeat from core client for 30 sec - exiting 18:06:53 (5884): No heartbeat from core client for 30 sec - exiting 18:06:54 (5884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:23:51 (5940): No heartbeat from core client for 30 sec - exiting 20:23:52 (5940): No heartbeat from core client for 30 sec - exiting 20:23:54 (5940): No heartbeat from core client for 30 sec - exiting 20:23:55 (5940): No heartbeat from core client for 30 sec - exiting 20:23:56 (5940): No heartbeat from core client for 30 sec - exiting 20:23:57 (5940): No heartbeat from core client for 30 sec - exiting 20:23:58 (5940): No heartbeat from core client for 30 sec - exiting 20:23:59 (5940): No heartbeat from core client for 30 sec - exiting 20:24:00 (5940): No heartbeat from core client for 30 sec - exiting 20:24:01 (5940): No heartbeat from core client for 30 sec - exiting 20:24:02 (5940): No heartbeat from core client for 30 sec - exiting 20:24:03 (5940): No heartbeat from core client for 30 sec - exiting 20:24:04 (5940): No heartbeat from core client for 30 sec - exiting 20:24:06 (5940): No heartbeat from core client for 30 sec - exiting 20:24:07 (5940): No heartbeat from core client for 30 sec - exiting 20:24:08 (5940): No heartbeat from core client for 30 sec - exiting 20:24:09 (5940): No heartbeat from core client for 30 sec - exiting 20:24:10 (5940): No heartbeat from core client for 30 sec - exiting 20:24:11 (5940): No heartbeat from core client for 30 sec - exiting 20:24:12 (5940): No heartbeat from core client for 30 sec - exiting 20:24:13 (5940): No heartbeat from core client for 30 sec - exiting 20:24:14 (5940): No heartbeat from core client for 30 sec - exiting 20:24:15 (5940): No heartbeat from core client for 30 sec - exiting 20:24:16 (5940): No heartbeat from core client for 30 sec - exiting 20:24:18 (5940): No heartbeat from core client for 30 sec - exiting 20:24:19 (5940): No heartbeat from core client for 30 sec - exiting 20:24:20 (5940): No heartbeat from core client for 30 sec - exiting 20:24:21 (5940): No heartbeat from core client for 30 sec - exiting 20:24:22 (5940): No heartbeat from core client for 30 sec - exiting 20:24:23 (5940): No heartbeat from core client for 30 sec - exiting 20:24:24 (5940): No heartbeat from core client for 30 sec - exiting 20:24:25 (5940): No heartbeat from core client for 30 sec - exiting 20:24:26 (5940): No heartbeat from core client for 30 sec - exiting 20:24:27 (5940): No heartbeat from core client for 30 sec - exiting 20:24:29 (5940): No heartbeat from core client for 30 sec - exiting 20:24:30 (5940): No heartbeat from core client for 30 sec - exiting 20:24:31 (5940): No heartbeat from core client for 30 sec - exiting 20:24:32 (5940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:25:49 (1348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:26:46 (4028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:55:07 (5316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:22:33 (5596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:13:18 (5292): No heartbeat from core client for 30 sec - exiting 18:13:19 (5292): No heartbeat from core client for 30 sec - exiting 18:13:20 (5292): No heartbeat from core client for 30 sec - exiting 18:13:21 (5292): No heartbeat from core client for 30 sec - exiting 18:13:22 (5292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:13:23 (5292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 20:08:46 (3700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:53:40 (4880): No heartbeat from core client for 30 sec - exiting 18:53:41 (4880): No heartbeat from core client for 30 sec - exiting 18:53:42 (4880): No heartbeat from core client for 30 sec - exiting 18:53:43 (4880): No heartbeat from core client for 30 sec - exiting 18:53:44 (4880): No heartbeat from core client for 30 sec - exiting 18:53:46 (4880): No heartbeat from core client for 30 sec - exiting 18:53:47 (4880): No heartbeat from core client for 30 sec - exiting 18:53:48 (4880): No heartbeat from core client for 30 sec - exiting 18:53:49 (4880): No heartbeat from core client for 30 sec - exiting 18:53:50 (4880): No heartbeat from core client for 30 sec - exiting 18:53:51 (4880): No heartbeat from core client for 30 sec - exiting 18:53:52 (4880): No heartbeat from core client for 30 sec - exiting 18:53:53 (4880): No heartbeat from core client for 30 sec - exiting 18:53:54 (4880): No heartbeat from core client for 30 sec - exiting 18:53:55 (4880): No heartbeat from core client for 30 sec - exiting 18:53:57 (4880): No heartbeat from core client for 30 sec - exiting 18:53:58 (4880): No heartbeat from core client for 30 sec - exiting 18:53:59 (4880): No heartbeat from core client for 30 sec - exiting 18:54:00 (4880): No heartbeat from core client for 30 sec - exiting 18:54:01 (4880): No heartbeat from core client for 30 sec - exiting 18:54:02 (4880): No heartbeat from core client for 30 sec - exiting 18:54:03 (4880): No heartbeat from core client for 30 sec - exiting 18:54:04 (4880): No heartbeat from core client for 30 sec - exiting 18:54:05 (4880): No heartbeat from core client for 30 sec - exiting 18:54:06 (4880): No heartbeat from core client for 30 sec - exiting 18:54:07 (4880): No heartbeat from core client for 30 sec - exiting 18:54:09 (4880): No heartbeat from core client for 30 sec - exiting 18:54:10 (4880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:08:37 (5328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:08:38 (5328): No heartbeat from core client for 30 sec - exiting 19:09:29 (5428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1200, iMonCtr=1 Model crash detected, will try to restart... 18:09:23 (4420): No heartbeat from core client for 30 sec - exiting 18:09:24 (4420): No heartbeat from core client for 30 sec - exiting 18:09:25 (4420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:47:48 (5896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:11:46 (4684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4992, iMonCtr=1 Model crash detected, will try to restart... 07:56:43 (5096): No heartbeat from core client for 30 sec - exiting 07:56:44 (5096): No heartbeat from core client for 30 sec - exiting 07:56:46 (5096): No heartbeat from core client for 30 sec - exiting 07:56:47 (5096): No heartbeat from core client for 30 sec - exiting 07:56:48 (5096): No heartbeat from core client for 30 sec - exiting 07:56:49 (5096): No heartbeat from core client for 30 sec - exiting 07:56:50 (5096): No heartbeat from core client for 30 sec - exiting 07:56:51 (5096): No heartbeat from core client for 30 sec - exiting 07:56:52 (5096): No heartbeat from core client for 30 sec - exiting 07:56:53 (5096): No heartbeat from core client for 30 sec - exiting 07:56:54 (5096): No heartbeat from core client for 30 sec - exiting 07:56:55 (5096): No heartbeat from core client for 30 sec - exiting 07:56:56 (5096): No heartbeat from core client for 30 sec - exiting 07:56:58 (5096): No heartbeat from core client for 30 sec - exiting 07:56:59 (5096): No heartbeat from core client for 30 sec - exiting 07:57:00 (5096): No heartbeat from core client for 30 sec - exiting 07:57:01 (5096): No heartbeat from core client for 30 sec - exiting 07:57:02 (5096): No heartbeat from core client for 30 sec - exiting 07:57:03 (5096): No heartbeat from core client for 30 sec - exiting 07:57:04 (5096): No heartbeat from core client for 30 sec - exiting 07:57:05 (5096): No heartbeat from core client for 30 sec - exiting 07:57:06 (5096): No heartbeat from core client for 30 sec - exiting 07:57:07 (5096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:30:27 (4248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=828, iMonCtr=1 Model crash detected, will try to restart... 17:44:03 (2692): No heartbeat from core client for 30 sec - exiting 17:44:04 (2692): No heartbeat from core client for 30 sec - exiting 17:44:06 (2692): No heartbeat from core client for 30 sec - exiting 17:44:07 (2692): No heartbeat from core client for 30 sec - exiting 17:44:08 (2692): No heartbeat from core client for 30 sec - exiting 17:44:09 (2692): No heartbeat from core client for 30 sec - exiting 17:44:10 (2692): No heartbeat from core client for 30 sec - exiting 17:44:11 (2692): No heartbeat from core client for 30 sec - exiting 17:44:12 (2692): No heartbeat from core client for 30 sec - exiting 17:44:13 (2692): No heartbeat from core client for 30 sec - exiting 17:44:14 (2692): No heartbeat from core client for 30 sec - exiting 17:44:15 (2692): No heartbeat from core client for 30 sec - exiting 17:44:16 (2692): No heartbeat from core client for 30 sec - exiting 17:44:18 (2692): No heartbeat from core client for 30 sec - exiting 17:44:19 (2692): No heartbeat from core client for 30 sec - exiting 17:44:20 (2692): No heartbeat from core client for 30 sec - exiting 17:44:21 (2692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:03:05 (5912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:52:15 (3976): No heartbeat from core client for 30 sec - exiting 17:52:16 (3976): No heartbeat from core client for 30 sec - exiting 17:52:17 (3976): No heartbeat from core client for 30 sec - exiting 17:52:18 (3976): No heartbeat from core client for 30 sec - exiting 17:52:19 (3976): No heartbeat from core client for 30 sec - exiting 17:52:20 (3976): No heartbeat from core client for 30 sec - exiting 17:52:21 (3976): No heartbeat from core client for 30 sec - exiting 17:52:23 (3976): No heartbeat from core client for 30 sec - exiting 17:52:24 (3976): No heartbeat from core client for 30 sec - exiting 17:52:25 (3976): No heartbeat from core client for 30 sec - exiting 17:52:26 (3976): No heartbeat from core client for 30 sec - exiting 17:52:27 (3976): No heartbeat from core client for 30 sec - exiting 17:52:28 (3976): No heartbeat from core client for 30 sec - exiting 17:52:29 (3976): No heartbeat from core client for 30 sec - exiting 17:52:30 (3976): No heartbeat from core client for 30 sec - exiting 17:52:31 (3976): No heartbeat from core client for 30 sec - exiting 17:52:32 (3976): No heartbeat from core client for 30 sec - exiting 17:52:33 (3976): No heartbeat from core client for 30 sec - exiting 17:52:35 (3976): No heartbeat from core client for 30 sec - exiting 17:52:36 (3976): No heartbeat from core client for 30 sec - exiting 17:52:37 (3976): No heartbeat from core client for 30 sec - exiting 17:52:38 (3976): No heartbeat from core client for 30 sec - exiting 17:52:39 (3976): No heartbeat from core client for 30 sec - exiting 17:52:40 (3976): No heartbeat from core client for 30 sec - exiting 17:52:41 (3976): No heartbeat from core client for 30 sec - exiting 17:52:42 (3976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:54:26 (2568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5000, iMonCtr=1 Model crash detected, will try to restart... 18:06:24 (5312): No heartbeat from core client for 30 sec - exiting 18:06:25 (5312): No heartbeat from core client for 30 sec - exiting 18:06:26 (5312): No heartbeat from core client for 30 sec - exiting 18:06:28 (5312): No heartbeat from core client for 30 sec - exiting 18:06:29 (5312): No heartbeat from core client for 30 sec - exiting 18:06:30 (5312): No heartbeat from core client for 30 sec - exiting 18:06:31 (5312): No heartbeat from core client for 30 sec - exiting 18:06:32 (5312): No heartbeat from core client for 30 sec - exiting 18:06:33 (5312): No heartbeat from core client for 30 sec - exiting 18:06:34 (5312): No heartbeat from core client for 30 sec - exiting 18:06:35 (5312): No heartbeat from core client for 30 sec - exiting 18:06:36 (5312): No heartbeat from core client for 30 sec - exiting 18:06:37 (5312): No heartbeat from core client for 30 sec - exiting 18:06:38 (5312): No heartbeat from core client for 30 sec - exiting 18:06:40 (5312): No heartbeat from core client for 30 sec - exiting 18:06:41 (5312): No heartbeat from core client for 30 sec - exiting 18:06:42 (5312): No heartbeat from core client for 30 sec - exiting 18:06:43 (5312): No heartbeat from core client for 30 sec - exiting 18:06:44 (5312):CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 18:28:29 (4404): No heartbeat from core client for 30 sec - exiting 18:28:30 (4404): No heartbeat from core client for 30 sec - exiting 18:28:31 (4404): No heartbeat from core client for 30 sec - exiting 18:28:32 (4404): No heartbeat from core client for 30 sec - exiting 18:28:34 (4404): No heartbeat from core client for 30 sec - exiting 18:28:35 (4404): No heartbeat from core client for 30 sec - exiting 18:28:36 (4404): No heartbeat from core client for 30 sec - exiting 18:28:37 (4404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... C18:34:57 (3592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:37:58 (2896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:48:42 (5448): No heartbeat from core client for 30 sec - exiting 17:48:43 (5448): No heartbeat from core client for 30 sec - exiting 17:48:44 (5448): No heartbeat from core client for 30 sec - exiting 17:48:45 (5448): No heartbeat from core client for 30 sec - exiting 17:48:46 (5448): No heartbeat from core client for 30 sec - exiting 17:48:48 (5448): No heartbeat from core client for 30 sec - exiting 17:48:49 (5448): No heartbeat from core client for 30 sec - exiting 17:48:50 (5448): No heartbeat from core client for 30 sec - exiting 17:48:51 (5448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:48:52 (5448): No heartbeat from core client for 30 sec - exiting 17:48:53 (5448): No heartbeat from core client for 30 sec - exiting 17:48:54 (5448): No heartbeat from core client for 30 sec - exiting 17:48:55 (5448): No heartbeat from core client for 30 sec - exiting 17:48:56 (5448): No heartbeat from core client for 30 sec - exiting 17:48:57 (5448): No heartbeat from core client for 30 sec - exiting 17:48:58 (5448): No heartbeat from core client for 30 sec - exiting 17:49:00 (5448): No heartbeat from core client for 30 sec - exiting 17:49:01 (5448): No heartbeat from core client for 30 sec - exiting 17:49:02 (5448): No heartbeat from core client for 30 sec - exiting 17:55:14 (5576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:19:56 (1704): No heartbeat from core client for 30 sec - exiting 18:19:57 (1704): No heartbeat from core client for 30 sec - exiting 18:19:58 (1704): No heartbeat from core client for 30 sec - exiting 18:19:59 (1704): No heartbeat from core client for 30 sec - exiting 18:20:00 (1704): No heartbeat from core client for 30 sec - exiting 18:20:01 (1704): No heartbeat from core client for 30 sec - exiting 18:20:03 (1704): No heartbeat from core client for 30 sec - exiting 18:20:04 (1704): No heartbeat from core client for 30 sec - exiting 18:20:05 (1704): No heartbeat from core client for 30 sec - exiting 18:20:06 (1704): No heartbeat from core client for 30 sec - exiting 18:20:07 (1704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:20:08 (1704): No heartbeat from core client for 30 sec - exiting 18:20:09 (1704): No heartbeat from core client for 30 sec - exiting 18:20:10 (1704): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:09:03 (4136): No heartbeat from core client for 30 sec - exiting 18:09:05 (4136): No heartbeat from core client for 30 sec - exiting 18:09:06 (4136): No heartbeat from core client for 30 sec - exiting 18:09:07 (4136): No heartbeat from core client for 30 sec - exiting 18:09:08 (4136): No heartbeat from core client for 30 sec - exiting 18:09:09 (4136): No heartbeat from core client for 30 sec - exiting 18:09:10 (4136): No heartbeat from core client for 30 sec - exiting 18:09:11 (4136): No heartbeat from core client for 30 sec - exiting 18:09:12 (4136): No heartbeat from core client for 30 sec - exiting 18:09:13 (4136): No heartbeat from core client for 30 sec - exiting 18:09:14 (4136): No heartbeat from core client for 30 sec - exiting 18:09:15 (4136): No heartbeat from core client for 30 sec - exiting 18:09:16 (4136): No heartbeat from core client for 30 sec - exiting 18:09:17 (4136): No heartbeat from core client for 30 sec - exiting 18:09:18 (4136): No heartbeat from core client for 30 sec - exiting 18:09:19 (4136): No heartbeat from core client for 30 sec - exiting 18:09:20 (4136): No heartbeat from core client for 30 sec - exiting 18:09:21 (4136): No heartbeat from core client for 30 sec - exiting 18:09:23 (4136): No heartbeat from core client for 30 sec - exiting 18:09:24 (4136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:16:03 (2956): No heartbeat from core client for 30 sec - exiting 18:16:04 (2956): No heartbeat from core client for 30 sec - exiting 18:16:05 (2956): No heartbeat from core client for 30 sec - exiting 18:16:06 (2956): No heartbeat from core client for 30 sec - exiting 18:16:07 (2956): No heartbeat from core client for 30 sec - exiting 18:16:08 (2956): No heartbeat from core client for 30 sec - exiting 18:16:09 (2956): No heartbeat from core client for 30 sec - exiting 18:16:10 (2956): No heartbeat from core client for 30 sec - exiting 18:16:11 (2956): No heartbeat from core client for 30 sec - exiting 18:16:12 (2956): No heartbeat from core client for 30 sec - exiting 18:16:14 (2956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5584, iMonCtr=1 Model crash detected, will try to restart... 08:43:13 (2736): No heartbeat from core client for 30 sec - exiting 08:43:14 (2736): No heartbeat from core client for 30 sec - exiting 08:43:15 (2736): No heartbeat from core client for 30 sec - exiting 08:43:17 (2736): No heartbeat from core client for 30 sec - exiting 08:43:18 (2736): No heartbeat from core client for 30 sec - exiting 08:43:19 (2736): No heartbeat from core client for 30 sec - exiting 08:43:20 (2736): No heartbeat from core client for 30 sec - exiting 08:43:21 (2736): No heartbeat from core client for 30 sec - exiting 08:43:22 (2736): No heartbeat from core client for 30 sec - exiting 08:43:23 (2736): No heartbeat from core client for 30 sec - exiting 08:43:24 (2736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:53:32 (624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:01:05 (6112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:04:28 (4076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:14:21 (2920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:20:11 (6020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:27:21 (4888): No heartbeat from core client for 30 sec - exiting 18:27:22 (4888): No heartbeat from core client for 30 sec - exiting 18:27:23 (4888): No heartbeat from core client for 30 sec - exiting 18:27:24 (4888): No heartbeat from core client for 30 sec - exiting 18:27:25 (4888): No heartbeat from core client for 30 sec - exiting 18:27:26 (4888): No heartbeat from core client for 30 sec - exiting 18:27:27 (4888): No heartbeat from core client for 30 sec - exiting 18:27:29 (4888): No heartbeat from core client for 30 sec - exiting 18:27:30 (4888): No heartbeat from core client for 30 sec - exiting 18:27:31 (4888): No heartbeat from core client for 30 sec - exiting 18:27:32 (4888): No heartbeat from core client for 30 sec - exiting 18:27:33 (4888): No heartbeat from core client for 30 sec - exiting 18:27:34 (4888): No heartbeat from core client for 30 sec - exiting 18:27:35 (4888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:27:36 (4888): No heartbeat from core client for 30 sec - exiting 18:27:37 (4888): No heartbeat from core client for 30 sec - exiting 18:27:38 (4888): No heartbeat from core client for 30 sec - exiting 18:27:40 (4888): No heartbeat from core client for 30 sec - exiting 18:27:41 (4888): No heartbeat from core client for 30 sec - exiting 18:27:42 (4888): No heartbeat from core client for 30 sec - exiting 18:27:43 (4888): No heartbeat from core client for 30 sec - exiting 18:27:44 (4888): No heartbeat from core client for 30 sec - exiting 18:27:45 (4888): No heartbeat from core client for 30 sec - exiting 18:27:46 (4888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:20:47 (136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:05:09 (2292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:25:16 (1724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:03:47 (3652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=38444, iMonCtr=1 Model crash detected, will try to restart... 20:19:59 (34412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 May 2013 09:54:05	1116570	15689837	hadcm3n_u4r9_2020_40_008339325_0	259,200	515,908	1.9904
06 May 2013 18:44:43	1116570	15689837	hadcm3n_u4r9_2020_40_008339325_0	233,280	465,263	1.9944
04 May 2013 13:27:11	1116570	15689837	hadcm3n_u4r9_2020_40_008339325_0	207,360	414,580	1.9993
01 May 2013 06:48:15	1116570	15689837	hadcm3n_u4r9_2020_40_008339325_0	181,440	363,400	2.0029
21 Apr 2013 19:52:48	1116570	15689837	hadcm3n_u4r9_2020_40_008339325_0	155,520	311,941	2.0058
20 Apr 2013 16:00:49	1116570	15689837	hadcm3n_u4r9_2020_40_008339325_0	129,600	260,088	2.0069
12 Apr 2013 16:11:01	1116570	15689837	hadcm3n_u4r9_2020_40_008339325_0	103,680	207,820	2.0044
07 Apr 2013 06:02:01	1116570	15689837	hadcm3n_u4r9_2020_40_008339325_0	77,760	156,173	2.0084
01 Apr 2013 18:39:52	1116570	15689837	hadcm3n_u4r9_2020_40_008339325_0	51,840	104,997	2.0254
30 Mar 2013 19:11:02	1116570	15689837	hadcm3n_u4r9_2020_40_008339325_0	25,920	53,840	2.0772