Task 15632402

Name	hadcm3n_3kog_1980_40_008318369_0
Workunit	8469504
Created	24 Feb 2013, 5:09:35 UTC
Sent	24 Feb 2013, 5:09:43 UTC
Report deadline	26 May 2013, 12:36:54 UTC
Received	29 Mar 2013, 11:04:30 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1268982
Run time	22 days 15 hours 20 min 43 sec
CPU time	21 days 4 hours 1 min 37 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.65 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:41:13 (6696): No heartbeat from core client for 30 sec - exiting 18:41:14 (6696): No heartbeat from core client for 30 sec - exiting 18:41:15 (6696): No heartbeat from core client for 30 sec - exiting 18:41:16 (6696): No heartbeat from core client for 30 sec - exiting 18:41:17 (6696): No heartbeat from core client for 30 sec - exiting 18:41:18 (6696): No heartbeat from core client for 30 sec - exiting 18:41:19 (6696): No heartbeat from core client for 30 sec - exiting 18:41:20 (6696): No heartbeat from core client for 30 sec - exiting 18:41:21 (6696): No heartbeat from core client for 30 sec - exiting 18:41:22 (6696): No heartbeat from core client for 30 sec - exiting 18:41:23 (6696): No heartbeat from core client for 30 sec - exiting 18:41:24 (6696): No heartbeat from core client for 30 sec - exiting 18:41:25 (6696): No heartbeat from core client for 30 sec - exiting 18:41:26 (6696): No heartbeat from core client for 30 sec - exiting 18:41:27 (6696): No heartbeat from core client for 30 sec - exiting 18:41:28 (6696): No heartbeat from core client for 30 sec - exiting 18:41:29 (6696): No heartbeat from core client for 30 sec - exiting 18:41:30 (6696): No heartbeat from core client for 30 sec - exiting 18:41:31 (6696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:13:07 (4556): No heartbeat from core client for 30 sec - exiting 18:13:08 (4556): No heartbeat from core client for 30 sec - exiting 18:13:09 (4556): No heartbeat from core client for 30 sec - exiting 18:13:10 (4556): No heartbeat from core client for 30 sec - exiting 18:13:11 (4556): No heartbeat from core client for 30 sec - exiting 18:13:12 (4556): No heartbeat from core client for 30 sec - exiting 18:13:13 (4556): No heartbeat from core client for 30 sec - exiting 18:13:14 (4556): No heartbeat from core client for 30 sec - exiting 18:13:15 (4556): No heartbeat from core client for 30 sec - exiting 18:13:16 (4556): No heartbeat from core client for 30 sec - exiting 18:13:17 (4556): No heartbeat from core client for 30 sec - exiting 18:13:18 (4556): No heartbeat from core client for 30 sec - exiting 18:13:19 (4556): No heartbeat from core client for 30 sec - exiting 18:13:20 (4556): No heartbeat from core client for 30 sec - exiting 18:13:21 (4556): No heartbeat from core client for 30 sec - exiting 18:13:22 (4556): No heartbeat from core client for 30 sec - exiting 18:13:23 (4556): No heartbeat from core client for 30 sec - exiting 18:13:24 (4556): No heartbeat from core client for 30 sec - exiting 18:13:25 (4556): No heartbeat from core client for 30 sec - exiting 18:13:26 (4556): No heartbeat from core client for 30 sec - exiting 18:13:27 (4556): No heartbeat from core client for 30 sec - exiting 18:13:28 (4556): No heartbeat from core client for 30 sec - exiting 18:13:29 (4556): No heartbeat from core client for 30 sec - exiting 18:13:30 (4556): No heartbeat from core client for 30 sec - exiting 18:13:31 (4556): No heartbeat from core client for 30 sec - exiting 18:13:32 (4556): No heartbeat from core client for 30 sec - exiting 18:13:33 (4556): No heartbeat from core client for 30 sec - exiting 18:13:34 (4556): No heartbeat from core client for 30 sec - exiting 18:13:35 (4556): No heartbeat from core client for 30 sec - exiting 18:13:36 (4556): No heartbeat from core client for 30 sec - exiting 18:13:37 (4556): No heartbeat from core client for 30 sec - exiting 18:13:38 (4556): No heartbeat from core client for 30 sec - exiting 18:13:39 (4556): No heartbeat from core client for 30 sec - exiting 18:13:40 (4556): No heartbeat from core client for 30 sec - exiting 18:13:41 (4556): No heartbeat from core client for 30 sec - exiting 18:13:42 (4556): No heartbeat from core client for 30 sec - exiting 18:13:43 (4556): No heartbeat from core client for 30 sec - exiting 18:13:44 (4556): No heartbeat from core client for 30 sec - exiting 18:13:45 (4556): No heartbeat from core client for 30 sec - exiting 18:13:46 (4556): No heartbeat from core client for 30 sec - exiting 18:13:47 (4556): No heartbeat from core client for 30 sec - exiting 18:13:48 (4556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:48:30 (8000): No heartbeat from core client for 30 sec - exiting 14:48:31 (8000): No heartbeat from core client for 30 sec - exiting 14:48:32 (8000): No heartbeat from core client for 30 sec - exiting 14:48:33 (8000): No heartbeat from core client for 30 sec - exiting 14:48:34 (8000): No heartbeat from core client for 30 sec - exiting 14:48:35 (8000): No heartbeat from core client for 30 sec - exiting 14:48:36 (8000): No heartbeat from core client for 30 sec - exiting 14:48:37 (8000): No heartbeat from core client for 30 sec - exiting 14:48:38 (8000): No heartbeat from core client for 30 sec - exiting 14:48:39 (8000): No heartbeat from core client for 30 sec - exiting 14:48:40 (8000): No heartbeat from core client for 30 sec - exiting 14:48:41 (8000): No heartbeat from core client for 30 sec - exiting 14:48:42 (8000): No heartbeat from core client for 30 sec - exiting 14:48:43 (8000): No heartbeat from core client for 30 sec - exiting 14:48:44 (8000): No heartbeat from core client for 30 sec - exiting 14:48:45 (8000): No heartbeat from core client for 30 sec - exiting 14:48:46 (8000): No heartbeat from core client for 30 sec - exiting 14:48:47 (8000): No heartbeat from core client for 30 sec - exiting 14:48:48 (8000): No heartbeat from core client for 30 sec - exiting 14:48:49 (8000): No heartbeat from core client for 30 sec - exiting 14:48:50 (8000): No heartbeat from core client for 30 sec - exiting 14:48:51 (8000): No heartbeat from core client for 30 sec - exiting 14:48:52 (8000): No heartbeat from core client for 30 sec - exiting 14:48:53 (8000): No heartbeat from core client for 30 sec - exiting 14:48:54 (8000): No heartbeat from core client for 30 sec - exiting 14:48:55 (8000): No heartbeat from core client for 30 sec - exiting 14:48:56 (8000): No heartbeat from core client for 30 sec - exiting 14:48:57 (8000): No heartbeat from core client for 30 sec - exiting 14:48:58 (8000): No heartbeat from core client for 30 sec - exiting 14:48:59 (8000): No heartbeat from core client for 30 sec - exiting 14:49:00 (8000): No heartbeat from core client for 30 sec - exiting 14:49:01 (8000): No heartbeat from core client for 30 sec - exiting 14:49:02 (8000): No heartbeat from core client for 30 sec - exiting 14:49:03 (8000): No heartbeat from core client for 30 sec - exiting 14:49:04 (8000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:41:14 (5740): No heartbeat from core client for 30 sec - exiting 03:41:15 (5740): No heartbeat from core client for 30 sec - exiting 03:41:16 (5740): No heartbeat from core client for 30 sec - exiting 03:41:17 (5740): No heartbeat from core client for 30 sec - exiting 03:41:18 (5740): No heartbeat from core client for 30 sec - exiting 03:41:19 (5740): No heartbeat from core client for 30 sec - exiting 03:41:20 (5740): No heartbeat from core client for 30 sec - exiting 03:41:21 (5740): No heartbeat from core client for 30 sec - exiting 03:41:22 (5740): No heartbeat from core client for 30 sec - exiting 03:41:23 (5740): No heartbeat from core client for 30 sec - exiting 03:41:24 (5740): No heartbeat from core client for 30 sec - exiting 03:41:25 (5740): No heartbeat from core client for 30 sec - exiting 03:41:26 (5740): No heartbeat from core client for 30 sec - exiting 03:41:27 (5740): No heartbeat from core client for 30 sec - exiting 03:41:28 (5740): No heartbeat from core client for 30 sec - exiting 03:41:29 (5740): No heartbeat from core client for 30 sec - exiting 03:41:30 (5740): No heartbeat from core client for 30 sec - exiting 03:41:31 (5740): No heartbeat from core client for 30 sec - exiting 03:41:32 (5740): No heartbeat from core client for 30 sec - exiting 03:41:33 (5740): No heartbeat from core client for 30 sec - exiting 03:41:34 (5740): No heartbeat from core client for 30 sec - exiting 03:41:35 (5740): No heartbeat from core client for 30 sec - exiting 03:41:36 (5740): No heartbeat from core client for 30 sec - exiting 03:41:37 (5740): No heartbeat from core client for 30 sec - exiting 03:41:38 (5740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:53:29 (6660): No heartbeat from core client for 30 sec - exiting 04:53:30 (6660): No heartbeat from core client for 30 sec - exiting 04:53:31 (6660): No heartbeat from core client for 30 sec - exiting 04:53:32 (6660): No heartbeat from core client for 30 sec - exiting 04:53:33 (6660): No heartbeat from core client for 30 sec - exiting 04:53:34 (6660): No heartbeat from core client for 30 sec - exiting 04:53:35 (6660): No heartbeat from core client for 30 sec - exiting 04:53:36 (6660): No heartbeat from core client for 30 sec - exiting 04:53:37 (6660): No heartbeat from core client for 30 sec - exiting 04:53:38 (6660): No heartbeat from core client for 30 sec - exiting 04:53:39 (6660): No heartbeat from core client for 30 sec - exiting 04:53:40 (6660): No heartbeat from core client for 30 sec - exiting 04:53:41 (6660): No heartbeat from core client for 30 sec - exiting 04:53:42 (6660): No heartbeat from core client for 30 sec - exiting 04:53:43 (6660): No heartbeat from core client for 30 sec - exiting 04:53:44 (6660): No heartbeat from core client for 30 sec - exiting 04:53:45 (6660): No heartbeat from core client for 30 sec - exiting 04:53:46 (6660): No heartbeat from core client for 30 sec - exiting 04:53:47 (6660): No heartbeat from core client for 30 sec - exiting 04:53:48 (6660): No heartbeat from core client for 30 sec - exiting 04:53:49 (6660): No heartbeat from core client for 30 sec - exiting 04:53:50 (6660): No heartbeat from core client for 30 sec - exiting 04:53:51 (6660): No heartbeat from core client for 30 sec - exiting 04:53:52 (6660): No heartbeat from core client for 30 sec - exiting 04:53:53 (6660): No heartbeat from core client for 30 sec - exiting 04:53:54 (6660): No heartbeat from core client for 30 sec - exiting 04:53:55 (6660): No heartbeat from core client for 30 sec - exiting 04:53:56 (6660): No heartbeat from core client for 30 sec - exiting 04:53:57 (6660): No heartbeat from core client for 30 sec - exiting 04:53:58 (6660): No heartbeat from core client for 30 sec - exiting 04:53:59 (6660): No heartbeat from core client for 30 sec - exiting 04:54:00 (6660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15716, selfPID=15716, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/3kogko.pjk4c10 Error converting file to netcdf: dataout/3kogko.pik4c10 Error converting file to netcdf: dataout/3kogko.pfk4c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1148, iMonCtr=1 Model crash detected, will try to restart... 03:34:13 (7744): No heartbeat from core client for 30 sec - exiting 03:34:14 (7744): No heartbeat from core client for 30 sec - exiting 03:34:15 (7744): No heartbeat from core client for 30 sec - exiting 03:34:16 (7744): No heartbeat from core client for 30 sec - exiting 03:34:17 (7744): No heartbeat from core client for 30 sec - exiting 03:34:18 (7744): No heartbeat from core client for 30 sec - exiting 03:34:19 (7744): No heartbeat from core client for 30 sec - exiting 03:34:20 (7744): No heartbeat from core client for 30 sec - exiting 03:34:21 (7744): No heartbeat from core client for 30 sec - exiting 03:34:22 (7744): No heartbeat from core client for 30 sec - exiting 03:34:23 (7744): No heartbeat from core client for 30 sec - exiting 03:34:24 (7744): No heartbeat from core client for 30 sec - exiting 03:34:25 (7744): No heartbeat from core client for 30 sec - exiting 03:34:26 (7744): No heartbeat from core client for 30 sec - exiting 03:34:27 (7744): No heartbeat from core client for 30 sec - exiting 03:34:28 (7744): No heartbeat from core client for 30 sec - exiting 03:34:29 (7744): No heartbeat from core client for 30 sec - exiting 03:34:30 (7744): No heartbeat from core client for 30 sec - exiting 03:34:31 (7744): No heartbeat from core client for 30 sec - exiting 03:34:32 (7744): No heartbeat from core client for 30 sec - exiting 03:34:33 (7744): No heartbeat from core client for 30 sec - exiting 03:34:34 (7744): No heartbeat from core client for 30 sec - exiting 03:34:35 (7744): No heartbeat from core client for 30 sec - exiting 03:34:36 (7744): No heartbeat from core client for 30 sec - exiting 03:34:37 (7744): No heartbeat from core client for 30 sec - exiting 03:34:38 (7744): No heartbeat from core client for 30 sec - exiting 03:34:39 (7744): No heartbeat from core client for 30 sec - exiting 03:34:40 (7744): No heartbeat from core client for 30 sec - exiting 03:34:41 (7744): No heartbeat from core client for 30 sec - exiting 03:34:42 (7744): No heartbeat from core client for 30 sec - exiting 03:34:43 (7744): No heartbeat from core client for 30 sec - exiting 03:34:44 (7744): No heartbeat from core client for 30 sec - exiting 03:34:45 (7744): No heartbeat from core client for 30 sec - exiting 03:34:46 (7744): No heartbeat from core client for 30 sec - exiting 03:34:47 (7744): No heartbeat from core client for 30 sec - exiting 03:34:48 (7744): No heartbeat from core client for 30 sec - exiting 03:34:49 (7744): No heartbeat from core client for 30 sec - exiting 03:34:50 (7744): No heartbeat from core client for 30 sec - exiting 03:34:51 (7744): No heartbeat from core client for 30 sec - exiting 03:34:52 (7744): No heartbeat from core client for 30 sec - exiting 03:34:53 (7744): No heartbeat from core client for 30 sec - exiting 03:34:54 (7744): No heartbeat from core client for 30 sec - exiting 03:34:55 (7744): No heartbeat from core client for 30 sec - exiting 03:34:56 (7744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Mar 2013 10:06:24	1268982	15632402	hadcm3n_3kog_1980_40_008318369_0	1,036,800	1,828,892	1.7640
29 Mar 2013 00:41:33	1268982	15632402	hadcm3n_3kog_1980_40_008318369_0	1,010,880	1,794,722	1.7754
28 Mar 2013 10:54:25	1268982	15632402	hadcm3n_3kog_1980_40_008318369_0	984,960	1,759,398	1.7863
27 Mar 2013 23:45:25	1268982	15632402	hadcm3n_3kog_1980_40_008318369_0	959,040	1,724,454	1.7981
27 Mar 2013 08:22:11	1268982	15632402	hadcm3n_3kog_1980_40_008318369_0	933,120	1,686,537	1.8074
26 Mar 2013 19:26:33	1268982	15632402	hadcm3n_3kog_1980_40_008318369_0	907,200	1,650,382	1.8192
26 Mar 2013 04:29:28	1268982	15632402	hadcm3n_3kog_1980_40_008318369_0	881,280	1,604,010	1.8201
25 Mar 2013 03:20:54	1268982	15632402	hadcm3n_3kog_1980_40_008318369_0	855,360	1,558,180	1.8217
24 Mar 2013 17:51:14	1268982	15632402	hadcm3n_3kog_1980_40_008318369_0	829,440	1,524,250	1.8377
24 Mar 2013 08:22:00	1268982	15632402	hadcm3n_3kog_1980_40_008318369_0	803,520	1,489,977	1.8543
23 Mar 2013 21:58:03	1268982	15632402	hadcm3n_3kog_1980_40_008318369_0	777,600	1,455,085	1.8713
23 Mar 2013 11:24:19	1268982	15632402	hadcm3n_3kog_1980_40_008318369_0	751,680	1,419,359	1.8882
22 Mar 2013 23:18:32	1268982	15632402	hadcm3n_3kog_1980_40_008318369_0	725,760	1,379,893	1.9013
22 Mar 2013 11:24:49	1268982	15632402	hadcm3n_3kog_1980_40_008318369_0	699,840	1,340,111	1.9149
21 Mar 2013 22:40:32	1268982	15632402	hadcm3n_3kog_1980_40_008318369_0	673,920	1,299,357	1.9281
21 Mar 2013 04:53:15	1268982	15632402	hadcm3n_3kog_1980_40_008318369_0	648,000	1,257,096	1.9400
20 Mar 2013 11:07:34	1268982	15632402	hadcm3n_3kog_1980_40_008318369_0	622,080	1,205,130	1.9373
19 Mar 2013 14:56:45	1268982	15632402	hadcm3n_3kog_1980_40_008318369_0	596,160	1,153,431	1.9348
18 Mar 2013 22:11:17	1268982	15632402	hadcm3n_3kog_1980_40_008318369_0	570,240	1,103,287	1.9348
18 Mar 2013 08:08:31	1268982	15632402	hadcm3n_3kog_1980_40_008318369_0	544,320	1,053,468	1.9354