Task 19130812

Name	hadcm3n_ldpv_198012_480_010219810_0
Workunit	10219810
Created	4 Dec 2015, 14:39:48 UTC
Sent	4 Dec 2015, 14:43:19 UTC
Report deadline	15 Nov 2016, 20:03:19 UTC
Received	18 Feb 2016, 0:55:43 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1376367
Run time	21 days 11 hours 12 min
CPU time	15 days 20 hours 39 min 7 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.42 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.6.9</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 09:36:39 (4016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:16:18 (2404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:14:10 (3008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:12:22 (5148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:38:06 (3496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:36:52 (3976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:31:28 (2228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:19:20 (228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:43:58 (3944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:30:56 (2632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:05:19 (3316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:02:41 (1456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:00:50 (5680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:19:09 (2092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:19:11 (2092): No heartbeat from core client for 30 sec - exiting 18:19:12 (2092): No heartbeat from core client for 30 sec - exiting 19:17:13 (6072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:16:05 (4908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:41:53 (1244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3020, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3020, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:32:06 (4024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:11:12 (584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:11:13 (584): No heartbeat from core client for 30 sec - exiting 23:08:04 (3620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:20:07 (3884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:24:11 (2972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:20:45 (2656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:38:43 (276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:38:44 (276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:25:40 (2684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/ldpvko.pjj8c10 Error converting file to netcdf: dataout/ldpvko.pij8c10 Error converting file to netcdf: dataout/ldpvko.pfj8c10 Error converting file to netcdf: dataout/ldpvka.phj8c10 Error converting file to netcdf: dataout/ldpvka.pgj8c10 Error converting file to netcdf: dataout/ldpvka.pej8c10 Error converting file to netcdf: dataout/ldpvka.pdj8c10 CPDN Monitor - Quit request from BOINC... 13:24:31 (3804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:22:37 (1952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:20:47 (196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:19:45 (1184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:18:26 (5048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:02:59 (3736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:01:04 (1212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:47:11 (4040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:12 (4040): No heartbeat from core client for 30 sec - exiting 09:46:04 (3164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:30:45 (4004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:29:27 (5408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:10:03 (268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:49:15 (3100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:47:40 (4972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:46:08 (4744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:37:38 (2960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:29:36 (1872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:29:37 (1872): No heartbeat from core client for 30 sec - exiting 12:27:42 (880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:23:33 (3144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:22:29 (5192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:19:43 (4764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:06:25 (3884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:06:26 (3884): No heartbeat from core client for 30 sec - exiting 14:58:45 (5756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:56:00 (13988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:54:34 (10652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:32:35 (10820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:32:37 (10820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:07:44 (3584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:05:50 (5088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:04:48 (4516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=648, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:46:02 (4784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:43:57 (5484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:41:24 (4568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:34:10 (3068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:34:11 (3068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 22:30:02 (1948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:01:49 (2784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:00:20 (4832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:04:11 (4368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:03:06 (5444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:59:05 (1744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:08:53 (5488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:07:22 (4676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:06:19 (4540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:05:10 (4436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:03:56 (6064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:01:43 (6104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:11:22 (2188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:08:36 (5656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:07:34 (1212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:11:25 (492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:09:17 (4124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:44:36 (2428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:01:50 (1024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:00:25 (2200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:59:00 (4852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:57:35 (5936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:43:20 (5716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:36:11 (3760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:29:56 (4668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:27:33 (5472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C930CAE read attempt to address 0x400AE12C Engaging BOINC Windows Runtime Debugger... 10:58:18 (2724): No heartbeat from core client for 30 sec - exiting 10:58:19 (2724): No heartbeat from core client for 30 sec - exiting 10:58:20 (2724): No heartbeat from core client for 30 sec - exiting 10:58:21 (2724): No heartbeat from core client for 30 sec - exiting 10:58:22 (2724): No heartbeat from core client for 30 sec - exiting 10:58:23 (2724): No heartbeat from core client for 30 sec - exiting 10:58:24 (2724): No heartbeat from core client for 30 sec - exiting 10:58:25 (2724): No heartbeat from core client for 30 sec - exiting 10:58:26 (2724): No heartbeat from core client for 30 sec - exiting 10:58:27 (2724): No heartbeat from core client for 30 sec - exiting 10:58:28 (2724): No heartbeat from core client for 30 sec - exiting 10:58:29 (2724): No heartbeat from core client for 30 sec - exiting 10:58:30 (2724): No heartbeat from core client for 30 sec - exiting 10:58:31 (2724): No heartbeat from core client for 30 sec - exiting 10:58:32 (2724): No heartbeat from core client for 30 sec - exiting 10:58:33 (2724): No heartbeat from core client for 30 sec - exiting 10:58:34 (2724): No heartbeat from core client for 30 sec - exiting 10:58:35 (2724): No heartbeat from core client for 30 sec - exiting 10:58:36 (2724): No heartbeat from core client for 30 sec - exiting 10:58:37 (2724): No heartbeat from core client for 30 sec - exiting 10:58:39 (2724): No heartbeat from core client for 30 sec - exiting 10:58:40 (2724): No heartbeat from core client for 30 sec - exiting 10:58:41 (2724): No heartbeat from core client for 30 sec - exiting 10:58:42 (2724): No heartbeat from core client for 30 sec - exiting 10:58:43 (2724): No heartbeat from core client for 30 sec - exiting 10:58:44 (2724): No heartbeat from core client for 30 sec - exiting 10:58:45 (2724): No heartbeat from core client for 30 sec - exiting 10:58:46 (2724): No heartbeat from core client for 30 sec - exiting 10:58:47 (2724): No heartbeat from core client for 30 sec - exiting 10:58:48 (2724): No heartbeat from core client for 30 sec - exiting 10:58:49 (2724): No heartbeat from core client for 30 sec - exiting 10:58:50 (2724): No heartbeat from core client for 30 sec - exiting 10:58:51 (2724): No heartbeat from core client for 30 sec - exiting 10:58:52 (2724): No heartbeat from core client for 30 sec - exiting 13:57:12 (2724): No heartbeat from core client for 30 sec - exiting 13:57:13 (2724): No heartbeat from core client for 30 sec - exiting 13:57:14 (2724): No heartbeat from core client for 30 sec - exiting 13:57:15 (2724): No heartbeat from core client for 30 sec - exiting 13:57:16 (2724): No heartbeat from core client for 30 sec - exiting 13:57:17 (2724): No heartbeat from core client for 30 sec - exiting 13:57:18 (2724): No heartbeat from core client for 30 sec - exiting 13:57:19 (2724): No heartbeat from core client for 30 sec - exiting 13:57:20 (2724): No heartbeat from core client for 30 sec - exiting 13:57:21 (2724): No heartbeat from core client for 30 sec - exiting 13:57:22 (2724): No heartbeat from core client for 30 sec - exiting 13:57:23 (2724): No heartbeat from core client for 30 sec - exiting 13:57:24 (2724): No heartbeat from core client for 30 sec - exiting 13:57:25 (2724): No heartbeat from core client for 30 sec - exiting 13:57:26 (2724): No heartbeat from core client for 30 sec - exiting 13:57:27 (2724): No heartbeat from core client for 30 sec - exiting 13:57:28 (2724): No heartbeat from core client for 30 sec - exiting 13:57:29 (2724): No heartbeat from core client for 30 sec - exiting 13:57:30 (2724): No heartbeat from core client for 30 sec - exiting 13:57:31 (2724): No heartbeat from core client for 30 sec - exiting 13:57:32 (2724): No heartbeat from core client for 30 sec - exiting 13:57:33 (2724): No heartbeat from core client for 30 sec - exiting 13:57:34 (2724): No heartbeat from core client for 30 sec - exiting 13:57:35 (2724): No heartbeat from core client for 30 sec - exiting 13:57:36 (2724): No heartbeat from core client for 30 sec - exiting 13:57:37 (2724): No heartbeat from core client for 30 sec - exiting 13:57:39 (2724): No heartbeat from core client for 30 sec - exiting 13:57:40 (2724): No heartbeat from core client for 30 sec - exiting 13:57:41 (2724): No heartbeat from core client for 30 sec - exiting 13:57:42 (2724): No heartbeat from core client for 30 sec - exiting 13:57:43 (2724): No heartbeat from core client for 30 sec - exiting 13:57:44 (2724): No heartbeat from core client for 30 sec - exiting 13:57:45 (2724): No heartbeat from core client for 30 sec - exiting 13:57:46 (2724): No heartbeat from core client for 30 sec - exiting 13:57:47 (2724): No heartbeat from core client for 30 sec - exiting 13:57:48 (2724): No heartbeat from core client for 30 sec - exiting 18:52:57 (2724): No heartbeat from core client for 30 sec - exiting 18:52:58 (2724): No heartbeat from core client for 30 sec - exiting 18:52:59 (2724): No heartbeat from core client for 30 sec - exiting 18:53:00 (2724): No heartbeat from core client for 30 sec - exiting 18:53:01 (2724): No heartbeat from core client for 30 sec - exiting 18:53:03 (2724): No heartbeat from core client for 30 sec - exiting 18:53:04 (2724): No heartbeat from core client for 30 sec - exiting 18:53:05 (2724): No heartbeat from core client for 30 sec - exiting 18:53:06 (2724): No heartbeat from core client for 30 sec - exiting 18:53:07 (2724): No heartbeat from core client for 30 sec - exiting 18:53:08 (2724): No heartbeat from core client for 30 sec - exiting 18:53:09 (2724): No heartbeat from core client for 30 sec - exiting 18:53:10 (2724): No heartbeat from core client for 30 sec - exiting 18:53:11 (2724): No heartbeat from core client for 30 sec - exiting 18:53:12 (2724): No heartbeat from core client for 30 sec - exiting 18:53:14 (2724): No heartbeat from core client for 30 sec - exiting 18:53:15 (2724): No heartbeat from core client for 30 sec - exiting 18:53:16 (2724): No heartbeat from core client for 30 sec - exiting 18:53:17 (2724): No heartbeat from core client for 30 sec - exiting 18:53:18 (2724): No heartbeat from core client for 30 sec - exiting 18:53:19 (2724): No heartbeat from core client for 30 sec - exiting 18:53:20 (2724): No heartbeat from core client for 30 sec - exiting 18:53:21 (2724): No heartbeat from core client for 30 sec - exiting 18:53:22 (2724): No heartbeat from core client for 30 sec - exiting 18:53:23 (2724): No heartbeat from core client for 30 sec - exiting 18:53:24 (2724): No heartbeat from core client for 30 sec - exiting 18:53:25 (2724): No heartbeat from core client for 30 sec - exiting 18:53:26 (2724): No heartbeat from core client for 30 sec - exiting 20:50:44 (2724): No heartbeat from core client for 30 sec - exiting 20:50:45 (2724): No heartbeat from core client for 30 sec - exiting 20:50:46 (2724): No heartbeat from core client for 30 sec - exiting 20:50:47 (2724): No heartbeat from core client for 30 sec - exiting 20:50:48 (2724): No heartbeat from core client for 30 sec - exiting 20:50:49 (2724): No heartbeat from core client for 30 sec - exiting 20:50:50 (2724): No heartbeat from core client for 30 sec - exiting 20:50:51 (2724): No heartbeat from core client for 30 sec - exiting 20:50:52 (2724): No heartbeat from core client for 30 sec - exiting 20:50:53 (2724): No heartbeat from core client for 30 sec - exiting 20:50:54 (2724): No heartbeat from core client for 30 sec - exiting 20:50:55 (2724): No heartbeat from core client for 30 sec - exiting 20:50:56 (2724): No heartbeat from core client for 30 sec - exiting 20:50:58 (2724): No heartbeat from core client for 30 sec - exiting 20:50:59 (2724): No heartbeat from core client for 30 sec - exiting 20:51:00 (2724): No heartbeat from core client for 30 sec - exiting 20:51:01 (2724): No heartbeat from core client for 30 sec - exiting 20:51:02 (2724): No heartbeat from core client for 30 sec - exiting 20:51:03 (2724): No heartbeat from core client for 30 sec - exiting 20:51:04 (2724): No heartbeat from core client for 30 sec - exiting 20:51:05 (2724): No heartbeat from core client for 30 sec - exiting 20:51:06 (2724): No heartbeat from core client for 30 sec - exiting 20:51:07 (2724): No heartbeat from core client for 30 sec - exiting 20:51:08 (2724): No heartbeat from core client for 30 sec - exiting 20:51:09 (2724): No heartbeat from core client for 30 sec - exiting 20:51:11 (2724): No heartbeat from core client for 30 sec - exiting 20:51:12 (2724): No heartbeat from core client for 30 sec - exiting 20:51:13 (2724): No heartbeat from core client for 30 sec - exiting 20:51:14 (2724): No heartbeat from core client for 30 sec - exiting 20:51:15 (2724): No heartbeat from core client for 30 sec - exiting 20:51:16 (2724): No heartbeat from core client for 30 sec - exiting 20:51:17 (2724): No heartbeat from core client for 30 sec - exiting 20:51:18 (2724): No heartbeat from core client for 30 sec - exiting 20:51:19 (2724): No heartbeat from core client for 30 sec - exiting 20:51:20 (2724): No heartbeat from core client for 30 sec - exiting 20:51:22 (2724): No heartbeat from core client for 30 sec - exiting 20:51:23 (2724): No heartbeat from core client for 30 sec - exiting 20:51:24 (2724): No heartbeat from core client for 30 sec - exiting 20:51:25 (2724): No heartbeat from core client for 30 sec - exiting 20:51:26 (2724): No heartbeat from core client for 30 sec - exiting 20:51:27 (2724): No heartbeat from core client for 30 sec - exiting 20:51:28 (2724): No heartbeat from core client for 30 sec - exiting 20:51:29 (2724): No heartbeat from core client for 30 sec - exiting 20:51:30 (2724): No heartbeat from core client for 30 sec - exiting 20:51:31 (2724): No heartbeat from core client for 30 sec - exiting 20:51:32 (2724): No heartbeat from core client for 30 sec - exiting 20:51:33 (2724): No heartbeat from core client for 30 sec - exiting 20:51:35 (2724): No heartbeat from core client for 30 sec - exiting 20:51:36 (2724): No heartbeat from core client for 30 sec - exiting 20:51:37 (2724): No heartbeat from core client for 30 sec - exiting 20:51:38 (2724): No heartbeat from core client for 30 sec - exiting 20:51:39 (2724): No heartbeat from core client for 30 sec - exiting 20:51:40 (2724): No heartbeat from core client for 30 sec - exiting 20:51:41 (2724): No heartbeat from core client for 30 sec - exiting 20:51:42 (2724): No heartbeat from core client for 30 sec - exiting 20:51:43 (2724): No heartbeat from core client for 30 sec - exiting 20:51:44 (2724): No heartbeat from core client for 30 sec - exiting 20:51:45 (2724): No heartbeat from core client for 30 sec - exiting 20:51:46 (2724): No heartbeat from core client for 30 sec - exiting 20:51:47 (2724): No heartbeat from core client for 30 sec - exiting 20:51:49 (2724): No heartbeat from core client for 30 sec - exiting 20:51:50 (2724): No heartbeat from core client for 30 sec - exiting 20:51:51 (2724): No heartbeat from core client for 30 sec - exiting 20:51:52 (2724): No heartbeat from core client for 30 sec - exiting 20:51:53 (2724): No heartbeat from core client for 30 sec - exiting 20:51:54 (2724): No heartbeat from core client for 30 sec - exiting 20:51:55 (2724): No heartbeat from core client for 30 sec - exiting 20:51:56 (2724): No heartbeat from core client for 30 sec - exiting 20:51:57 (2724): No heartbeat from core client for 30 sec - exiting 20:51:58 (2724): No heartbeat from core client for 30 sec - exiting 20:51:59 (2724): No heartbeat from core client for 30 sec - exiting 20:52:00 (2724): No heartbeat from core client for 30 sec - exiting 20:52:01 (2724): No heartbeat from core client for 30 sec - exiting 20:52:03 (2724): No heartbeat from core client for 30 sec - exiting 20:52:04 (2724): No heartbeat from core client for 30 sec - exiting 20:52:05 (2724): No heartbeat from core client for 30 sec - exiting 20:52:06 (2724): No heartbeat from core client for 30 sec - exiting 20:52:07 (2724): No heartbeat from core client for 30 sec - exiting 20:52:08 (2724): No heartbeat from core client for 30 sec - exiting 20:52:09 (2724): No heartbeat from core client for 30 sec - exiting 20:52:10 (2724): No heartbeat from core client for 30 sec - exiting 20:52:11 (2724): No heartbeat from core client for 30 sec - exiting 20:52:12 (2724): No heartbeat from core client for 30 sec - exiting 20:52:13 (2724): No heartbeat from core client for 30 sec - exiting 20:52:15 (2724): No heartbeat from core client for 30 sec - exiting 20:52:16 (2724): No heartbeat from core client for 30 sec - exiting 20:52:17 (2724): No heartbeat from core client for 30 sec - exiting 20:52:18 (2724): No heartbeat from core client for 30 sec - exiting 20:52:19 (2724): No heartbeat from core client for 30 sec - exiting 20:52:20 (2724): No heartbeat from core client for 30 sec - exiting 20:52:21 (2724): No heartbeat from core client for 30 sec - exiting 20:52:22 (2724): No heartbeat from core client for 30 sec - exiting 20:52:23 (2724): No heartbeat from core client for 30 sec - exiting 20:52:24 (2724): No heartbeat from core client for 30 sec - exiting 21:49:40 (2724): No heartbeat from core client for 30 sec - exiting 21:49:41 (2724): No heartbeat from core client for 30 sec - exiting 21:49:42 (2724): No heartbeat from core client for 30 sec - exiting 21:49:43 (2724): No heartbeat from core client for 30 sec - exiting 21:49:44 (2724): No heartbeat from core client for 30 sec - exiting 21:49:45 (2724): No heartbeat from core client for 30 sec - exiting 21:49:46 (2724): No heartbeat from core client for 30 sec - exiting 21:49:47 (2724): No heartbeat from core client for 30 sec - exiting 21:49:48 (2724): No heartbeat from core client for 30 sec - exiting 21:49:49 (2724): No heartbeat from core client for 30 sec - exiting 21:49:50 (2724): No heartbeat from core client for 30 sec - exiting 21:49:51 (2724): No heartbeat from core client for 30 sec - exiting 21:49:52 (2724): No heartbeat from core client for 30 sec - exiting 21:49:54 (2724): No heartbeat from core client for 30 sec - exiting 21:49:55 (2724): No heartbeat from core client for 30 sec - exiting 21:49:56 (2724): No heartbeat from core client for 30 sec - exiting 21:49:57 (2724): No heartbeat from core client for 30 sec - exiting 21:49:58 (2724): No heartbeat from core client for 30 sec - exiting 21:49:59 (2724): No heartbeat from core client for 30 sec - exiting 21:50:00 (2724): No heartbeat from core client for 30 sec - exiting 21:50:01 (2724): No heartbeat from core client for 30 sec - exiting 21:50:02 (2724): No heartbeat from core client for 30 sec - exiting 21:50:03 (2724): No heartbeat from core client for 30 sec - exiting 21:50:04 (2724): No heartbeat from core client for 30 sec - exiting 21:50:05 (2724): No heartbeat from core client for 30 sec - exiting 21:50:06 (2724): No heartbeat from core client for 30 sec - exiting 21:50:07 (2724): No heartbeat from core client for 30 sec - exiting 21:50:08 (2724): No heartbeat from core client for 30 sec - exiting 21:50:09 (2724): No heartbeat from core client for 30 sec - exiting 21:50:10 (2724): No heartbeat from core client for 30 sec - exiting 21:50:11 (2724): No heartbeat from core client for 30 sec - exiting 23:48:27 (2724): No heartbeat from core client for 30 sec - exiting 23:48:28 (2724): No heartbeat from core client for 30 sec - exiting 23:48:29 (2724): No heartbeat from core client for 30 sec - exiting 23:48:30 (2724): No heartbeat from core client for 30 sec - exiting 23:48:31 (2724): No heartbeat from core client for 30 sec - exiting 23:48:32 (2724): No heartbeat from core client for 30 sec - exiting 23:48:34 (2724): No heartbeat from core client for 30 sec - exiting 23:48:35 (2724): No heartbeat from core client for 30 sec - exiting 23:48:36 (2724): No heartbeat from core client for 30 sec - exiting 23:48:37 (2724): No heartbeat from core client for 30 sec - exiting 23:48:38 (2724): No heartbeat from core client for 30 sec - exiting 23:48:39 (2724): No heartbeat from core client for 30 sec - exiting 23:48:40 (2724): No heartbeat from core client for 30 sec - exiting 23:48:41 (2724): No heartbeat from core client for 30 sec - exiting 23:48:42 (2724): No heartbeat from core client for 30 sec - exiting 23:48:43 (2724): No heartbeat from core client for 30 sec - exiting 23:48:44 (2724): No heartbeat from core client for 30 sec - exiting 23:48:45 (2724): No heartbeat from core client for 30 sec - exiting 23:48:47 (2724): No heartbeat from core client for 30 sec - exiting 23:48:48 (2724): No heartbeat from core client for 30 sec - exiting 23:48:49 (2724): No heartbeat from core client for 30 sec - exiting 23:48:50 (2724): No heartbeat from core client for 30 sec - exiting 23:48:51 (2724): No heartbeat from core client for 30 sec - exiting 23:48:52 (2724): No heartbeat from core client for 30 sec - exiting 23:48:53 (2724): No heartbeat from core client for 30 sec - exiting 23:48:54 (2724): No heartbeat from core client for 30 sec - exiting 23:48:55 (2724): No heartbeat from core client for 30 sec - exiting 23:48:56 (2724): No heartbeat from core client for 30 sec - exiting 23:48:57 (2724): No heartbeat from core client for 30 sec - exiting 23:48:59 (2724): No heartbeat from core client for 30 sec - exiting 23:49:00 (2724): No heartbeat from core client for 30 sec - exiting 23:49:01 (2724): No heartbeat from core client for 30 sec - exiting 23:49:02 (2724): No heartbeat from core client for 30 sec - exiting 23:49:03 (2724): No heartbeat from core client for 30 sec - exiting 23:49:04 (2724): No heartbeat from core client for 30 sec - exiting 23:49:05 (2724): No heartbeat from core client for 30 sec - exiting 23:49:06 (2724): No heartbeat from core client for 30 sec - exiting 23:49:07 (2724): No heartbeat from core client for 30 sec - exiting 23:49:08 (2724): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C930AA3 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C930AA3 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... 22:36:33 (1184): No heartbeat from core client for 30 sec - exiting 22:36:34 (1184): No heartbeat from core client for 30 sec - exiting 22:36:36 (1184): No heartbeat from core client for 30 sec - exiting 22:36:37 (1184): No heartbeat from core client for 30 sec - exiting 22:36:38 (1184): No heartbeat from core client for 30 sec - exiting 22:36:39 (1184): No heartbeat from core client for 30 sec - exiting 22:36:40 (1184): No heartbeat from core client for 30 sec - exiting 22:36:41 (1184): No heartbeat from core client for 30 sec - exiting 22:36:42 (1184): No heartbeat from core client for 30 sec - exiting 22:36:43 (1184): No heartbeat from core client for 30 sec - exiting 22:36:44 (1184): No heartbeat from core client for 30 sec - exiting 22:36:45 (1184): No heartbeat from core client for 30 sec - exiting 22:36:46 (1184): No heartbeat from core client for 30 sec - exiting 22:36:47 (1184): No heartbeat from core client for 30 sec - exiting 22:36:48 (1184): No heartbeat from core client for 30 sec - exiting 22:36:50 (1184): No heartbeat from core client for 30 sec - exiting 22:36:51 (1184): No heartbeat from core client for 30 sec - exiting 22:36:52 (1184): No heartbeat from core client for 30 sec - exiting 22:36:53 (1184): No heartbeat from core client for 30 sec - exiting 22:36:54 (1184): No heartbeat from core client for 30 sec - exiting 22:36:55 (1184): No heartbeat from core client for 30 sec - exiting 22:36:56 (1184): No heartbeat from core client for 30 sec - exiting 22:36:57 (1184): No heartbeat from core client for 30 sec - exiting 22:36:58 (1184): No heartbeat from core client for 30 sec - exiting 22:36:59 (1184): No heartbeat from core client for 30 sec - exiting 22:37:00 (1184): No heartbeat from core client for 30 sec - exiting 22:37:01 (1184): No heartbeat from core client for 30 sec - exiting 22:37:02 (1184): No heartbeat from core client for 30 sec - exiting 22:37:03 (1184): No heartbeat from core client for 30 sec - exiting 22:37:04 (1184): No heartbeat from core client for 30 sec - exiting 22:37:05 (1184): No heartbeat from core client for 30 sec - exiting 22:37:06 (1184): No heartbeat from core client for 30 sec - exiting 22:37:07 (1184): No heartbeat from core client for 30 sec - exiting 22:37:08 (1184): No heartbeat from core client for 30 sec - exiting 22:37:09 (1184): No heartbeat from core client for 30 sec - exiting 22:37:11 (1184): No heartbeat from core client for 30 sec - exiting 22:37:12 (1184): No heartbeat from core client for 30 sec - exiting 22:37:13 (1184): No heartbeat from core client for 30 sec - exiting 22:37:14 (1184): No heartbeat from core client for 30 sec - exiting 22:37:15 (1184): No heartbeat from core client for 30 sec - exiting 22:37:16 (1184): No heartbeat from core client for 30 sec - exiting 22:37:17 (1184): No heartbeat from core client for 30 sec - exiting 22:37:18 (1184): No heartbeat from core client for 30 sec - exiting 22:37:19 (1184): No heartbeat from core client for 30 sec - exiting 22:37:20 (1184): No heartbeat from core client for 30 sec - exiting 22:37:21 (1184): No heartbeat from core client for 30 sec - exiting 22:37:22 (1184): No heartbeat from core client for 30 sec - exiting 22:37:23 (1184): No heartbeat from core client for 30 sec - exiting 22:37:24 (1184): No heartbeat from core client for 30 sec - exiting 22:37:25 (1184): No heartbeat from core client for 30 sec - exiting 22:37:26 (1184): No heartbeat from core client for 30 sec - exiting 22:37:27 (1184): No heartbeat from core client for 30 sec - exiting 22:37:28 (1184): No heartbeat from core client for 30 sec - exiting 22:37:30 (1184): No heartbeat from core client for 30 sec - exiting 22:37:31 (1184): No heartbeat from core client for 30 sec - exiting 22:37:32 (1184): No heartbeat from core client for 30 sec - exiting 22:37:33 (1184): No heartbeat from core client for 30 sec - exiting 22:37:34 (1184): No heartbeat from core client for 30 sec - exiting 22:37:35 (1184): No heartbeat from core client for 30 sec - exiting 22:37:36 (1184): No heartbeat from core client for 30 sec - exiting 22:37:37 (1184): No heartbeat from core client for 30 sec - exiting 22:37:38 (1184): No heartbeat from core client for 30 sec - exiting 22:37:39 (1184): No heartbeat from core client for 30 sec - exiting 22:37:40 (1184): No heartbeat from core client for 30 sec - exiting 22:37:41 (1184): No heartbeat from core client for 30 sec - exiting 22:37:42 (1184): No heartbeat from core client for 30 sec - exiting 22:37:43 (1184): No heartbeat from core client for 30 sec - exiting 22:37:44 (1184): No heartbeat from core client for 30 sec - exiting 22:37:45 (1184): No heartbeat from core client for 30 sec - exiting 22:37:46 (1184): No heartbeat from core client for 30 sec - exiting 22:37:47 (1184): No heartbeat from core client for 30 sec - exiting 22:37:48 (1184): No heartbeat from core client for 30 sec - exiting 22:37:50 (1184): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C930AA3 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... 09:44:29 (3768): No heartbeat from core client for 30 sec - exiting 09:44:30 (3768): No heartbeat from core client for 30 sec - exiting 09:44:31 (3768): No heartbeat from core client for 30 sec - exiting 09:44:33 (3768): No heartbeat from core client for 30 sec - exiting 09:44:34 (3768): No heartbeat from core client for 30 sec - exiting 09:44:35 (3768): No heartbeat from core client for 30 sec - exiting 09:44:36 (3768): No heartbeat from core client for 30 sec - exiting 09:44:37 (3768): No heartbeat from core client for 30 sec - exiting 09:44:38 (3768): No heartbeat from core client for 30 sec - exiting 09:44:39 (3768): No heartbeat from core client for 30 sec - exiting 09:44:40 (3768): No heartbeat from core client for 30 sec - exiting 09:44:41 (3768): No heartbeat from core client for 30 sec - exiting 09:44:42 (3768): No heartbeat from core client for 30 sec - exiting 09:44:44 (3768): No heartbeat from core client for 30 sec - exiting 09:44:45 (3768): No heartbeat from core client for 30 sec - exiting 09:44:46 (3768): No heartbeat from core client for 30 sec - exiting 09:44:47 (3768): No heartbeat from core client for 30 sec - exiting 09:44:48 (3768): No heartbeat from core client for 30 sec - exiting 09:44:49 (3768): No heartbeat from core client for 30 sec - exiting 09:44:50 (3768): No heartbeat from core client for 30 sec - exiting 09:44:51 (3768): No heartbeat from core client for 30 sec - exiting 09:44:52 (3768): No heartbeat from core client for 30 sec - exiting 09:44:53 (3768): No heartbeat from core client for 30 sec - exiting 09:44:54 (3768): No heartbeat from core client for 30 sec - exiting 09:44:56 (3768): No heartbeat from core client for 30 sec - exiting 09:44:57 (3768): No heartbeat from core client for 30 sec - exiting 09:44:58 (3768): No heartbeat from core client for 30 sec - exiting 09:44:59 (3768): No heartbeat from core client for 30 sec - exiting 09:45:00 (3768): No heartbeat from core client for 30 sec - exiting 09:45:01 (3768): No heartbeat from core client for 30 sec - exiting 09:45:02 (3768): No heartbeat from core client for 30 sec - exiting 17:42:00 (3768): No heartbeat from core client for 30 sec - exiting 17:42:01 (3768): No heartbeat from core client for 30 sec - exiting 17:42:02 (3768): No heartbeat from core client for 30 sec - exiting 17:42:03 (3768): No heartbeat from core client for 30 sec - exiting 17:42:04 (3768): No heartbeat from core client for 30 sec - exiting 17:42:05 (3768): No heartbeat from core client for 30 sec - exiting 17:42:06 (3768): No heartbeat from core client for 30 sec - exiting 17:42:07 (3768): No heartbeat from core client for 30 sec - exiting 17:42:09 (3768): No heartbeat from core client for 30 sec - exiting 17:42:10 (3768): No heartbeat from core client for 30 sec - exiting 17:42:11 (3768): No heartbeat from core client for 30 sec - exiting 17:42:12 (3768): No heartbeat from core client for 30 sec - exiting 17:42:13 (3768): No heartbeat from core client for 30 sec - exiting 17:42:14 (3768): No heartbeat from core client for 30 sec - exiting 17:42:15 (3768): No heartbeat from core client for 30 sec - exiting 17:42:16 (3768): No heartbeat from core client for 30 sec - exiting 17:42:17 (3768): No heartbeat from core client for 30 sec - exiting 17:42:18 (3768): No heartbeat from core client for 30 sec - exiting 17:42:20 (3768): No heartbeat from core client for 30 sec - exiting 17:42:21 (3768): No heartbeat from core client for 30 sec - exiting 17:42:22 (3768): No heartbeat from core client for 30 sec - exiting 17:42:23 (3768): No heartbeat from core client for 30 sec - exiting 17:42:24 (3768): No heartbeat from core client for 30 sec - exiting 17:42:25 (3768): No heartbeat from core client for 30 sec - exiting 17:42:26 (3768): No heartbeat from core client for 30 sec - exiting 17:42:27 (3768): No heartbeat from core client for 30 sec - exiting 17:42:28 (3768): No heartbeat from core client for 30 sec - exiting 17:42:29 (3768): No heartbeat from core client for 30 sec - exiting 17:42:30 (3768): No heartbeat from core client for 30 sec - exiting 17:42:31 (3768): No heartbeat from core client for 30 sec - exiting 17:42:32 (3768): No heartbeat from core client for 30 sec - exiting 17:42:33 (3768): No heartbeat from core client for 30 sec - exiting 17:42:34 (3768): No heartbeat from core client for 30 sec - exiting Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Feb 2016 00:32:30	1376367	19130812	hadcm3n_ldpv_198012_480_010219810_0	1,036,800	1,369,869	1.3212
14 Feb 2016 02:33:14	1376367	19130812	hadcm3n_ldpv_198012_480_010219810_0	1,010,880	1,336,219	1.3218
13 Feb 2016 01:00:26	1376367	19130812	hadcm3n_ldpv_198012_480_010219810_0	984,960	1,304,636	1.3246
12 Feb 2016 05:21:29	1376367	19130812	hadcm3n_ldpv_198012_480_010219810_0	959,040	1,271,918	1.3262
11 Feb 2016 07:24:24	1376367	19130812	hadcm3n_ldpv_198012_480_010219810_0	933,120	1,238,329	1.3271
10 Feb 2016 10:46:38	1376367	19130812	hadcm3n_ldpv_198012_480_010219810_0	907,200	1,205,221	1.3285
09 Feb 2016 12:19:12	1376367	19130812	hadcm3n_ldpv_198012_480_010219810_0	881,280	1,171,826	1.3297
06 Feb 2016 13:33:51	1376367	19130812	hadcm3n_ldpv_198012_480_010219810_0	855,360	1,138,507	1.3310
03 Feb 2016 06:17:15	1376367	19130812	hadcm3n_ldpv_198012_480_010219810_0	829,440	1,105,055	1.3323
02 Feb 2016 06:18:10	1376367	19130812	hadcm3n_ldpv_198012_480_010219810_0	803,520	1,071,399	1.3334
23 Jan 2016 12:12:18	1376367	19130812	hadcm3n_ldpv_198012_480_010219810_0	777,600	1,057,079	1.3594
22 Jan 2016 07:17:08	1376367	19130812	hadcm3n_ldpv_198012_480_010219810_0	751,680	1,019,608	1.3564
21 Jan 2016 10:21:31	1376367	19130812	hadcm3n_ldpv_198012_480_010219810_0	725,760	982,922	1.3543
19 Jan 2016 14:45:10	1376367	19130812	hadcm3n_ldpv_198012_480_010219810_0	699,840	946,904	1.3530
19 Jan 2016 00:46:10	1376367	19130812	hadcm3n_ldpv_198012_480_010219810_0	673,920	906,645	1.3453
18 Jan 2016 02:13:29	1376367	19130812	hadcm3n_ldpv_198012_480_010219810_0	648,000	869,918	1.3425
17 Jan 2016 04:01:05	1376367	19130812	hadcm3n_ldpv_198012_480_010219810_0	622,080	832,160	1.3377
15 Jan 2016 12:56:22	1376367	19130812	hadcm3n_ldpv_198012_480_010219810_0	596,160	795,683	1.3347
12 Jan 2016 13:25:53	1376367	19130812	hadcm3n_ldpv_198012_480_010219810_0	570,240	760,519	1.3337
11 Jan 2016 13:03:40	1376367	19130812	hadcm3n_ldpv_198012_480_010219810_0	544,320	726,046	1.3339