Task 14448918

Name	hadam3p_pnw_bib1_1964_1_007910028_0
Workunit	8065140
Created	17 Apr 2012, 19:25:48 UTC
Sent	8 May 2012, 12:42:10 UTC
Report deadline	20 Apr 2013, 18:02:10 UTC
Received	13 Aug 2012, 8:33:36 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1306963
Run time	32 days 15 hours 4 min 15 sec
CPU time	26 days 13 hours 28 min 46 sec
Validate state	Workunit error - check skipped
Credit	3,005.88
Device peak FLOPS	0.68 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.0.33</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... 21:41:50 (6080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:14:48 (2092): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:10:30 (3052): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4756, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:17:03 (2488): No heartbeat from core client for 30 sec - exiting 16:17:04 (2488): No heartbeat from core client for 30 sec - exiting 16:17:05 (2488): No heartbeat from core client for 30 sec - exiting 16:17:06 (2488): No heartbeat from core client for 30 sec - exiting 16:17:07 (2488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:44:52 (4972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:44:53 (4972): No heartbeat from core client for 30 sec - exiting 00:44:54 (4972): No heartbeat from core client for 30 sec - exiting 00:44:55 (4972): No heartbeat from core client for 30 sec - exiting 00:44:56 (4972): No heartbeat from core client for 30 sec - exiting 00:44:57 (4972): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 03:18:59 (6568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:19:00 (6568): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:07:41 (6808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6584, selfPID=4928, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not runng, exiting, bRetVal = 1, checkPID=0, selfPID=7068, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 19:51:10 (6628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7560, selfPID=7560, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7776, selfPID=5476, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 CPDN Monitor - Quit request from BOINC... 02:12:00 (7404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:13:05 (6736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:05:48 (6456): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 11:21:02 (3204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:46:40 (8108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:55:26 (7248): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:58:58 (5512): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 19:58:59 (5512): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:40:59 (7700): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 02:41:00 (7700): No heartbeat from core client for 30 sec - exiting 02:41:01 (7700): No heartbeat from core client for 30 sec - exiting 02:41:02 (7700): No heartbeat from core client for 30 sec - exiting 02:41:03 (7700): No heartbeat from core client for 30 sec - exiting 02:41:05 (7700): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:54:51 (4496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:54:52 (4496): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:18:38 (9620): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 22:18:40 (9620): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6580, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6572, selfPID=3124, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=380, selfPID=3536, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 09:43:08 (4124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1668, selfPID=2316, iMonCtr=1 Model crash detected, will try to restart... 10:29:00 (5192): No heartbeat from core client for 30 sec - exiting 10:29:01 (5192): No heartbeat from core client for 30 sec - exiting 10:29:02 (5192): No heartbeat from core client for 30 sec - exiting 10:29:03 (5192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:33:37 (2396): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:55:41 (7488): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 13:33:18 (7840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:33:19 (7840): No heartbeat from core client for 30 sec - exiting 13:33:20 (7840): No heartbeat from core client for 30 sec - exiting 13:33:21 (7840): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 16:39:34 (7532): No heartbeat from core client for 30 sec - exiting 16:39:36 (7532): No heartbeat from core client for 30 sec - exiting 16:40:10 (7532): No heartbeat from core client for 30 sec - exiting 16:40:11 (7532): No heartbeat from core client for 30 sec - exiting 16:40:12 (7532): No heartbeat from core client for 30 sec - exiting 16:40:13 (7532): No heartbeat from core client for 30 sec - exiting 16:40:15 (7532): No heartbeat from core client for 30 sec - exiting 16:40:16 (7532): No heartbeat from core client for 30 sec - exiting 16:40:17 (7532): No heartbeat from core client for 30 sec - exiting 16:40:18 (7532): No heartbeat from core client for 30 sec - exiting 16:40:19 (7532): No heartbeat from core client for 30 sec - exiting 16:40:20 (7532): No heartbeat from core client for 30 sec - exiting 16:40:21 (7532): No heartbeat from core client for 30 sec - exiting 16:40:22 (7532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:53:58 (4244): No heartbeat from core client for 30 sec - exiting 16:53:59 (4244): No heartbeat from core client for 30 sec - exiting 16:54:00 (4244): No heartbeat from core client for 30 sec - exiting 16:54:01 (4244): No heartbeat from core client for 30 sec - exiting 16:54:02 (4244): No heartbeat from core client for 30 sec - exiting 16:54:03 (4244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:33:19 (6216): No heartbeat from core client for 30 sec - exiting 17:33:20 (6216): No heartbeat from core client for 30 sec - exiting 17:33:54 (6216): No heartbeat from core client for 30 sec - exiting 17:33:55 (6216): No heartbeat from core client for 30 sec - exiting 17:33:56 (6216): No heartbeat from core client for 30 sec - exiting 17:33:58 (6216): No heartbeat from core client for 30 sec - exiting 17:33:59 (6216): No heartbeat from core client for 30 sec - exiting 17:34:00 (6216): No heartbeat from core client for 30 sec - exiting 17:34:01 (6216): No heartbeat from core client for 30 sec - exiting 17:34:02 (6216): No heartbeat from core client for 30 sec - exiting 17:34:03 (6216): No heartbeat from core client for 30 sec - exiting 17:34:04 (6216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8172, selfPID=7608, iMonCtr=1 Model crash detected, will try to restart... 22:48:47 (6928): No heartbeat from core client for 30 sec - exiting 22:48:49 (6928): No heartbeat from core client for 30 sec - exiting 22:48:50 (6928): No heartbeat from core client for 30 sec - exiting 22:48:51 (6928): No heartbeat from core client for 30 sec - exiting 22:48:52 (6928): No heartbeat from core client for 30 sec - exiting 22:48:53 (6928): No heartbeat from core client for 30 sec - exiting 22:48:54 (6928): No heartbeat from core client for 30 sec - exiting 22:48:55 (6928): No heartbeat from core client for 30 sec - exiting 22:48:56 (6928): No heartbeat from core client for 30 sec - exiting 22:48:58 (6928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:32:14 (6316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:04:56 (912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:26:04 (7184): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 22:26:05 (7184): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:28:56 (7744): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:23:12 (7732): No heartbeat from core client for 30 sec - exiting 12:23:13 (7732): No heartbeat from core client for 30 sec - exiting 12:23:14 (7732): No heartbeat from core client for 30 sec - exiting 12:23:15 (7732): No heartbeat from core client for 30 sec - exiting 12:23:16 (7732): No heartbeat from core client for 30 sec - exiting 12:23:17 (7732): No heartbeat from core client for 30 sec - exiting 12:23:18 (7732): No heartbeat from core client for 30 sec - exiting 12:23:19 (7732): No heartbeat from core client for 30 sec - exiting 12:23:20 (7732): No heartbeat from core client for 30 sec - exiting 12:23:24 (7732): No heartbeat from core client for 30 sec - exiting 12:23:25 (7732): No heartbeat from core client for 30 sec - exiting 12:23:26 (7732): No heartbeat from core client for 30 sec - exiting 12:23:27 (7732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:38:08 (7580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6992, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 4 19:14:43 (7832): No heartbeat from core client for 30 sec - exiting 19:14:44 (7832): No heartbeat from core client for 30 sec - exiting 19:14:45 (7832): No heartbeat from core client for 30 sec - exiting 19:14:47 (7832): No heartbeat from core client for 30 sec - exiting 19:14:48 (7832): No heartbeat from core client for 30 sec - exiting 19:14:49 (7832): No heartbeat from core client for 30 sec - exiting 19:14:50 (7832): No heartbeat from core client for 30 sec - exiting 19:14:51 (7832): No heartbeat from core client for 30 sec - exiting 19:14:52 (7832): No heartbeat from core client for 30 sec - exiting 19:14:53 (7832): No heartbeat from core client for 30 sec - exiting 19:14:54 (7832): No heartbeat from core client for 30 sec - exiting 19:14:55 (7832): No heartbeat from core client for 30 sec - exiting 19:14:56 (7832): No heartbeat from core client for 30 sec - exiting 19:14:57 (7832): No heartbeat from core client for 30 sec - exiting 19:14:58 (7832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:00:08 (3800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:55:31 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:51:48 (4776): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 02:51:49 (4776): No heartbeat from core client for 30 sec - exiting 14:07:00 (3620): No heartbeat from core client for 30 sec - exiting 14:07:02 (3620): No heartbeat from core client for 30 sec - exiting 14:07:03 (3620): No heartbeat from core client for 30 sec - exiting 14:07:04 (3620): No heartbeat from core client for 30 sec - exiting 14:07:05 (3620): No heartbeat from core client for 30 sec - exiting 14:07:06 (3620): No heartbeat from core client for 30 sec - exiting 14:07:07 (3620): No heartbeat from core client for 30 sec - exiting 14:07:08 (3620): No heartbeat from core client for 30 sec - exiting 14:07:09 (3620): No heartbeat from core client for 30 sec - exiting 14:07:10 (3620): No heartbeat from core client for 30 sec - exiting 14:07:11 (3620): No heartbeat from core client for 30 sec - exiting 14:07:12 (3620): No heartbeat from core client for 30 sec - exiting 14:07:13 (3620): No heartbeat from core client for 30 sec - exiting 14:07:14 (3620): No heartbeat from core client for 30 sec - exiting 14:07:16 (3620): No heartbeat from core client for 30 sec - exiting 14:07:17 (3620): No heartbeat from core client for 30 sec - exiting 14:07:18 (3620): No heartbeat from core client for 30 sec - exiting 14:07:19 (3620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:24:43 (6116): No heartbeat from core client for 30 sec - exiting 14:24:45 (6116): No heartbeat from core client for 30 sec - exiting 14:24:46 (6116): No heartbeat from core client for 30 sec - exiting 14:24:47 (6116): No heartbeat from core client for 30 sec - exiting 14:24:48 (6116): No heartbeat from core client for 30 sec - exiting 14:24:49 (6116): No heartbeat from core client for 30 sec - exiting 14:24:50 (6116): No heartbeat from core client for 30 sec - exiting 14:24:51 (6116): No heartbeat from core client for 30 sec - exiting 14:24:52 (6116): No heartbeat from core client for 30 sec - exiting 14:24:53 (6116): No heartbeat from core client for 30 sec - exiting 14:24:54 (6116): No heartbeat from core client for 30 sec - exiting 14:24:55 (6116): No heartbeat from core client for 30 sec - exiting 14:24:56 (6116): No heartbeat from core client for 30 sec - exiting 14:24:57 (6116): No heartbeat from core client for 30 sec - exiting 14:24:58 (6116): No heartbeat from core client for 30 sec - exiting 14:24:59 (6116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:52:08 (7132): No heartbeat from core client for 30 sec - exiting 16:52:09 (7132): No heartbeat from core client for 30 sec - exiting 16:52:10 (7132): No heartbeat from core client for 30 sec - exiting 16:52:11 (7132): No heartbeat from core client for 30 sec - exiting 16:52:13 (7132): No heartbeat from core client for 30 sec - exiting 16:52:14 (7132): No heartbeat from core client for 30 sec - exiting 16:52:15 (7132): No heartbeat from core client for 30 sec - exiting 16:52:16 (7132): No heartbeat from core client for 30 sec - exiting 16:52:24 (7132): No heartbeat from core client for 30 sec - exiting 16:52:25 (7132): No heartbeat from core client for 30 sec - exiting 16:52:26 (7132): No heartbeat from core client for 30 sec - exiting 16:52:27 (7132): No heartbeat from core client for 30 sec - exiting 16:52:29 (7132): No heartbeat from core client for 30 sec - exiting 16:52:31 (7132): No heartbeat from core client for 30 sec - exiting 16:52:32 (7132): No heartbeat from core client for 30 sec - exiting 16:52:33 (7132): No heartbeat from core client for 30 sec - exiting 16:52:34 (7132): No heartbeat from core client for 30 sec - exiting 16:52:35 (7132): No heartbeat from core client for 30 sec - exiting 16:52:36 (7132): No heartbeat from core client for 30 sec - exiting 16:52:37 (7132): No heartbeat from core client for 30 sec - exiting 16:52:38 (7132): No heartbeat from core client for 30 sec - exiting 16:52:39 (7132): No heartbeat from core client for 30 sec - exiting 16:52:40 (7132): No heartbeat from core client for 30 sec - exiting 16:52:41 (7132): No heartbeat from core client for 30 sec - exiting 16:52:42 (7132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:27:52 (1060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:33:33 (2760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:33:34 (2760): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:37:38 (6364): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:52:59 (4704): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 22:53:01 (4704): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 07:05:13 (4216): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 07:05:14 (4216): No heartbeat from core client for 30 sec - exiting 12:29:32 (6280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:39:05 (7304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:39:06 (7304): No heartbeat from core client for 30 sec - exiting 12:54:40 (4436): No heartbeat from core client for 30 sec - exiting 12:54:41 (4436): No heartbeat from core client for 30 sec - exiting 12:54:43 (4436): No heartbeat from core client for 30 sec - exiting 12:55:21 (4436): No heartbeat from core client for 30 sec - exiting 12:55:22 (4436): No heartbeat from core client for 30 sec - exiting 12:55:23 (4436): No heartbeat from core client for 30 sec - exiting 12:55:24 (4436): No heartbeat from core client for 30 sec - exiting 12:55:25 (4436): No heartbeat from core client for 30 sec - exiting 12:55:26 (4436): No heartbeat from core client for 30 sec - exiting 12:55:27 (4436): No heartbeat from core client for 30 sec - exiting 12:55:28 (4436): No heartbeat from core client for 30 sec - exiting 12:55:29 (4436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:55:30 (4436): No heartbeat from core client for 30 sec - exiting 12:55:31 (4436): No heartbeat from core client for 30 sec - exiting 12:55:32 (4436): No heartbeat from core client for 30 sec - exiting 12:55:33 (4436): No heartbeat from core client for 30 sec - exiting 12:55:34 (4436): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:33:15 (5444): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 08:33:17 (5444): No heartbeat from core client for 30 sec - exiting 13:05:39 (5920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:10:04 (7192): No heartbeat from core client for 30 sec - exiting 11:10:05 (7192): No heartbeat from core client for 30 sec - exiting 11:10:06 (7192): No heartbeat from core client for 30 sec - exiting 11:10:07 (7192): No heartbeat from core client for 30 sec - exiting 11:10:08 (7192): No heartbeat from core client for 30 sec - exiting 11:10:09 (7192): No heartbeat from core client for 30 sec - exiting 11:10:10 (7192): No heartbeat from core client for 30 sec - exiting 11:10:12 (7192): No heartbeat from core client for 30 sec - exiting 11:10:13 (7192): No heartbeat from core client for 30 sec - exiting 11:10:14 (7192): No heartbeat from core client for 30 sec - exiting 11:10:15 (7192): No heartbeat from core client for 30 sec - exiting 11:10:16 (7192): No heartbeat from core client for 30 sec - exiting 11:10:17 (7192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:45:42 (3476): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 07:59:44 (2220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:36:18 (7812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5028, selfPID=5028, iMonCtr=2 13:43:30 (7932): No heartbeat from core client for 30 sec - exiting 13:43:31 (7932): No heartbeat from core client for 30 sec - exiting 13:43:33 (7932): No heartbeat from core client for 30 sec - exiting 13:43:34 (7932): No heartbeat from core client for 30 sec - exiting 13:43:35 (7932): No heartbeat from core client for 30 sec - exiting 13:43:36 (7932): No heartbeat from core client for 30 sec - exiting 13:43:37 (7932): No heartbeat from core client for 30 sec - exiting 13:43:38 (7932): No heartbeat from core client for 30 sec - exiting 13:43:39 (7932): No heartbeat from core client for 30 sec - exiting 13:43:40 (7932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:43:38 (7324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:59:38 (6016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:38:37 (3864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:45:35 (5428): No heartbeat from core client for 30 sec - exiting 21:45:36 (5428): No heartbeat from core client for 30 sec - exiting 21:45:37 (5428): No heartbeat from core client for 30 sec - exiting 21:45:38 (5428): No heartbeat from core client for 30 sec - exiting 21:45:40 (5428): No heartbeat from core client for 30 sec - exiting 21:45:41 (5428): No heartbeat from core client for 30 sec - exiting 21:45:42 (5428): No heartbeat from core client for 30 sec - exiting 21:45:43 (5428): No heartbeat from core client for 30 sec - exiting 21:45:44 (5428): No heartbeat from core client for 30 sec - exiting 21:45:45 (5428): No heartbeat from core client for 30 sec - exiting 21:45:46 (5428): No heartbeat from core client for 30 sec - exiting 21:45:47 (5428): No heartbeat from core client for 30 sec - exiting 21:45:48 (5428): No heartbeat from core client for 30 sec - exiting 21:45:50 (5428): No heartbeat from core client for 30 sec - exiting 21:45:51 (5428): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 22:16:18 (1728): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:04:28 (564): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 20:04:30 (564): No heartbeat from core client for 30 sec - exiting 20:04:31 (564): No heartbeat from core client for 30 sec - exiting 20:04:33 (564): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 20:58:44 (2880): No heartbeat from core client for 30 sec - exiting 20:58:45 (2880): No heartbeat from core client for 30 sec - exiting 20:58:47 (2880): No heartbeat from core client for 30 sec - exiting 20:58:48 (2880): No heartbeat from core client for 30 sec - exiting 20:58:49 (2880): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 20:58:50 (2880): No heartbeat from core client for 30 sec - exiting 20:58:51 (2880): No heartbeat from core client for 30 sec - exiting 21:58:52 (3928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1500, selfPID=1500, iMonCtr=2 10:02:05 (7244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:02:06 (7244): No heartbeat from core client for 30 sec - exiting 10:02:07 (7244): No heartbeat from core client for 30 sec - exiting 10:02:08 (7244): No heartbeat from core client for 30 sec - exiting 10:02:09 (7244): No heartbeat from core client for 30 sec - exiting 10:02:10 (7244): No heartbeat from core client for 30 sec - exiting 10:02:11 (7244): No heartbeat from core client for 30 sec - exiting 10:02:12 (7244): No heartbeat from core client for 30 sec - exiting 22:06:07 (7076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:06:09 (7076): No heartbeat from core client for 30 sec - exiting 04:08:27 (7188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:08:28 (7188): No heartbeat from core client for 30 sec - exiting 22:45:53 (4900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:45:55 (4900): No heartbeat from core client for 30 sec - exiting 04:50:19 (9136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:50:20 (9136): No heartbeat from core client for 30 sec - exiting 04:50:21 (9136): No heartbeat from core client for 30 sec - exiting 04:50:23 (9136): No heartbeat from core client for 30 sec - exiting 23:42:47 (2064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:44:55 (7848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:50:12 (5524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:52:21 (8440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:23:34 (8944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:23:36 (8944): No heartbeat from core client for 30 sec - exiting 21:23:37 (8944): No heartbeat from core client for 30 sec - exiting 21:23:38 (8944): No heartbeat from core client for 30 sec - exiting 21:23:39 (8944): No heartbeat from core client for 30 sec - exiting 21:23:40 (8944): No heartbeat from core client for 30 sec - exiting 21:23:42 (8944): No heartbeat from core client for 30 sec - exiting 06:27:01 (9860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:37:35 (10048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:15:57 (8208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:16:24 (9100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:20:42 (7788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:53:39 (8128): No heartbeat from core client for 30 sec - exiting 19:53:40 (8128): No heartbeat from core client for 30 sec - exiting 19:53:41 (8128): No heartbeat from core client for 30 sec - exiting 19:53:42 (8128): No heartbeat from core client for 30 sec - exiting 19:53:43 (8128): No heartbeat from core client for 30 sec - exiting 19:53:44 (8128): No heartbeat from core client for 30 sec - exiting 19:53:45 (8128): No heartbeat from core client for 30 sec - exiting 19:53:46 (8128): No heartbeat from core client for 30 sec - exiting 19:53:48 (8128): No heartbeat from core client for 30 sec - exiting 19:53:49 (8128): No heartbeat from core client for 30 sec - exiting 19:53:50 (8128): No heartbeat from core client for 30 sec - exiting 19:53:51 (8128): No heartbeat from core client for 30 sec - exiting 19:53:52 (8128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:53:53 (8128): No heartbeat from core client for 30 sec - exiting 05:45:52 (6772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:23:04 (7176): No heartbeat from core client for 30 sec - exiting 15:23:05 (7176): No heartbeat from core client for 30 sec - exiting 15:23:06 (7176): No heartbeat from core client for 30 sec - exiting 15:23:07 (7176): No heartbeat from core client for 30 sec - exiting 15:23:09 (7176): No heartbeat from core client for 30 sec - exiting 15:23:10 (7176): No heartbeat from core client for 30 sec - exiting 15:23:11 (7176): No heartbeat from core client for 30 sec - exiting 15:23:12 (7176): No heartbeat from core client for 30 sec - exiting 15:23:13 (7176): No heartbeat from core client for 30 sec - exiting 15:23:14 (7176): No heartbeat from core client for 30 sec - exiting 15:23:15 (7176): No heartbeat from core client for 30 sec - exiting 15:23:16 (7176): No heartbeat from core client for 30 sec - exiting 15:23:18 (7176): No heartbeat from core client for 30 sec - exiting 15:23:19 (7176): No heartbeat from core client for 30 sec - exiting 15:23:20 (7176): No heartbeat from core client for 30 sec - exiting 15:23:21 (7176): No heartbeat from core client for 30 sec - exiting 15:23:22 (7176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:12:27 (7376): No heartbeat from core client for 30 sec - exiting 16:12:29 (7376): No heartbeat from core client for 30 sec - exiting 16:12:30 (7376): No heartbeat from core client for 30 sec - exiting 16:12:31 (7376): No heartbeat from core client for 30 sec - exiting 16:12:35 (7376): No heartbeat from core client for 30 sec - exiting 16:12:36 (7376): No heartbeat from core client for 30 sec - exiting 16:12:37 (7376): No heartbeat from core client for 30 sec - exiting 16:12:38 (7376): No heartbeat from core client for 30 sec - exiting 16:12:39 (7376): No heartbeat from core client for 30 sec - exiting 16:12:40 (7376): No heartbeat from core client for 30 sec - exiting 16:12:41 (7376): No heartbeat from core client for 30 sec - exiting 16:12:42 (7376): No heartbeat from core client for 30 sec - exiting 16:12:44 (7376): No heartbeat from core client for 30 sec - exiting 16:12:45 (7376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:10:42 (6624): No heartbeat from core client for 30 sec - exiting 19:10:44 (6624): No heartbeat from core client for 30 sec - exiting 19:10:46 (6624): No heartbeat from core client for 30 sec - exiting 19:10:47 (6624): No heartbeat from core client for 30 sec - exiting 19:10:48 (6624): No heartbeat from core client for 30 sec - exiting 19:10:49 (6624): No heartbeat from core client for 30 sec - exiting 19:10:50 (6624): No heartbeat from core client for 30 sec - exiting 19:10:51 (6624): No heartbeat from core client for 30 sec - exiting 19:10:52 (6624): No heartbeat from core client for 30 sec - exiting 19:10:54 (6624): No heartbeat from core client for 30 sec - exiting 19:10:55 (6624): No heartbeat from core client for 30 sec - exiting 19:10:56 (6624): No heartbeat from core client for 30 sec - exiting 19:10:57 (6624): No heartbeat from core client for 30 sec - exiting 19:10:58 (6624): No heartbeat from core client for 30 sec - exiting 19:10:59 (6624): No heartbeat from core client for 30 sec - exiting 19:11:00 (6624): No heartbeat from core client for 30 sec - exiting 19:11:01 (6624): No heartbeat from core client for 30 sec - exiting 19:11:02 (6624): No heartbeat from core client for 30 sec - exiting 19:11:04 (6624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:48:23 (3696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3876, selfPID=3876, iMonCtr=2 04:48:24 (3696): No heartbeat from core client for 30 sec - exiting 20:02:00 (1328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:02:01 (1328): No heartbeat from core client for 30 sec - exiting 05:10:24 (7404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:10:25 (7404): No heartbeat from core client for 30 sec - exiting 05:10:26 (7404): No heartbeat from core client for 30 sec - exiting 11:12:54 (7376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:12:20 (1140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:47:34 (8140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:47:35 (8140): No heartbeat from core client for 30 sec - exiting 19:31:15 (6552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:33 (7764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7164, selfPID=7164, iMonCtr=2 20:19:55 (220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:58:37 (8048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:27:08 (1612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:45:24 (4520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:38:33 (6624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:38:34 (6624): No heartbeat from core client for 30 sec - exiting 02:41:40 (2064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:10:30 (2540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:20:32 (4732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:21:21 (8188): No heartbeat from core client for 30 sec - exiting 03:21:22 (8188): No heartbeat from core client for 30 sec - exiting 03:21:23 (8188): No heartbeat from core client for 30 sec - exiting 03:21:24 (8188): No heartbeat from core client for 30 sec - exiting 03:21:25 (8188): No heartbeat from core client for 30 sec - exiting 03:21:26 (8188): No heartbeat from core client for 30 sec - exiting 03:21:27 (8188): No heartbeat from core client for 30 sec - exiting 03:21:28 (8188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:21:29 (8188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4760, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=168, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5076, selfPID=5744, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5112, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4276, selfPID=4728, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5788, selfPID=5608, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5088, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4668, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3324, selfPID=5372, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4456, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1872, selfPID=4992, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5316, selfPID=4592, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5288, selfPID=4604, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5480, selfPID=4648, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2656, selfPID=5824, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5688, selfPID=4668, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4360, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4356, selfPID=4504, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4108, selfPID=4892, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1176, selfPID=5260, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5568, selfPID=4756, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8092, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6860, selfPID=4628, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 10 CPDN Monitor - Quit request from BOINC... 01:41:36 (4740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:41:37 (4740): No heartbeat from core client for 30 sec - exiting 01:41:38 (4740): No heartbeat from core client for 30 sec - exiting 01:41:39 (4740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8076, selfPID=8076, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3212, selfPID=3716, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5908, iMonCtr=2 Model crash detected, will try to restart... 11:00:05 (2572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Aug 2012 04:28:27	1206098	14448918	hadam3p_pnw_bib1_1964_1_007910028_0	138,336	2,291,000	16.5611
06 Aug 2012 21:22:25	1206098	14448918	hadam3p_pnw_bib1_1964_1_007910028_0	126,816	2,108,328	16.6251
01 Aug 2012 20:29:23	1206098	14448918	hadam3p_pnw_bib1_1964_1_007910028_0	115,296	1,916,986	16.6266
28 Jul 2012 13:45:01	1206098	14448918	hadam3p_pnw_bib1_1964_1_007910028_0	103,776	1,730,431	16.6747
25 Jul 2012 07:42:00	1206098	14448918	hadam3p_pnw_bib1_1964_1_007910028_0	92,256	1,537,224	16.6626
20 Jul 2012 19:22:15	1206098	14448918	hadam3p_pnw_bib1_1964_1_007910028_0	80,736	1,343,780	16.6441
17 Jul 2012 17:29:23	1206098	14448918	hadam3p_pnw_bib1_1964_1_007910028_0	69,216	1,148,537	16.5935
19 Jun 2012 00:53:45	1206098	14448918	hadam3p_pnw_bib1_1964_1_007910028_0	57,696	956,998	16.5869
12 Jun 2012 02:14:47	1206098	14448918	hadam3p_pnw_bib1_1964_1_007910028_0	46,176	767,124	16.6130
29 May 2012 01:50:33	1206098	14448918	hadam3p_pnw_bib1_1964_1_007910028_0	34,656	568,291	16.3981
22 May 2012 10:41:37	1206098	14448918	hadam3p_pnw_bib1_1964_1_007910028_0	23,136	378,258	16.3493
17 May 2012 15:09:08	1206098	14448918	hadam3p_pnw_bib1_1964_1_007910028_0	11,617	192,204	16.5451
17 May 2012 13:15:50	1206098	14448918	hadam3p_pnw_bib1_1964_1_007910028_0	11,616	190,037	16.3599