Task 12300873

Name	hadam3p_pnw_zsns_1999_1_007015664_0
Workunit	7218980
Created	24 Nov 2010, 15:00:51 UTC
Sent	14 Jan 2011, 13:04:27 UTC
Report deadline	27 Dec 2011, 18:24:27 UTC
Received	10 Feb 2011, 20:25:58 UTC
Server state	Over
Outcome	Didn't need
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1047469
Run time	10 days 14 hours 32 min 49 sec
CPU time	7 days 3 hours 41 min 39 sec
Validate state	Initial
Credit	3,005.90
Device peak FLOPS	1.94 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.08 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=904, selfPID=904, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5584, selfPID=5584, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7376, selfPID=7376, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7300, selfPID=7300, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6360, selfPID=6360, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4680, selfPID=4680, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7208, selfPID=7208, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6556, selfPID=6556, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5048, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=480, selfPID=480, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5144, selfPID=5144, iMonCtr=2 09:11:11 (5536): No heartbeat from core client for 30 sec - exiting 09:11:13 (5536): No heartbeat from core client for 30 sec - exiting 09:11:14 (5536): No heartbeat from core client for 30 sec - exiting 09:11:15 (5536): No heartbeat from core client for 30 sec - exiting 09:11:16 (5536): No heartbeat from core client for 30 sec - exiting 09:11:17 (5536): No heartbeat from core client for 30 sec - exiting 09:11:18 (5536): No heartbeat from core client for 30 sec - exiting 09:11:19 (5536): No heartbeat from core client for 30 sec - exiting 09:11:20 (5536): No heartbeat from core client for 30 sec - exiting 09:11:21 (5536): No heartbeat from core client for 30 sec - exiting 09:11:22 (5536): No heartbeat from core client for 30 sec - exiting 09:11:23 (5536): No heartbeat from core client for 30 sec - exiting 09:11:24 (5536): No heartbeat from core client for 30 sec - exiting 09:11:25 (5536): No heartbeat from core client for 30 sec - exiting 09:11:27 (5536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3008, selfPID=3008, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=440, selfPID=440, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3852, selfPID=3852, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=448, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6748, selfPID=6748, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3452, selfPID=3452, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4544, selfPID=4216, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6172, selfPID=6172, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1836, selfPID=1836, iMonCtr=2 22:47:20 (4920): No heartbeat from core client for 30 sec - exiting 22:47:22 (4920): No heartbeat from core client for 30 sec - exiting 22:47:23 (4920): No heartbeat from core client for 30 sec - exiting 22:47:24 (4920): No heartbeat from core client for 30 sec - exiting 22:47:25 (4920): No heartbeat from core client for 30 sec - exiting 22:47:26 (4920): No heartbeat from core client for 30 sec - exiting 22:47:27 (4920): No heartbeat from core client for 30 sec - exiting 22:47:28 (4920): No heartbeat from core client for 30 sec - exiting 22:47:29 (4920): No heartbeat from core client for 30 sec - exiting 22:47:30 (4920): No heartbeat from core client for 30 sec - exiting 22:47:31 (4920): No heartbeat from core client for 30 sec - exiting 22:47:32 (4920): No heartbeat from core client for 30 sec - exiting 22:47:33 (4920): No heartbeat from core client for 30 sec - exiting 22:47:34 (4920): No heartbeat from core client for 30 sec - exiting 22:47:35 (4920): No heartbeat from core client for 30 sec - exiting 22:47:36 (4920): No heartbeat from core client for 30 sec - exiting 22:47:37 (4920): No heartbeat from core client for 30 sec - exiting 22:47:38 (4920): No heartbeat from core client for 30 sec - exiting 22:47:39 (4920): No heartbeat from core client for 30 sec - exiting 22:47:40 (4920): No heartbeat from core client for 30 sec - exiting 22:47:41 (4920): No heartbeat from core client for 30 sec - exiting 22:47:42 (4920): No heartbeat from core client for 30 sec - exiting 22:47:43 (4920): No heartbeat from core client for 30 sec - exiting 22:47:44 (4920): No heartbeat from core client for 30 sec - exiting 22:47:45 (4920): No heartbeat from core client for 30 sec - exiting 22:47:46 (4920): No heartbeat from core client for 30 sec - exiting 22:47:47 (4920): No heartbeat from core client for 30 sec - exiting 22:47:48 (4920): No heartbeat from core client for 30 sec - exiting 22:47:49 (4920): No heartbeat from core client for 30 sec - exiting 22:47:50 (4920): No heartbeat from core client for 30 sec - exiting 22:47:51 (4920): No heartbeat from core client for 30 sec - exiting 22:47:52 (4920): No heartbeat from core client for 30 sec - exiting 22:47:53 (4920): No heartbeat from core client for 30 sec - exiting 22:47:54 (4920): No heartbeat from core client for 30 sec - exiting 22:47:55 (4920): No heartbeat from core client for 30 sec - exiting 22:47:56 (4920): No heartbeat from core client for 30 sec - exiting 22:47:57 (4920): No heartbeat from core client for 30 sec - exiting 22:47:58 (4920): No heartbeat from core client for 30 sec - exiting 22:47:59 (4920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7116, selfPID=7116, iMonCtr=2 05:31:08 (5552): No heartbeat from core client for 30 sec - exiting 05:31:09 (5552): No heartbeat from core client for 30 sec - exiting 05:31:10 (5552): No heartbeat from core client for 30 sec - exiting 05:31:11 (5552): No heartbeat from core client for 30 sec - exiting 05:31:12 (5552): No heartbeat from core client for 30 sec - exiting 05:31:13 (5552): No heartbeat from core client for 30 sec - exiting 05:31:14 (5552): No heartbeat from core client for 30 sec - exiting 05:31:15 (5552): No heartbeat from core client for 30 sec - exiting 05:31:16 (5552): No heartbeat from core client for 30 sec - exiting 05:31:17 (5552): No heartbeat from core client for 30 sec - exiting 05:31:18 (5552): No heartbeat from core client for 30 sec - exiting 05:31:19 (5552): No heartbeat from core client for 30 sec - exiting 05:31:20 (5552): No heartbeat from core client for 30 sec - exiting 05:31:21 (5552): No heartbeat from core client for 30 sec - exiting 05:31:22 (5552): No heartbeat from core client for 30 sec - exiting 05:31:23 (5552): No heartbeat from core client for 30 sec - exiting 05:31:24 (5552): No heartbeat from core client for 30 sec - exiting 05:31:25 (5552): No heartbeat from core client for 30 sec - exiting 05:31:26 (5552): No heartbeat from core client for 30 sec - exiting 05:31:27 (5552): No heartbeat from core client for 30 sec - exiting 05:31:28 (5552): No heartbeat from core client for 30 sec - exiting 05:31:29 (5552): No heartbeat from core client for 30 sec - exiting 05:31:30 (5552): No heartbeat from core client for 30 sec - exiting 05:31:31 (5552): No heartbeat from core client for 30 sec - exiting 05:31:32 (5552): No heartbeat from core client for 30 sec - exiting 05:31:33 (5552): No heartbeat from core client for 30 sec - exiting 05:31:34 (5552): No heartbeat from core client for 30 sec - exiting 05:31:35 (5552): No heartbeat from core client for 30 sec - exiting 05:31:36 (5552): No heartbeat from core client for 30 sec - exiting 05:31:37 (5552): No heartbeat from core client for 30 sec - exiting 05:31:38 (5552): No heartbeat from core client for 30 sec - exiting 05:31:39 (5552): No heartbeat from core client for 30 sec - exiting 05:31:40 (5552): No heartbeat from core client for 30 sec - exiting 05:31:41 (5552): No heartbeat from core client for 30 sec - exiting 05:31:42 (5552): No heartbeat from core client for 30 sec - exiting 05:31:43 (5552): No heartbeat from core client for 30 sec - exiting 05:31:45 (5552): No heartbeat from core client for 30 sec - exiting 05:31:46 (5552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:15:52 (568): No heartbeat from core client for 30 sec - exiting 10:15:53 (568): No heartbeat from core client for 30 sec - exiting 10:15:54 (568): No heartbeat from core client for 30 sec - exiting 10:15:55 (568): No heartbeat from core client for 30 sec - exiting 10:15:56 (568): No heartbeat from core client for 30 sec - exiting 10:15:57 (568): No heartbeat from core client for 30 sec - exiting 10:15:58 (568): No heartbeat from core client for 30 sec - exiting 10:15:59 (568): No heartbeat from core client for 30 sec - exiting 10:16:00 (568): No heartbeat from core client for 30 sec - exiting 10:16:01 (568): No heartbeat from core client for 30 sec - exiting 10:16:02 (568): No heartbeat from core client for 30 sec - exiting 10:16:03 (568): No heartbeat from core client for 30 sec - exiting 10:16:04 (568): No heartbeat from core client for 30 sec - exiting 10:16:06 (568): No heartbeat from core client for 30 sec - exiting 10:16:07 (568): No heartbeat from core client for 30 sec - exiting 10:16:08 (568): No heartbeat from core client for 30 sec - exiting 10:16:09 (568): No heartbeat from core client for 30 sec - exiting 10:16:10 (568): No heartbeat from core client for 30 sec - exiting 10:16:11 (568): No heartbeat from core client for 30 sec - exiting 10:16:12 (568): No heartbeat from core client for 30 sec - exiting 10:16:13 (568): No heartbeat from core client for 30 sec - exiting 10:16:14 (568): No heartbeat from core client for 30 sec - exiting 10:16:15 (568): No heartbeat from core client for 30 sec - exiting 10:16:16 (568): No heartbeat from core client for 30 sec - exiting 10:16:17 (568): No heartbeat from core client for 30 sec - exiting 10:16:18 (568): No heartbeat from core client for 30 sec - exiting 10:16:19 (568): No heartbeat from core client for 30 sec - exiting 10:16:20 (568): No heartbeat from core client for 30 sec - exiting 10:16:22 (568): No heartbeat from core client for 30 sec - exiting 10:16:23 (568): No heartbeat from core client for 30 sec - exiting 10:16:24 (568): No heartbeat from core client for 30 sec - exiting 10:16:25 (568): No heartbeat from core client for 30 sec - exiting 10:16:26 (568): No heartbeat from core client for 30 sec - exiting 10:16:27 (568): No heartbeat from core client for 30 sec - exiting 10:16:28 (568): No heartbeat from core client for 30 sec - exiting 10:16:29 (568): No heartbeat from core client for 30 sec - exiting 10:16:30 (568): No heartbeat from core client for 30 sec - exiting 10:16:31 (568): No heartbeat from core client for 30 sec - exiting 10:16:33 (568): No heartbeat from core client for 30 sec - exiting 10:16:34 (568): No heartbeat from core client for 30 sec - exiting 10:16:35 (568): No heartbeat from core client for 30 sec - exiting 10:16:36 (568): No heartbeat from core client for 30 sec - exiting 10:16:37 (568): No heartbeat from core client for 30 sec - exiting 10:16:38 (568): No heartbeat from core client for 30 sec - exiting 10:16:39 (568): No heartbeat from core client for 30 sec - exiting 10:16:40 (568): No heartbeat from core client for 30 sec - exiting 10:16:41 (568): No heartbeat from core client for 30 sec - exiting 10:16:42 (568): No heartbeat from core client for 30 sec - exiting 10:16:43 (568): No heartbeat from core client for 30 sec - exiting 10:16:44 (568): No heartbeat from core client for 30 sec - exiting 10:16:45 (568): No heartbeat from core client for 30 sec - exiting 10:16:47 (568): No heartbeat from core client for 30 sec - exiting 10:16:48 (568): No heartbeat from core client for 30 sec - exiting 10:16:49 (568): No heartbeat from core client for 30 sec - exiting 10:16:50 (568): No heartbeat from core client for 30 sec - exiting 10:16:51 (568): No heartbeat from core client for 30 sec - exiting 10:16:52 (568): No heartbeat from core client for 30 sec - exiting 10:16:53 (568): No heartbeat from core client for 30 sec - exiting 10:16:54 (568): No heartbeat from core client for 30 sec - exiting 10:16:55 (568): No heartbeat from core client for 30 sec - exiting 10:16:56 (568): No heartbeat from core client for 30 sec - exiting 10:16:57 (568): No heartbeat from core client for 30 sec - exiting 10:16:58 (568): No heartbeat from core client for 30 sec - exiting 10:16:59 (568): No heartbeat from core client for 30 sec - exiting 10:17:00 (568): No heartbeat from core client for 30 sec - exiting 10:17:01 (568): No heartbeat from core client for 30 sec - exiting 10:17:02 (568): No heartbeat from core client for 30 sec - exiting 10:17:03 (568): No heartbeat from core client for 30 sec - exiting 10:17:04 (568): No heartbeat from core client for 30 sec - exiting 10:17:05 (568): No heartbeat from core client for 30 sec - exiting 10:17:06 (568): No heartbeat from core client for 30 sec - exiting 10:17:07 (568): No heartbeat from core client for 30 sec - exiting 10:17:08 (568): No heartbeat from core client for 30 sec - exiting 10:17:09 (568): No heartbeat from core client for 30 sec - exiting 10:17:10 (568): No heartbeat from core client for 30 sec - exiting 10:17:11 (568): No heartbeat from core client for 30 sec - exiting 10:17:12 (568): No heartbeat from core client for 30 sec - exiting 10:17:13 (568): No heartbeat from core client for 30 sec - exiting 10:17:14 (568): No heartbeat from core client for 30 sec - exiting 10:17:15 (568): No heartbeat from core client for 30 sec - exiting 10:17:16 (568): No heartbeat from core client for 30 sec - exiting 10:17:17 (568): No heartbeat from core client for 30 sec - exiting 10:17:18 (568): No heartbeat from core client for 30 sec - exiting 10:17:20 (568): No heartbeat from core client for 30 sec - exiting 10:17:21 (568): No heartbeat from core client for 30 sec - exiting 10:17:22 (568): No heartbeat from core client for 30 sec - exiting 10:17:23 (568): No heartbeat from core client for 30 sec - exiting 10:17:24 (568): No heartbeat from core client for 30 sec - exiting 10:17:25 (568): No heartbeat from core client for 30 sec - exiting 10:17:26 (568): No heartbeat from core client for 30 sec - exiting 10:17:27 (568): No heartbeat from core client for 30 sec - exiting 10:17:28 (568): No heartbeat from core client for 30 sec - exiting 10:17:29 (568): No heartbeat from core client for 30 sec - exiting 10:17:30 (568): No heartbeat from core client for 30 sec - exiting 10:17:31 (568): No heartbeat from core client for 30 sec - exiting 10:17:32 (568): No heartbeat from core client for 30 sec - exiting 10:17:33 (568): No heartbeat from core client for 30 sec - exiting 10:17:34 (568): No heartbeat from core client for 30 sec - exiting 10:17:35 (568): No heartbeat from core client for 30 sec - exiting 10:17:36 (568): No heartbeat from core client for 30 sec - exiting 10:17:37 (568): No heartbeat from core client for 30 sec - exiting 10:17:38 (568): No heartbeat from core client for 30 sec - exiting 10:17:39 (568): No heartbeat from core client for 30 sec - exiting 10:17:40 (568): No heartbeat from core client for 30 sec - exiting 10:17:41 (568): No heartbeat from core client for 30 sec - exiting 10:17:42 (568): No heartbeat from core client for 30 sec - exiting 10:17:43 (568): No heartbeat from core client for 30 sec - exiting 10:17:44 (568): No heartbeat from core client for 30 sec - exiting 10:17:45 (568): No heartbeat from core client for 30 sec - exiting 10:17:46 (568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:12:16 (5884): No heartbeat from core client for 30 sec - exiting 09:12:17 (5884): No heartbeat from core client for 30 sec - exiting 09:12:18 (5884): No heartbeat from core client for 30 sec - exiting 09:12:19 (5884): No heartbeat from core client for 30 sec - exiting 09:12:20 (5884): No heartbeat from core client for 30 sec - exiting 09:12:21 (5884): No heartbeat from core client for 30 sec - exiting 09:12:22 (5884): No heartbeat from core client for 30 sec - exiting 09:12:23 (5884): No heartbeat from core client for 30 sec - exiting 09:12:24 (5884): No heartbeat from core client for 30 sec - exiting 09:12:26 (5884): No heartbeat from core client for 30 sec - exiting 09:12:27 (5884): No heartbeat from core client for 30 sec - exiting 09:12:28 (5884): No heartbeat from core client for 30 sec - exiting 09:12:29 (5884): No heartbeat from core client for 30 sec - exiting 09:12:30 (5884): No heartbeat from core client for 30 sec - exiting 09:12:31 (5884): No heartbeat from core client for 30 sec - exiting 09:12:32 (5884): No heartbeat from core client for 30 sec - exiting 09:12:33 (5884): No heartbeat from core client for 30 sec - exiting 09:12:34 (5884): No heartbeat from core client for 30 sec - exiting 09:12:35 (5884): No heartbeat from core client for 30 sec - exiting 09:12:36 (5884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8180, selfPID=6972, iMonCtr=1 Model crash detected, will try to restart... 00:30:12 (5532): No heartbeat from core client for 30 sec - exiting 00:30:13 (5532): No heartbeat from core client for 30 sec - exiting 00:30:14 (5532): No heartbeat from core client for 30 sec - exiting 00:30:15 (5532): No heartbeat from core client for 30 sec - exiting 00:30:16 (5532): No heartbeat from core client for 30 sec - exiting 00:30:17 (5532): No heartbeat from core client for 30 sec - exiting 00:30:18 (5532): No heartbeat from core client for 30 sec - exiting 00:30:19 (5532): No heartbeat from core client for 30 sec - exiting 00:30:20 (5532): No heartbeat from core client for 30 sec - exiting 00:30:21 (5532): No heartbeat from core client for 30 sec - exiting 00:30:22 (5532): No heartbeat from core client for 30 sec - exiting 00:30:23 (5532): No heartbeat from core client for 30 sec - exiting 00:30:25 (5532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6776, selfPID=6776, iMonCtr=2 07:00:53 (4824): No heartbeat from core client for 30 sec - exiting 07:00:54 (4824): No heartbeat from core client for 30 sec - exiting 07:00:55 (4824): No heartbeat from core client for 30 sec - exiting 07:00:56 (4824): No heartbeat from core client for 30 sec - exiting 07:00:57 (4824): No heartbeat from core client for 30 sec - exiting 07:00:58 (4824): No heartbeat from core client for 30 sec - exiting 07:00:59 (4824): No heartbeat from core client for 30 sec - exiting 07:01:00 (4824): No heartbeat from core client for 30 sec - exiting 07:01:01 (4824): No heartbeat from core client for 30 sec - exiting 07:01:02 (4824): No heartbeat from core client for 30 sec - exiting 07:01:03 (4824): No heartbeat from core client for 30 sec - exiting 07:01:04 (4824): No heartbeat from core client for 30 sec - exiting 07:01:05 (4824): No heartbeat from core client for 30 sec - exiting 07:01:06 (4824): No heartbeat from core client for 30 sec - exiting 07:01:07 (4824): No heartbeat from core client for 30 sec - exiting 07:01:08 (4824): No heartbeat from core client for 30 sec - exiting 07:01:09 (4824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6804, selfPID=6804, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5572, selfPID=5572, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5088, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7128, selfPID=7128, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7756, selfPID=7756, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3424, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 10:40:14 (5440): No heartbeat from core client for 30 sec - exiting 10:40:15 (5440): No heartbeat from core client for 30 sec - exiting 10:40:18 (5440): No heartbeat from core client for 30 sec - exiting 10:40:19 (5440): No heartbeat from core client for 30 sec - exiting 10:40:20 (5440): No heartbeat from core client for 30 sec - exiting 10:40:22 (5440): No heartbeat from core client for 30 sec - exiting 10:40:23 (5440): No heartbeat from core client for 30 sec - exiting 10:40:24 (5440): No heartbeat from core client for 30 sec - exiting 10:40:26 (5440): No heartbeat from core client for 30 sec - exiting 10:40:27 (5440): No heartbeat from core client for 30 sec - exiting 10:40:30 (5440): No heartbeat from core client for 30 sec - exiting 10:40:31 (5440): No heartbeat from core client for 30 sec - exiting 10:40:33 (5440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5912, selfPID=5912, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2612, selfPID=2612, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5032, selfPID=5032, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:26:08 (4252): No heartbeat from core client for 30 sec - exiting 09:26:09 (4252): No heartbeat from core client for 30 sec - exiting 09:26:10 (4252): No heartbeat from core client for 30 sec - exiting 09:26:11 (4252): No heartbeat from core client for 30 sec - exiting 09:26:12 (4252): No heartbeat from core client for 30 sec - exiting 09:26:13 (4252): No heartbeat from core client for 30 sec - exiting 09:26:14 (4252): No heartbeat from core client for 30 sec - exiting 09:26:15 (4252): No heartbeat from core client for 30 sec - exiting 09:26:16 (4252): No heartbeat from core client for 30 sec - exiting 09:26:17 (4252): No heartbeat from core client for 30 sec - exiting 09:26:18 (4252): No heartbeat from core client for 30 sec - exiting 09:26:19 (4252): No heartbeat from core client for 30 sec - exiting 09:26:20 (4252): No heartbeat from core client for 30 sec - exiting 09:26:21 (4252): No heartbeat from core client for 30 sec - exiting 09:26:22 (4252): No heartbeat from core client for 30 sec - exiting 09:26:23 (4252): No heartbeat from core client for 30 sec - exiting 09:26:24 (4252): No heartbeat from core client for 30 sec - exiting 09:26:25 (4252): No heartbeat from core client for 30 sec - exiting 09:26:26 (4252): No heartbeat from core client for 30 sec - exiting 09:26:27 (4252): No heartbeat from core client for 30 sec - exiting 09:26:29 (4252): No heartbeat from core client for 30 sec - exiting 09:26:30 (4252): No heartbeat from core client for 30 sec - exiting 09:26:31 (4252): No heartbeat from core client for 30 sec - exiting 09:26:32 (4252): No heartbeat from core client for 30 sec - exiting 09:26:33 (4252): No heartbeat from core client for 30 sec - exiting 09:26:34 (4252): No heartbeat from core client for 30 sec - exiting 09:26:35 (4252): No heartbeat from core client for 30 sec - exiting 09:26:36 (4252): No heartbeat from core client for 30 sec - exiting 09:26:37 (4252): No heartbeat from core client for 30 sec - exiting 09:26:38 (4252): No heartbeat from core client for 30 sec - exiting 09:26:39 (4252): No heartbeat from core client for 30 sec - exiting 09:26:40 (4252): No heartbeat from core client for 30 sec - exiting 09:26:41 (4252): No heartbeat from core client for 30 sec - exiting 09:26:42 (4252): No heartbeat from core client for 30 sec - exiting 09:26:44 (4252): No heartbeat from core client for 30 sec - exiting 09:26:45 (4252): No heartbeat from core client for 30 sec - exiting 09:26:46 (4252): No heartbeat from core client for 30 sec - exiting 09:26:47 (4252): No heartbeat from core client for 30 sec - exiting 09:26:48 (4252): No heartbeat from core client for 30 sec - exiting 09:26:49 (4252): No heartbeat from core client for 30 sec - exiting 09:26:50 (4252): No heartbeat from core client for 30 sec - exiting 09:26:52 (4252): No heartbeat from core client for 30 sec - exiting 09:26:53 (4252): No heartbeat from core client for 30 sec - exiting 09:26:54 (4252): No heartbeat from core client for 30 sec - exiting 09:26:56 (4252): No heartbeat from core client for 30 sec - exiting 09:26:59 (4252): No heartbeat from core client for 30 sec - exiting 09:27:00 (4252): No heartbeat from core client for 30 sec - exiting 09:27:02 (4252): No heartbeat from core client for 30 sec - exiting 09:27:03 (4252): No heartbeat from core client for 30 sec - exiting 09:27:04 (4252): No heartbeat from core client for 30 sec - exiting 09:27:06 (4252): No heartbeat from core client for 30 sec - exiting 09:27:07 (4252): No heartbeat from core client for 30 sec - exiting 09:27:08 (4252): No heartbeat from core client for 30 sec - exiting 09:27:11 (4252): No heartbeat from core client for 30 sec - exiting 09:27:14 (4252): No heartbeat from core client for 30 sec - exiting 09:27:18 (4252): No heartbeat from core client for 30 sec - exiting 09:27:20 (4252): No heartbeat from core client for 30 sec - exiting 09:27:22 (4252): No heartbeat from core client for 30 sec - exiting 09:27:24 (4252): No heartbeat from core client for 30 sec - exiting 09:27:25 (4252): No heartbeat from core client for 30 sec - exiting 09:27:26 (4252): No heartbeat from core client for 30 sec - exiting 09:27:27 (4252): No heartbeat from core client for 30 sec - exiting 09:27:28 (4252): No heartbeat from core client for 30 sec - exiting 09:27:29 (4252): No heartbeat from core client for 30 sec - exiting 09:27:30 (4252): No heartbeat from core client for 30 sec - exiting 09:27:31 (4252): No heartbeat from core client for 30 sec - exiting 09:27:32 (4252): No heartbeat from core client for 30 sec - exiting 09:27:33 (4252): No heartbeat from core client for 30 sec - exiting 09:27:34 (4252): No heartbeat from core client for 30 sec - exiting 09:27:35 (4252): No heartbeat from core client for 30 sec - exiting 09:27:36 (4252): No heartbeat from core client for 30 sec - exiting 09:27:38 (4252): No heartbeat from core client for 30 sec - exiting 09:27:39 (4252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2768, selfPID=2768, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:38:32 (3228): No heartbeat from core client for 30 sec - exiting 22:38:33 (3228): No heartbeat from core client for 30 sec - exiting 22:38:34 (3228): No heartbeat from core client for 30 sec - exiting 22:38:35 (3228): No heartbeat from core client for 30 sec - exiting 22:38:36 (3228): No heartbeat from core client for 30 sec - exiting 22:38:37 (3228): No heartbeat from core client for 30 sec - exiting 22:38:38 (3228): No heartbeat from core client for 30 sec - exiting 22:38:39 (3228): No heartbeat from core client for 30 sec - exiting 22:38:40 (3228): No heartbeat from core client for 30 sec - exiting 22:38:41 (3228): No heartbeat from core client for 30 sec - exiting 22:38:42 (3228): No heartbeat from core client for 30 sec - exiting 22:38:43 (3228): No heartbeat from core client for 30 sec - exiting 22:38:44 (3228): No heartbeat from core client for 30 sec - exiting 22:38:45 (3228): No heartbeat from core client for 30 sec - exiting 22:38:46 (3228): No heartbeat from core client for 30 sec - exiting 22:38:47 (3228): No heartbeat from core client for 30 sec - exiting 22:38:48 (3228): No heartbeat from core client for 30 sec - exiting 22:38:49 (3228): No heartbeat from core client for 30 sec - exiting 22:38:50 (3228): No heartbeat from core client for 30 sec - exiting 22:38:51 (3228): No heartbeat from core client for 30 sec - exiting 22:38:52 (3228): No heartbeat from core client for 30 sec - exiting 22:38:53 (3228): No heartbeat from core client for 30 sec - exiting 22:38:54 (3228): No heartbeat from core client for 30 sec - exiting 22:38:55 (3228): No heartbeat from core client for 30 sec - exiting 22:38:56 (3228): No heartbeat from core client for 30 sec - exiting 22:38:57 (3228): No heartbeat from core client for 30 sec - exiting 22:38:58 (3228): No heartbeat from core client for 30 sec - exiting 22:38:59 (3228): No heartbeat from core client for 30 sec - exiting 22:39:00 (3228): No heartbeat from core client for 30 sec - exiting 22:39:01 (3228): No heartbeat from core client for 30 sec - exiting 22:39:02 (3228): No heartbeat from core client for 30 sec - exiting 22:39:03 (3228): No heartbeat from core client for 30 sec - exiting 22:39:04 (3228): No heartbeat from core client for 30 sec - exiting 22:39:05 (3228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:39:06 (3228): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6344, selfPID=6344, iMonCtr=2 05:26:44 (6856): No heartbeat from core client for 30 sec - exiting 05:26:45 (6856): No heartbeat from core client for 30 sec - exiting 05:26:46 (6856): No heartbeat from core client for 30 sec - exiting 05:26:47 (6856): No heartbeat from core client for 30 sec - exiting 05:26:48 (6856): No heartbeat from core client for 30 sec - exiting 05:26:49 (6856): No heartbeat from core client for 30 sec - exiting 05:26:50 (6856): No heartbeat from core client for 30 sec - exiting 05:26:51 (6856): No heartbeat from core client for 30 sec - exiting 05:26:52 (6856): No heartbeat from core client for 30 sec - exiting 05:26:53 (6856): No heartbeat from core client for 30 sec - exiting 05:26:54 (6856): No heartbeat from core client for 30 sec - exiting 05:26:55 (6856): No heartbeat from core client for 30 sec - exiting 05:26:56 (6856): No heartbeat from core client for 30 sec - exiting 05:26:57 (6856): No heartbeat from core client for 30 sec - exiting 05:26:58 (6856): No heartbeat from core client for 30 sec - exiting 05:26:59 (6856): No heartbeat from core client for 30 sec - exiting 05:27:00 (6856): No heartbeat from core client for 30 sec - exiting 05:27:01 (6856): No heartbeat from core client for 30 sec - exiting 05:27:02 (6856): No heartbeat from core client for 30 sec - exiting 05:27:03 (6856): No heartbeat from core client for 30 sec - exiting 05:27:04 (6856): No heartbeat from core client for 30 sec - exiting 05:27:05 (6856): No heartbeat from core client for 30 sec - exiting 05:27:06 (6856): No heartbeat from core client for 30 sec - exiting 05:27:07 (6856): No heartbeat from core client for 30 sec - exiting 05:27:08 (6856): No heartbeat from core client for 30 sec - exiting 05:27:09 (6856): No heartbeat from core client for 30 sec - exiting 05:27:10 (6856): No heartbeat from core client for 30 sec - exiting 05:27:11 (6856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2504, selfPID=2504, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2552, selfPID=2552, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 07:32:02 (5756): No heartbeat from core client for 30 sec - exiting 07:32:04 (5756): No heartbeat from core client for 30 sec - exiting 07:32:05 (5756): No heartbeat from core client for 30 sec - exiting 07:32:06 (5756): No heartbeat from core client for 30 sec - exiting 07:32:07 (5756): No heartbeat from core client for 30 sec - exiting 07:32:08 (5756): No heartbeat from core client for 30 sec - exiting 07:32:09 (5756): No heartbeat from core client for 30 sec - exiting 07:32:10 (5756): No heartbeat from core client for 30 sec - exiting 07:32:11 (5756): No heartbeat from core client for 30 sec - exiting 07:32:12 (5756): No heartbeat from core client for 30 sec - exiting 07:32:13 (5756): No heartbeat from core client for 30 sec - exiting 07:32:14 (5756): No heartbeat from core client for 30 sec - exiting 07:32:15 (5756): No heartbeat from core client for 30 sec - exiting 07:32:16 (5756): No heartbeat from core client for 30 sec - exiting 07:32:17 (5756): No heartbeat from core client for 30 sec - exiting 07:32:18 (5756): No heartbeat from core client for 30 sec - exiting 07:32:19 (5756): No heartbeat from core client for 30 sec - exiting 07:32:20 (5756): No heartbeat from core client for 30 sec - exiting 07:32:21 (5756): No heartbeat from core client for 30 sec - exiting 07:32:22 (5756): No heartbeat from core client for 30 sec - exiting 07:32:23 (5756): No heartbeat from core client for 30 sec - exiting 07:32:24 (5756): No heartbeat from core client for 30 sec - exiting 07:32:25 (5756): No heartbeat from core client for 30 sec - exiting 07:32:26 (5756): No heartbeat from core client for 30 sec - exiting 07:32:27 (5756): No heartbeat from core client for 30 sec - exiting 07:32:28 (5756): No heartbeat from core client for 30 sec - exiting 07:32:29 (5756): No heartbeat from core client for 30 sec - exiting 07:32:30 (5756): No heartbeat from core client for 30 sec - exiting 07:32:31 (5756): No heartbeat from core client for 30 sec - exiting 07:32:32 (5756): No heartbeat from core client for 30 sec - exiting 07:32:33 (5756): No heartbeat from core client for 30 sec - exiting 07:32:34 (5756): No heartbeat from core client for 30 sec - exiting 07:32:35 (5756): No heartbeat from core client for 30 sec - exiting 07:32:36 (5756): No heartbeat from core client for 30 sec - exiting 07:32:37 (5756): No heartbeat from core client for 30 sec - exiting 07:32:38 (5756): No heartbeat from core client for 30 sec - exiting 07:32:39 (5756): No heartbeat from core client for 30 sec - exiting 07:32:40 (5756): No heartbeat from core client for 30 sec - exiting 07:32:41 (5756): No heartbeat from core client for 30 sec - exiting 07:32:42 (5756): No heartbeat from core client for 30 sec - exiting 07:32:43 (5756): No heartbeat from core client for 30 sec - exiting 07:32:44 (5756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8080, selfPID=8080, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5740, selfPID=5740, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5296, selfPID=5296, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Leaving CPDN_Main::Monitor... 20:20:24 (3900): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Feb 2011 19:31:37	1047469	12300873	hadam3p_pnw_zsns_1999_1_007015664_0	138,337	616,971	4.4599
09 Feb 2011 19:03:02	1047469	12300873	hadam3p_pnw_zsns_1999_1_007015664_0	138,336	616,323	4.4553
05 Feb 2011 17:11:24	1047469	12300873	hadam3p_pnw_zsns_1999_1_007015664_0	126,816	566,042	4.4635
03 Feb 2011 18:55:18	1047469	12300873	hadam3p_pnw_zsns_1999_1_007015664_0	115,296	516,315	4.4782
01 Feb 2011 14:36:39	1047469	12300873	hadam3p_pnw_zsns_1999_1_007015664_0	103,776	466,484	4.4951
30 Jan 2011 16:43:44	1047469	12300873	hadam3p_pnw_zsns_1999_1_007015664_0	92,256	415,923	4.5084
28 Jan 2011 18:54:32	1047469	12300873	hadam3p_pnw_zsns_1999_1_007015664_0	80,736	363,368	4.5007
26 Jan 2011 14:00:45	1047469	12300873	hadam3p_pnw_zsns_1999_1_007015664_0	69,216	310,382	4.4843
24 Jan 2011 13:07:12	1047469	12300873	hadam3p_pnw_zsns_1999_1_007015664_0	57,698	258,414	4.4787
24 Jan 2011 03:15:48	1047469	12300873	hadam3p_pnw_zsns_1999_1_007015664_0	57,696	257,802	4.4683
22 Jan 2011 11:30:59	1047469	12300873	hadam3p_pnw_zsns_1999_1_007015664_0	46,176	206,459	4.4711
20 Jan 2011 11:21:01	1047469	12300873	hadam3p_pnw_zsns_1999_1_007015664_0	34,656	153,936	4.4418
18 Jan 2011 11:43:55	1047469	12300873	hadam3p_pnw_zsns_1999_1_007015664_0	23,136	101,558	4.3896
16 Jan 2011 16:46:20	1047469	12300873	hadam3p_pnw_zsns_1999_1_007015664_0	11,616	52,038	4.4799