Task 14799725

Name	hadam3p_pnw_axve_1962_1_008002345_1
Workunit	8157459
Created	19 Jun 2012, 19:27:20 UTC
Sent	19 Jun 2012, 19:27:22 UTC
Report deadline	2 Jun 2013, 0:47:22 UTC
Received	29 Dec 2012, 0:01:22 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1167915
Run time	60 days 3 hours 55 min 14 sec
CPU time	16 days 11 hours 4 min 18 sec
Validate state	Workunit error - check skipped
Credit	3,005.88
Device peak FLOPS	2.20 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> client for 30 sec - exiting 21:19:45 (3768): No heartbeat from core client for 30 sec - exiting 21:19:46 (3768): No heartbeat from core client for 30 sec - exiting 21:19:47 (3768): No heartbeat from core client for 30 sec - exiting 21:19:48 (3768): No heartbeat from core client for 30 sec - exiting 21:19:49 (3768): No heartbeat from core client for 30 sec - exiting 21:19:50 (3768): No heartbeat from core client for 30 sec - exiting 21:19:51 (3768): No heartbeat from core client for 30 sec - exiting 21:19:52 (3768): No heartbeat from core client for 30 sec - exiting 21:19:54 (3768): No heartbeat from core client for 30 sec - exiting 21:19:55 (3768): No heartbeat from core client for 30 sec - exiting 21:19:56 (3768): No heartbeat from core client for 30 sec - exiting 21:19:57 (3768): No heartbeat from core client for 30 sec - exiting 21:19:58 (3768): No heartbeat from core client for 30 sec - exiting 21:19:59 (3768): No heartbeat from core client for 30 sec - exiting 21:20:00 (3768): No heartbeat from core client for 30 sec - exiting 21:20:01 (3768): No heartbeat from core client for 30 sec - exiting 21:20:02 (3768): No heartbeat from core client for 30 sec - exiting 21:20:03 (3768): No heartbeat from core client for 30 sec - exiting 21:20:05 (3768): No heartbeat from core client for 30 sec - exiting 21:20:06 (3768): No heartbeat from core client for 30 sec - exiting 21:20:07 (3768): No heartbeat from core client for 30 sec - exiting 21:20:08 (3768): No heartbeat from core client for 30 sec - exiting 21:20:09 (3768): No heartbeat from core client for 30 sec - exiting 21:20:10 (3768): No heartbeat from core client for 30 sec - exiting 21:20:11 (3768): No heartbeat from core client for 30 sec - exiting 21:20:12 (3768): No heartbeat from core client for 30 sec - exiting 21:20:13 (3768): No heartbeat from core client for 30 sec - exiting 21:20:14 (3768): No heartbeat from core client for 30 sec - exiting 21:20:16 (3768): No heartbeat from core client for 30 sec - exiting 21:20:17 (3768): No heartbeat from core client for 30 sec - exiting 21:20:18 (3768): No heartbeat from core client for 30 sec - exiting 21:20:19 (3768): No heartbeat from core client for 30 sec - exiting 21:20:20 (3768): No heartbeat from core client for 30 sec - exiting 21:20:21 (3768): No heartbeat from core client for 30 sec - exiting 21:20:22 (3768): No heartbeat from core client for 30 sec - exiting 21:20:23 (3768): No heartbeat from core client for 30 sec - exiting 21:20:24 (3768): No heartbeat from core client for 30 sec - exiting 21:20:25 (3768): No heartbeat from core client for 30 sec - exiting 21:20:26 (3768): No heartbeat from core client for 30 sec - exiting 21:20:28 (3768): No heartbeat from core client for 30 sec - exiting 21:20:29 (3768): No heartbeat from core client for 30 sec - exiting 21:20:30 (3768): No heartbeat from core client for 30 sec - exiting 21:20:31 (3768): No heartbeat from core client for 30 sec - exiting 21:20:32 (3768): No heartbeat from core client for 30 sec - exiting 21:20:33 (3768): No heartbeat from core client for 30 sec - exiting 21:20:34 (3768): No heartbeat from core client for 30 sec - exiting 21:20:35 (3768): No heartbeat from core client for 30 sec - exiting 21:20:36 (3768): No heartbeat from core client for 30 sec - exiting 21:20:37 (3768): No heartbeat from core client for 30 sec - exiting 21:20:38 (3768): No heartbeat from core client for 30 sec - exiting 21:20:40 (3768): No heartbeat from core client for 30 sec - exiting 21:20:41 (3768): No heartbeat from core client for 30 sec - exiting 21:20:42 (3768): No heartbeat from core client for 30 sec - exiting 21:20:43 (3768): No heartbeat from core client for 30 sec - exiting 21:20:44 (3768): No heartbeat from core client for 30 sec - exiting 21:20:45 (3768): No heartbeat from core client for 30 sec - exiting 21:20:46 (3768): No heartbeat from core client for 30 sec - exiting 21:20:47 (3768): No heartbeat from core client for 30 sec - exiting 21:20:48 (3768): No heartbeat from core client for 30 sec - exiting 21:20:49 (3768): No heartbeat from core client for 30 sec - exiting 21:20:51 (3768): No heartbeat from core client for 30 sec - exiting 21:20:52 (3768): No heartbeat from core client for 30 sec - exiting 21:20:53 (3768): No heartbeat from core client for 30 sec - exiting 21:20:54 (3768): No heartbeat from core client for 30 sec - exiting 21:20:55 (3768): No heartbeat from core client for 30 sec - exiting 21:20:56 (3768): No heartbeat from core client for 30 sec - exiting 21:20:57 (3768): No heartbeat from core client for 30 sec - exiting 21:20:58 (3768): No heartbeat from core client for 30 sec - exiting 21:20:59 (3768): No heartbeat from core client for 30 sec - exiting 21:21:00 (3768): No heartbeat from core client for 30 sec - exiting 21:21:02 (3768): No heartbeat from core client for 30 sec - exiting 21:21:03 (3768): No heartbeat from core client for 30 sec - exiting 21:21:04 (3768): No heartbeat from core client for 30 sec - exiting 21:21:05 (3768): No heartbeat from core client for 30 sec - exiting 21:21:06 (3768): No heartbeat from core client for 30 sec - exiting 21:21:07 (3768): No heartbeat from core client for 30 sec - exiting 21:21:08 (3768): No heartbeat from core client for 30 sec - exiting 21:21:09 (3768): No heartbeat from core client for 30 sec - exiting 21:21:10 (3768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:49:01 (4636): No heartbeat from core client for 30 sec - exiting 21:49:02 (4636): No heartbeat from core client for 30 sec - exiting 21:49:03 (4636): No heartbeat from core client for 30 sec - exiting 21:49:04 (4636): No heartbeat from core client for 30 sec - exiting 21:49:06 (4636): No heartbeat from core client for 30 sec - exiting 21:49:07 (4636): No heartbeat from core client for 30 sec - exiting 21:49:08 (4636): No heartbeat from core client for 30 sec - exiting 21:49:09 (4636): No heartbeat from core client for 30 sec - exiting 21:49:10 (4636): No heartbeat from core client for 30 sec - exiting 21:49:11 (4636): No heartbeat from core client for 30 sec - exiting 21:49:12 (4636): No heartbeat from core client for 30 sec - exiting 21:49:14 (4636): No heartbeat from core client for 30 sec - exiting 21:49:15 (4636): No heartbeat from core client for 30 sec - exiting 21:49:16 (4636): No heartbeat from core client for 30 sec - exiting 21:49:17 (4636): No heartbeat from core client for 30 sec - exiting 21:49:18 (4636): No heartbeat from core client for 30 sec - exiting 21:49:19 (4636): No heartbeat from core client for 30 sec - exiting 21:49:20 (4636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:51:38 (1180): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:43:32 (5504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:05:40 (5944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:05:41 (5944): No heartbeat from core client for 30 sec - exiting 12:05:42 (5944): No heartbeat from core client for 30 sec - exiting 12:05:43 (5944): No heartbeat from core client for 30 sec - exiting 12:05:44 (5944): No heartbeat from core client for 30 sec - exiting 12:05:46 (5944): No heartbeat from core client for 30 sec - exiting 12:05:47 (5944): No heartbeat from core client for 30 sec - exiting 12:05:48 (5944): No heartbeat from core client for 30 sec - exiting 12:05:49 (5944): No heartbeat from core client for 30 sec - exiting 12:05:50 (5944): No heartbeat from core client for 30 sec - exiting 12:05:51 (5944): No heartbeat from core client for 30 sec - exiting 12:05:52 (5944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:35:15 (3836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:35:51 (4852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:36:46 (3064): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... 19:54:02 (5728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:55:02 (4132): No heartbeat from core client for 30 sec - exiting 19:55:03 (4132): No heartbeat from core client for 30 sec - exiting 19:55:04 (4132): No heartbeat from core client for 30 sec - exiting 19:55:05 (4132): No heartbeat from core client for 30 sec - exiting 19:55:07 (4132): No heartbeat from core client for 30 sec - exiting 19:55:08 (4132): No heartbeat from core client for 30 sec - exiting 19:55:09 (4132): No heartbeat from core client for 30 sec - exiting 19:55:10 (4132): No heartbeat from core client for 30 sec - exiting 19:55:11 (4132): No heartbeat from core client for 30 sec - exiting 19:55:12 (4132): No heartbeat from core client for 30 sec - exiting 19:55:13 (4132): No heartbeat from core client for 30 sec - exiting 19:55:14 (4132): No heartbeat from core client for 30 sec - exiting 19:55:15 (4132): No heartbeat from core client for 30 sec - exiting 19:55:16 (4132): No heartbeat from core client for 30 sec - exiting 19:55:18 (4132): No heartbeat from core client for 30 sec - exiting 19:55:19 (4132): No heartbeat from core client for 30 sec - exiting 19:55:21 (4132): No heartbeat from core client for 30 sec - exiting 19:55:22 (4132): No heartbeat from core client for 30 sec - exiting 19:55:24 (4132): No heartbeat from core client for 30 sec - exiting 19:55:25 (4132): No heartbeat from core client for 30 sec - exiting 19:55:26 (4132): No heartbeat from core client for 30 sec - exiting 19:55:27 (4132): No heartbeat from core client for 30 sec - exiting 19:55:28 (4132): No heartbeat from core client for 30 sec - exiting 19:55:29 (4132): No heartbeat from core client for 30 sec - exiting 19:55:30 (4132): No heartbeat from core client for 30 sec - exiting 19:55:31 (4132): No heartbeat from core client for 30 sec - exiting 19:55:32 (4132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:57:52 (1588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5184, selfPID=5184, iMonCtr=2 19:59:03 (5552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:21:25 (1776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:21:26 (1776): No heartbeat from core client for 30 sec - exiting 20:21:27 (1776): No heartbeat from core client for 30 sec - exiting 20:21:28 (1776): No heartbeat from core client for 30 sec - exiting 20:21:29 (1776): No heartbeat from core client for 30 sec - exiting 20:21:30 (1776): No heartbeat from core client for 30 sec - exiting 20:24:57 (5736): No heartbeat from core client for 30 sec - exiting 20:24:59 (5736): No heartbeat from core client for 30 sec - exiting 20:25:00 (5736): No heartbeat from core client for 30 sec - exiting 20:25:01 (5736): No heartbeat from core client for 30 sec - exiting 20:25:02 (5736): No heartbeat from core client for 30 sec - exiting 20:25:03 (5736): No heartbeat from core client for 30 sec - exiting 20:25:04 (5736): No heartbeat from core client for 30 sec - exiting 20:25:05 (5736): No heartbeat from core client for 30 sec - exiting 20:25:06 (5736): No heartbeat from core client for 30 sec - exiting 20:25:07 (5736): No heartbeat from core client for 30 sec - exiting 20:25:08 (5736): No heartbeat from core client for 30 sec - exiting 20:25:09 (5736): No heartbeat from core client for 30 sec - exiting 20:25:11 (5736): No heartbeat from core client for 30 sec - exiting 20:25:12 (5736): No heartbeat from core client for 30 sec - exiting 20:25:13 (5736): No heartbeat from core client for 30 sec - exiting 20:25:14 (5736): No heartbeat from core client for 30 sec - exiting 20:25:15 (5736): No heartbeat from core client for 30 sec - exiting 20:25:21 (5736): No heartbeat from core client for 30 sec - exiting 20:25:22 (5736): No heartbeat from core client for 30 sec - exiting 20:25:23 (5736): No heartbeat from core client for 30 sec - exiting 20:25:25 (5736): No heartbeat from core client for 30 sec - exiting 20:25:26 (5736): No heartbeat from core client for 30 sec - exiting 20:25:27 (5736): No heartbeat from core client for 30 sec - exiting 20:25:28 (5736): No heartbeat from core client for 30 sec - exiting 20:25:29 (5736): No heartbeat from core client for 30 sec - exiting 20:25:30 (5736): No heartbeat from core client for 30 sec - exiting 20:25:31 (5736): No heartbeat from core client for 30 sec - exiting 20:25:32 (5736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:39:12 (648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3604, selfPID=3604, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5188, selfPID=5188, iMonCtr=2 09:54:30 (5052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3860, selfPID=4172, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 17:06:45 (5064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6024, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4868, selfPID=4868, iMonCtr=2 21:51:23 (7724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5836, selfPID=5836, iMonCtr=2 21:51:28 (7724): No heartbeat from core client for 30 sec - exiting 21:51:29 (7724): No heartbeat from core client for 30 sec - exiting 21:51:30 (7724): No heartbeat from core client for 30 sec - exiting 02:49:24 (7456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:50:30 (6008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:52:07 (5596): No heartbeat from core client for 30 sec - exiting 02:52:26 (5596): No heartbeat from core client for 30 sec - exiting 02:52:27 (5596): No heartbeat from core client for 30 sec - exiting 02:52:28 (5596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:33:15 (4244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:33:19 (4244): No heartbeat from core client for 30 sec - exiting 20:33:20 (4244): No heartbeat from core client for 30 sec - exiting 20:33:21 (4244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 23:38:23 (1740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:38:26 (1740): No heartbeat from core client for 30 sec - exiting 23:38:27 (1740): No heartbeat from core client for 30 sec - exiting 23:38:28 (1740): No heartbeat from core client for 30 sec - exiting 23:38:29 (1740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2004, selfPID=2004, iMonCtr=2 10:35:35 (4296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:32:33 (4592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:34:17 (6116): No heartbeat from core client for 30 sec - exiting 18:34:19 (6116): No heartbeat from core client for 30 sec - exiting 18:34:20 (6116): No heartbeat from core client for 30 sec - exiting 18:34:24 (6116): No heartbeat from core client for 30 sec - exiting 18:34:25 (6116): No heartbeat from core client for 30 sec - exiting 18:34:39 (6116): No heartbeat from core client for 30 sec - exiting 18:34:40 (6116): No heartbeat from core client for 30 sec - exiting 18:34:43 (6116): No heartbeat from core client for 30 sec - exiting 18:34:44 (6116): No heartbeat from core client for 30 sec - exiting 18:34:46 (6116): No heartbeat from core client for 30 sec - exiting 18:34:48 (6116): No heartbeat from core client for 30 sec - exiting 18:34:50 (6116): No heartbeat from core client for 30 sec - exiting 18:34:51 (6116): No heartbeat from core client for 30 sec - exiting 18:34:54 (6116): No heartbeat from core client for 30 sec - exiting 18:34:55 (6116): No heartbeat from core client for 30 sec - exiting 18:34:56 (6116): No heartbeat from core client for 30 sec - exiting 18:34:57 (6116): No heartbeat from core client for 30 sec - exiting 18:34:58 (6116): No heartbeat from core client for 30 sec - exiting 18:35:00 (6116): No heartbeat from core client for 30 sec - exiting 18:35:01 (6116): No heartbeat from core client for 30 sec - exiting 18:35:02 (6116): No heartbeat from core client for 30 sec - exiting 18:35:03 (6116): No heartbeat from core client for 30 sec - exiting 18:35:04 (6116): No heartbeat from core client for 30 sec - exiting 18:35:05 (6116): No heartbeat from core client for 30 sec - exiting 18:35:06 (6116): No heartbeat from core client for 30 sec - exiting 18:35:07 (6116): No heartbeat from core client for 30 sec - exiting 18:35:08 (6116): No heartbeat from core client for 30 sec - exiting 18:35:10 (6116): No heartbeat from core client for 30 sec - exiting 18:35:11 (6116): No heartbeat from core client for 30 sec - exiting 18:35:30 (6116): No heartbeat from core client for 30 sec - exiting 18:35:31 (6116): No heartbeat from core client for 30 sec - exiting 18:35:32 (6116): No heartbeat from core client for 30 sec - exiting 18:35:33 (6116): No heartbeat from core client for 30 sec - exiting 18:35:34 (6116): No heartbeat from core client for 30 sec - exiting 18:35:36 (6116): No heartbeat from core client for 30 sec - exiting 18:35:37 (6116): No heartbeat from core client for 30 sec - exiting 18:35:38 (6116): No heartbeat from core client for 30 sec - exiting 18:35:42 (6116): No heartbeat from core client for 30 sec - exiting 18:35:43 (6116): No heartbeat from core client for 30 sec - exiting 18:35:44 (6116): No heartbeat from core client for 30 sec - exiting 18:35:46 (6116): No heartbeat from core client for 30 sec - exiting 18:36:01 (6116): No heartbeat from core client for 30 sec - exiting 18:36:03 (6116): No heartbeat from core client for 30 sec - exiting 18:36:04 (6116): No heartbeat from core client for 30 sec - exiting 18:36:05 (6116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:49:40 (4576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:49:45 (4576): No heartbeat from core client for 30 sec - exiting 16:49:46 (4576): No heartbeat from core client for 30 sec - exiting 16:49:47 (4576): No heartbeat from core client for 30 sec - exiting 16:49:48 (4576): No heartbeat from core client for 30 sec - exiting 16:49:49 (4576): No heartbeat from core client for 30 sec - exiting 16:49:50 (4576): No heartbeat from core client for 30 sec - exiting 16:49:51 (4576): No heartbeat from core client for 30 sec - exiting 16:49:52 (4576): No heartbeat from core client for 30 sec - exiting 16:49:53 (4576): No heartbeat from core client for 30 sec - exiting 16:49:54 (4576): No heartbeat from core client for 30 sec - exiting 16:49:55 (4576): No heartbeat from core client for 30 sec - exiting 16:49:56 (4576): No heartbeat from core client for 30 sec - exiting 16:50:00 (5632): Can't acquire lockfile (32) - waiting 35s 16:51:11 (5632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:53:25 (3124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:53:29 (3124): No heartbeat from core client for 30 sec - exiting 16:53:30 (3124): No heartbeat from core client for 30 sec - exiting 16:53:31 (3124): No heartbeat from core client for 30 sec - exiting 16:53:32 (3124): No heartbeat from core client for 30 sec - exiting 16:54:05 (4988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:14:53 (3272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:28:18 (4816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8552, selfPID=5088, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 16:58:59 (3148): No heartbeat from core client for 30 sec - exiting 16:59:01 (3148): No heartbeat from core client for 30 sec - exiting 16:59:02 (3148): No heartbeat from core client for 30 sec - exiting 16:59:03 (3148): No heartbeat from core client for 30 sec - exiting 16:59:04 (3148): No heartbeat from core client for 30 sec - exiting 16:59:05 (3148): No heartbeat from core client for 30 sec - exiting 16:59:07 (3148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:19:26 (5920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:21:08 (6268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:21:10 (6268): No heartbeat from core client for 30 sec - exiting 09:21:11 (6268): No heartbeat from core client for 30 sec - exiting 09:21:12 (6268): No heartbeat from core client for 30 sec - exiting 09:21:13 (6268): No heartbeat from core client for 30 sec - exiting 09:21:14 (6268): No heartbeat from core client for 30 sec - exiting 12:41:55 (4920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:16:46 (7648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:30:47 (6044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:58:19 (6392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:58:23 (6392): No heartbeat from core client for 30 sec - exiting 20:58:24 (6392): No heartbeat from core client for 30 sec - exiting 20:58:25 (6392): No heartbeat from core client for 30 sec - exiting 20:58:26 (6392): No heartbeat from core client for 30 sec - exiting 20:58:27 (6392): No heartbeat from core client for 30 sec - exiting 20:58:28 (6392): No heartbeat from core client for 30 sec - exiting 20:58:29 (6392): No heartbeat from core client for 30 sec - exiting 20:58:30 (6392): No heartbeat from core client for 30 sec - exiting 20:58:31 (6392): No heartbeat from core client for 30 sec - exiting 20:58:32 (6392): No heartbeat from core client for 30 sec - exiting 20:58:33 (6392): No heartbeat from core client for 30 sec - exiting 20:58:34 (6392): No heartbeat from core client for 30 sec - exiting 20:58:35 (6392): No heartbeat from core client for 30 sec - exiting 20:58:36 (6392): No heartbeat from core client for 30 sec - exiting 20:58:37 (6392): No heartbeat from core client for 30 sec - exiting 20:58:38 (6392): No heartbeat from core client for 30 sec - exiting 20:58:39 (6392): No heartbeat from core client for 30 sec - exiting 20:58:40 (6392): No heartbeat from core client for 30 sec - exiting 20:58:41 (6392): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8480, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4788, selfPID=4244, iMonCtr=1 Model crash detected, will try to restart... 16:43:21 (2196): No heartbeat from core client for 30 sec - exiting 16:43:23 (2196): No heartbeat from core client for 30 sec - exiting 16:43:24 (2196): No heartbeat from core client for 30 sec - exiting 16:43:25 (2196): No heartbeat from core client for 30 sec - exiting 16:43:26 (2196): No heartbeat from core client for 30 sec - exiting 16:43:27 (2196): No heartbeat from core client for 30 sec - exiting 16:43:28 (2196): No heartbeat from core client for 30 sec - exiting 16:43:29 (2196): No heartbeat from core client for 30 sec - exiting 16:43:30 (2196): No heartbeat from core client for 30 sec - exiting 16:43:31 (2196): No heartbeat from core client for 30 sec - exiting 16:43:32 (2196): No heartbeat from core client for 30 sec - exiting 16:43:33 (2196): No heartbeat from core client for 30 sec - exiting 16:43:35 (2196): No heartbeat from core client for 30 sec - exiting 16:43:36 (2196): No heartbeat from core client for 30 sec - exiting 16:43:37 (2196): No heartbeat from core client for 30 sec - exiting 16:43:38 (2196): No heartbeat from core client for 30 sec - exiting 16:43:39 (2196): No heartbeat from core client for 30 sec - exiting 16:43:40 (2196): No heartbeat from core client for 30 sec - exiting 16:43:41 (2196): No heartbeat from core client for 30 sec - exiting 16:43:42 (2196): No heartbeat from core client for 30 sec - exiting 16:43:43 (2196): No heartbeat from core client for 30 sec - exiting 16:43:44 (2196): No heartbeat from core client for 30 sec - exiting 16:43:45 (2196): No heartbeat from core client for 30 sec - exiting 16:43:47 (2196): No heartbeat from core client for 30 sec - exiting 16:43:48 (2196): No heartbeat from core client for 30 sec - exiting 16:43:49 (2196): No heartbeat from core client for 30 sec - exiting 16:43:50 (2196): No heartbeat from core client for 30 sec - exiting 16:43:51 (2196): No heartbeat from core client for 30 sec - exiting 16:43:52 (2196): No heartbeat from core client for 30 sec - exiting 16:43:53 (2196): No heartbeat from core client for 30 sec - exiting 16:43:54 (2196): No heartbeat from core client for 30 sec - exiting 16:43:55 (2196): No heartbeat from core client for 30 sec - exiting 16:43:56 (2196): No heartbeat from core client for 30 sec - exiting 16:43:57 (2196): No heartbeat from core client for 30 sec - exiting 16:43:59 (2196): No heartbeat from core client for 30 sec - exiting 16:44:00 (2196): No heartbeat from core client for 30 sec - exiting 16:44:01 (2196): No heartbeat from core client for 30 sec - exiting 16:44:02 (2196): No heartbeat from core client for 30 sec - exiting 16:44:03 (2196): No heartbeat from core client for 30 sec - exiting 16:44:04 (2196): No heartbeat from core client for 30 sec - exiting 16:44:05 (2196): No heartbeat from core client for 30 sec - exiting 16:44:06 (2196): No heartbeat from core client for 30 sec - exiting 16:44:07 (2196): No heartbeat from core client for 30 sec - exiting 16:44:08 (2196): No heartbeat from core client for 30 sec - exiting 16:44:10 (2196): No heartbeat from core client for 30 sec - exiting 16:44:11 (2196): No heartbeat from core client for 30 sec - exiting 16:44:12 (2196): No heartbeat from core client for 30 sec - exiting 16:44:13 (2196): No heartbeat from core client for 30 sec - exiting 16:44:14 (2196): No heartbeat from core client for 30 sec - exiting 16:44:15 (2196): No heartbeat from core client for 30 sec - exiting 16:44:16 (2196): No heartbeat from core client for 30 sec - exiting 16:44:17 (2196): No heartbeat from core client for 30 sec - exiting 16:44:18 (2196): No heartbeat from core client for 30 sec - exiting 16:44:19 (2196): No heartbeat from core client for 30 sec - exiting 16:44:20 (2196): No heartbeat from core client for 30 sec - exiting 16:44:22 (2196): No heartbeat from core client for 30 sec - exiting 16:44:23 (2196): No heartbeat from core client for 30 sec - exiting 16:44:24 (2196): No heartbeat from core client for 30 sec - exiting 16:44:25 (2196): No heartbeat from core client for 30 sec - exiting 16:44:26 (2196): No heartbeat from core client for 30 sec - exiting 16:44:27 (2196): No heartbeat from core client for 30 sec - exiting 16:44:28 (2196): No heartbeat from core client for 30 sec - exiting 16:44:29 (2196): No heartbeat from core client for 30 sec - exiting 16:44:30 (2196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:44:31 (2196): No heartbeat from core client for 30 sec - exiting 21:17:19 (1992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:13:01 (4348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:13:02 (4348): No heartbeat from core client for 30 sec - exiting 02:13:38 (9916): No heartbeat from core client for 30 sec - exiting 02:13:40 (9916): No heartbeat from core client for 30 sec - exiting 02:13:41 (9916): No heartbeat from core client for 30 sec - exiting 02:13:44 (9916): No heartbeat from core client for 30 sec - exiting 02:13:45 (9916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:51:51 (2080): No heartbeat from core client for 30 sec - exiting 16:51:52 (2080): No heartbeat from core client for 30 sec - exiting 16:51:53 (2080): No heartbeat from core client for 30 sec - exiting 16:51:54 (2080): No heartbeat from core client for 30 sec - exiting 16:51:55 (2080): No heartbeat from core client for 30 sec - exiting 16:51:56 (2080): No heartbeat from core client for 30 sec - exiting 16:51:57 (2080): No heartbeat from core client for 30 sec - exiting 16:51:58 (2080): No heartbeat from core client for 30 sec - exiting 16:51:59 (2080): No heartbeat from core client for 30 sec - exiting 16:52:00 (2080): No heartbeat from core client for 30 sec - exiting 16:52:02 (2080): No heartbeat from core client for 30 sec - exiting 16:52:03 (2080): No heartbeat from core client for 30 sec - exiting 16:52:04 (2080): No heartbeat from core client for 30 sec - exiting 16:52:05 (2080): No heartbeat from core client for 30 sec - exiting 16:52:06 (2080): No heartbeat from core client for 30 sec - exiting 16:52:07 (2080): No heartbeat from core client for 30 sec - exiting 16:52:08 (2080): No heartbeat from core client for 30 sec - exiting 16:52:09 (2080): No heartbeat from core client for 30 sec - exiting 16:52:10 (2080): No heartbeat from core client for 30 sec - exiting 16:52:11 (2080): No heartbeat from core client for 30 sec - exiting 16:52:12 (2080): No heartbeat from core client for 30 sec - exiting 16:52:14 (2080): No heartbeat from core client for 30 sec - exiting 16:52:15 (2080): No heartbeat from core client for 30 sec - exiting 16:52:16 (2080): No heartbeat from core client for 30 sec - exiting 16:52:17 (2080): No heartbeat from core client for 30 sec - exiting 16:52:18 (2080): No heartbeat from core client for 30 sec - exiting 16:52:19 (2080): No heartbeat from core client for 30 sec - exiting 16:52:20 (2080): No heartbeat from core client for 30 sec - exiting 16:52:21 (2080): No heartbeat from core client for 30 sec - exiting 16:52:22 (2080): No heartbeat from core client for 30 sec - exiting 16:52:23 (2080): No heartbeat from core client for 30 sec - exiting 16:52:24 (2080): No heartbeat from core client for 30 sec - exiting 16:52:26 (2080): No heartbeat from core client for 30 sec - exiting 16:52:27 (2080): No heartbeat from core client for 30 sec - exiting 16:52:28 (2080): No heartbeat from core client for 30 sec - exiting 16:52:29 (2080): No heartbeat from core client for 30 sec - exiting 16:52:30 (2080): No heartbeat from core client for 30 sec - exiting 16:52:31 (2080): No heartbeat from core client for 30 sec - exiting 16:52:32 (2080): No heartbeat from core client for 30 sec - exiting 16:52:33 (2080): No heartbeat from core client for 30 sec - exiting 16:52:34 (2080): No heartbeat from core client for 30 sec - exiting 16:52:35 (2080): No heartbeat from core client for 30 sec - exiting 16:52:36 (2080): No heartbeat from core client for 30 sec - exiting 16:52:38 (2080): No heartbeat from core client for 30 sec - exiting 16:52:39 (2080): No heartbeat from core client for 30 sec - exiting 16:52:40 (2080): No heartbeat from core client for 30 sec - exiting 16:52:41 (2080): No heartbeat from core client for 30 sec - exiting 16:52:42 (2080): No heartbeat from core client for 30 sec - exiting 16:52:43 (2080): No heartbeat from core client for 30 sec - exiting 16:52:44 (2080): No heartbeat from core client for 30 sec - exiting 16:52:45 (2080): No heartbeat from core client for 30 sec - exiting 16:52:46 (2080): No heartbeat from core client for 30 sec - exiting 16:52:47 (2080): No heartbeat from core client for 30 sec - exiting 16:52:49 (2080): No heartbeat from core client for 30 sec - exiting 16:52:50 (2080): No heartbeat from core client for 30 sec - exiting 16:52:51 (2080): No heartbeat from core client for 30 sec - exiting 16:52:52 (2080): No heartbeat from core client for 30 sec - exiting 16:52:53 (2080): No heartbeat from core client for 30 sec - exiting 16:52:54 (2080): No heartbeat from core client for 30 sec - exiting 16:52:55 (2080): No heartbeat from core client for 30 sec - exiting 16:52:56 (2080): No heartbeat from core client for 30 sec - exiting 16:52:57 (2080): No heartbeat from core client for 30 sec - exiting 16:52:58 (2080): No heartbeat from core client for 30 sec - exiting 16:52:59 (2080): No heartbeat from core client for 30 sec - exiting 16:53:01 (2080): No heartbeat from core client for 30 sec - exiting 16:53:02 (2080): No heartbeat from core client for 30 sec - exiting 16:53:03 (2080): No heartbeat from core client for 30 sec - exiting 16:53:04 (2080): No heartbeat from core client for 30 sec - exiting 16:53:05 (2080): No heartbeat from core client for 30 sec - exiting 16:53:06 (2080): No heartbeat from core client for 30 sec - exiting 16:53:07 (2080): No heartbeat from core client for 30 sec - exiting 16:53:08 (2080): No heartbeat from core client for 30 sec - exiting 16:53:09 (2080): No heartbeat from core client for 30 sec - exiting 16:53:10 (2080): No heartbeat from core client for 30 sec - exiting 16:53:11 (2080): No heartbeat from core client for 30 sec - exiting 16:53:13 (2080): No heartbeat from core client for 30 sec - exiting 16:53:14 (2080): No heartbeat from core client for 30 sec - exiting 16:53:15 (2080): No heartbeat from core client for 30 sec - exiting 16:53:16 (2080): No heartbeat from core client for 30 sec - exiting 16:53:17 (2080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:10:47 (7580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:10:51 (7580): No heartbeat from core client for 30 sec - exiting 17:10:52 (7580): No heartbeat from core client for 30 sec - exiting 17:10:53 (7580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 10:36:26 (5164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:14:43 (4700): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 16:14:44 (4700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:01:52 (4968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:02:55 (6572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Dec 2012 21:32:07	1167915	14799725	hadam3p_pnw_axve_1962_1_008002345_1	138,336	1,419,622	10.2621
20 Dec 2012 04:15:12	1167915	14799725	hadam3p_pnw_axve_1962_1_008002345_1	126,819	1,309,687	10.3272
19 Dec 2012 20:42:13	1167915	14799725	hadam3p_pnw_axve_1962_1_008002345_1	126,817	1,309,027	10.3222
19 Dec 2012 18:09:27	1167915	14799725	hadam3p_pnw_axve_1962_1_008002345_1	126,816	1,308,008	10.3142
07 Dec 2012 15:33:09	1167915	14799725	hadam3p_pnw_axve_1962_1_008002345_1	115,297	1,195,029	10.3648
07 Dec 2012 13:27:47	1167915	14799725	hadam3p_pnw_axve_1962_1_008002345_1	115,296	1,193,699	10.3533
03 Dec 2012 05:08:39	1167915	14799725	hadam3p_pnw_axve_1962_1_008002345_1	103,776	1,073,046	10.3400
28 Nov 2012 19:14:59	1167915	14799725	hadam3p_pnw_axve_1962_1_008002345_1	92,257	947,864	10.2742
28 Nov 2012 03:45:40	1167915	14799725	hadam3p_pnw_axve_1962_1_008002345_1	92,256	947,131	10.2663
10 Nov 2012 15:26:47	1167915	14799725	hadam3p_pnw_axve_1962_1_008002345_1	80,736	830,085	10.2815
04 Nov 2012 12:36:09	1167915	14799725	hadam3p_pnw_axve_1962_1_008002345_1	69,216	722,246	10.4347
25 Oct 2012 23:12:02	1167915	14799725	hadam3p_pnw_axve_1962_1_008002345_1	57,696	604,934	10.4849
25 Aug 2012 11:50:22	1167915	14799725	hadam3p_pnw_axve_1962_1_008002345_1	46,176	524,747	11.3641
08 Aug 2012 04:10:55	1167915	14799725	hadam3p_pnw_axve_1962_1_008002345_1	34,657	379,733	10.9569
08 Aug 2012 01:55:37	1167915	14799725	hadam3p_pnw_axve_1962_1_008002345_1	34,656	378,462	10.9205
17 Jul 2012 11:45:55	1167915	14799725	hadam3p_pnw_axve_1962_1_008002345_1	23,247	253,726	10.9144
17 Jul 2012 08:50:20	1167915	14799725	hadam3p_pnw_axve_1962_1_008002345_1	23,234	250,770	10.7932
17 Jul 2012 05:24:38	1167915	14799725	hadam3p_pnw_axve_1962_1_008002345_1	23,206	247,641	10.6714
16 Jul 2012 13:27:22	1167915	14799725	hadam3p_pnw_axve_1962_1_008002345_1	23,136	245,878	10.6275
02 Jul 2012 14:38:20	1167915	14799725	hadam3p_pnw_axve_1962_1_008002345_1	11,616	117,389	10.1058