Task 14337064

Name	hadam3p_pnw_2uvu_1976_1_007851778_0
Workunit	8006890
Created	1 Apr 2012, 11:50:44 UTC
Sent	1 Apr 2012, 11:50:47 UTC
Report deadline	14 Mar 2013, 17:10:47 UTC
Received	30 May 2012, 18:39:11 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	871942
Run time	12 days 19 hours 39 min 23 sec
CPU time	10 days 6 hours 13 min 15 sec
Validate state	Workunit error - check skipped
Credit	3,006.05
Device peak FLOPS	1.44 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <stderr_txt> Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1984, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5988, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4972, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1160, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4728, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4864, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5100, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4248, selfPID=4264, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4896, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6012, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4300, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4928, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4372, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2360, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4148, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5132, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4416, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1484, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3904, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4068, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2904, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5464, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5348, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4816, selfPID=6024, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3440, selfPID=552, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1636, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3860, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6088, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5732, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 3 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5680, selfPID=4752, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2928, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4344, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 3 11:32:37 (5932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:32:40 (5932): No heartbeat from core client for 30 sec - exiting 11:32:41 (5932): No heartbeat from core client for 30 sec - exiting 11:32:42 (5932): No heartbeat from core client for 30 sec - exiting 11:32:43 (5932): No heartbeat from core client for 30 sec - exiting 11:32:44 (5932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3484, selfPID=3484, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5168, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 3 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4040, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5488, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1884, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 4 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5412, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4496, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4240, iMonCtr=2 Model crash detected, will try to restart... Clobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPontIolleD:=0, selfPI:=5860, iCPMN process io not runningn eCtr=2 xiting, bRetVal = 1, checkPID=0, selfPID=5448, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 5 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3604, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3176, iMonCtr=2 Model crash detected, will try to restart... 07:34:30 (5832): No heartbeat from core client for 30 sec - exiting 07:34:32 (5832): No heartbeat from core client for 30 sec - exiting 07:34:33 (5832): No heartbeat from core client for 30 sec - exiting 07:34:34 (5832): No heartbeat from core client for 30 sec - exiting 07:34:36 (5832): No heartbeat from core client for 30 sec - exiting 07:34:37 (5832): No heartbeat from core client for 30 sec - exiting 07:34:39 (5832): No heartbeat from core client for 30 sec - exiting 07:34:40 (5832): No heartbeat from core client for 30 sec - exiting 07:34:41 (5832): No heartbeat from core client for 30 sec - exiting 07:34:42 (5832): No heartbeat from core client for 30 sec - exiting 07:34:44 (5832): No heartbeat from core client for 30 sec - exiting 07:34:45 (5832): No heartbeat from core client for 30 sec - exiting 07:34:46 (5832): No heartbeat from core client for 30 sec - exiting 07:34:48 (5832): No heartbeat from core client for 30 sec - exiting 07:34:49 (5832): No heartbeat from core client for 30 sec - exiting 07:34:51 (5832): No heartbeat from core client for 30 sec - exiting 07:34:53 (5832): No heartbeat from core client for 30 sec - exiting 07:34:54 (5832): No heartbeat from core client for 30 sec - exiting 07:34:57 (5832): No heartbeat from core client for 30 sec - exiting 07:34:59 (5832): No heartbeat from core client for 30 sec - exiting 07:35:03 (5832): No heartbeat from core client for 30 sec - exiting 07:35:04 (5832): No heartbeat from core client for 30 sec - exiting 07:35:05 (5832): No heartbeat from core client for 30 sec - exiting 07:35:06 (5832): No heartbeat from core client for 30 sec - exiting 07:35:08 (5832): No heartbeat from core client for 30 sec - exiting 07:35:09 (5832): No heartbeat from core client for 30 sec - exiting 07:35:10 (5832): No heartbeat from core client for 30 sec - exiting 07:35:11 (5832): No heartbeat from core client for 30 sec - exiting 07:35:12 (5832): No heartbeat from core client for 30 sec - exiting 07:35:13 (5832): No heartbeat from core client for 30 sec - exiting 07:35:14 (5832): No heartbeat from core client for 30 sec - exiting 07:35:15 (5832): No heartbeat from core client for 30 sec - exiting 07:35:16 (5832): No heartbeat from core client for 30 sec - exiting 07:35:17 (5832): No heartbeat from core client for 30 sec - exiting 07:35:18 (5832): No heartbeat from core client for 30 sec - exiting 07:35:19 (5832): No heartbeat from core client for 30 sec - exiting 07:35:20 (5832): No heartbeat from core client for 30 sec - exiting 07:35:21 (5832): No heartbeat from core client for 30 sec - exiting 07:35:22 (5832): No heartbeat from core client for 30 sec - exiting 07:35:23 (5832): No heartbeat from core client for 30 sec - exiting 07:35:24 (5832): No heartbeat from core client for 30 sec - exiting 07:35:26 (5832): No heartbeat from core client for 30 sec - exiting 07:35:27 (5832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:39:40 (2444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4480, selfPID=4480, iMonCtr=2 07:40:16 (3524): No heartbeat from core client for 30 sec - exiting 07:40:17 (3524): No heartbeat from core client for 30 sec - exiting 07:40:18 (3524): No heartbeat from core client for 30 sec - exiting 07:40:19 (3524): No heartbeat from core client for 30 sec - exiting 07:40:20 (3524): No heartbeat from core client for 30 sec - exiting 07:40:21 (3524): No heartbeat from core client for 30 sec - exiting 07:40:22 (3524): No heartbeat from core client for 30 sec - exiting 07:40:23 (3524): No heartbeat from core client for 30 sec - exiting 07:40:24 (3524): No heartbeat from core client for 30 sec - exiting 07:40:25 (3524): No heartbeat from core client for 30 sec - exiting 07:40:26 (3524): No heartbeat from core client for 30 sec - exiting 07:40:27 (3524): No heartbeat from core client for 30 sec - exiting 07:40:28 (3524): No heartbeat from core client for 30 sec - exiting 07:40:29 (3524): No heartbeat from core client for 30 sec - exiting 07:40:30 (3524): No heartbeat from core client for 30 sec - exiting 07:40:31 (3524): No heartbeat from core client for 30 sec - exiting 07:40:32 (3524): No heartbeat from core client for 30 sec - exiting 07:40:33 (3524): No heartbeat from core client for 30 sec - exiting 07:40:34 (3524): No heartbeat from core client for 30 sec - exiting 07:40:35 (3524): No heartbeat from core client for 30 sec - exiting 07:40:36 (3524): No heartbeat from core client for 30 sec - exiting 07:40:37 (3524): No heartbeat from core client for 30 sec - exiting 07:40:38 (3524): No heartbeat from core client for 30 sec - exiting 07:40:39 (3524): No heartbeat from core client for 30 sec - exiting 07:40:40 (3524): No heartbeat from core client for 30 sec - exiting 07:40:42 (3524): No heartbeat from core client for 30 sec - exiting 07:40:43 (3524): No heartbeat from core client for 30 sec - exiting 07:40:44 (3524): No heartbeat from core client for 30 sec - exiting 07:40:45 (3524): No heartbeat from core client for 30 sec - exiting 07:40:47 (3524): No heartbeat from core client for 30 sec - exiting 07:40:53 (3524): No heartbeat from core client for 30 sec - exiting 07:40:58 (3524): No heartbeat from core client for 30 sec - exiting 07:40:59 (3524): No heartbeat from core client for 30 sec - exiting 07:41:00 (3524): No heartbeat from core client for 30 sec - exiting 07:41:01 (3524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5564, iMonCtr=2 Model crash detected, will try to restart... 20:47:49 (5728): No heartbeat from core client for 30 sec - exiting 20:47:50 (5728): No heartbeat from core client for 30 sec - exiting 20:47:51 (5728): No heartbeat from core client for 30 sec - exiting 20:47:52 (5728): No heartbeat from core client for 30 sec - exiting 20:47:53 (5728): No heartbeat from core client for 30 sec - exiting 20:47:54 (5728): No heartbeat from core client for 30 sec - exiting 20:47:55 (5728): No heartbeat from core client for 30 sec - exiting 20:47:56 (5728): No heartbeat from core client for 30 sec - exiting 20:47:57 (5728): No heartbeat from core client for 30 sec - exiting 20:47:58 (5728): No heartbeat from core client for 30 sec - exiting 20:47:59 (5728): No heartbeat from core client for 30 sec - exiting 20:48:00 (5728): No heartbeat from core client for 30 sec - exiting 20:48:01 (5728): No heartbeat from core client for 30 sec - exiting 20:48:02 (5728): No heartbeat from core client for 30 sec - exiting 20:48:03 (5728): No heartbeat from core client for 30 sec - exiting 20:48:04 (5728): No heartbeat from core client for 30 sec - exiting 20:48:05 (5728): No heartbeat from core client for 30 sec - exiting 20:48:06 (5728): No heartbeat from core client for 30 sec - exiting 20:48:07 (5728): No heartbeat from core client for 30 sec - exiting 20:48:08 (5728): No heartbeat from core client for 30 sec - exiting 20:48:09 (5728): No heartbeat from core client for 30 sec - exiting 20:48:10 (5728): No heartbeat from core client for 30 sec - exiting 20:48:11 (5728): No heartbeat from core client for 30 sec - exiting 20:48:12 (5728): No heartbeat from core client for 30 sec - exiting 20:48:13 (5728): No heartbeat from core client for 30 sec - exiting 20:48:14 (5728): No heartbeat from core client for 30 sec - exiting 20:48:15 (5728): No heartbeat from core client for 30 sec - exiting 20:48:16 (5728): No heartbeat from core client for 30 sec - exiting 20:48:17 (5728): No heartbeat from core client for 30 sec - exiting 20:48:18 (5728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:07:47 (1328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:07:49 (1328): No heartbeat from core client for 30 sec - exiting 21:07:50 (1328): No heartbeat from core client for 30 sec - exiting 21:08:40 (6056): No heartbeat from core client for 30 sec - exiting 21:08:41 (6056): No heartbeat from core client for 30 sec - exiting 21:08:42 (6056): No heartbeat from core client for 30 sec - exiting 21:08:43 (6056): No heartbeat from core client for 30 sec - exiting 21:08:44 (6056): No heartbeat from core client for 30 sec - exiting 21:08:45 (6056): No heartbeat from core client for 30 sec - exiting 21:08:46 (6056): No heartbeat from core client for 30 sec - exiting 21:08:47 (6056): No heartbeat from core client for 30 sec - exiting 21:08:48 (6056): No heartbeat from core client for 30 sec - exiting 21:08:49 (6056): No heartbeat from core client for 30 sec - exiting 21:08:50 (6056): No heartbeat from core client for 30 sec - exiting 21:08:51 (6056): No heartbeat from core client for 30 sec - exiting 21:08:52 (6056): No heartbeat from core client for 30 sec - exiting 21:08:53 (6056): No heartbeat from core client for 30 sec - exiting 21:08:54 (6056): No heartbeat from core client for 30 sec - exiting 21:08:55 (6056): No heartbeat from core client for 30 sec - exiting 21:08:56 (6056): No heartbeat from core client for 30 sec - exiting 21:08:57 (6056): No heartbeat from core client for 30 sec - exiting 21:08:58 (6056): No heartbeat from core client for 30 sec - exiting 21:08:59 (6056): No heartbeat from core client for 30 sec - exiting 21:09:00 (6056): No heartbeat from core client for 30 sec - exiting 21:09:01 (6056): No heartbeat from core client for 30 sec - exiting 21:09:02 (6056): No heartbeat from core client for 30 sec - exiting 21:09:04 (6056): No heartbeat from core client for 30 sec - exiting 21:09:05 (6056): No heartbeat from core client for 30 sec - exiting 21:09:06 (6056): No heartbeat from core client for 30 sec - exiting 21:09:07 (6056): No heartbeat from core client for 30 sec - exiting 21:09:08 (6056): No heartbeat from core client for 30 sec - exiting 21:09:09 (6056): No heartbeat from core client for 30 sec - exiting 21:09:10 (6056): No heartbeat from core client for 30 sec - exiting 21:09:11 (6056): No heartbeat from core client for 30 sec - exiting 21:09:12 (6056): No heartbeat from core client for 30 sec - exiting 21:09:13 (6056): No heartbeat from core client for 30 sec - exiting 21:09:14 (6056): No heartbeat from core client for 30 sec - exiting 21:09:15 (6056): No heartbeat from core client for 30 sec - exiting 21:09:16 (6056): No heartbeat from core client for 30 sec - exiting 21:09:17 (6056): No heartbeat from core client for 30 sec - exiting 21:09:18 (6056): No heartbeat from core client for 30 sec - exiting 21:09:19 (6056): No heartbeat from core client for 30 sec - exiting 21:09:20 (6056): No heartbeat from core client for 30 sec - exiting 21:09:21 (6056): No heartbeat from core client for 30 sec - exiting 21:09:22 (6056): No heartbeat from core client for 30 sec - exiting 21:09:23 (6056): No heartbeat from core client for 30 sec - exiting 21:09:24 (6056): No heartbeat from core client for 30 sec - exiting 21:09:25 (6056): No heartbeat from core client for 30 sec - exiting 21:09:26 (6056): No heartbeat from core client for 30 sec - exiting 21:09:27 (6056): No heartbeat from core client for 30 sec - exiting 21:09:28 (6056): No heartbeat from core client for 30 sec - exiting 21:09:29 (6056): No heartbeat from core client for 30 sec - exiting 21:09:30 (6056): No heartbeat from core client for 30 sec - exiting 21:09:31 (6056): No heartbeat from core client for 30 sec - exiting 21:09:32 (6056): No heartbeat from core client for 30 sec - exiting 21:09:33 (6056): No heartbeat from core client for 30 sec - exiting 21:09:34 (6056): No heartbeat from core client for 30 sec - exiting 21:09:35 (6056): No heartbeat from core client for 30 sec - exiting 21:09:36 (6056): No heartbeat from core client for 30 sec - exiting 21:09:37 (6056): No heartbeat from core client for 30 sec - exiting 21:09:38 (6056): No heartbeat from core client for 30 sec - exiting 21:09:39 (6056): No heartbeat from core client for 30 sec - exiting 21:09:40 (6056): No heartbeat from core client for 30 sec - exiting 21:09:41 (6056): No heartbeat from core client for 30 sec - exiting 21:09:42 (6056): No heartbeat from core client for 30 sec - exiting 21:09:43 (6056): No heartbeat from core client for 30 sec - exiting 21:09:44 (6056): No heartbeat from core client for 30 sec - exiting 21:09:45 (6056): No heartbeat from core client for 30 sec - exiting 21:09:46 (6056): No heartbeat from core client for 30 sec - exiting 21:09:47 (6056): No heartbeat from core client for 30 sec - exiting 21:09:48 (6056): No heartbeat from core client for 30 sec - exiting 21:09:49 (6056): No heartbeat from core client for 30 sec - exiting 21:09:50 (6056): No heartbeat from core client for 30 sec - exiting 21:09:51 (6056): No heartbeat from core client for 30 sec - exiting 21:09:52 (6056): No heartbeat from core client for 30 sec - exiting 21:09:53 (6056): No heartbeat from core client for 30 sec - exiting 21:09:55 (6056): No heartbeat from core client for 30 sec - exiting 21:09:56 (6056): No heartbeat from core client for 30 sec - exiting 21:09:57 (6056): No heartbeat from core client for 30 sec - exiting 21:09:58 (6056): No heartbeat from core client for 30 sec - exiting 21:09:59 (6056): No heartbeat from core client for 30 sec - exiting 21:10:00 (6056): No heartbeat from core client for 30 sec - exiting 21:10:01 (6056): No heartbeat from core client for 30 sec - exiting 21:10:02 (6056): No heartbeat from core client for 30 sec - exiting 21:10:03 (6056): No heartbeat from core client for 30 sec - exiting 21:10:04 (6056): No heartbeat from core client for 30 sec - exiting 21:10:05 (6056): No heartbeat from core client for 30 sec - exiting 21:10:06 (6056): No heartbeat from core client for 30 sec - exiting 21:10:07 (6056): No heartbeat from core client for 30 sec - exiting 21:10:08 (6056): No heartbeat from core client for 30 sec - exiting 21:10:09 (6056): No heartbeat from core client for 30 sec - exiting 21:10:10 (6056): No heartbeat from core client for 30 sec - exiting 21:10:11 (6056): No heartbeat from core client for 30 sec - exiting 21:10:12 (6056): No heartbeat from core client for 30 sec - exiting 21:10:13 (6056): No heartbeat from core client for 30 sec - exiting 21:10:14 (6056): No heartbeat from core client for 30 sec - exiting 21:10:15 (6056): No heartbeat from core client for 30 sec - exiting 21:10:16 (6056): No heartbeat from core client for 30 sec - exiting 21:10:17 (6056): No heartbeat from core client for 30 sec - exiting 21:10:18 (6056): No heartbeat from core client for 30 sec - exiting 21:10:19 (6056): No heartbeat from core client for 30 sec - exiting 21:10:20 (6056): No heartbeat from core client for 30 sec - exiting 21:10:21 (6056): No heartbeat from core client for 30 sec - exiting 21:10:22 (6056): No heartbeat from core client for 30 sec - exiting 21:10:23 (6056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5244, iMonCtr=2 Model crash detected, will try to restart... 15:48:08 (4160): No heartbeat from core client for 30 sec - exiting 15:48:09 (4160): No heartbeat from core client for 30 sec - exiting 15:48:10 (4160): No heartbeat from core client for 30 sec - exiting 15:48:11 (4160): No heartbeat from core client for 30 sec - exiting 15:48:12 (4160): No heartbeat from core client for 30 sec - exiting 15:48:13 (4160): No heartbeat from core client for 30 sec - exiting 15:48:14 (4160): No heartbeat from core client for 30 sec - exiting 15:48:15 (4160): No heartbeat from core client for 30 sec - exiting 15:48:17 (4160): No heartbeat from core client for 30 sec - exiting 15:48:18 (4160): No heartbeat from core client for 30 sec - exiting 15:48:19 (4160): No heartbeat from core client for 30 sec - exiting 15:48:20 (4160): No heartbeat from core client for 30 sec - exiting 15:48:21 (4160): No heartbeat from core client for 30 sec - exiting 15:48:22 (4160): No heartbeat from core client for 30 sec - exiting 15:48:23 (4160): No heartbeat from core client for 30 sec - exiting 15:48:24 (4160): No heartbeat from core client for 30 sec - exiting 15:48:25 (4160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5292, iMonCtr=2 Model crash detected, will try to restart... 09:58:26 (5944): No heartbeat from core client for 30 sec - exiting 09:58:27 (5944): No heartbeat from core client for 30 sec - exiting 09:58:28 (5944): No heartbeat from core client for 30 sec - exiting 09:58:29 (5944): No heartbeat from core client for 30 sec - exiting 09:58:31 (5944): No heartbeat from core client for 30 sec - exiting 09:58:32 (5944): No heartbeat from core client for 30 sec - exiting 09:58:33 (5944): No heartbeat from core client for 30 sec - exiting 09:58:34 (5944): No heartbeat from core client for 30 sec - exiting 09:58:35 (5944): No heartbeat from core client for 30 sec - exiting 09:58:36 (5944): No heartbeat from core client for 30 sec - exiting 09:58:37 (5944): No heartbeat from core client for 30 sec - exiting 09:58:38 (5944): No heartbeat from core client for 30 sec - exiting 09:58:39 (5944): No heartbeat from core client for 30 sec - exiting 09:58:40 (5944): No heartbeat from core client for 30 sec - exiting 09:58:41 (5944): No heartbeat from core client for 30 sec - exiting 09:58:43 (5944): No heartbeat from core client for 30 sec - exiting 09:58:45 (5944): No heartbeat from core client for 30 sec - exiting 09:58:46 (5944): No heartbeat from core client for 30 sec - exiting 09:58:47 (5944): No heartbeat from core client for 30 sec - exiting 09:58:48 (5944): No heartbeat from core client for 30 sec - exiting 09:58:49 (5944): No heartbeat from core client for 30 sec - exiting 09:58:50 (5944): No heartbeat from core client for 30 sec - exiting 09:58:51 (5944): No heartbeat from core client for 30 sec - exiting 09:58:52 (5944): No heartbeat from core client for 30 sec - exiting 09:58:53 (5944): No heartbeat from core client for 30 sec - exiting 09:58:54 (5944): No heartbeat from core client for 30 sec - exiting 09:58:55 (5944): No heartbeat from core client for 30 sec - exiting 09:58:56 (5944): No heartbeat from core client for 30 sec - exiting 09:58:57 (5944): No heartbeat from core client for 30 sec - exiting 09:59:00 (5944): No heartbeat from core client for 30 sec - exiting 09:59:01 (5944): No heartbeat from core client for 30 sec - exiting 09:59:02 (5944): No heartbeat from core client for 30 sec - exiting 09:59:03 (5944): No heartbeat from core client for 30 sec - exiting 09:59:04 (5944): No heartbeat from core client for 30 sec - exiting 09:59:06 (5944): No heartbeat from core client for 30 sec - exiting 09:59:07 (5944): No heartbeat from core client for 30 sec - exiting 09:59:08 (5944): No heartbeat from core client for 30 sec - exiting 09:59:09 (5944): No heartbeat from core client for 30 sec - exiting 09:59:11 (5944): No heartbeat from core client for 30 sec - exiting 09:59:13 (5944): No heartbeat from core client for 30 sec - exiting 09:59:14 (5944): No heartbeat from core client for 30 sec - exiting 09:59:15 (5944): No heartbeat from core client for 30 sec - exiting 09:59:16 (5944): No heartbeat from core client for 30 sec - exiting 09:59:18 (5944): No heartbeat from core client for 30 sec - exiting 09:59:19 (5944): No heartbeat from core client for 30 sec - exiting 09:59:20 (5944): No heartbeat from core client for 30 sec - exiting 09:59:21 (5944): No heartbeat from core client for 30 sec - exiting 09:59:23 (5944): No heartbeat from core client for 30 sec - exiting 09:59:24 (5944): No heartbeat from core client for 30 sec - exiting 09:59:25 (5944): No heartbeat from core client for 30 sec - exiting 09:59:26 (5944): No heartbeat from core client for 30 sec - exiting 09:59:28 (5944): No heartbeat from core client for 30 sec - exiting 09:59:30 (5944): No heartbeat from core client for 30 sec - exiting 09:59:31 (5944): No heartbeat from core client for 30 sec - exiting 09:59:32 (5944): No heartbeat from core client for 30 sec - exiting 09:59:33 (5944): No heartbeat from core client for 30 sec - exiting 09:59:34 (5944): No heartbeat from core client for 30 sec - exiting 09:59:35 (5944): No heartbeat from core client for 30 sec - exiting 09:59:36 (5944): No heartbeat from core client for 30 sec - exiting 09:59:38 (5944): No heartbeat from core client for 30 sec - exiting 09:59:39 (5944): No heartbeat from core client for 30 sec - exiting 09:59:40 (5944): No heartbeat from core client for 30 sec - exiting 09:59:42 (5944): No heartbeat from core client for 30 sec - exiting 09:59:43 (5944): No heartbeat from core client for 30 sec - exiting 09:59:44 (5944): No heartbeat from core client for 30 sec - exiting 09:59:45 (5944): No heartbeat from core client for 30 sec - exiting 09:59:46 (5944): No heartbeat from core client for 30 sec - exiting 09:59:47 (5944): No heartbeat from core client for 30 sec - exiting 09:59:48 (5944): No heartbeat from core client for 30 sec - exiting 09:59:49 (5944): No heartbeat from core client for 30 sec - exiting 09:59:50 (5944): No heartbeat from core client for 30 sec - exiting 09:59:51 (5944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5272, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 5 11:02:38 (2336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4860, selfPID=4860, iMonCtr=2 11:03:42 (4648): No heartbeat from core client for 30 sec - exiting 11:03:44 (4648): No heartbeat from core client for 30 sec - exiting 11:03:45 (4648): No heartbeat from core client for 30 sec - exiting 11:03:46 (4648): No heartbeat from core client for 30 sec - exiting 11:03:47 (4648): No heartbeat from core client for 30 sec - exiting 11:03:48 (4648): No heartbeat from core client for 30 sec - exiting 11:03:49 (4648): No heartbeat from core client for 30 sec - exiting 11:03:50 (4648): No heartbeat from core client for 30 sec - exiting 11:03:51 (4648): No heartbeat from core client for 30 sec - exiting 11:03:52 (4648): No heartbeat from core client for 30 sec - exiting 11:03:53 (4648): No heartbeat from core client for 30 sec - exiting 11:03:54 (4648): No heartbeat from core client for 30 sec - exiting 11:03:55 (4648): No heartbeat from core client for 30 sec - exiting 11:03:56 (4648): No heartbeat from core client for 30 sec - exiting 11:03:57 (4648): No heartbeat from core client for 30 sec - exiting 11:03:58 (4648): No heartbeat from core client for 30 sec - exiting 11:03:59 (4648): No heartbeat from core client for 30 sec - exiting 11:04:00 (4648): No heartbeat from core client for 30 sec - exiting 11:04:01 (4648): No heartbeat from core client for 30 sec - exiting 11:04:02 (4648): No heartbeat from core client for 30 sec - exiting 11:04:03 (4648): No heartbeat from core client for 30 sec - exiting 11:04:04 (4648): No heartbeat from core client for 30 sec - exiting 11:04:05 (4648): No heartbeat from core client for 30 sec - exiting 11:04:06 (4648): No heartbeat from core client for 30 sec - exiting 11:04:07 (4648): No heartbeat from core client for 30 sec - exiting 11:04:08 (4648): No heartbeat from core client for 30 sec - exiting 11:04:09 (4648): No heartbeat from core client for 30 sec - exiting 11:04:10 (4648): No heartbeat from core client for 30 sec - exiting 11:04:11 (4648): No heartbeat from core client for 30 sec - exiting 11:04:12 (4648): No heartbeat from core client for 30 sec - exiting 11:04:13 (4648): No heartbeat from core client for 30 sec - exiting 11:04:14 (4648): No heartbeat from core client for 30 sec - exiting 11:04:15 (4648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3520, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 5 13:01:57 (948): No heartbeat from core client for 30 sec - exiting 13:01:58 (948): No heartbeat from core client for 30 sec - exiting 13:01:59 (948): No heartbeat from core client for 30 sec - exiting 13:02:00 (948): No heartbeat from core client for 30 sec - exiting 13:02:01 (948): No heartbeat from core client for 30 sec - exiting 13:02:02 (948): No heartbeat from core client for 30 sec - exiting 13:02:03 (948): No heartbeat from core client for 30 sec - exiting 13:02:04 (948): No heartbeat from core client for 30 sec - exiting 13:02:05 (948): No heartbeat from core client for 30 sec - exiting 13:02:06 (948): No heartbeat from core client for 30 sec - exiting 13:02:07 (948): No heartbeat from core client for 30 sec - exiting 13:02:08 (948): No heartbeat from core client for 30 sec - exiting 13:02:09 (948): No heartbeat from core client for 30 sec - exiting 13:02:10 (948): No heartbeat from core client for 30 sec - exiting 13:02:11 (948): No heartbeat from core client for 30 sec - exiting 13:02:12 (948): No heartbeat from core client for 30 sec - exiting 13:02:13 (948): No heartbeat from core client for 30 sec - exiting 13:02:14 (948): No heartbeat from core client for 30 sec - exiting 13:02:15 (948): No heartbeat from core client for 30 sec - exiting 13:02:16 (948): No heartbeat from core client for 30 sec - exiting 13:02:17 (948): No heartbeat from core client for 30 sec - exiting 13:02:18 (948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2940, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2672, iMonCtr=2 Model crash detected, will try to restart... 15:13:42 (1428): No heartbeat from core client for 30 sec - exiting 15:13:43 (1428): No heartbeat from core client for 30 sec - exiting 15:13:44 (1428): No heartbeat from core client for 30 sec - exiting 15:13:45 (1428): No heartbeat from core client for 30 sec - exiting 15:13:46 (1428): No heartbeat from core client for 30 sec - exiting 15:13:47 (1428): No heartbeat from core client for 30 sec - exiting 15:13:48 (1428): No heartbeat from core client for 30 sec - exiting 15:13:49 (1428): No heartbeat from core client for 30 sec - exiting 15:13:50 (1428): No heartbeat from core client for 30 sec - exiting 15:13:51 (1428): No heartbeat from core client for 30 sec - exiting 15:13:52 (1428): No heartbeat from core client for 30 sec - exiting 15:13:53 (1428): No heartbeat from core client for 30 sec - exiting 15:13:54 (1428): No heartbeat from core client for 30 sec - exiting 15:13:55 (1428): No heartbeat from core client for 30 sec - exiting 15:13:56 (1428): No heartbeat from core client for 30 sec - exiting 15:13:57 (1428): No heartbeat from core client for 30 sec - exiting 15:13:58 (1428): No heartbeat from core client for 30 sec - exiting 15:13:59 (1428): No heartbeat from core client for 30 sec - exiting 15:14:00 (1428): No heartbeat from core client for 30 sec - exiting 15:14:01 (1428): No heartbeat from core client for 30 sec - exiting 15:14:02 (1428): No heartbeat from core client for 30 sec - exiting 15:14:03 (1428): No heartbeat from core client for 30 sec - exiting 15:14:04 (1428): No heartbeat from core client for 30 sec - exiting 15:14:05 (1428): No heartbeat from core client for 30 sec - exiting 15:14:06 (1428): No heartbeat from core client for 30 sec - exiting 15:14:07 (1428): No heartbeat from core client for 30 sec - exiting 15:14:08 (1428): No heartbeat from core client for 30 sec - exiting 15:14:09 (1428): No heartbeat from core client for 30 sec - exiting 15:14:11 (1428): No heartbeat from core client for 30 sec - exiting 15:14:12 (1428): No heartbeat from core client for 30 sec - exiting 15:14:13 (1428): No heartbeat from core client for 30 sec - exiting 15:14:14 (1428): No heartbeat from core client for 30 sec - exiting 15:14:15 (1428): No heartbeat from core client for 30 sec - exiting 15:14:16 (1428): No heartbeat from core client for 30 sec - exiting 15:14:17 (1428): No heartbeat from core client for 30 sec - exiting 15:14:18 (1428): No heartbeat from core client for 30 sec - exiting 15:14:19 (1428): No heartbeat from core client for 30 sec - exiting 15:14:20 (1428): No heartbeat from core client for 30 sec - exiting 15:14:21 (1428): No heartbeat from core client for 30 sec - exiting 15:14:22 (1428): No heartbeat from core client for 30 sec - exiting 15:14:23 (1428): No heartbeat from core client for 30 sec - exiting 15:14:24 (1428): No heartbeat from core client for 30 sec - exiting 15:14:25 (1428): No heartbeat from core client for 30 sec - exiting 15:14:26 (1428): No heartbeat from core client for 30 sec - exiting 15:14:27 (1428): No heartbeat from core client for 30 sec - exiting 15:14:28 (1428): No heartbeat from core client for 30 sec - exiting 15:14:29 (1428): No heartbeat from core client for 30 sec - exiting 15:14:30 (1428): No heartbeat from core client for 30 sec - exiting 15:14:31 (1428): No heartbeat from core client for 30 sec - exiting 15:14:32 (1428): No heartbeat from core client for 30 sec - exiting 15:14:33 (1428): No heartbeat from core client for 30 sec - exiting 15:14:34 (1428): No heartbeat from core client for 30 sec - exiting 15:14:35 (1428): No heartbeat from core client for 30 sec - exiting 15:14:36 (1428): No heartbeat from core client for 30 sec - exiting 15:14:37 (1428): No heartbeat from core client for 30 sec - exiting 15:14:38 (1428): No heartbeat from core client for 30 sec - exiting 15:14:39 (1428): No heartbeat from core client for 30 sec - exiting 15:14:40 (1428): No heartbeat from core client for 30 sec - exiting 15:14:41 (1428): No heartbeat from core client for 30 sec - exiting 15:14:42 (1428): No heartbeat from core client for 30 sec - exiting 15:14:43 (1428): No heartbeat from core client for 30 sec - exiting 15:14:44 (1428): No heartbeat from core client for 30 sec - exiting 15:14:45 (1428): No heartbeat from core client for 30 sec - exiting 15:14:46 (1428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1064, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5736, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4628, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5028, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=272, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4868, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2432, selfPID=2432, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=280, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3428, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4224, selfPID=4224, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1564, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5308, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2060, selfPID=4268, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5512, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3916, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2564, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5636, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5152, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1072, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2836, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 May 2012 13:20:18	871942	14337064	hadam3p_pnw_2uvu_1976_1_007851778_0	138,344	885,162	6.3983
27 May 2012 20:27:38	871942	14337064	hadam3p_pnw_2uvu_1976_1_007851778_0	138,336	884,283	6.3923
24 May 2012 07:17:21	871942	14337064	hadam3p_pnw_2uvu_1976_1_007851778_0	126,816	819,273	6.4603
21 May 2012 09:19:27	871942	14337064	hadam3p_pnw_2uvu_1976_1_007851778_0	115,296	750,546	6.5097
18 May 2012 16:38:35	871942	14337064	hadam3p_pnw_2uvu_1976_1_007851778_0	103,776	681,317	6.5653
16 May 2012 19:40:56	871942	14337064	hadam3p_pnw_2uvu_1976_1_007851778_0	92,256	616,128	6.6785
13 May 2012 15:56:31	871942	14337064	hadam3p_pnw_2uvu_1976_1_007851778_0	80,736	549,433	6.8053
12 May 2012 21:44:24	871942	14337064	hadam3p_pnw_2uvu_1976_1_007851778_0	69,216	487,281	7.0400
06 May 2012 12:33:31	871942	14337064	hadam3p_pnw_2uvu_1976_1_007851778_0	57,696	416,608	7.2207
03 May 2012 08:40:03	871942	14337064	hadam3p_pnw_2uvu_1976_1_007851778_0	46,176	334,723	7.2489
29 Apr 2012 13:28:22	871942	14337064	hadam3p_pnw_2uvu_1976_1_007851778_0	34,656	251,849	7.2671
22 Apr 2012 12:14:46	871942	14337064	hadam3p_pnw_2uvu_1976_1_007851778_0	23,136	170,461	7.3678
19 Apr 2012 15:02:15	871942	14337064	hadam3p_pnw_2uvu_1976_1_007851778_0	11,617	87,181	7.5046
19 Apr 2012 13:20:14	871942	14337064	hadam3p_pnw_2uvu_1976_1_007851778_0	11,616	86,069	7.4095