Task 15300968

Name	hadam3p_pnw_z802_1961_1_006940890_1
Workunit	7144206
Created	22 Sep 2012, 13:14:12 UTC
Sent	22 Sep 2012, 14:41:44 UTC
Report deadline	4 Sep 2013, 20:01:44 UTC
Received	11 Jan 2013, 11:14:16 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1231174
Run time	3 days 10 hours 35 min 46 sec
CPU time	3 days 0 hours 21 min 35 sec
Validate state	Initial
Credit	3,006.53
Device peak FLOPS	3.14 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=392, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1624, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:36:35 (4156): No heartbeat from core client for 30 sec - exiting 18:36:36 (4156): No heartbeat from core client for 30 sec - exiting 18:36:37 (4156): No heartbeat from core client for 30 sec - exiting 18:36:38 (4156): No heartbeat from core client for 30 sec - exiting 18:36:39 (4156): No heartbeat from core client for 30 sec - exiting 18:36:40 (4156): No heartbeat from core client for 30 sec - exiting 18:36:41 (4156): No heartbeat from core client for 30 sec - exiting 18:36:42 (4156): No heartbeat from core client for 30 sec - exiting 18:36:43 (4156): No heartbeat from core client for 30 sec - exiting 18:36:45 (4156): No heartbeat from core client for 30 sec - exiting 18:36:46 (4156): No heartbeat from core client for 30 sec - exiting 18:36:47 (4156): No heartbeat from core client for 30 sec - exiting 18:36:48 (4156): No heartbeat from core client for 30 sec - exiting 18:36:49 (4156): No heartbeat from core client for 30 sec - exiting 18:36:50 (4156): No heartbeat from core client for 30 sec - exiting 18:36:51 (4156): No heartbeat from core client for 30 sec - exiting 18:36:52 (4156): No heartbeat from core client for 30 sec - exiting 18:36:53 (4156): No heartbeat from core client for 30 sec - exiting 18:36:54 (4156): No heartbeat from core client for 30 sec - exiting 18:36:55 (4156): No heartbeat from core client for 30 sec - exiting 18:36:57 (4156): No heartbeat from core client for 30 sec - exiting 18:36:58 (4156): No heartbeat from core client for 30 sec - exiting 18:36:59 (4156): No heartbeat from core client for 30 sec - exiting 18:37:00 (4156): No heartbeat from core client for 30 sec - exiting 18:37:01 (4156): No heartbeat from core client for 30 sec - exiting 18:37:02 (4156): No heartbeat from core client for 30 sec - exiting 18:37:03 (4156): No heartbeat from core client for 30 sec - exiting 18:37:04 (4156): No heartbeat from core client for 30 sec - exiting 18:37:05 (4156): No heartbeat from core client for 30 sec - exiting 18:37:06 (4156): No heartbeat from core client for 30 sec - exiting 18:37:07 (4156): No heartbeat from core client for 30 sec - exiting 18:37:09 (4156): No heartbeat from core client for 30 sec - exiting 18:37:10 (4156): No heartbeat from core client for 30 sec - exiting 18:37:11 (4156): No heartbeat from core client for 30 sec - exiting 18:37:12 (4156): No heartbeat from core client for 30 sec - exiting 18:37:13 (4156): No heartbeat from core client for 30 sec - exiting 18:37:14 (4156): No heartbeat from core client for 30 sec - exiting 18:37:15 (4156): No heartbeat from core client for 30 sec - exiting 18:37:16 (4156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:37:17 (4156): No heartbeat from core client for 30 sec - exiting 18:40:46 (3616): No heartbeat from core client for 30 sec - exiting 18:40:47 (3616): No heartbeat from core client for 30 sec - exiting 18:40:48 (3616): No heartbeat from core client for 30 sec - exiting 18:40:49 (3616): No heartbeat from core client for 30 sec - exiting 18:40:50 (3616): No heartbeat from core client for 30 sec - exiting 18:40:51 (3616): No heartbeat from core client for 30 sec - exiting 18:40:52 (3616): No heartbeat from core client for 30 sec - exiting 18:40:53 (3616): No heartbeat from core client for 30 sec - exiting 18:40:54 (3616): No heartbeat from core client for 30 sec - exiting 18:40:55 (3616): No heartbeat from core client for 30 sec - exiting 18:40:57 (3616): No heartbeat from core client for 30 sec - exiting 18:40:58 (3616): No heartbeat from core client for 30 sec - exiting 18:40:59 (3616): No heartbeat from core client for 30 sec - exiting 18:41:00 (3616): No heartbeat from core client for 30 sec - exiting 18:41:01 (3616): No heartbeat from core client for 30 sec - exiting 18:41:02 (3616): No heartbeat from core client for 30 sec - exiting 18:41:03 (3616): No heartbeat from core client for 30 sec - exiting 18:41:04 (3616): No heartbeat from core client for 30 sec - exiting 18:41:05 (3616): No heartbeat from core client for 30 sec - exiting 18:41:06 (3616): No heartbeat from core client for 30 sec - exiting 18:41:07 (3616): No heartbeat from core client for 30 sec - exiting 18:41:08 (3616): No heartbeat from core client for 30 sec - exiting 18:41:09 (3616): No heartbeat from core client for 30 sec - exiting 18:41:11 (3616): No heartbeat from core client for 30 sec - exiting 18:41:12 (3616): No heartbeat from core client for 30 sec - exiting 18:41:13 (3616): No heartbeat from core client for 30 sec - exiting 18:41:14 (3616): No heartbeat from core client for 30 sec - exiting 18:41:15 (3616): No heartbeat from core client for 30 sec - exiting 18:41:16 (3616): No heartbeat from core client for 30 sec - exiting 18:41:17 (3616): No heartbeat from core client for 30 sec - exiting 18:41:18 (3616): No heartbeat from core client for 30 sec - exiting 18:41:19 (3616): No heartbeat from core client for 30 sec - exiting 18:41:20 (3616): No heartbeat from core client for 30 sec - exiting 18:41:21 (3616): No heartbeat from core client for 30 sec - exiting 18:41:23 (3616): No heartbeat from core client for 30 sec - exiting 18:41:24 (3616): No heartbeat from core client for 30 sec - exiting 18:41:25 (3616): No heartbeat from core client for 30 sec - exiting 18:41:26 (3616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:41:27 (3616): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3912, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4668, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4772, selfPID=4772, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4844, selfPID=4844, iMonCtr=2 20:00:45 (204): No heartbeat from core client for 30 sec - exiting 20:00:46 (204): No heartbeat from core client for 30 sec - exiting 20:00:47 (204): No heartbeat from core client for 30 sec - exiting 20:00:49 (204): No heartbeat from core client for 30 sec - exiting 20:00:50 (204): No heartbeat from core client for 30 sec - exiting 20:00:51 (204): No heartbeat from core client for 30 sec - exiting 20:00:52 (204): No heartbeat from core client for 30 sec - exiting 20:00:53 (204): No heartbeat from core client for 30 sec - exiting 20:00:54 (204): No heartbeat from core client for 30 sec - exiting 20:00:55 (204): No heartbeat from core client for 30 sec - exiting 20:00:56 (204): No heartbeat from core client for 30 sec - exiting 20:00:57 (204): No heartbeat from core client for 30 sec - exiting 20:00:58 (204): No heartbeat from core client for 30 sec - exiting 20:01:00 (204): No heartbeat from core client for 30 sec - exiting 20:01:01 (204): No heartbeat from core client for 30 sec - exiting 20:01:02 (204): No heartbeat from core client for 30 sec - exiting 20:01:03 (204): No heartbeat from core client for 30 sec - exiting 20:01:04 (204): No heartbeat from core client for 30 sec - exiting 20:01:05 (204): No heartbeat from core client for 30 sec - exiting 20:01:06 (204): No heartbeat from core client for 30 sec - exiting 20:01:07 (204): No heartbeat from core client for 30 sec - exiting 20:01:08 (204): No heartbeat from core client for 30 sec - exiting 20:01:09 (204): No heartbeat from core client for 30 sec - exiting 20:01:10 (204): No heartbeat from core client for 30 sec - exiting 20:01:11 (204): No heartbeat from core client for 30 sec - exiting 20:01:13 (204): No heartbeat from core client for 30 sec - exiting 20:01:14 (204): No heartbeat from core client for 30 sec - exiting 20:01:15 (204): No heartbeat from core client for 30 sec - exiting 20:01:16 (204): No heartbeat from core client for 30 sec - exiting 20:01:17 (204): No heartbeat from core client for 30 sec - exiting 20:01:18 (204): No heartbeat from core client for 30 sec - exiting 20:01:19 (204): No heartbeat from core client for 30 sec - exiting 20:01:20 (204): No heartbeat from core client for 30 sec - exiting 20:01:21 (204): No heartbeat from core client for 30 sec - exiting 20:01:22 (204): No heartbeat from core client for 30 sec - exiting 20:01:24 (204): No heartbeat from core client for 30 sec - exiting 20:01:25 (204): No heartbeat from core client for 30 sec - exiting 20:01:26 (204): No heartbeat from core client for 30 sec - exiting 20:01:27 (204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:01:28 (204): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4300, selfPID=3084, iMonCtr=1 Model crash detected, will try to restart... 18:58:53 (3520): No heartbeat from core client for 30 sec - exiting 18:58:54 (3520): No heartbeat from core client for 30 sec - exiting 18:58:55 (3520): No heartbeat from core client for 30 sec - exiting 18:58:56 (3520): No heartbeat from core client for 30 sec - exiting 18:58:57 (3520): No heartbeat from core client for 30 sec - exiting 18:58:58 (3520): No heartbeat from core client for 30 sec - exiting 18:58:59 (3520): No heartbeat from core client for 30 sec - exiting 18:59:00 (3520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:59:01 (3520): No heartbeat from core client for 30 sec - exiting 18:59:02 (3520): No heartbeat from core client for 30 sec - exiting 18:59:03 (3520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4480, selfPID=4524, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 2 CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5076, selfPID=3648, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 5 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1260, selfPID=3128, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3368, selfPID=3368, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3784, selfPID=3784, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4404, selfPID=4404, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=292, selfPID=292, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4928, selfPID=3540, iMonCtr=1 Model crash detected, will try to restart... 19:13:01 (3632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4724, selfPID=4724, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4040, selfPID=4040, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3976, selfPID=3976, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker::CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 18:40:34 (3512): No heartbeat from core client for 30 sec - exiting 18:40:35 (3512): No heartbeat from core client for 30 sec - exiting 18:40:36 (3512): No heartbeat from core client for 30 sec - exiting 18:40:37 (3512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:40:38 (3512): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2336, selfPID=2336, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:17:15 (1816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5056, selfPID=5056, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4268, selfPID=4268, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3928, selfPID=3928, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2148, selfPID=2148, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 14:02:50 (3588): No heartbeat from core client for 30 sec - exiting 14:02:51 (3588): No heartbeat from core client for 30 sec - exiting 14:02:52 (3588): No heartbeat from core client for 30 sec - exiting 14:02:53 (3588): No heartbeat from core client for 30 sec - exiting 14:02:54 (3588): No heartbeat from core client for 30 sec - exiting 14:02:55 (3588): No heartbeat from core client for 30 sec - exiting 14:02:56 (3588): No heartbeat from core client for 30 sec - exiting 14:02:57 (3588): No heartbeat from core client for 30 sec - exiting 14:02:58 (3588): No heartbeat from core client for 30 sec - exiting 14:02:59 (3588): No heartbeat from core client for 30 sec - exiting 14:03:00 (3588): No heartbeat from core client for 30 sec - exiting 14:03:01 (3588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:03:02 (3588): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 16:45:28 (3880): No heartbeat from core client for 30 sec - exiting 16:45:30 (3880): No heartbeat from core client for 30 sec - exiting 16:45:31 (3880): No heartbeat from core client for 30 sec - exiting 16:45:32 (3880): No heartbeat from core client for 30 sec - exiting 16:45:33 (3880): No heartbeat from core client for 30 sec - exiting 16:45:34 (3880): No heartbeat from core client for 30 sec - exiting 16:45:35 (3880): No heartbeat from core client for 30 sec - exiting 16:45:36 (3880): No heartbeat from core client for 30 sec - exiting 16:45:37 (3880): No heartbeat from core client for 30 sec - exiting 16:45:38 (3880): No heartbeat from core client for 30 sec - exiting 16:45:39 (3880): No heartbeat from core client for 30 sec - exiting 16:45:40 (3880): No heartbeat from core client for 30 sec - exiting 16:45:42 (3880): No heartbeat from core client for 30 sec - exiting 16:45:43 (3880): No heartbeat from core client for 30 sec - exiting 16:45:44 (3880): No heartbeat from core client for 30 sec - exiting 16:45:45 (3880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:45:46 (3880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4552, selfPID=4552, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5064, selfPID=5064, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4440, selfPID=4440, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 14:03:56 (4456): No heartbeat from core client for 30 sec - exiting 14:03:57 (4456): No heartbeat from core client for 30 sec - exiting 14:03:58 (4456): No heartbeat from core client for 30 sec - exiting 14:03:59 (4456): No heartbeat from core client for 30 sec - exiting 14:04:00 (4456): No heartbeat from core client for 30 sec - exiting 14:04:01 (4456): No heartbeat from core client for 30 sec - exiting 14:04:02 (4456): No heartbeat from core client for 30 sec - exiting 14:04:03 (4456): No heartbeat from core client for 30 sec - exiting 14:04:04 (4456): No heartbeat from core client for 30 sec - exiting 14:04:05 (4456): No heartbeat from core client for 30 sec - exiting 14:04:06 (4456): No heartbeat from core client for 30 sec - exiting 14:04:07 (4456): No heartbeat from core client for 30 sec - exiting 14:04:08 (4456): No heartbeat from core client for 30 sec - exiting 14:04:09 (4456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=792, selfPID=792, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:27:24 (3984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4264, selfPID=4264, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:29:54 (2108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:29:42 (3308): No heartbeat from core client for 30 sec - exiting 22:29:43 (3308): No heartbeat from core client for 30 sec - exiting 22:29:44 (3308): No heartbeat from core client for 30 sec - exiting 22:29:45 (3308): No heartbeat from core client for 30 sec - exiting 22:29:47 (3308): No heartbeat from core client for 30 sec - exiting 22:29:48 (3308): No heartbeat from core client for 30 sec - exiting 22:29:49 (3308): No heartbeat from core client for 30 sec - exiting 22:29:50 (3308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:29:51 (3308): No heartbeat from core client for 30 sec - exiting 00:21:44 (2828): No heartbeat from core client for 30 sec - exiting 00:21:46 (2828): No heartbeat from core client for 30 sec - exiting 00:21:47 (2828): No heartbeat from core client for 30 sec - exiting 00:21:48 (2828): No heartbeat from core client for 30 sec - exiting 00:21:49 (2828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:21:50 (2828): No heartbeat from core client for 30 sec - exiting 17:01:10 (3972): No heartbeat from core client for 30 sec - exiting 17:01:11 (3972): No heartbeat from core client for 30 sec - exiting 17:01:12 (3972): No heartbeat from core client for 30 sec - exiting 17:01:13 (3972): No heartbeat from core client for 30 sec - exiting 17:01:14 (3972): No heartbeat from core client for 30 sec - exiting 17:01:15 (3972): No heartbeat from core client for 30 sec - exiting 17:01:16 (3972): No heartbeat from core client for 30 sec - exiting 17:01:17 (3972): No heartbeat from core client for 30 sec - exiting 17:01:18 (3972): No heartbeat from core client for 30 sec - exiting 17:01:19 (3972): No heartbeat from core client for 30 sec - exiting 17:01:20 (3972): No heartbeat from core client for 30 sec - exiting 17:01:21 (3972): No heartbeat from core client for 30 sec - exiting 17:01:22 (3972): No heartbeat from core client for 30 sec - exiting 17:01:24 (3972): No heartbeat from core client for 30 sec - exiting 17:01:25 (3972): No heartbeat from core client for 30 sec - exiting 17:01:26 (3972): No heartbeat from core client for 30 sec - exiting 17:01:27 (3972): No heartbeat from core client for 30 sec - exiting 17:01:28 (3972): No heartbeat from core client for 30 sec - exiting 17:01:29 (3972): No heartbeat from core client for 30 sec - exiting 17:01:30 (3972): No heartbeat from core client for 30 sec - exiting 17:01:31 (3972): No heartbeat from core client for 30 sec - exiting 17:01:32 (3972): No heartbeat from core client for 30 sec - exiting 17:01:33 (3972): No heartbeat from core client for 30 sec - exiting 17:01:34 (3972): No heartbeat from core client for 30 sec - exiting 17:01:35 (3972): No heartbeat from core client for 30 sec - exiting 17:01:36 (3972): No heartbeat from core client for 30 sec - exiting 17:01:37 (3972): No heartbeat from core client for 30 sec - exiting 17:01:38 (3972): No heartbeat from core client for 30 sec - exiting 17:01:39 (3972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:01:40 (3972): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:27:45 (3552): No heartbeat from core client for 30 sec - exiting 20:27:46 (3552): No heartbeat from core client for 30 sec - exiting 20:27:47 (3552): No heartbeat from core client for 30 sec - exiting 20:27:48 (3552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:27:50 (3552): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3540, selfPID=3912, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 19:43:42 (3404): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Jan 2013 18:23:12	1231174	15300968	hadam3p_pnw_z802_1961_1_006940890_1	138,366	260,147	1.8801
08 Jan 2013 16:20:59	1231174	15300968	hadam3p_pnw_z802_1961_1_006940890_1	138,346	259,892	1.8786
07 Jan 2013 18:43:06	1231174	15300968	hadam3p_pnw_z802_1961_1_006940890_1	138,336	259,623	1.8768
28 Nov 2012 14:08:04	1231174	15300968	hadam3p_pnw_z802_1961_1_006940890_1	126,816	238,266	1.8788
05 Nov 2012 15:44:15	1231174	15300968	hadam3p_pnw_z802_1961_1_006940890_1	115,296	215,928	1.8728
25 Oct 2012 11:20:16	1231174	15300968	hadam3p_pnw_z802_1961_1_006940890_1	103,781	195,473	1.8835
23 Oct 2012 16:39:12	1231174	15300968	hadam3p_pnw_z802_1961_1_006940890_1	103,776	195,219	1.8812
18 Oct 2012 18:35:50	1231174	15300968	hadam3p_pnw_z802_1961_1_006940890_1	92,256	175,319	1.9004
09 Oct 2012 17:47:42	1231174	15300968	hadam3p_pnw_z802_1961_1_006940890_1	80,736	153,630	1.9029
05 Oct 2012 18:14:14	1231174	15300968	hadam3p_pnw_z802_1961_1_006940890_1	69,216	132,535	1.9148
04 Oct 2012 18:50:52	1231174	15300968	hadam3p_pnw_z802_1961_1_006940890_1	57,696	111,017	1.9242
03 Oct 2012 18:52:43	1231174	15300968	hadam3p_pnw_z802_1961_1_006940890_1	46,176	89,331	1.9346
02 Oct 2012 19:11:24	1231174	15300968	hadam3p_pnw_z802_1961_1_006940890_1	34,656	67,009	1.9335
30 Sep 2012 13:17:24	1231174	15300968	hadam3p_pnw_z802_1961_1_006940890_1	23,136	44,857	1.9388
24 Sep 2012 16:47:47	1231174	15300968	hadam3p_pnw_z802_1961_1_006940890_1	11,616	22,540	1.9404