Task 13713898

Name	hadam3p_pnw_6ww5_1999_1_007591213_0
Workunit	7769343
Created	5 Dec 2011, 11:08:15 UTC
Sent	23 Dec 2011, 12:27:26 UTC
Report deadline	4 Dec 2012, 17:47:26 UTC
Received	7 Apr 2012, 11:30:03 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1186953
Run time	5 days 9 hours 37 min 37 sec
CPU time	4 days 21 hours 59 min 45 sec
Validate state	Workunit error - check skipped
Credit	3,005.88
Device peak FLOPS	2.34 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> nCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 5 16:14:27 (2348): No heartbeat from core client for 30 sec - exiting 16:14:28 (2348): No heartbeat from core client for 30 sec - exiting 16:14:29 (2348): No heartbeat from core client for 30 sec - exiting 16:14:30 (2348): No heartbeat from core client for 30 sec - exiting 16:14:31 (2348): No heartbeat from core client for 30 sec - exiting 16:14:32 (2348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2396, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3312, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2452, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2636, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 6 Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3416, selfPID=2924, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:54:23 (2828): No heartbeat from core client for 30 sec - exiting 07:54:24 (2828): No heartbeat from core client for 30 sec - exiting 07:54:25 (2828): No heartbeat from core client for 30 sec - exiting 07:54:26 (2828): No heartbeat from core client for 30 sec - exiting 07:54:27 (2828): No heartbeat from core client for 30 sec - exiting 07:54:28 (2828): No heartbeat from core client for 30 sec - exiting 07:54:29 (2828): No heartbeat from core client for 30 sec - exiting 07:54:30 (2828): No heartbeat from core client for 30 sec - exiting 07:54:32 (2828): No heartbeat from core client for 30 sec - exiting 07:54:33 (2828): No heartbeat from core client for 30 sec - exiting 07:54:34 (2828): No heartbeat from core client for 30 sec - exiting 07:54:35 (2828): No heartbeat from core client for 30 sec - exiting 07:54:36 (2828): No heartbeat from core client for 30 sec - exiting 07:54:37 (2828): No heartbeat from core client for 30 sec - exiting 07:54:38 (2828): No heartbeat from core client for 30 sec - exiting 07:54:39 (2828): No heartbeat from core client for 30 sec - exiting 07:54:40 (2828): No heartbeat from core client for 30 sec - exiting 07:54:41 (2828): No heartbeat from core client for 30 sec - exiting 07:54:42 (2828): No heartbeat from core client for 30 sec - exiting 07:54:44 (2828): No heartbeat from core client for 30 sec - exiting 07:54:45 (2828): No heartbeat from core client for 30 sec - exiting 07:54:46 (2828): No heartbeat from core client for 30 sec - exiting 07:54:47 (2828): No heartbeat from core client for 30 sec - exiting 07:54:48 (2828): No heartbeat from core client for 30 sec - exiting 07:54:49 (2828): No heartbeat from core client for 30 sec - exiting 07:54:50 (2828): No heartbeat from core client for 30 sec - exiting 07:54:51 (2828): No heartbeat from core client for 30 sec - exiting 07:54:52 (2828): No heartbeat from core client for 30 sec - exiting 07:54:53 (2828): No heartbeat from core client for 30 sec - exiting 07:54:54 (2828): No heartbeat from core client for 30 sec - exiting 07:54:56 (2828): No heartbeat from core client for 30 sec - exiting 07:54:57 (2828): No heartbeat from core client for 30 sec - exiting 07:54:58 (2828): No heartbeat from core client for 30 sec - exiting 07:54:59 (2828): No heartbeat from core client for 30 sec - exiting 07:55:00 (2828): No heartbeat from core client for 30 sec - exiting 07:55:01 (2828): No heartbeat from core client for 30 sec - exiting 07:55:02 (2828): No heartbeat from core client for 30 sec - exiting 07:55:03 (2828): No heartbeat from core client for 30 sec - exiting 07:55:04 (2828): No heartbeat from core client for 30 sec - exiting 07:55:05 (2828): No heartbeat from core client for 30 sec - exiting 07:55:06 (2828): No heartbeat from core client for 30 sec - exiting 07:55:08 (2828): No heartbeat from core client for 30 sec - exiting 07:55:09 (2828): No heartbeat from core client for 30 sec - exiting 07:55:10 (2828): No heartbeat from core client for 30 sec - exiting 07:55:11 (2828): No heartbeat from core client for 30 sec - exiting 07:55:12 (2828): No heartbeat from core client for 30 sec - exiting 07:55:13 (2828): No heartbeat from core client for 30 sec - exiting 07:55:14 (2828): No heartbeat from core client for 30 sec - exiting 07:55:15 (2828): No heartbeat from core client for 30 sec - exiting 07:55:16 (2828): No heartbeat from core client for 30 sec - exiting 07:55:17 (2828): No heartbeat from core client for 30 sec - exiting 07:55:18 (2828): No heartbeat from core client for 30 sec - exiting 07:55:20 (2828): No heartbeat from core client for 30 sec - exiting 07:55:21 (2828): No heartbeat from core client for 30 sec - exiting 07:55:22 (2828): No heartbeat from core client for 30 sec - exiting 07:55:23 (2828): No heartbeat from core client for 30 sec - exiting 07:55:24 (2828): No heartbeat from core client for 30 sec - exiting 07:55:25 (2828): No heartbeat from core client for 30 sec - exiting 07:55:26 (2828): No heartbeat from core client for 30 sec - exiting 07:55:27 (2828): No heartbeat from core client for 30 sec - exiting 07:55:28 (2828): No heartbeat from core client for 30 sec - exiting 07:55:29 (2828): No heartbeat from core client for 30 sec - exiting 07:55:31 (2828): No heartbeat from core client for 30 sec - exiting 07:55:32 (2828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5620, iMonCtr=2 Model crash detected, will try to restart... 21:40:10 (3476): No heartbeat from core client for 30 sec - exiting 21:40:11 (3476): No heartbeat from core client for 30 sec - exiting 21:40:12 (3476): No heartbeat from core client for 30 sec - exiting 21:40:13 (3476): No heartbeat from core client for 30 sec - exiting 21:40:14 (3476): No heartbeat from core client for 30 sec - exiting 21:40:15 (3476): No heartbeat from core client for 30 sec - exiting 21:40:16 (3476): No heartbeat from core client for 30 sec - exiting 21:40:17 (3476): No heartbeat from core client for 30 sec - exiting 21:40:18 (3476): No heartbeat from core client for 30 sec - exiting 21:40:19 (3476): No heartbeat from core client for 30 sec - exiting 21:40:21 (3476): No heartbeat from core client for 30 sec - exiting 21:40:22 (3476): No heartbeat from core client for 30 sec - exiting 21:40:23 (3476): No heartbeat from core client for 30 sec - exiting 21:40:24 (3476): No heartbeat from core client for 30 sec - exiting 21:40:58 (3476): No heartbeat from core client for 30 sec - exiting 21:40:59 (3476): No heartbeat from core client for 30 sec - exiting 21:41:00 (3476): No heartbeat from core client for 30 sec - exiting 21:41:01 (3476): No heartbeat from core client for 30 sec - exiting 21:41:02 (3476): No heartbeat from core client for 30 sec - exiting 21:41:03 (3476): No heartbeat from core client for 30 sec - exiting 21:41:04 (3476): No heartbeat from core client for 30 sec - exiting 21:41:05 (3476): No heartbeat from core client for 30 sec - exiting 21:41:07 (3476): No heartbeat from core client for 30 sec - exiting 21:41:08 (3476): No heartbeat from core client for 30 sec - exiting 21:41:09 (3476): No heartbeat from core client for 30 sec - exiting 21:41:10 (3476): No heartbeat from core client for 30 sec - exiting 21:41:11 (3476): No heartbeat from core client for 30 sec - exiting 21:41:12 (3476): No heartbeat from core client for 30 sec - exiting 21:41:13 (3476): No heartbeat from core client for 30 sec - exiting 21:41:14 (3476): No heartbeat from core client for 30 sec - exiting 21:41:15 (3476): No heartbeat from core client for 30 sec - exiting 21:41:16 (3476): No heartbeat from core client for 30 sec - exiting 21:41:17 (3476): No heartbeat from core client for 30 sec - exiting 21:41:19 (3476): No heartbeat from core client for 30 sec - exiting 21:41:20 (3476): No heartbeat from core client for 30 sec - exiting 21:41:21 (3476): No heartbeat from core client for 30 sec - exiting 21:41:22 (3476): No heartbeat from core client for 30 sec - exiting 21:41:23 (3476): No heartbeat from core client for 30 sec - exiting 21:41:24 (3476): No heartbeat from core client for 30 sec - exiting 21:41:25 (3476): No heartbeat from core client for 30 sec - exiting 21:41:26 (3476): No heartbeat from core client for 30 sec - exiting 21:41:27 (3476): No heartbeat from core client for 30 sec - exiting 21:41:28 (3476): No heartbeat from core client for 30 sec - exiting 21:41:29 (3476): No heartbeat from core client for 30 sec - exiting 21:41:31 (3476): No heartbeat from core client for 30 sec - exiting 21:41:32 (3476): No heartbeat from core client for 30 sec - exiting 21:41:33 (3476): No heartbeat from core client for 30 sec - exiting 21:41:34 (3476): No heartbeat from core client for 30 sec - exiting 21:41:35 (3476): No heartbeat from core client for 30 sec - exiting 21:41:36 (3476): No heartbeat from core client for 30 sec - exiting 21:41:37 (3476): No heartbeat from core client for 30 sec - exiting 21:41:38 (3476): No heartbeat from core client for 30 sec - exiting 21:41:39 (3476): No heartbeat from core client for 30 sec - exiting 21:41:40 (3476): No heartbeat from core client for 30 sec - exiting 21:41:42 (3476): No heartbeat from core client for 30 sec - exiting 21:41:43 (3476): No heartbeat from core client for 30 sec - exiting 21:41:44 (3476): No heartbeat from core client for 30 sec - exiting 21:41:45 (3476): No heartbeat from core client for 30 sec - exiting 21:41:46 (3476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3792, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3544, selfPID=3096, iMonCtr=1 Model crash detected, will try to restart... 18:39:50 (3844): No heartbeat from core client for 30 sec - exiting 18:39:51 (3844): No heartbeat from core client for 30 sec - exiting 18:39:52 (3844): No heartbeat from core client for 30 sec - exiting 18:39:53 (3844): No heartbeat from core client for 30 sec - exiting 18:39:54 (3844): No heartbeat from core client for 30 sec - exiting 18:39:55 (3844): No heartbeat from core client for 30 sec - exiting 18:39:56 (3844): No heartbeat from core client for 30 sec - exiting 18:40:40 (3844): No heartbeat from core client for 30 sec - exiting 18:40:41 (3844): No heartbeat from core client for 30 sec - exiting 18:40:42 (3844): No heartbeat from core client for 30 sec - exiting 18:40:43 (3844): No heartbeat from core client for 30 sec - exiting 18:40:44 (3844): No heartbeat from core client for 30 sec - exiting 18:40:45 (3844): No heartbeat from core client for 30 sec - exiting 18:40:46 (3844): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=708, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1748, iMonCtr=2 Model crash detected, will try to restart... 18:15:27 (3788): No heartbeat from core client for 30 sec - exiting 18:15:28 (3788): No heartbeat from core client for 30 sec - exiting 18:15:29 (3788): No heartbeat from core client for 30 sec - exiting 18:15:30 (3788): No heartbeat from core client for 30 sec - exiting 18:15:31 (3788): No heartbeat from core client for 30 sec - exiting 18:15:32 (3788): No heartbeat from core client for 30 sec - exiting 18:15:34 (3788): No heartbeat from core client for 30 sec - exiting 18:15:35 (3788): No heartbeat from core client for 30 sec - exiting 18:15:36 (3788): No heartbeat from core client for 30 sec - exiting 18:15:37 (3788): No heartbeat from core client for 30 sec - exiting 18:15:38 (3788): No heartbeat from core client for 30 sec - exiting 18:15:39 (3788): No heartbeat from core client for 30 sec - exiting 18:15:40 (3788): No heartbeat from core client for 30 sec - exiting 18:15:41 (3788): No heartbeat from core client for 30 sec - exiting 18:15:42 (3788): No heartbeat from core client for 30 sec - exiting 18:15:43 (3788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1880, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3436, iMonCtr=2 22:26:57 (3988): No heartbeat from core client for 30 sec - exiting 22:26:58 (3988): No heartbeat from core client for 30 sec - exiting 22:26:59 (3988): No heartbeat from core client for 30 sec - exiting 22:27:00 (3988): No heartbeat from core client for 30 sec - exiting 22:27:01 (3988): No heartbeat from core client for 30 sec - exiting 22:27:03 (3988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:57:28 (3376): No heartbeat from core client for 30 sec - exiting 16:57:29 (3376): No heartbeat from core client for 30 sec - exiting 16:57:30 (3376): No heartbeat from core client for 30 sec - exiting 16:57:31 (3376): No heartbeat from core client for 30 sec - exiting 16:57:32 (3376): No heartbeat from core client for 30 sec - exiting 16:57:33 (3376): No heartbeat from core client for 30 sec - exiting 16:57:34 (3376): No heartbeat from core client for 30 sec - exiting 16:57:35 (3376): No heartbeat from core client for 30 sec - exiting 16:57:36 (3376): No heartbeat from core client for 30 sec - exiting 16:57:37 (3376): No heartbeat from core client for 30 sec - exiting 16:57:38 (3376): No heartbeat from core client for 30 sec - exiting 16:57:39 (3376): No heartbeat from core client for 30 sec - exiting 16:57:40 (3376): No heartbeat from core client for 30 sec - exiting 16:57:41 (3376): No heartbeat from core client for 30 sec - exiting 16:57:42 (3376): No heartbeat from core client for 30 sec - exiting 16:57:44 (3376): No heartbeat from core client for 30 sec - exiting 16:57:45 (3376): No heartbeat from core client for 30 sec - exiting 16:57:46 (3376): No heartbeat from core client for 30 sec - exiting 16:57:47 (3376): No heartbeat from core client for 30 sec - exiting 16:57:48 (3376): No heartbeat from core client for 30 sec - exiting 16:57:49 (3376): No heartbeat from core client for 30 sec - exiting 16:57:50 (3376): No heartbeat from core client for 30 sec - exiting 16:57:51 (3376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:01:03 (4256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3476, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1896, selfPID=1060, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=940, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 Suspended CPDN Monitor - Suspend request from BOINC... 21:19:37 (3820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:19:38 (3820): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2296, iMonCtr=2 Model crash detected, will try to restart... 20:17:10 (3864): No heartbeat from core client for 30 sec - exiting 20:17:11 (3864): No heartbeat from core client for 30 sec - exiting 20:17:12 (3864): No heartbeat from core client for 30 sec - exiting 20:17:13 (3864): No heartbeat from core client for 30 sec - exiting 20:17:15 (3864): No heartbeat from core client for 30 sec - exiting 20:17:16 (3864): No heartbeat from core client for 30 sec - exiting 20:17:17 (3864): No heartbeat from core client for 30 sec - exiting 20:17:18 (3864): No heartbeat from core client for 30 sec - exiting 20:17:19 (3864): No heartbeat from core client for 30 sec - exiting 20:17:20 (3864): No heartbeat from core client for 30 sec - exiting 20:17:21 (3864): No heartbeat from core client for 30 sec - exiting 20:17:22 (3864): No heartbeat from core client for 30 sec - exiting 20:17:23 (3864): No heartbeat from core client for 30 sec - exiting 20:17:24 (3864): No heartbeat from core client for 30 sec - exiting 20:17:26 (3864): No heartbeat from core client for 30 sec - exiting 20:17:27 (3864): No heartbeat from core client for 30 sec - exiting 20:17:28 (3864): No heartbeat from core client for 30 sec - exiting 20:17:29 (3864): No heartbeat from core client for 30 sec - exiting 20:17:30 (3864): No heartbeat from core client for 30 sec - exiting 20:17:31 (3864): No heartbeat from core client for 30 sec - exiting 20:17:32 (3864): No heartbeat from core client for 30 sec - exiting 20:17:33 (3864): No heartbeat from core client for 30 sec - exiting 20:17:34 (3864): No heartbeat from core client for 30 sec - exiting 20:17:35 (3864): No heartbeat from core client for 30 sec - exiting 20:17:36 (3864): No heartbeat from core client for 30 sec - exiting 20:17:38 (3864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:17:39 (3864): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:51:22 (2952): No heartbeat from core client for 30 sec - exiting 21:51:23 (2952): No heartbeat from core client for 30 sec - exiting 21:51:24 (2952): No heartbeat from core client for 30 sec - exiting 21:51:25 (2952): No heartbeat from core client for 30 sec - exiting 21:51:26 (2952): No heartbeat from core client for 30 sec - exiting 21:51:27 (2952): No heartbeat from core client for 30 sec - exiting 21:51:28 (2952): No heartbeat from core client for 30 sec - exiting 21:51:29 (2952): No heartbeat from core client for 30 sec - exiting 21:51:30 (2952): No heartbeat from core client for 30 sec - exiting 21:51:31 (2952): No heartbeat from core client for 30 sec - exiting 21:51:33 (2952): No heartbeat from core client for 30 sec - exiting 21:51:34 (2952): No heartbeat from core client for 30 sec - exiting 21:51:35 (2952): No heartbeat from core client for 30 sec - exiting 21:51:36 (2952): No heartbeat from core client for 30 sec - exiting 21:51:37 (2952): No heartbeat from core client for 30 sec - exiting 21:51:38 (2952): No heartbeat from core client for 30 sec - exiting 21:51:39 (2952): No heartbeat from core client for 30 sec - exiting 21:51:40 (2952): No heartbeat from core client for 30 sec - exiting 21:51:41 (2952): No heartbeat from core client for 30 sec - exiting 21:51:42 (2952): No heartbeat from core client for 30 sec - exiting 21:51:43 (2952): No heartbeat from core client for 30 sec - exiting 21:51:45 (2952): No heartbeat from core client for 30 sec - exiting 21:51:46 (2952): No heartbeat from core client for 30 sec - exiting 21:51:47 (2952): No heartbeat from core client for 30 sec - exiting 21:51:48 (2952): No heartbeat from core client for 30 sec - exiting 21:51:49 (2952): No heartbeat from core client for 30 sec - exiting 21:51:50 (2952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:45:53 (3964): No heartbeat from core client for 30 sec - exiting 20:45:54 (3964): No heartbeat from core client for 30 sec - exiting 20:45:55 (3964): No heartbeat from core client for 30 sec - exiting 20:45:56 (3964): No heartbeat from core client for 30 sec - exiting 20:45:58 (3964): No heartbeat from core client for 30 sec - exiting 20:45:59 (3964): No heartbeat from core client for 30 sec - exiting 20:46:00 (3964): No heartbeat from core client for 30 sec - exiting 20:46:01 (3964): No heartbeat from core client for 30 sec - exiting 20:46:02 (3964): No heartbeat from core client for 30 sec - exiting 20:46:03 (3964): No heartbeat from core client for 30 sec - exiting 20:46:04 (3964): No heartbeat from core client for 30 sec - exiting 20:46:05 (3964): No heartbeat from core client for 30 sec - exiting 20:46:06 (3964): No heartbeat from core client for 30 sec - exiting 20:46:07 (3964): No heartbeat from core client for 30 sec - exiting 20:46:09 (3964): No heartbeat from core client for 30 sec - exiting 20:46:10 (3964): No heartbeat from core client for 30 sec - exiting 20:46:11 (3964): No heartbeat from core client for 30 sec - exiting 20:46:12 (3964): No heartbeat from core client for 30 sec - exiting 20:46:13 (3964): No heartbeat from core client for 30 sec - exiting 20:46:14 (3964): No heartbeat from core client for 30 sec - exiting 20:46:15 (3964): No heartbeat from core client for 30 sec - exiting 20:46:16 (3964): No heartbeat from core client for 30 sec - exiting 20:46:17 (3964): No heartbeat from core client for 30 sec - exiting 20:46:18 (3964): No heartbeat from core client for 30 sec - exiting 20:46:19 (3964): No heartbeat from core client for 30 sec - exiting 20:46:21 (3964): No heartbeat from core client for 30 sec - exiting 20:46:22 (3964): No heartbeat from core client for 30 sec - exiting 20:46:23 (3964): No heartbeat from core client for 30 sec - exiting 20:46:24 (3964): No heartbeat from core client for 30 sec - exiting 20:46:25 (3964): No heartbeat from core client for 30 sec - exiting 20:46:26 (3964): No heartbeat from core client for 30 sec - exiting 20:46:27 (3964): No heartbeat from core client for 30 sec - exiting 20:46:28 (3964): No heartbeat from core client for 30 sec - exiting 20:46:29 (3964): No heartbeat from core client for 30 sec - exiting 20:46:30 (3964): No heartbeat from core client for 30 sec - exiting 20:46:31 (3964): No heartbeat from core client for 30 sec - exiting 20:46:33 (3964): No heartbeat from core client for 30 sec - exiting 20:46:34 (3964): No heartbeat from core client for 30 sec - exiting 20:46:35 (3964): No heartbeat from core client for 30 sec - exiting 20:46:36 (3964): No heartbeat from core client for 30 sec - exiting 20:46:37 (3964): No heartbeat from core client for 30 sec - exiting 20:46:38 (3964): No heartbeat from core client for 30 sec - exiting 20:46:39 (3964): No heartbeat from core client for 30 sec - exiting 20:46:40 (3964): No heartbeat from core client for 30 sec - exiting 20:46:41 (3964): No heartbeat from core client for 30 sec - exiting 20:46:42 (3964): No heartbeat from core client for 30 sec - exiting 20:46:43 (3964): No heartbeat from core client for 30 sec - exiting 20:46:45 (3964): No heartbeat from core client for 30 sec - exiting 20:46:46 (3964): No heartbeat from core client for 30 sec - exiting 20:46:47 (3964): No heartbeat from core client for 30 sec - exiting 20:46:48 (3964): No heartbeat from core client for 30 sec - exiting 20:46:49 (3964): No heartbeat from core client for 30 sec - exiting 20:46:50 (3964): No heartbeat from core client for 30 sec - exiting 20:46:51 (3964): No heartbeat from core client for 30 sec - exiting 20:46:52 (3964): No heartbeat from core client for 30 sec - exiting 20:46:53 (3964): No heartbeat from core client for 30 sec - exiting 20:46:54 (3964): No heartbeat from core client for 30 sec - exiting 20:46:55 (3964): No heartbeat from core client for 30 sec - exiting 20:46:57 (3964): No heartbeat from core client for 30 sec - exiting 20:46:58 (3964): No heartbeat from core client for 30 sec - exiting 20:46:59 (3964): No heartbeat from core client for 30 sec - exiting 20:47:00 (3964): No heartbeat from core client for 30 sec - exiting 20:47:01 (3964): No heartbeat from core client for 30 sec - exiting 20:47:02 (3964): No heartbeat from core client for 30 sec - exiting 20:47:03 (3964): No heartbeat from core client for 30 sec - exiting 20:47:04 (3964): No heartbeat from core client for 30 sec - exiting 20:47:05 (3964): No heartbeat from core client for 30 sec - exiting 20:47:06 (3964): No heartbeat from core client for 30 sec - exiting 20:47:07 (3964): No heartbeat from core client for 30 sec - exiting 20:47:09 (3964): No heartbeat from core client for 30 sec - exiting 20:47:10 (3964): No heartbeat from core client for 30 sec - exiting 20:47:11 (3964): No heartbeat from core client for 30 sec - exiting 20:47:12 (3964): No heartbeat from core client for 30 sec - exiting 20:47:13 (3964): No heartbeat from core client for 30 sec - exiting 20:47:14 (3964): No heartbeat from core client for 30 sec - exiting 20:47:15 (3964): No heartbeat from core client for 30 sec - exiting 20:47:16 (3964): No heartbeat from core client for 30 sec - exiting 20:47:17 (3964): No heartbeat from core client for 30 sec - exiting 20:47:18 (3964): No heartbeat from core client for 30 sec - exiting 20:47:19 (3964): No heartbeat from core client for 30 sec - exiting 20:47:21 (3964): No heartbeat from core client for 30 sec - exiting 20:47:22 (3964): No heartbeat from core client for 30 sec - exiting 20:47:23 (3964): No heartbeat from core client for 30 sec - exiting 20:47:24 (3964): No heartbeat from core client for 30 sec - exiting 20:47:25 (3964): No heartbeat from core client for 30 sec - exiting 20:47:26 (3964): No heartbeat from core client for 30 sec - exiting 20:47:27 (3964): No heartbeat from core client for 30 sec - exiting 20:47:28 (3964): No heartbeat from core client for 30 sec - exiting 20:47:29 (3964): No heartbeat from core client for 30 sec - exiting 20:47:30 (3964): No heartbeat from core client for 30 sec - exiting 20:47:32 (3964): No heartbeat from core client for 30 sec - exiting 20:47:33 (3964): No heartbeat from core client for 30 sec - exiting 20:47:34 (3964): No heartbeat from core client for 30 sec - exiting 20:47:35 (3964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:47:36 (3964): No heartbeat from core client for 30 sec - exiting 20:48:21 (3308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:49:10 (1424): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4048, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4032, selfPID=1616, iMonCtr=1 Model crash detected, will try to restart... 22:01:50 (3740): No heartbeat from core client for 30 sec - exiting 22:01:51 (3740): No heartbeat from core client for 30 sec - exiting 22:01:52 (3740): No heartbeat from core client for 30 sec - exiting 22:01:53 (3740): No heartbeat from core client for 30 sec - exiting 22:01:54 (3740): No heartbeat from core client for 30 sec - exiting 22:01:56 (3740): No heartbeat from core client for 30 sec - exiting 22:01:57 (3740): No heartbeat from core client for 30 sec - exiting 22:01:58 (3740): No heartbeat from core client for 30 sec - exiting 22:01:59 (3740): No heartbeat from core client for 30 sec - exiting 22:02:00 (3740): No heartbeat from core client for 30 sec - exiting 22:02:01 (3740): No heartbeat from core client for 30 sec - exiting 22:02:02 (3740): No heartbeat from core client for 30 sec - exiting 22:02:03 (3740): No heartbeat from core client for 30 sec - exiting 22:02:04 (3740): No heartbeat from core client for 30 sec - exiting 22:02:05 (3740): No heartbeat from core client for 30 sec - exiting 22:02:06 (3740): No heartbeat from core client for 30 sec - exiting 22:02:08 (3740): No heartbeat from core client for 30 sec - exiting 22:02:09 (3740): No heartbeat from core client for 30 sec - exiting 22:02:10 (3740): No heartbeat from core client for 30 sec - exiting 22:02:11 (3740): No heartbeat from core client for 30 sec - exiting 22:02:12 (3740): No heartbeat from core client for 30 sec - exiting 22:02:13 (3740): No heartbeat from core client for 30 sec - exiting 22:02:14 (3740): No heartbeat from core client for 30 sec - exiting 22:02:15 (3740): No heartbeat from core client for 30 sec - exiting 22:02:16 (3740): No heartbeat from core client for 30 sec - exiting 22:02:17 (3740): No heartbeat from core client for 30 sec - exiting 22:02:19 (3740): No heartbeat from core client for 30 sec - exiting 22:02:20 (3740): No heartbeat from core client for 30 sec - exiting 22:02:21 (3740): No heartbeat from core client for 30 sec - exiting 22:02:22 (3740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:02:23 (3740): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:38:34 (508): No heartbeat from core client for 30 sec - exiting 19:38:35 (508): No heartbeat from core client for 30 sec - exiting 19:38:36 (508): No heartbeat from core client for 30 sec - exiting 19:38:37 (508): No heartbeat from core client for 30 sec - exiting 19:38:38 (508): No heartbeat from core client for 30 sec - exiting 19:38:39 (508): No heartbeat from core client for 30 sec - exiting 19:38:40 (508): No heartbeat from core client for 30 sec - exiting 19:38:41 (508): No heartbeat from core client for 30 sec - exiting 19:38:42 (508): No heartbeat from core client for 30 sec - exiting 19:38:43 (508): No heartbeat from core client for 30 sec - exiting 19:38:44 (508): No heartbeat from core client for 30 sec - exiting 19:38:46 (508): No heartbeat from core client for 30 sec - exiting 19:38:47 (508): No heartbeat from core client for 30 sec - exiting 19:38:48 (508): No heartbeat from core client for 30 sec - exiting 19:38:49 (508): No heartbeat from core client for 30 sec - exiting 19:38:50 (508): No heartbeat from core client for 30 sec - exiting 19:38:51 (508): No heartbeat from core client for 30 sec - exiting 19:38:52 (508): No heartbeat from core client for 30 sec - exiting 19:38:53 (508): No heartbeat from core client for 30 sec - exiting 19:38:54 (508): No heartbeat from core client for 30 sec - exiting 19:38:55 (508): No heartbeat from core client for 30 sec - exiting 19:38:56 (508): No heartbeat from core client for 30 sec - exiting 19:38:58 (508): No heartbeat from core client for 30 sec - exiting 19:38:59 (508): No heartbeat from core client for 30 sec - exiting 19:39:00 (508): No heartbeat from core client for 30 sec - exiting 19:39:01 (508): No heartbeat from core client for 30 sec - exiting 19:39:02 (508): No heartbeat from core client for 30 sec - exiting 19:39:03 (508): No heartbeat from core client for 30 sec - exiting 19:39:04 (508): No heartbeat from core client for 30 sec - exiting 19:39:05 (508): No heartbeat from core client for 30 sec - exiting 19:39:06 (508): No heartbeat from core client for 30 sec - exiting 19:39:07 (508): No heartbeat from core client for 30 sec - exiting 19:39:08 (508): No heartbeat from core client for 30 sec - exiting 19:39:10 (508): No heartbeat from core client for 30 sec - exiting 19:39:11 (508): No heartbeat from core client for 30 sec - exiting 19:39:12 (508): No heartbeat from core client for 30 sec - exiting 19:39:13 (508): No heartbeat from core client for 30 sec - exiting 19:39:14 (508): No heartbeat from core client for 30 sec - exiting 19:39:15 (508): No heartbeat from core client for 30 sec - exiting 19:39:16 (508): No heartbeat from core client for 30 sec - exiting 19:39:17 (508): No heartbeat from core client for 30 sec - exiting 19:39:18 (508): No heartbeat from core client for 30 sec - exiting 19:39:19 (508): No heartbeat from core client for 30 sec - exiting 19:39:21 (508): No heartbeat from core client for 30 sec - exiting 19:39:22 (508): No heartbeat from core client for 30 sec - exiting 19:39:23 (508): No heartbeat from core client for 30 sec - exiting 19:39:24 (508): No heartbeat from core client for 30 sec - exiting 19:39:25 (508): No heartbeat from core client for 30 sec - exiting 19:39:26 (508): No heartbeat from core client for 30 sec - exiting 19:39:27 (508): No heartbeat from core client for 30 sec - exiting 19:39:28 (508): No heartbeat from core client for 30 sec - exiting 19:39:29 (508): No heartbeat from core client for 30 sec - exiting 19:39:30 (508): No heartbeat from core client for 30 sec - exiting 19:39:31 (508): No heartbeat from core client for 30 sec - exiting 19:39:33 (508): No heartbeat from core client for 30 sec - exiting 19:39:34 (508): No heartbeat from core client for 30 sec - exiting 19:39:35 (508): No heartbeat from core client for 30 sec - exiting 19:39:36 (508): No heartbeat from core client for 30 sec - exiting 19:39:37 (508): No heartbeat from core client for 30 sec - exiting 19:39:38 (508): No heartbeat from core client for 30 sec - exiting 19:39:39 (508): No heartbeat from core client for 30 sec - exiting 19:39:40 (508): No heartbeat from core client for 30 sec - exiting 19:39:41 (508): No heartbeat from core client for 30 sec - exiting 19:39:42 (508): No heartbeat from core client for 30 sec - exiting 19:39:43 (508): No heartbeat from core client for 30 sec - exiting 19:39:45 (508): No heartbeat from core client for 30 sec - exiting 19:39:46 (508): No heartbeat from core client for 30 sec - exiting 19:39:47 (508): No heartbeat from core client for 30 sec - exiting 19:39:48 (508): No heartbeat from core client for 30 sec - exiting 19:39:49 (508): No heartbeat from core client for 30 sec - exiting 19:39:50 (508): No heartbeat from core client for 30 sec - exiting 19:39:51 (508): No heartbeat from core client for 30 sec - exiting 19:39:52 (508): No heartbeat from core client for 30 sec - exiting 19:39:53 (508): No heartbeat from core client for 30 sec - exiting 19:39:54 (508): No heartbeat from core client for 30 sec - exiting 19:39:55 (508): No heartbeat from core client for 30 sec - exiting 19:39:57 (508): No heartbeat from core client for 30 sec - exiting 19:39:58 (508): No heartbeat from core client for 30 sec - exiting 19:39:59 (508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:41:02 (2144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:40:11 (3544): No heartbeat from core client for 30 sec - exiting 20:40:12 (3544): No heartbeat from core client for 30 sec - exiting 20:40:13 (3544): No heartbeat from core client for 30 sec - exiting 20:40:17 (3544): No heartbeat from core client for 30 sec - exiting 20:40:18 (3544): No heartbeat from core client for 30 sec - exiting 20:40:20 (3544): No heartbeat from core client for 30 sec - exiting 20:40:21 (3544): No heartbeat from core client for 30 sec - exiting 20:40:22 (3544): No heartbeat from core client for 30 sec - exiting 20:40:23 (3544): No heartbeat from core client for 30 sec - exiting 20:40:24 (3544): No heartbeat from core client for 30 sec - exiting 20:40:25 (3544): No heartbeat from core client for 30 sec - exiting 20:40:26 (3544): No heartbeat from core client for 30 sec - exiting 20:40:27 (3544): No heartbeat from core client for 30 sec - exiting 20:40:28 (3544): No heartbeat from core client for 30 sec - exiting 20:40:29 (3544): No heartbeat from core client for 30 sec - exiting 20:40:30 (3544): No heartbeat from core client for 30 sec - exiting 20:40:32 (3544): No heartbeat from core client for 30 sec - exiting 20:40:33 (3544): No heartbeat from core client for 30 sec - exiting 20:40:34 (3544): No heartbeat from core client for 30 sec - exiting 20:40:35 (3544): No heartbeat from core client for 30 sec - exiting 20:40:36 (3544): No heartbeat from core client for 30 sec - exiting 20:40:37 (3544): No heartbeat from core client for 30 sec - exiting 20:40:38 (3544): No heartbeat from core client for 30 sec - exiting 20:40:39 (3544): No heartbeat from core client for 30 sec - exiting 20:40:40 (3544): No heartbeat from core client for 30 sec - exiting 20:40:41 (3544): No heartbeat from core client for 30 sec - exiting 20:40:43 (3544): No heartbeat from core client for 30 sec - exiting 20:40:44 (3544): No heartbeat from core client for 30 sec - exiting 20:40:45 (3544): No heartbeat from core client for 30 sec - exiting 20:40:46 (3544): No heartbeat from core client for 30 sec - exiting 20:40:47 (3544): No heartbeat from core client for 30 sec - exiting 20:40:48 (3544): No heartbeat from core client for 30 sec - exiting 20:40:49 (3544): No heartbeat from core client for 30 sec - exiting 20:40:50 (3544): No heartbeat from core client for 30 sec - exiting 20:40:51 (3544): No heartbeat from core client for 30 sec - exiting 20:40:52 (3544): No heartbeat from core client for 30 sec - exiting 20:40:53 (3544): No heartbeat from core client for 30 sec - exiting 20:40:55 (3544): No heartbeat from core client for 30 sec - exiting 20:40:56 (3544): No heartbeat from core client for 30 sec - exiting 20:40:57 (3544): No heartbeat from core client for 30 sec - exiting 20:40:58 (3544): No heartbeat from core client for 30 sec - exiting 20:40:59 (3544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:41:00 (3544): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3456, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:38:15 (2192): No heartbeat from core client for 30 sec - exiting 15:38:16 (2192): No heartbeat from core client for 30 sec - exiting 15:38:17 (2192): No heartbeat from core client for 30 sec - exiting 15:38:18 (2192): No heartbeat from core client for 30 sec - exiting 15:38:19 (2192): No heartbeat from core client for 30 sec - exiting 15:38:20 (2192): No heartbeat from core client for 30 sec - exiting 15:38:21 (2192): No heartbeat from core client for 30 sec - exiting 15:38:22 (2192): No heartbeat from core client for 30 sec - exiting 15:38:24 (2192): No heartbeat from core client for 30 sec - exiting 15:38:25 (2192): No heartbeat from core client for 30 sec - exiting 15:38:26 (2192): No heartbeat from core client for 30 sec - exiting 15:38:27 (2192): No heartbeat from core client for 30 sec - exiting 15:38:28 (2192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4072, selfPID=4072, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2608, selfPID=5000, iMonCtr=1 Model crash detected, will try to restart... 09:31:32 (2012): No heartbeat from core client for 30 sec - exiting 09:31:33 (2012): No heartbeat from core client for 30 sec - exiting 09:31:34 (2012): No heartbeat from core client for 30 sec - exiting 09:31:36 (2012): No heartbeat from core client for 30 sec - exiting 09:31:37 (2012): No heartbeat from core client for 30 sec - exiting 09:31:38 (2012): No heartbeat from core client for 30 sec - exiting 09:31:39 (2012): No heartbeat from core client for 30 sec - exiting 09:31:40 (2012): No heartbeat from core client for 30 sec - exiting 09:31:41 (2012): No heartbeat from core client for 30 sec - exiting 09:31:42 (2012): No heartbeat from core client for 30 sec - exiting 09:31:43 (2012): No heartbeat from core client for 30 sec - exiting 09:31:44 (2012): No heartbeat from core client for 30 sec - exiting 09:31:45 (2012): No heartbeat from core client for 30 sec - exiting 09:31:46 (2012): No heartbeat from core client for 30 sec - exiting 09:31:48 (2012): No heartbeat from core client for 30 sec - exiting 09:31:49 (2012): No heartbeat from core client for 30 sec - exiting 09:31:50 (2012): No heartbeat from core client for 30 sec - exiting 09:31:51 (2012): No heartbeat from core client for 30 sec - exiting 09:31:52 (2012): No heartbeat from core client for 30 sec - exiting 09:31:53 (2012): No heartbeat from core client for 30 sec - exiting 09:31:54 (2012): No heartbeat from core client for 30 sec - exiting 09:31:55 (2012): No heartbeat from core client for 30 sec - exiting 09:31:56 (2012): No heartbeat from core client for 30 sec - exiting 09:31:57 (2012): No heartbeat from core client for 30 sec - exiting 09:31:58 (2012): No heartbeat from core client for 30 sec - exiting 09:32:00 (2012): No heartbeat from core client for 30 sec - exiting 09:32:01 (2012): No heartbeat from core client for 30 sec - exiting 09:32:02 (2012): No heartbeat from core client for 30 sec - exiting 09:32:03 (2012): No heartbeat from core client for 30 sec - exiting 09:32:04 (2012): No heartbeat from core client for 30 sec - exiting 09:32:05 (2012): No heartbeat from core client for 30 sec - exiting 09:32:06 (2012): No heartbeat from core client for 30 sec - exiting 09:32:07 (2012): No heartbeat from core client for 30 sec - exiting 09:32:08 (2012): No heartbeat from core client for 30 sec - exiting 09:32:09 (2012): No heartbeat from core client for 30 sec - exiting 09:32:11 (2012): No heartbeat from core client for 30 sec - exiting 09:32:12 (2012): No heartbeat from core client for 30 sec - exiting 09:32:13 (2012): No heartbeat from core client for 30 sec - exiting 09:32:14 (2012): No heartbeat from core client for 30 sec - exiting 09:32:15 (2012): No heartbeat from core client for 30 sec - exiting 09:32:16 (2012): No heartbeat from core client for 30 sec - exiting 09:32:17 (2012): No heartbeat from core client for 30 sec - exiting 09:32:18 (2012): No heartbeat from core client for 30 sec - exiting 09:32:19 (2012): No heartbeat from core client for 30 sec - exiting 09:32:20 (2012): No heartbeat from core client for 30 sec - exiting 09:32:22 (2012): No heartbeat from core client for 30 sec - exiting 09:32:23 (2012): No heartbeat from core client for 30 sec - exiting 09:32:24 (2012): No heartbeat from core client for 30 sec - exiting 09:32:25 (2012): No heartbeat from core client for 30 sec - exiting 09:32:26 (2012): No heartbeat from core client for 30 sec - exiting 09:32:27 (2012): No heartbeat from core client for 30 sec - exiting 09:32:28 (2012): No heartbeat from core client for 30 sec - exiting 09:32:29 (2012): No heartbeat from core client for 30 sec - exiting 09:32:30 (2012): No heartbeat from core client for 30 sec - exiting 09:32:31 (2012): No heartbeat from core client for 30 sec - exiting 09:32:32 (2012): No heartbeat from core client for 30 sec - exiting 09:32:34 (2012): No heartbeat from core client for 30 sec - exiting 09:32:35 (2012): No heartbeat from core client for 30 sec - exiting 09:32:36 (2012): No heartbeat from core client for 30 sec - exiting 09:32:37 (2012): No heartbeat from core client for 30 sec - exiting 09:32:38 (2012): No heartbeat from core client for 30 sec - exiting 09:32:39 (2012): No heartbeat from core client for 30 sec - exiting 09:32:40 (2012): No heartbeat from core client for 30 sec - exiting 09:32:41 (2012): No heartbeat from core client for 30 sec - exiting 09:32:42 (2012): No heartbeat from core client for 30 sec - exiting 09:32:43 (2012): No heartbeat from core client for 30 sec - exiting 09:32:44 (2012): No heartbeat from core client for 30 sec - exiting 09:32:46 (2012): No heartbeat from core client for 30 sec - exiting 09:32:47 (2012): No heartbeat from core client for 30 sec - exiting 09:32:48 (2012): No heartbeat from core client for 30 sec - exiting 09:32:49 (2012): No heartbeat from core client for 30 sec - exiting 09:32:50 (2012): No heartbeat from core client for 30 sec - exiting 09:32:51 (2012): No heartbeat from core client for 30 sec - exiting 09:32:52 (2012): No heartbeat from core client for 30 sec - exiting 09:32:53 (2012): No heartbeat from core client for 30 sec - exiting 09:32:54 (2012): No heartbeat from core client for 30 sec - exiting 09:32:55 (2012): No heartbeat from core client for 30 sec - exiting 09:32:56 (2012): No heartbeat from core client for 30 sec - exiting 09:32:58 (2012): No heartbeat from core client for 30 sec - exiting 09:32:59 (2012): No heartbeat from core client for 30 sec - exiting 09:33:00 (2012): No heartbeat from core client for 30 sec - exiting 09:33:01 (2012): No heartbeat from core client for 30 sec - exiting 09:33:02 (2012): No heartbeat from core client for 30 sec - exiting 09:33:03 (2012): No heartbeat from core client for 30 sec - exiting 09:33:04 (2012): No heartbeat from core client for 30 sec - exiting 09:33:05 (2012): No heartbeat from core client for 30 sec - exiting 09:33:06 (2012): No heartbeat from core client for 30 sec - exiting 09:33:07 (2012): No heartbeat from core client for 30 sec - exiting 09:33:08 (2012): No heartbeat from core client for 30 sec - exiting 09:33:10 (2012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Apr 2012 09:48:07	1186953	13713898	hadam3p_pnw_6ww5_1999_1_007591213_0	138,336	424,010	3.0651
05 Apr 2012 19:36:06	1186953	13713898	hadam3p_pnw_6ww5_1999_1_007591213_0	126,816	389,329	3.0700
30 Mar 2012 20:30:44	1186953	13713898	hadam3p_pnw_6ww5_1999_1_007591213_0	115,296	354,911	3.0783
22 Mar 2012 21:32:57	1186953	13713898	hadam3p_pnw_6ww5_1999_1_007591213_0	103,776	320,233	3.0858
19 Mar 2012 19:14:09	1186953	13713898	hadam3p_pnw_6ww5_1999_1_007591213_0	92,256	285,249	3.0919
15 Mar 2012 15:34:35	1186953	13713898	hadam3p_pnw_6ww5_1999_1_007591213_0	80,736	250,351	3.1009
09 Mar 2012 21:48:43	1186953	13713898	hadam3p_pnw_6ww5_1999_1_007591213_0	69,216	215,429	3.1124
28 Feb 2012 22:47:49	1186953	13713898	hadam3p_pnw_6ww5_1999_1_007591213_0	57,706	179,304	3.1072
28 Feb 2012 21:44:24	1186953	13713898	hadam3p_pnw_6ww5_1999_1_007591213_0	57,696	178,823	3.0994
19 Feb 2012 10:14:42	1186953	13713898	hadam3p_pnw_6ww5_1999_1_007591213_0	46,176	143,534	3.1084
29 Jan 2012 22:12:01	1186953	13713898	hadam3p_pnw_6ww5_1999_1_007591213_0	34,656	108,154	3.1208
18 Jan 2012 22:44:22	1186953	13713898	hadam3p_pnw_6ww5_1999_1_007591213_0	23,136	72,051	3.1142
10 Jan 2012 21:41:09	1186953	13713898	hadam3p_pnw_6ww5_1999_1_007591213_0	11,616	37,051	3.1897