Task 13314863

Name	hadam3p_saf_29z9_1961_1_007428901_2
Workunit	7626404
Created	30 Aug 2011, 2:20:51 UTC
Sent	30 Aug 2011, 2:21:10 UTC
Report deadline	11 Aug 2012, 7:41:10 UTC
Received	9 Dec 2011, 8:31:03 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1160009
Run time	6 days 0 hours 14 min 31 sec
CPU time	5 days 14 hours 11 min 51 sec
Validate state	Workunit error - check skipped
Credit	2,242.53
Device peak FLOPS	2.45 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9796, selfPID=9796, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1408, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5756, selfPID=6404, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6788, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6796, selfPID=5152, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5752, selfPID=4292, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4944, selfPID=5884, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3664, selfPID=5344, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2216, selfPID=4704, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7556, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7548, selfPID=4512, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4436, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 20:48:59 (3532): No heartbeat from core client for 30 sec - exiting 20:49:00 (3532): No heartbeat from core client for 30 sec - exiting 20:49:01 (3532): No heartbeat from core client for 30 sec - exiting 20:49:02 (3532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5780, selfPID=4892, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3720, selfPID=4956, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6128, selfPID=3872, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7324, selfPID=316, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:02:48 (5260): No heartbeat from core client for 30 sec - exiting 18:02:49 (5260): No heartbeat from core client for 30 sec - exiting 18:02:50 (5260): No heartbeat from core client for 30 sec - exiting 18:02:51 (5260): No heartbeat from core client for 30 sec - exiting 18:02:53 (5260): No heartbeat from core client for 30 sec - exiting 18:02:54 (5260): No heartbeat from core client for 30 sec - exiting 18:02:55 (5260): No heartbeat from core client for 30 sec - exiting 18:02:56 (5260): No heartbeat from core client for 30 sec - exiting 18:02:57 (5260): No heartbeat from core client for 30 sec - exiting 18:02:58 (5260): No heartbeat from core client for 30 sec - exiting 18:02:59 (5260): No heartbeat from core client for 30 sec - exiting 18:03:00 (5260): No heartbeat from core client for 30 sec - exiting 18:03:01 (5260): No heartbeat from core client for 30 sec - exiting 18:03:02 (5260): No heartbeat from core client for 30 sec - exiting 18:03:03 (5260): No heartbeat from core client for 30 sec - exiting 18:03:05 (5260): No heartbeat from core client for 30 sec - exiting 18:03:06 (5260): No heartbeat from core client for 30 sec - exiting 18:03:07 (5260): No heartbeat from core client for 30 sec - exiting 18:03:08 (5260): No heartbeat from core client for 30 sec - exiting 18:03:09 (5260): No heartbeat from core client for 30 sec - exiting 18:03:10 (5260): No heartbeat from core client for 30 sec - exiting 18:03:11 (5260): No heartbeat from core client for 30 sec - exiting 18:03:12 (5260): No heartbeat from core client for 30 sec - exiting 18:03:13 (5260): No heartbeat from core client for 30 sec - exiting 18:03:14 (5260): No heartbeat from core client for 30 sec - exiting 18:03:15 (5260): No heartbeat from core client for 30 sec - exiting 18:03:17 (5260): No heartbeat from core client for 30 sec - exiting 18:03:18 (5260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6964, selfPID=6856, iMonCtr=1 Model crash detected, will try to restart... 11:15:09 (2720): No heartbeat from core client for 30 sec - exiting 11:15:11 (2720): No heartbeat from core client for 30 sec - exiting 11:15:12 (2720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6572, selfPID=6572, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... 08:17:34 (5024): No heartbeat from core client for 30 sec - exiting 08:17:35 (5024): No heartbeat from core client for 30 sec - exiting 08:17:37 (5024): No heartbeat from core client for 30 sec - exiting 08:17:38 (5024): No heartbeat from core client for 30 sec - exiting 08:17:39 (5024): No heartbeat from core client for 30 sec - exiting 08:17:40 (5024): No heartbeat from core client for 30 sec - exiting 08:17:41 (5024): No heartbeat from core client for 30 sec - exiting 08:17:42 (5024): No heartbeat from core client for 30 sec - exiting 08:17:43 (5024): No heartbeat from core client for 30 sec - exiting 08:17:44 (5024): No heartbeat from core client for 30 sec - exiting 08:17:45 (5024): No heartbeat from core client for 30 sec - exiting 08:17:46 (5024): No heartbeat from core client for 30 sec - exiting 08:17:47 (5024): No heartbeat from core client for 30 sec - exiting 08:17:49 (5024): No heartbeat from core client for 30 sec - exiting 08:17:50 (5024): No heartbeat from core client for 30 sec - exiting 08:17:51 (5024): No heartbeat from core client for 30 sec - exiting 08:17:52 (5024): No heartbeat from core client for 30 sec - exiting 08:17:53 (5024): No heartbeat from core client for 30 sec - exiting 08:17:54 (5024): No heartbeat from core client for 30 sec - exiting 08:17:55 (5024): No heartbeat from core client for 30 sec - exiting 08:17:56 (5024): No heartbeat from core client for 30 sec - exiting 08:17:57 (5024): No heartbeat from core client for 30 sec - exiting 08:17:58 (5024): No heartbeat from core client for 30 sec - exiting 08:17:59 (5024): No heartbeat from core client for 30 sec - exiting 08:18:01 (5024): No heartbeat from core client for 30 sec - exiting 08:18:02 (5024): No heartbeat from core client for 30 sec - exiting 08:18:03 (5024): No heartbeat from core client for 30 sec - exiting 08:18:04 (5024): No heartbeat from core client for 30 sec - exiting 08:18:05 (5024): No heartbeat from core client for 30 sec - exiting 08:18:06 (5024): No heartbeat from core client for 30 sec - exiting 08:18:07 (5024): No heartbeat from core client for 30 sec - exiting 08:18:08 (5024): No heartbeat from core client for 30 sec - exiting 08:18:09 (5024): No heartbeat from core client for 30 sec - exiting 08:18:10 (5024): No heartbeat from core client for 30 sec - exiting 08:18:12 (5024): No heartbeat from core client for 30 sec - exiting 08:18:13 (5024): No heartbeat from core client for 30 sec - exiting 08:18:14 (5024): No heartbeat from core client for 30 sec - exiting 08:18:15 (5024): No heartbeat from core client for 30 sec - exiting 08:18:16 (5024): No heartbeat from core client for 30 sec - exiting 08:18:17 (5024): No heartbeat from core client for 30 sec - exiting 08:18:18 (5024): No heartbeat from core client for 30 sec - exiting 08:18:19 (5024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:57:48 (4916): No heartbeat from core client for 30 sec - exiting 15:57:49 (4916): No heartbeat from core client for 30 sec - exiting 15:57:51 (4916): No heartbeat from core client for 30 sec - exiting 15:57:52 (4916): No heartbeat from core client for 30 sec - exiting 15:57:53 (4916): No heartbeat from core client for 30 sec - exiting 15:57:54 (4916): No heartbeat from core client for 30 sec - exiting 15:57:55 (4916): No heartbeat from core client for 30 sec - exiting 15:57:56 (4916): No heartbeat from core client for 30 sec - exiting 15:57:57 (4916): No heartbeat from core client for 30 sec - exiting 15:57:58 (4916): No heartbeat from core client for 30 sec - exiting 15:57:59 (4916): No heartbeat from core client for 30 sec - exiting 15:58:00 (4916): No heartbeat from core client for 30 sec - exiting 15:58:01 (4916): No heartbeat from core client for 30 sec - exiting 15:58:03 (4916): No heartbeat from core client for 30 sec - exiting 15:58:04 (4916): No heartbeat from core client for 30 sec - exiting 15:58:05 (4916): No heartbeat from core client for 30 sec - exiting 15:58:06 (4916): No heartbeat from core client for 30 sec - exiting 15:58:07 (4916): No heartbeat from core client for 30 sec - exiting 15:58:08 (4916): No heartbeat from core client for 30 sec - exiting 15:58:09 (4916): No heartbeat from core client for 30 sec - exiting 15:58:10 (4916): No heartbeat from core client for 30 sec - exiting 15:58:11 (4916): No heartbeat from core client for 30 sec - exiting 15:58:12 (4916): No heartbeat from core client for 30 sec - exiting 15:58:13 (4916): No heartbeat from core client for 30 sec - exiting 15:58:15 (4916): No heartbeat from core client for 30 sec - exiting 15:58:16 (4916): No heartbeat from core client for 30 sec - exiting 15:58:17 (4916): No heartbeat from core client for 30 sec - exiting 15:58:18 (4916): No heartbeat from core client for 30 sec - exiting 15:58:19 (4916): No heartbeat from core client for 30 sec - exiting 15:58:20 (4916): No heartbeat from core client for 30 sec - exiting 15:58:21 (4916): No heartbeat from core client for 30 sec - exiting 15:58:22 (4916): No heartbeat from core client for 30 sec - exiting 15:58:23 (4916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4176, iMonCtr=2 16:49:52 (4968): No heartbeat from core client for 30 sec - exiting 16:49:53 (4968): No heartbeat from core client for 30 sec - exiting 16:49:54 (4968): No heartbeat from core client for 30 sec - exiting 16:49:55 (4968): No heartbeat from core client for 30 sec - exiting 16:49:56 (4968): No heartbeat from core client for 30 sec - exiting 16:49:58 (4968): No heartbeat from core client for 30 sec - exiting 16:49:59 (4968): No heartbeat from core client for 30 sec - exiting 16:50:00 (4968): No heartbeat from core client for 30 sec - exiting 16:50:01 (4968): No heartbeat from core client for 30 sec - exiting 16:50:02 (4968): No heartbeat from core client for 30 sec - exiting 16:50:03 (4968): No heartbeat from core client for 30 sec - exiting 16:50:04 (4968): No heartbeat from core client for 30 sec - exiting 16:50:05 (4968): No heartbeat from core client for 30 sec - exiting 16:50:06 (4968): No heartbeat from core client for 30 sec - exiting 16:50:07 (4968): No heartbeat from core client for 30 sec - exiting 16:50:08 (4968): No heartbeat from core client for 30 sec - exiting 16:50:10 (4968): No heartbeat from core client for 30 sec - exiting 16:50:11 (4968): No heartbeat from core client for 30 sec - exiting 16:50:12 (4968): No heartbeat from core client for 30 sec - exiting 16:50:13 (4968): No heartbeat from core client for 30 sec - exiting 16:50:14 (4968): No heartbeat from core client for 30 sec - exiting 16:50:15 (4968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4164, selfPID=1808, iMonCtr=1 Model crash detected, will try to restart... 17:18:32 (4728): No heartbeat from core client for 30 sec - exiting 17:18:34 (4728): No heartbeat from core client for 30 sec - exiting 17:18:35 (4728): No heartbeat from core client for 30 sec - exiting 17:18:36 (4728): No heartbeat from core client for 30 sec - exiting 17:18:37 (4728): No heartbeat from core client for 30 sec - exiting 17:18:38 (4728): No heartbeat from core client for 30 sec - exiting 17:18:39 (4728): No heartbeat from core client for 30 sec - exiting 17:18:40 (4728): No heartbeat from core client for 30 sec - exiting 17:18:41 (4728): No heartbeat from core client for 30 sec - exiting 17:18:42 (4728): No heartbeat from core client for 30 sec - exiting 17:18:43 (4728): No heartbeat from core client for 30 sec - exiting 17:18:44 (4728): No heartbeat from core client for 30 sec - exiting 17:18:46 (4728): No heartbeat from core client for 30 sec - exiting 17:18:47 (4728): No heartbeat from core client for 30 sec - exiting 17:18:48 (4728): No heartbeat from core client for 30 sec - exiting 17:18:49 (4728): No heartbeat from core client for 30 sec - exiting 17:18:50 (4728): No heartbeat from core client for 30 sec - exiting 17:18:51 (4728): No heartbeat from core client for 30 sec - exiting 17:18:52 (4728): No heartbeat from core client for 30 sec - exiting 17:18:53 (4728): No heartbeat from core client for 30 sec - exiting 17:18:54 (4728): No heartbeat from core client for 30 sec - exiting 17:18:55 (4728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4988, iMonCtr=2 19:27:55 (4912): No heartbeat from core client for 30 sec - exiting 19:27:57 (4912): No heartbeat from core client for 30 sec - exiting 19:27:58 (4912): No heartbeat from core client for 30 sec - exiting 19:27:59 (4912): No heartbeat from core client for 30 sec - exiting 19:28:00 (4912): No heartbeat from core client for 30 sec - exiting 19:28:01 (4912): No heartbeat from core client for 30 sec - exiting 19:28:02 (4912): No heartbeat from core client for 30 sec - exiting 19:28:03 (4912): No heartbeat from core client for 30 sec - exiting 19:28:04 (4912): No heartbeat from core client for 30 sec - exiting 19:28:05 (4912): No heartbeat from core client for 30 sec - exiting 19:28:06 (4912): No heartbeat from core client for 30 sec - exiting 19:28:08 (4912): No heartbeat from core client for 30 sec - exiting 19:28:09 (4912): No heartbeat from core client for 30 sec - exiting 19:28:10 (4912): No heartbeat from core client for 30 sec - exiting 19:28:11 (4912): No heartbeat from core client for 30 sec - exiting 19:28:12 (4912): No heartbeat from core client for 30 sec - exiting 19:28:13 (4912): No heartbeat from core client for 30 sec - exiting 19:28:14 (4912): No heartbeat from core client for 30 sec - exiting 19:28:15 (4912): No heartbeat from core client for 30 sec - exiting 19:28:16 (4912): No heartbeat from core client for 30 sec - exiting 19:28:17 (4912): No heartbeat from core client for 30 sec - exiting 19:28:18 (4912): No heartbeat from core client for 30 sec - exiting 19:28:20 (4912): No heartbeat from core client for 30 sec - exiting 19:28:21 (4912): No heartbeat from core client for 30 sec - exiting 19:28:22 (4912): No heartbeat from core client for 30 sec - exiting 19:28:23 (4912): No heartbeat from core client for 30 sec - exiting 19:28:24 (4912): No heartbeat from core client for 30 sec - exiting 19:28:25 (4912): No heartbeat from core client for 30 sec - exiting 19:28:26 (4912): No heartbeat from core client for 30 sec - exiting 19:28:27 (4912): No heartbeat from core client for 30 sec - exiting 19:28:28 (4912): No heartbeat from core client for 30 sec - exiting 19:28:30 (4912): No heartbeat from core client for 30 sec - exiting 19:28:31 (4912): No heartbeat from core client for 30 sec - exiting 19:28:32 (4912): No heartbeat from core client for 30 sec - exiting 19:28:33 (4912): No heartbeat from core client for 30 sec - exiting 19:28:34 (4912): No heartbeat from core client for 30 sec - exiting 19:28:35 (4912): No heartbeat from core client for 30 sec - exiting 19:28:36 (4912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:17:05 (4924): No heartbeat from core client for 30 sec - exiting 08:17:06 (4924): No heartbeat from core client for 30 sec - exiting 08:17:08 (4924): No heartbeat from core client for 30 sec - exiting 08:17:09 (4924): No heartbeat from core client for 30 sec - exiting 08:17:10 (4924): No heartbeat from core client for 30 sec - exiting 08:17:11 (4924): No heartbeat from core client for 30 sec - exiting 08:17:12 (4924): No heartbeat from core client for 30 sec - exiting 08:17:13 (4924): No heartbeat from core client for 30 sec - exiting 08:17:14 (4924): No heartbeat from core client for 30 sec - exiting 08:17:15 (4924): No heartbeat from core client for 30 sec - exiting 08:17:16 (4924): No heartbeat from core client for 30 sec - exiting 08:17:17 (4924): No heartbeat from core client for 30 sec - exiting 08:17:18 (4924): No heartbeat from core client for 30 sec - exiting 08:17:20 (4924): No heartbeat from core client for 30 sec - exiting 08:17:21 (4924): No heartbeat from core client for 30 sec - exiting 08:17:22 (4924): No heartbeat from core client for 30 sec - exiting 08:17:23 (4924): No heartbeat from core client for 30 sec - exiting 08:17:24 (4924): No heartbeat from core client for 30 sec - exiting 08:17:25 (4924): No heartbeat from core client for 30 sec - exiting 08:17:26 (4924): No heartbeat from core client for 30 sec - exiting 08:17:27 (4924): No heartbeat from core client for 30 sec - exiting 08:17:28 (4924): No heartbeat from core client for 30 sec - exiting 08:17:30 (4924): No heartbeat from core client for 30 sec - exiting 08:17:31 (4924): No heartbeat from core client for 30 sec - exiting 08:17:32 (4924): No heartbeat from core client for 30 sec - exiting 08:17:33 (4924): No heartbeat from core client for 30 sec - exiting 08:17:34 (4924): No heartbeat from core client for 30 sec - exiting 08:17:35 (4924): No heartbeat from core client for 30 sec - exiting 08:17:36 (4924): No heartbeat from core client for 30 sec - exiting 08:17:37 (4924): No heartbeat from core client for 30 sec - exiting 08:17:38 (4924): No heartbeat from core client for 30 sec - exiting 08:17:39 (4924): No heartbeat from core client for 30 sec - exiting 08:17:40 (4924): No heartbeat from core client for 30 sec - exiting 08:17:42 (4924): No heartbeat from core client for 30 sec - exiting 08:17:43 (4924): No heartbeat from core client for 30 sec - exiting 08:17:44 (4924): No heartbeat from core client for 30 sec - exiting 08:17:45 (4924): No heartbeat from core client for 30 sec - exiting 08:17:46 (4924): No heartbeat from core client for 30 sec - exiting 08:17:47 (4924): No heartbeat from core client for 30 sec - exiting 08:17:48 (4924): No heartbeat from core client for 30 sec - exiting 08:17:49 (4924): No heartbeat from core client for 30 sec - exiting 08:17:50 (4924): No heartbeat from core client for 30 sec - exiting 08:17:51 (4924): No heartbeat from core client for 30 sec - exiting 08:17:52 (4924): No heartbeat from core client for 30 sec - exiting 08:17:54 (4924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:25:48 (2008): No heartbeat from core client for 30 sec - exiting 19:25:49 (2008): No heartbeat from core client for 30 sec - exiting 19:25:50 (2008): No heartbeat from core client for 30 sec - exiting 19:25:51 (2008): No heartbeat from core client for 30 sec - exiting 19:25:52 (2008): No heartbeat from core client for 30 sec - exiting 19:25:53 (2008): No heartbeat from core client for 30 sec - exiting 19:25:54 (2008): No heartbeat from core client for 30 sec - exiting 19:25:56 (2008): No heartbeat from core client for 30 sec - exiting 19:25:57 (2008): No heartbeat from core client for 30 sec - exiting 19:25:58 (2008): No heartbeat from core client for 30 sec - exiting 19:25:59 (2008): No heartbeat from core client for 30 sec - exiting 19:26:00 (2008): No heartbeat from core client for 30 sec - exiting 19:26:01 (2008): No heartbeat from core client for 30 sec - exiting 19:26:02 (2008): No heartbeat from core client for 30 sec - exiting 19:26:03 (2008): No heartbeat from core client for 30 sec - exiting 19:26:04 (2008): No heartbeat from core client for 30 sec - exiting 19:26:05 (2008): No heartbeat from core client for 30 sec - exiting 19:26:06 (2008): No heartbeat from core client for 30 sec - exiting 19:26:08 (2008): No heartbeat from core client for 30 sec - exiting 19:26:09 (2008): No heartbeat from core client for 30 sec - exiting 19:26:10 (2008): No heartbeat from core client for 30 sec - exiting 19:26:11 (2008): No heartbeat from core client for 30 sec - exiting 19:26:12 (2008): No heartbeat from core client for 30 sec - exiting 19:26:13 (2008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4420, iMonCtr=2 19:42:29 (5176): No heartbeat from core client for 30 sec - exiting 19:42:31 (5176): No heartbeat from core client for 30 sec - exiting 19:42:32 (5176): No heartbeat from core client for 30 sec - exiting 19:42:33 (5176): No heartbeat from core client for 30 sec - exiting 19:42:34 (5176): No heartbeat from core client for 30 sec - exiting 19:42:35 (5176): No heartbeat from core client for 30 sec - exiting 19:42:36 (5176): No heartbeat from core client for 30 sec - exiting 19:42:37 (5176): No heartbeat from core client for 30 sec - exiting 19:42:38 (5176): No heartbeat from core client for 30 sec - exiting 19:42:39 (5176): No heartbeat from core client for 30 sec - exiting 19:42:41 (5176): No heartbeat from core client for 30 sec - exiting 19:42:42 (5176): No heartbeat from core client for 30 sec - exiting 19:42:43 (5176): No heartbeat from core client for 30 sec - exiting 19:42:44 (5176): No heartbeat from core client for 30 sec - exiting 19:42:45 (5176): No heartbeat from core client for 30 sec - exiting 19:42:46 (5176): No heartbeat from core client for 30 sec - exiting 19:42:47 (5176): No heartbeat from core client for 30 sec - exiting 19:42:48 (5176): No heartbeat from core client for 30 sec - exiting 19:42:49 (5176): No heartbeat from core client for 30 sec - exiting 19:42:50 (5176): No heartbeat from core client for 30 sec - exiting 19:42:51 (5176): No heartbeat from core client for 30 sec - exiting 19:42:53 (5176): No heartbeat from core client for 30 sec - exiting 19:42:54 (5176): No heartbeat from core client for 30 sec - exiting 19:42:55 (5176): No heartbeat from core client for 30 sec - exiting 19:42:56 (5176): No heartbeat from core client for 30 sec - exiting 19:42:57 (5176): No heartbeat from core client for 30 sec - exiting 19:42:58 (5176): No heartbeat from core client for 30 sec - exiting 19:42:59 (5176): No heartbeat from core client for 30 sec - exiting 19:43:00 (5176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6776, iMonCtr=2 19:31:33 (4884): No heartbeat from core client for 30 sec - exiting 19:31:34 (4884): No heartbeat from core client for 30 sec - exiting 19:31:35 (4884): No heartbeat from core client for 30 sec - exiting 19:31:36 (4884): No heartbeat from core client for 30 sec - exiting 19:31:37 (4884): No heartbeat from core client for 30 sec - exiting 19:31:39 (4884): No heartbeat from core client for 30 sec - exiting 19:31:40 (4884): No heartbeat from core client for 30 sec - exiting 19:31:41 (4884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:03:43 (2912): No heartbeat from core client for 30 sec - exiting 08:03:44 (2912): No heartbeat from core client for 30 sec - exiting 08:03:45 (2912): No heartbeat from core client for 30 sec - exiting 08:03:47 (2912): No heartbeat from core client for 30 sec - exiting 08:03:48 (2912): No heartbeat from core client for 30 sec - exiting 08:03:49 (2912): No heartbeat from core client for 30 sec - exiting 08:03:50 (2912): No heartbeat from core client for 30 sec - exiting 08:03:51 (2912): No heartbeat from core client for 30 sec - exiting 08:03:52 (2912): No heartbeat from core client for 30 sec - exiting 08:03:53 (2912): No heartbeat from core client for 30 sec - exiting 08:03:54 (2912): No heartbeat from core client for 30 sec - exiting 08:03:55 (2912): No heartbeat from core client for 30 sec - exiting 08:03:56 (2912): No heartbeat from core client for 30 sec - exiting 08:03:57 (2912): No heartbeat from core client for 30 sec - exiting 08:03:59 (2912): No heartbeat from core client for 30 sec - exiting 08:04:00 (2912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:38:05 (4200): No heartbeat from core client for 30 sec - exiting 17:38:06 (4200): No heartbeat from core client for 30 sec - exiting 17:38:07 (4200): No heartbeat from core client for 30 sec - exiting 17:38:08 (4200): No heartbeat from core client for 30 sec - exiting 17:38:09 (4200): No heartbeat from core client for 30 sec - exiting 17:38:11 (4200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6228, selfPID=5520, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 07:44:13 (5032): No heartbeat from core client for 30 sec - exiting 07:44:14 (5032): No heartbeat from core client for 30 sec - exiting 07:44:15 (5032): No heartbeat from core client for 30 sec - exiting 07:44:16 (5032): No heartbeat from core client for 30 sec - exiting 07:44:18 (5032): No heartbeat from core client for 30 sec - exiting 07:44:19 (5032): No heartbeat from core client for 30 sec - exiting 07:44:20 (5032): No heartbeat from core client for 30 sec - exiting 07:44:21 (5032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:13:51 (5060): No heartbeat from core client for 30 sec - exiting 10:13:52 (5060): No heartbeat from core client for 30 sec - exiting 10:13:53 (5060): No heartbeat from core client for 30 sec - exiting 10:13:54 (5060): No heartbeat from core client for 30 sec - exiting 10:13:56 (5060): No heartbeat from core client for 30 sec - exiting 10:13:57 (5060): No heartbeat from core client for 30 sec - exiting 10:13:58 (5060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4136, selfPID=5080, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7636, selfPID=6948, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 21:13:26 (5036): No heartbeat from core client for 30 sec - exiting 21:13:27 (5036): No heartbeat from core client for 30 sec - exiting 21:13:28 (5036): No heartbeat from core client for 30 sec - exiting 21:13:29 (5036): No heartbeat from core client for 30 sec - exiting 21:13:30 (5036): No heartbeat from core client for 30 sec - exiting 21:13:31 (5036): No heartbeat from core client for 30 sec - exiting 21:13:33 (5036): No heartbeat from core client for 30 sec - exiting 21:13:34 (5036): No heartbeat from core client for 30 sec - exiting 21:13:35 (5036): No heartbeat from core client for 30 sec - exiting 21:13:36 (5036): No heartbeat from core client for 30 sec - exiting 21:13:37 (5036): No heartbeat from core client for 30 sec - exiting 21:13:38 (5036): No heartbeat from core client for 30 sec - exiting 21:13:39 (5036): No heartbeat from core client for 30 sec - exiting 21:13:40 (5036): No heartbeat from core client for 30 sec - exiting 21:13:41 (5036): No heartbeat from core client for 30 sec - exiting 21:13:42 (5036): No heartbeat from core client for 30 sec - exiting 21:13:43 (5036): No heartbeat from core client for 30 sec - exiting 21:13:45 (5036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6344, iMonCtr=2 18:39:42 (2360): No heartbeat from core client for 30 sec - exiting 18:39:43 (2360): No heartbeat from core client for 30 sec - exiting 18:39:44 (2360): No heartbeat from core client for 30 sec - exiting 18:39:45 (2360): No heartbeat from core client for 30 sec - exiting 18:39:47 (2360): No heartbeat from core client for 30 sec - exiting 18:39:48 (2360): No heartbeat from core client for 30 sec - exiting 18:39:49 (2360): No heartbeat from core client for 30 sec - exiting 18:39:50 (2360): No heartbeat from core client for 30 sec - exiting 18:39:51 (2360): No heartbeat from core client for 30 sec - exiting 18:39:52 (2360): No heartbeat from core client for 30 sec - exiting 18:39:53 (2360): No heartbeat from core client for 30 sec - exiting 18:39:54 (2360): No heartbeat from core client for 30 sec - exiting 18:39:55 (2360): No heartbeat from core client for 30 sec - exiting 18:39:56 (2360): No heartbeat from core client for 30 sec - exiting 18:39:58 (2360): No heartbeat from core client for 30 sec - exiting 18:39:59 (2360): No heartbeat from core client for 30 sec - exiting 18:40:00 (2360): No heartbeat from core client for 30 sec - exiting 18:40:01 (2360): No heartbeat from core client for 30 sec - exiting 18:40:02 (2360): No heartbeat from core client for 30 sec - exiting 18:40:03 (2360): No heartbeat from core client for 30 sec - exiting 18:40:04 (2360): No heartbeat from core client for 30 sec - exiting 18:40:05 (2360): No heartbeat from core client for 30 sec - exiting 18:40:06 (2360): No heartbeat from core client for 30 sec - exiting 18:40:07 (2360): No heartbeat from core client for 30 sec - exiting 18:40:08 (2360): No heartbeat from core client for 30 sec - exiting 18:40:10 (2360): No heartbeat from core client for 30 sec - exiting 18:41:28 (2360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:41:29 (2360): No heartbeat from core client for 30 sec - exiting 18:41:30 (2360): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 17:40:46 (4468): No heartbeat from core client for 30 sec - exiting 17:40:47 (4468): No heartbeat from core client for 30 sec - exiting 17:40:48 (4468): No heartbeat from core client for 30 sec - exiting 17:40:49 (4468): No heartbeat from core client for 30 sec - exiting 17:40:50 (4468): No heartbeat from core client for 30 sec - exiting 17:40:51 (4468): No heartbeat from core client for 30 sec - exiting 17:40:52 (4468): No heartbeat from core client for 30 sec - exiting 17:40:53 (4468): No heartbeat from core client for 30 sec - exiting 17:40:55 (4468): No heartbeat from core client for 30 sec - exiting 17:40:56 (4468): No heartbeat from core client for 30 sec - exiting 17:40:57 (4468): No heartbeat from core client for 30 sec - exiting 17:40:58 (4468): No heartbeat from core client for 30 sec - exiting 17:40:59 (4468): No heartbeat from core client for 30 sec - exiting 17:41:00 (4468): No heartbeat from core client for 30 sec - exiting 17:41:01 (4468): No heartbeat from core client for 30 sec - exiting 17:41:02 (4468): No heartbeat from core client for 30 sec - exiting 17:41:03 (4468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6212, selfPID=7908, iMonCtr=1 Model crash detected, will try to restart... 10:45:41 (2360): No heartbeat from core client for 30 sec - exiting 10:45:43 (2360): No heartbeat from core client for 30 sec - exiting 10:45:44 (2360): No heartbeat from core client for 30 sec - exiting 10:45:45 (2360): No heartbeat from core client for 30 sec - exiting 10:45:46 (2360): No heartbeat from core client for 30 sec - exiting 10:45:47 (2360): No heartbeat from core client for 30 sec - exiting 10:45:48 (2360): No heartbeat from core client for 30 sec - exiting 10:45:49 (2360): No heartbeat from core client for 30 sec - exiting 10:45:50 (2360): No heartbeat from core client for 30 sec - exiting 10:45:51 (2360): No heartbeat from core client for 30 sec - exiting 10:45:53 (2360): No heartbeat from core client for 30 sec - exiting 10:45:54 (2360): No heartbeat from core client for 30 sec - exiting 10:45:55 (2360): No heartbeat from core client for 30 sec - exiting 10:45:56 (2360): No heartbeat from core client for 30 sec - exiting 10:45:57 (2360): No heartbeat from core client for 30 sec - exiting 10:45:58 (2360): No heartbeat from core client for 30 sec - exiting 10:45:59 (2360): No heartbeat from core client for 30 sec - exiting 10:46:00 (2360): No heartbeat from core client for 30 sec - exiting 10:46:01 (2360): No heartbeat from core client for 30 sec - exiting 10:46:02 (2360): No heartbeat from core client for 30 sec - exiting 10:46:03 (2360): No heartbeat from core client for 30 sec - exiting 10:46:05 (2360): No heartbeat from core client for 30 sec - exiting 10:46:06 (2360): No heartbeat from core client for 30 sec - exiting 10:46:07 (2360): No heartbeat from core client for 30 sec - exiting 10:46:08 (2360): No heartbeat from core client for 30 sec - exiting 10:46:09 (2360): No heartbeat from core client for 30 sec - exiting 10:46:10 (2360): No heartbeat from core client for 30 sec - exiting 10:46:11 (2360): No heartbeat from core client for 30 sec - exiting 10:46:12 (2360): No heartbeat from core client for 30 sec - exiting 10:46:13 (2360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6676, selfPID=5736, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 19:32:00 (4816): No heartbeat from core client for 30 sec - exiting 19:32:01 (4816): No heartbeat from core client for 30 sec - exiting 19:32:02 (4816): No heartbeat from core client for 30 sec - exiting 19:32:03 (4816): No heartbeat from core client for 30 sec - exiting 19:32:04 (4816): No heartbeat from core client for 30 sec - exiting 19:32:05 (4816): No heartbeat from core client for 30 sec - exiting 19:32:06 (4816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7124, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Dec 2011 05:12:05	1160009	13314863	hadam3p_saf_29z9_1961_1_007428901_2	138,240	481,819	3.4854
02 Dec 2011 23:03:41	1160009	13314863	hadam3p_saf_29z9_1961_1_007428901_2	126,720	441,886	3.4871
22 Nov 2011 08:38:47	1160009	13314863	hadam3p_saf_29z9_1961_1_007428901_2	115,207	405,788	3.5223
22 Nov 2011 08:38:47	1160009	13314863	hadam3p_saf_29z9_1961_1_007428901_2	115,200	405,265	3.5179
15 Nov 2011 19:06:26	1160009	13314863	hadam3p_saf_29z9_1961_1_007428901_2	103,680	368,134	3.5507
15 Nov 2011 19:06:26	1160009	13314863	hadam3p_saf_29z9_1961_1_007428901_2	92,160	327,527	3.5539
31 Oct 2011 16:55:33	1160009	13314863	hadam3p_saf_29z9_1961_1_007428901_2	80,640	285,668	3.5425
18 Oct 2011 14:36:55	1160009	13314863	hadam3p_saf_29z9_1961_1_007428901_2	69,120	243,012	3.5158
09 Oct 2011 04:02:38	1160009	13314863	hadam3p_saf_29z9_1961_1_007428901_2	57,696	202,086	3.5026
08 Oct 2011 06:30:23	1160009	13314863	hadam3p_saf_29z9_1961_1_007428901_2	46,176	161,981	3.5079
07 Oct 2011 08:05:11	1160009	13314863	hadam3p_saf_29z9_1961_1_007428901_2	34,656	119,505	3.4483
04 Oct 2011 04:53:01	1160009	13314863	hadam3p_saf_29z9_1961_1_007428901_2	23,136	76,036	3.2865
31 Aug 2011 07:45:06	1160009	13314863	hadam3p_saf_29z9_1961_1_007428901_2	11,616	37,244	3.2063