Task 13871403

Name	hadam3p_eu_8egp_2008_1_007668770_0
Workunit	7823857
Created	4 Jan 2012, 18:19:32 UTC
Sent	6 Jan 2012, 10:03:51 UTC
Report deadline	18 Dec 2012, 15:23:51 UTC
Received	6 Feb 2012, 23:38:58 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1016212
Run time	10 days 3 hours 28 min 17 sec
CPU time	6 days 19 hours 36 min 9 sec
Validate state	Workunit error - check skipped
Credit	2,386.39
Device peak FLOPS	1.68 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.6.38</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3916, iMonCtr=2 Model crash detected, will try to restart... 22:17:40 (4704): No heartbeat from core client for 30 sec - exiting 22:17:41 (4704): No heartbeat from core client for 30 sec - exiting 22:17:42 (4704): No heartbeat from core client for 30 sec - exiting 22:17:43 (4704): No heartbeat from core client for 30 sec - exiting 22:17:44 (4704): No heartbeat from core client for 30 sec - exiting 22:17:45 (4704): No heartbeat from core client for 30 sec - exiting 22:17:46 (4704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4796, iMonCtr=2 Model crash detected, will try to restart... 10:19:14 (4600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:19:15 (4600): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3924, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7296, selfPID=5156, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 20:50:30 (3840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CGlobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3256, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3300, selfPID=3932, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6028, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2912, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4636, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3276, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5392, selfPID=5964, iMonCtr=1 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1152, iMonCtr=2 Model crash detected, will try to restart... lobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4564, iMonCtr=2 Leaving CPDN_Main::Monitor... C17:48:49 (1820): No heartbeat from core client for 30 sec - exiting 17:48:50 (1820): No heartbeat from core client for 30 sec - exiting 17:48:51 (1820): No heartbeat from core client for 30 sec - exiting 17:48:52 (1820): No heartbeat from core client for 30 sec - exiting 17:48:53 (1820): No heartbeat from core client for 30 sec - exiting 17:48:55 (1820): No heartbeat from core client for 30 sec - exiting 17:48:56 (1820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:20:00 (3600): No heartbeat from core client for 30 sec - exiting 05:20:02 (3600): No heartbeat from core client for 30 sec - exiting 05:20:03 (3600): No heartbeat from core client for 30 sec - exiting 05:20:04 (3600): No heartbeat from core client for 30 sec - exiting 05:20:05 (3600): No heartbeat from core client for 30 sec - exiting 05:20:06 (3600): No heartbeat from core client for 30 sec - exiting 05:20:07 (3600): No heartbeat from core client for 30 sec - exiting 05:20:09 (3600): No heartbeat from core client for 30 sec - exiting 05:20:10 (3600): No heartbeat from core client for 30 sec - exiting 05:20:11 (3600): No heartbeat from core client for 30 sec - exiting 05:20:12 (3600): No heartbeat from core client for 30 sec - exiting 05:20:13 (3600): No heartbeat from core client for 30 sec - exiting 05:20:14 (3600): No heartbeat from core client for 30 sec - exiting 05:20:15 (3600): No heartbeat from core client for 30 sec - exiting 05:20:16 (3600): No heartbeat from core client for 30 sec - exiting 05:20:17 (3600): No heartbeat from core client for 30 sec - exiting 05:20:19 (3600): No heartbeat from core client for 30 sec - exiting 05:20:20 (3600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:56:22 (4692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4308, selfPID=2780, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5564, selfPID=5812, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6116, selfPID=6132, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4484, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=888, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3056, selfPID=4828, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5984, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3372, selfPID=2344, iMonCtr=1 Model crash detected, will try to restart... 06:22:27 (6140): No heartbeat from core client for 30 sec - exiting 06:22:29 (6140): No heartbeat from core client for 30 sec - exiting 06:22:30 (6140): No heartbeat from core client for 30 sec - exiting 06:22:31 (6140): No heartbeat from core client for 30 sec - exiting 06:22:32 (6140): No heartbeat from core client for 30 sec - exiting 06:22:33 (6140): No heartbeat from core client for 30 sec - exiting 06:22:34 (6140): No heartbeat from core client for 30 sec - exiting 06:22:35 (6140): No heartbeat from core client for 30 sec - exiting 06:22:37 (6140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4108, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5124, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3672, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5980, selfPID=4128, iMonCtr=1 Model crash detected, will try to restart... 07:03:43 (2460): No heartbeat from core client for 30 sec - exiting 07:03:44 (2460): No heartbeat from core client for 30 sec - exiting 07:03:45 (2460): No heartbeat from core client for 30 sec - exiting 07:03:46 (2460): No heartbeat from core client for 30 sec - exiting 07:03:47 (2460): No heartbeat from core client for 30 sec - exiting 07:03:48 (2460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4016, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4300, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4548, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3256, selfPID=1960, iMonCtr=1 Model crash detected, will try to restart... 00:15:47 (1388): No heartbeat from core client for 30 sec - exiting 00:15:48 (1388): No heartbeat from core client for 30 sec - exiting 00:15:49 (1388): No heartbeat from core client for 30 sec - exiting 00:15:50 (1388): No heartbeat from core client for 30 sec - exiting 00:15:51 (1388): No heartbeat from core client for 30 sec - exiting 00:15:52 (1388): No heartbeat from core client for 30 sec - exiting 00:15:53 (1388): No heartbeat from core client for 30 sec - exiting 00:15:54 (1388): No heartbeat from core client for 30 sec - exiting 00:15:55 (1388): No heartbeat from core client for 30 sec - exiting 00:15:56 (1388): No heartbeat from core client for 30 sec - exiting 00:15:57 (1388): No heartbeat from core client for 30 sec - exiting 00:15:58 (1388): No heartbeat from core client for 30 sec - exiting 00:15:59 (1388): No heartbeat from core client for 30 sec - exiting 00:16:00 (1388): No heartbeat from core client for 30 sec - exiting 00:16:01 (1388): No heartbeat from core client for 30 sec - exiting 00:16:02 (1388): No heartbeat from core client for 30 sec - exiting 00:16:03 (1388): No heartbeat from core client for 30 sec - exiting 00:16:04 (1388): No heartbeat from core client for 30 sec - exiting 00:16:05 (1388): No heartbeat from core client for 30 sec - exiting 00:16:06 (1388): No heartbeat from core client for 30 sec - exiting 00:16:07 (1388): No heartbeat from core client for 30 sec - exiting 00:16:08 (1388): No heartbeat from core client for 30 sec - exiting 00:16:09 (1388): No heartbeat from core client for 30 sec - exiting 00:16:10 (1388): No heartbeat from core client for 30 sec - exiting 00:16:11 (1388): No heartbeat from core client for 30 sec - exiting 00:16:12 (1388): No heartbeat from core client for 30 sec - exiting 00:16:13 (1388): No heartbeat from core client for 30 sec - exiting 00:16:14 (1388): No heartbeat from core client for 30 sec - exiting 00:16:15 (1388): No heartbeat from core client for 30 sec - exiting 00:16:16 (1388): No heartbeat from core client for 30 sec - exiting 00:16:17 (1388): No heartbeat from core client for 30 sec - exiting 00:16:18 (1388): No heartbeat from core client for 30 sec - exiting 00:16:19 (1388): No heartbeat from core client for 30 sec - exiting 00:16:20 (1388): No heartbeat from core client for 30 sec - exiting 00:16:21 (1388): No heartbeat from core client for 30 sec - exiting 00:16:22 (1388): No heartbeat from core client for 30 sec - exiting 00:16:23 (1388): No heartbeat from core client for 30 sec - exiting 00:16:24 (1388): No heartbeat from core client for 30 sec - exiting 00:16:25 (1388): No heartbeat from core client for 30 sec - exiting 00:16:26 (1388): No heartbeat from core client for 30 sec - exiting 00:16:27 (1388): No heartbeat from core client for 30 sec - exiting 00:16:28 (1388): No heartbeat from core client for 30 sec - exiting 00:16:29 (1388): No heartbeat from core client for 30 sec - exiting 00:16:30 (1388): No heartbeat from core client for 30 sec - exiting 00:16:31 (1388): No heartbeat from core client for 30 sec - exiting 00:16:32 (1388): No heartbeat from core client for 30 sec - exiting 00:16:33 (1388): No heartbeat from core client for 30 sec - exiting 00:16:34 (1388): No heartbeat from core client for 30 sec - exiting 00:16:35 (1388): No heartbeat from core client for 30 sec - exiting 00:16:36 (1388): No heartbeat from core client for 30 sec - exiting 00:16:37 (1388): No heartbeat from core client for 30 sec - exiting 00:16:38 (1388): No heartbeat from core client for 30 sec - exiting 00:16:39 (1388): No heartbeat from core client for 30 sec - exiting 00:16:40 (1388): No heartbeat from core client for 30 sec - exiting 00:16:41 (1388): No heartbeat from core client for 30 sec - exiting 00:16:42 (1388): No heartbeat from core client for 30 sec - exiting 00:16:43 (1388): No heartbeat from core client for 30 sec - exiting 00:16:44 (1388): No heartbeat from core client for 30 sec - exiting 00:16:45 (1388): No heartbeat from core client for 30 sec - exiting 00:16:46 (1388): No heartbeat from core client for 30 sec - exiting 00:16:47 (1388): No heartbeat from core client for 30 sec - exiting 00:16:48 (1388): No heartbeat from core client for 30 sec - exiting 00:16:49 (1388): No heartbeat from core client for 30 sec - exiting 00:16:50 (1388): No heartbeat from core client for 30 sec - exiting 00:16:51 (1388): No heartbeat from core client for 30 sec - exiting 00:16:52 (1388): No heartbeat from core client for 30 sec - exiting 00:16:53 (1388): No heartbeat from core client for 30 sec - exiting 00:16:54 (1388): No heartbeat from core client for 30 sec - exiting 00:16:55 (1388): No heartbeat from core client for 30 sec - exiting 00:16:56 (1388): No heartbeat from core client for 30 sec - exiting 00:16:57 (1388): No heartbeat from core client for 30 sec - exiting 00:16:58 (1388): No heartbeat from core client for 30 sec - exiting 00:16:59 (1388): No heartbeat from core client for 30 sec - exiting 00:17:00 (1388): No heartbeat from core client for 30 sec - exiting 00:17:01 (1388): No heartbeat from core client for 30 sec - exiting 00:17:02 (1388): No heartbeat from core client for 30 sec - exiting 00:17:03 (1388): No heartbeat from core client for 30 sec - exiting 00:17:04 (1388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2548, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4132, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3496, selfPID=4632, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 06:54:33 (4960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5720, selfPID=5720, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 09:03:45 (2120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3088, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5716, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4196, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5068, selfPID=5312, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4060, selfPID=3880, iMonCtr=1 Model crash detected, will try to restart... 07:51:38 (4848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:54:44 (3784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:54:45 (3784): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3256, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4112, selfPID=5164, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3792, selfPID=3400, iMonCtr=1 Model crash detected, will try to restart... 17:29:24 (3372): No heartbeat from core client for 30 sec - exiting 17:29:25 (3372): No heartbeat from core client for 30 sec - exiting 17:29:26 (3372): No heartbeat from core client for 30 sec - exiting 17:29:27 (3372): No heartbeat from core client for 30 sec - exiting 17:29:28 (3372): No heartbeat from core client for 30 sec - exiting 17:29:29 (3372): No heartbeat from core client for 30 sec - exiting 17:29:30 (3372): No heartbeat from core client for 30 sec - exiting 17:29:32 (3372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5912, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5608, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2952, selfPID=3660, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5556, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3996, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5908, selfPID=4920, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5848, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4744, iMonCtr=2 Model crash detected, will try to restart... 14:47:11 (4752): No heartbeat from core client for 30 sec - exiting 14:47:12 (4752): No heartbeat from core client for 30 sec - exiting 14:47:13 (4752): No heartbeat from core client for 30 sec - exiting 14:47:14 (4752): No heartbeat from core client for 30 sec - exiting 14:47:15 (4752): No heartbeat from core client for 30 sec - exiting 14:47:16 (4752): No heartbeat from core client for 30 sec - exiting 14:47:17 (4752): No heartbeat from core client for 30 sec - exiting 14:47:18 (4752): No heartbeat from core client for 30 sec - exiting 14:47:19 (4752): No heartbeat from core client for 30 sec - exiting 14:47:20 (4752): No heartbeat from core client for 30 sec - exiting 14:47:21 (4752): No heartbeat from core client for 30 sec - exiting 14:47:22 (4752): No heartbeat from core client for 30 sec - exiting 14:47:23 (4752): No heartbeat from core client for 30 sec - exiting 14:47:24 (4752): No heartbeat from core client for 30 sec - exiting 14:47:25 (4752): No heartbeat from core client for 30 sec - exiting 14:47:26 (4752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6032, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4948, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3848, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 06:59:48 (5836): No heartbeat from core client for 30 sec - exiting 06:59:49 (5836): No heartbeat from core client for 30 sec - exiting 06:59:50 (5836): No heartbeat from core client for 30 sec - exiting 06:59:51 (5836): No heartbeat from core client for 30 sec - exiting 06:59:52 (5836): No heartbeat from core client for 30 sec - exiting 06:59:53 (5836): No heartbeat from core client for 30 sec - exiting 06:59:54 (5836): No heartbeat from core client for 30 sec - exiting 06:59:55 (5836): No heartbeat from core client for 30 sec - exiting 06:59:56 (5836): No heartbeat from core client for 30 sec - exiting 06:59:57 (5836): No heartbeat from core client for 30 sec - exiting 06:59:58 (5836): No heartbeat from core client for 30 sec - exiting 06:59:59 (5836): No heartbeat from core client for 30 sec - exiting 07:00:00 (5836): No heartbeat from core client for 30 sec - exiting 07:00:01 (5836): No heartbeat from core client for 30 sec - exiting 07:00:02 (5836): No heartbeat from core client for 30 sec - exiting 07:00:03 (5836): No heartbeat from core client for 30 sec - exiting 07:00:04 (5836): No heartbeat from core client for 30 sec - exiting 07:00:06 (5836): No heartbeat from core client for 30 sec - exiting 07:00:07 (5836): No heartbeat from core client for 30 sec - exiting 07:00:08 (5836): No heartbeat from core client for 30 sec - exiting 07:00:09 (5836): No heartbeat from core client for 30 sec - exiting 07:00:10 (5836): No heartbeat from core client for 30 sec - exiting 07:00:11 (5836): No heartbeat from core client for 30 sec - exiting 07:00:12 (5836): No heartbeat from core client for 30 sec - exiting 07:00:13 (5836): No heartbeat from core client for 30 sec - exiting 07:00:14 (5836): No heartbeat from core client for 30 sec - exiting 07:00:15 (5836): No heartbeat from core client for 30 sec - exiting 07:00:16 (5836): No heartbeat from core client for 30 sec - exiting 07:00:17 (5836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5504, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5184, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5456, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4480, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4392, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4724, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=984, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3616, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5864, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1504, selfPID=5596, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5108, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=788, iMonCtr=2 Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1076, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4248, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2976, selfPID=1408, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3244, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5812, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3640, selfPID=1572, iMonCtr=1 Model crash detected, will try to restart... 06:53:59 (4612): No heartbeat from core client for 30 sec - exiting 06:54:00 (4612): No heartbeat from core client for 30 sec - exiting 06:54:01 (4612): No heartbeat from core client for 30 sec - exiting 06:54:02 (4612): No heartbeat from core client for 30 sec - exiting 06:54:03 (4612): No heartbeat from core client for 30 sec - exiting 06:54:04 (4612): No heartbeat from core client for 30 sec - exiting 06:54:05 (4612): No heartbeat from core client for 30 sec - exiting 06:54:06 (4612): No heartbeat from core client for 30 sec - exiting 06:54:07 (4612): No heartbeat from core client for 30 sec - exiting 06:54:08 (4612): No heartbeat from core client for 30 sec - exiting 06:54:09 (4612): No heartbeat from core client for 30 sec - exiting 06:54:10 (4612): No heartbeat from core client for 30 sec - exiting 06:54:11 (4612): No heartbeat from core client for 30 sec - exiting 06:54:12 (4612): No heartbeat from core client for 30 sec - exiting 06:54:13 (4612): No heartbeat from core client for 30 sec - exiting 06:54:14 (4612): No heartbeat from core client for 30 sec - exiting 06:54:15 (4612): No heartbeat from core client for 30 sec - exiting 06:54:16 (4612): No heartbeat from core client for 30 sec - exiting 06:54:17 (4612): No heartbeat from core client for 30 sec - exiting 06:54:18 (4612): No heartbeat from core client for 30 sec - exiting 06:54:19 (4612): No heartbeat from core client for 30 sec - exiting 06:54:20 (4612): No heartbeat from core client for 30 sec - exiting 06:54:21 (4612): No heartbeat from core client for 30 sec - exiting 06:54:22 (4612): No heartbeat from core client for 30 sec - exiting 06:54:23 (4612): No heartbeat from core client for 30 sec - exiting 06:54:24 (4612): No heartbeat from core client for 30 sec - exiting 06:54:25 (4612): No heartbeat from core client for 30 sec - exiting 06:54:26 (4612): No heartbeat from core client for 30 sec - exiting 06:54:27 (4612): No heartbeat from core client for 30 sec - exiting 06:54:28 (4612): No heartbeat from core client for 30 sec - exiting 06:54:29 (4612): No heartbeat from core client for 30 sec - exiting 06:54:30 (4612): No heartbeat from core client for 30 sec - exiting 06:54:31 (4612): No heartbeat from core client for 30 sec - exiting 06:54:32 (4612): No heartbeat from core client for 30 sec - exiting 06:54:33 (4612): No heartbeat from core client for 30 sec - exiting 06:54:34 (4612): No heartbeat from core client for 30 sec - exiting 06:54:35 (4612): No heartbeat from core client for 30 sec - exiting 06:54:36 (4612): No heartbeat from core client for 30 sec - exiting 06:54:37 (4612): No heartbeat from core client for 30 sec - exiting 06:54:38 (4612): No heartbeat from core client for 30 sec - exiting 06:54:39 (4612): No heartbeat from core client for 30 sec - exiting 06:54:40 (4612): No heartbeat from core client for 30 sec - exiting 06:54:41 (4612): No heartbeat from core client for 30 sec - exiting 06:54:42 (4612): No heartbeat from core client for 30 sec - exiting 06:54:43 (4612): No heartbeat from core client for 30 sec - exiting 06:54:44 (4612): No heartbeat from core client for 30 sec - exiting 06:54:45 (4612): No heartbeat from core client for 30 sec - exiting 06:54:46 (4612): No heartbeat from core client for 30 sec - exiting 06:54:47 (4612): No heartbeat from core client for 30 sec - exiting 06:54:48 (4612): No heartbeat from core client for 30 sec - exiting 06:54:49 (4612): No heartbeat from core client for 30 sec - exiting 06:54:50 (4612): No heartbeat from core client for 30 sec - exiting 06:54:51 (4612): No heartbeat from core client for 30 sec - exiting 06:54:52 (4612): No heartbeat from core client for 30 sec - exiting 06:54:53 (4612): No heartbeat from core client for 30 sec - exiting 06:54:54 (4612): No heartbeat from core client for 30 sec - exiting 06:54:55 (4612): No heartbeat from core client for 30 sec - exiting 06:54:56 (4612): No heartbeat from core client for 30 sec - exiting 06:54:57 (4612): No heartbeat from core client for 30 sec - exiting 06:54:58 (4612): No heartbeat from core client for 30 sec - exiting 06:54:59 (4612): No heartbeat from core client for 30 sec - exiting 06:55:00 (4612): No heartbeat from core client for 30 sec - exiting 06:55:02 (4612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5824, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1808, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5332, selfPID=4564, iMonCtr=1 Model crash detected, will try to restart... 16:41:26 (4412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3128, selfPID=5524, iMonCtr=1 Model crash detected, will try to restart... 05:34:42 (5096): No heartbeat from core client for 30 sec - exiting 05:34:43 (5096): No heartbeat from core client for 30 sec - exiting 05:34:44 (5096): No heartbeat from core client for 30 sec - exiting 05:34:45 (5096): No heartbeat from core client for 30 sec - exiting 05:34:46 (5096): No heartbeat from core client for 30 sec - exiting 05:34:47 (5096): No heartbeat from core client for 30 sec - exiting 05:34:48 (5096): No heartbeat from core client for 30 sec - exiting 05:34:49 (5096): No heartbeat from core client for 30 sec - exiting 05:34:50 (5096): No heartbeat from core client for 30 sec - exiting 05:34:51 (5096): No heartbeat from core client for 30 sec - exiting 05:34:52 (5096): No heartbeat from core client for 30 sec - exiting 05:34:53 (5096): No heartbeat from core client for 30 sec - exiting 05:34:54 (5096): No heartbeat from core client for 30 sec - exiting 05:34:55 (5096): No heartbeat from core client for 30 sec - exiting 05:34:56 (5096): No heartbeat from core client for 30 sec - exiting 05:34:57 (5096): No heartbeat from core client for 30 sec - exiting 05:34:58 (5096): No heartbeat from core client for 30 sec - exiting 05:34:59 (5096): No heartbeat from core client for 30 sec - exiting 05:35:00 (5096): No heartbeat from core client for 30 sec - exiting 05:35:01 (5096): No heartbeat from core client for 30 sec - exiting 05:35:02 (5096): No heartbeat from core client for 30 sec - exiting 05:35:03 (5096): No heartbeat from core client for 30 sec - exiting 05:35:04 (5096): No heartbeat from core client for 30 sec - exiting 05:35:05 (5096): No heartbeat from core client for 30 sec - exiting 05:35:06 (5096): No heartbeat from core client for 30 sec - exiting 05:35:07 (5096): No heartbeat from core client for 30 sec - exiting 05:35:08 (5096): No heartbeat from core client for 30 sec - exiting 05:35:09 (5096): No heartbeat from core client for 30 sec - exiting 05:35:10 (5096): No heartbeat from core client for 30 sec - exiting 05:35:11 (5096): No heartbeat from core client for 30 sec - exiting 05:35:12 (5096): No heartbeat from core client for 30 sec - exiting 05:35:13 (5096): No heartbeat from core client for 30 sec - exiting 05:35:14 (5096): No heartbeat from core client for 30 sec - exiting 05:35:15 (5096): No heartbeat from core client for 30 sec - exiting 05:35:16 (5096): No heartbeat from core client for 30 sec - exiting 05:35:17 (5096): No heartbeat from core client for 30 sec - exiting 05:35:18 (5096): No heartbeat from core client for 30 sec - exiting 05:35:19 (5096): No heartbeat from core client for 30 sec - exiting 05:35:20 (5096): No heartbeat from core client for 30 sec - exiting 05:35:21 (5096): No heartbeat from core client for 30 sec - exiting 05:35:22 (5096): No heartbeat from core client for 30 sec - exiting 05:35:23 (5096): No heartbeat from core client for 30 sec - exiting 05:35:24 (5096): No heartbeat from core client for 30 sec - exiting 05:35:25 (5096): No heartbeat from core client for 30 sec - exiting 05:35:26 (5096): No heartbeat from core client for 30 sec - exiting 05:35:27 (5096): No heartbeat from core client for 30 sec - exiting 05:35:28 (5096): No heartbeat from core client for 30 sec - exiting 05:35:29 (5096): No heartbeat from core client for 30 sec - exiting 05:35:30 (5096): No heartbeat from core client for 30 sec - exiting 05:35:31 (5096): No heartbeat from core client for 30 sec - exiting 05:35:32 (5096): No heartbeat from core client for 30 sec - exiting 05:35:33 (5096): No heartbeat from core client for 30 sec - exiting 05:35:34 (5096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3688, selfPID=4164, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5816, selfPID=3136, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 08:18:49 (5900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:18:50 (5900): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4820, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1804, selfPID=5356, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4656, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5900, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4792, selfPID=4244, iMonCtr=1 Model crash detected, will try to restart... 07:51:30 (4728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:51:31 (4728): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4180, selfPID=4180, iMonCtr=2 07:51:33 (4728): No heartbeat from core client for 30 sec - exiting 07:51:33 (4728): No heartbeat from core client for 30 sec - exiting 07:51:35 (4728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5356, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6940, selfPID=3996, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6040, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6064, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4496, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5936, iMonCtr=2 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5372, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5964, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5844, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4392, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1932, selfPID=5688, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3032, selfPID=5496, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Feb 2012 22:15:03	1016212	13871403	hadam3p_eu_8egp_2008_1_007668770_0	138,336	588,045	4.2508
04 Feb 2012 14:01:24	1016212	13871403	hadam3p_eu_8egp_2008_1_007668770_0	126,816	538,803	4.2487
02 Feb 2012 13:58:35	1016212	13871403	hadam3p_eu_8egp_2008_1_007668770_0	115,296	489,984	4.2498
01 Feb 2012 19:05:26	1016212	13871403	hadam3p_eu_8egp_2008_1_007668770_0	103,776	440,339	4.2432
30 Jan 2012 09:54:23	1016212	13871403	hadam3p_eu_8egp_2008_1_007668770_0	92,256	391,486	4.2435
26 Jan 2012 09:49:15	1016212	13871403	hadam3p_eu_8egp_2008_1_007668770_0	80,736	343,498	4.2546
23 Jan 2012 09:05:18	1016212	13871403	hadam3p_eu_8egp_2008_1_007668770_0	69,216	294,424	4.2537
19 Jan 2012 19:25:50	1016212	13871403	hadam3p_eu_8egp_2008_1_007668770_0	57,696	245,621	4.2572
17 Jan 2012 10:38:40	1016212	13871403	hadam3p_eu_8egp_2008_1_007668770_0	46,176	196,976	4.2658
14 Jan 2012 02:55:55	1016212	13871403	hadam3p_eu_8egp_2008_1_007668770_0	34,656	147,935	4.2687
13 Jan 2012 08:37:37	1016212	13871403	hadam3p_eu_8egp_2008_1_007668770_0	23,137	98,685	4.2652
13 Jan 2012 07:27:23	1016212	13871403	hadam3p_eu_8egp_2008_1_007668770_0	23,136	98,062	4.2385
10 Jan 2012 15:19:57	1016212	13871403	hadam3p_eu_8egp_2008_1_007668770_0	11,616	50,037	4.3076