Task 13889645

Name	hadam3p_eu_8aw0_2006_1_007664137_2
Workunit	7819224
Created	8 Jan 2012, 20:38:22 UTC
Sent	8 Jan 2012, 20:49:04 UTC
Report deadline	21 Dec 2012, 2:09:04 UTC
Received	8 Feb 2012, 10:07:37 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1016212
Run time	10 days 1 hours 29 min 6 sec
CPU time	6 days 19 hours 46 min 5 sec
Validate state	Workunit error - check skipped
Credit	2,386.39
Device peak FLOPS	1.66 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.6.38</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=584, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5972, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5488, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3936, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4356, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5976, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4480, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3620, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 17:48:49 (3776): No heartbeat from core client for 30 sec - exiting 17:48:50 (3776): No heartbeat from core client for 30 sec - exiting 17:48:51 (3776): No heartbeat from core client for 30 sec - exiting 17:48:52 (3776): No heartbeat from core client for 30 sec - exiting 17:48:54 (3776): No heartbeat from core client for 30 sec - exiting 17:48:55 (3776): No heartbeat from core client for 30 sec - exiting 17:48:56 (3776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5628, selfPID=2912, iMonCtr=1 Model crash detected, will try to restart... 05:20:00 (5500): No heartbeat from core client for 30 sec - exiting 05:20:01 (5500): No heartbeat from core client for 30 sec - exiting 05:20:02 (5500): No heartbeat from core client for 30 sec - exiting 05:20:03 (5500): No heartbeat from core client for 30 sec - exiting 05:20:04 (5500): No heartbeat from core client for 30 sec - exiting 05:20:05 (5500): No heartbeat from core client for 30 sec - exiting 05:20:07 (5500): No heartbeat from core client for 30 sec - exiting 05:20:08 (5500): No heartbeat from core client for 30 sec - exiting 05:20:09 (5500): No heartbeat from core client for 30 sec - exiting 05:20:10 (5500): No heartbeat from core client for 30 sec - exiting 05:20:12 (5500): No heartbeat from core client for 30 sec - exiting 05:20:13 (5500): No heartbeat from core client for 30 sec - exiting 05:20:14 (5500): No heartbeat from core client for 30 sec - exiting 05:20:15 (5500): No heartbeat from core client for 30 sec - exiting 05:20:16 (5500): No heartbeat from core client for 30 sec - exiting 05:20:17 (5500): No heartbeat from core client for 30 sec - exiting 05:20:18 (5500): No heartbeat from core client for 30 sec - exiting 05:20:19 (5500): No heartbeat from core client for 30 sec - exiting 05:20:21 (5500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:56:22 (4512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5496, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1480, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5820, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 06:26:50 (5992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4880, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5992, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2148, selfPID=4436, iMonCtr=1 Model crash detected, will try to restart... 06:22:28 (4128): No heartbeat from core client for 30 sec - exiting 06:22:29 (4128): No heartbeat from core client for 30 sec - exiting 06:22:30 (4128): No heartbeat from core client for 30 sec - exiting 06:22:31 (4128): No heartbeat from core client for 30 sec - exiting 06:22:32 (4128): No heartbeat from core client for 30 sec - exiting 06:22:33 (4128): No heartbeat from core client for 30 sec - exiting 06:22:34 (4128): No heartbeat from core client for 30 sec - exiting 06:22:35 (4128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4468, iMonCtr=2 Model crash detected, will try to restart... 07:03:43 (3748): No heartbeat from core client for 30 sec - exiting 07:03:44 (3748): No heartbeat from core client for 30 sec - exiting 07:03:45 (3748): No heartbeat from core client for 30 sec - exiting 07:03:46 (3748): No heartbeat from core client for 30 sec - exiting 07:03:47 (3748): No heartbeat from core client for 30 sec - exiting 07:03:48 (3748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3684, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2196, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2560, selfPID=4648, iMonCtr=1 Model crash detected, will try to restart... 00:15:47 (4476): No heartbeat from core client for 30 sec - exiting 00:15:48 (4476): No heartbeat from core client for 30 sec - exiting 00:15:49 (4476): No heartbeat from core client for 30 sec - exiting 00:15:50 (4476): No heartbeat from core client for 30 sec - exiting 00:15:51 (4476): No heartbeat from core client for 30 sec - exiting 00:15:52 (4476): No heartbeat from core client for 30 sec - exiting 00:15:53 (4476): No heartbeat from core client for 30 sec - exiting 00:15:54 (4476): No heartbeat from core client for 30 sec - exiting 00:15:55 (4476): No heartbeat from core client for 30 sec - exiting 00:15:56 (4476): No heartbeat from core client for 30 sec - exiting 00:15:57 (4476): No heartbeat from core client for 30 sec - exiting 00:15:58 (4476): No heartbeat from core client for 30 sec - exiting 00:15:59 (4476): No heartbeat from core client for 30 sec - exiting 00:16:00 (4476): No heartbeat from core client for 30 sec - exiting 00:16:01 (4476): No heartbeat from core client for 30 sec - exiting 00:16:02 (4476): No heartbeat from core client for 30 sec - exiting 00:16:03 (4476): No heartbeat from core client for 30 sec - exiting 00:16:04 (4476): No heartbeat from core client for 30 sec - exiting 00:16:05 (4476): No heartbeat from core client for 30 sec - exiting 00:16:06 (4476): No heartbeat from core client for 30 sec - exiting 00:16:07 (4476): No heartbeat from core client for 30 sec - exiting 00:16:08 (4476): No heartbeat from core client for 30 sec - exiting 00:16:09 (4476): No heartbeat from core client for 30 sec - exiting 00:16:10 (4476): No heartbeat from core client for 30 sec - exiting 00:16:11 (4476): No heartbeat from core client for 30 sec - exiting 00:16:12 (4476): No heartbeat from core client for 30 sec - exiting 00:16:13 (4476): No heartbeat from core client for 30 sec - exiting 00:16:14 (4476): No heartbeat from core client for 30 sec - exiting 00:16:15 (4476): No heartbeat from core client for 30 sec - exiting 00:16:16 (4476): No heartbeat from core client for 30 sec - exiting 00:16:17 (4476): No heartbeat from core client for 30 sec - exiting 00:16:18 (4476): No heartbeat from core client for 30 sec - exiting 00:16:19 (4476): No heartbeat from core client for 30 sec - exiting 00:16:20 (4476): No heartbeat from core client for 30 sec - exiting 00:16:21 (4476): No heartbeat from core client for 30 sec - exiting 00:16:22 (4476): No heartbeat from core client for 30 sec - exiting 00:16:23 (4476): No heartbeat from core client for 30 sec - exiting 00:16:24 (4476): No heartbeat from core client for 30 sec - exiting 00:16:25 (4476): No heartbeat from core client for 30 sec - exiting 00:16:26 (4476): No heartbeat from core client for 30 sec - exiting 00:16:27 (4476): No heartbeat from core client for 30 sec - exiting 00:16:28 (4476): No heartbeat from core client for 30 sec - exiting 00:16:29 (4476): No heartbeat from core client for 30 sec - exiting 00:16:30 (4476): No heartbeat from core client for 30 sec - exiting 00:16:31 (4476): No heartbeat from core client for 30 sec - exiting 00:16:32 (4476): No heartbeat from core client for 30 sec - exiting 00:16:33 (4476): No heartbeat from core client for 30 sec - exiting 00:16:34 (4476): No heartbeat from core client for 30 sec - exiting 00:16:35 (4476): No heartbeat from core client for 30 sec - exiting 00:16:36 (4476): No heartbeat from core client for 30 sec - exiting 00:16:37 (4476): No heartbeat from core client for 30 sec - exiting 00:16:38 (4476): No heartbeat from core client for 30 sec - exiting 00:16:39 (4476): No heartbeat from core client for 30 sec - exiting 00:16:40 (4476): No heartbeat from core client for 30 sec - exiting 00:16:41 (4476): No heartbeat from core client for 30 sec - exiting 00:16:42 (4476): No heartbeat from core client for 30 sec - exiting 00:16:43 (4476): No heartbeat from core client for 30 sec - exiting 00:16:44 (4476): No heartbeat from core client for 30 sec - exiting 00:16:45 (4476): No heartbeat from core client for 30 sec - exiting 00:16:46 (4476): No heartbeat from core client for 30 sec - exiting 00:16:47 (4476): No heartbeat from core client for 30 sec - exiting 00:16:48 (4476): No heartbeat from core client for 30 sec - exiting 00:16:49 (4476): No heartbeat from core client for 30 sec - exiting 00:16:50 (4476): No heartbeat from core client for 30 sec - exiting 00:16:51 (4476): No heartbeat from core client for 30 sec - exiting 00:16:52 (4476): No heartbeat from core client for 30 sec - exiting 00:16:53 (4476): No heartbeat from core client for 30 sec - exiting 00:16:54 (4476): No heartbeat from core client for 30 sec - exiting 00:16:55 (4476): No heartbeat from core client for 30 sec - exiting 00:16:56 (4476): No heartbeat from core client for 30 sec - exiting 00:16:57 (4476): No heartbeat from core client for 30 sec - exiting 00:16:58 (4476): No heartbeat from core client for 30 sec - exiting 00:16:59 (4476): No heartbeat from core client for 30 sec - exiting 00:17:00 (4476): No heartbeat from core client for 30 sec - exiting 00:17:01 (4476): No heartbeat from core client for 30 sec - exiting 00:17:02 (4476): No heartbeat from core client for 30 sec - exiting 00:17:03 (4476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:20:12 (5564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5512, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5568, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=968, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4060, selfPID=4164, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5748, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5848, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 06:54:32 (4500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5480, selfPID=5480, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 09:03:49 (4052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2644, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=224, selfPID=5492, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2996, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5012, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4072, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5264, selfPID=1840, iMonCtr=1 Model crash detected, will try to restart... 07:51:45 (4940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1372, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4552, selfPID=3896, iMonCtr=1 Model crash detected, will try to restart... 17:29:23 (652): No heartbeat from core client for 30 sec - exiting 17:29:25 (652): No heartbeat from core client for 30 sec - exiting 17:29:26 (652): No heartbeat from core client for 30 sec - exiting 17:29:27 (652): No heartbeat from core client for 30 sec - exiting 17:29:28 (652): No heartbeat from core client for 30 sec - exiting 17:29:29 (652): No heartbeat from core client for 30 sec - exiting 17:29:30 (652): No heartbeat from core client for 30 sec - exiting 17:29:32 (652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4780, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4508, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3088, selfPID=4276, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1636, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Coltroller:bal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5188, iMonCtr=2 : CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5856, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2808, iMonCtr=2 Model crash detected, will try to restart... 14:47:10 (5392): No heartbeat from core client for 30 sec - exiting 14:47:11 (5392): No heartbeat from core client for 30 sec - exiting 14:47:13 (5392): No heartbeat from core client for 30 sec - exiting 14:47:14 (5392): No heartbeat from core client for 30 sec - exiting 14:47:15 (5392): No heartbeat from core client for 30 sec - exiting 14:47:16 (5392): No heartbeat from core client for 30 sec - exiting 14:47:17 (5392): No heartbeat from core client for 30 sec - exiting 14:47:18 (5392): No heartbeat from core client for 30 sec - exiting 14:47:19 (5392): No heartbeat from core client for 30 sec - exiting 14:47:20 (5392): No heartbeat from core client for 30 sec - exiting 14:47:21 (5392): No heartbeat from core client for 30 sec - exiting 14:47:22 (5392): No heartbeat from core client for 30 sec - exiting 14:47:23 (5392): No heartbeat from core client for 30 sec - exiting 14:47:24 (5392): No heartbeat from core client for 30 sec - exiting 14:47:25 (5392): No heartbeat from core client for 30 sec - exiting 14:47:26 (5392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4584, selfPID=1144, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6040, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4428, selfPID=5992, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 06:59:48 (6008): No heartbeat from core client for 30 sec - exiting 06:59:49 (6008): No heartbeat from core client for 30 sec - exiting 06:59:50 (6008): No heartbeat from core client for 30 sec - exiting 06:59:51 (6008): No heartbeat from core client for 30 sec - exiting 06:59:52 (6008): No heartbeat from core client for 30 sec - exiting 06:59:53 (6008): No heartbeat from core client for 30 sec - exiting 06:59:54 (6008): No heartbeat from core client for 30 sec - exiting 06:59:55 (6008): No heartbeat from core client for 30 sec - exiting 06:59:56 (6008): No heartbeat from core client for 30 sec - exiting 06:59:57 (6008): No heartbeat from core client for 30 sec - exiting 06:59:58 (6008): No heartbeat from core client for 30 sec - exiting 06:59:59 (6008): No heartbeat from core client for 30 sec - exiting 07:00:00 (6008): No heartbeat from core client for 30 sec - exiting 07:00:01 (6008): No heartbeat from core client for 30 sec - exiting 07:00:02 (6008): No heartbeat from core client for 30 sec - exiting 07:00:04 (6008): No heartbeat from core client for 30 sec - exiting 07:00:05 (6008): No heartbeat from core client for 30 sec - exiting 07:00:06 (6008): No heartbeat from core client for 30 sec - exiting 07:00:07 (6008): No heartbeat from core client for 30 sec - exiting 07:00:08 (6008): No heartbeat from core client for 30 sec - exiting 07:00:09 (6008): No heartbeat from core client for 30 sec - exiting 07:00:10 (6008): No heartbeat from core client for 30 sec - exiting 07:00:11 (6008): No heartbeat from core client for 30 sec - exiting 07:00:12 (6008): No heartbeat from core client for 30 sec - exiting 07:00:13 (6008): No heartbeat from core client for 30 sec - exiting 07:00:14 (6008): No heartbeat from core client for 30 sec - exiting 07:00:15 (6008): No heartbeat from core client for 30 sec - exiting 07:00:16 (6008): No heartbeat from core client for 30 sec - exiting 07:00:18 (6008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5724, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4928, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4292, selfPID=4492, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1136, selfPID=4828, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5020, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3740, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4728, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4592, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5624, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2840, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4752, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6096, iMonCtr=2 Leaving CPDN_Main::Monitor... 06:53:59 (1112): No heartbeat from core client for 30 sec - exiting 06:54:01 (1112): No heartbeat from core client for 30 sec - exiting 06:54:02 (1112): No heartbeat from core client for 30 sec - exiting 06:54:03 (1112): No heartbeat from core client for 30 sec - exiting 06:54:04 (1112): No heartbeat from core client for 30 sec - exiting 06:54:05 (1112): No heartbeat from core client for 30 sec - exiting 06:54:06 (1112): No heartbeat from core client for 30 sec - exiting 06:54:07 (1112): No heartbeat from core client for 30 sec - exiting 06:54:08 (1112): No heartbeat from core client for 30 sec - exiting 06:54:09 (1112): No heartbeat from core client for 30 sec - exiting 06:54:10 (1112): No heartbeat from core client for 30 sec - exiting 06:54:11 (1112): No heartbeat from core client for 30 sec - exiting 06:54:12 (1112): No heartbeat from core client for 30 sec - exiting 06:54:13 (1112): No heartbeat from core client for 30 sec - exiting 06:54:14 (1112): No heartbeat from core client for 30 sec - exiting 06:54:15 (1112): No heartbeat from core client for 30 sec - exiting 06:54:16 (1112): No heartbeat from core client for 30 sec - exiting 06:54:17 (1112): No heartbeat from core client for 30 sec - exiting 06:54:18 (1112): No heartbeat from core client for 30 sec - exiting 06:54:19 (1112): No heartbeat from core client for 30 sec - exiting 06:54:20 (1112): No heartbeat from core client for 30 sec - exiting 06:54:21 (1112): No heartbeat from core client for 30 sec - exiting 06:54:22 (1112): No heartbeat from core client for 30 sec - exiting 06:54:23 (1112): No heartbeat from core client for 30 sec - exiting 06:54:24 (1112): No heartbeat from core client for 30 sec - exiting 06:54:25 (1112): No heartbeat from core client for 30 sec - exiting 06:54:26 (1112): No heartbeat from core client for 30 sec - exiting 06:54:27 (1112): No heartbeat from core client for 30 sec - exiting 06:54:28 (1112): No heartbeat from core client for 30 sec - exiting 06:54:29 (1112): No heartbeat from core client for 30 sec - exiting 06:54:30 (1112): No heartbeat from core client for 30 sec - exiting 06:54:31 (1112): No heartbeat from core client for 30 sec - exiting 06:54:32 (1112): No heartbeat from core client for 30 sec - exiting 06:54:33 (1112): No heartbeat from core client for 30 sec - exiting 06:54:34 (1112): No heartbeat from core client for 30 sec - exiting 06:54:35 (1112): No heartbeat from core client for 30 sec - exiting 06:54:36 (1112): No heartbeat from core client for 30 sec - exiting 06:54:37 (1112): No heartbeat from core client for 30 sec - exiting 06:54:38 (1112): No heartbeat from core client for 30 sec - exiting 06:54:39 (1112): No heartbeat from core client for 30 sec - exiting 06:54:40 (1112): No heartbeat from core client for 30 sec - exiting 06:54:41 (1112): No heartbeat from core client for 30 sec - exiting 06:54:42 (1112): No heartbeat from core client for 30 sec - exiting 06:54:43 (1112): No heartbeat from core client for 30 sec - exiting 06:54:44 (1112): No heartbeat from core client for 30 sec - exiting 06:54:45 (1112): No heartbeat from core client for 30 sec - exiting 06:54:46 (1112): No heartbeat from core client for 30 sec - exiting 06:54:47 (1112): No heartbeat from core client for 30 sec - exiting 06:54:48 (1112): No heartbeat from core client for 30 sec - exiting 06:54:49 (1112): No heartbeat from core client for 30 sec - exiting 06:54:50 (1112): No heartbeat from core client for 30 sec - exiting 06:54:51 (1112): No heartbeat from core client for 30 sec - exiting 06:54:52 (1112): No heartbeat from core client for 30 sec - exiting 06:54:53 (1112): No heartbeat from core client for 30 sec - exiting 06:54:54 (1112): No heartbeat from core client for 30 sec - exiting 06:54:55 (1112): No heartbeat from core client for 30 sec - exiting 06:54:56 (1112): No heartbeat from core client for 30 sec - exiting 06:54:57 (1112): No heartbeat from core client for 30 sec - exiting 06:54:58 (1112): No heartbeat from core client for 30 sec - exiting 06:54:59 (1112): No heartbeat from core client for 30 sec - exiting 06:55:00 (1112): No heartbeat from core client for 30 sec - exiting 06:55:01 (1112): No heartbeat from core client for 30 sec - exiting 06:55:02 (1112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2316, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1828, iMonCtr=2 Model crash detected, will try to restart... 16:41:29 (4104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4484, selfPID=4484, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5700, iMonCtr=2 05:34:41 (4956): No heartbeat from core client for 30 sec - exiting 05:34:42 (4956): No heartbeat from core client for 30 sec - exiting 05:34:43 (4956): No heartbeat from core client for 30 sec - exiting 05:34:44 (4956): No heartbeat from core client for 30 sec - exiting 05:34:45 (4956): No heartbeat from core client for 30 sec - exiting 05:34:46 (4956): No heartbeat from core client for 30 sec - exiting 05:34:47 (4956): No heartbeat from core client for 30 sec - exiting 05:34:48 (4956): No heartbeat from core client for 30 sec - exiting 05:34:49 (4956): No heartbeat from core client for 30 sec - exiting 05:34:50 (4956): No heartbeat from core client for 30 sec - exiting 05:34:51 (4956): No heartbeat from core client for 30 sec - exiting 05:34:52 (4956): No heartbeat from core client for 30 sec - exiting 05:34:53 (4956): No heartbeat from core client for 30 sec - exiting 05:34:54 (4956): No heartbeat from core client for 30 sec - exiting 05:34:55 (4956): No heartbeat from core client for 30 sec - exiting 05:34:56 (4956): No heartbeat from core client for 30 sec - exiting 05:34:57 (4956): No heartbeat from core client for 30 sec - exiting 05:34:58 (4956): No heartbeat from core client for 30 sec - exiting 05:34:59 (4956): No heartbeat from core client for 30 sec - exiting 05:35:00 (4956): No heartbeat from core client for 30 sec - exiting 05:35:01 (4956): No heartbeat from core client for 30 sec - exiting 05:35:02 (4956): No heartbeat from core client for 30 sec - exiting 05:35:03 (4956): No heartbeat from core client for 30 sec - exiting 05:35:04 (4956): No heartbeat from core client for 30 sec - exiting 05:35:05 (4956): No heartbeat from core client for 30 sec - exiting 05:35:06 (4956): No heartbeat from core client for 30 sec - exiting 05:35:07 (4956): No heartbeat from core client for 30 sec - exiting 05:35:08 (4956): No heartbeat from core client for 30 sec - exiting 05:35:09 (4956): No heartbeat from core client for 30 sec - exiting 05:35:10 (4956): No heartbeat from core client for 30 sec - exiting 05:35:11 (4956): No heartbeat from core client for 30 sec - exiting 05:35:12 (4956): No heartbeat from core client for 30 sec - exiting 05:35:13 (4956): No heartbeat from core client for 30 sec - exiting 05:35:14 (4956): No heartbeat from core client for 30 sec - exiting 05:35:15 (4956): No heartbeat from core client for 30 sec - exiting 05:35:16 (4956): No heartbeat from core client for 30 sec - exiting 05:35:17 (4956): No heartbeat from core client for 30 sec - exiting 05:35:18 (4956): No heartbeat from core client for 30 sec - exiting 05:35:19 (4956): No heartbeat from core client for 30 sec - exiting 05:35:20 (4956): No heartbeat from core client for 30 sec - exiting 05:35:21 (4956): No heartbeat from core client for 30 sec - exiting 05:35:22 (4956): No heartbeat from core client for 30 sec - exiting 05:35:23 (4956): No heartbeat from core client for 30 sec - exiting 05:35:24 (4956): No heartbeat from core client for 30 sec - exiting 05:35:25 (4956): No heartbeat from core client for 30 sec - exiting 05:35:26 (4956): No heartbeat from core client for 30 sec - exiting 05:35:27 (4956): No heartbeat from core client for 30 sec - exiting 05:35:28 (4956): No heartbeat from core client for 30 sec - exiting 05:35:29 (4956): No heartbeat from core client for 30 sec - exiting 05:35:30 (4956): No heartbeat from core client for 30 sec - exiting 05:35:31 (4956): No heartbeat from core client for 30 sec - exiting 05:35:32 (4956): No heartbeat from core client for 30 sec - exiting 05:35:33 (4956): No heartbeat from core client for 30 sec - exiting 05:35:35 (4956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5380, selfPID=3644, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3400, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 08:19:02 (5912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5404, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4504, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5908, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4888, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4988, selfPID=4196, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4776, selfPID=4776, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6748, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8048, selfPID=1284, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3820, selfPID=6072, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3748, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5460, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5456, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5380, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5852, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5892, selfPID=1204, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4728, selfPID=5504, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Feb 2012 09:47:17	1016212	13889645	hadam3p_eu_8aw0_2006_1_007664137_2	138,336	588,650	4.2552
04 Feb 2012 19:40:11	1016212	13889645	hadam3p_eu_8aw0_2006_1_007664137_2	126,816	540,139	4.2592
03 Feb 2012 22:50:57	1016212	13889645	hadam3p_eu_8aw0_2006_1_007664137_2	115,296	490,996	4.2586
02 Feb 2012 01:19:34	1016212	13889645	hadam3p_eu_8aw0_2006_1_007664137_2	103,776	441,431	4.2537
30 Jan 2012 13:23:11	1016212	13889645	hadam3p_eu_8aw0_2006_1_007664137_2	92,256	392,354	4.2529
26 Jan 2012 13:33:00	1016212	13889645	hadam3p_eu_8aw0_2006_1_007664137_2	80,736	344,735	4.2699
23 Jan 2012 13:51:30	1016212	13889645	hadam3p_eu_8aw0_2006_1_007664137_2	69,216	296,027	4.2769
20 Jan 2012 09:24:57	1016212	13889645	hadam3p_eu_8aw0_2006_1_007664137_2	57,696	247,300	4.2863
18 Jan 2012 09:04:14	1016212	13889645	hadam3p_eu_8aw0_2006_1_007664137_2	46,187	198,675	4.3015
18 Jan 2012 08:04:01	1016212	13889645	hadam3p_eu_8aw0_2006_1_007664137_2	46,176	197,915	4.2861
14 Jan 2012 08:12:02	1016212	13889645	hadam3p_eu_8aw0_2006_1_007664137_2	34,656	148,756	4.2924
13 Jan 2012 13:58:48	1016212	13889645	hadam3p_eu_8aw0_2006_1_007664137_2	23,136	99,491	4.3003
10 Jan 2012 20:20:37	1016212	13889645	hadam3p_eu_8aw0_2006_1_007664137_2	11,616	51,236	4.4108