Task 13854246

Name	hadam3p_eu_803v_1998_1_007626948_1
Workunit	7805267
Created	3 Jan 2012, 11:27:15 UTC
Sent	3 Jan 2012, 11:27:19 UTC
Report deadline	15 Dec 2012, 16:47:19 UTC
Received	28 Feb 2012, 21:32:37 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	934531
Run time	13 days 8 hours 54 min 57 sec
CPU time	11 days 2 hours 45 min 14 sec
Validate state	Workunit error - check skipped
Credit	2,386.39
Device peak FLOPS	1.58 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:37:45 (18712): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 01:37:50 (18712): No heartbeat from core client for 30 sec - exiting 01:37:51 (18712): No heartbeat from core client for 30 sec - exiting 01:37:52 (18712): No heartbeat from core client for 30 sec - exiting 01:37:53 (18712): No heartbeat from core client for 30 sec - exiting 01:37:54 (18712): No heartbeat from core client for 30 sec - exiting 01:37:55 (18712): No heartbeat from core client for 30 sec - exiting 01:37:56 (18712): No heartbeat from core client for 30 sec - exiting 01:37:57 (18712): No heartbeat from core client for 30 sec - exiting 01:37:58 (18712): No heartbeat from core client for 30 sec - exiting 01:38:00 (18712): No heartbeat from core client for 30 sec - exiting 01:38:01 (18712): No heartbeat from core client for 30 sec - exiting 01:38:02 (18712): No heartbeat from core client for 30 sec - exiting 01:38:03 (18712): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5096, iMonCtr=2 Model crash detected, will try to restart... 20:08:00 (5984): No heartbeat from core client for 30 sec - exiting 20:08:01 (5984): No heartbeat from core client for 30 sec - exiting 20:08:02 (5984): No heartbeat from core client for 30 sec - exiting 20:08:03 (5984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5296, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5388, iMonCtr=2 Model crash detected, will try to restart... 19:40:42 (1424): No heartbeat from core client for 30 sec - exiting 19:40:43 (1424): No heartbeat from core client for 30 sec - exiting 19:40:44 (1424): No heartbeat from core client for 30 sec - exiting 19:40:45 (1424): No heartbeat from core client for 30 sec - exiting 19:40:46 (1424): No heartbeat from core client for 30 sec - exiting 19:41:17 (1424): No heartbeat from core client for 30 sec - exiting 19:41:18 (1424): No heartbeat from core client for 30 sec - exiting 19:41:19 (1424): No heartbeat from core client for 30 sec - exiting 19:41:20 (1424): No heartbeat from core client for 30 sec - exiting 19:41:21 (1424): No heartbeat from core client for 30 sec - exiting 19:41:22 (1424): No heartbeat from core client for 30 sec - exiting 19:41:23 (1424): No heartbeat from core client for 30 sec - exiting 19:41:24 (1424): No heartbeat from core client for 30 sec - exiting 19:41:25 (1424): No heartbeat from core client for 30 sec - exiting 19:41:26 (1424): No heartbeat from core client for 30 sec - exiting 19:41:27 (1424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:46:06 (5304): No heartbeat from core client for 30 sec - exiting 07:46:08 (5304): No heartbeat from core client for 30 sec - exiting 07:46:09 (5304): No heartbeat from core client for 30 sec - exiting 07:46:11 (5304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:46:12 (5304): No heartbeat from core client for 30 sec - exiting 07:46:13 (5304): No heartbeat from core client for 30 sec - exiting 07:46:14 (5304): No heartbeat from core client for 30 sec - exiting 19:43:10 (6052): No heartbeat from core client for 30 sec - exiting 19:43:11 (6052): No heartbeat from core client for 30 sec - exiting 19:43:12 (6052): No heartbeat from core client for 30 sec - exiting 19:43:13 (6052): No heartbeat from core client for 30 sec - exiting 19:43:14 (6052): No heartbeat from core client for 30 sec - exiting 19:43:15 (6052): No heartbeat from core client for 30 sec - exiting 19:43:16 (6052): No heartbeat from core client for 30 sec - exiting 19:43:17 (6052): No heartbeat from core client for 30 sec - exiting 19:43:18 (6052): No heartbeat from core client for 30 sec - exiting 19:43:19 (6052): No heartbeat from core client for 30 sec - exiting 19:43:20 (6052): No heartbeat from core client for 30 sec - exiting 19:43:21 (6052): No heartbeat from core client for 30 sec - exiting 19:43:22 (6052): No heartbeat from core client for 30 sec - exiting 19:43:23 (6052): No heartbeat from core client for 30 sec - exiting 19:43:24 (6052): No heartbeat from core client for 30 sec - exiting 19:43:25 (6052): No heartbeat from core client for 30 sec - exiting 19:43:26 (6052): No heartbeat from core client for 30 sec - exiting 19:43:27 (6052): No heartbeat from core client for 30 sec - exiting 19:43:28 (6052): No heartbeat from core client for 30 sec - exiting 19:43:29 (6052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1088, selfPID=5360, iMonCtr=1 Model crash detected, will try to restart... 20:19:07 (6088): No heartbeat from core client for 30 sec - exiting 20:19:08 (6088): No heartbeat from core client for 30 sec - exiting 20:19:09 (6088): No heartbeat from core client for 30 sec - exiting 20:19:10 (6088): No heartbeat from core client for 30 sec - exiting 20:19:11 (6088): No heartbeat from core client for 30 sec - exiting 20:19:12 (6088): No heartbeat from core client for 30 sec - exiting 20:19:13 (6088): No heartbeat from core client for 30 sec - exiting 20:19:14 (6088): No heartbeat from core client for 30 sec - exiting 20:19:15 (6088): No heartbeat from core client for 30 sec - exiting 20:19:16 (6088): No heartbeat from core client for 30 sec - exiting 20:19:17 (6088): No heartbeat from core client for 30 sec - exiting 20:19:18 (6088): No heartbeat from core client for 30 sec - exiting 20:19:19 (6088): No heartbeat from core client for 30 sec - exiting 20:19:20 (6088): No heartbeat from core client for 30 sec - exiting 20:19:21 (6088): No heartbeat from core client for 30 sec - exiting 20:19:22 (6088): No heartbeat from core client for 30 sec - exiting 20:19:23 (6088): No heartbeat from core client for 30 sec - exiting 20:19:24 (6088): No heartbeat from core client for 30 sec - exiting 20:19:25 (6088): No heartbeat from core client for 30 sec - exiting 20:19:26 (6088): No heartbeat from core client for 30 sec - exiting 20:19:27 (6088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2396, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5884, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2516, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5792, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3200, iMonCtr=2 19:45:56 (6044): No heartbeat from core client for 30 sec - exiting 19:45:57 (6044): No heartbeat from core client for 30 sec - exiting 19:45:58 (6044): No heartbeat from core client for 30 sec - exiting 19:45:59 (6044): No heartbeat from core client for 30 sec - exiting 19:46:00 (6044): No heartbeat from core client for 30 sec - exiting 19:46:01 (6044): No heartbeat from core client for 30 sec - exiting 19:46:02 (6044): No heartbeat from core client for 30 sec - exiting 19:46:03 (6044): No heartbeat from core client for 30 sec - exiting 19:46:04 (6044): No heartbeat from core client for 30 sec - exiting 19:46:05 (6044): No heartbeat from core client for 30 sec - exiting 19:46:06 (6044): No heartbeat from core client for 30 sec - exiting 19:46:07 (6044): No heartbeat from core client for 30 sec - exiting 19:46:08 (6044): No heartbeat from core client for 30 sec - exiting 19:46:09 (6044): No heartbeat from core client for 30 sec - exiting 19:46:10 (6044): No heartbeat from core client for 30 sec - exiting 19:46:11 (6044): No heartbeat from core client for 30 sec - exiting 19:46:12 (6044): No heartbeat from core client for 30 sec - exiting 19:46:13 (6044): No heartbeat from core client for 30 sec - exiting 19:46:14 (6044): No heartbeat from core client for 30 sec - exiting 19:46:15 (6044): No heartbeat from core client for 30 sec - exiting 19:46:16 (6044): No heartbeat from core client for 30 sec - exiting 19:46:17 (6044): No heartbeat from core client for 30 sec - exiting 19:46:18 (6044): No heartbeat from core client for 30 sec - exiting 19:46:19 (6044): No heartbeat from core client for 30 sec - exiting 19:46:20 (6044): No heartbeat from core client for 30 sec - exiting 19:46:21 (6044): No heartbeat from core client for 30 sec - exiting 19:46:22 (6044): No heartbeat from core client for 30 sec - exiting 19:46:23 (6044): No heartbeat from core client for 30 sec - exiting 19:46:24 (6044): No heartbeat from core client for 30 sec - exiting 19:46:25 (6044): No heartbeat from core client for 30 sec - exiting 19:46:26 (6044): No heartbeat from core client for 30 sec - exiting 19:46:28 (6044): No heartbeat from core client for 30 sec - exiting 19:46:29 (6044): No heartbeat from core client for 30 sec - exiting 19:46:30 (6044): No heartbeat from core client for 30 sec - exiting 19:46:31 (6044): No heartbeat from core client for 30 sec - exiting 19:46:32 (6044): No heartbeat from core client for 30 sec - exiting 19:46:33 (6044): No heartbeat from core client for 30 sec - exiting 19:46:34 (6044): No heartbeat from core client for 30 sec - exiting 19:46:35 (6044): No heartbeat from core client for 30 sec - exiting 19:46:36 (6044): No heartbeat from core client for 30 sec - exiting 19:46:37 (6044): No heartbeat from core client for 30 sec - exiting 19:46:38 (6044): No heartbeat from core client for 30 sec - exiting 19:46:39 (6044): No heartbeat from core client for 30 sec - exiting 19:46:40 (6044): No heartbeat from core client for 30 sec - exiting 19:46:41 (6044): No heartbeat from core client for 30 sec - exiting 19:46:42 (6044): No heartbeat from core client for 30 sec - exiting 19:46:43 (6044): No heartbeat from core client for 30 sec - exiting 19:46:44 (6044): No heartbeat from core client for 30 sec - exiting 19:46:45 (6044): No heartbeat from core client for 30 sec - exiting 19:46:46 (6044): No heartbeat from core client for 30 sec - exiting 19:46:47 (6044): No heartbeat from core client for 30 sec - exiting 19:46:48 (6044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:01:11 (3108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:01:13 (3108): No heartbeat from core client for 30 sec - exiting 20:01:14 (3108): No heartbeat from core client for 30 sec - exiting 20:01:15 (3108): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4592, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:38:54 (5560): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 02:39:00 (5560): No heartbeat from core client for 30 sec - exiting 02:39:01 (5560): No heartbeat from core client for 30 sec - exiting 02:39:02 (5560): No heartbeat from core client for 30 sec - exiting 02:39:03 (5560): No heartbeat from core client for 30 sec - exiting 02:39:04 (5560): No heartbeat from core client for 30 sec - exiting 02:39:05 (5560): No heartbeat from core client for 30 sec - exiting 02:39:06 (5560): No heartbeat from core client for 30 sec - exiting 02:39:07 (5560): No heartbeat from core client for 30 sec - exiting 02:39:08 (5560): No heartbeat from core client for 30 sec - exiting 02:39:10 (5560): No heartbeat from core client for 30 sec - exiting 02:39:11 (5560): No heartbeat from core client for 30 sec - exiting 02:39:12 (5560): No heartbeat from core client for 30 sec - exiting 02:39:13 (5560): No heartbeat from core client for 30 sec - exiting 02:39:14 (5560): No heartbeat from core client for 30 sec - exiting 02:39:15 (5560): No heartbeat from core client for 30 sec - exiting 02:39:16 (5560): No heartbeat from core client for 30 sec - exiting 02:39:17 (5560): No heartbeat from core client for 30 sec - exiting 02:39:18 (5560): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8152, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:53:05 (5952): No heartbeat from core client for 30 sec - exiting 18:53:06 (5952): No heartbeat from core client for 30 sec - exiting 18:53:07 (5952): No heartbeat from core client for 30 sec - exiting 18:53:08 (5952): No heartbeat from core client for 30 sec - exiting 18:53:09 (5952): No heartbeat from core client for 30 sec - exiting 18:53:10 (5952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3772, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1972, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5040, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2824, iMonCtr=2 19:41:49 (1104): No heartbeat from core client for 30 sec - exiting 19:41:50 (1104): No heartbeat from core client for 30 sec - exiting 19:41:51 (1104): No heartbeat from core client for 30 sec - exiting 19:41:52 (1104): No heartbeat from core client for 30 sec - exiting 19:41:53 (1104): No heartbeat from core client for 30 sec - exiting 19:41:54 (1104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:26:48 (5760): No heartbeat from core client for 30 sec - exiting 19:26:49 (5760): No heartbeat from core client for 30 sec - exiting 19:26:50 (5760): No heartbeat from core client for 30 sec - exiting 19:26:51 (5760): No heartbeat from core client for 30 sec - exiting 19:26:52 (5760): No heartbeat from core client for 30 sec - exiting 19:26:53 (5760): No heartbeat from core client for 30 sec - exiting 19:26:54 (5760): No heartbeat from core client for 30 sec - exiting 19:26:55 (5760): No heartbeat from core client for 30 sec - exiting 19:26:56 (5760): No heartbeat from core client for 30 sec - exiting 19:26:57 (5760): No heartbeat from core client for 30 sec - exiting 19:26:58 (5760): No heartbeat from core client for 30 sec - exiting 19:26:59 (5760): No heartbeat from core client for 30 sec - exiting 19:27:00 (5760): No heartbeat from core client for 30 sec - exiting 19:27:01 (5760): No heartbeat from core client for 30 sec - exiting 19:27:02 (5760): No heartbeat from core client for 30 sec - exiting 19:27:03 (5760): No heartbeat from core client for 30 sec - exiting 19:27:04 (5760): No heartbeat from core client for 30 sec - exiting 19:27:05 (5760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4320, iMonCtr=2 Model crash detected, will try to restart... 20:04:01 (6136): No heartbeat from core client for 30 sec - exiting 20:04:02 (6136): No heartbeat from core client for 30 sec - exiting 20:04:03 (6136): No heartbeat from core client for 30 sec - exiting 20:04:04 (6136): No heartbeat from core client for 30 sec - exiting 20:04:05 (6136): No heartbeat from core client for 30 sec - exiting 20:04:06 (6136): No heartbeat from core client for 30 sec - exiting 20:04:07 (6136): No heartbeat from core client for 30 sec - exiting 20:04:08 (6136): No heartbeat from core client for 30 sec - exiting 20:04:09 (6136): No heartbeat from core client for 30 sec - exiting 20:04:10 (6136): No heartbeat from core client for 30 sec - exiting 20:04:11 (6136): No heartbeat from core client for 30 sec - exiting 20:04:12 (6136): No heartbeat from core client for 30 sec - exiting 20:04:13 (6136): No heartbeat from core client for 30 sec - exiting 20:04:14 (6136): No heartbeat from core client for 30 sec - exiting 20:04:15 (6136): No heartbeat from core client for 30 sec - exiting 20:04:16 (6136): No heartbeat from core client for 30 sec - exiting 20:04:17 (6136): No heartbeat from core client for 30 sec - exiting 20:04:18 (6136): No heartbeat from core client for 30 sec - exiting 20:04:19 (6136): No heartbeat from core client for 30 sec - exiting 20:04:20 (6136): No heartbeat from core client for 30 sec - exiting 20:04:21 (6136): No heartbeat from core client for 30 sec - exiting 20:04:22 (6136): No heartbeat from core client for 30 sec - exiting 20:04:23 (6136): No heartbeat from core client for 30 sec - exiting 20:04:24 (6136): No heartbeat from core client for 30 sec - exiting 20:04:25 (6136): No heartbeat from core client for 30 sec - exiting 20:04:26 (6136): No heartbeat from core client for 30 sec - exiting 20:04:27 (6136): No heartbeat from core client for 30 sec - exiting 20:04:28 (6136): No heartbeat from core client for 30 sec - exiting 20:04:29 (6136): No heartbeat from core client for 30 sec - exiting 20:04:30 (6136): No heartbeat from core client for 30 sec - exiting 20:04:31 (6136): No heartbeat from core client for 30 sec - exiting 20:04:32 (6136): No heartbeat from core client for 30 sec - exiting 20:04:33 (6136): No heartbeat from core client for 30 sec - exiting 20:04:34 (6136): No heartbeat from core client for 30 sec - exiting 20:04:35 (6136): No heartbeat from core client for 30 sec - exiting 20:04:36 (6136): No heartbeat from core client for 30 sec - exiting 20:04:37 (6136): No heartbeat from core client for 30 sec - exiting 20:04:38 (6136): No heartbeat from core client for 30 sec - exiting 20:04:39 (6136): No heartbeat from core client for 30 sec - exiting 20:04:40 (6136): No heartbeat from core client for 30 sec - exiting 20:04:41 (6136): No heartbeat from core client for 30 sec - exiting 20:04:42 (6136): No heartbeat from core client for 30 sec - exiting 20:04:43 (6136): No heartbeat from core client for 30 sec - exiting 20:04:44 (6136): No heartbeat from core client for 30 sec - exiting 20:04:45 (6136): No heartbeat from core client for 30 sec - exiting 20:04:46 (6136): No heartbeat from core client for 30 sec - exiting 20:04:47 (6136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6044, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5128, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=376, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5680, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:34:37 (3216): No heartbeat from core client for 30 sec - exiting 20:34:38 (3216): No heartbeat from core client for 30 sec - exiting 20:34:39 (3216): No heartbeat from core client for 30 sec - exiting 20:34:40 (3216): No heartbeat from core client for 30 sec - exiting 20:34:41 (3216): No heartbeat from core client for 30 sec - exiting 20:34:42 (3216): No heartbeat from core client for 30 sec - exiting 20:34:43 (3216): No heartbeat from core client for 30 sec - exiting 20:34:44 (3216): No heartbeat from core client for 30 sec - exiting 20:34:45 (3216): No heartbeat from core client for 30 sec - exiting 20:34:46 (3216): No heartbeat from core client for 30 sec - exiting 20:34:47 (3216): No heartbeat from core client for 30 sec - exiting 20:34:48 (3216): No heartbeat from core client for 30 sec - exiting 20:34:49 (3216): No heartbeat from core client for 30 sec - exiting 20:34:50 (3216): No heartbeat from core client for 30 sec - exiting 20:34:51 (3216): No heartbeat from core client for 30 sec - exiting 20:34:52 (3216): No heartbeat from core client for 30 sec - exiting 20:34:53 (3216): No heartbeat from core client for 30 sec - exiting 20:34:54 (3216): No heartbeat from core client for 30 sec - exiting 20:34:55 (3216): No heartbeat from core client for 30 sec - exiting 20:34:56 (3216): No heartbeat from core client for 30 sec - exiting 20:34:57 (3216): No heartbeat from core client for 30 sec - exiting 20:34:58 (3216): No heartbeat from core client for 30 sec - exiting 20:34:59 (3216): No heartbeat from core client for 30 sec - exiting 20:35:00 (3216): No heartbeat from core client for 30 sec - exiting 20:35:01 (3216): No heartbeat from core client for 30 sec - exiting 20:35:02 (3216): No heartbeat from core client for 30 sec - exiting 20:35:03 (3216): No heartbeat from core client for 30 sec - exiting 20:35:04 (3216): No heartbeat from core client for 30 sec - exiting 20:35:05 (3216): No heartbeat from core client for 30 sec - exiting 20:35:06 (3216): No heartbeat from core client for 30 sec - exiting 20:35:07 (3216): No heartbeat from core client for 30 sec - exiting 20:35:08 (3216): No heartbeat from core client for 30 sec - exiting 20:35:09 (3216): No heartbeat from core client for 30 sec - exiting 20:35:10 (3216): No heartbeat from core client for 30 sec - exiting 20:35:11 (3216): No heartbeat from core client for 30 sec - exiting 20:35:12 (3216): No heartbeat from core client for 30 sec - exiting 20:35:44 (3216): No heartbeat from core client for 30 sec - exiting 20:35:45 (3216): No heartbeat from core client for 30 sec - exiting 20:35:46 (3216): No heartbeat from core client for 30 sec - exiting 20:35:47 (3216): No heartbeat from core client for 30 sec - exiting 20:35:48 (3216): No heartbeat from core client for 30 sec - exiting 20:35:49 (3216): No heartbeat from core client for 30 sec - exiting 20:35:50 (3216): No heartbeat from core client for 30 sec - exiting 20:35:51 (3216): No heartbeat from core client for 30 sec - exiting 20:35:52 (3216): No heartbeat from core client for 30 sec - exiting 20:35:53 (3216): No heartbeat from core client for 30 sec - exiting 20:35:54 (3216): No heartbeat from core client for 30 sec - exiting 20:35:55 (3216): No heartbeat from core client for 30 sec - exiting 20:35:56 (3216): No heartbeat from core client for 30 sec - exiting 20:35:57 (3216): No heartbeat from core client for 30 sec - exiting 20:35:58 (3216): No heartbeat from core client for 30 sec - exiting 20:35:59 (3216): No heartbeat from core client for 30 sec - exiting 20:36:00 (3216): No heartbeat from core client for 30 sec - exiting 20:36:01 (3216): No heartbeat from core client for 30 sec - exiting 20:36:02 (3216): No heartbeat from core client for 30 sec - exiting 20:36:03 (3216): No heartbeat from core client for 30 sec - exiting 20:36:04 (3216): No heartbeat from core client for 30 sec - exiting 20:36:05 (3216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:59:32 (5476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:59:33 (5476): No heartbeat from core client for 30 sec - exiting 20:59:34 (5476): No heartbeat from core client for 30 sec - exiting 20:59:35 (5476): No heartbeat from core client for 30 sec - exiting 21:00:16 (4228): No heartbeat from core client for 30 sec - exiting 21:00:17 (4228): No heartbeat from core client for 30 sec - exiting 21:00:18 (4228): No heartbeat from core client for 30 sec - exiting 21:00:19 (4228): No heartbeat from core client for 30 sec - exiting 21:00:20 (4228): No heartbeat from core client for 30 sec - exiting 21:00:21 (4228): No heartbeat from core client for 30 sec - exiting 21:00:22 (4228): No heartbeat from core client for 30 sec - exiting 21:00:23 (4228): No heartbeat from core client for 30 sec - exiting 21:00:24 (4228): No heartbeat from core client for 30 sec - exiting 21:00:25 (4228): No heartbeat from core client for 30 sec - exiting 21:00:26 (4228): No heartbeat from core client for 30 sec - exiting 21:00:27 (4228): No heartbeat from core client for 30 sec - exiting 21:00:28 (4228): No heartbeat from core client for 30 sec - exiting 21:00:29 (4228): No heartbeat from core client for 30 sec - exiting 21:00:30 (4228): No heartbeat from core client for 30 sec - exiting 21:00:31 (4228): No heartbeat from core client for 30 sec - exiting 21:00:32 (4228): No heartbeat from core client for 30 sec - exiting 21:00:33 (4228): No heartbeat from core client for 30 sec - exiting 21:00:34 (4228): No heartbeat from core client for 30 sec - exiting 21:00:35 (4228): No heartbeat from core client for 30 sec - exiting 21:00:36 (4228): No heartbeat from core client for 30 sec - exiting 21:00:37 (4228): No heartbeat from core client for 30 sec - exiting 21:00:38 (4228): No heartbeat from core client for 30 sec - exiting 21:00:39 (4228): No heartbeat from core client for 30 sec - exiting 21:00:40 (4228): No heartbeat from core client for 30 sec - exiting 21:00:41 (4228): No heartbeat from core client for 30 sec - exiting 21:00:42 (4228): No heartbeat from core client for 30 sec - exiting 21:00:43 (4228): No heartbeat from core client for 30 sec - exiting 21:00:45 (4228): No heartbeat from core client for 30 sec - exiting 21:00:46 (4228): No heartbeat from core client for 30 sec - exiting 21:00:47 (4228): No heartbeat from core client for 30 sec - exiting 21:00:48 (4228): No heartbeat from core client for 30 sec - exiting 21:00:49 (4228): No heartbeat from core client for 30 sec - exiting 21:00:50 (4228): No heartbeat from core client for 30 sec - exiting 21:00:51 (4228): No heartbeat from core client for 30 sec - exiting 21:00:52 (4228): No heartbeat from core client for 30 sec - exiting 21:00:53 (4228): No heartbeat from core client for 30 sec - exiting 21:00:54 (4228): No heartbeat from core client for 30 sec - exiting 21:00:55 (4228): No heartbeat from core client for 30 sec - exiting 21:00:56 (4228): No heartbeat from core client for 30 sec - exiting 21:00:57 (4228): No heartbeat from core client for 30 sec - exiting 21:00:58 (4228): No heartbeat from core client for 30 sec - exiting 21:00:59 (4228): No heartbeat from core client for 30 sec - exiting 21:01:00 (4228): No heartbeat from core client for 30 sec - exiting 21:01:01 (4228): No heartbeat from core client for 30 sec - exiting 21:01:02 (4228): No heartbeat from core client for 30 sec - exiting 21:01:03 (4228): No heartbeat from core client for 30 sec - exiting 21:01:04 (4228): No heartbeat from core client for 30 sec - exiting 21:01:05 (4228): No heartbeat from core client for 30 sec - exiting 21:01:06 (4228): No heartbeat from core client for 30 sec - exiting 21:01:07 (4228): No heartbeat from core client for 30 sec - exiting 21:01:08 (4228): No heartbeat from core client for 30 sec - exiting 21:01:09 (4228): No heartbeat from core client for 30 sec - exiting 21:01:10 (4228): No heartbeat from core client for 30 sec - exiting 21:01:11 (4228): No heartbeat from core client for 30 sec - exiting 21:01:12 (4228): No heartbeat from core client for 30 sec - exiting 21:01:13 (4228): No heartbeat from core client for 30 sec - exiting 21:01:14 (4228): No heartbeat from core client for 30 sec - exiting 21:01:15 (4228): No heartbeat from core client for 30 sec - exiting 21:01:16 (4228): No heartbeat from core client for 30 sec - exiting 21:01:17 (4228): No heartbeat from core client for 30 sec - exiting 21:01:18 (4228): No heartbeat from core client for 30 sec - exiting 21:01:19 (4228): No heartbeat from core client for 30 sec - exiting 21:01:20 (4228): No heartbeat from core client for 30 sec - exiting 21:01:21 (4228): No heartbeat from core client for 30 sec - exiting 21:01:22 (4228): No heartbeat from core client for 30 sec - exiting 21:01:23 (4228): No heartbeat from core client for 30 sec - exiting 21:01:24 (4228): No heartbeat from core client for 30 sec - exiting 21:01:25 (4228): No heartbeat from core client for 30 sec - exiting 21:01:26 (4228): No heartbeat from core client for 30 sec - exiting 21:01:27 (4228): No heartbeat from core client for 30 sec - exiting 21:01:28 (4228): No heartbeat from core client for 30 sec - exiting 21:01:29 (4228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Feb 2012 02:24:47	934531	13854246	hadam3p_eu_803v_1998_1_007626948_1	138,336	958,622	6.9297
25 Feb 2012 08:55:38	934531	13854246	hadam3p_eu_803v_1998_1_007626948_1	126,816	872,901	6.8832
22 Feb 2012 00:48:45	934531	13854246	hadam3p_eu_803v_1998_1_007626948_1	115,296	790,486	6.8561
19 Feb 2012 11:56:35	934531	13854246	hadam3p_eu_803v_1998_1_007626948_1	103,776	709,700	6.8388
18 Feb 2012 01:28:21	934531	13854246	hadam3p_eu_803v_1998_1_007626948_1	92,256	627,763	6.8046
15 Feb 2012 03:08:30	934531	13854246	hadam3p_eu_803v_1998_1_007626948_1	80,736	547,922	6.7866
12 Feb 2012 15:30:46	934531	13854246	hadam3p_eu_803v_1998_1_007626948_1	69,216	468,790	6.7729
11 Feb 2012 01:56:43	934531	13854246	hadam3p_eu_803v_1998_1_007626948_1	57,696	391,329	6.7826
07 Feb 2012 21:39:29	934531	13854246	hadam3p_eu_803v_1998_1_007626948_1	46,176	314,468	6.8102
05 Feb 2012 01:42:31	934531	13854246	hadam3p_eu_803v_1998_1_007626948_1	34,656	234,957	6.7797
01 Feb 2012 20:02:14	934531	13854246	hadam3p_eu_803v_1998_1_007626948_1	23,136	156,943	6.7835
29 Jan 2012 19:43:53	934531	13854246	hadam3p_eu_803v_1998_1_007626948_1	11,616	78,959	6.7974