Task 13663864

Name	hadam3p_saf_24he_1961_1_007037898_2
Workunit	7241214
Created	26 Nov 2011, 16:57:11 UTC
Sent	26 Nov 2011, 16:57:22 UTC
Report deadline	7 Nov 2012, 22:17:22 UTC
Received	15 Jan 2012, 20:54:18 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1181701
Run time	2 days 16 hours 25 min 44 sec
CPU time	2 days 12 hours 36 min 45 sec
Validate state	Invalid
Credit	1,870.33
Device peak FLOPS	3.41 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5956, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5924, selfPID=5924, iMonCtr=2 21:13:39 (4900): No heartbeat from core client for 30 sec - exiting 21:13:41 (4900): No heartbeat from core client for 30 sec - exiting 21:13:42 (4900): No heartbeat from core client for 30 sec - exiting 21:13:43 (4900): No heartbeat from core client for 30 sec - exiting 21:13:44 (4900): No heartbeat from core client for 30 sec - exiting 21:13:45 (4900): No heartbeat from core client for 30 sec - exiting 21:13:46 (4900): No heartbeat from core client for 30 sec - exiting 21:13:47 (4900): No heartbeat from core client for 30 sec - exiting 21:13:48 (4900): No heartbeat from core client for 30 sec - exiting 21:13:49 (4900): No heartbeat from core client for 30 sec - exiting 21:13:50 (4900): No heartbeat from core client for 30 sec - exiting 21:13:52 (4900): No heartbeat from core client for 30 sec - exiting 21:13:53 (4900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:20:43 (5008): No heartbeat from core client for 30 sec - exiting 17:20:44 (5008): No heartbeat from core client for 30 sec - exiting 17:20:45 (5008): No heartbeat from core client for 30 sec - exiting 17:20:46 (5008): No heartbeat from core client for 30 sec - exiting 17:20:47 (5008): No heartbeat from core client for 30 sec - exiting 17:20:48 (5008): No heartbeat from core client for 30 sec - exiting 17:20:49 (5008): No heartbeat from core client for 30 sec - exiting 17:20:51 (5008): No heartbeat from core client for 30 sec - exiting 17:20:52 (5008): No heartbeat from core client for 30 sec - exiting 17:20:53 (5008): No heartbeat from core client for 30 sec - exiting 17:20:54 (5008): No heartbeat from core client for 30 sec - exiting 17:20:55 (5008): No heartbeat from core client for 30 sec - exiting 17:20:56 (5008): No heartbeat from core client for 30 sec - exiting 17:20:57 (5008): No heartbeat from core client for 30 sec - exiting 17:20:58 (5008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:22:14 (4396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:22:15 (4396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3960, selfPID=3960, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:27:35 (3184): No heartbeat from core client for 30 sec - exiting 18:27:36 (3184): No heartbeat from core client for 30 sec - exiting 18:27:37 (3184): No heartbeat from core client for 30 sec - exiting 18:27:38 (3184): No heartbeat from core client for 30 sec - exiting 18:27:39 (3184): No heartbeat from core client for 30 sec - exiting 18:27:40 (3184): No heartbeat from core client for 30 sec - exiting 18:27:41 (3184): No heartbeat from core client for 30 sec - exiting 18:27:42 (3184): No heartbeat from core client for 30 sec - exiting 18:27:43 (3184): No heartbeat from core client for 30 sec - exiting 18:27:44 (3184): No heartbeat from core client for 30 sec - exiting 18:27:45 (3184): No heartbeat from core client for 30 sec - exiting 18:27:46 (3184): No heartbeat from core client for 30 sec - exiting 18:27:47 (3184): No heartbeat from core client for 30 sec - exiting 18:27:48 (3184): No heartbeat from core client for 30 sec - exiting 18:27:49 (3184): No heartbeat from core client for 30 sec - exiting 18:27:50 (3184): No heartbeat from core client for 30 sec - exiting 18:27:51 (3184): No heartbeat from core client for 30 sec - exiting 18:27:52 (3184): No heartbeat from core client for 30 sec - exiting 18:27:53 (3184): No heartbeat from core client for 30 sec - exiting 18:27:54 (3184): No heartbeat from core client for 30 sec - exiting 18:27:55 (3184): No heartbeat from core client for 30 sec - exiting 18:27:56 (3184): No heartbeat from core client for 30 sec - exiting 18:27:57 (3184): No heartbeat from core client for 30 sec - exiting 18:27:58 (3184): No heartbeat from core client for 30 sec - exiting 18:27:59 (3184): No heartbeat from core client for 30 sec - exiting 18:28:00 (3184): No heartbeat from core client for 30 sec - exiting 18:28:01 (3184): No heartbeat from core client for 30 sec - exiting 18:28:02 (3184): No heartbeat from core client for 30 sec - exiting 18:28:03 (3184): No heartbeat from core client for 30 sec - exiting 18:28:04 (3184): No heartbeat from core client for 30 sec - exiting 18:28:05 (3184): No heartbeat from core client for 30 sec - exiting 18:28:06 (3184): No heartbeat from core client for 30 sec - exiting 18:28:07 (3184): No heartbeat from core client for 30 sec - exiting 18:28:08 (3184): No heartbeat from core client for 30 sec - exiting 18:28:09 (3184): No heartbeat from core client for 30 sec - exiting 18:28:10 (3184): No heartbeat from core client for 30 sec - exiting 18:28:11 (3184): No heartbeat from core client for 30 sec - exiting 18:28:12 (3184): No heartbeat from core client for 30 sec - exiting 18:28:13 (3184): No heartbeat from core client for 30 sec - exiting 18:28:14 (3184): No heartbeat from core client for 30 sec - exiting 18:28:15 (3184): No heartbeat from core client for 30 sec - exiting 18:28:16 (3184): No heartbeat from core client for 30 sec - exiting 18:28:17 (3184): No heartbeat from core client for 30 sec - exiting 18:28:18 (3184): No heartbeat from core client for 30 sec - exiting 18:28:19 (3184): No heartbeat from core client for 30 sec - exiting 18:28:20 (3184): No heartbeat from core client for 30 sec - exiting 18:28:21 (3184): No heartbeat from core client for 30 sec - exiting 18:28:22 (3184): No heartbeat from core client for 30 sec - exiting 18:28:23 (3184): No heartbeat from core client for 30 sec - exiting 18:28:25 (3184): No heartbeat from core client for 30 sec - exiting 18:28:26 (3184): No heartbeat from core client for 30 sec - exiting 18:28:27 (3184): No heartbeat from core client for 30 sec - exiting 18:28:28 (3184): No heartbeat from core client for 30 sec - exiting 18:28:29 (3184): No heartbeat from core client for 30 sec - exiting 18:28:30 (3184): No heartbeat from core client for 30 sec - exiting 18:28:31 (3184): No heartbeat from core client for 30 sec - exiting 18:28:32 (3184): No heartbeat from core client for 30 sec - exiting 18:28:33 (3184): No heartbeat from core client for 30 sec - exiting 18:28:34 (3184): No heartbeat from core client for 30 sec - exiting 18:28:35 (3184): No heartbeat from core client for 30 sec - exiting 18:28:36 (3184): No heartbeat from core client for 30 sec - exiting 18:28:37 (3184): No heartbeat from core client for 30 sec - exiting 18:28:38 (3184): No heartbeat from core client for 30 sec - exiting 18:28:40 (3184): No heartbeat from core client for 30 sec - exiting 18:28:41 (3184): No heartbeat from core client for 30 sec - exiting 18:28:42 (3184): No heartbeat from core client for 30 sec - exiting 18:28:43 (3184): No heartbeat from core client for 30 sec - exiting 18:28:44 (3184): No heartbeat from core client for 30 sec - exiting 18:28:45 (3184): No heartbeat from core client for 30 sec - exiting 18:28:46 (3184): No heartbeat from core client for 30 sec - exiting 18:28:47 (3184): No heartbeat from core client for 30 sec - exiting 18:28:48 (3184): No heartbeat from core client for 30 sec - exiting 18:28:49 (3184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:57:04 (3440): No heartbeat from core client for 30 sec - exiting 08:57:05 (3440): No heartbeat from core client for 30 sec - exiting 08:57:06 (3440): No heartbeat from core client for 30 sec - exiting 08:57:07 (3440): No heartbeat from core client for 30 sec - exiting 08:57:08 (3440): No heartbeat from core client for 30 sec - exiting 08:57:09 (3440): No heartbeat from core client for 30 sec - exiting 08:57:11 (3440): No heartbeat from core client for 30 sec - exiting 08:57:12 (3440): No heartbeat from core client for 30 sec - exiting 08:57:13 (3440): No heartbeat from core client for 30 sec - exiting 08:57:14 (3440): No heartbeat from core client for 30 sec - exiting 08:57:15 (3440): No heartbeat from core client for 30 sec - exiting 08:57:16 (3440): No heartbeat from core client for 30 sec - exiting 08:57:17 (3440): No heartbeat from core client for 30 sec - exiting 08:57:18 (3440): No heartbeat from core client for 30 sec - exiting 08:57:19 (3440): No heartbeat from core client for 30 sec - exiting 08:57:20 (3440): No heartbeat from core client for 30 sec - exiting 08:57:21 (3440): No heartbeat from core client for 30 sec - exiting 08:57:23 (3440): No heartbeat from core client for 30 sec - exiting 08:57:24 (3440): No heartbeat from core client for 30 sec - exiting 08:57:25 (3440): No heartbeat from core client for 30 sec - exiting 08:57:26 (3440): No heartbeat from core client for 30 sec - exiting 08:57:27 (3440): No heartbeat from core client for 30 sec - exiting 08:57:28 (3440): No heartbeat from core client for 30 sec - exiting 08:57:29 (3440): No heartbeat from core client for 30 sec - exiting 08:57:30 (3440): No heartbeat from core client for 30 sec - exiting 08:57:31 (3440): No heartbeat from core client for 30 sec - exiting 08:57:32 (3440): No heartbeat from core client for 30 sec - exiting 08:57:34 (3440): No heartbeat from core client for 30 sec - exiting 08:57:35 (3440): No heartbeat from core client for 30 sec - exiting 08:57:36 (3440): No heartbeat from core client for 30 sec - exiting 08:57:37 (3440): No heartbeat from core client for 30 sec - exiting 08:57:38 (3440): No heartbeat from core client for 30 sec - exiting 08:57:39 (3440): No heartbeat from core client for 30 sec - exiting 08:57:40 (3440): No heartbeat from core client for 30 sec - exiting 08:57:41 (3440): No heartbeat from core client for 30 sec - exiting 08:57:42 (3440): No heartbeat from core client for 30 sec - exiting 08:57:43 (3440): No heartbeat from core client for 30 sec - exiting 08:57:45 (3440): No heartbeat from core client for 30 sec - exiting 08:57:46 (3440): No heartbeat from core client for 30 sec - exiting 08:57:47 (3440): No heartbeat from core client for 30 sec - exiting 08:57:48 (3440): No heartbeat from core client for 30 sec - exiting 08:57:49 (3440): No heartbeat from core client for 30 sec - exiting 08:57:50 (3440): No heartbeat from core client for 30 sec - exiting 08:57:51 (3440): No heartbeat from core client for 30 sec - exiting 08:57:53 (3440): No heartbeat from core client for 30 sec - exiting 08:57:54 (3440): No heartbeat from core client for 30 sec - exiting 08:57:55 (3440): No heartbeat from core client for 30 sec - exiting 08:57:56 (3440): No heartbeat from core client for 30 sec - exiting 08:57:57 (3440): No heartbeat from core client for 30 sec - exiting 08:57:58 (3440): No heartbeat from core client for 30 sec - exiting 08:57:59 (3440): No heartbeat from core client for 30 sec - exiting 08:58:00 (3440): No heartbeat from core client for 30 sec - exiting 08:58:01 (3440): No heartbeat from core client for 30 sec - exiting 08:58:02 (3440): No heartbeat from core client for 30 sec - exiting 08:58:03 (3440): No heartbeat from core client for 30 sec - exiting 08:58:04 (3440): No heartbeat from core client for 30 sec - exiting 08:58:05 (3440): No heartbeat from core client for 30 sec - exiting 08:58:06 (3440): No heartbeat from core client for 30 sec - exiting 08:58:07 (3440): No heartbeat from core client for 30 sec - exiting 08:58:08 (3440): No heartbeat from core client for 30 sec - exiting 08:58:09 (3440): No heartbeat from core client for 30 sec - exiting 08:58:10 (3440): No heartbeat from core client for 30 sec - exiting 08:58:11 (3440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:00:06 (4532): No heartbeat from core client for 30 sec - exiting 09:00:07 (4532): No heartbeat from core client for 30 sec - exiting 09:00:08 (4532): No heartbeat from core client for 30 sec - exiting 09:00:09 (4532): No heartbeat from core client for 30 sec - exiting 09:00:10 (4532): No heartbeat from core client for 30 sec - exiting 09:00:11 (4532): No heartbeat from core client for 30 sec - exiting 09:00:12 (4532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:00:13 (4532): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:44:46 (4144): No heartbeat from core client for 30 sec - exiting 10:44:47 (4144): No heartbeat from core client for 30 sec - exiting 10:44:48 (4144): No heartbeat from core client for 30 sec - exiting 10:44:49 (4144): No heartbeat from core client for 30 sec - exiting 10:44:50 (4144): No heartbeat from core client for 30 sec - exiting 10:44:51 (4144): No heartbeat from core client for 30 sec - exiting 10:44:52 (4144): No heartbeat from core client for 30 sec - exiting 10:44:53 (4144): No heartbeat from core client for 30 sec - exiting 10:44:54 (4144): No heartbeat from core client for 30 sec - exiting 10:44:55 (4144): No heartbeat from core client for 30 sec - exiting 10:44:56 (4144): No heartbeat from core client for 30 sec - exiting 10:44:57 (4144): No heartbeat from core client for 30 sec - exiting 10:44:58 (4144): No heartbeat from core client for 30 sec - exiting 10:44:59 (4144): No heartbeat from core client for 30 sec - exiting 10:45:00 (4144): No heartbeat from core client for 30 sec - exiting 10:45:01 (4144): No heartbeat from core client for 30 sec - exiting 10:45:02 (4144): No heartbeat from core client for 30 sec - exiting 10:45:03 (4144): No heartbeat from core client for 30 sec - exiting 10:45:04 (4144): No heartbeat from core client for 30 sec - exiting 10:45:05 (4144): No heartbeat from core client for 30 sec - exiting 10:45:06 (4144): No heartbeat from core client for 30 sec - exiting 10:45:07 (4144): No heartbeat from core client for 30 sec - exiting 10:45:08 (4144): No heartbeat from core client for 30 sec - exiting 10:45:09 (4144): No heartbeat from core client for 30 sec - exiting 10:45:10 (4144): No heartbeat from core client for 30 sec - exiting 10:45:11 (4144): No heartbeat from core client for 30 sec - exiting 10:45:13 (4144): No heartbeat from core client for 30 sec - exiting 10:45:14 (4144): No heartbeat from core client for 30 sec - exiting 10:45:15 (4144): No heartbeat from core client for 30 sec - exiting 10:45:16 (4144): No heartbeat from core client for 30 sec - exiting 10:45:17 (4144): No heartbeat from core client for 30 sec - exiting 10:45:18 (4144): No heartbeat from core client for 30 sec - exiting 10:45:19 (4144): No heartbeat from core client for 30 sec - exiting 10:45:20 (4144): No heartbeat from core client for 30 sec - exiting 10:45:21 (4144): No heartbeat from core client for 30 sec - exiting 10:45:22 (4144): No heartbeat from core client for 30 sec - exiting 10:45:23 (4144): No heartbeat from core client for 30 sec - exiting 10:45:24 (4144): No heartbeat from core client for 30 sec - exiting 10:45:25 (4144): No heartbeat from core client for 30 sec - exiting 10:45:26 (4144): No heartbeat from core client for 30 sec - exiting 10:45:28 (4144): No heartbeat from core client for 30 sec - exiting 10:45:29 (4144): No heartbeat from core client for 30 sec - exiting 10:45:30 (4144): No heartbeat from core client for 30 sec - exiting 10:45:31 (4144): No heartbeat from core client for 30 sec - exiting 10:45:32 (4144): No heartbeat from core client for 30 sec - exiting 10:45:33 (4144): No heartbeat from core client for 30 sec - exiting 10:45:34 (4144): No heartbeat from core client for 30 sec - exiting 10:45:35 (4144): No heartbeat from core client for 30 sec - exiting 10:45:36 (4144): No heartbeat from core client for 30 sec - exiting 10:45:37 (4144): No heartbeat from core client for 30 sec - exiting 10:45:38 (4144): No heartbeat from core client for 30 sec - exiting 10:45:39 (4144): No heartbeat from core client for 30 sec - exiting 10:45:40 (4144): No heartbeat from core client for 30 sec - exiting 10:45:41 (4144): No heartbeat from core client for 30 sec - exiting 10:45:42 (4144): No heartbeat from core client for 30 sec - exiting 10:45:43 (4144): No heartbeat from core client for 30 sec - exiting 10:45:44 (4144): No heartbeat from core client for 30 sec - exiting 10:45:45 (4144): No heartbeat from core client for 30 sec - exiting 10:45:46 (4144): No heartbeat from core client for 30 sec - exiting 10:45:47 (4144): No heartbeat from core client for 30 sec - exiting 10:45:48 (4144): No heartbeat from core client for 30 sec - exiting 10:45:49 (4144): No heartbeat from core client for 30 sec - exiting 10:45:50 (4144): No heartbeat from core client for 30 sec - exiting 10:45:51 (4144): No heartbeat from core client for 30 sec - exiting 10:45:52 (4144): No heartbeat from core client for 30 sec - exiting 10:45:53 (4144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:12:05 (4108): No heartbeat from core client for 30 sec - exiting 07:12:06 (4108): No heartbeat from core client for 30 sec - exiting 07:12:07 (4108): No heartbeat from core client for 30 sec - exiting 07:12:08 (4108): No heartbeat from core client for 30 sec - exiting 07:12:09 (4108): No heartbeat from core client for 30 sec - exiting 07:12:10 (4108): No heartbeat from core client for 30 sec - exiting 07:12:11 (4108): No heartbeat from core client for 30 sec - exiting 07:12:12 (4108): No heartbeat from core client for 30 sec - exiting 07:12:13 (4108): No heartbeat from core client for 30 sec - exiting 07:12:14 (4108): No heartbeat from core client for 30 sec - exiting 07:12:15 (4108): No heartbeat from core client for 30 sec - exiting 07:12:16 (4108): No heartbeat from core client for 30 sec - exiting 07:12:17 (4108): No heartbeat from core client for 30 sec - exiting 07:12:18 (4108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4812, selfPID=4812, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 23:40:11 (3612): No heartbeat from core client for 30 sec - exiting 23:40:12 (3612): No heartbeat from core client for 30 sec - exiting 23:40:13 (3612): No heartbeat from core client for 30 sec - exiting 23:40:14 (3612): No heartbeat from core client for 30 sec - exiting 23:40:15 (3612): No heartbeat from core client for 30 sec - exiting 23:40:16 (3612): No heartbeat from core client for 30 sec - exiting 23:40:17 (3612): No heartbeat from core client for 30 sec - exiting 23:40:18 (3612): No heartbeat from core client for 30 sec - exiting 23:40:19 (3612): No heartbeat from core client for 30 sec - exiting 23:40:20 (3612): No heartbeat from core client for 30 sec - exiting 23:40:21 (3612): No heartbeat from core client for 30 sec - exiting 23:40:22 (3612): No heartbeat from core client for 30 sec - exiting 23:40:24 (3612): No heartbeat from core client for 30 sec - exiting 23:40:25 (3612): No heartbeat from core client for 30 sec - exiting 23:40:26 (3612): No heartbeat from core client for 30 sec - exiting 23:40:27 (3612): No heartbeat from core client for 30 sec - exiting 23:40:28 (3612): No heartbeat from core client for 30 sec - exiting 23:40:29 (3612): No heartbeat from core client for 30 sec - exiting 23:40:30 (3612): No heartbeat from core client for 30 sec - exiting 23:40:31 (3612): No heartbeat from core client for 30 sec - exiting 23:40:32 (3612): No heartbeat from core client for 30 sec - exiting 23:40:33 (3612): No heartbeat from core client for 30 sec - exiting 23:40:34 (3612): No heartbeat from core client for 30 sec - exiting 23:40:35 (3612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:56:51 (4292): No heartbeat from core client for 30 sec - exiting 20:56:52 (4292): No heartbeat from core client for 30 sec - exiting 20:56:53 (4292): No heartbeat from core client for 30 sec - exiting 20:56:54 (4292): No heartbeat from core client for 30 sec - exiting 20:56:55 (4292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:41:16 (3780): No heartbeat from core client for 30 sec - exiting 18:41:17 (3780): No heartbeat from core client for 30 sec - exiting 18:41:18 (3780): No heartbeat from core client for 30 sec - exiting 18:41:19 (3780): No heartbeat from core client for 30 sec - exiting 18:41:20 (3780): No heartbeat from core client for 30 sec - exiting 18:41:21 (3780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:42:14 (3988): No heartbeat from core client for 30 sec - exiting 10:42:15 (3988): No heartbeat from core client for 30 sec - exiting 10:42:16 (3988): No heartbeat from core client for 30 sec - exiting 10:42:17 (3988): No heartbeat from core client for 30 sec - exiting 10:42:18 (3988): No heartbeat from core client for 30 sec - exiting 10:42:19 (3988): No heartbeat from core client for 30 sec - exiting 10:42:50 (3988): No heartbeat from core client for 30 sec - exiting 10:42:51 (3988): No heartbeat from core client for 30 sec - exiting 10:42:52 (3988): No heartbeat from core client for 30 sec - exiting 10:42:53 (3988): No heartbeat from core client for 30 sec - exiting 10:42:54 (3988): No heartbeat from core client for 30 sec - exiting 10:42:55 (3988): No heartbeat from core client for 30 sec - exiting 10:42:56 (3988): No heartbeat from core client for 30 sec - exiting 10:42:57 (3988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1736, selfPID=1736, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=740, selfPID=740, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3728, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4316, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... 21:49:26 (2740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4540, selfPID=4540, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4540, selfPID=5588, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_saf_24he_1961_1_007037898_2_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_24he_1961_1_007037898_2_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Jan 2012 21:15:26	1181701	13663864	hadam3p_saf_24he_1961_1_007037898_2	115,296	217,003	1.8821
19 Dec 2011 20:29:21	1181701	13663864	hadam3p_saf_24he_1961_1_007037898_2	103,776	194,526	1.8745
13 Dec 2011 20:14:05	1181701	13663864	hadam3p_saf_24he_1961_1_007037898_2	92,256	171,820	1.8624
05 Dec 2011 16:28:29	1181701	13663864	hadam3p_saf_24he_1961_1_007037898_2	80,749	150,483	1.8636
05 Dec 2011 11:51:45	1181701	13663864	hadam3p_saf_24he_1961_1_007037898_2	80,736	150,154	1.8598
04 Dec 2011 20:22:16	1181701	13663864	hadam3p_saf_24he_1961_1_007037898_2	69,216	128,628	1.8584
03 Dec 2011 15:22:56	1181701	13663864	hadam3p_saf_24he_1961_1_007037898_2	57,696	107,061	1.8556
01 Dec 2011 10:36:50	1181701	13663864	hadam3p_saf_24he_1961_1_007037898_2	46,176	85,750	1.8570
28 Nov 2011 14:02:02	1181701	13663864	hadam3p_saf_24he_1961_1_007037898_2	34,656	64,695	1.8668
28 Nov 2011 05:54:44	1181701	13663864	hadam3p_saf_24he_1961_1_007037898_2	23,136	43,817	1.8939
27 Nov 2011 16:12:40	1181701	13663864	hadam3p_saf_24he_1961_1_007037898_2	11,616	22,427	1.9307