Task 12236515

Name	hadam3p_pnw_zb0s_1987_1_006954404_0
Workunit	7157720
Created	23 Nov 2010, 9:02:38 UTC
Sent	19 Mar 2011, 6:29:20 UTC
Report deadline	29 Feb 2012, 11:49:20 UTC
Received	28 Mar 2011, 3:07:33 UTC
Server state	Over
Outcome	Didn't need
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1088462
Run time	3 days 0 hours 17 min 34 sec
CPU time	2 days 20 hours 25 min 55 sec
Validate state	Invalid
Credit	1,754.30
Device peak FLOPS	3.12 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.08 windows_intelx86
Stderr	<core_client_version>6.12.15</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:01:58 (3344): No heartbeat from core client for 30 sec - exiting 06:02:00 (3344): No heartbeat from core client for 30 sec - exiting 06:02:01 (3344): No heartbeat from core client for 30 sec - exiting 06:02:02 (3344): No heartbeat from core client for 30 sec - exiting 06:02:03 (3344): No heartbeat from core client for 30 sec - exiting 06:02:04 (3344): No heartbeat from core client for 30 sec - exiting 06:02:05 (3344): No heartbeat from core client for 30 sec - exiting 06:02:06 (3344): No heartbeat from core client for 30 sec - exiting 06:02:07 (3344): No heartbeat from core client for 30 sec - exiting 06:02:08 (3344): No heartbeat from core client for 30 sec - exiting 06:02:09 (3344): No heartbeat from core client for 30 sec - exiting 06:02:10 (3344): No heartbeat from core client for 30 sec - exiting 06:02:12 (3344): No heartbeat from core client for 30 sec - exiting 06:02:13 (3344): No heartbeat from core client for 30 sec - exiting 06:02:14 (3344): No heartbeat from core client for 30 sec - exiting 06:02:15 (3344): No heartbeat from core client for 30 sec - exiting 06:02:16 (3344): No heartbeat from core client for 30 sec - exiting 06:02:17 (3344): No heartbeat from core client for 30 sec - exiting 06:02:18 (3344): No heartbeat from core client for 30 sec - exiting 06:02:19 (3344): No heartbeat from core client for 30 sec - exiting 06:02:20 (3344): No heartbeat from core client for 30 sec - exiting 06:02:21 (3344): No heartbeat from core client for 30 sec - exiting 06:02:22 (3344): No heartbeat from core client for 30 sec - exiting 06:02:24 (3344): No heartbeat from core client for 30 sec - exiting 06:02:25 (3344): No heartbeat from core client for 30 sec - exiting 06:02:26 (3344): No heartbeat from core client for 30 sec - exiting 06:02:27 (3344): No heartbeat from core client for 30 sec - exiting 06:02:28 (3344): No heartbeat from core client for 30 sec - exiting 06:02:29 (3344): No heartbeat from core client for 30 sec - exiting 06:02:30 (3344): No heartbeat from core client for 30 sec - exiting 06:02:31 (3344): No heartbeat from core client for 30 sec - exiting 06:02:32 (3344): No heartbeat from core client for 30 sec - exiting 06:02:33 (3344): No heartbeat from core client for 30 sec - exiting 06:02:35 (3344): No heartbeat from core client for 30 sec - exiting 06:02:36 (3344): No heartbeat from core client for 30 sec - exiting 06:02:37 (3344): No heartbeat from core client for 30 sec - exiting 06:02:38 (3344): No heartbeat from core client for 30 sec - exiting 06:02:39 (3344): No heartbeat from core client for 30 sec - exiting 06:02:40 (3344): No heartbeat from core client for 30 sec - exiting 06:02:41 (3344): No heartbeat from core client for 30 sec - exiting 06:02:42 (3344): No heartbeat from core client for 30 sec - exiting 06:02:43 (3344): No heartbeat from core client for 30 sec - exiting 06:02:44 (3344): No heartbeat from core client for 30 sec - exiting 06:02:45 (3344): No heartbeat from core client for 30 sec - exiting 06:02:47 (3344): No heartbeat from core client for 30 sec - exiting 06:02:48 (3344): No heartbeat from core client for 30 sec - exiting 06:02:49 (3344): No heartbeat from core client for 30 sec - exiting 06:02:50 (3344): No heartbeat from core client for 30 sec - exiting 06:02:51 (3344): No heartbeat from core client for 30 sec - exiting 06:02:52 (3344): No heartbeat from core client for 30 sec - exiting 06:02:53 (3344): No heartbeat from core client for 30 sec - exiting 06:02:54 (3344): No heartbeat from core client for 30 sec - exiting 06:02:55 (3344): No heartbeat from core client for 30 sec - exiting 06:02:56 (3344): No heartbeat from core client for 30 sec - exiting 06:02:57 (3344): No heartbeat from core client for 30 sec - exiting 06:02:59 (3344): No heartbeat from core client for 30 sec - exiting 06:03:00 (3344): No heartbeat from core client for 30 sec - exiting 06:03:01 (3344): No heartbeat from core client for 30 sec - exiting 06:03:02 (3344): No heartbeat from core client for 30 sec - exiting 06:03:03 (3344): No heartbeat from core client for 30 sec - exiting 06:03:04 (3344): No heartbeat from core client for 30 sec - exiting 06:03:05 (3344): No heartbeat from core client for 30 sec - exiting 06:03:06 (3344): No heartbeat from core client for 30 sec - exiting 06:03:07 (3344): No heartbeat from core client for 30 sec - exiting 06:03:08 (3344): No heartbeat from core client for 30 sec - exiting 06:03:10 (3344): No heartbeat from core client for 30 sec - exiting 06:03:11 (3344): No heartbeat from core client for 30 sec - exiting 06:03:12 (3344): No heartbeat from core client for 30 sec - exiting 06:03:13 (3344): No heartbeat from core client for 30 sec - exiting 06:03:14 (3344): No heartbeat from core client for 30 sec - exiting 06:03:15 (3344): No heartbeat from core client for 30 sec - exiting 06:03:16 (3344): No heartbeat from core client for 30 sec - exiting 06:03:17 (3344): No heartbeat from core client for 30 sec - exiting 06:03:18 (3344): No heartbeat from core client for 30 sec - exiting 06:03:19 (3344): No heartbeat from core client for 30 sec - exiting 06:03:20 (3344): No heartbeat from core client for 30 sec - exiting 06:03:22 (3344): No heartbeat from core client for 30 sec - exiting 06:03:23 (3344): No heartbeat from core client for 30 sec - exiting 06:03:24 (3344): No heartbeat from core client for 30 sec - exiting 06:03:25 (3344): No heartbeat from core client for 30 sec - exiting 06:03:26 (3344): No heartbeat from core client for 30 sec - exiting 06:03:27 (3344): No heartbeat from core client for 30 sec - exiting 06:03:28 (3344): No heartbeat from core client for 30 sec - exiting 06:03:29 (3344): No heartbeat from core client for 30 sec - exiting 06:03:30 (3344): No heartbeat from core client for 30 sec - exiting 06:03:31 (3344): No heartbeat from core client for 30 sec - exiting 06:03:32 (3344): No heartbeat from core client for 30 sec - exiting 06:03:34 (3344): No heartbeat from core client for 30 sec - exiting 06:03:35 (3344): No heartbeat from core client for 30 sec - exiting 06:03:36 (3344): No heartbeat from core client for 30 sec - exiting 06:03:37 (3344): No heartbeat from core client for 30 sec - exiting 06:03:38 (3344): No heartbeat from core client for 30 sec - exiting 06:03:39 (3344): No heartbeat from core client for 30 sec - exiting 06:03:40 (3344): No heartbeat from core client for 30 sec - exiting 06:03:41 (3344): No heartbeat from core client for 30 sec - exiting 06:03:42 (3344): No heartbeat from core client for 30 sec - exiting 06:03:43 (3344): No heartbeat from core client for 30 sec - exiting 06:03:45 (3344): No heartbeat from core client for 30 sec - exiting 06:03:46 (3344): No heartbeat from core client for 30 sec - exiting 06:03:47 (3344): No heartbeat from core client for 30 sec - exiting 06:03:48 (3344): No heartbeat from core client for 30 sec - exiting 06:03:49 (3344): No heartbeat from core client for 30 sec - exiting 06:03:50 (3344): No heartbeat from core client for 30 sec - exiting 06:03:51 (3344): No heartbeat from core client for 30 sec - exiting 06:03:52 (3344): No heartbeat from core client for 30 sec - exiting 06:03:53 (3344): No heartbeat from core client for 30 sec - exiting 06:03:54 (3344): No heartbeat from core client for 30 sec - exiting 06:03:55 (3344): No heartbeat from core client for 30 sec - exiting 06:03:57 (3344): No heartbeat from core client for 30 sec - exiting 06:03:58 (3344): No heartbeat from core client for 30 sec - exiting 06:03:59 (3344): No heartbeat from core client for 30 sec - exiting 06:04:00 (3344): No heartbeat from core client for 30 sec - exiting 06:04:01 (3344): No heartbeat from core client for 30 sec - exiting 06:04:02 (3344): No heartbeat from core client for 30 sec - exiting 06:04:03 (3344): No heartbeat from core client for 30 sec - exiting 06:04:04 (3344): No heartbeat from core client for 30 sec - exiting 06:04:05 (3344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2424, selfPID=2424, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:36:05 (988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:01:50 (4920): No heartbeat from core client for 30 sec - exiting 06:01:51 (4920): No heartbeat from core client for 30 sec - exiting 06:01:53 (4920): No heartbeat from core client for 30 sec - exiting 06:01:54 (4920): No heartbeat from core client for 30 sec - exiting 06:01:55 (4920): No heartbeat from core client for 30 sec - exiting 06:01:56 (4920): No heartbeat from core client for 30 sec - exiting 06:01:57 (4920): No heartbeat from core client for 30 sec - exiting 06:01:58 (4920): No heartbeat from core client for 30 sec - exiting 06:01:59 (4920): No heartbeat from core client for 30 sec - exiting 06:02:00 (4920): No heartbeat from core client for 30 sec - exiting 06:02:01 (4920): No heartbeat from core client for 30 sec - exiting 06:02:02 (4920): No heartbeat from core client for 30 sec - exiting 06:02:03 (4920): No heartbeat from core client for 30 sec - exiting 06:02:05 (4920): No heartbeat from core client for 30 sec - exiting 06:02:06 (4920): No heartbeat from core client for 30 sec - exiting 06:02:07 (4920): No heartbeat from core client for 30 sec - exiting 06:02:08 (4920): No heartbeat from core client for 30 sec - exiting 06:02:09 (4920): No heartbeat from core client for 30 sec - exiting 06:02:10 (4920): No heartbeat from core client for 30 sec - exiting 06:02:11 (4920): No heartbeat from core client for 30 sec - exiting 06:02:12 (4920): No heartbeat from core client for 30 sec - exiting 06:02:13 (4920): No heartbeat from core client for 30 sec - exiting 06:02:14 (4920): No heartbeat from core client for 30 sec - exiting 06:02:16 (4920): No heartbeat from core client for 30 sec - exiting 06:02:17 (4920): No heartbeat from core client for 30 sec - exiting 06:02:18 (4920): No heartbeat from core client for 30 sec - exiting 06:02:19 (4920): No heartbeat from core client for 30 sec - exiting 06:02:20 (4920): No heartbeat from core client for 30 sec - exiting 06:02:21 (4920): No heartbeat from core client for 30 sec - exiting 06:02:22 (4920): No heartbeat from core client for 30 sec - exiting 06:02:23 (4920): No heartbeat from core client for 30 sec - exiting 06:02:24 (4920): No heartbeat from core client for 30 sec - exiting 06:02:25 (4920): No heartbeat from core client for 30 sec - exiting 06:02:26 (4920): No heartbeat from core client for 30 sec - exiting 06:02:28 (4920): No heartbeat from core client for 30 sec - exiting 06:02:29 (4920): No heartbeat from core client for 30 sec - exiting 06:02:30 (4920): No heartbeat from core client for 30 sec - exiting 06:02:31 (4920): No heartbeat from core client for 30 sec - exiting 06:02:32 (4920): No heartbeat from core client for 30 sec - exiting 06:02:33 (4920): No heartbeat from core client for 30 sec - exiting 06:02:34 (4920): No heartbeat from core client for 30 sec - exiting 06:02:35 (4920): No heartbeat from core client for 30 sec - exiting 06:02:36 (4920): No heartbeat from core client for 30 sec - exiting 06:02:37 (4920): No heartbeat from core client for 30 sec - exiting 06:02:38 (4920): No heartbeat from core client for 30 sec - exiting 06:02:40 (4920): No heartbeat from core client for 30 sec - exiting 06:02:41 (4920): No heartbeat from core client for 30 sec - exiting 06:02:42 (4920): No heartbeat from core client for 30 sec - exiting 06:02:43 (4920): No heartbeat from core client for 30 sec - exiting 06:02:44 (4920): No heartbeat from core client for 30 sec - exiting 06:02:45 (4920): No heartbeat from core client for 30 sec - exiting 06:02:46 (4920): No heartbeat from core client for 30 sec - exiting 06:02:47 (4920): No heartbeat from core client for 30 sec - exiting 06:02:48 (4920): No heartbeat from core client for 30 sec - exiting 06:02:49 (4920): No heartbeat from core client for 30 sec - exiting 06:02:51 (4920): No heartbeat from core client for 30 sec - exiting 06:02:52 (4920): No heartbeat from core client for 30 sec - exiting 06:02:53 (4920): No heartbeat from core client for 30 sec - exiting 06:02:54 (4920): No heartbeat from core client for 30 sec - exiting 06:02:55 (4920): No heartbeat from core client for 30 sec - exiting 06:02:56 (4920): No heartbeat from core client for 30 sec - exiting 06:02:57 (4920): No heartbeat from core client for 30 sec - exiting 06:02:58 (4920): No heartbeat from core client for 30 sec - exiting 06:02:59 (4920): No heartbeat from core client for 30 sec - exiting 06:03:00 (4920): No heartbeat from core client for 30 sec - exiting 06:03:01 (4920): No heartbeat from core client for 30 sec - exiting 06:03:03 (4920): No heartbeat from core client for 30 sec - exiting 06:03:04 (4920): No heartbeat from core client for 30 sec - exiting 06:03:05 (4920): No heartbeat from core client for 30 sec - exiting 06:03:06 (4920): No heartbeat from core client for 30 sec - exiting 06:03:07 (4920): No heartbeat from core client for 30 sec - exiting 06:03:08 (4920): No heartbeat from core client for 30 sec - exiting 06:03:09 (4920): No heartbeat from core client for 30 sec - exiting 06:03:10 (4920): No heartbeat from core client for 30 sec - exiting 06:03:11 (4920): No heartbeat from core client for 30 sec - exiting 06:03:12 (4920): No heartbeat from core client for 30 sec - exiting 06:03:13 (4920): No heartbeat from core client for 30 sec - exiting 06:03:15 (4920): No heartbeat from core client for 30 sec - exiting 06:03:16 (4920): No heartbeat from core client for 30 sec - exiting 06:03:17 (4920): No heartbeat from core client for 30 sec - exiting 06:03:18 (4920): No heartbeat from core client for 30 sec - exiting 06:03:19 (4920): No heartbeat from core client for 30 sec - exiting 06:03:20 (4920): No heartbeat from core client for 30 sec - exiting 06:03:21 (4920): No heartbeat from core client for 30 sec - exiting 06:03:22 (4920): No heartbeat from core client for 30 sec - exiting 06:03:23 (4920): No heartbeat from core client for 30 sec - exiting 06:03:24 (4920): No heartbeat from core client for 30 sec - exiting 06:03:26 (4920): No heartbeat from core client for 30 sec - exiting 06:03:27 (4920): No heartbeat from core client for 30 sec - exiting 06:03:28 (4920): No heartbeat from core client for 30 sec - exiting 06:03:29 (4920): No heartbeat from core client for 30 sec - exiting 06:03:30 (4920): No heartbeat from core client for 30 sec - exiting 06:03:31 (4920): No heartbeat from core client for 30 sec - exiting 06:03:32 (4920): No heartbeat from core client for 30 sec - exiting 06:03:33 (4920): No heartbeat from core client for 30 sec - exiting 06:03:34 (4920): No heartbeat from core client for 30 sec - exiting 06:03:35 (4920): No heartbeat from core client for 30 sec - exiting 06:03:36 (4920): No heartbeat from core client for 30 sec - exiting 06:03:38 (4920): No heartbeat from core client for 30 sec - exiting 06:03:39 (4920): No heartbeat from core client for 30 sec - exiting 06:03:40 (4920): No heartbeat from core client for 30 sec - exiting 06:03:41 (4920): No heartbeat from core client for 30 sec - exiting 06:03:42 (4920): No heartbeat from core client for 30 sec - exiting 06:03:43 (4920): No heartbeat from core client for 30 sec - exiting 06:03:44 (4920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1332, selfPID=1332, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:35:05 (4460): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:02:14 (4548): No heartbeat from core client for 30 sec - exiting 06:02:15 (4548): No heartbeat from core client for 30 sec - exiting 06:02:16 (4548): No heartbeat from core client for 30 sec - exiting 06:02:17 (4548): No heartbeat from core client for 30 sec - exiting 06:02:18 (4548): No heartbeat from core client for 30 sec - exiting 06:02:19 (4548): No heartbeat from core client for 30 sec - exiting 06:02:21 (4548): No heartbeat from core client for 30 sec - exiting 06:02:22 (4548): No heartbeat from core client for 30 sec - exiting 06:02:23 (4548): No heartbeat from core client for 30 sec - exiting 06:02:24 (4548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5032, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4468, iMonCtr=2 06:02:03 (188): No heartbeat from core client for 30 sec - exiting 06:02:04 (188): No heartbeat from core client for 30 sec - exiting 06:02:05 (188): No heartbeat from core client for 30 sec - exiting 06:02:06 (188): No heartbeat from core client for 30 sec - exiting 06:02:07 (188): No heartbeat from core client for 30 sec - exiting 06:02:08 (188): No heartbeat from core client for 30 sec - exiting 06:02:09 (188): No heartbeat from core client for 30 sec - exiting 06:02:11 (188): No heartbeat from core client for 30 sec - exiting 06:02:12 (188): No heartbeat from core client for 30 sec - exiting 06:02:13 (188): No heartbeat from core client for 30 sec - exiting 06:02:14 (188): No heartbeat from core client for 30 sec - exiting 06:02:15 (188): No heartbeat from core client for 30 sec - exiting 06:02:16 (188): No heartbeat from core client for 30 sec - exiting 06:02:17 (188): No heartbeat from core client for 30 sec - exiting 06:02:18 (188): No heartbeat from core client for 30 sec - exiting 06:02:19 (188): No heartbeat from core client for 30 sec - exiting 06:02:20 (188): No heartbeat from core client for 30 sec - exiting 06:02:22 (188): No heartbeat from core client for 30 sec - exiting 06:02:23 (188): No heartbeat from core client for 30 sec - exiting 06:02:24 (188): No heartbeat from core client for 30 sec - exiting 06:02:25 (188): No heartbeat from core client for 30 sec - exiting 06:02:26 (188): No heartbeat from core client for 30 sec - exiting 06:02:27 (188): No heartbeat from core client for 30 sec - exiting 06:02:28 (188): No heartbeat from core client for 30 sec - exiting 06:02:29 (188): No heartbeat from core client for 30 sec - exiting 06:02:30 (188): No heartbeat from core client for 30 sec - exiting 06:02:31 (188): No heartbeat from core client for 30 sec - exiting 06:02:32 (188): No heartbeat from core client for 30 sec - exiting 06:02:34 (188): No heartbeat from core client for 30 sec - exiting 06:02:35 (188): No heartbeat from core client for 30 sec - exiting 06:02:36 (188): No heartbeat from core client for 30 sec - exiting 06:02:37 (188): No heartbeat from core client for 30 sec - exiting 06:02:38 (188): No heartbeat from core client for 30 sec - exiting 06:02:39 (188): No heartbeat from core client for 30 sec - exiting 06:02:40 (188): No heartbeat from core client for 30 sec - exiting 06:02:41 (188): No heartbeat from core client for 30 sec - exiting 06:02:42 (188): No heartbeat from core client for 30 sec - exiting 06:02:43 (188): No heartbeat from core client for 30 sec - exiting 06:02:44 (188): No heartbeat from core client for 30 sec - exiting 06:02:46 (188): No heartbeat from core client for 30 sec - exiting 06:02:47 (188): No heartbeat from core client for 30 sec - exiting 06:02:48 (188): No heartbeat from core client for 30 sec - exiting 06:02:49 (188): No heartbeat from core client for 30 sec - exiting 06:02:50 (188): No heartbeat from core client for 30 sec - exiting 06:02:51 (188): No heartbeat from core client for 30 sec - exiting 06:02:52 (188): No heartbeat from core client for 30 sec - exiting 06:02:53 (188): No heartbeat from core client for 30 sec - exiting 06:02:54 (188): No heartbeat from core client for 30 sec - exiting 06:02:55 (188): No heartbeat from core client for 30 sec - exiting 06:02:57 (188): No heartbeat from core client for 30 sec - exiting 06:02:58 (188): No heartbeat from core client for 30 sec - exiting 06:02:59 (188): No heartbeat from core client for 30 sec - exiting 06:03:00 (188): No heartbeat from core client for 30 sec - exiting 06:03:01 (188): No heartbeat from core client for 30 sec - exiting 06:03:02 (188): No heartbeat from core client for 30 sec - exiting 06:03:03 (188): No heartbeat from core client for 30 sec - exiting 06:03:04 (188): No heartbeat from core client for 30 sec - exiting 06:03:05 (188): No heartbeat from core client for 30 sec - exiting 06:03:06 (188): No heartbeat from core client for 30 sec - exiting 06:03:07 (188): No heartbeat from core client for 30 sec - exiting 06:03:09 (188): No heartbeat from core client for 30 sec - exiting 06:03:10 (188): No heartbeat from core client for 30 sec - exiting 06:03:11 (188): No heartbeat from core client for 30 sec - exiting 06:03:12 (188): No heartbeat from core client for 30 sec - exiting 06:03:13 (188): No heartbeat from core client for 30 sec - exiting 06:03:14 (188): No heartbeat from core client for 30 sec - exiting 06:03:15 (188): No heartbeat from core client for 30 sec - exiting 06:03:16 (188): No heartbeat from core client for 30 sec - exiting 06:03:17 (188): No heartbeat from core client for 30 sec - exiting 06:03:18 (188): No heartbeat from core client for 30 sec - exiting 06:03:19 (188): No heartbeat from core client for 30 sec - exiting 06:03:21 (188): No heartbeat from core client for 30 sec - exiting 06:03:22 (188): No heartbeat from core client for 30 sec - exiting 06:03:23 (188): No heartbeat from core client for 30 sec - exiting 06:03:24 (188): No heartbeat from core client for 30 sec - exiting 06:03:25 (188): No heartbeat from core client for 30 sec - exiting 06:03:26 (188): No heartbeat from core client for 30 sec - exiting 06:03:27 (188): No heartbeat from core client for 30 sec - exiting 06:03:28 (188): No heartbeat from core client for 30 sec - exiting 06:03:29 (188): No heartbeat from core client for 30 sec - exiting 06:03:30 (188): No heartbeat from core client for 30 sec - exiting 06:03:32 (188): No heartbeat from core client for 30 sec - exiting 06:03:33 (188): No heartbeat from core client for 30 sec - exiting 06:03:34 (188): No heartbeat from core client for 30 sec - exiting 06:03:35 (188): No heartbeat from core client for 30 sec - exiting 06:03:36 (188): No heartbeat from core client for 30 sec - exiting 06:03:37 (188): No heartbeat from core client for 30 sec - exiting 06:03:38 (188): No heartbeat from core client for 30 sec - exiting 06:03:39 (188): No heartbeat from core client for 30 sec - exiting 06:03:40 (188): No heartbeat from core client for 30 sec - exiting 06:03:41 (188): No heartbeat from core client for 30 sec - exiting 06:03:42 (188): No heartbeat from core client for 30 sec - exiting 06:03:44 (188): No heartbeat from core client for 30 sec - exiting 06:03:45 (188): No heartbeat from core client for 30 sec - exiting 06:03:46 (188): No heartbeat from core client for 30 sec - exiting 06:03:47 (188): No heartbeat from core client for 30 sec - exiting 06:03:48 (188): No heartbeat from core client for 30 sec - exiting 06:03:49 (188): No heartbeat from core client for 30 sec - exiting 06:03:50 (188): No heartbeat from core client for 30 sec - exiting 06:03:51 (188): No heartbeat from core client for 30 sec - exiting 06:03:52 (188): No heartbeat from core client for 30 sec - exiting 06:03:53 (188): No heartbeat from core client for 30 sec - exiting 06:03:54 (188): No heartbeat from core client for 30 sec - exiting 06:03:56 (188): No heartbeat from core client for 30 sec - exiting 06:03:57 (188): No heartbeat from core client for 30 sec - exiting 06:03:58 (188): No heartbeat from core client for 30 sec - exiting 06:03:59 (188): No heartbeat from core client for 30 sec - exiting 06:04:00 (188): No heartbeat from core client for 30 sec - exiting 06:04:01 (188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2096, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4748, iMonCtr=2 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 7 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:23:20 (5092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4252, selfPID=3240, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 7 22:26:52 (3240): called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_pnw_zb0s_1987_1_006954404_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zb0s_1987_1_006954404_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zb0s_1987_1_006954404_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zb0s_1987_1_006954404_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zb0s_1987_1_006954404_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Mar 2011 18:35:34	1088462	12236515	hadam3p_pnw_zb0s_1987_1_006954404_0	80,736	217,272	2.6911
26 Mar 2011 06:50:44	1088462	12236515	hadam3p_pnw_zb0s_1987_1_006954404_0	69,216	186,349	2.6923
25 Mar 2011 10:30:46	1088462	12236515	hadam3p_pnw_zb0s_1987_1_006954404_0	57,696	155,167	2.6894
24 Mar 2011 10:54:30	1088462	12236515	hadam3p_pnw_zb0s_1987_1_006954404_0	46,176	123,660	2.6780
23 Mar 2011 13:17:59	1088462	12236515	hadam3p_pnw_zb0s_1987_1_006954404_0	34,656	92,912	2.6810
22 Mar 2011 11:07:35	1088462	12236515	hadam3p_pnw_zb0s_1987_1_006954404_0	23,136	62,782	2.7136
21 Mar 2011 05:26:27	1088462	12236515	hadam3p_pnw_zb0s_1987_1_006954404_0	11,616	32,206	2.7726