Task 12614853

Name	hadam3p_pnw_2wgv_1979_1_007175575_0
Workunit	7373857
Created	22 Feb 2011, 11:23:14 UTC
Sent	10 Mar 2011, 19:22:12 UTC
Report deadline	21 Feb 2012, 0:42:12 UTC
Received	22 Apr 2011, 11:04:23 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1128512
Run time	1 days 10 hours 31 min 47 sec
CPU time	1 days 7 hours 38 min 59 sec
Validate state	Invalid
Credit	1,003.35
Device peak FLOPS	3.44 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.08 windows_intelx86
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3968, selfPID=3968, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2264, selfPID=2264, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4916, selfPID=4916, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:00:52 (3712): No heartbeat from core client for 30 sec - exiting 18:00:53 (3712): No heartbeat from core client for 30 sec - exiting 18:00:55 (3712): No heartbeat from core client for 30 sec - exiting 18:00:56 (3712): No heartbeat from core client for 30 sec - exiting 18:00:57 (3712): No heartbeat from core client for 30 sec - exiting 18:00:58 (3712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4552, selfPID=4552, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2764, selfPID=2764, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2876, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4988, selfPID=4988, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3948, selfPID=3948, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3500, selfPID=3500, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:55:32 (3392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4524, selfPID=4524, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4616, selfPID=4616, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3824, selfPID=3824, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:13:43 (3528): No heartbeat from core client for 30 sec - exiting 08:13:44 (3528): No heartbeat from core client for 30 sec - exiting 08:13:45 (3528): No heartbeat from core client for 30 sec - exiting 08:13:46 (3528): No heartbeat from core client for 30 sec - exiting 08:13:47 (3528): No heartbeat from core client for 30 sec - exiting 08:13:48 (3528): No heartbeat from core client for 30 sec - exiting 08:13:50 (3528): No heartbeat from core client for 30 sec - exiting 08:13:51 (3528): No heartbeat from core client for 30 sec - exiting 08:14:14 (1524): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4828, selfPID=4828, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5044, selfPID=5044, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:42:15 (3584): No heartbeat from core client for 30 sec - exiting 16:42:16 (3584): No heartbeat from core client for 30 sec - exiting 16:42:17 (3584): No heartbeat from core client for 30 sec - exiting 16:42:18 (3584): No heartbeat from core client for 30 sec - exiting 16:42:20 (3584): No heartbeat from core client for 30 sec - exiting 16:42:21 (3584): No heartbeat from core client for 30 sec - exiting 16:42:22 (3584): No heartbeat from core client for 30 sec - exiting 16:42:23 (3584): No heartbeat from core client for 30 sec - exiting 16:42:24 (3584): No heartbeat from core client for 30 sec - exiting 16:42:25 (3584): No heartbeat from core client for 30 sec - exiting 16:42:26 (3584): No heartbeat from core client for 30 sec - exiting 16:42:27 (3584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5028, selfPID=5028, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1660, selfPID=1660, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3708, selfPID=3708, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4564, selfPID=4564, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5024, selfPID=5024, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2648, selfPID=2648, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:01:20 (3692): No heartbeat from core client for 30 sec - exiting 12:01:21 (3692): No heartbeat from core client for 30 sec - exiting 12:01:22 (3692): No heartbeat from core client for 30 sec - exiting 12:01:23 (3692): No heartbeat from core client for 30 sec - exiting 12:01:24 (3692): No heartbeat from core client for 30 sec - exiting 12:01:25 (3692): No heartbeat from core client for 30 sec - exiting 12:01:26 (3692): No heartbeat from core client for 30 sec - exiting 12:01:27 (3692): No heartbeat from core client for 30 sec - exiting 12:01:28 (3692): No heartbeat from core client for 30 sec - exiting 12:01:29 (3692): No heartbeat from core client for 30 sec - exiting 12:01:30 (3692): No heartbeat from core client for 30 sec - exiting 12:01:31 (3692): No heartbeat from core client for 30 sec - exiting 12:01:32 (3692): No heartbeat from core client for 30 sec - exiting 12:01:33 (3692): No heartbeat from core client for 30 sec - exiting 12:01:34 (3692): No heartbeat from core client for 30 sec - exiting 12:01:35 (3692): No heartbeat from core client for 30 sec - exiting 12:01:36 (3692): No heartbeat from core client for 30 sec - exiting 12:01:37 (3692): No heartbeat from core client for 30 sec - exiting 12:01:38 (3692): No heartbeat from core client for 30 sec - exiting 12:01:39 (3692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=396, selfPID=396, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3172, selfPID=3172, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5116, selfPID=5116, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5092, selfPID=5092, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4892, selfPID=4892, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:01:38 (3160): No heartbeat from core client for 30 sec - exiting 18:01:39 (3160): No heartbeat from core client for 30 sec - exiting 18:01:40 (3160): No heartbeat from core client for 30 sec - exiting 18:01:41 (3160): No heartbeat from core client for 30 sec - exiting 18:01:42 (3160): No heartbeat from core client for 30 sec - exiting 18:01:43 (3160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4628, selfPID=4628, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4672, selfPID=4672, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4520, selfPID=4520, iMonCtr=2 11:25:12 (3660): No heartbeat from core client for 30 sec - exiting 11:25:13 (3660): No heartbeat from core client for 30 sec - exiting 11:25:15 (3660): No heartbeat from core client for 30 sec - exiting 11:25:16 (3660): No heartbeat from core client for 30 sec - exiting 11:25:17 (3660): No heartbeat from core client for 30 sec - exiting 11:25:18 (3660): No heartbeat from core client for 30 sec - exiting 11:25:19 (3660): No heartbeat from core client for 30 sec - exiting 11:25:20 (3660): No heartbeat from core client for 30 sec - exiting 11:25:21 (3660): No heartbeat from core client for 30 sec - exiting 11:25:22 (3660): No heartbeat from core client for 30 sec - exiting 11:25:23 (3660): No heartbeat from core client for 30 sec - exiting 11:25:24 (3660): No heartbeat from core client for 30 sec - exiting 11:25:25 (3660): No heartbeat from core client for 30 sec - exiting 11:25:27 (3660): No heartbeat from core client for 30 sec - exiting 11:25:28 (3660): No heartbeat from core client for 30 sec - exiting 11:25:29 (3660): No heartbeat from core client for 30 sec - exiting 11:25:30 (3660): No heartbeat from core client for 30 sec - exiting 11:25:31 (3660): No heartbeat from core client for 30 sec - exiting 11:25:32 (3660): No heartbeat from core client for 30 sec - exiting 11:25:33 (3660): No heartbeat from core client for 30 sec - exiting 11:25:34 (3660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1364, selfPID=1364, iMonCtr=2 16:05:53 (3604): No heartbeat from core client for 30 sec - exiting 16:05:54 (3604): No heartbeat from core client for 30 sec - exiting 16:05:55 (3604): No heartbeat from core client for 30 sec - exiting 16:05:56 (3604): No heartbeat from core client for 30 sec - exiting 16:05:57 (3604): No heartbeat from core client for 30 sec - exiting 16:05:58 (3604): No heartbeat from core client for 30 sec - exiting 16:05:59 (3604): No heartbeat from core client for 30 sec - exiting 16:06:00 (3604): No heartbeat from core client for 30 sec - exiting 16:06:01 (3604): No heartbeat from core client for 30 sec - exiting 16:06:02 (3604): No heartbeat from core client for 30 sec - exiting 16:06:03 (3604): No heartbeat from core client for 30 sec - exiting 16:06:04 (3604): No heartbeat from core client for 30 sec - exiting 16:06:05 (3604): No heartbeat from core client for 30 sec - exiting 16:06:06 (3604): No heartbeat from core client for 30 sec - exiting 16:06:07 (3604): No heartbeat from core client for 30 sec - exiting 16:06:08 (3604): No heartbeat from core client for 30 sec - exiting 16:06:09 (3604): No heartbeat from core client for 30 sec - exiting 16:06:10 (3604): No heartbeat from core client for 30 sec - exiting 16:06:11 (3604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5092, selfPID=5092, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4884, selfPID=4884, iMonCtr=2 18:11:58 (3876): No heartbeat from core client for 30 sec - exiting 18:11:59 (3876): No heartbeat from core client for 30 sec - exiting 18:12:01 (3876): No heartbeat from core client for 30 sec - exiting 18:12:02 (3876): No heartbeat from core client for 30 sec - exiting 18:12:03 (3876): No heartbeat from core client for 30 sec - exiting 18:12:04 (3876): No heartbeat from core client for 30 sec - exiting 18:12:05 (3876): No heartbeat from core client for 30 sec - exiting 18:12:06 (3876): No heartbeat from core client for 30 sec - exiting 18:12:07 (3876): No heartbeat from core client for 30 sec - exiting 18:12:08 (3876): No heartbeat from core client for 30 sec - exiting 18:12:09 (3876): No heartbeat from core client for 30 sec - exiting 18:12:10 (3876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:22:02 (3524): No heartbeat from core client for 30 sec - exiting 20:22:04 (3524): No heartbeat from core client for 30 sec - exiting 20:22:05 (3524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1724, selfPID=1724, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5020, selfPID=5020, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 17:34:21 (3704): No heartbeat from core client for 30 sec - exiting 17:34:22 (3704): No heartbeat from core client for 30 sec - exiting 17:34:23 (3704): No heartbeat from core client for 30 sec - exiting 17:34:24 (3704): No heartbeat from core client for 30 sec - exiting 17:34:25 (3704): No heartbeat from core client for 30 sec - exiting 17:34:26 (3704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3768, selfPID=3768, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1272, selfPID=1272, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3388, selfPID=3388, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2132, selfPID=2132, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3664, selfPID=3664, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3716, selfPID=3716, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4676, selfPID=4676, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4140, selfPID=4140, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4580, selfPID=4580, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 17:35:06 (3380): No heartbeat from core client for 30 sec - exiting 17:35:07 (3380): No heartbeat from core client for 30 sec - exiting 17:35:08 (3380): No heartbeat from core client for 30 sec - exiting 17:35:09 (3380): No heartbeat from core client for 30 sec - exiting 17:35:10 (3380): No heartbeat from core client for 30 sec - exiting 17:35:11 (3380): No heartbeat from core client for 30 sec - exiting 17:35:12 (3380): No heartbeat from core client for 30 sec - exiting 17:35:14 (3380): No heartbeat from core client for 30 sec - exiting 17:35:15 (3380): No heartbeat from core client for 30 sec - exiting 17:35:16 (3380): No heartbeat from core client for 30 sec - exiting 17:35:17 (3380): No heartbeat from core client for 30 sec - exiting 17:35:18 (3380): No heartbeat from core client for 30 sec - exiting 17:35:19 (3380): No heartbeat from core client for 30 sec - exiting 17:35:20 (3380): No heartbeat from core client for 30 sec - exiting 17:35:21 (3380): No heartbeat from core client for 30 sec - exiting 17:35:22 (3380): No heartbeat from core client for 30 sec - exiting 17:35:23 (3380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:54:16 (3260): No heartbeat from core client for 30 sec - exiting 19:54:17 (3260): No heartbeat from core client for 30 sec - exiting 19:54:18 (3260): No heartbeat from core client for 30 sec - exiting 19:54:20 (3260): No heartbeat from core client for 30 sec - exiting 19:54:21 (3260): No heartbeat from core client for 30 sec - exiting 19:54:22 (3260): No heartbeat from core client for 30 sec - exiting 19:54:23 (3260): No heartbeat from core client for 30 sec - exiting 19:54:24 (3260): No heartbeat from core client for 30 sec - exiting 19:54:25 (3260): No heartbeat from core client for 30 sec - exiting 19:54:26 (3260): No heartbeat from core client for 30 sec - exiting 19:54:27 (3260): No heartbeat from core client for 30 sec - exiting 19:54:28 (3260): No heartbeat from core client for 30 sec - exiting 19:54:29 (3260): No heartbeat from core client for 30 sec - exiting 19:54:30 (3260): No heartbeat from core client for 30 sec - exiting 19:54:32 (3260): No heartbeat from core client for 30 sec - exiting 19:54:33 (3260): No heartbeat from core client for 30 sec - exiting 19:54:34 (3260): No heartbeat from core client for 30 sec - exiting 19:54:35 (3260): No heartbeat from core client for 30 sec - exiting 19:54:36 (3260): No heartbeat from core client for 30 sec - exiting 19:54:37 (3260): No heartbeat from core client for 30 sec - exiting Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 19:54:38 (3260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:54:39 (3260): No heartbeat from core client for 30 sec - exiting Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1920, selfPID=3736, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 4 19:54:56 (3736): called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_pnw_2wgv_1979_1_007175575_0_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2wgv_1979_1_007175575_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2wgv_1979_1_007175575_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2wgv_1979_1_007175575_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2wgv_1979_1_007175575_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2wgv_1979_1_007175575_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2wgv_1979_1_007175575_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2wgv_1979_1_007175575_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Apr 2011 19:23:42	1128512	12614853	hadam3p_pnw_2wgv_1979_1_007175575_0	46,176	105,471	2.2841
20 Apr 2011 19:02:03	1128512	12614853	hadam3p_pnw_2wgv_1979_1_007175575_0	34,656	79,458	2.2928
20 Apr 2011 19:02:03	1128512	12614853	hadam3p_pnw_2wgv_1979_1_007175575_0	23,136	53,432	2.3095
11 Apr 2011 17:14:43	1128512	12614853	hadam3p_pnw_2wgv_1979_1_007175575_0	11,616	27,339	2.3536