Task 14082021

Name	hadam3p_pnw_zm92_1998_1_007720024_1
Workunit	7875132
Created	9 Feb 2012, 13:05:36 UTC
Sent	9 Feb 2012, 13:51:38 UTC
Report deadline	21 Jan 2013, 19:11:38 UTC
Received	5 Mar 2012, 14:34:35 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	961094
Run time	4 days 21 hours 38 min 37 sec
CPU time	3 days 13 hours 41 min 44 sec
Validate state	Invalid
Credit	1,754.32
Device peak FLOPS	2.10 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.0.18</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5868, selfPID=5868, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7652, selfPID=7652, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4728, selfPID=4728, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2720, selfPID=2720, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:40:22 (4740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:40:51 (4740): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6288, selfPID=6288, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2424, selfPID=2424, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6800, selfPID=6800, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting,CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No ProCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:40:00 (6024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:51:02 (4172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No PCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8132, selfPID=8132, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6276, selfPID=6276, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=664, selfPID=664, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6784, selfPID=6784, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6904, selfPID=6904, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6256, selfPID=4192, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6796, selfPID=4364, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7244, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6844, selfPID=6844, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6124, selfPID=6124, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1128, selfPID=1128, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5620, selfPID=5620, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4656, selfPID=5100, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2176, selfPID=3236, iMonCtr=1 Model crash detected, will try to restart... 17:07:03 (4776): No heartbeat from core client for 30 sec - exiting 17:07:04 (4776): No heartbeat from core client for 30 sec - exiting 17:07:06 (4776): No heartbeat from core client for 30 sec - exiting 17:07:07 (4776): No heartbeat from core client for 30 sec - exiting 17:07:08 (4776): No heartbeat from core client for 30 sec - exiting 17:07:09 (4776): No heartbeat from core client for 30 sec - exiting 17:07:10 (4776): No heartbeat from core client for 30 sec - exiting 17:07:11 (4776): No heartbeat from core client for 30 sec - exiting 17:07:12 (4776): No heartbeat from core client for 30 sec - exiting 17:07:13 (4776): No heartbeat from core client for 30 sec - exiting 17:07:14 (4776): No heartbeat from core client for 30 sec - exiting 17:07:15 (4776): No heartbeat from core client for 30 sec - exiting 17:07:16 (4776): No heartbeat from core client for 30 sec - exiting 17:07:18 (4776): No heartbeat from core client for 30 sec - exiting 17:07:19 (4776): No heartbeat from core client for 30 sec - exiting 17:07:20 (4776): No heartbeat from core client for 30 sec - exiting 17:07:21 (4776): No heartbeat from core client for 30 sec - exiting 17:07:22 (4776): No heartbeat from core client for 30 sec - exiting 17:07:23 (4776): No heartbeat from core client for 30 sec - exiting 17:07:24 (4776): No heartbeat from core client for 30 sec - exiting 17:07:25 (4776): No heartbeat from core client for 30 sec - exiting 17:07:26 (4776): No heartbeat from core client for 30 sec - exiting 17:07:27 (4776): No heartbeat from core client for 30 sec - exiting 17:07:28 (4776): No heartbeat from core client for 30 sec - exiting 17:07:30 (4776): No heartbeat from core client for 30 sec - exiting 17:07:31 (4776): No heartbeat from core client for 30 sec - exiting 17:07:32 (4776): No heartbeat from core client for 30 sec - exiting 17:07:33 (4776): No heartbeat from core client for 30 sec - exiting 17:07:34 (4776): No heartbeat from core client for 30 sec - exiting 17:07:35 (4776): No heartbeat from core client for 30 sec - exiting 17:07:36 (4776): No heartbeat from core client for 30 sec - exiting 17:07:37 (4776): No heartbeat from core client for 30 sec - exiting 17:07:38 (4776): No heartbeat from core client for 30 sec - exiting 17:07:39 (4776): No heartbeat from core client for 30 sec - exiting 17:07:41 (4776): No heartbeat from core client for 30 sec - exiting 17:07:42 (4776): No heartbeat from core client for 30 sec - exiting 17:07:43 (4776): No heartbeat from core client for 30 sec - exiting 17:07:44 (4776): No heartbeat from core client for 30 sec - exiting 17:07:45 (4776): No heartbeat from core client for 30 sec - exiting 17:07:46 (4776): No heartbeat from core client for 30 sec - exiting 17:07:47 (4776): No heartbeat from core client for 30 sec - exiting 17:07:48 (4776): No heartbeat from core client for 30 sec - exiting 17:07:49 (4776): No heartbeat from core client for 30 sec - exiting 17:07:50 (4776): No heartbeat from core client for 30 sec - exiting 17:07:51 (4776): No heartbeat from core client for 30 sec - exiting 17:07:53 (4776): No heartbeat from core client for 30 sec - exiting 17:07:54 (4776): No heartbeat from core client for 30 sec - exiting 17:07:55 (4776): No heartbeat from core client for 30 sec - exiting 17:07:56 (4776): No heartbeat from core client for 30 sec - exiting 17:07:57 (4776): No heartbeat from core client for 30 sec - exiting 17:07:58 (4776): No heartbeat from core client for 30 sec - exiting 17:07:59 (4776): No heartbeat from core client for 30 sec - exiting 17:08:00 (4776): No heartbeat from core client for 30 sec - exiting 17:08:01 (4776): No heartbeat from core client for 30 sec - exiting 17:08:02 (4776): No heartbeat from core client for 30 sec - exiting 17:08:03 (4776): No heartbeat from core client for 30 sec - exiting 17:08:05 (4776): No heartbeat from core client for 30 sec - exiting 17:08:06 (4776): No heartbeat from core client for 30 sec - exiting 17:08:07 (4776): No heartbeat from core client for 30 sec - exiting 17:08:08 (4776): No heartbeat from core client for 30 sec - exiting 17:08:09 (4776): No heartbeat from core client for 30 sec - exiting 17:08:10 (4776): No heartbeat from core client for 30 sec - exiting 17:08:11 (4776): No heartbeat from core client for 30 sec - exiting 17:08:12 (4776): No heartbeat from core client for 30 sec - exiting 17:08:13 (4776): No heartbeat from core client for 30 sec - exiting 17:08:14 (4776): No heartbeat from core client for 30 sec - exiting 17:08:15 (4776): No heartbeat from core client for 30 sec - exiting 17:08:17 (4776): No heartbeat from core client for 30 sec - exiting 17:08:18 (4776): No heartbeat from core client for 30 sec - exiting 17:08:19 (4776): No heartbeat from core client for 30 sec - exiting 17:08:20 (4776): No heartbeat from core client for 30 sec - exiting 17:08:21 (4776): No heartbeat from core client for 30 sec - exiting 17:08:22 (4776): No heartbeat from core client for 30 sec - exiting 17:08:23 (4776): No heartbeat from core client for 30 sec - exiting 17:08:24 (4776): No heartbeat from core client for 30 sec - exiting 17:08:25 (4776): No heartbeat from core client for 30 sec - exiting 17:08:26 (4776): No heartbeat from core client for 30 sec - exiting 17:08:27 (4776): No heartbeat from core client for 30 sec - exiting 17:08:29 (4776): No heartbeat from core client for 30 sec - exiting 17:08:30 (4776): No heartbeat from core client for 30 sec - exiting 17:08:31 (4776): No heartbeat from core client for 30 sec - exiting 17:08:32 (4776): No heartbeat from core client for 30 sec - exiting 17:08:33 (4776): No heartbeat from core client for 30 sec - exiting 17:08:34 (4776): No heartbeat from core client for 30 sec - exiting 17:08:35 (4776): No heartbeat from core client for 30 sec - exiting 17:08:36 (4776): No heartbeat from core client for 30 sec - exiting 17:08:37 (4776): No heartbeat from core client for 30 sec - exiting 17:08:38 (4776): No heartbeat from core client for 30 sec - exiting 17:08:39 (4776): No heartbeat from core client for 30 sec - exiting 17:08:41 (4776): No heartbeat from core client for 30 sec - exiting 17:08:42 (4776): No heartbeat from core client for 30 sec - exiting 17:08:43 (4776): No heartbeat from core client for 30 sec - exiting 17:08:44 (4776): No heartbeat from core client for 30 sec - exiting 17:08:45 (4776): No heartbeat from core client for 30 sec - exiting 17:08:46 (4776): No heartbeat from core client for 30 sec - exiting 17:08:47 (4776): No heartbeat from core client for 30 sec - exiting 17:08:48 (4776): No heartbeat from core client for 30 sec - exiting 17:08:49 (4776): No heartbeat from core client for 30 sec - exiting 17:08:50 (4776): No heartbeat from core client for 30 sec - exiting 17:08:51 (4776): No heartbeat from core client for 30 sec - exiting 17:08:53 (4776): No heartbeat from core client for 30 sec - exiting 17:08:54 (4776): No heartbeat from core client for 30 sec - exiting 17:08:55 (4776): No heartbeat from core client for 30 sec - exiting 17:08:56 (4776): No heartbeat from core client for 30 sec - exiting 17:08:57 (4776): No heartbeat from core client for 30 sec - exiting 17:08:58 (4776): No heartbeat from core client for 30 sec - exiting 17:08:59 (4776): No heartbeat from core client for 30 sec - exiting 17:09:00 (4776): No heartbeat from core client for 30 sec - exiting 17:09:01 (4776): No heartbeat from core client for 30 sec - exiting 17:09:02 (4776): No heartbeat from core client for 30 sec - exiting 17:09:03 (4776): No heartbeat from core client for 30 sec - exiting 17:09:05 (4776): No heartbeat from core client for 30 sec - exiting 17:09:06 (4776): No heartbeat from core client for 30 sec - exiting 17:09:07 (4776): No heartbeat from core client for 30 sec - exiting 17:09:08 (4776): No heartbeat from core client for 30 sec - exiting 17:09:09 (4776): No heartbeat from core client for 30 sec - exiting 17:09:10 (4776): No heartbeat from core client for 30 sec - exiting 17:09:11 (4776): No heartbeat from core client for 30 sec - exiting 17:09:12 (4776): No heartbeat from core client for 30 sec - exiting 17:09:13 (4776): No heartbeat from core client for 30 sec - exiting 17:09:14 (4776): No heartbeat from core client for 30 sec - exiting 17:09:16 (4776): No heartbeat from core client for 30 sec - exiting 17:09:17 (4776): No heartbeat from core client for 30 sec - exiting 17:09:18 (4776): No heartbeat from core client for 30 sec - exiting 17:09:19 (4776): No heartbeat from core client for 30 sec - exiting 17:09:20 (4776): No heartbeat from core client for 30 sec - exiting 17:09:21 (4776): No heartbeat from core client for 30 sec - exiting 17:09:22 (4776): No heartbeat from core client for 30 sec - exiting 17:09:23 (4776): No heartbeat from core client for 30 sec - exiting 17:09:24 (4776): No heartbeat from core client for 30 sec - exiting 17:09:25 (4776): No heartbeat from core client for 30 sec - exiting 17:09:26 (4776): No heartbeat from core client for 30 sec - exiting 17:09:28 (4776): No heartbeat from core client for 30 sec - exiting 17:09:29 (4776): No heartbeat from core client for 30 sec - exiting 17:09:30 (4776): No heartbeat from core client for 30 sec - exiting 17:09:31 (4776): No heartbeat from core client for 30 sec - exiting 17:09:32 (4776): No heartbeat from core client for 30 sec - exiting 17:09:33 (4776): No heartbeat from core client for 30 sec - exiting 17:09:34 (4776): No heartbeat from core client for 30 sec - exiting 17:09:35 (4776): No heartbeat from core client for 30 sec - exiting 17:09:36 (4776): No heartbeat from core client for 30 sec - exiting 17:09:37 (4776): No heartbeat from core client for 30 sec - exiting 17:09:38 (4776): No heartbeat from core client for 30 sec - exiting 17:09:40 (4776): No heartbeat from core client for 30 sec - exiting 17:09:41 (4776): No heartbeat from core client for 30 sec - exiting 17:09:42 (4776): No heartbeat from core client for 30 sec - exiting 17:09:43 (4776): No heartbeat from core client for 30 sec - exiting 17:09:44 (4776): No heartbeat from core client for 30 sec - exiting 17:09:45 (4776): No heartbeat from core client for 30 sec - exiting 17:09:46 (4776): No heartbeat from core client for 30 sec - exiting 17:09:47 (4776): No heartbeat from core client for 30 sec - exiting 17:09:48 (4776): No heartbeat from core client for 30 sec - exiting 17:09:49 (4776): No heartbeat from core client for 30 sec - exiting 17:09:50 (4776): No heartbeat from core client for 30 sec - exiting 17:09:52 (4776): No heartbeat from core client for 30 sec - exiting 17:09:53 (4776): No heartbeat from core client for 30 sec - exiting 17:09:54 (4776): No heartbeat from core client for 30 sec - exiting 17:09:55 (4776): No heartbeat from core client for 30 sec - exiting 17:09:56 (4776): No heartbeat from core client for 30 sec - exiting 17:09:57 (4776): No heartbeat from core client for 30 sec - exiting 17:09:58 (4776): No heartbeat from core client for 30 sec - exiting 17:09:59 (4776): No heartbeat from core client for 30 sec - exiting 17:10:00 (4776): No heartbeat from core client for 30 sec - exiting 17:10:01 (4776): No heartbeat from core client for 30 sec - exiting 17:10:02 (4776): No heartbeat from core client for 30 sec - exiting 17:10:04 (4776): No heartbeat from core client for 30 sec - exiting 17:10:05 (4776): No heartbeat from core client for 30 sec - exiting 17:10:06 (4776): No heartbeat from core client for 30 sec - exiting 17:10:07 (4776): No heartbeat from core client for 30 sec - exiting 17:10:08 (4776): No heartbeat from core client for 30 sec - exiting 17:10:09 (4776): No heartbeat from core client for 30 sec - exiting 17:10:10 (4776): No heartbeat from core client for 30 sec - exiting 17:10:11 (4776): No heartbeat from core client for 30 sec - exiting 17:10:12 (4776): No heartbeat from core client for 30 sec - exiting 17:10:13 (4776): No heartbeat from core client for 30 sec - exiting 17:10:14 (4776): No heartbeat from core client for 30 sec - exiting 17:10:16 (4776): No heartbeat from core client for 30 sec - exiting 17:10:17 (4776): No heartbeat from core client for 30 sec - exiting 17:10:18 (4776): No heartbeat from core client for 30 sec - exiting 17:10:19 (4776): No heartbeat from core client for 30 sec - exiting 17:10:20 (4776): No heartbeat from core client for 30 sec - exiting 17:10:21 (4776): No heartbeat from core client for 30 sec - exiting 17:10:22 (4776): No heartbeat from core client for 30 sec - exiting 17:10:23 (4776): No heartbeat from core client for 30 sec - exiting 17:10:24 (4776): No heartbeat from core client for 30 sec - exiting 17:10:25 (4776): No heartbeat from core client for 30 sec - exiting 17:10:26 (4776): No heartbeat from core client for 30 sec - exiting 17:10:28 (4776): No heartbeat from core client for 30 sec - exiting 17:10:29 (4776): No heartbeat from core client for 30 sec - exiting 17:10:30 (4776): No heartbeat from core client for 30 sec - exiting 17:10:31 (4776): No heartbeat from core client for 30 sec - exiting 17:10:32 (4776): No heartbeat from core client for 30 sec - exiting 17:10:33 (4776): No heartbeat from core client for 30 sec - exiting 17:10:34 (4776): No heartbeat from core client for 30 sec - exiting 17:10:35 (4776): No heartbeat from core client for 30 sec - exiting 17:10:36 (4776): No heartbeat from core client for 30 sec - exiting 17:10:37 (4776): No heartbeat from core client for 30 sec - exiting 17:10:39 (4776): No heartbeat from core client for 30 sec - exiting 17:10:40 (4776): No heartbeat from core client for 30 sec - exiting 17:10:41 (4776): No heartbeat from core client for 30 sec - exiting 17:10:42 (4776): No heartbeat from core client for 30 sec - exiting 17:10:43 (4776): No heartbeat from core client for 30 sec - exiting 17:10:44 (4776): No heartbeat from core client for 30 sec - exiting 17:10:45 (4776): No heartbeat from core client for 30 sec - exiting 17:10:46 (4776): No heartbeat from core client for 30 sec - exiting 17:10:47 (4776): No heartbeat from core client for 30 sec - exiting 17:10:48 (4776): No heartbeat from core client for 30 sec - exiting 17:10:49 (4776): No heartbeat from core client for 30 sec - exiting 17:10:51 (4776): No heartbeat from core client for 30 sec - exiting 17:10:52 (4776): No heartbeat from core client for 30 sec - exiting 17:10:53 (4776): No heartbeat from core client for 30 sec - exiting 17:10:54 (4776): No heartbeat from core client for 30 sec - exiting 17:10:55 (4776): No heartbeat from core client for 30 sec - exiting 17:10:56 (4776): No heartbeat from core client for 30 sec - exiting 17:10:57 (4776): No heartbeat from core client for 30 sec - exiting 17:10:58 (4776): No heartbeat from core client for 30 sec - exiting 17:10:59 (4776): No heartbeat from core client for 30 sec - exiting 17:11:00 (4776): No heartbeat from core client for 30 sec - exiting 17:11:01 (4776): No heartbeat from core client for 30 sec - exiting 17:11:03 (4776): No heartbeat from core client for 30 sec - exiting 17:11:04 (4776): No heartbeat from core client for 30 sec - exiting 17:11:05 (4776): No heartbeat from core client for 30 sec - exiting 17:11:06 (4776): No heartbeat from core client for 30 sec - exiting 17:11:07 (4776): No heartbeat from core client for 30 sec - exiting 17:11:08 (4776): No heartbeat from core client for 30 sec - exiting 17:11:09 (4776): No heartbeat from core client for 30 sec - exiting 17:11:10 (4776): No heartbeat from core client for 30 sec - exiting 17:11:11 (4776): No heartbeat from core client for 30 sec - exiting 17:11:12 (4776): No heartbeat from core client for 30 sec - exiting 17:11:13 (4776): No heartbeat from core client for 30 sec - exiting 17:11:15 (4776): No heartbeat from core client for 30 sec - exiting 17:11:16 (4776): No heartbeat from core client for 30 sec - exiting 17:11:17 (4776): No heartbeat from core client for 30 sec - exiting 17:11:18 (4776): No heartbeat from core client for 30 sec - exiting 17:11:19 (4776): No heartbeat from core client for 30 sec - exiting 17:11:20 (4776): No heartbeat from core client for 30 sec - exiting 17:11:21 (4776): No heartbeat from core client for 30 sec - exiting 17:11:22 (4776): No heartbeat from core client for 30 sec - exiting 17:11:23 (4776): No heartbeat from core client for 30 sec - exiting 17:11:24 (4776): No heartbeat from core client for 30 sec - exiting 17:11:25 (4776): No heartbeat from core client for 30 sec - exiting 17:11:27 (4776): No heartbeat from core client for 30 sec - exiting 17:11:28 (4776): No heartbeat from core client for 30 sec - exiting 17:11:29 (4776): No heartbeat from core client for 30 sec - exiting 17:11:30 (4776): No heartbeat from core client for 30 sec - exiting 17:11:31 (4776): No heartbeat from core client for 30 sec - exiting 17:11:32 (4776): No heartbeat from core client for 30 sec - exiting 17:11:33 (4776): No heartbeat from core client for 30 sec - exiting 17:11:34 (4776): No heartbeat from core client for 30 sec - exiting 17:11:35 (4776): No heartbeat from core client for 30 sec - exiting 17:11:36 (4776): No heartbeat from core client for 30 sec - exiting 17:11:37 (4776): No heartbeat from core client for 30 sec - exiting 17:11:39 (4776): No heartbeat from core client for 30 sec - exiting 17:11:40 (4776): No heartbeat from core client for 30 sec - exiting 17:11:41 (4776): No heartbeat from core client for 30 sec - exiting 17:11:42 (4776): No heartbeat from core client for 30 sec - exiting 17:11:43 (4776): No heartbeat from core client for 30 sec - exiting 17:11:44 (4776): No heartbeat from core client for 30 sec - exiting 17:11:45 (4776): No heartbeat from core client for 30 sec - exiting 17:11:46 (4776): No heartbeat from core client for 30 sec - exiting 17:11:47 (4776): No heartbeat from core client for 30 sec - exiting 17:11:48 (4776): No heartbeat from core client for 30 sec - exiting 17:11:49 (4776): No heartbeat from core client for 30 sec - exiting 17:11:51 (4776): No heartbeat from core client for 30 sec - exiting 17:11:52 (4776): No heartbeat from core client for 30 sec - exiting 17:11:53 (4776): No heartbeat from core client for 30 sec - exiting 17:11:54 (4776): No heartbeat from core client for 30 sec - exiting 17:11:55 (4776): No heartbeat from core client for 30 sec - exiting 17:11:56 (4776): No heartbeat from core client for 30 sec - exiting 17:11:57 (4776): No heartbeat from core client for 30 sec - exiting 17:11:58 (4776): No heartbeat from core client for 30 sec - exiting 17:11:59 (4776): No heartbeat from core client for 30 sec - exiting 17:12:00 (4776): No heartbeat from core client for 30 sec - exiting 17:12:01 (4776): No heartbeat from core client for 30 sec - exiting 17:12:03 (4776): No heartbeat from core client for 30 sec - exiting 17:12:04 (4776): No heartbeat from core client for 30 sec - exiting 17:12:05 (4776): No heartbeat from core client for 30 sec - exiting 17:12:06 (4776): No heartbeat from core client for 30 sec - exiting 17:12:07 (4776): No heartbeat from core client for 30 sec - exiting 17:12:08 (4776): No heartbeat from core client for 30 sec - exiting 17:12:09 (4776): No heartbeat from core client for 30 sec - exiting 17:12:10 (4776): No heartbeat from core client for 30 sec - exiting 17:12:11 (4776): No heartbeat from core client for 30 sec - exiting 17:12:12 (4776): No heartbeat from core client for 30 sec - exiting 17:12:14 (4776): No heartbeat from core client for 30 sec - exiting 17:12:15 (4776): No heartbeat from core client for 30 sec - exiting 17:12:16 (4776): No heartbeat from core client for 30 sec - exiting 17:12:17 (4776): No heartbeat from core client for 30 sec - exiting 17:12:18 (4776): No heartbeat from core client for 30 sec - exiting 17:12:19 (4776): No heartbeat from core client for 30 sec - exiting 17:12:20 (4776): No heartbeat from core client for 30 sec - exiting 17:12:21 (4776): No heartbeat from core client for 30 sec - exiting 17:12:22 (4776): No heartbeat from core client for 30 sec - exiting 17:12:23 (4776): No heartbeat from core client for 30 sec - exiting 17:12:24 (4776): No heartbeat from core client for 30 sec - exiting 17:12:26 (4776): No heartbeat from core client for 30 sec - exiting 17:12:27 (4776): No heartbeat from core client for 30 sec - exiting 17:12:28 (4776): No heartbeat from core client for 30 sec - exiting 17:12:29 (4776): No heartbeat from core client for 30 sec - exiting 17:12:30 (4776): No heartbeat from core client for 30 sec - exiting 17:12:31 (4776): No heartbeat from core client for 30 sec - exiting 17:12:32 (4776): No heartbeat from core client for 30 sec - exiting 17:12:33 (4776): No heartbeat from core client for 30 sec - exiting 17:12:34 (4776): No heartbeat from core client for 30 sec - exiting 17:12:35 (4776): No heartbeat from core client for 30 sec - exiting 17:12:36 (4776): No heartbeat from core client for 30 sec - exiting 17:12:38 (4776): No heartbeat from core client for 30 sec - exiting 17:12:39 (4776): No heartbeat from core client for 30 sec - exiting 17:12:40 (4776): No heartbeat from core client for 30 sec - exiting 17:12:41 (4776): No heartbeat from core client for 30 sec - exiting 17:12:42 (4776): No heartbeat from core client for 30 sec - exiting 17:12:43 (4776): No heartbeat from core client for 30 sec - exiting 17:12:44 (4776): No heartbeat from core client for 30 sec - exiting 17:12:45 (4776): No heartbeat from core client for 30 sec - exiting 17:12:46 (4776): No heartbeat from core client for 30 sec - exiting 17:12:47 (4776): No heartbeat from core client for 30 sec - exiting 17:12:48 (4776): No heartbeat from core client for 30 sec - exiting 17:12:50 (4776): No heartbeat from core client for 30 sec - exiting 17:12:51 (4776): No heartbeat from core client for 30 sec - exiting 17:12:52 (4776): No heartbeat from core client for 30 sec - exiting 17:12:53 (4776): No heartbeat from core client for 30 sec - exiting 17:12:54 (4776): No heartbeat from core client for 30 sec - exiting 17:12:55 (4776): No heartbeat from core client for 30 sec - exiting 17:12:56 (4776): No heartbeat from core client for 30 sec - exiting 17:12:57 (4776): No heartbeat from core client for 30 sec - exiting 17:12:58 (4776): No heartbeat from core client for 30 sec - exiting 17:12:59 (4776): No heartbeat from core client for 30 sec - exiting 17:13:00 (4776): No heartbeat from core client for 30 sec - exiting 17:13:02 (4776): No heartbeat from core client for 30 sec - exiting 17:13:03 (4776): No heartbeat from core client for 30 sec - exiting 17:13:04 (4776): No heartbeat from core client for 30 sec - exiting 17:13:05 (4776): No heartbeat from core client for 30 sec - exiting 17:13:06 (4776): No heartbeat from core client for 30 sec - exiting 17:13:07 (4776): No heartbeat from core client for 30 sec - exiting 17:13:08 (4776): No heartbeat from core client for 30 sec - exiting 17:13:09 (4776): No heartbeat from core client for 30 sec - exiting 17:13:10 (4776): No heartbeat from core client for 30 sec - exiting 17:13:11 (4776): No heartbeat from core client for 30 sec - exiting 17:13:12 (4776): No heartbeat from core client for 30 sec - exiting 17:13:14 (4776): No heartbeat from core client for 30 sec - exiting 17:13:15 (4776): No heartbeat from core client for 30 sec - exiting 17:13:16 (4776): No heartbeat from core client for 30 sec - exiting 17:13:17 (4776): No heartbeat from core client for 30 sec - exiting 17:13:18 (4776): No heartbeat from core client for 30 sec - exiting 17:13:19 (4776): No heartbeat from core client for 30 sec - exiting 17:13:20 (4776): No heartbeat from core client for 30 sec - exiting 17:13:21 (4776): No heartbeat from core client for 30 sec - exiting 17:13:22 (4776): No heartbeat from core client for 30 sec - exiting 17:13:23 (4776): No heartbeat from core client for 30 sec - exiting 17:13:24 (4776): No heartbeat from core client for 30 sec - exiting 17:13:26 (4776): No heartbeat from core client for 30 sec - exiting 17:13:27 (4776): No heartbeat from core client for 30 sec - exiting 17:13:28 (4776): No heartbeat from core client for 30 sec - exiting 17:13:29 (4776): No heartbeat from core client for 30 sec - exiting 17:13:30 (4776): No heartbeat from core client for 30 sec - exiting 17:13:31 (4776): No heartbeat from core client for 30 sec - exiting 17:13:32 (4776): No heartbeat from core client for 30 sec - exiting 17:13:33 (4776): No heartbeat from core client for 30 sec - exiting 17:13:34 (4776): No heartbeat from core client for 30 sec - exiting 17:13:35 (4776): No heartbeat from core client for 30 sec - exiting 17:13:36 (4776): No heartbeat from core client for 30 sec - exiting 17:13:38 (4776): No heartbeat from core client for 30 sec - exiting 17:13:39 (4776): No heartbeat from core client for 30 sec - exiting 17:13:40 (4776): No heartbeat from core client for 30 sec - exiting 17:13:41 (4776): No heartbeat from core client for 30 sec - exiting 17:13:42 (4776): No heartbeat from core client for 30 sec - exiting 17:13:43 (4776): No heartbeat from core client for 30 sec - exiting 17:13:44 (4776): No heartbeat from core client for 30 sec - exiting 17:13:45 (4776): No heartbeat from core client for 30 sec - exiting 17:13:46 (4776): No heartbeat from core client for 30 sec - exiting 17:13:47 (4776): No heartbeat from core client for 30 sec - exiting 17:13:49 (4776): No heartbeat from core client for 30 sec - exiting 17:13:50 (4776): No heartbeat from core client for 30 sec - exiting 17:13:51 (4776): No heartbeat from core client for 30 sec - exiting 17:13:52 (4776): No heartbeat from core client for 30 sec - exiting 17:13:53 (4776): No heartbeat from core client for 30 sec - exiting 17:13:54 (4776): No heartbeat from core client for 30 sec - exiting 17:13:55 (4776): No heartbeat from core client for 30 sec - exiting 17:13:56 (4776): No heartbeat from core client for 30 sec - exiting 17:13:57 (4776): No heartbeat from core client for 30 sec - exiting 17:13:58 (4776): No heartbeat from core client for 30 sec - exiting 17:13:59 (4776): No heartbeat from core client for 30 sec - exiting 17:14:01 (4776): No heartbeat from core client for 30 sec - exiting 17:14:02 (4776): No heartbeat from core client for 30 sec - exiting 17:14:03 (4776): No heartbeat from core client for 30 sec - exiting 17:14:04 (4776): No heartbeat from core client for 30 sec - exiting 17:14:05 (4776): No heartbeat from core client for 30 sec - exiting 17:14:06 (4776): No heartbeat from core client for 30 sec - exiting 17:14:07 (4776): No heartbeat from core client for 30 sec - exiting 17:14:08 (4776): No heartbeat from core client for 30 sec - exiting 17:14:09 (4776): No heartbeat from core client for 30 sec - exiting 17:14:10 (4776): No heartbeat from core client for 30 sec - exiting 17:14:11 (4776): No heartbeat from core client for 30 sec - exiting 17:14:13 (4776): No heartbeat from core client for 30 sec - exiting 17:14:14 (4776): No heartbeat from core client for 30 sec - exiting 17:14:15 (4776): No heartbeat from core client for 30 sec - exiting 17:14:16 (4776): No heartbeat from core client for 30 sec - exiting 17:14:17 (4776): No heartbeat from core client for 30 sec - exiting 17:14:18 (4776): No heartbeat from core client for 30 sec - exiting 17:14:19 (4776): No heartbeat from core client for 30 sec - exiting 17:14:20 (4776): No heartbeat from core client for 30 sec - exiting 17:14:21 (4776): No heartbeat from core client for 30 sec - exiting 17:14:22 (4776): No heartbeat from core client for 30 sec - exiting 17:14:23 (4776): No heartbeat from core client for 30 sec - exiting 17:14:25 (4776): No heartbeat from core client for 30 sec - exiting 17:14:26 (4776): No heartbeat from core client for 30 sec - exiting 17:14:27 (4776): No heartbeat from core client for 30 sec - exiting 17:14:28 (4776): No heartbeat from core client for 30 sec - exiting 17:14:29 (4776): No heartbeat from core client for 30 sec - exiting 17:14:30 (4776): No heartbeat from core client for 30 sec - exiting 17:14:31 (4776): No heartbeat from core client for 30 sec - exiting 17:14:32 (4776): No heartbeat from core client for 30 sec - exiting 17:14:33 (4776): No heartbeat from core client for 30 sec - exiting 17:14:34 (4776): No heartbeat from core client for 30 sec - exiting 17:14:35 (4776): No heartbeat from core client for 30 sec - exiting 17:14:37 (4776): No heartbeat from core client for 30 sec - exiting 17:14:38 (4776): No heartbeat from core client for 30 sec - exiting 17:14:39 (4776): No heartbeat from core client for 30 sec - exiting 17:14:40 (4776): No heartbeat from core client for 30 sec - exiting 17:14:41 (4776): No heartbeat from core client for 30 sec - exiting 17:14:42 (4776): No heartbeat from core client for 30 sec - exiting 17:14:43 (4776): No heartbeat from core client for 30 sec - exiting 17:14:44 (4776): No heartbeat from core client for 30 sec - exiting 17:14:45 (4776): No heartbeat from core client for 30 sec - exiting 17:14:46 (4776): No heartbeat from core client for 30 sec - exiting 17:14:47 (4776): No heartbeat from core client for 30 sec - exiting 17:14:49 (4776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5068, selfPID=5068, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1224, selfPID=4356, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5684, selfPID=5684, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5296, selfPID=5296, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=360, selfPID=360, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2480, selfPID=2480, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2344, selfPID=2344, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 7 Called boinc_finish </stderr_txt><message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_zm92_1998_1_007720024_1_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zm92_1998_1_007720024_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zm92_1998_1_007720024_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zm92_1998_1_007720024_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zm92_1998_1_007720024_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Mar 2012 12:23:08	961094	14082021	hadam3p_pnw_zm92_1998_1_007720024_1	80,737	290,703	3.6006
02 Mar 2012 01:03:14	961094	14082021	hadam3p_pnw_zm92_1998_1_007720024_1	80,736	290,325	3.5960
28 Feb 2012 01:47:40	961094	14082021	hadam3p_pnw_zm92_1998_1_007720024_1	69,216	255,301	3.6885
21 Feb 2012 14:09:30	961094	14082021	hadam3p_pnw_zm92_1998_1_007720024_1	57,696	213,409	3.6989
16 Feb 2012 19:14:51	961094	14082021	hadam3p_pnw_zm92_1998_1_007720024_1	46,177	169,979	3.6810
16 Feb 2012 16:12:04	961094	14082021	hadam3p_pnw_zm92_1998_1_007720024_1	46,176	169,500	3.6707
15 Feb 2012 03:35:07	961094	14082021	hadam3p_pnw_zm92_1998_1_007720024_1	34,656	127,888	3.6902
13 Feb 2012 15:16:46	961094	14082021	hadam3p_pnw_zm92_1998_1_007720024_1	23,136	86,010	3.7176
11 Feb 2012 14:10:45	961094	14082021	hadam3p_pnw_zm92_1998_1_007720024_1	11,616	43,665	3.7590