Task 12208659

Name	hadam3p_pnw_z5wq_1985_1_006928578_0
Workunit	7131894
Created	22 Nov 2010, 11:55:52 UTC
Sent	26 Mar 2011, 0:39:35 UTC
Report deadline	7 Mar 2012, 5:59:35 UTC
Received	19 May 2011, 12:05:04 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	790144
Run time	5 days 18 hours 37 min 59 sec
CPU time	4 days 23 hours 34 min 35 sec
Validate state	Workunit error - check skipped
Credit	3,005.88
Device peak FLOPS	2.30 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8448, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7932, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5840, selfPID=4904, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 21:04:40 (1332): No heartbeat from core client for 30 sec - exiting 21:04:41 (1332): No heartbeat from core client for 30 sec - exiting 21:04:42 (1332): No heartbeat from core client for 30 sec - exiting 21:04:43 (1332): No heartbeat from core client for 30 sec - exiting 21:04:44 (1332): No heartbeat from core client for 30 sec - exiting 21:04:45 (1332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4928, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4008, selfPID=5112, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3856, selfPID=960, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5596, selfPID=4984, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1216, selfPID=4932, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4944, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 7 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:34:26 (4828): No heartbeat from core client for 30 sec - exiting 07:34:27 (4828): No heartbeat from core client for 30 sec - exiting 07:34:28 (4828): No heartbeat from core client for 30 sec - exiting 07:34:29 (4828): No heartbeat from core client for 30 sec - exiting 07:34:30 (4828): No heartbeat from core client for 30 sec - exiting 07:34:31 (4828): No heartbeat from core client for 30 sec - exiting 07:34:32 (4828): No heartbeat from core client for 30 sec - exiting 07:34:33 (4828): No heartbeat from core client for 30 sec - exiting 07:34:34 (4828): No heartbeat from core client for 30 sec - exiting 07:34:35 (4828): No heartbeat from core client for 30 sec - exiting 07:34:36 (4828): No heartbeat from core client for 30 sec - exiting 07:34:37 (4828): No heartbeat from core client for 30 sec - exiting 07:34:38 (4828): No heartbeat from core client for 30 sec - exiting 07:34:39 (4828): No heartbeat from core client for 30 sec - exiting 07:34:40 (4828): No heartbeat from core client for 30 sec - exiting 07:34:41 (4828): No heartbeat from core client for 30 sec - exiting 07:34:42 (4828): No heartbeat from core client for 30 sec - exiting 07:34:43 (4828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4540, selfPID=4936, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 7 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4072, selfPID=4196, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5788, selfPID=5060, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3416, selfPID=5036, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4560, selfPID=4748, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5816, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5656, selfPID=5040, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5824, selfPID=5056, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=896, selfPID=2484, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2652, selfPID=5008, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5924, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5304, iMonCtr=2 Model crash detected, will try to restart... 23:14:59 (4008): No heartbeat from core client for 30 sec - exiting 23:15:00 (4008): No heartbeat from core client for 30 sec - exiting 23:15:01 (4008): No heartbeat from core client for 30 sec - exiting 23:15:02 (4008): No heartbeat from core client for 30 sec - exiting 23:15:03 (4008): No heartbeat from core client for 30 sec - exiting 23:15:04 (4008): No heartbeat from core client for 30 sec - exiting 23:15:05 (4008): No heartbeat from core client for 30 sec - exiting 23:15:06 (4008): No heartbeat from core client for 30 sec - exiting 23:15:07 (4008): No heartbeat from core client for 30 sec - exiting 23:15:08 (4008): No heartbeat from core client for 30 sec - exiting 23:15:09 (4008): No heartbeat from core client for 30 sec - exiting 23:15:10 (4008): No heartbeat from core client for 30 sec - exiting 23:15:11 (4008): No heartbeat from core client for 30 sec - exiting 23:15:12 (4008): No heartbeat from core client for 30 sec - exiting 23:15:13 (4008): No heartbeat from core client for 30 sec - exiting 23:15:14 (4008): No heartbeat from core client for 30 sec - exiting 23:15:15 (4008): No heartbeat from core client for 30 sec - exiting 23:15:16 (4008): No heartbeat from core client for 30 sec - exiting 23:15:17 (4008): No heartbeat from core client for 30 sec - exiting 23:15:18 (4008): No heartbeat from core client for 30 sec - exiting 23:15:19 (4008): No heartbeat from core client for 30 sec - exiting 23:15:20 (4008): No heartbeat from core client for 30 sec - exiting 23:15:21 (4008): No heartbeat from core client for 30 sec - exiting 23:15:22 (4008): No heartbeat from core client for 30 sec - exiting 23:15:23 (4008): No heartbeat from core client for 30 sec - exiting 23:15:24 (4008): No heartbeat from core client for 30 sec - exiting 23:15:25 (4008): No heartbeat from core client for 30 sec - exiting 23:15:26 (4008): No heartbeat from core client for 30 sec - exiting 23:15:27 (4008): No heartbeat from core client for 30 sec - exiting 23:15:28 (4008): No heartbeat from core client for 30 sec - exiting 23:15:29 (4008): No heartbeat from core client for 30 sec - exiting 23:15:30 (4008): No heartbeat from core client for 30 sec - exiting 23:15:31 (4008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:32:16 (1828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:32:17 (1828): No heartbeat from core client for 30 sec - exiting 07:32:18 (1828): No heartbeat from core client for 30 sec - exiting 07:32:19 (1828): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:25:54 (4840): No heartbeat from core client for 30 sec - exiting 20:25:56 (4840): No heartbeat from core client for 30 sec - exiting 20:25:57 (4840): No heartbeat from core client for 30 sec - exiting 20:25:58 (4840): No heartbeat from core client for 30 sec - exiting 20:25:59 (4840): No heartbeat from core client for 30 sec - exiting 20:26:00 (4840): No heartbeat from core client for 30 sec - exiting 20:26:01 (4840): No heartbeat from core client for 30 sec - exiting 20:26:02 (4840): No heartbeat from core client for 30 sec - exiting 20:26:03 (4840): No heartbeat from core client for 30 sec - exiting 20:26:04 (4840): No heartbeat from core client for 30 sec - exiting 20:26:05 (4840): No heartbeat from core client for 30 sec - exiting 20:26:06 (4840): No heartbeat from core client for 30 sec - exiting 20:26:07 (4840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:02:46 (2484): No heartbeat from core client for 30 sec - exiting 21:02:47 (2484): No heartbeat from core client for 30 sec - exiting 21:02:48 (2484): No heartbeat from core client for 30 sec - exiting 21:02:49 (2484): No heartbeat from core client for 30 sec - exiting 21:02:50 (2484): No heartbeat from core client for 30 sec - exiting 21:02:51 (2484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5208, iMonCtr=2 Model crash detected, will try to restart... 22:40:38 (3204): No heartbeat from core client for 30 sec - exiting 22:40:39 (3204): No heartbeat from core client for 30 sec - exiting 22:40:40 (3204): No heartbeat from core client for 30 sec - exiting 22:40:41 (3204): No heartbeat from core client for 30 sec - exiting 22:40:42 (3204): No heartbeat from core client for 30 sec - exiting 22:40:43 (3204): No heartbeat from core client for 30 sec - exiting 22:40:44 (3204): No heartbeat from core client for 30 sec - exiting 22:40:45 (3204): No heartbeat from core client for 30 sec - exiting 22:40:46 (3204): No heartbeat from core client for 30 sec - exiting 22:40:47 (3204): No heartbeat from core client for 30 sec - exiting 22:40:48 (3204): No heartbeat from core client for 30 sec - exiting 22:40:49 (3204): No heartbeat from core client for 30 sec - exiting 22:40:50 (3204): No heartbeat from core client for 30 sec - exiting 22:40:51 (3204): No heartbeat from core client for 30 sec - exiting 22:40:52 (3204): No heartbeat from core client for 30 sec - exiting 22:40:53 (3204): No heartbeat from core client for 30 sec - exiting 22:40:54 (3204): No heartbeat from core client for 30 sec - exiting 22:40:55 (3204): No heartbeat from core client for 30 sec - exiting 22:40:56 (3204): No heartbeat from core client for 30 sec - exiting 22:40:57 (3204): No heartbeat from core client for 30 sec - exiting 22:40:58 (3204): No heartbeat from core client for 30 sec - exiting 22:40:59 (3204): No heartbeat from core client for 30 sec - exiting 22:41:00 (3204): No heartbeat from core client for 30 sec - exiting 22:41:01 (3204): No heartbeat from core client for 30 sec - exiting 22:41:02 (3204): No heartbeat from core client for 30 sec - exiting 22:41:03 (3204): No heartbeat from core client for 30 sec - exiting 22:41:04 (3204): No heartbeat from core client for 30 sec - exiting 22:41:05 (3204): No heartbeat from core client for 30 sec - exiting 22:41:06 (3204): No heartbeat from core client for 30 sec - exiting 22:41:07 (3204): No heartbeat from core client for 30 sec - exiting 22:41:08 (3204): No heartbeat from core client for 30 sec - exiting 22:41:09 (3204): No heartbeat from core client for 30 sec - exiting 22:41:10 (3204): No heartbeat from core client for 30 sec - exiting 22:41:11 (3204): No heartbeat from core client for 30 sec - exiting 22:41:12 (3204): No heartbeat from core client for 30 sec - exiting 22:41:13 (3204): No heartbeat from core client for 30 sec - exiting 22:41:14 (3204): No heartbeat from core client for 30 sec - exiting 22:41:15 (3204): No heartbeat from core client for 30 sec - exiting 22:41:16 (3204): No heartbeat from core client for 30 sec - exiting 22:41:17 (3204): No heartbeat from core client for 30 sec - exiting 22:41:18 (3204): No heartbeat from core client for 30 sec - exiting 22:41:19 (3204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:03:34 (5076): No heartbeat from core client for 30 sec - exiting 23:03:35 (5076): No heartbeat from core client for 30 sec - exiting 23:03:36 (5076): No heartbeat from core client for 30 sec - exiting 23:03:37 (5076): No heartbeat from core client for 30 sec - exiting 23:03:38 (5076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:31:38 (4440): No heartbeat from core client for 30 sec - exiting 07:31:39 (4440): No heartbeat from core client for 30 sec - exiting 07:31:40 (4440): No heartbeat from core client for 30 sec - exiting 07:31:41 (4440): No heartbeat from core client for 30 sec - exiting 07:31:42 (4440): No heartbeat from core client for 30 sec - exiting 07:31:43 (4440): No heartbeat from core client for 30 sec - exiting 07:31:44 (4440): No heartbeat from core client for 30 sec - exiting 07:31:45 (4440): No heartbeat from core client for 30 sec - exiting 07:31:46 (4440): No heartbeat from core client for 30 sec - exiting 07:31:47 (4440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:19:28 (2764): No heartbeat from core client for 30 sec - exiting 19:19:29 (2764): No heartbeat from core client for 30 sec - exiting 19:19:30 (2764): No heartbeat from core client for 30 sec - exiting 19:19:31 (2764): No heartbeat from core client for 30 sec - exiting 19:19:32 (2764): No heartbeat from core client for 30 sec - exiting 19:19:33 (2764): No heartbeat from core client for 30 sec - exiting 19:19:34 (2764): No heartbeat from core client for 30 sec - exiting 19:19:35 (2764): No heartbeat from core client for 30 sec - exiting 19:19:36 (2764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5584, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5608, iMonCtr=2 Model crash detected, will try to restart... 07:34:47 (4256): No heartbeat from core client for 30 sec - exiting 07:34:48 (4256): No heartbeat from core client for 30 sec - exiting 07:34:49 (4256): No heartbeat from core client for 30 sec - exiting 07:34:50 (4256): No heartbeat from core client for 30 sec - exiting 07:34:51 (4256): No heartbeat from core client for 30 sec - exiting 07:34:52 (4256): No heartbeat from core client for 30 sec - exiting 07:34:53 (4256): No heartbeat from core client for 30 sec - exiting 07:34:54 (4256): No heartbeat from core client for 30 sec - exiting 07:34:55 (4256): No heartbeat from core client for 30 sec - exiting 07:34:56 (4256): No heartbeat from core client for 30 sec - exiting 07:34:57 (4256): No heartbeat from core client for 30 sec - exiting 07:34:58 (4256): No heartbeat from core client for 30 sec - exiting 07:34:59 (4256): No heartbeat from core client for 30 sec - exiting 07:35:00 (4256): No heartbeat from core client for 30 sec - exiting 07:35:01 (4256): No heartbeat from core client for 30 sec - exiting 07:35:02 (4256): No heartbeat from core client for 30 sec - exiting 07:35:03 (4256): No heartbeat from core client for 30 sec - exiting 07:35:04 (4256): No heartbeat from core client for 30 sec - exiting 07:35:05 (4256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:03:59 (5052): No heartbeat from core client for 30 sec - exiting 19:04:00 (5052): No heartbeat from core client for 30 sec - exiting 19:04:01 (5052): No heartbeat from core client for 30 sec - exiting 19:04:02 (5052): No heartbeat from core client for 30 sec - exiting 19:04:03 (5052): No heartbeat from core client for 30 sec - exiting 19:04:04 (5052): No heartbeat from core client for 30 sec - exiting 19:04:05 (5052): No heartbeat from core client for 30 sec - exiting 19:04:06 (5052): No heartbeat from core client for 30 sec - exiting 19:04:07 (5052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 May 2011 12:36:38	790144	12208659	hadam3p_pnw_z5wq_1985_1_006928578_0	138,336	429,659	3.1059
16 May 2011 03:44:34	790144	12208659	hadam3p_pnw_z5wq_1985_1_006928578_0	126,816	393,417	3.1023
14 May 2011 11:52:29	790144	12208659	hadam3p_pnw_z5wq_1985_1_006928578_0	115,296	357,340	3.0993
11 May 2011 10:51:33	790144	12208659	hadam3p_pnw_z5wq_1985_1_006928578_0	103,776	321,924	3.1021
08 May 2011 09:44:42	790144	12208659	hadam3p_pnw_z5wq_1985_1_006928578_0	92,256	286,503	3.1055
01 May 2011 11:32:23	790144	12208659	hadam3p_pnw_z5wq_1985_1_006928578_0	80,736	250,994	3.1088
30 Apr 2011 05:16:17	790144	12208659	hadam3p_pnw_z5wq_1985_1_006928578_0	69,216	215,179	3.1088
26 Apr 2011 21:52:13	790144	12208659	hadam3p_pnw_z5wq_1985_1_006928578_0	57,696	179,529	3.1116
24 Apr 2011 23:02:28	790144	12208659	hadam3p_pnw_z5wq_1985_1_006928578_0	46,176	143,558	3.1089
23 Apr 2011 08:48:06	790144	12208659	hadam3p_pnw_z5wq_1985_1_006928578_0	34,656	107,687	3.1073
20 Apr 2011 21:32:59	790144	12208659	hadam3p_pnw_z5wq_1985_1_006928578_0	23,136	72,028	3.1132
20 Apr 2011 21:32:59	790144	12208659	hadam3p_pnw_z5wq_1985_1_006928578_0	11,616	36,584	3.1494