Task 13663627

Name	hadcm3n_u0cy_1980_40_007458010_4
Workunit	7655513
Created	26 Nov 2011, 13:13:33 UTC
Sent	26 Nov 2011, 13:14:55 UTC
Report deadline	25 Feb 2012, 20:42:06 UTC
Received	4 Feb 2012, 2:29:59 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	943197
Run time	27 days 6 hours 41 min 40 sec
CPU time	20 days 1 hours 39 min 46 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.20 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> :: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... 17:24:07 (4640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:24:08 (4640): No heartbeat from core client for 30 sec - exiting 17:24:09 (4640): No heartbeat from core client for 30 sec - exiting 17:24:10 (4640): No heartbeat from core client for 30 sec - exiting 17:24:11 (4640): No heartbeat from core client for 30 sec - exiting 17:24:12 (4640): No heartbeat from core client for 30 sec - exiting 17:24:13 (4640): No heartbeat from core client for 30 sec - exiting 17:24:14 (4640): No heartbeat from core client for 30 sec - exiting 17:24:15 (4640): No heartbeat from core client for 30 sec - exiting 17:24:16 (4640): No heartbeat from core client for 30 sec - exiting 17:24:17 (4640): No heartbeat from core client for 30 sec - exiting 23:53:47 (4980): No heartbeat from core client for 30 sec - exiting 23:53:48 (4980): No heartbeat from core client for 30 sec - exiting 23:53:49 (4980): No heartbeat from core client for 30 sec - exiting 23:53:50 (4980): No heartbeat from core client for 30 sec - exiting 23:53:51 (4980): No heartbeat from core client for 30 sec - exiting 23:53:52 (4980): No heartbeat from core client for 30 sec - exiting 23:53:53 (4980): No heartbeat from core client for 30 sec - exiting 23:53:54 (4980): No heartbeat from core client for 30 sec - exiting 23:53:56 (4980): No heartbeat from core client for 30 sec - exiting 23:53:57 (4980): No heartbeat from core client for 30 sec - exiting 23:53:58 (4980): No heartbeat from core client for 30 sec - exiting 23:53:59 (4980): No heartbeat from core client for 30 sec - exiting 23:54:00 (4980): No heartbeat from core client for 30 sec - exiting 23:54:01 (4980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:54:24 (2196): No heartbeat from core client for 30 sec - exiting 23:54:26 (2196): No heartbeat from core client for 30 sec - exiting 23:54:27 (2196): No heartbeat from core client for 30 sec - exiting 23:54:28 (2196): No heartbeat from core client for 30 sec - exiting 23:54:29 (2196): No heartbeat from core client for 30 sec - exiting 23:54:30 (2196): No heartbeat from core client for 30 sec - exiting 23:54:31 (2196): No heartbeat from core client for 30 sec - exiting 23:54:32 (2196): No heartbeat from core client for 30 sec - exiting 23:54:33 (2196): No heartbeat from core client for 30 sec - exiting 23:54:34 (2196): No heartbeat from core client for 30 sec - exiting 23:54:36 (2196): No heartbeat from core client for 30 sec - exiting 23:54:37 (2196): No heartbeat from core client for 30 sec - exiting 23:54:38 (2196): No heartbeat from core client for 30 sec - exiting 23:54:39 (2196): No heartbeat from core client for 30 sec - exiting 23:54:40 (2196): No heartbeat from core client for 30 sec - exiting 23:54:41 (2196): No heartbeat from core client for 30 sec - exiting 23:54:42 (2196): No heartbeat from core client for 30 sec - exiting 23:54:43 (2196): No heartbeat from core client for 30 sec - exiting 23:54:44 (2196): No heartbeat from core client for 30 sec - exiting 23:54:45 (2196): No heartbeat from core client for 30 sec - exiting 23:54:47 (2196): No heartbeat from core client for 30 sec - exiting 23:54:48 (2196): No heartbeat from core client for 30 sec - exiting 23:54:49 (2196): No heartbeat from core client for 30 sec - exiting 23:54:50 (2196): No heartbeat from core client for 30 sec - exiting 23:54:51 (2196): No heartbeat from core client for 30 sec - exiting 23:54:52 (2196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:57:45 (2192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:57:23 (3024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:25:13 (4460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2360, iMonCtr=1 Model crash detected, will try to restart... 23:54:49 (4876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:54:00 (1452): No heartbeat from core client for 30 sec - exiting 23:54:02 (1452): No heartbeat from core client for 30 sec - exiting 23:54:03 (1452): No heartbeat from core client for 30 sec - exiting 23:54:04 (1452): No heartbeat from core client for 30 sec - exiting 23:54:05 (1452): No heartbeat from core client for 30 sec - exiting 23:54:06 (1452): No heartbeat from core client for 30 sec - exiting 23:54:07 (1452): No heartbeat from core client for 30 sec - exiting 23:54:08 (1452): No heartbeat from core client for 30 sec - exiting 23:54:09 (1452): No heartbeat from core client for 30 sec - exiting 23:54:10 (1452): No heartbeat from core client for 30 sec - exiting 23:54:11 (1452): No heartbeat from core client for 30 sec - exiting 23:54:13 (1452): No heartbeat from core client for 30 sec - exiting 23:54:14 (1452): No heartbeat from core client for 30 sec - exiting 23:54:15 (1452): No heartbeat from core client for 30 sec - exiting 23:54:16 (1452): No heartbeat from core client for 30 sec - exiting 23:54:17 (1452): No heartbeat from core client for 30 sec - exiting 23:54:18 (1452): No heartbeat from core client for 30 sec - exiting 23:54:19 (1452): No heartbeat from core client for 30 sec - exiting 23:54:20 (1452): No heartbeat from core client for 30 sec - exiting 23:54:21 (1452): No heartbeat from core client for 30 sec - exiting 23:54:22 (1452): No heartbeat from core client for 30 sec - exiting 23:54:23 (1452): No heartbeat from core client for 30 sec - exiting 23:54:25 (1452): No heartbeat from core client for 30 sec - exiting 23:54:26 (1452): No heartbeat from core client for 30 sec - exiting 23:54:27 (1452): No heartbeat from core client for 30 sec - exiting 23:54:28 (1452): No heartbeat from core client for 30 sec - exiting 23:54:29 (1452): No heartbeat from core client for 30 sec - exiting 23:54:30 (1452): No heartbeat from core client for 30 sec - exiting 23:54:31 (1452): No heartbeat from core client for 30 sec - exiting 23:54:32 (1452): No heartbeat from core client for 30 sec - exiting 23:54:33 (1452): No heartbeat from core client for 30 sec - exiting 23:54:34 (1452): No heartbeat from core client for 30 sec - exiting 23:54:35 (1452): No heartbeat from core client for 30 sec - exiting 23:54:37 (1452): No heartbeat from core client for 30 sec - exiting 23:54:38 (1452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:57:42 (3404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4612, iMonCtr=1 Model crash detected, will try to restart... 03:49:00 (4764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:57:45 (5028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:31:21 (5088): No heartbeat from core client for 30 sec - exiting 18:31:22 (5088): No heartbeat from core client for 30 sec - exiting 18:31:23 (5088): No heartbeat from core client for 30 sec - exiting 18:31:24 (5088): No heartbeat from core client for 30 sec - exiting 18:31:26 (5088): No heartbeat from core client for 30 sec - exiting 18:31:27 (5088): No heartbeat from core client for 30 sec - exiting 18:31:28 (5088): No heartbeat from core client for 30 sec - exiting 18:31:29 (5088): No heartbeat from core client for 30 sec - exiting 18:31:30 (5088): No heartbeat from core client for 30 sec - exiting 18:31:31 (5088): No heartbeat from core client for 30 sec - exiting 18:31:32 (5088): No heartbeat from core client for 30 sec - exiting 18:31:33 (5088): No heartbeat from core client for 30 sec - exiting 18:31:34 (5088): No heartbeat from core client for 30 sec - exiting 18:31:35 (5088): No heartbeat from core client for 30 sec - exiting 18:31:36 (5088): No heartbeat from core client for 30 sec - exiting 18:31:38 (5088): No heartbeat from core client for 30 sec - exiting 18:31:39 (5088): No heartbeat from core client for 30 sec - exiting 18:31:40 (5088): No heartbeat from core client for 30 sec - exiting 18:31:41 (5088): No heartbeat from core client for 30 sec - exiting 18:31:42 (5088): No heartbeat from core client for 30 sec - exiting 18:31:43 (5088): No heartbeat from core client for 30 sec - exiting 18:31:44 (5088): No heartbeat from core client for 30 sec - exiting 18:31:45 (5088): No heartbeat from core client for 30 sec - exiting 18:31:46 (5088): No heartbeat from core client for 30 sec - exiting 18:31:47 (5088): No heartbeat from core client for 30 sec - exiting 18:31:48 (5088): No heartbeat from core client for 30 sec - exiting 18:31:50 (5088): No heartbeat from core client for 30 sec - exiting 18:31:51 (5088): No heartbeat from core client for 30 sec - exiting 18:31:52 (5088): No heartbeat from core client for 30 sec - exiting 18:31:53 (5088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:31:54 (5088): No heartbeat from core client for 30 sec - exiting 23:54:31 (1328): No heartbeat from core client for 30 sec - exiting 23:54:33 (1328): No heartbeat from core client for 30 sec - exiting 23:54:34 (1328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:54:15 (4604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:54:31 (3276): No heartbeat from core client for 30 sec - exiting 23:54:32 (3276): No heartbeat from core client for 30 sec - exiting 23:54:33 (3276): No heartbeat from core client for 30 sec - exiting 23:54:34 (3276): No heartbeat from core client for 30 sec - exiting 23:54:36 (3276): No heartbeat from core client for 30 sec - exiting 23:54:37 (3276): No heartbeat from core client for 30 sec - exiting 23:54:38 (3276): No heartbeat from core client for 30 sec - exiting 23:54:39 (3276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:58:48 (4760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4352, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 19:07:24 (2872): No heartbeat from core client for 30 sec - exiting 19:07:25 (2872): No heartbeat from core client for 30 sec - exiting 19:07:26 (2872): No heartbeat from core client for 30 sec - exiting 19:07:27 (2872): No heartbeat from core client for 30 sec - exiting 19:07:28 (2872): No heartbeat from core client for 30 sec - exiting 19:07:29 (2872): No heartbeat from core client for 30 sec - exiting 19:07:30 (2872): No heartbeat from core client for 30 sec - exiting 19:07:31 (2872): No heartbeat from core client for 30 sec - exiting 19:07:32 (2872): No heartbeat from core client for 30 sec - exiting 19:07:34 (2872): No heartbeat from core client for 30 sec - exiting 19:07:35 (2872): No heartbeat from core client for 30 sec - exiting 19:07:36 (2872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:54:43 (4488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... C21:01:22 (652): No heartbeat from core client for 30 sec - exiting 21:01:24 (652): No heartbeat from core client for 30 sec - exiting 21:01:25 (652): No heartbeat from core client for 30 sec - exiting 21:01:26 (652): No heartbeat from core client for 30 sec - exiting 21:01:27 (652): No heartbeat from core client for 30 sec - exiting 21:01:28 (652): No heartbeat from core client for 30 sec - exiting 21:01:29 (652): No heartbeat from core client for 30 sec - exiting 21:01:30 (652): No heartbeat from core client for 30 sec - exiting 21:01:32 (652): No heartbeat from core client for 30 sec - exiting 21:01:33 (652): No heartbeat from core client for 30 sec - exiting 21:01:34 (652): No heartbeat from core client for 30 sec - exiting 21:01:35 (652): No heartbeat from core client for 30 sec - exiting 21:01:36 (652): No heartbeat from core client for 30 sec - exiting 21:01:37 (652): No heartbeat from core client for 30 sec - exiting 21:01:38 (652): No heartbeat from core client for 30 sec - exiting 21:01:39 (652): No heartbeat from core client for 30 sec - exiting 21:01:40 (652): No heartbeat from core client for 30 sec - exiting 21:01:41 (652): No heartbeat from core client for 30 sec - exiting 21:01:43 (652): No heartbeat from core client for 30 sec - exiting 21:01:44 (652): No heartbeat from core client for 30 sec - exiting 21:01:45 (652): No heartbeat from core client for 30 sec - exiting 21:01:46 (652): No heartbeat from core client for 30 sec - exiting 21:01:47 (652): No heartbeat from core client for 30 sec - exiting 21:01:48 (652): No heartbeat from core client for 30 sec - exiting 21:01:49 (652): No heartbeat from core client for 30 sec - exiting 21:01:50 (652): No heartbeat from core client for 30 sec - exiting 21:01:51 (652): No heartbeat from core client for 30 sec - exiting 21:01:52 (652): No heartbeat from core client for 30 sec - exiting 21:01:54 (652): No heartbeat from core client for 30 sec - exiting 21:01:55 (652): No heartbeat from core client for 30 sec - exiting 21:01:56 (652): No heartbeat from core client for 30 sec - exiting 21:01:57 (652): No heartbeat from core client for 30 sec - exiting 21:01:58 (652): No heartbeat from core client for 30 sec - exiting 21:01:59 (652): No heartbeat from core client for 30 sec - exiting 21:02:00 (652): No heartbeat from core client for 30 sec - exiting 21:02:01 (652): No heartbeat from core client for 30 sec - exiting 21:02:02 (652): No heartbeat from core client for 30 sec - exiting 21:02:03 (652): No heartbeat from core client for 30 sec - exiting 21:02:04 (652): No heartbeat from core client for 30 sec - exiting 21:02:06 (652): No heartbeat from core client for 30 sec - exiting 21:02:07 (652): No heartbeat from core client for 30 sec - exiting 21:02:08 (652): No heartbeat from core client for 30 sec - exiting 21:02:09 (652): No heartbeat from core client for 30 sec - exiting 21:02:10 (652): No heartbeat from core client for 30 sec - exiting 21:02:11 (652): No heartbeat from core client for 30 sec - exiting 21:02:12 (652): No heartbeat from core client for 30 sec - exiting 21:02:13 (652): No heartbeat from core client for 30 sec - exiting 21:02:14 (652): No heartbeat from core client for 30 sec - exiting 21:02:15 (652): No heartbeat from core client for 30 sec - exiting 21:02:16 (652): No heartbeat from core client for 30 sec - exiting 21:02:18 (652): No heartbeat from core client for 30 sec - exiting 21:02:19 (652): No heartbeat from core client for 30 sec - exiting 21:02:20 (652): No heartbeat from core client for 30 sec - exiting 21:02:21 (652): No heartbeat from core client for 30 sec - exiting 21:02:22 (652): No heartbeat from core client for 30 sec - exiting 21:02:23 (652): No heartbeat from core client for 30 sec - exiting 21:02:24 (652): No heartbeat from core client for 30 sec - exiting 21:02:25 (652): No heartbeat from core client for 30 sec - exiting 21:02:26 (652): No heartbeat from core client for 30 sec - exiting 21:02:27 (652): No heartbeat from core client for 30 sec - exiting 21:02:29 (652): No heartbeat from core client for 30 sec - exiting 21:02:30 (652): No heartbeat from core client for 30 sec - exiting 21:02:31 (652): No heartbeat from core client for 30 sec - exiting 21:02:32 (652): No heartbeat from core client for 30 sec - exiting 21:02:33 (652): No heartbeat from core client for 30 sec - exiting 21:02:34 (652): No heartbeat from core client for 30 sec - exiting 21:02:35 (652): No heartbeat from core client for 30 sec - exiting 21:02:36 (652): No heartbeat from core client for 30 sec - exiting 21:02:37 (652): No heartbeat from core client for 30 sec - exiting 21:02:38 (652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:54:19 (912): No heartbeat from core client for 30 sec - exiting 23:54:21 (912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:54:17 (4596): No heartbeat from core client for 30 sec - exiting 23:54:18 (4596): No heartbeat from core client for 30 sec - exiting 23:54:19 (4596): No heartbeat from core client for 30 sec - exiting 23:54:20 (4596): No heartbeat from core client for 30 sec - exiting 23:54:21 (4596): No heartbeat from core client for 30 sec - exiting 23:54:22 (4596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:57:23 (5080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:57:24 (2604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:18:24 (4812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:53:51 (4952): No heartbeat from core client for 30 sec - exiting 23:53:52 (4952): No heartbeat from core client for 30 sec - exiting 23:53:53 (4952): No heartbeat from core client for 30 sec - exiting 23:53:54 (4952): No heartbeat from core client for 30 sec - exiting 23:53:55 (4952): No heartbeat from core client for 30 sec - exiting 23:53:56 (4952): No heartbeat from core client for 30 sec - exiting 23:53:57 (4952): No heartbeat from core client for 30 sec - exiting 23:53:58 (4952): No heartbeat from core client for 30 sec - exiting 23:54:00 (4952): No heartbeat from core client for 30 sec - exiting 23:54:01 (4952): No heartbeat from core client for 30 sec - exiting 23:54:02 (4952): No heartbeat from core client for 30 sec - exiting 23:54:03 (4952): No heartbeat from core client for 30 sec - exiting 23:54:04 (4952): No heartbeat from core client for 30 sec - exiting 23:54:05 (4952): No heartbeat from core client for 30 sec - exiting 23:54:06 (4952): No heartbeat from core client for 30 sec - exiting 23:54:07 (4952): No heartbeat from core client for 30 sec - exiting 23:54:08 (4952): No heartbeat from core client for 30 sec - exiting 23:54:09 (4952): No heartbeat from core client for 30 sec - exiting 23:54:10 (4952): No heartbeat from core client for 30 sec - exiting 23:54:12 (4952): No heartbeat from core client for 30 sec - exiting 23:54:13 (4952): No heartbeat from core client for 30 sec - exiting 23:54:14 (4952): No heartbeat from core client for 30 sec - exiting 23:54:15 (4952): No heartbeat from core client for 30 sec - exiting 23:54:16 (4952): No heartbeat from core client for 30 sec - exiting 23:54:17 (4952): No heartbeat from core client for 30 sec - exiting 23:54:18 (4952): No heartbeat from core client for 30 sec - exiting 23:54:19 (4952): No heartbeat from core client for 30 sec - exiting 23:54:20 (4952): No heartbeat from core client for 30 sec - exiting 23:54:21 (4952): No heartbeat from core client for 30 sec - exiting 23:54:22 (4952): No heartbeat from core client for 30 sec - exiting 23:54:24 (4952): No heartbeat from core client for 30 sec - exiting 23:54:25 (4952): No heartbeat from core client for 30 sec - exiting 23:54:26 (4952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:54:27 (4952): No heartbeat from core client for 30 sec - exiting 23:54:28 (4952): No heartbeat from core client for 30 sec - exiting 23:54:29 (4952): No heartbeat from core client for 30 sec - exiting 23:54:30 (4952): No heartbeat from core client for 30 sec - exiting 23:54:31 (4952): No heartbeat from core client for 30 sec - exiting 16:27:20 (4368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:54:50 (4368): No heartbeat from core client for 30 sec - exiting 23:54:51 (4368): No heartbeat from core client for 30 sec - exiting 23:54:52 (4368): No heartbeat from core client for 30 sec - exiting 23:54:53 (4368): No heartbeat from core client for 30 sec - exiting 23:54:54 (4368): No heartbeat from core client for 30 sec - exiting 23:54:56 (4368): No heartbeat from core client for 30 sec - exiting 23:54:57 (4368): No heartbeat from core client for 30 sec - exiting 23:54:58 (4368): No heartbeat from core client for 30 sec - exiting 23:54:59 (4368): No heartbeat from core client for 30 sec - exiting 23:55:00 (4368): No heartbeat from core client for 30 sec - exiting 23:55:01 (4368): No heartbeat from core client for 30 sec - exiting 23:55:02 (4368): No heartbeat from core client for 30 sec - exiting 23:55:03 (4368): No heartbeat from core client for 30 sec - exiting 23:55:04 (4368): No heartbeat from core client for 30 sec - exiting 23:55:05 (4368): No heartbeat from core client for 30 sec - exiting 23:55:06 (4368): No heartbeat from core client for 30 sec - exiting 23:55:08 (4368): No heartbeat from core client for 30 sec - exiting 23:55:09 (4368): No heartbeat from core client for 30 sec - exiting 23:55:10 (4368): No heartbeat from core client for 30 sec - exiting 23:55:11 (4368): No heartbeat from core client for 30 sec - exiting 23:55:12 (4368): No heartbeat from core client for 30 sec - exiting 23:55:13 (4368): No heartbeat from core client for 30 sec - exiting 23:55:14 (4368): No heartbeat from core client for 30 sec - exiting 23:55:15 (4368): No heartbeat from core client for 30 sec - exiting 23:55:16 (4368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:57:34 (4712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:54:17 (4848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4608, iMonCtr=1 Model crash detected, will try to restart... 19:21:45 (4960): No heartbeat from core client for 30 sec - exiting 19:21:47 (4960): No heartbeat from core client for 30 sec - exiting 19:21:48 (4960): No heartbeat from core client for 30 sec - exiting 19:21:49 (4960): No heartbeat from core client for 30 sec - exiting 19:21:50 (4960): No heartbeat from core client for 30 sec - exiting 19:21:51 (4960): No heartbeat from core client for 30 sec - exiting 19:21:52 (4960): No heartbeat from core client for 30 sec - exiting 19:21:53 (4960): No heartbeat from core client for 30 sec - exiting 19:21:54 (4960): No heartbeat from core client for 30 sec - exiting 19:21:55 (4960): No heartbeat from core client for 30 sec - exiting 19:21:56 (4960): No heartbeat from core client for 30 sec - exiting 19:21:57 (4960): No heartbeat from core client for 30 sec - exiting 19:21:59 (4960): No heartbeat from core client for 30 sec - exiting 19:22:00 (4960): No heartbeat from core client for 30 sec - exiting 19:22:01 (4960): No heartbeat from core client for 30 sec - exiting 19:22:02 (4960): No heartbeat from core client for 30 sec - exiting 19:22:03 (4960): No heartbeat from core client for 30 sec - exiting 19:22:04 (4960): No heartbeat from core client for 30 sec - exiting 19:22:05 (4960): No heartbeat from core client for 30 sec - exiting 19:22:06 (4960): No heartbeat from core client for 30 sec - exiting 19:22:07 (4960): No heartbeat from core client for 30 sec - exiting 19:22:08 (4960): No heartbeat from core client for 30 sec - exiting 19:22:09 (4960): No heartbeat from core client for 30 sec - exiting 19:22:11 (4960): No heartbeat from core client for 30 sec - exiting 19:22:12 (4960): No heartbeat from core client for 30 sec - exiting 19:22:13 (4960): No heartbeat from core client for 30 sec - exiting 19:22:14 (4960): No heartbeat from core client for 30 sec - exiting 19:22:15 (4960): No heartbeat from core client for 30 sec - exiting 19:22:16 (4960): No heartbeat from core client for 30 sec - exiting 19:22:17 (4960): No heartbeat from core client for 30 sec - exiting 19:22:18 (4960): No heartbeat from core client for 30 sec - exiting 19:22:19 (4960): No heartbeat from core client for 30 sec - exiting 19:22:20 (4960): No heartbeat from core client for 30 sec - exiting 19:22:21 (4960): No heartbeat from core client for 30 sec - exiting 19:22:23 (4960): No heartbeat from core client for 30 sec - exiting 19:22:24 (4960): No heartbeat from core client for 30 sec - exiting 19:22:25 (4960): No heartbeat from core client for 30 sec - exiting 19:22:26 (4960): No heartbeat from core client for 30 sec - exiting 19:22:27 (4960): No heartbeat from core client for 30 sec - exiting 19:22:28 (4960): No heartbeat from core client for 30 sec - exiting 19:22:29 (4960): No heartbeat from core client for 30 sec - exiting 19:22:30 (4960): No heartbeat from core client for 30 sec - exiting 19:22:31 (4960): No heartbeat from core client for 30 sec - exiting 19:22:32 (4960): No heartbeat from core client for 30 sec - exiting 19:22:33 (4960): No heartbeat from core client for 30 sec - exiting 19:22:35 (4960): No heartbeat from core client for 30 sec - exiting 19:22:36 (4960): No heartbeat from core client for 30 sec - exiting 19:22:37 (4960): No heartbeat from core client for 30 sec - exiting 19:22:38 (4960): No heartbeat from core client for 30 sec - exiting 19:22:39 (4960): No heartbeat from core client for 30 sec - exiting 19:22:40 (4960): No heartbeat from core client for 30 sec - exiting 19:22:41 (4960): No heartbeat from core client for 30 sec - exiting 19:22:42 (4960): No heartbeat from core client for 30 sec - exiting 19:22:43 (4960): No heartbeat from core client for 30 sec - exiting 19:22:44 (4960): No heartbeat from core client for 30 sec - exiting 19:22:45 (4960): No heartbeat from core client for 30 sec - exiting 19:22:47 (4960): No heartbeat from core client for 30 sec - exiting 19:22:48 (4960): No heartbeat from core client for 30 sec - exiting 19:22:49 (4960): No heartbeat from core client for 30 sec - exiting 19:22:50 (4960): No heartbeat from core client for 30 sec - exiting 19:22:51 (4960): No heartbeat from core client for 30 sec - exiting 19:22:52 (4960): No heartbeat from core client for 30 sec - exiting 19:22:53 (4960): No heartbeat from core client for 30 sec - exiting 19:22:54 (4960): No heartbeat from core client for 30 sec - exiting 19:22:55 (4960): No heartbeat from core client for 30 sec - exiting 19:22:56 (4960): No heartbeat from core client for 30 sec - exiting 19:22:58 (4960): No heartbeat from core client for 30 sec - exiting 19:22:59 (4960): No heartbeat from core client for 30 sec - exiting 19:23:00 (4960): No heartbeat from core client for 30 sec - exiting 19:23:01 (4960): No heartbeat from core client for 30 sec - exiting 19:23:02 (4960): No heartbeat from core client for 30 sec - exiting 19:23:03 (4960): No heartbeat from core client for 30 sec - exiting 19:23:04 (4960): No heartbeat from core client for 30 sec - exiting 19:23:05 (4960): No heartbeat from core client for 30 sec - exiting 19:23:06 (4960): No heartbeat from core client for 30 sec - exiting 19:23:07 (4960): No heartbeat from core client for 30 sec - exiting 19:23:09 (4960): No heartbeat from core client for 30 sec - exiting 19:23:10 (4960): No heartbeat from core client for 30 sec - exiting 19:23:11 (4960): No heartbeat from core client for 30 sec - exiting 19:23:12 (4960): No heartbeat from core client for 30 sec - exiting 19:23:13 (4960): No heartbeat from core client for 30 sec - exiting 19:23:14 (4960): No heartbeat from core client for 30 sec - exiting 19:23:15 (4960): No heartbeat from core client for 30 sec - exiting 19:23:16 (4960): No heartbeat from core client for 30 sec - exiting 19:23:17 (4960): No heartbeat from core client for 30 sec - exiting 19:23:18 (4960): No heartbeat from core client for 30 sec - exiting 19:23:20 (4960): No heartbeat from core client for 30 sec - exiting 19:23:21 (4960): No heartbeat from core client for 30 sec - exiting 19:23:22 (4960): No heartbeat from core client for 30 sec - exiting 19:23:23 (4960): No heartbeat from core client for 30 sec - exiting 19:23:24 (4960): No heartbeat from core client for 30 sec - exiting 19:23:25 (4960): No heartbeat from core client for 30 sec - exiting 19:23:26 (4960): No heartbeat from core client for 30 sec - exiting 19:23:27 (4960): No heartbeat from core client for 30 sec - exiting 19:23:28 (4960): No heartbeat from core client for 30 sec - exiting 19:23:29 (4960): No heartbeat from core client for 30 sec - exiting 19:23:31 (4960): No heartbeat from core client for 30 sec - exiting 19:23:32 (4960): No heartbeat from core client for 30 sec - exiting 19:23:33 (4960): No heartbeat from core client for 30 sec - exiting 19:23:34 (4960): No heartbeat from core client for 30 sec - exiting 19:23:35 (4960): No heartbeat from core client for 30 sec - exiting 19:23:36 (4960): No heartbeat from core client for 30 sec - exiting 19:23:37 (4960): No heartbeat from core client for 30 sec - exiting 19:23:38 (4960): No heartbeat from core client for 30 sec - exiting 19:23:39 (4960): No heartbeat from core client for 30 sec - exiting 19:23:40 (4960): No heartbeat from core client for 30 sec - exiting 19:23:41 (4960): No heartbeat from core client for 30 sec - exiting 19:23:43 (4960): No heartbeat from core client for 30 sec - exiting 19:23:44 (4960): No heartbeat from core client for 30 sec - exiting 19:23:45 (4960): No heartbeat from core client for 30 sec - exiting 19:23:46 (4960): No heartbeat from core client for 30 sec - exiting 19:23:47 (4960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:23:48 (4960): No heartbeat from core client for 30 sec - exiting C23:53:51 (5080): No heartbeat from core client for 30 sec - exiting 23:53:52 (5080): No heartbeat from core client for 30 sec - exiting 23:53:53 (5080): No heartbeat from core client for 30 sec - exiting 23:53:54 (5080): No heartbeat from core client for 30 sec - exiting 23:53:55 (5080): No heartbeat from core client for 30 sec - exiting 23:53:56 (5080): No heartbeat from core client for 30 sec - exiting 23:53:57 (5080): No heartbeat from core client for 30 sec - exiting 23:53:59 (5080): No heartbeat from core client for 30 sec - exiting 23:54:00 (5080): No heartbeat from core client for 30 sec - exiting 23:54:01 (5080): No heartbeat from core client for 30 sec - exiting 23:54:02 (5080): No heartbeat from core client for 30 sec - exiting 23:54:03 (5080): No heartbeat from core client for 30 sec - exiting 23:54:04 (5080): No heartbeat from core client for 30 sec - exiting 23:54:05 (5080): No heartbeat from core client for 30 sec - exiting 23:54:06 (5080): No heartbeat from core client for 30 sec - exiting 23:54:07 (5080): No heartbeat from core client for 30 sec - exiting 23:54:08 (5080): No heartbeat from core client for 30 sec - exiting 23:54:09 (5080): No heartbeat from core client for 30 sec - exiting 23:54:11 (5080): No heartbeat from core client for 30 sec - exiting 23:54:12 (5080): No heartbeat from core client for 30 sec - exiting 23:54:13 (5080): No heartbeat from core client for 30 sec - exiting 23:54:14 (5080): No heartbeat from core client for 30 sec - exiting 23:54:15 (5080): No heartbeat from core client for 30 sec - exiting 23:54:16 (5080): No heartbeat from core client for 30 sec - exiting 23:54:17 (5080): No heartbeat from core client for 30 sec - exiting 23:54:18 (5080): No heartbeat from core client for 30 sec - exiting 23:54:19 (5080): No heartbeat from core client for 30 sec - exiting 23:54:20 (5080): No heartbeat from core client for 30 sec - exiting 23:54:21 (5080): No heartbeat from core client for 30 sec - exiting 23:54:23 (5080): No heartbeat from core client for 30 sec - exiting 23:54:24 (5080): No heartbeat from core client for 30 sec - exiting 23:54:25 (5080): No heartbeat from core client for 30 sec - exiting 23:54:26 (5080): No heartbeat from core client for 30 sec - exiting 23:54:27 (5080): No heartbeat from core client for 30 sec - exiting 23:54:28 (5080): No heartbeat from core client for 30 sec - exiting 23:54:29 (5080): No heartbeat from core client for 30 sec - exiting 23:54:30 (5080): No heartbeat from core client for 30 sec - exiting 23:54:31 (5080): No heartbeat from core client for 30 sec - exiting 23:54:32 (5080): No heartbeat from core client for 30 sec - exiting 23:54:34 (5080): No heartbeat from core client for 30 sec - exiting 23:54:35 (5080): No heartbeat from core client for 30 sec - exiting 23:54:36 (5080): No heartbeat from core client for 30 sec - exiting 23:54:37 (5080): No heartbeat from core client for 30 sec - exiting 23:54:38 (5080): No heartbeat from core client for 30 sec - exiting 23:54:39 (5080): No heartbeat from core client for 30 sec - exiting 23:54:40 (5080): No heartbeat from core client for 30 sec - exiting 23:54:41 (5080): No heartbeat from core client for 30 sec - exiting 23:54:42 (5080): No heartbeat from core client for 30 sec - exiting 23:54:43 (5080): No heartbeat from core client for 30 sec - exiting 23:54:44 (5080): No heartbeat from core client for 30 sec - exiting 23:54:46 (5080): No heartbeat from core client for 30 sec - exiting 23:54:47 (5080): No heartbeat from core client for 30 sec - exiting 23:54:48 (5080): No heartbeat from core client for 30 sec - exiting 23:54:49 (5080): No heartbeat from core client for 30 sec - exiting 23:54:50 (5080): No heartbeat from core client for 30 sec - exiting 23:54:51 (5080): No heartbeat from core client for 30 sec - exiting 23:54:52 (5080): No heartbeat from core client for 30 sec - exiting 23:54:53 (5080): No heartbeat from core client for 30 sec - exiting 23:54:54 (5080): No heartbeat from core client for 30 sec - exiting 23:54:55 (5080): No heartbeat from core client for 30 sec - exiting 23:54:56 (5080): No heartbeat from core client for 30 sec - exiting 23:54:58 (5080): No heartbeat from core client for 30 sec - exiting 23:54:59 (5080): No heartbeat from core client for 30 sec - exiting 23:55:00 (5080): No heartbeat from core client for 30 sec - exiting 23:55:01 (5080): No heartbeat from core client for 30 sec - exiting 23:55:02 (5080): No heartbeat from core client for 30 sec - exiting 23:55:03 (5080): No heartbeat from core client for 30 sec - exiting 23:55:04 (5080): No heartbeat from core client for 30 sec - exiting 23:55:05 (5080): No heartbeat from core client for 30 sec - exiting 23:55:06 (5080): No heartbeat from core client for 30 sec - exiting 23:55:07 (5080): No heartbeat from core client for 30 sec - exiting 23:55:08 (5080): No heartbeat from core client for 30 sec - exiting 23:55:10 (5080): No heartbeat from core client for 30 sec - exiting 23:55:11 (5080): No heartbeat from core client for 30 sec - exiting 23:55:12 (5080): No heartbeat from core client for 30 sec - exiting 23:55:13 (5080): No heartbeat from core client for 30 sec - exiting 23:55:14 (5080): No heartbeat from core client for 30 sec - exiting 23:55:15 (5080): No heartbeat from core client for 30 sec - exiting 23:55:16 (5080): No heartbeat from core client for 30 sec - exiting 23:55:17 (5080): No heartbeat from core client for 30 sec - exiting 23:55:18 (5080): No heartbeat from core client for 30 sec - exiting 23:55:19 (5080): No heartbeat from core client for 30 sec - exiting 23:55:21 (5080): No heartbeat from core client for 30 sec - exiting 23:55:22 (5080): No heartbeat from core client for 30 sec - exiting 23:55:23 (5080): No heartbeat from core client for 30 sec - exiting 23:55:24 (5080): No heartbeat from core client for 30 sec - exiting 23:55:25 (5080): No heartbeat from core client for 30 sec - exiting 23:55:26 (5080): No heartbeat from core client for 30 sec - exiting 23:55:27 (5080): No heartbeat from core client for 30 sec - exiting 23:55:28 (5080): No heartbeat from core client for 30 sec - exiting 23:55:29 (5080): No heartbeat from core client for 30 sec - exiting 23:55:30 (5080): No heartbeat from core client for 30 sec - exiting 23:55:31 (5080): No heartbeat from core client for 30 sec - exiting 23:55:33 (5080): No heartbeat from core client for 30 sec - exiting 23:55:34 (5080): No heartbeat from core client for 30 sec - exiting 23:55:35 (5080): No heartbeat from core client for 30 sec - exiting 23:55:36 (5080): No heartbeat from core client for 30 sec - exiting 23:55:37 (5080): No heartbeat from core client for 30 sec - exiting 23:55:38 (5080): No heartbeat from core client for 30 sec - exiting 23:55:39 (5080): No heartbeat from core client for 30 sec - exiting 23:55:40 (5080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77720BB0 read attempt to address 0x00006634 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Feb 2012 18:48:23	943197	13663627	hadcm3n_u0cy_1980_40_007458010_4	1,036,800	1,733,377	1.6719
02 Feb 2012 00:59:18	943197	13663627	hadcm3n_u0cy_1980_40_007458010_4	1,010,880	1,687,844	1.6697
30 Jan 2012 03:22:36	943197	13663627	hadcm3n_u0cy_1980_40_007458010_4	984,960	1,643,046	1.6681
28 Jan 2012 11:15:20	943197	13663627	hadcm3n_u0cy_1980_40_007458010_4	959,040	1,598,108	1.6664
27 Jan 2012 00:24:21	943197	13663627	hadcm3n_u0cy_1980_40_007458010_4	933,120	1,553,588	1.6649
25 Jan 2012 04:31:45	943197	13663627	hadcm3n_u0cy_1980_40_007458010_4	907,200	1,508,492	1.6628
22 Jan 2012 07:10:52	943197	13663627	hadcm3n_u0cy_1980_40_007458010_4	881,280	1,463,460	1.6606
20 Jan 2012 05:24:03	943197	13663627	hadcm3n_u0cy_1980_40_007458010_4	855,360	1,417,900	1.6577
18 Jan 2012 07:53:59	943197	13663627	hadcm3n_u0cy_1980_40_007458010_4	829,440	1,373,109	1.6555
16 Jan 2012 20:25:08	943197	13663627	hadcm3n_u0cy_1980_40_007458010_4	803,520	1,328,169	1.6529
15 Jan 2012 02:24:08	943197	13663627	hadcm3n_u0cy_1980_40_007458010_4	777,600	1,283,364	1.6504
13 Jan 2012 05:42:00	943197	13663627	hadcm3n_u0cy_1980_40_007458010_4	751,680	1,238,223	1.6473
11 Jan 2012 06:18:22	943197	13663627	hadcm3n_u0cy_1980_40_007458010_4	725,760	1,193,243	1.6441
10 Jan 2012 03:07:06	943197	13663627	hadcm3n_u0cy_1980_40_007458010_4	699,840	1,156,537	1.6526
08 Jan 2012 10:15:10	943197	13663627	hadcm3n_u0cy_1980_40_007458010_4	673,920	1,111,982	1.6500
07 Jan 2012 18:50:04	943197	13663627	hadcm3n_u0cy_1980_40_007458010_4	648,000	1,067,363	1.6472
07 Jan 2012 01:40:45	943197	13663627	hadcm3n_u0cy_1980_40_007458010_4	622,080	1,022,445	1.6436
05 Jan 2012 03:33:14	943197	13663627	hadcm3n_u0cy_1980_40_007458010_4	596,160	976,962	1.6388
02 Jan 2012 17:11:51	943197	13663627	hadcm3n_u0cy_1980_40_007458010_4	570,240	932,179	1.6347
31 Dec 2011 05:40:42	943197	13663627	hadcm3n_u0cy_1980_40_007458010_4	544,320	889,613	1.6344