Task 17409794

Name	hadcm3n_8erx_1980_40_008728568_3
Workunit	8874546
Created	14 Nov 2014, 3:42:43 UTC
Sent	14 Nov 2014, 3:42:59 UTC
Report deadline	13 Feb 2015, 11:10:10 UTC
Received	17 Jan 2015, 12:40:58 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	25 (0x00000019) Unknown error code
Computer ID	1293894
Run time	15 days 21 hours 9 min 24 sec
CPU time	12 days 14 hours 53 min 9 sec
Validate state	Invalid
Credit	8,709.12
Device peak FLOPS	3.04 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.47</core_client_version> <![CDATA[ <message> The drive cannot locate a specific area or track on the disk. (0x19) - exit code 25 (0x19) </message> <stderr_txt> MonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 02:57:19 (3220): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 02:57:21 (3220): No heartbeat from core client for 30 sec - exiting 02:57:22 (3220): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:44:45 (2680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:44:46 (2680): No heartbeat from core client for 30 sec - exiting 12:44:47 (2680): No heartbeat from core client for 30 sec - exiting 12:44:48 (2680): No heartbeat from core client for 30 sec - exiting 12:44:49 (2680): No heartbeat from core client for 30 sec - exiting 12:44:50 (2680): No heartbeat from core client for 30 sec - exiting 12:49:37 (2948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:53:43 (2596): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:54:44 (1504): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 17:54:46 (1504): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 23:09:17 (512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:09:18 (512): No heartbeat from core client for 30 sec - exiting 23:09:19 (512): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 00:10:12 (3824): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:55:51 (4000): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 03:55:52 (4000): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:11:04 (1556): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 12:11:06 (1556): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:24:39 (2856): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:50:49 (2616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:50:50 (2616): No heartbeat from core client for 30 sec - exiting 13:50:51 (2616): No heartbeat from core client for 30 sec - exiting 13:50:53 (2616): No heartbeat from core client for 30 sec - exiting 13:51:54 (3080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:47:46 (2788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:47:48 (2788): No heartbeat from core client for 30 sec - exiting 22:48:26 (2416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:28:43 (3116): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 02:28:45 (3116): No heartbeat from core client for 30 sec - exiting 09:07:53 (3224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:08:44 (2816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:42:49 (1820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:43:04 (1820): No heartbeat from core client for 30 sec - exiting 11:43:06 (1820): No heartbeat from core client for 30 sec - exiting 11:43:14 (1820): No heartbeat from core client for 30 sec - exiting 11:43:21 (1820): No heartbeat from core client for 30 sec - exiting 11:43:35 (1820): No heartbeat from core client for 30 sec - exiting 11:43:43 (1820): No heartbeat from core client for 30 sec - exiting 11:43:50 (1820): No heartbeat from core client for 30 sec - exiting 11:43:52 (1820): No heartbeat from core client for 30 sec - exiting 11:43:59 (1820): No heartbeat from core client for 30 sec - exiting 11:44:05 (1820): No heartbeat from core client for 30 sec - exiting 11:44:14 (1820): No heartbeat from core client for 30 sec - exiting 11:44:21 (1820): No heartbeat from core client for 30 sec - exiting 11:44:27 (1820): No heartbeat from core client for 30 sec - exiting 11:44:29 (1820): No heartbeat from core client for 30 sec - exiting 11:44:36 (1820): No heartbeat from core client for 30 sec - exiting 11:44:42 (1820): No heartbeat from core client for 30 sec - exiting 11:44:50 (1820): No heartbeat from core client for 30 sec - exiting 11:44:58 (1820): No heartbeat from core client for 30 sec - exiting 12:23:14 (212): No heartbeat from core client for 30 sec - exiting 12:23:32 (212): No heartbeat from core client for 30 sec - exiting 12:23:39 (212): No heartbeat from core client for 30 sec - exiting 12:24:07 (212): No heartbeat from core client for 30 sec - exiting 12:24:14 (212): No heartbeat from core client for 30 sec - exiting 12:27:21 (212): No heartbeat from core client for 30 sec - exiting 12:27:27 (212): No heartbeat from core client for 30 sec - exiting 12:27:34 (212): No heartbeat from core client for 30 sec - exiting 12:27:42 (212): No heartbeat from core client for 30 sec - exiting 12:27:56 (212): No heartbeat from core client for 30 sec - exiting 12:27:57 (212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:14:41 (4052): No heartbeat from core client for 30 sec - exiting 04:14:50 (4052): No heartbeat from core client for 30 sec - exiting 04:14:58 (4052): No heartbeat from core client for 30 sec - exiting 04:15:05 (4052): No heartbeat from core client for 30 sec - exiting 04:15:11 (4052): No heartbeat from core client for 30 sec - exiting 04:15:24 (4052): No heartbeat from core client for 30 sec - exiting 04:15:26 (4052): No heartbeat from core client for 30 sec - exiting 04:15:32 (4052): No heartbeat from core client for 30 sec - exiting 04:15:43 (4052): No heartbeat from core client for 30 sec - exiting 04:15:50 (4052): No heartbeat from core client for 30 sec - exiting 04:15:57 (4052): No heartbeat from core client for 30 sec - exiting 04:16:04 (4052): No heartbeat from core client for 30 sec - exiting 04:16:10 (4052): No heartbeat from core client for 30 sec - exiting 04:16:17 (4052): No heartbeat from core client for 30 sec - exiting 04:16:19 (4052): No heartbeat from core client for 30 sec - exiting 04:16:25 (4052): No heartbeat from core client for 30 sec - exiting 04:16:33 (4052): No heartbeat from core client for 30 sec - exiting 04:16:53 (4052): No heartbeat from core client for 30 sec - exiting 04:16:59 (4052): No heartbeat from core client for 30 sec - exiting 04:17:07 (4052): No heartbeat from core client for 30 sec - exiting 04:17:09 (4052): No heartbeat from core client for 30 sec - exiting 04:17:16 (4052): No heartbeat from core client for 30 sec - exiting 04:17:24 (4052): No heartbeat from core client for 30 sec - exiting 04:17:31 (4052): No heartbeat from core client for 30 sec - exiting 04:17:37 (4052): No heartbeat from core client for 30 sec - exiting 04:17:45 (4052): No heartbeat from core client for 30 sec - exiting 04:17:47 (4052): No heartbeat from core client for 30 sec - exiting 04:17:54 (4052): No heartbeat from core client for 30 sec - exiting 04:18:12 (4052): No heartbeat from core client for 30 sec - exiting 04:18:20 (4052): No heartbeat from core client for 30 sec - exiting 04:18:26 (4052): No heartbeat from core client for 30 sec - exiting 04:18:34 (4052): No heartbeat from core client for 30 sec - exiting 04:18:49 (4052): No heartbeat from core client for 30 sec - exiting 04:18:51 (4052): No heartbeat from core client for 30 sec - exiting 04:18:57 (4052): No heartbeat from core client for 30 sec - exiting 04:19:05 (4052): No heartbeat from core client for 30 sec - exiting 04:19:12 (4052): No heartbeat from core client for 30 sec - exiting 04:19:18 (4052): No heartbeat from core client for 30 sec - exiting 04:19:25 (4052): No heartbeat from core client for 30 sec - exiting 04:19:27 (4052): No heartbeat from core client for 30 sec - exiting 04:19:34 (4052): No heartbeat from core client for 30 sec - exiting 04:19:42 (4052): No heartbeat from core client for 30 sec - exiting 04:19:49 (4052): No heartbeat from core client for 30 sec - exiting 04:19:57 (4052): No heartbeat from core client for 30 sec - exiting 04:20:04 (4052): No heartbeat from core client for 30 sec - exiting 04:20:16 (4052): No heartbeat from core client for 30 sec - exiting 04:20:18 (4052): No heartbeat from core client for 30 sec - exiting 04:20:24 (4052): No heartbeat from core client for 30 sec - exiting 04:20:32 (4052): No heartbeat from core client for 30 sec - exiting 04:20:39 (4052): No heartbeat from core client for 30 sec - exiting 04:20:45 (4052): No heartbeat from core client for 30 sec - exiting 04:20:52 (4052): No heartbeat from core client for 30 sec - exiting 04:20:54 (4052): No heartbeat from core client for 30 sec - exiting 04:21:01 (4052): No heartbeat from core client for 30 sec - exiting 04:21:08 (4052): No heartbeat from core client for 30 sec - exiting 04:21:16 (4052): No heartbeat from core client for 30 sec - exiting 04:21:22 (4052): No heartbeat from core client for 30 sec - exiting 04:21:30 (4052): No heartbeat from core client for 30 sec - exiting 04:21:32 (4052): No heartbeat from core client for 30 sec - exiting 04:21:39 (4052): No heartbeat from core client for 30 sec - exiting 04:21:46 (4052): No heartbeat from core client for 30 sec - exiting 04:21:53 (4052): No heartbeat from core client for 30 sec - exiting 04:22:19 (4052): No heartbeat from core client for 30 sec - exiting 04:22:32 (4052): No heartbeat from core client for 30 sec - exiting 04:22:38 (4052): No heartbeat from core client for 30 sec - exiting 04:22:46 (4052): No heartbeat from core client for 30 sec - exiting 04:22:48 (4052): No heartbeat from core client for 30 sec - exiting 04:22:54 (4052): No heartbeat from core client for 30 sec - exiting 04:23:01 (4052): No heartbeat from core client for 30 sec - exiting 04:23:09 (4052): No heartbeat from core client for 30 sec - exiting 04:23:15 (4052): No heartbeat from core client for 30 sec - exiting 04:23:22 (4052): No heartbeat from core client for 30 sec - exiting 04:23:24 (4052): No heartbeat from core client for 30 sec - exiting 04:23:31 (4052): No heartbeat from core client for 30 sec - exiting 04:24:44 (4052): No heartbeat from core client for 30 sec - exiting 04:24:51 (4052): No heartbeat from core client for 30 sec - exiting 04:24:59 (4052): No heartbeat from core client for 30 sec - exiting 04:25:07 (4052): No heartbeat from core client for 30 sec - exiting 04:25:14 (4052): No heartbeat from core client for 30 sec - exiting 04:25:53 (4052): No heartbeat from core client for 30 sec - exiting 04:26:42 (4052): No heartbeat from core client for 30 sec - exiting 04:26:48 (4052): No heartbeat from core client for 30 sec - exiting 04:26:56 (4052): No heartbeat from core client for 30 sec - exiting 04:27:14 (4052): No heartbeat from core client for 30 sec - exiting 04:27:39 (4052): No heartbeat from core client for 30 sec - exiting 04:28:02 (4052): No heartbeat from core client for 30 sec - exiting 04:28:09 (4052): No heartbeat from core client for 30 sec - exiting 04:28:11 (4052): No heartbeat from core client for 30 sec - exiting 04:28:18 (4052): No heartbeat from core client for 30 sec - exiting 04:28:25 (4052): No heartbeat from core client for 30 sec - exiting 04:28:33 (4052): No heartbeat from core client for 30 sec - exiting 04:28:39 (4052): No heartbeat from core client for 30 sec - exiting 04:28:46 (4052): No heartbeat from core client for 30 sec - exiting 04:28:48 (4052): No heartbeat from core client for 30 sec - exiting 04:28:54 (4052): No heartbeat from core client for 30 sec - exiting 04:29:01 (4052): No heartbeat from core client for 30 sec - exiting 04:29:08 (4052): No heartbeat from core client for 30 sec - exiting 04:29:15 (4052): No heartbeat from core client for 30 sec - exiting 04:29:22 (4052): No heartbeat from core client for 30 sec - exiting 04:29:24 (4052): No heartbeat from core client for 30 sec - exiting 04:29:31 (4052): No heartbeat from core client for 30 sec - exiting 04:29:52 (4052): No heartbeat from core client for 30 sec - exiting 04:29:59 (4052): No heartbeat from core client for 30 sec - exiting 04:30:07 (4052): No heartbeat from core client for 30 sec - exiting 04:30:13 (4052): No heartbeat from core client for 30 sec - exiting 04:30:20 (4052): No heartbeat from core client for 30 sec - exiting 04:30:22 (4052): No heartbeat from core client for 30 sec - exiting 04:30:29 (4052): No heartbeat from core client for 30 sec - exiting 04:30:36 (4052): No heartbeat from core client for 30 sec - exiting 04:30:43 (4052): No heartbeat from core client for 30 sec - exiting 04:30:50 (4052): No heartbeat from core client for 30 sec - exiting 04:30:57 (4052): No heartbeat from core client for 30 sec - exiting 04:30:59 (4052): No heartbeat from core client for 30 sec - exiting 04:31:05 (4052): No heartbeat from core client for 30 sec - exiting 04:31:14 (4052): No heartbeat from core client for 30 sec - exiting 04:31:21 (4052): No heartbeat from core client for 30 sec - exiting 04:31:34 (4052): No heartbeat from core client for 30 sec - exiting 04:31:42 (4052): No heartbeat from core client for 30 sec - exiting 04:31:44 (4052): No heartbeat from core client for 30 sec - exiting 04:31:51 (4052): No heartbeat from core client for 30 sec - exiting 04:31:58 (4052): No heartbeat from core client for 30 sec - exiting 04:32:06 (4052): No heartbeat from core client for 30 sec - exiting 04:32:12 (4052): No heartbeat from core client for 30 sec - exiting 04:32:20 (4052): No heartbeat from core client for 30 sec - exiting 04:32:22 (4052): No heartbeat from core client for 30 sec - exiting 04:32:30 (4052): No heartbeat from core client for 30 sec - exiting 04:32:38 (4052): No heartbeat from core client for 30 sec - exiting 04:32:46 (4052): No heartbeat from core client for 30 sec - exiting 04:32:53 (4052): No heartbeat from core client for 30 sec - exiting 04:33:01 (4052): No heartbeat from core client for 30 sec - exiting 04:33:03 (4052): No heartbeat from core client for 30 sec - exiting 04:33:10 (4052): No heartbeat from core client for 30 sec - exiting 04:33:46 (4052): No heartbeat from core client for 30 sec - exiting 04:33:53 (4052): No heartbeat from core client for 30 sec - exiting 04:34:01 (4052): No heartbeat from core client for 30 sec - exiting 04:34:08 (4052): No heartbeat from core client for 30 sec - exiting 04:34:15 (4052): No heartbeat from core client for 30 sec - exiting 04:34:17 (4052): No heartbeat from core client for 30 sec - exiting 04:34:24 (4052): No heartbeat from core client for 30 sec - exiting 04:34:31 (4052): No heartbeat from core client for 30 sec - exiting 04:34:37 (4052): No heartbeat from core client for 30 sec - exiting 04:34:44 (4052): No heartbeat from core client for 30 sec - exiting 04:34:51 (4052): No heartbeat from core client for 30 sec - exiting 04:34:52 (4052): No heartbeat from core client for 30 sec - exiting 04:34:59 (4052): No heartbeat from core client for 30 sec - exiting 04:35:07 (4052): No heartbeat from core client for 30 sec - exiting 04:35:14 (4052): No heartbeat from core client for 30 sec - exiting 04:35:21 (4052): No heartbeat from core client for 30 sec - exiting 04:35:52 (4052): No heartbeat from core client for 30 sec - exiting 04:35:54 (4052): No heartbeat from core client for 30 sec - exiting 04:36:00 (4052): No heartbeat from core client for 30 sec - exiting 04:36:08 (4052): No heartbeat from core client for 30 sec - exiting 04:36:16 (4052): No heartbeat from core client for 30 sec - exiting 04:36:22 (4052): No heartbeat from core client for 30 sec - exiting 04:36:29 (4052): No heartbeat from core client for 30 sec - exiting 04:36:49 (4052): No heartbeat from core client for 30 sec - exiting 04:36:51 (4052): No heartbeat from core client for 30 sec - exiting 04:37:09 (4052): No heartbeat from core client for 30 sec - exiting 04:37:11 (4052): No heartbeat from core client for 30 sec - exiting 04:37:18 (4052): No heartbeat from core client for 30 sec - exiting 04:37:26 (4052): No heartbeat from core client for 30 sec - exiting 04:37:33 (4052): No heartbeat from core client for 30 sec - exiting 04:37:40 (4052): No heartbeat from core client for 30 sec - exiting 04:37:47 (4052): No heartbeat from core client for 30 sec - exiting 04:37:51 (4052): No heartbeat from core client for 30 sec - exiting 04:37:57 (4052): No heartbeat from core client for 30 sec - exiting 04:38:04 (4052): No heartbeat from core client for 30 sec - exiting 04:38:11 (4052): No heartbeat from core client for 30 sec - exiting 04:38:18 (4052): No heartbeat from core client for 30 sec - exiting 04:38:25 (4052): No heartbeat from core client for 30 sec - exiting 04:38:27 (4052): No heartbeat from core client for 30 sec - exiting 04:38:33 (4052): No heartbeat from core client for 30 sec - exiting 04:38:40 (4052): No heartbeat from core client for 30 sec - exiting 04:38:47 (4052): No heartbeat from core client for 30 sec - exiting 04:38:55 (4052): No heartbeat from core client for 30 sec - exiting 04:39:01 (4052): No heartbeat from core client for 30 sec - exiting 04:39:08 (4052): No heartbeat from core client for 30 sec - exiting 04:41:11 (4052): No heartbeat from core client for 30 sec - exiting 04:41:13 (4052): No heartbeat from core client for 30 sec - exiting 04:41:22 (4052): No heartbeat from core client for 30 sec - exiting 04:41:29 (4052): No heartbeat from core client for 30 sec - exiting 04:41:58 (4052): No heartbeat from core client for 30 sec - exiting 04:42:04 (4052): No heartbeat from core client for 30 sec - exiting 04:42:11 (4052): No heartbeat from core client for 30 sec - exiting 04:42:19 (4052): No heartbeat from core client for 30 sec - exiting 04:42:20 (4052): No heartbeat from core client for 30 sec - exiting 04:42:28 (4052): No heartbeat from core client for 30 sec - exiting 04:42:37 (4052): No heartbeat from core client for 30 sec - exiting 04:42:50 (4052): No heartbeat from core client for 30 sec - exiting 04:42:56 (4052): No heartbeat from core client for 30 sec - exiting 04:43:03 (4052): No heartbeat from core client for 30 sec - exiting 04:43:10 (4052): No heartbeat from core client for 30 sec - exiting 04:43:17 (4052): No heartbeat from core client for 30 sec - exiting 04:43:19 (4052): No heartbeat from core client for 30 sec - exiting 04:43:44 (4052): No heartbeat from core client for 30 sec - exiting 04:43:51 (4052): No heartbeat from core client for 30 sec - exiting 04:43:58 (4052): No heartbeat from core client for 30 sec - exiting 04:44:06 (4052): No heartbeat from core client for 30 sec - exiting 04:44:13 (4052): No heartbeat from core client for 30 sec - exiting 04:44:19 (4052): No heartbeat from core client for 30 sec - exiting 04:44:21 (4052): No heartbeat from core client for 30 sec - exiting 04:44:28 (4052): No heartbeat from core client for 30 sec - exiting 04:44:56 (4052): No heartbeat from core client for 30 sec - exiting 04:45:02 (4052): No heartbeat from core client for 30 sec - exiting 04:45:10 (4052): No heartbeat from core client for 30 sec - exiting 04:45:18 (4052): No heartbeat from core client for 30 sec - exiting 04:45:19 (4052): No heartbeat from core client for 30 sec - exiting 04:45:26 (4052): No heartbeat from core client for 30 sec - exiting 04:45:34 (4052): No heartbeat from core client for 30 sec - exiting 04:45:41 (4052): No heartbeat from core client for 30 sec - exiting 04:45:51 (4052): No heartbeat from core client for 30 sec - exiting 04:45:59 (4052): No heartbeat from core client for 30 sec - exiting 04:46:05 (4052): No heartbeat from core client for 30 sec - exiting 04:46:07 (4052): No heartbeat from core client for 30 sec - exiting 04:46:19 (4052): No heartbeat from core client for 30 sec - exiting 04:46:28 (4052): No heartbeat from core client for 30 sec - exiting 04:46:35 (4052): No heartbeat from core client for 30 sec - exiting 04:46:43 (4052): No heartbeat from core client for 30 sec - exiting 04:46:50 (4052): No heartbeat from core client for 30 sec - exiting 04:46:51 (4052): No heartbeat from core client for 30 sec - exiting 04:47:03 (4052): No heartbeat from core client for 30 sec - exiting 04:47:18 (4052): No heartbeat from core client for 30 sec - exiting 04:47:26 (4052): No heartbeat from core client for 30 sec - exiting 04:47:32 (4052): No heartbeat from core client for 30 sec - exiting 04:47:49 (4052): No heartbeat from core client for 30 sec - exiting 04:47:56 (4052): No heartbeat from core client for 30 sec - exiting 04:48:02 (4052): No heartbeat from core client for 30 sec - exiting 04:48:04 (4052): No heartbeat from core client for 30 sec - exiting 04:48:12 (4052): No heartbeat from core client for 30 sec - exiting 04:48:19 (4052): No heartbeat from core client for 30 sec - exiting 04:48:26 (4052): No heartbeat from core client for 30 sec - exiting 04:48:33 (4052): No heartbeat from core client for 30 sec - exiting 04:48:40 (4052): No heartbeat from core client for 30 sec - exiting 04:48:42 (4052): No heartbeat from core client for 30 sec - exiting 04:48:49 (4052): No heartbeat from core client for 30 sec - exiting 04:48:55 (4052): No heartbeat from core client for 30 sec - exiting 04:49:02 (4052): No heartbeat from core client for 30 sec - exiting 04:49:09 (4052): No heartbeat from core client for 30 sec - exiting 04:49:15 (4052): No heartbeat from core client for 30 sec - exiting 04:49:17 (4052): No heartbeat from core client for 30 sec - exiting 04:49:25 (4052): No heartbeat from core client for 30 sec - exiting 04:49:32 (4052): No heartbeat from core client for 30 sec - exiting 04:49:39 (4052): No heartbeat from core client for 30 sec - exiting 04:49:48 (4052): No heartbeat from core client for 30 sec - exiting 04:49:54 (4052): No heartbeat from core client for 30 sec - exiting 04:50:25 (4052): No heartbeat from core client for 30 sec - exiting 04:50:32 (4052): No heartbeat from core client for 30 sec - exiting 04:50:39 (4052): No heartbeat from core client for 30 sec - exiting 04:50:46 (4052): No heartbeat from core client for 30 sec - exiting 04:50:53 (4052): No heartbeat from core client for 30 sec - exiting 04:51:00 (4052): No heartbeat from core client for 30 sec - exiting 04:51:01 (4052): No heartbeat from core client for 30 sec - exiting 04:51:09 (4052): No heartbeat from core client for 30 sec - exiting 04:51:16 (4052): No heartbeat from core client for 30 sec - exiting 04:51:23 (4052): No heartbeat from core client for 30 sec - exiting 04:51:31 (4052): No heartbeat from core client for 30 sec - exiting 04:51:38 (4052): No heartbeat from core client for 30 sec - exiting 04:51:39 (4052): No heartbeat from core client for 30 sec - exiting 04:51:46 (4052): No heartbeat from core client for 30 sec - exiting 04:51:55 (4052): No heartbeat from core client for 30 sec - exiting 04:52:04 (4052): No heartbeat from core client for 30 sec - exiting 04:52:11 (4052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:52:19 (4052): No heartbeat from core client for 30 sec - exiting 04:52:25 (4052): No heartbeat from core client for 30 sec - exiting 04:52:27 (4052): No heartbeat from core client for 30 sec - exiting 04:52:34 (4052): No heartbeat from core client for 30 sec - exiting 04:52:41 (4052): No heartbeat from core client for 30 sec - exiting 04:52:47 (4052): No heartbeat from core client for 30 sec - exiting 04:52:54 (4052): No heartbeat from core client for 30 sec - exiting 04:53:01 (4052): No heartbeat from core client for 30 sec - exiting 04:53:03 (4052): No heartbeat from core client for 30 sec - exiting 10:17:57 (1728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:10:41 (952): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:37:03 (2140): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:08:37 (3616): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:02:59 (2776): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:41:25 (3076): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:54:27 (2456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:55:09 (1436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:11:02 (3996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:11:58 (1404): No heartbeat from core client for 30 sec - exiting 19:11:59 (1404): No heartbeat from core client for 30 sec - exiting 19:12:00 (1404): No heartbeat from core client for 30 sec - exiting 19:12:01 (1404): No heartbeat from core client for 30 sec - exiting 19:12:02 (1404): No heartbeat from core client for 30 sec - exiting 19:12:04 (1404): No heartbeat from core client for 30 sec - exiting 19:12:05 (1404): No heartbeat from core client for 30 sec - exiting 19:12:06 (1404): No heartbeat from core client for 30 sec - exiting 19:12:07 (1404): No heartbeat from core client for 30 sec - exiting 19:12:08 (1404): No heartbeat from core client for 30 sec - exiting 19:12:09 (1404): No heartbeat from core client for 30 sec - exiting 19:12:11 (1404): No heartbeat from core client for 30 sec - exiting 19:12:12 (1404): No heartbeat from core client for 30 sec - exiting 19:12:13 (1404): No heartbeat from core client for 30 sec - exiting 19:12:14 (1404): No heartbeat from core client for 30 sec - exiting 19:12:15 (1404): No heartbeat from core client for 30 sec - exiting 19:12:17 (1404): No heartbeat from core client for 30 sec - exiting 19:12:18 (1404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:42:58 (3304): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 11:39:07 (3852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:39:08 (3852): No heartbeat from core client for 30 sec - exiting 11:39:52 (2992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:43:55 (2712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:43:56 (2712): No heartbeat from core client for 30 sec - exiting 15:44:49 (1900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:50:06 (2192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:50:07 (2192): No heartbeat from core client for 30 sec - exiting 15:50:08 (2192): No heartbeat from core client for 30 sec - exiting 15:50:09 (2192): No heartbeat from core client for 30 sec - exiting 15:50:11 (2192): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:28:51 (3832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:28:53 (3832): No heartbeat from core client for 30 sec - exiting 08:28:54 (3832): No heartbeat from core client for 30 sec - exiting 08:28:55 (3832): No heartbeat from core client for 30 sec - exiting 08:28:56 (3832): No heartbeat from core client for 30 sec - exiting 08:28:57 (3832): No heartbeat from core client for 30 sec - exiting 08:28:58 (3832): No heartbeat from core client for 30 sec - exiting 08:28:59 (3832): No heartbeat from core client for 30 sec - exiting 08:29:00 (3832): No heartbeat from core client for 30 sec - exiting 08:29:01 (3832): No heartbeat from core client for 30 sec - exiting 08:29:03 (3832): No heartbeat from core client for 30 sec - exiting 16:58:37 (744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:58:38 (744): No heartbeat from core client for 30 sec - exiting 16:58:39 (744): No heartbeat from core client for 30 sec - exiting 16:58:41 (744): No heartbeat from core client for 30 sec - exiting 16:58:42 (744): No heartbeat from core client for 30 sec - exiting 16:58:43 (744): No heartbeat from core client for 30 sec - exiting 16:59:48 (2908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:58:14 (3912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:58:15 (3912): No heartbeat from core client for 30 sec - exiting 20:58:16 (3912): No heartbeat from core client for 30 sec - exiting 20:58:17 (3912): No heartbeat from core client for 30 sec - exiting 21:00:35 (1512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:00:36 (1512): No heartbeat from core client for 30 sec - exiting 21:00:37 (1512): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 22:02:58 (3436): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:25:54 (2988): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:10:21 (3032): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 12:10:23 (3032): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:40:58 (2920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:40:59 (2920): No heartbeat from core client for 30 sec - exiting 09:41:00 (2920): No heartbeat from core client for 30 sec - exiting 09:41:42 (3624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:10:50 (2668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:10:52 (2668): No heartbeat from core client for 30 sec - exiting 15:10:53 (2668): No heartbeat from core client for 30 sec - exiting 15:10:54 (2668): No heartbeat from core client for 30 sec - exiting 15:10:55 (2668): No heartbeat from core client for 30 sec - exiting 15:12:27 (4020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:19:42 (1972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:10:30 (2616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:40:49 (2436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:41:31 (3912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:00:40 (1692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:00:41 (1692): No heartbeat from core client for 30 sec - exiting 12:00:42 (1692): No heartbeat from core client for 30 sec - exiting 12:00:43 (1692): No heartbeat from core client for 30 sec - exiting 12:00:44 (1692): No heartbeat from core client for 30 sec - exiting 12:01:31 (1296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:24:58 (2848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:25:45 (3112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:49:28 (3380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:50:10 (3580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:03:42 (3316): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 22:03:50 (3316): No heartbeat from core client for 30 sec - exiting 22:03:51 (3316): No heartbeat from core client for 30 sec - exiting 22:03:59 (3316): No heartbeat from core client for 30 sec - exiting 22:04:42 (3316): No heartbeat from core client for 30 sec - exiting 22:04:48 (3316): No heartbeat from core client for 30 sec - exiting 22:04:58 (3316): No heartbeat from core client for 30 sec - exiting 22:05:05 (3316): No heartbeat from core client for 30 sec - exiting 22:05:12 (3316): No heartbeat from core client for 30 sec - exiting 22:05:13 (3316): No heartbeat from core client for 30 sec - exiting 22:05:20 (3316): No heartbeat from core client for 30 sec - exiting 22:05:27 (3316): No heartbeat from core client for 30 sec - exiting 22:05:35 (3316): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 09:39:42 (3296): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:26:57 (2008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:26:58 (2008): No heartbeat from core client for 30 sec - exiting 11:27:00 (2008): No heartbeat from core client for 30 sec - exiting 11:27:01 (2008): No heartbeat from core client for 30 sec - exiting 11:27:02 (2008): No heartbeat from core client for 30 sec - exiting 11:27:03 (2008): No heartbeat from core client for 30 sec - exiting 11:27:04 (2008): No heartbeat from core client for 30 sec - exiting 11:27:05 (2008): No heartbeat from core client for 30 sec - exiting 11:27:06 (2008): No heartbeat from core client for 30 sec - exiting 11:27:07 (2008): No heartbeat from core client for 30 sec - exiting 11:27:08 (2008): No heartbeat from core client for 30 sec - exiting 11:29:58 (2244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:30:00 (2244): No heartbeat from core client for 30 sec - exiting 11:31:07 (2752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:35:36 (3204): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:27:04 (1328): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:06:49 (2020): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Jan 2015 05:44:50	1293894	17409794	hadcm3n_8erx_1980_40_008728568_3	725,760	1,090,457	1.5025
15 Jan 2015 02:01:04	1293894	17409794	hadcm3n_8erx_1980_40_008728568_3	699,840	1,057,034	1.5104
09 Jan 2015 05:07:39	1293894	17409794	hadcm3n_8erx_1980_40_008728568_3	673,920	1,025,384	1.5215
08 Jan 2015 16:22:29	1293894	17409794	hadcm3n_8erx_1980_40_008728568_3	648,000	1,002,281	1.5467
08 Jan 2015 16:22:29	1293894	17409794	hadcm3n_8erx_1980_40_008728568_3	622,080	979,070	1.5739
08 Jan 2015 16:22:29	1293894	17409794	hadcm3n_8erx_1980_40_008728568_3	596,160	956,114	1.6038
08 Jan 2015 16:22:29	1293894	17409794	hadcm3n_8erx_1980_40_008728568_3	570,240	933,216	1.6365
08 Jan 2015 16:22:29	1293894	17409794	hadcm3n_8erx_1980_40_008728568_3	544,320	908,464	1.6690
02 Jan 2015 02:05:19	1293894	17409794	hadcm3n_8erx_1980_40_008728568_3	518,400	881,389	1.7002
01 Jan 2015 02:10:46	1293894	17409794	hadcm3n_8erx_1980_40_008728568_3	492,480	847,066	1.7200
31 Dec 2014 02:14:40	1293894	17409794	hadcm3n_8erx_1980_40_008728568_3	466,560	813,889	1.7444
30 Dec 2014 02:07:15	1293894	17409794	hadcm3n_8erx_1980_40_008728568_3	440,640	781,466	1.7735
29 Dec 2014 03:02:38	1293894	17409794	hadcm3n_8erx_1980_40_008728568_3	414,720	748,730	1.8054
27 Dec 2014 02:11:42	1293894	17409794	hadcm3n_8erx_1980_40_008728568_3	388,800	715,632	1.8406
19 Dec 2014 11:36:13	1293894	17409794	hadcm3n_8erx_1980_40_008728568_3	362,880	682,135	1.8798
13 Dec 2014 15:44:08	1293894	17409794	hadcm3n_8erx_1980_40_008728568_3	336,960	648,955	1.9259
09 Dec 2014 02:04:00	1293894	17409794	hadcm3n_8erx_1980_40_008728568_3	311,040	616,982	1.9836
07 Dec 2014 04:13:11	1293894	17409794	hadcm3n_8erx_1980_40_008728568_3	285,120	581,782	2.0405
06 Dec 2014 02:20:06	1293894	17409794	hadcm3n_8erx_1980_40_008728568_3	259,200	546,865	2.1098
04 Dec 2014 06:54:53	1293894	17409794	hadcm3n_8erx_1980_40_008728568_3	233,280	513,782	2.2024