Task 16048167

Name	hadcm3n_3e2z_2020_40_008389445_3
Workunit	8540304
Created	28 Sep 2013, 12:09:37 UTC
Sent	28 Sep 2013, 12:30:43 UTC
Report deadline	28 Dec 2013, 19:57:54 UTC
Received	8 Nov 2013, 1:17:50 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1264738
Run time	9 days 16 hours 18 min 46 sec
CPU time	9 days 1 hours 25 min 31 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.03 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code -1073741819 (0xc0000005) </message> <stderr_txt> MonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... 11:30:32 (16236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:31:57 (7920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:35:26 (10588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:37:25 (10376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:37:26 (10376): No heartbeat from core client for 30 sec - exiting 11:37:27 (10376): No heartbeat from core client for 30 sec - exiting 11:37:28 (10376): No heartbeat from core client for 30 sec - exiting 11:37:29 (10376): No heartbeat from core client for 30 sec - exiting 11:37:30 (10376): No heartbeat from core client for 30 sec - exiting 11:37:31 (10376): No heartbeat from core client for 30 sec - exiting 11:37:32 (10376): No heartbeat from core client for 30 sec - exiting 11:37:33 (10376): No heartbeat from core client for 30 sec - exiting 11:37:34 (10376): No heartbeat from core client for 30 sec - exiting 11:37:35 (10376): No heartbeat from core client for 30 sec - exiting 11:38:27 (9996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:39:50 (4636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:41:32 (9844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:41:33 (9844): No heartbeat from core client for 30 sec - exiting 11:41:34 (9844): No heartbeat from core client for 30 sec - exiting 11:41:35 (9844): No heartbeat from core client for 30 sec - exiting 11:41:36 (9844): No heartbeat from core client for 30 sec - exiting 11:41:37 (9844): No heartbeat from core client for 30 sec - exiting 11:41:38 (9844): No heartbeat from core client for 30 sec - exiting 11:41:39 (9844): No heartbeat from core client for 30 sec - exiting 11:41:40 (9844): No heartbeat from core client for 30 sec - exiting 11:41:41 (9844): No heartbeat from core client for 30 sec - exiting 11:41:42 (9844): No heartbeat from core client for 30 sec - exiting 11:43:38 (15300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:43:39 (15300): No heartbeat from core client for 30 sec - exiting 11:43:40 (15300): No heartbeat from core client for 30 sec - exiting 11:43:41 (15300): No heartbeat from core client for 30 sec - exiting 11:43:42 (15300): No heartbeat from core client for 30 sec - exiting 11:43:43 (15300): No heartbeat from core client for 30 sec - exiting 11:43:44 (15300): No heartbeat from core client for 30 sec - exiting 11:43:45 (15300): No heartbeat from core client for 30 sec - exiting 11:43:46 (15300): No heartbeat from core client for 30 sec - exiting 11:43:47 (15300): No heartbeat from core client for 30 sec - exiting 11:43:48 (15300): No heartbeat from core client for 30 sec - exiting 11:52:59 (11328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:55:46 (14364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:55:47 (14364): No heartbeat from core client for 30 sec - exiting 11:55:48 (14364): No heartbeat from core client for 30 sec - exiting 11:55:49 (14364): No heartbeat from core client for 30 sec - exiting 11:55:50 (14364): No heartbeat from core client for 30 sec - exiting 11:55:51 (14364): No heartbeat from core client for 30 sec - exiting 11:55:52 (14364): No heartbeat from core client for 30 sec - exiting 11:55:53 (14364): No heartbeat from core client for 30 sec - exiting 11:57:15 (14744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:57:16 (14744): No heartbeat from core client for 30 sec - exiting 11:57:17 (14744): No heartbeat from core client for 30 sec - exiting 11:57:18 (14744): No heartbeat from core client for 30 sec - exiting 11:57:19 (14744): No heartbeat from core client for 30 sec - exiting 11:57:20 (14744): No heartbeat from core client for 30 sec - exiting 11:57:21 (14744): No heartbeat from core client for 30 sec - exiting 11:57:22 (14744): No heartbeat from core client for 30 sec - exiting 11:57:23 (14744): No heartbeat from core client for 30 sec - exiting 11:57:24 (14744): No heartbeat from core client for 30 sec - exiting 11:57:25 (14744): No heartbeat from core client for 30 sec - exiting 11:58:56 (14944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:58:57 (14944): No heartbeat from core client for 30 sec - exiting 11:58:58 (14944): No heartbeat from core client for 30 sec - exiting 11:58:59 (14944): No heartbeat from core client for 30 sec - exiting 11:59:00 (14944): No heartbeat from core client for 30 sec - exiting 11:59:01 (14944): No heartbeat from core client for 30 sec - exiting 11:59:02 (14944): No heartbeat from core client for 30 sec - exiting 11:59:03 (14944): No heartbeat from core client for 30 sec - exiting 11:59:04 (14944): No heartbeat from core client for 30 sec - exiting 11:59:05 (14944): No heartbeat from core client for 30 sec - exiting 11:59:06 (14944): No heartbeat from core client for 30 sec - exiting 12:00:55 (16260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:00:56 (16260): No heartbeat from core client for 30 sec - exiting 12:00:57 (16260): No heartbeat from core client for 30 sec - exiting 12:00:58 (16260): No heartbeat from core client for 30 sec - exiting 12:00:59 (16260): No heartbeat from core client for 30 sec - exiting 12:01:00 (16260): No heartbeat from core client for 30 sec - exiting 12:01:01 (16260): No heartbeat from core client for 30 sec - exiting 12:01:02 (16260): No heartbeat from core client for 30 sec - exiting 12:01:03 (16260): No heartbeat from core client for 30 sec - exiting 12:01:04 (16260): No heartbeat from core client for 30 sec - exiting 12:01:05 (16260): No heartbeat from core client for 30 sec - exiting 12:02:39 (8784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:03:47 (5812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:05:52 (3920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:06:59 (16616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:08:17 (11752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:08:18 (11752): No heartbeat from core client for 30 sec - exiting 12:08:19 (11752): No heartbeat from core client for 30 sec - exiting 12:08:20 (11752): No heartbeat from core client for 30 sec - exiting 12:08:21 (11752): No heartbeat from core client for 30 sec - exiting 12:08:22 (11752): No heartbeat from core client for 30 sec - exiting 12:08:23 (11752): No heartbeat from core client for 30 sec - exiting 12:08:24 (11752): No heartbeat from core client for 30 sec - exiting 12:08:25 (11752): No heartbeat from core client for 30 sec - exiting 12:08:26 (11752): No heartbeat from core client for 30 sec - exiting 12:08:27 (11752): No heartbeat from core client for 30 sec - exiting 12:10:20 (6352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:10:21 (6352): No heartbeat from core client for 30 sec - exiting 12:10:22 (6352): No heartbeat from core client for 30 sec - exiting 12:10:23 (6352): No heartbeat from core client for 30 sec - exiting 12:10:24 (6352): No heartbeat from core client for 30 sec - exiting 12:10:25 (6352): No heartbeat from core client for 30 sec - exiting 12:10:26 (6352): No heartbeat from core client for 30 sec - exiting 12:10:27 (6352): No heartbeat from core client for 30 sec - exiting 12:10:28 (6352): No heartbeat from core client for 30 sec - exiting 12:10:29 (6352): No heartbeat from core client for 30 sec - exiting 12:10:30 (6352): No heartbeat from core client for 30 sec - exiting 12:12:02 (9012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:12:03 (9012): No heartbeat from core client for 30 sec - exiting 12:12:04 (9012): No heartbeat from core client for 30 sec - exiting 12:12:05 (9012): No heartbeat from core client for 30 sec - exiting 12:12:06 (9012): No heartbeat from core client for 30 sec - exiting 12:12:07 (9012): No heartbeat from core client for 30 sec - exiting 12:12:08 (9012): No heartbeat from core client for 30 sec - exiting 12:12:09 (9012): No heartbeat from core client for 30 sec - exiting 12:12:10 (9012): No heartbeat from core client for 30 sec - exiting 12:12:11 (9012): No heartbeat from core client for 30 sec - exiting 12:12:12 (9012): No heartbeat from core client for 30 sec - exiting 12:13:31 (8504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:15:36 (14480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:15:37 (14480): No heartbeat from core client for 30 sec - exiting 12:15:38 (14480): No heartbeat from core client for 30 sec - exiting 12:15:39 (14480): No heartbeat from core client for 30 sec - exiting 12:15:40 (14480): No heartbeat from core client for 30 sec - exiting 12:15:41 (14480): No heartbeat from core client for 30 sec - exiting 12:15:42 (14480): No heartbeat from core client for 30 sec - exiting 12:15:43 (14480): No heartbeat from core client for 30 sec - exiting 12:15:44 (14480): No heartbeat from core client for 30 sec - exiting 12:15:45 (14480): No heartbeat from core client for 30 sec - exiting 12:15:46 (14480): No heartbeat from core client for 30 sec - exiting 12:17:33 (14912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:19:32 (10816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:19:33 (10816): No heartbeat from core client for 30 sec - exiting 12:19:34 (10816): No heartbeat from core client for 30 sec - exiting 12:19:35 (10816): No heartbeat from core client for 30 sec - exiting 12:19:36 (10816): No heartbeat from core client for 30 sec - exiting 12:19:37 (10816): No heartbeat from core client for 30 sec - exiting 12:19:38 (10816): No heartbeat from core client for 30 sec - exiting 12:19:39 (10816): No heartbeat from core client for 30 sec - exiting 12:19:40 (10816): No heartbeat from core client for 30 sec - exiting 12:19:41 (10816): No heartbeat from core client for 30 sec - exiting 12:19:42 (10816): No heartbeat from core client for 30 sec - exiting 12:25:37 (15692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:26:35 (2828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:28:14 (12248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:28:15 (12248): No heartbeat from core client for 30 sec - exiting 12:28:16 (12248): No heartbeat from core client for 30 sec - exiting 12:28:17 (12248): No heartbeat from core client for 30 sec - exiting 12:28:18 (12248): No heartbeat from core client for 30 sec - exiting 12:28:19 (12248): No heartbeat from core client for 30 sec - exiting 12:28:20 (12248): No heartbeat from core client for 30 sec - exiting 12:28:21 (12248): No heartbeat from core client for 30 sec - exiting 12:28:22 (12248): No heartbeat from core client for 30 sec - exiting 12:28:23 (12248): No heartbeat from core client for 30 sec - exiting 12:28:24 (12248): No heartbeat from core client for 30 sec - exiting 12:30:10 (2176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:30:11 (2176): No heartbeat from core client for 30 sec - exiting 12:30:12 (2176): No heartbeat from core client for 30 sec - exiting 12:30:13 (2176): No heartbeat from core client for 30 sec - exiting 12:30:14 (2176): No heartbeat from core client for 30 sec - exiting 12:30:15 (2176): No heartbeat from core client for 30 sec - exiting 12:30:16 (2176): No heartbeat from core client for 30 sec - exiting 12:30:17 (2176): No heartbeat from core client for 30 sec - exiting 12:30:18 (2176): No heartbeat from core client for 30 sec - exiting 12:30:19 (2176): No heartbeat from core client for 30 sec - exiting 12:30:20 (2176): No heartbeat from core client for 30 sec - exiting 12:32:12 (8864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:32:13 (8864): No heartbeat from core client for 30 sec - exiting 12:32:14 (8864): No heartbeat from core client for 30 sec - exiting 12:32:15 (8864): No heartbeat from core client for 30 sec - exiting 12:32:16 (8864): No heartbeat from core client for 30 sec - exiting 12:32:17 (8864): No heartbeat from core client for 30 sec - exiting 12:32:18 (8864): No heartbeat from core client for 30 sec - exiting 12:32:19 (8864): No heartbeat from core client for 30 sec - exiting 12:32:20 (8864): No heartbeat from core client for 30 sec - exiting 12:32:21 (8864): No heartbeat from core client for 30 sec - exiting 12:32:22 (8864): No heartbeat from core client for 30 sec - exiting 12:34:30 (3904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:34:31 (3904): No heartbeat from core client for 30 sec - exiting 12:34:32 (3904): No heartbeat from core client for 30 sec - exiting 12:34:33 (3904): No heartbeat from core client for 30 sec - exiting 12:34:34 (3904): No heartbeat from core client for 30 sec - exiting 12:34:35 (3904): No heartbeat from core client for 30 sec - exiting 12:34:36 (3904): No heartbeat from core client for 30 sec - exiting 12:34:37 (3904): No heartbeat from core client for 30 sec - exiting 12:34:38 (3904): No heartbeat from core client for 30 sec - exiting 12:34:39 (3904): No heartbeat from core client for 30 sec - exiting 12:34:40 (3904): No heartbeat from core client for 30 sec - exiting 12:36:18 (9404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:38:38 (16488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:38:39 (16488): No heartbeat from core client for 30 sec - exiting 12:38:40 (16488): No heartbeat from core client for 30 sec - exiting 12:38:41 (16488): No heartbeat from core client for 30 sec - exiting 12:38:42 (16488): No heartbeat from core client for 30 sec - exiting 12:38:43 (16488): No heartbeat from core client for 30 sec - exiting 12:38:44 (16488): No heartbeat from core client for 30 sec - exiting 12:38:45 (16488): No heartbeat from core client for 30 sec - exiting 12:38:46 (16488): No heartbeat from core client for 30 sec - exiting 12:38:47 (16488): No heartbeat from core client for 30 sec - exiting 12:38:48 (16488): No heartbeat from core client for 30 sec - exiting 12:40:45 (9868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:40:46 (9868): No heartbeat from core client for 30 sec - exiting 12:40:47 (9868): No heartbeat from core client for 30 sec - exiting 12:40:48 (9868): No heartbeat from core client for 30 sec - exiting 12:40:49 (9868): No heartbeat from core client for 30 sec - exiting 12:40:50 (9868): No heartbeat from core client for 30 sec - exiting 12:40:51 (9868): No heartbeat from core client for 30 sec - exiting 12:40:52 (9868): No heartbeat from core client for 30 sec - exiting 12:40:53 (9868): No heartbeat from core client for 30 sec - exiting 12:40:54 (9868): No heartbeat from core client for 30 sec - exiting 12:40:55 (9868): No heartbeat from core client for 30 sec - exiting 12:42:17 (8004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:44:05 (12564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:47:45 (1156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:47:46 (1156): No heartbeat from core client for 30 sec - exiting 12:47:47 (1156): No heartbeat from core client for 30 sec - exiting 12:47:48 (1156): No heartbeat from core client for 30 sec - exiting 12:47:49 (1156): No heartbeat from core client for 30 sec - exiting 12:47:50 (1156): No heartbeat from core client for 30 sec - exiting 12:47:51 (1156): No heartbeat from core client for 30 sec - exiting 12:47:52 (1156): No heartbeat from core client for 30 sec - exiting 12:47:53 (1156): No heartbeat from core client for 30 sec - exiting 12:47:54 (1156): No heartbeat from core client for 30 sec - exiting 12:47:55 (1156): No heartbeat from core client for 30 sec - exiting 12:49:49 (12056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:49:50 (12056): No heartbeat from core client for 30 sec - exiting 12:49:51 (12056): No heartbeat from core client for 30 sec - exiting 12:49:52 (12056): No heartbeat from core client for 30 sec - exiting 12:49:53 (12056): No heartbeat from core client for 30 sec - exiting 12:49:54 (12056): No heartbeat from core client for 30 sec - exiting 12:49:55 (12056): No heartbeat from core client for 30 sec - exiting 12:49:56 (12056): No heartbeat from core client for 30 sec - exiting 12:49:57 (12056): No heartbeat from core client for 30 sec - exiting 12:49:58 (12056): No heartbeat from core client for 30 sec - exiting 12:49:59 (12056): No heartbeat from core client for 30 sec - exiting 12:52:04 (15928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:54:18 (4060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:54:19 (4060): No heartbeat from core client for 30 sec - exiting 12:54:20 (4060): No heartbeat from core client for 30 sec - exiting 12:54:21 (4060): No heartbeat from core client for 30 sec - exiting 12:54:22 (4060): No heartbeat from core client for 30 sec - exiting 12:54:23 (4060): No heartbeat from core client for 30 sec - exiting 12:55:36 (17236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:55:37 (17236): No heartbeat from core client for 30 sec - exiting 12:55:38 (17236): No heartbeat from core client for 30 sec - exiting 12:55:39 (17236): No heartbeat from core client for 30 sec - exiting 12:55:40 (17236): No heartbeat from core client for 30 sec - exiting 12:55:41 (17236): No heartbeat from core client for 30 sec - exiting 12:55:42 (17236): No heartbeat from core client for 30 sec - exiting 12:55:43 (17236): No heartbeat from core client for 30 sec - exiting 12:55:44 (17236): No heartbeat from core client for 30 sec - exiting 12:55:45 (17236): No heartbeat from core client for 30 sec - exiting 12:55:46 (17236): No heartbeat from core client for 30 sec - exiting 12:58:10 (14020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:58:11 (14020): No heartbeat from core client for 30 sec - exiting 12:58:12 (14020): No heartbeat from core client for 30 sec - exiting 12:58:13 (14020): No heartbeat from core client for 30 sec - exiting 12:58:14 (14020): No heartbeat from core client for 30 sec - exiting 12:58:15 (14020): No heartbeat from core client for 30 sec - exiting 12:58:16 (14020): No heartbeat from core client for 30 sec - exiting 12:58:17 (14020): No heartbeat from core client for 30 sec - exiting 12:58:18 (14020): No heartbeat from core client for 30 sec - exiting 12:58:19 (14020): No heartbeat from core client for 30 sec - exiting 12:58:20 (14020): No heartbeat from core client for 30 sec - exiting 13:00:00 (7000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:00:01 (7000): No heartbeat from core client for 30 sec - exiting 13:00:02 (7000): No heartbeat from core client for 30 sec - exiting 13:00:03 (7000): No heartbeat from core client for 30 sec - exiting 13:00:04 (7000): No heartbeat from core client for 30 sec - exiting 13:00:05 (7000): No heartbeat from core client for 30 sec - exiting 13:00:06 (7000): No heartbeat from core client for 30 sec - exiting 13:00:07 (7000): No heartbeat from core client for 30 sec - exiting 13:00:08 (7000): No heartbeat from core client for 30 sec - exiting 13:00:09 (7000): No heartbeat from core client for 30 sec - exiting 13:00:10 (7000): No heartbeat from core client for 30 sec - exiting 13:02:11 (6720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:02:12 (6720): No heartbeat from core client for 30 sec - exiting 13:02:13 (6720): No heartbeat from core client for 30 sec - exiting 13:02:14 (6720): No heartbeat from core client for 30 sec - exiting 13:02:15 (6720): No heartbeat from core client for 30 sec - exiting 13:02:16 (6720): No heartbeat from core client for 30 sec - exiting 13:02:17 (6720): No heartbeat from core client for 30 sec - exiting 13:02:18 (6720): No heartbeat from core client for 30 sec - exiting 13:02:19 (6720): No heartbeat from core client for 30 sec - exiting 13:02:20 (6720): No heartbeat from core client for 30 sec - exiting 13:02:21 (6720): No heartbeat from core client for 30 sec - exiting 13:09:21 (12820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:10:07 (14096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:12:04 (10988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:14:14 (3144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:15:50 (2736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:17:55 (14496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:20:03 (15836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:22:02 (16808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:23:40 (17012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:23:41 (17012): No heartbeat from core client for 30 sec - exiting 13:23:42 (17012): No heartbeat from core client for 30 sec - exiting 13:23:43 (17012): No heartbeat from core client for 30 sec - exiting 13:23:44 (17012): No heartbeat from core client for 30 sec - exiting 13:23:45 (17012): No heartbeat from core client for 30 sec - exiting 13:23:46 (17012): No heartbeat from core client for 30 sec - exiting 13:23:47 (17012): No heartbeat from core client for 30 sec - exiting 13:23:48 (17012): No heartbeat from core client for 30 sec - exiting 13:23:49 (17012): No heartbeat from core client for 30 sec - exiting 13:23:50 (17012): No heartbeat from core client for 30 sec - exiting 13:26:56 (6332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:29:08 (7552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:29:09 (7552): No heartbeat from core client for 30 sec - exiting 13:29:10 (7552): No heartbeat from core client for 30 sec - exiting 13:29:11 (7552): No heartbeat from core client for 30 sec - exiting 13:29:12 (7552): No heartbeat from core client for 30 sec - exiting 13:29:13 (7552): No heartbeat from core client for 30 sec - exiting 13:29:14 (7552): No heartbeat from core client for 30 sec - exiting 13:29:15 (7552): No heartbeat from core client for 30 sec - exiting 13:29:16 (7552): No heartbeat from core client for 30 sec - exiting 13:29:17 (7552): No heartbeat from core client for 30 sec - exiting 13:29:18 (7552): No heartbeat from core client for 30 sec - exiting 13:31:12 (4852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:34:32 (16728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:34:33 (16728): No heartbeat from core client for 30 sec - exiting 13:34:34 (16728): No heartbeat from core client for 30 sec - exiting 13:34:35 (16728): No heartbeat from core client for 30 sec - exiting 13:34:36 (16728): No heartbeat from core client for 30 sec - exiting 13:34:37 (16728): No heartbeat from core client for 30 sec - exiting 13:34:38 (16728): No heartbeat from core client for 30 sec - exiting 13:34:39 (16728): No heartbeat from core client for 30 sec - exiting 13:34:40 (16728): No heartbeat from core client for 30 sec - exiting 13:34:41 (16728): No heartbeat from core client for 30 sec - exiting 13:34:42 (16728): No heartbeat from core client for 30 sec - exiting 13:35:26 (11596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:36:27 (12040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:38:06 (11780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:38:07 (11780): No heartbeat from core client for 30 sec - exiting 13:38:08 (11780): No heartbeat from core client for 30 sec - exiting 13:38:09 (11780): No heartbeat from core client for 30 sec - exiting 13:38:10 (11780): No heartbeat from core client for 30 sec - exiting 13:38:53 (980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:39:27 (3040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:41:12 (10224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:41:13 (10224): No heartbeat from core client for 30 sec - exiting 13:41:14 (10224): No heartbeat from core client for 30 sec - exiting 13:41:15 (10224): No heartbeat from core client for 30 sec - exiting 13:41:16 (10224): No heartbeat from core client for 30 sec - exiting 13:41:17 (10224): No heartbeat from core client for 30 sec - exiting 13:41:18 (10224): No heartbeat from core client for 30 sec - exiting 13:41:19 (10224): No heartbeat from core client for 30 sec - exiting 13:41:20 (10224): No heartbeat from core client for 30 sec - exiting 13:41:21 (10224): No heartbeat from core client for 30 sec - exiting 13:41:22 (10224): No heartbeat from core client for 30 sec - exiting 13:42:56 (12032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:42:57 (12032): No heartbeat from core client for 30 sec - exiting 13:42:58 (12032): No heartbeat from core client for 30 sec - exiting 13:42:59 (12032): No heartbeat from core client for 30 sec - exiting 13:43:00 (12032): No heartbeat from core client for 30 sec - exiting 13:43:01 (12032): No heartbeat from core client for 30 sec - exiting 13:43:02 (12032): No heartbeat from core client for 30 sec - exiting 13:43:03 (12032): No heartbeat from core client for 30 sec - exiting 13:43:04 (12032): No heartbeat from core client for 30 sec - exiting 13:43:05 (12032): No heartbeat from core client for 30 sec - exiting 13:43:06 (12032): No heartbeat from core client for 30 sec - exiting 13:44:26 (4040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:46:29 (12384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:46:30 (12384): No heartbeat from core client for 30 sec - exiting 13:46:31 (12384): No heartbeat from core client for 30 sec - exiting 13:46:32 (12384): No heartbeat from core client for 30 sec - exiting 13:46:33 (12384): No heartbeat from core client for 30 sec - exiting 13:46:34 (12384): No heartbeat from core client for 30 sec - exiting 13:46:35 (12384): No heartbeat from core client for 30 sec - exiting 13:46:36 (12384): No heartbeat from core client for 30 sec - exiting 13:46:37 (12384): No heartbeat from core client for 30 sec - exiting 13:46:38 (12384): No heartbeat from core client for 30 sec - exiting 13:46:39 (12384): No heartbeat from core client for 30 sec - exiting 13:47:48 (8232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:49:09 (15520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:50:23 (11460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:52:03 (15180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:53:00 (6208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:54:20 (14988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:55:07 (8348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:55:59 (13564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:58:00 (11496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:58:01 (11496): No heartbeat from core client for 30 sec - exiting 13:58:02 (11496): No heartbeat from core client for 30 sec - exiting 13:58:03 (11496): No heartbeat from core client for 30 sec - exiting 13:58:04 (11496): No heartbeat from core client for 30 sec - exiting 13:58:05 (11496): No heartbeat from core client for 30 sec - exiting 13:58:06 (11496): No heartbeat from core client for 30 sec - exiting 13:58:07 (11496): No heartbeat from core client for 30 sec - exiting 13:58:08 (11496): No heartbeat from core client for 30 sec - exiting 13:58:09 (11496): No heartbeat from core client for 30 sec - exiting 13:58:10 (11496): No heartbeat from core client for 30 sec - exiting 13:59:42 (8224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:01:25 (8212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:03:35 (12652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:03:36 (12652): No heartbeat from core client for 30 sec - exiting 14:03:37 (12652): No heartbeat from core client for 30 sec - exiting 14:03:38 (12652): No heartbeat from core client for 30 sec - exiting 14:03:39 (12652): No heartbeat from core client for 30 sec - exiting 14:03:40 (12652): No heartbeat from core client for 30 sec - exiting 14:03:41 (12652): No heartbeat from core client for 30 sec - exiting 14:03:42 (12652): No heartbeat from core client for 30 sec - exiting 14:03:43 (12652): No heartbeat from core client for 30 sec - exiting 14:03:44 (12652): No heartbeat from core client for 30 sec - exiting 14:03:45 (12652): No heartbeat from core client for 30 sec - exiting 14:05:45 (10720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:08:19 (10616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:08:20 (10616): No heartbeat from core client for 30 sec - exiting 14:08:21 (10616): No heartbeat from core client for 30 sec - exiting 14:08:22 (10616): No heartbeat from core client for 30 sec - exiting 14:08:23 (10616): No heartbeat from core client for 30 sec - exiting 14:08:24 (10616): No heartbeat from core client for 30 sec - exiting 14:08:25 (10616): No heartbeat from core client for 30 sec - exiting 14:08:26 (10616): No heartbeat from core client for 30 sec - exiting 14:08:27 (10616): No heartbeat from core client for 30 sec - exiting 14:08:28 (10616): No heartbeat from core client for 30 sec - exiting 14:08:29 (10616): No heartbeat from core client for 30 sec - exiting 14:15:16 (13676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:16:10 (4948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:25:16 (11240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:26:24 (10832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:35:17 (5828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:36:39 (16288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:37:44 (8120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:39:55 (9352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:39:56 (9352): No heartbeat from core client for 30 sec - exiting 14:39:57 (9352): No heartbeat from core client for 30 sec - exiting 14:39:58 (9352): No heartbeat from core client for 30 sec - exiting 14:39:59 (9352): No heartbeat from core client for 30 sec - exiting 14:40:00 (9352): No heartbeat from core client for 30 sec - exiting 14:40:01 (9352): No heartbeat from core client for 30 sec - exiting 14:40:02 (9352): No heartbeat from core client for 30 sec - exiting 14:40:03 (9352): No heartbeat from core client for 30 sec - exiting 14:40:04 (9352): No heartbeat from core client for 30 sec - exiting 14:40:05 (9352): No heartbeat from core client for 30 sec - exiting 14:41:27 (6628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:43:33 (7880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:43:34 (7880): No heartbeat from core client for 30 sec - exiting 14:43:35 (7880): No heartbeat from core client for 30 sec - exiting 14:43:36 (7880): No heartbeat from core client for 30 sec - exiting 14:43:37 (7880): No heartbeat from core client for 30 sec - exiting 14:43:38 (7880): No heartbeat from core client for 30 sec - exiting 14:43:39 (7880): No heartbeat from core client for 30 sec - exiting 14:43:40 (7880): No heartbeat from core client for 30 sec - exiting 14:43:41 (7880): No heartbeat from core client for 30 sec - exiting 14:43:42 (7880): No heartbeat from core client for 30 sec - exiting 14:43:43 (7880): No heartbeat from core client for 30 sec - exiting 14:45:18 (3220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:48:12 (13792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:48:13 (13792): No heartbeat from core client for 30 sec - exiting 14:48:14 (13792): No heartbeat from core client for 30 sec - exiting 14:48:15 (13792): No heartbeat from core client for 30 sec - exiting 14:48:16 (13792): No heartbeat from core client for 30 sec - exiting 14:48:17 (13792): No heartbeat from core client for 30 sec - exiting 14:48:18 (13792): No heartbeat from core client for 30 sec - exiting 14:48:19 (13792): No heartbeat from core client for 30 sec - exiting 14:48:20 (13792): No heartbeat from core client for 30 sec - exiting 14:48:21 (13792): No heartbeat from core client for 30 sec - exiting 14:48:22 (13792): No heartbeat from core client for 30 sec - exiting 14:49:49 (3872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:52:22 (14088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77093AB3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77093AB3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Nov 2013 10:35:59	1264738	16048167	hadcm3n_3e2z_2020_40_008389445_3	518,400	780,256	1.5051
06 Nov 2013 20:11:56	1264738	16048167	hadcm3n_3e2z_2020_40_008389445_3	492,480	741,244	1.5051
06 Nov 2013 05:16:24	1264738	16048167	hadcm3n_3e2z_2020_40_008389445_3	466,560	702,196	1.5050
05 Nov 2013 16:25:58	1264738	16048167	hadcm3n_3e2z_2020_40_008389445_3	440,640	663,605	1.5060
04 Nov 2013 19:28:06	1264738	16048167	hadcm3n_3e2z_2020_40_008389445_3	414,720	626,222	1.5100
04 Nov 2013 01:01:35	1264738	16048167	hadcm3n_3e2z_2020_40_008389445_3	388,800	588,615	1.5139
03 Nov 2013 11:53:43	1264738	16048167	hadcm3n_3e2z_2020_40_008389445_3	362,880	549,809	1.5151
02 Nov 2013 20:08:25	1264738	16048167	hadcm3n_3e2z_2020_40_008389445_3	336,960	511,066	1.5167
02 Nov 2013 06:17:24	1264738	16048167	hadcm3n_3e2z_2020_40_008389445_3	311,040	473,022	1.5208
01 Nov 2013 16:14:50	1264738	16048167	hadcm3n_3e2z_2020_40_008389445_3	285,120	433,973	1.5221
11 Oct 2013 11:29:00	1264738	16048167	hadcm3n_3e2z_2020_40_008389445_3	259,200	394,919	1.5236
08 Oct 2013 14:59:19	1264738	16048167	hadcm3n_3e2z_2020_40_008389445_3	233,280	356,120	1.5266
08 Oct 2013 00:59:11	1264738	16048167	hadcm3n_3e2z_2020_40_008389445_3	207,360	317,240	1.5299
03 Oct 2013 22:26:00	1264738	16048167	hadcm3n_3e2z_2020_40_008389445_3	181,440	277,767	1.5309
03 Oct 2013 02:33:21	1264738	16048167	hadcm3n_3e2z_2020_40_008389445_3	155,520	238,605	1.5342
01 Oct 2013 01:52:43	1264738	16048167	hadcm3n_3e2z_2020_40_008389445_3	129,600	198,788	1.5339
30 Sep 2013 14:04:16	1264738	16048167	hadcm3n_3e2z_2020_40_008389445_3	103,680	158,768	1.5313
30 Sep 2013 02:12:17	1264738	16048167	hadcm3n_3e2z_2020_40_008389445_3	77,760	119,034	1.5308
29 Sep 2013 14:36:16	1264738	16048167	hadcm3n_3e2z_2020_40_008389445_3	51,840	79,393	1.5315
29 Sep 2013 03:06:51	1264738	16048167	hadcm3n_3e2z_2020_40_008389445_3	25,920	39,846	1.5373