Task 16101362

Name	hadcm3n_83ji_1980_40_008462529_1
Workunit	8613385
Created	1 Dec 2013, 5:32:33 UTC
Sent	1 Dec 2013, 5:32:40 UTC
Report deadline	2 Mar 2014, 12:59:51 UTC
Received	26 Jan 2014, 8:51:59 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1266852
Run time	20 days 15 hours 30 min 44 sec
CPU time	19 days 20 hours 24 min 46 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.18 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <stderr_txt> onCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 00:12:58 (4556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:06:49 (6040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:00:49 (4440): No heartbeat from core client for 30 sec - exiting 00:00:50 (4440): No heartbeat from core client for 30 sec - exiting 00:00:51 (4440): No heartbeat from core client for 30 sec - exiting 00:00:52 (4440): No heartbeat from core client for 30 sec - exiting 00:00:53 (4440): No heartbeat from core client for 30 sec - exiting 00:00:54 (4440): No heartbeat from core client for 30 sec - exiting 00:00:55 (4440): No heartbeat from core client for 30 sec - exiting 00:00:56 (4440): No heartbeat from core client for 30 sec - exiting 00:00:57 (4440): No heartbeat from core client for 30 sec - exiting 00:00:59 (4440): No heartbeat from core client for 30 sec - exiting 00:01:00 (4440): No heartbeat from core client for 30 sec - exiting 00:01:01 (4440): No heartbeat from core client for 30 sec - exiting 00:01:02 (4440): No heartbeat from core client for 30 sec - exiting 00:01:03 (4440): No heartbeat from core client for 30 sec - exiting 00:01:04 (4440): No heartbeat from core client for 30 sec - exiting 00:01:05 (4440): No heartbeat from core client for 30 sec - exiting 00:01:06 (4440): No heartbeat from core client for 30 sec - exiting 00:01:07 (4440): No heartbeat from core client for 30 sec - exiting 00:01:08 (4440): No heartbeat from core client for 30 sec - exiting 00:01:09 (4440): No heartbeat from core client for 30 sec - exiting 00:01:11 (4440): No heartbeat from core client for 30 sec - exiting 00:01:12 (4440): No heartbeat from core client for 30 sec - exiting 00:01:13 (4440): No heartbeat from core client for 30 sec - exiting 00:01:14 (4440): No heartbeat from core client for 30 sec - exiting 00:01:15 (4440): No heartbeat from core client for 30 sec - exiting 00:01:16 (4440): No heartbeat from core client for 30 sec - exiting 00:01:17 (4440): No heartbeat from core client for 30 sec - exiting 00:01:18 (4440): No heartbeat from core client for 30 sec - exiting 00:01:19 (4440): No heartbeat from core client for 30 sec - exiting 00:01:20 (4440): No heartbeat from core client for 30 sec - exiting 00:01:21 (4440): No heartbeat from core client for 30 sec - exiting 00:01:23 (4440): No heartbeat from core client for 30 sec - exiting 00:01:24 (4440): No heartbeat from core client for 30 sec - exiting 00:01:25 (4440): No heartbeat from core client for 30 sec - exiting 00:01:26 (4440): No heartbeat from core client for 30 sec - exiting 00:01:27 (4440): No heartbeat from core client for 30 sec - exiting 00:01:28 (4440): No heartbeat from core client for 30 sec - exiting 00:01:29 (4440): No heartbeat from core client for 30 sec - exiting 00:01:30 (4440): No heartbeat from core client for 30 sec - exiting 00:01:31 (4440): No heartbeat from core client for 30 sec - exiting 00:01:32 (4440): No heartbeat from core client for 30 sec - exiting 00:01:33 (4440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:26:28 (2672): No heartbeat from core client for 30 sec - exiting 23:26:30 (2672): No heartbeat from core client for 30 sec - exiting 23:26:31 (2672): No heartbeat from core client for 30 sec - exiting 23:26:32 (2672): No heartbeat from core client for 30 sec - exiting 23:26:33 (2672): No heartbeat from core client for 30 sec - exiting 23:26:34 (2672): No heartbeat from core client for 30 sec - exiting 23:26:35 (2672): No heartbeat from core client for 30 sec - exiting 23:26:36 (2672): No heartbeat from core client for 30 sec - exiting 23:26:37 (2672): No heartbeat from core client for 30 sec - exiting 23:26:38 (2672): No heartbeat from core client for 30 sec - exiting 23:26:39 (2672): No heartbeat from core client for 30 sec - exiting 23:26:41 (2672): No heartbeat from core client for 30 sec - exiting 23:26:42 (2672): No heartbeat from core client for 30 sec - exiting 23:26:43 (2672): No heartbeat from core client for 30 sec - exiting 23:26:44 (2672): No heartbeat from core client for 30 sec - exiting 23:26:45 (2672): No heartbeat from core client for 30 sec - exiting 23:26:46 (2672): No heartbeat from core client for 30 sec - exiting 23:26:47 (2672): No heartbeat from core client for 30 sec - exiting 23:26:48 (2672): No heartbeat from core client for 30 sec - exiting 23:26:49 (2672): No heartbeat from core client for 30 sec - exiting 23:26:50 (2672): No heartbeat from core client for 30 sec - exiting 23:26:51 (2672): No heartbeat from core client for 30 sec - exiting 23:26:53 (2672): No heartbeat from core client for 30 sec - exiting 23:26:54 (2672): No heartbeat from core client for 30 sec - exiting 23:26:55 (2672): No heartbeat from core client for 30 sec - exiting 23:26:56 (2672): No heartbeat from core client for 30 sec - exiting 23:26:57 (2672): No heartbeat from core client for 30 sec - exiting 23:26:58 (2672): No heartbeat from core client for 30 sec - exiting 23:26:59 (2672): No heartbeat from core client for 30 sec - exiting 23:27:00 (2672): No heartbeat from core client for 30 sec - exiting 23:27:01 (2672): No heartbeat from core client for 30 sec - exiting 23:27:02 (2672): No heartbeat from core client for 30 sec - exiting 23:27:03 (2672): No heartbeat from core client for 30 sec - exiting 23:27:05 (2672): No heartbeat from core client for 30 sec - exiting 23:27:06 (2672): No heartbeat from core client for 30 sec - exiting 23:27:07 (2672): No heartbeat from core client for 30 sec - exiting 23:27:08 (2672): No heartbeat from core client for 30 sec - exiting 23:27:09 (2672): No heartbeat from core client for 30 sec - exiting 23:27:10 (2672): No heartbeat from core client for 30 sec - exiting 23:27:11 (2672): No heartbeat from core client for 30 sec - exiting 23:27:12 (2672): No heartbeat from core client for 30 sec - exiting 23:27:13 (2672): No heartbeat from core client for 30 sec - exiting 23:27:14 (2672): No heartbeat from core client for 30 sec - exiting 23:27:15 (2672): No heartbeat from core client for 30 sec - exiting 23:27:17 (2672): No heartbeat from core client for 30 sec - exiting 23:27:18 (2672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:34:39 (5696): No heartbeat from core client for 30 sec - exiting 23:34:41 (5696): No heartbeat from core client for 30 sec - exiting 23:34:42 (5696): No heartbeat from core client for 30 sec - exiting 23:34:43 (5696): No heartbeat from core client for 30 sec - exiting 23:34:44 (5696): No heartbeat from core client for 30 sec - exiting 23:34:45 (5696): No heartbeat from core client for 30 sec - exiting 23:34:46 (5696): No heartbeat from core client for 30 sec - exiting 23:34:47 (5696): No heartbeat from core client for 30 sec - exiting 23:34:48 (5696): No heartbeat from core client for 30 sec - exiting 23:34:49 (5696): No heartbeat from core client for 30 sec - exiting 23:34:50 (5696): No heartbeat from core client for 30 sec - exiting 23:34:51 (5696): No heartbeat from core client for 30 sec - exiting 23:34:52 (5696): No heartbeat from core client for 30 sec - exiting 23:34:53 (5696): No heartbeat from core client for 30 sec - exiting 23:34:54 (5696): No heartbeat from core client for 30 sec - exiting 23:34:55 (5696): No heartbeat from core client for 30 sec - exiting 23:34:56 (5696): No heartbeat from core client for 30 sec - exiting 23:34:57 (5696): No heartbeat from core client for 30 sec - exiting 23:34:58 (5696): No heartbeat from core client for 30 sec - exiting 23:34:59 (5696): No heartbeat from core client for 30 sec - exiting 23:35:00 (5696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:40:08 (1340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6828, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 23:16:38 (7060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:45:16 (4220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:15:50 (5772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:16:03 (6280): No heartbeat from core client for 30 sec - exiting 23:16:04 (6280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:11:19 (4012): No heartbeat from core client for 30 sec - exiting 23:11:20 (4012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/83jiko.pjj9c10 Error converting file to netcdf: dataout/83jiko.pij9c10 Error converting file to netcdf: dataout/83jiko.pfj9c10 Error converting file to netcdf: dataout/83jika.phj9c10 Error converting file to netcdf: dataout/83jika.pgj9c10 Error converting file to netcdf: dataout/83jika.pej9c10 Error converting file to netcdf: dataout/83jika.pdj9c10 23:38:40 (3776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:38:41 (3776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:25:11 (1884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:26:31 (956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:26:34 (2320): Can't acquire lockfile (32) - waiting 35s Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:31:32 (5820): No heartbeat from core client for 30 sec - exiting 23:31:33 (5820): No heartbeat from core client for 30 sec - exiting 23:31:34 (5820): No heartbeat from core client for 30 sec - exiting 23:31:35 (5820): No heartbeat from core client for 30 sec - exiting 23:31:36 (5820): No heartbeat from core client for 30 sec - exiting 23:31:37 (5820): No heartbeat from core client for 30 sec - exiting 23:31:38 (5820): No heartbeat from core client for 30 sec - exiting 23:31:39 (5820): No heartbeat from core client for 30 sec - exiting 23:31:40 (5820): No heartbeat from core client for 30 sec - exiting 23:31:42 (5820): No heartbeat from core client for 30 sec - exiting 23:31:43 (5820): No heartbeat from core client for 30 sec - exiting 23:31:44 (5820): No heartbeat from core client for 30 sec - exiting 23:31:45 (5820): No heartbeat from core client for 30 sec - exiting 23:31:46 (5820): No heartbeat from core client for 30 sec - exiting 23:31:47 (5820): No heartbeat from core client for 30 sec - exiting 23:31:48 (5820): No heartbeat from core client for 30 sec - exiting 23:31:49 (5820): No heartbeat from core client for 30 sec - exiting 23:31:50 (5820): No heartbeat from core client for 30 sec - exiting 23:31:51 (5820): No heartbeat from core client for 30 sec - exiting 23:31:53 (5820): No heartbeat from core client for 30 sec - exiting 23:31:54 (5820): No heartbeat from core client for 30 sec - exiting 23:31:55 (5820): No heartbeat from core client for 30 sec - exiting 23:31:56 (5820): No heartbeat from core client for 30 sec - exiting 23:31:57 (5820): No heartbeat from core client for 30 sec - exiting 23:31:58 (5820): No heartbeat from core client for 30 sec - exiting 23:31:59 (5820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:31:04 (7016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:40:34 (2344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:40:37 (2344): No heartbeat from core client for 30 sec - exiting 01:40:38 (2344): No heartbeat from core client for 30 sec - exiting 01:40:39 (2344): No heartbeat from core client for 30 sec - exiting 01:40:40 (2344): No heartbeat from core client for 30 sec - exiting 01:40:41 (2344): No heartbeat from core client for 30 sec - exiting 01:40:42 (2344): No heartbeat from core client for 30 sec - exiting 01:40:43 (2344): No heartbeat from core client for 30 sec - exiting 01:40:44 (2344): No heartbeat from core client for 30 sec - exiting 01:40:45 (2344): No heartbeat from core client for 30 sec - exiting 01:40:46 (2344): No heartbeat from core client for 30 sec - exiting 01:40:48 (2344): No heartbeat from core client for 30 sec - exiting 01:41:53 (5516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:52:04 (4024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:52:05 (4024): No heartbeat from core client for 30 sec - exiting 01:52:06 (4024): No heartbeat from core client for 30 sec - exiting 01:52:07 (4024): No heartbeat from core client for 30 sec - exiting 01:52:08 (4024): No heartbeat from core client for 30 sec - exiting 01:52:09 (4024): No heartbeat from core client for 30 sec - exiting 01:52:11 (4024): No heartbeat from core client for 30 sec - exiting 01:52:12 (4024): No heartbeat from core client for 30 sec - exiting 01:52:13 (4024): No heartbeat from core client for 30 sec - exiting 01:52:14 (4024): No heartbeat from core client for 30 sec - exiting 01:52:15 (4024): No heartbeat from core client for 30 sec - exiting 01:52:16 (4024): No heartbeat from core client for 30 sec - exiting 01:52:17 (4024): No heartbeat from core client for 30 sec - exiting 01:52:18 (4024): No heartbeat from core client for 30 sec - exiting 01:52:19 (4024): No heartbeat from core client for 30 sec - exiting 01:52:20 (4024): No heartbeat from core client for 30 sec - exiting 01:52:21 (4024): No heartbeat from core client for 30 sec - exiting 01:52:23 (4024): No heartbeat from core client for 30 sec - exiting 01:52:24 (4024): No heartbeat from core client for 30 sec - exiting 01:52:25 (4024): No heartbeat from core client for 30 sec - exiting 01:52:26 (4024): No heartbeat from core client for 30 sec - exiting 01:52:27 (4024): No heartbeat from core client for 30 sec - exiting 01:52:28 (4024): No heartbeat from core client for 30 sec - exiting 01:52:29 (4024): No heartbeat from core client for 30 sec - exiting 01:52:30 (4024): No heartbeat from core client for 30 sec - exiting 01:52:31 (4024): No heartbeat from core client for 30 sec - exiting 01:52:32 (4024): No heartbeat from core client for 30 sec - exiting 01:52:33 (4024): No heartbeat from core client for 30 sec - exiting 01:52:35 (4024): No heartbeat from core client for 30 sec - exiting 01:52:36 (4024): No heartbeat from core client for 30 sec - exiting 01:52:37 (4024): No heartbeat from core client for 30 sec - exiting 01:52:38 (4024): No heartbeat from core client for 30 sec - exiting 01:52:39 (4024): No heartbeat from core client for 30 sec - exiting 01:53:55 (5752): No heartbeat from core client for 30 sec - exiting 01:53:56 (5752): No heartbeat from core client for 30 sec - exiting 01:53:57 (5752): No heartbeat from core client for 30 sec - exiting 01:53:58 (5752): No heartbeat from core client for 30 sec - exiting 01:53:59 (5752): No heartbeat from core client for 30 sec - exiting 01:54:01 (5752): No heartbeat from core client for 30 sec - exiting 01:54:02 (5752): No heartbeat from core client for 30 sec - exiting 01:54:03 (5752): No heartbeat from core client for 30 sec - exiting 01:54:04 (5752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:58:39 (3440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:58:41 (3440): No heartbeat from core client for 30 sec - exiting 01:58:42 (3440): No heartbeat from core client for 30 sec - exiting 01:58:43 (3440): No heartbeat from core client for 30 sec - exiting 03:16:16 (1840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:16:17 (1840): No heartbeat from core client for 30 sec - exiting 03:17:15 (5232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:38:26 (6488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:38:27 (6488): No heartbeat from core client for 30 sec - exiting 08:38:28 (6488): No heartbeat from core client for 30 sec - exiting 08:39:14 (5068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:45:44 (3628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:45:45 (3628): No heartbeat from core client for 30 sec - exiting 08:45:46 (3628): No heartbeat from core client for 30 sec - exiting 08:45:47 (3628): No heartbeat from core client for 30 sec - exiting 08:46:27 (148): No heartbeat from core client for 30 sec - exiting 08:46:28 (148): No heartbeat from core client for 30 sec - exiting 08:46:29 (148): No heartbeat from core client for 30 sec - exiting 08:46:30 (148): No heartbeat from core client for 30 sec - exiting 08:46:31 (148): No heartbeat from core client for 30 sec - exiting 08:46:32 (148): No heartbeat from core client for 30 sec - exiting 08:46:33 (148): No heartbeat from core client for 30 sec - exiting 08:46:34 (148): No heartbeat from core client for 30 sec - exiting 08:46:35 (148): No heartbeat from core client for 30 sec - exiting 08:46:36 (148): No heartbeat from core client for 30 sec - exiting 08:46:37 (148): No heartbeat from core client for 30 sec - exiting 08:46:38 (148): No heartbeat from core client for 30 sec - exiting 08:46:39 (148): No heartbeat from core client for 30 sec - exiting 08:46:40 (148): No heartbeat from core client for 30 sec - exiting 08:46:41 (148): No heartbeat from core client for 30 sec - exiting 08:46:42 (148): No heartbeat from core client for 30 sec - exiting 08:46:43 (148): No heartbeat from core client for 30 sec - exiting 08:46:44 (148): No heartbeat from core client for 30 sec - exiting 08:46:45 (148): No heartbeat from core client for 30 sec - exiting 08:46:46 (148): No heartbeat from core client for 30 sec - exiting 08:46:47 (148): No heartbeat from core client for 30 sec - exiting 08:46:48 (148): No heartbeat from core client for 30 sec - exiting 08:46:49 (148): No heartbeat from core client for 30 sec - exiting 08:46:50 (148): No heartbeat from core client for 30 sec - exiting 08:46:51 (148): No heartbeat from core client for 30 sec - exiting 08:46:52 (148): No heartbeat from core client for 30 sec - exiting 08:46:53 (148): No heartbeat from core client for 30 sec - exiting 08:46:54 (148): No heartbeat from core client for 30 sec - exiting 08:46:55 (148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:58:31 (4592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:58:32 (4592): No heartbeat from core client for 30 sec - exiting 08:58:33 (4592): No heartbeat from core client for 30 sec - exiting 08:58:34 (4592): No heartbeat from core client for 30 sec - exiting 08:58:35 (4592): No heartbeat from core client for 30 sec - exiting 08:58:36 (4592): No heartbeat from core client for 30 sec - exiting 08:58:37 (4592): No heartbeat from core client for 30 sec - exiting 08:58:38 (4592): No heartbeat from core client for 30 sec - exiting 08:58:39 (4592): No heartbeat from core client for 30 sec - exiting 08:58:40 (4592): No heartbeat from core client for 30 sec - exiting 08:58:41 (4592): No heartbeat from core client for 30 sec - exiting 08:58:42 (4592): No heartbeat from core client for 30 sec - exiting 08:58:43 (4592): No heartbeat from core client for 30 sec - exiting 08:58:44 (4592): No heartbeat from core client for 30 sec - exiting 08:58:45 (4592): No heartbeat from core client for 30 sec - exiting 08:58:46 (4592): No heartbeat from core client for 30 sec - exiting 08:58:47 (4592): No heartbeat from core client for 30 sec - exiting 08:58:48 (4592): No heartbeat from core client for 30 sec - exiting 08:58:49 (4592): No heartbeat from core client for 30 sec - exiting 08:58:50 (4592): No heartbeat from core client for 30 sec - exiting 08:58:51 (4592): No heartbeat from core client for 30 sec - exiting 08:58:52 (4592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 23:32:14 (6360): No heartbeat from core client for 30 sec - exiting 23:32:15 (6360): No heartbeat from core client for 30 sec - exiting 23:32:16 (6360): No heartbeat from core client for 30 sec - exiting 23:32:17 (6360): No heartbeat from core client for 30 sec - exiting 23:32:18 (6360): No heartbeat from core client for 30 sec - exiting 23:32:19 (6360): No heartbeat from core client for 30 sec - exiting 23:32:20 (6360): No heartbeat from core client for 30 sec - exiting 23:32:21 (6360): No heartbeat from core client for 30 sec - exiting 23:32:23 (6360): No heartbeat from core client for 30 sec - exiting 23:32:24 (6360): No heartbeat from core client for 30 sec - exiting 23:32:25 (6360): No heartbeat from core client for 30 sec - exiting 23:32:26 (6360): No heartbeat from core client for 30 sec - exiting 23:32:27 (6360): No heartbeat from core client for 30 sec - exiting 23:32:28 (6360): No heartbeat from core client for 30 sec - exiting 23:32:29 (6360): No heartbeat from core client for 30 sec - exiting 23:32:30 (6360): No heartbeat from core client for 30 sec - exiting 23:32:31 (6360): No heartbeat from core client for 30 sec - exiting 23:32:32 (6360): No heartbeat from core client for 30 sec - exiting 23:32:33 (6360): No heartbeat from core client for 30 sec - exiting 23:32:35 (6360): No heartbeat from core client for 30 sec - exiting 23:32:36 (6360): No heartbeat from core client for 30 sec - exiting 23:32:37 (6360): No heartbeat from core client for 30 sec - exiting 23:32:38 (6360): No heartbeat from core client for 30 sec - exiting 23:32:39 (6360): No heartbeat from core client for 30 sec - exiting 23:32:40 (6360): No heartbeat from core client for 30 sec - exiting 23:32:41 (6360): No heartbeat from core client for 30 sec - exiting 23:32:42 (6360): No heartbeat from core client for 30 sec - exiting 23:32:43 (6360): No heartbeat from core client for 30 sec - exiting 23:32:44 (6360): No heartbeat from core client for 30 sec - exiting 23:32:45 (6360): No heartbeat from core client for 30 sec - exiting 23:32:47 (6360): No heartbeat from core client for 30 sec - exiting 23:32:48 (6360): No heartbeat from core client for 30 sec - exiting 23:32:49 (6360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:38:05 (6904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:38:06 (6904): No heartbeat from core client for 30 sec - exiting 23:38:07 (6904): No heartbeat from core client for 30 sec - exiting 00:28:42 (7152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:28:44 (7152): No heartbeat from core client for 30 sec - exiting 00:28:45 (7152): No heartbeat from core client for 30 sec - exiting 00:28:46 (7152): No heartbeat from core client for 30 sec - exiting 00:28:47 (7152): No heartbeat from core client for 30 sec - exiting 00:28:48 (7152): No heartbeat from core client for 30 sec - exiting 00:59:19 (5768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:59:21 (5768): No heartbeat from core client for 30 sec - exiting 00:59:22 (5768): No heartbeat from core client for 30 sec - exiting 00:59:23 (5768): No heartbeat from core client for 30 sec - exiting 01:32:13 (6184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:36:03 (6228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 01:42:14 (2924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:42:15 (2924): No heartbeat from core client for 30 sec - exiting 01:43:15 (5160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:43:16 (5160): No heartbeat from core client for 30 sec - exiting 01:43:18 (5160): No heartbeat from core client for 30 sec - exiting 01:43:19 (5160): No heartbeat from core client for 30 sec - exiting 01:43:20 (5160): No heartbeat from core client for 30 sec - exiting 01:52:16 (6368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:52:18 (6368): No heartbeat from core client for 30 sec - exiting 01:52:19 (6368): No heartbeat from core client for 30 sec - exiting 01:52:20 (6368): No heartbeat from core client for 30 sec - exiting 01:52:22 (6368): No heartbeat from core client for 30 sec - exiting 01:52:23 (6368): No heartbeat from core client for 30 sec - exiting 01:52:24 (6368): No heartbeat from core client for 30 sec - exiting 01:52:25 (6368): No heartbeat from core client for 30 sec - exiting 01:52:26 (6368): No heartbeat from core client for 30 sec - exiting 01:52:27 (6368): No heartbeat from core client for 30 sec - exiting 01:52:28 (6368): No heartbeat from core client for 30 sec - exiting 01:52:29 (6368): No heartbeat from core client for 30 sec - exiting 01:52:30 (6368): No heartbeat from core client for 30 sec - exiting 01:52:31 (6368): No heartbeat from core client for 30 sec - exiting 01:52:32 (6368): No heartbeat from core client for 30 sec - exiting 01:52:34 (6368): No heartbeat from core client for 30 sec - exiting 01:52:35 (6368): No heartbeat from core client for 30 sec - exiting 01:52:36 (6368): No heartbeat from core client for 30 sec - exiting 01:52:37 (6368): No heartbeat from core client for 30 sec - exiting 01:52:38 (6368): No heartbeat from core client for 30 sec - exiting 01:53:37 (3900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:02:17 (3600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:02:19 (3600): No heartbeat from core client for 30 sec - exiting 02:02:20 (3600): No heartbeat from core client for 30 sec - exiting 02:02:21 (3600): No heartbeat from core client for 30 sec - exiting 02:03:07 (7164): No heartbeat from core client for 30 sec - exiting 02:03:08 (7164): No heartbeat from core client for 30 sec - exiting 02:03:09 (7164): No heartbeat from core client for 30 sec - exiting 02:03:10 (7164): No heartbeat from core client for 30 sec - exiting 02:03:12 (7164): No heartbeat from core client for 30 sec - exiting 02:03:13 (7164): No heartbeat from core client for 30 sec - exiting 02:03:14 (7164): No heartbeat from core client for 30 sec - exiting 02:03:15 (7164): No heartbeat from core client for 30 sec - exiting 02:03:16 (7164): No heartbeat from core client for 30 sec - exiting 02:03:17 (7164): No heartbeat from core client for 30 sec - exiting 02:03:18 (7164): No heartbeat from core client for 30 sec - exiting 02:03:19 (7164): No heartbeat from core client for 30 sec - exiting 02:03:20 (7164): No heartbeat from core client for 30 sec - exiting 02:03:21 (7164): No heartbeat from core client for 30 sec - exiting 02:03:22 (7164): No heartbeat from core client for 30 sec - exiting 02:03:24 (7164): No heartbeat from core client for 30 sec - exiting 02:03:25 (7164): No heartbeat from core client for 30 sec - exiting 02:03:26 (7164): No heartbeat from core client for 30 sec - exiting 02:03:27 (7164): No heartbeat from core client for 30 sec - exiting 02:03:28 (7164): No heartbeat from core client for 30 sec - exiting 02:03:29 (7164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:03:30 (7164): No heartbeat from core client for 30 sec - exiting 02:12:19 (4140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:12:20 (4140): No heartbeat from core client for 30 sec - exiting 02:12:21 (4140): No heartbeat from core client for 30 sec - exiting 02:12:22 (4140): No heartbeat from core client for 30 sec - exiting 02:12:23 (4140): No heartbeat from core client for 30 sec - exiting 02:12:24 (4140): No heartbeat from core client for 30 sec - exiting 02:12:25 (4140): No heartbeat from core client for 30 sec - exiting 02:14:15 (5332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:22:20 (2976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:22:21 (2976): No heartbeat from core client for 30 sec - exiting 02:22:22 (2976): No heartbeat from core client for 30 sec - exiting 02:22:24 (2976): No heartbeat from core client for 30 sec - exiting 02:23:35 (6880): No heartbeat from core client for 30 sec - exiting 02:23:36 (6880): No heartbeat from core client for 30 sec - exiting 02:23:37 (6880): No heartbeat from core client for 30 sec - exiting 02:23:38 (6880): No heartbeat from core client for 30 sec - exiting 02:23:39 (6880): No heartbeat from core client for 30 sec - exiting 02:23:40 (6880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:32:21 (6656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:32:22 (6656): No heartbeat from core client for 30 sec - exiting 02:32:23 (6656): No heartbeat from core client for 30 sec - exiting 02:32:24 (6656): No heartbeat from core client for 30 sec - exiting 02:32:25 (6656): No heartbeat from core client for 30 sec - exiting 02:32:26 (6656): No heartbeat from core client for 30 sec - exiting 02:33:32 (4120): No heartbeat from core client for 30 sec - exiting 02:33:33 (4120): No heartbeat from core client for 30 sec - exiting 02:33:35 (4120): No heartbeat from core client for 30 sec - exiting 02:33:36 (4120): No heartbeat from core client for 30 sec - exiting 02:33:37 (4120): No heartbeat from core client for 30 sec - exiting 02:33:38 (4120): No heartbeat from core client for 30 sec - exiting 02:33:39 (4120): No heartbeat from core client for 30 sec - exiting 02:33:40 (4120): No heartbeat from core client for 30 sec - exiting 02:33:41 (4120): No heartbeat from core client for 30 sec - exiting 02:33:42 (4120): No heartbeat from core client for 30 sec - exiting 02:33:43 (4120): No heartbeat from core client for 30 sec - exiting 02:33:44 (4120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:37:47 (5900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:36:12 (3816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:36:13 (3816): No heartbeat from core client for 30 sec - exiting 03:36:15 (3816): No heartbeat from core client for 30 sec - exiting 03:37:19 (4864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:48:55 (5760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:48:57 (5760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:11:33 (7156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:12:17 (6568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:16:05 (3704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:45:29 (5848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:45:30 (5848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 03:18:48 (6912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2856, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Jan 2014 07:51:53	1266852	16101362	hadcm3n_83ji_1980_40_008462529_1	1,036,800	1,714,511	1.6537
25 Jan 2014 03:56:18	1266852	16101362	hadcm3n_83ji_1980_40_008462529_1	1,010,880	1,667,447	1.6495
24 Jan 2014 22:50:15	1266852	16101362	hadcm3n_83ji_1980_40_008462529_1	984,960	1,620,204	1.6449
22 Jan 2014 06:48:03	1266852	16101362	hadcm3n_83ji_1980_40_008462529_1	959,040	1,572,100	1.6392
21 Jan 2014 03:03:49	1266852	16101362	hadcm3n_83ji_1980_40_008462529_1	933,120	1,525,153	1.6345
20 Jan 2014 01:23:44	1266852	16101362	hadcm3n_83ji_1980_40_008462529_1	907,200	1,479,604	1.6310
18 Jan 2014 07:51:50	1266852	16101362	hadcm3n_83ji_1980_40_008462529_1	881,280	1,432,298	1.6252
17 Jan 2014 05:21:20	1266852	16101362	hadcm3n_83ji_1980_40_008462529_1	855,360	1,384,729	1.6189
16 Jan 2014 02:11:56	1266852	16101362	hadcm3n_83ji_1980_40_008462529_1	829,440	1,336,924	1.6118
14 Jan 2014 08:02:51	1266852	16101362	hadcm3n_83ji_1980_40_008462529_1	803,520	1,289,101	1.6043
13 Jan 2014 05:37:11	1266852	16101362	hadcm3n_83ji_1980_40_008462529_1	777,600	1,243,549	1.5992
12 Jan 2014 03:02:04	1266852	16101362	hadcm3n_83ji_1980_40_008462529_1	751,680	1,198,797	1.5948
11 Jan 2014 01:09:32	1266852	16101362	hadcm3n_83ji_1980_40_008462529_1	725,760	1,155,197	1.5917
09 Jan 2014 23:04:29	1266852	16101362	hadcm3n_83ji_1980_40_008462529_1	699,840	1,112,562	1.5897
08 Jan 2014 07:45:31	1266852	16101362	hadcm3n_83ji_1980_40_008462529_1	673,920	1,068,740	1.5859
07 Jan 2014 05:57:17	1266852	16101362	hadcm3n_83ji_1980_40_008462529_1	648,000	1,025,411	1.5824
06 Jan 2014 02:47:02	1266852	16101362	hadcm3n_83ji_1980_40_008462529_1	622,080	986,297	1.5855
04 Jan 2014 03:13:32	1266852	16101362	hadcm3n_83ji_1980_40_008462529_1	596,160	950,315	1.5941
02 Jan 2014 23:33:31	1266852	16101362	hadcm3n_83ji_1980_40_008462529_1	570,240	909,318	1.5946
01 Jan 2014 05:53:33	1266852	16101362	hadcm3n_83ji_1980_40_008462529_1	544,320	868,031	1.5947