Task 13025104

Name	hadcm3n_t511_1940_40_007315962_0
Workunit	7513392
Created	29 Jun 2011, 0:22:22 UTC
Sent	29 Jun 2011, 0:26:56 UTC
Report deadline	28 Sep 2011, 7:54:07 UTC
Received	28 Sep 2011, 0:15:37 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1155255
Run time	25 days 23 hours 59 min 58 sec
CPU time	23 days 1 hours 45 min 27 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.19 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> RetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:16:46 (2024): No heartbeat from core client for 30 sec - exiting 09:16:48 (2024): No heartbeat from core client for 30 sec - exiting 09:16:49 (2024): No heartbeat from core client for 30 sec - exiting 09:16:50 (2024): No heartbeat from core client for 30 sec - exiting 09:16:51 (2024): No heartbeat from core client for 30 sec - exiting 09:16:52 (2024): No heartbeat from core client for 30 sec - exiting 09:16:53 (2024): No heartbeat from core client for 30 sec - exiting 09:16:54 (2024): No heartbeat from core client for 30 sec - exiting 09:16:55 (2024): No heartbeat from core client for 30 sec - exiting 09:16:56 (2024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:56:15 (3416): No heartbeat from core client for 30 sec - exiting 15:56:16 (3416): No heartbeat from core client for 30 sec - exiting 15:56:17 (3416): No heartbeat from core client for 30 sec - exiting 15:56:18 (3416): No heartbeat from core client for 30 sec - exiting 15:56:19 (3416): No heartbeat from core client for 30 sec - exiting 15:56:20 (3416): No heartbeat from core client for 30 sec - exiting 15:56:21 (3416): No heartbeat from core client for 30 sec - exiting 15:56:22 (3416): No heartbeat from core client for 30 sec - exiting 15:56:23 (3416): No heartbeat from core client for 30 sec - exiting 15:56:25 (3416): No heartbeat from core client for 30 sec - exiting 15:56:26 (3416): No heartbeat from core client for 30 sec - exiting 15:56:27 (3416): No heartbeat from core client for 30 sec - exiting 15:56:28 (3416): No heartbeat from core client for 30 sec - exiting 15:56:29 (3416): No heartbeat from core client for 30 sec - exiting 15:56:30 (3416): No heartbeat from core client for 30 sec - exiting 15:56:31 (3416): No heartbeat from core client for 30 sec - exiting 15:56:32 (3416): No heartbeat from core client for 30 sec - exiting 15:56:33 (3416): No heartbeat from core client for 30 sec - exiting 15:56:34 (3416): No heartbeat from core client for 30 sec - exiting 15:56:36 (3416): No heartbeat from core client for 30 sec - exiting 15:56:37 (3416): No heartbeat from core client for 30 sec - exiting 15:56:38 (3416): No heartbeat from core client for 30 sec - exiting 15:56:39 (3416): No heartbeat from core client for 30 sec - exiting 15:56:40 (3416): No heartbeat from core client for 30 sec - exiting 15:56:41 (3416): No heartbeat from core client for 30 sec - exiting 15:56:42 (3416): No heartbeat from core client for 30 sec - exiting 15:56:43 (3416): No heartbeat from core client for 30 sec - exiting 15:56:44 (3416): No heartbeat from core client for 30 sec - exiting 15:56:46 (3416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on t511ka.dag97k0 Atmos Hold Restart file rename failed on atmos_restart.hold 16:35:27 (3404): No heartbeat from core client for 30 sec - exiting 16:35:28 (3404): No heartbeat from core client for 30 sec - exiting 16:35:29 (3404): No heartbeat from core client for 30 sec - exiting 16:35:31 (3404): No heartbeat from core client for 30 sec - exiting 16:35:32 (3404): No heartbeat from core client for 30 sec - exiting 16:35:33 (3404): No heartbeat from core client for 30 sec - exiting 16:35:34 (3404): No heartbeat from core client for 30 sec - exiting 16:35:35 (3404): No heartbeat from core client for 30 sec - exiting 16:35:36 (3404): No heartbeat from core client for 30 sec - exiting 16:35:37 (3404): No heartbeat from core client for 30 sec - exiting 16:35:38 (3404): No heartbeat from core client for 30 sec - exiting 16:35:39 (3404): No heartbeat from core client for 30 sec - exiting 16:35:40 (3404): No heartbeat from core client for 30 sec - exiting 16:35:42 (3404): No heartbeat from core client for 30 sec - exiting 16:35:43 (3404): No heartbeat from core client for 30 sec - exiting 16:35:44 (3404): No heartbeat from core client for 30 sec - exiting 16:35:45 (3404): No heartbeat from core client for 30 sec - exiting 16:35:46 (3404): No heartbeat from core client for 30 sec - exiting 16:35:47 (3404): No heartbeat from core client for 30 sec - exiting 16:35:48 (3404): No heartbeat from core client for 30 sec - exiting 16:35:49 (3404): No heartbeat from core client for 30 sec - exiting 16:35:50 (3404): No heartbeat from core client for 30 sec - exiting 16:35:51 (3404): No heartbeat from core client for 30 sec - exiting 16:35:52 (3404): No heartbeat from core client for 30 sec - exiting 16:35:54 (3404): No heartbeat from core client for 30 sec - exiting 16:35:55 (3404): No heartbeat from core client for 30 sec - exiting 16:35:56 (3404): No heartbeat from core client for 30 sec - exiting 16:35:57 (3404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:31:21 (2760): No heartbeat from core client for 30 sec - exiting 08:31:22 (2760): No heartbeat from core client for 30 sec - exiting 08:31:23 (2760): No heartbeat from core client for 30 sec - exiting 08:31:24 (2760): No heartbeat from core client for 30 sec - exiting 08:31:25 (2760): No heartbeat from core client for 30 sec - exiting 08:31:26 (2760): No heartbeat from core client for 30 sec - exiting 08:31:27 (2760): No heartbeat from core client for 30 sec - exiting 08:31:28 (2760): No heartbeat from core client for 30 sec - exiting 08:31:29 (2760): No heartbeat from core client for 30 sec - exiting 08:31:31 (2760): No heartbeat from core client for 30 sec - exiting 08:31:32 (2760): No heartbeat from core client for 30 sec - exiting 08:31:33 (2760): No heartbeat from core client for 30 sec - exiting 08:31:34 (2760): No heartbeat from core client for 30 sec - exiting 08:31:35 (2760): No heartbeat from core client for 30 sec - exiting 08:31:36 (2760): No heartbeat from core client for 30 sec - exiting 08:31:37 (2760): No heartbeat from core client for 30 sec - exiting 08:31:38 (2760): No heartbeat from core client for 30 sec - exiting 08:31:39 (2760): No heartbeat from core client for 30 sec - exiting 08:31:40 (2760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:25:07 (332): No heartbeat from core client for 30 sec - exiting 12:25:08 (332): No heartbeat from core client for 30 sec - exiting 12:25:09 (332): No heartbeat from core client for 30 sec - exiting 12:25:10 (332): No heartbeat from core client for 30 sec - exiting 12:25:11 (332): No heartbeat from core client for 30 sec - exiting 12:25:12 (332): No heartbeat from core client for 30 sec - exiting 12:25:13 (332): No heartbeat from core client for 30 sec - exiting 12:25:14 (332): No heartbeat from core client for 30 sec - exiting 12:25:16 (332): No heartbeat from core client for 30 sec - exiting 12:25:17 (332): No heartbeat from core client for 30 sec - exiting 12:25:18 (332): No heartbeat from core client for 30 sec - exiting 12:25:19 (332): No heartbeat from core client for 30 sec - exiting 12:25:20 (332): No heartbeat from core client for 30 sec - exiting 12:25:21 (332): No heartbeat from core client for 30 sec - exiting 12:25:22 (332): No heartbeat from core client for 30 sec - exiting 12:25:23 (332): No heartbeat from core client for 30 sec - exiting 12:25:24 (332): No heartbeat from core client for 30 sec - exiting 12:25:25 (332): No heartbeat from core client for 30 sec - exiting 12:25:27 (332): No heartbeat from core client for 30 sec - exiting 12:25:28 (332): No heartbeat from core client for 30 sec - exiting 12:25:29 (332): No heartbeat from core client for 30 sec - exiting 12:25:30 (332): No heartbeat from core client for 30 sec - exiting 12:25:31 (332): No heartbeat from core client for 30 sec - exiting 12:25:32 (332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:41:33 (2164): No heartbeat from core client for 30 sec - exiting 08:41:34 (2164): No heartbeat from core client for 30 sec - exiting 08:41:35 (2164): No heartbeat from core client for 30 sec - exiting 08:41:36 (2164): No heartbeat from core client for 30 sec - exiting 08:41:37 (2164): No heartbeat from core client for 30 sec - exiting 08:41:38 (2164): No heartbeat from core client for 30 sec - exiting 08:41:39 (2164): No heartbeat from core client for 30 sec - exiting 08:41:40 (2164): No heartbeat from core client for 30 sec - exiting 08:41:41 (2164): No heartbeat from core client for 30 sec - exiting 08:41:42 (2164): No heartbeat from core client for 30 sec - exiting 08:41:44 (2164): No heartbeat from core client for 30 sec - exiting 08:41:45 (2164): No heartbeat from core client for 30 sec - exiting 08:41:46 (2164): No heartbeat from core client for 30 sec - exiting 08:41:47 (2164): No heartbeat from core client for 30 sec - exiting 08:41:48 (2164): No heartbeat from core client for 30 sec - exiting 08:41:49 (2164): No heartbeat from core client for 30 sec - exiting 08:41:50 (2164): No heartbeat from core client for 30 sec - exiting 08:41:51 (2164): No heartbeat from core client for 30 sec - exiting 08:41:52 (2164): No heartbeat from core client for 30 sec - exiting 08:41:53 (2164): No heartbeat from core client for 30 sec - exiting 08:41:55 (2164): No heartbeat from core client for 30 sec - exiting 08:41:56 (2164): No heartbeat from core client for 30 sec - exiting 08:41:57 (2164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:29:51 (2152): No heartbeat from core client for 30 sec - exiting 08:29:52 (2152): No heartbeat from core client for 30 sec - exiting 08:29:53 (2152): No heartbeat from core client for 30 sec - exiting 08:29:55 (2152): No heartbeat from core client for 30 sec - exiting 08:29:56 (2152): No heartbeat from core client for 30 sec - exiting 08:29:57 (2152): No heartbeat from core client for 30 sec - exiting 08:29:58 (2152): No heartbeat from core client for 30 sec - exiting 08:29:59 (2152): No heartbeat from core client for 30 sec - exiting 08:30:00 (2152): No heartbeat from core client for 30 sec - exiting 08:30:01 (2152): No heartbeat from core client for 30 sec - exiting 08:30:02 (2152): No heartbeat from core client for 30 sec - exiting 08:30:03 (2152): No heartbeat from core client for 30 sec - exiting 08:30:04 (2152): No heartbeat from core client for 30 sec - exiting 08:30:05 (2152): No heartbeat from core client for 30 sec - exiting 08:30:07 (2152): No heartbeat from core client for 30 sec - exiting 08:30:08 (2152): No heartbeat from core client for 30 sec - exiting 08:30:09 (2152): No heartbeat from core client for 30 sec - exiting 08:30:10 (2152): No heartbeat from core client for 30 sec - exiting 08:30:11 (2152): No heartbeat from core client for 30 sec - exiting 08:30:12 (2152): No heartbeat from core client for 30 sec - exiting 08:30:13 (2152): No heartbeat from core client for 30 sec - exiting 08:30:14 (2152): No heartbeat from core client for 30 sec - exiting 08:30:15 (2152): No heartbeat from core client for 30 sec - exiting 08:30:16 (2152): No heartbeat from core client for 30 sec - exiting 08:30:18 (2152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:01:39 (256): No heartbeat from core client for 30 sec - exiting 09:01:40 (256): No heartbeat from core client for 30 sec - exiting 09:01:41 (256): No heartbeat from core client for 30 sec - exiting 09:01:42 (256): No heartbeat from core client for 30 sec - exiting 09:01:43 (256): No heartbeat from core client for 30 sec - exiting 09:01:45 (256): No heartbeat from core client for 30 sec - exiting 09:01:46 (256): No heartbeat from core client for 30 sec - exiting 09:01:47 (256): No heartbeat from core client for 30 sec - exiting 09:01:48 (256): No heartbeat from core client for 30 sec - exiting 09:01:49 (256): No heartbeat from core client for 30 sec - exiting 09:01:50 (256): No heartbeat from core client for 30 sec - exiting 09:01:51 (256): No heartbeat from core client for 30 sec - exiting 09:01:52 (256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:46:33 (2016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:29:12 (2940): No heartbeat from core client for 30 sec - exiting 10:29:13 (2940): No heartbeat from core client for 30 sec - exiting 10:29:14 (2940): No heartbeat from core client for 30 sec - exiting 10:29:15 (2940): No heartbeat from core client for 30 sec - exiting 10:29:17 (2940): No heartbeat from core client for 30 sec - exiting 10:29:18 (2940): No heartbeat from core client for 30 sec - exiting 10:29:19 (2940): No heartbeat from core client for 30 sec - exiting 10:29:20 (2940): No heartbeat from core client for 30 sec - exiting 10:29:21 (2940): No heartbeat from core client for 30 sec - exiting 10:29:22 (2940): No heartbeat from core client for 30 sec - exiting 10:29:23 (2940): No heartbeat from core client for 30 sec - exiting 10:29:24 (2940): No heartbeat from core client for 30 sec - exiting 10:29:25 (2940): No heartbeat from core client for 30 sec - exiting 10:29:26 (2940): No heartbeat from core client for 30 sec - exiting 10:29:28 (2940): No heartbeat from core client for 30 sec - exiting 10:29:29 (2940): No heartbeat from core client for 30 sec - exiting 10:29:30 (2940): No heartbeat from core client for 30 sec - exiting 10:29:31 (2940): No heartbeat from core client for 30 sec - exiting 10:29:32 (2940): No heartbeat from core client for 30 sec - exiting 10:29:33 (2940): No heartbeat from core client for 30 sec - exiting 10:29:34 (2940): No heartbeat from core client for 30 sec - exiting 10:29:35 (2940): No heartbeat from core client for 30 sec - exiting 10:29:36 (2940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:20:30 (3164): No heartbeat from core client for 30 sec - exiting 08:20:31 (3164): No heartbeat from core client for 30 sec - exiting 08:20:32 (3164): No heartbeat from core client for 30 sec - exiting 08:20:33 (3164): No heartbeat from core client for 30 sec - exiting 08:20:34 (3164): No heartbeat from core client for 30 sec - exiting 08:20:35 (3164): No heartbeat from core client for 30 sec - exiting 08:20:37 (3164): No heartbeat from core client for 30 sec - exiting 08:20:38 (3164): No heartbeat from core client for 30 sec - exiting 08:20:39 (3164): No heartbeat from core client for 30 sec - exiting 08:20:40 (3164): No heartbeat from core client for 30 sec - exiting 08:20:41 (3164): No heartbeat from core client for 30 sec - exiting 08:20:42 (3164): No heartbeat from core client for 30 sec - exiting 08:20:43 (3164): No heartbeat from core client for 30 sec - exiting 08:20:44 (3164): No heartbeat from core client for 30 sec - exiting 08:20:45 (3164): No heartbeat from core client for 30 sec - exiting 08:20:46 (3164): No heartbeat from core client for 30 sec - exiting 08:20:47 (3164): No heartbeat from core client for 30 sec - exiting 08:20:49 (3164): No heartbeat from core client for 30 sec - exiting 08:20:50 (3164): No heartbeat from core client for 30 sec - exiting 08:20:51 (3164): No heartbeat from core client for 30 sec - exiting 08:20:52 (3164): No heartbeat from core client for 30 sec - exiting 08:20:53 (3164): No heartbeat from core client for 30 sec - exiting 08:20:54 (3164): No heartbeat from core client for 30 sec - exiting 08:20:55 (3164): No heartbeat from core client for 30 sec - exiting 08:20:56 (3164): No heartbeat from core client for 30 sec - exiting 08:20:57 (3164): No heartbeat from core client for 30 sec - exiting 08:20:58 (3164): No heartbeat from core client for 30 sec - exiting 08:20:59 (3164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:21:01 (3164): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:43:00 (1092): No heartbeat from core client for 30 sec - exiting 08:43:01 (1092): No heartbeat from core client for 30 sec - exiting 08:43:02 (1092): No heartbeat from core client for 30 sec - exiting 08:43:04 (1092): No heartbeat from core client for 30 sec - exiting 08:43:05 (1092): No heartbeat from core client for 30 sec - exiting 08:43:06 (1092): No heartbeat from core client for 30 sec - exiting 08:43:07 (1092): No heartbeat from core client for 30 sec - exiting 08:43:08 (1092): No heartbeat from core client for 30 sec - exiting 08:43:09 (1092): No heartbeat from core client for 30 sec - exiting 08:43:10 (1092): No heartbeat from core client for 30 sec - exiting 08:43:11 (1092): No heartbeat from core client for 30 sec - exiting 08:43:12 (1092): No heartbeat from core client for 30 sec - exiting 08:43:13 (1092): No heartbeat from core client for 30 sec - exiting 08:43:14 (1092): No heartbeat from core client for 30 sec - exiting 08:43:16 (1092): No heartbeat from core client for 30 sec - exiting 08:43:17 (1092): No heartbeat from core client for 30 sec - exiting 08:43:18 (1092): No heartbeat from core client for 30 sec - exiting 08:43:19 (1092): No heartbeat from core client for 30 sec - exiting 08:43:20 (1092): No heartbeat from core client for 30 sec - exiting 08:43:21 (1092): No heartbeat from core client for 30 sec - exiting 08:43:22 (1092): No heartbeat from core client for 30 sec - exiting 08:43:23 (1092): No heartbeat from core client for 30 sec - exiting 08:43:24 (1092): No heartbeat from core client for 30 sec - exiting 08:43:25 (1092): No heartbeat from core client for 30 sec - exiting 08:43:26 (1092): No heartbeat from core client for 30 sec - exiting 08:43:28 (1092): No heartbeat from core client for 30 sec - exiting 08:43:29 (1092): No heartbeat from core client for 30 sec - exiting 08:43:30 (1092): No heartbeat from core client for 30 sec - exiting 08:43:31 (1092): No heartbeat from core client for 30 sec - exiting 08:43:32 (1092): No heartbeat from core client for 30 sec - exiting 08:43:33 (1092): No heartbeat from core client for 30 sec - exiting 08:43:34 (1092): No heartbeat from core client for 30 sec - exiting 08:43:35 (1092): No heartbeat from core client for 30 sec - exiting 08:43:36 (1092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:42:30 (184): No heartbeat from core client for 30 sec - exiting 08:42:31 (184): No heartbeat from core client for 30 sec - exiting 08:42:32 (184): No heartbeat from core client for 30 sec - exiting 08:42:33 (184): No heartbeat from core client for 30 sec - exiting 08:42:34 (184): No heartbeat from core client for 30 sec - exiting 08:42:35 (184): No heartbeat from core client for 30 sec - exiting 08:42:36 (184): No heartbeat from core client for 30 sec - exiting 08:42:37 (184): No heartbeat from core client for 30 sec - exiting 08:42:38 (184): No heartbeat from core client for 30 sec - exiting 08:42:39 (184): No heartbeat from core client for 30 sec - exiting 08:42:41 (184): No heartbeat from core client for 30 sec - exiting 08:42:42 (184): No heartbeat from core client for 30 sec - exiting 08:42:43 (184): No heartbeat from core client for 30 sec - exiting 08:42:44 (184): No heartbeat from core client for 30 sec - exiting 08:42:45 (184): No heartbeat from core client for 30 sec - exiting 08:42:46 (184): No heartbeat from core client for 30 sec - exiting 08:42:47 (184): No heartbeat from core client for 30 sec - exiting 08:42:48 (184): No heartbeat from core client for 30 sec - exiting 08:42:49 (184): No heartbeat from core client for 30 sec - exiting 08:42:50 (184): No heartbeat from core client for 30 sec - exiting 08:42:52 (184): No heartbeat from core client for 30 sec - exiting 08:42:53 (184): No heartbeat from core client for 30 sec - exiting 08:42:54 (184): No heartbeat from core client for 30 sec - exiting 08:42:55 (184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:42:56 (184): No heartbeat from core client for 30 sec - exiting 08:42:57 (184): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:59:32 (2088): No heartbeat from core client for 30 sec - exiting 08:59:33 (2088): No heartbeat from core client for 30 sec - exiting 08:59:34 (2088): No heartbeat from core client for 30 sec - exiting 08:59:35 (2088): No heartbeat from core client for 30 sec - exiting 08:59:36 (2088): No heartbeat from core client for 30 sec - exiting 08:59:37 (2088): No heartbeat from core client for 30 sec - exiting 08:59:38 (2088): No heartbeat from core client for 30 sec - exiting 08:59:39 (2088): No heartbeat from core client for 30 sec - exiting 08:59:41 (2088): No heartbeat from core client for 30 sec - exiting 08:59:42 (2088): No heartbeat from core client for 30 sec - exiting 08:59:43 (2088): No heartbeat from core client for 30 sec - exiting 08:59:44 (2088): No heartbeat from core client for 30 sec - exiting 08:59:45 (2088): No heartbeat from core client for 30 sec - exiting 08:59:46 (2088): No heartbeat from core client for 30 sec - exiting 08:59:47 (2088): No heartbeat from core client for 30 sec - exiting 08:59:48 (2088): No heartbeat from core client for 30 sec - exiting 08:59:49 (2088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:34:43 (4008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2920, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2920, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Sep 2011 23:12:20	1155255	13025104	hadcm3n_t511_1940_40_007315962_0	1,036,800	1,993,524	1.9228
24 Sep 2011 19:24:20	1155255	13025104	hadcm3n_t511_1940_40_007315962_0	1,010,880	1,940,723	1.9198
23 Sep 2011 18:25:14	1155255	13025104	hadcm3n_t511_1940_40_007315962_0	984,960	1,887,534	1.9164
23 Sep 2011 01:09:47	1155255	13025104	hadcm3n_t511_1940_40_007315962_0	959,040	1,844,812	1.9236
22 Sep 2011 06:56:31	1155255	13025104	hadcm3n_t511_1940_40_007315962_0	933,120	1,786,902	1.9150
21 Sep 2011 12:49:22	1155255	13025104	hadcm3n_t511_1940_40_007315962_0	907,200	1,729,203	1.9061
20 Sep 2011 21:13:50	1155255	13025104	hadcm3n_t511_1940_40_007315962_0	881,280	1,678,920	1.9051
20 Sep 2011 06:52:10	1155255	13025104	hadcm3n_t511_1940_40_007315962_0	855,360	1,631,252	1.9071
14 Sep 2011 06:23:58	1155255	13025104	hadcm3n_t511_1940_40_007315962_0	829,440	1,582,567	1.9080
07 Sep 2011 01:46:27	1155255	13025104	hadcm3n_t511_1940_40_007315962_0	803,520	1,531,833	1.9064
01 Sep 2011 10:03:13	1155255	13025104	hadcm3n_t511_1940_40_007315962_0	777,600	1,481,547	1.9053
31 Aug 2011 05:31:21	1155255	13025104	hadcm3n_t511_1940_40_007315962_0	751,680	1,433,275	1.9068
24 Aug 2011 00:20:46	1155255	13025104	hadcm3n_t511_1940_40_007315962_0	725,760	1,385,118	1.9085
23 Aug 2011 03:12:57	1155255	13025104	hadcm3n_t511_1940_40_007315962_0	699,840	1,335,545	1.9084
21 Aug 2011 10:10:35	1155255	13025104	hadcm3n_t511_1940_40_007315962_0	673,920	1,288,787	1.9124
13 Aug 2011 23:44:15	1155255	13025104	hadcm3n_t511_1940_40_007315962_0	648,000	1,239,657	1.9131
13 Aug 2011 07:57:46	1155255	13025104	hadcm3n_t511_1940_40_007315962_0	622,080	1,189,945	1.9128
12 Aug 2011 16:08:53	1155255	13025104	hadcm3n_t511_1940_40_007315962_0	596,160	1,140,341	1.9128
10 Aug 2011 04:42:37	1155255	13025104	hadcm3n_t511_1940_40_007315962_0	570,240	1,091,338	1.9138
09 Aug 2011 10:00:30	1155255	13025104	hadcm3n_t511_1940_40_007315962_0	544,320	1,039,720	1.9101