Task 16297626

Name	hadcm3n_n2d7_1880_40_008374029_3
Workunit	8524888
Created	1 Mar 2014, 16:34:07 UTC
Sent	1 Mar 2014, 16:34:18 UTC
Report deadline	1 Jun 2014, 0:01:29 UTC
Received	18 Mar 2014, 20:07:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1212599
Run time	15 days 21 hours 16 min 56 sec
CPU time	10 days 3 hours 58 min 20 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.03 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... 03:05:17 (16608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:05:18 (16608): No heartbeat from core client for 30 sec - exiting 03:05:19 (16608): No heartbeat from core client for 30 sec - exiting 03:05:20 (16608): No heartbeat from core client for 30 sec - exiting 03:19:07 (2936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:19:09 (2936): No heartbeat from core client for 30 sec - exiting 03:25:58 (14184): No heartbeat from core client for 30 sec - exiting 03:25:59 (14184): No heartbeat from core client for 30 sec - exiting 03:26:00 (14184): No heartbeat from core client for 30 sec - exiting 03:26:01 (14184): No heartbeat from core client for 30 sec - exiting 03:26:02 (14184): No heartbeat from core client for 30 sec - exiting 03:26:03 (14184): No heartbeat from core client for 30 sec - exiting 03:26:04 (14184): No heartbeat from core client for 30 sec - exiting 03:26:05 (14184): No heartbeat from core client for 30 sec - exiting 03:26:06 (14184): No heartbeat from core client for 30 sec - exiting 03:26:07 (14184): No heartbeat from core client for 30 sec - exiting 03:26:08 (14184): No heartbeat from core client for 30 sec - exiting 03:26:09 (14184): No heartbeat from core client for 30 sec - exiting 03:26:10 (14184): No heartbeat from core client for 30 sec - exiting 03:26:11 (14184): No heartbeat from core client for 30 sec - exiting 03:26:12 (14184): No heartbeat from core client for 30 sec - exiting 03:26:13 (14184): No heartbeat from core client for 30 sec - exiting 03:26:14 (14184): No heartbeat from core client for 30 sec - exiting 03:26:15 (14184): No heartbeat from core client for 30 sec - exiting 03:26:16 (14184): No heartbeat from core client for 30 sec - exiting 03:26:17 (14184): No heartbeat from core client for 30 sec - exiting 03:26:18 (14184): No heartbeat from core client for 30 sec - exiting 03:26:19 (14184): No heartbeat from core client for 30 sec - exiting 03:26:20 (14184): No heartbeat from core client for 30 sec - exiting 03:26:21 (14184): No heartbeat from core client for 30 sec - exiting 03:26:22 (14184): No heartbeat from core client for 30 sec - exiting 03:26:23 (14184): No heartbeat from core client for 30 sec - exiting 03:26:24 (14184): No heartbeat from core client for 30 sec - exiting 03:26:25 (14184): No heartbeat from core client for 30 sec - exiting 03:26:26 (14184): No heartbeat from core client for 30 sec - exiting 03:26:27 (14184): No heartbeat from core client for 30 sec - exiting 03:26:28 (14184): No heartbeat from core client for 30 sec - exiting 03:26:29 (14184): No heartbeat from core client for 30 sec - exiting 03:26:30 (14184): No heartbeat from core client for 30 sec - exiting 03:26:31 (14184): No heartbeat from core client for 30 sec - exiting 03:26:32 (14184): No heartbeat from core client for 30 sec - exiting 03:26:33 (14184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:27:35 (16520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:44:42 (14428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:44:44 (14428): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13820, iMonCtr=1 Model crash detected, will try to restart... 04:33:35 (4520): No heartbeat from core client for 30 sec - exiting 04:33:36 (4520): No heartbeat from core client for 30 sec - exiting 04:33:37 (4520): No heartbeat from core client for 30 sec - exiting 04:33:38 (4520): No heartbeat from core client for 30 sec - exiting 04:33:39 (4520): No heartbeat from core client for 30 sec - exiting 04:33:40 (4520): No heartbeat from core client for 30 sec - exiting 04:33:41 (4520): No heartbeat from core client for 30 sec - exiting 04:33:42 (4520): No heartbeat from core client for 30 sec - exiting 04:33:43 (4520): No heartbeat from core client for 30 sec - exiting 04:33:44 (4520): No heartbeat from core client for 30 sec - exiting 04:33:45 (4520): No heartbeat from core client for 30 sec - exiting 04:33:46 (4520): No heartbeat from core client for 30 sec - exiting 04:33:47 (4520): No heartbeat from core client for 30 sec - exiting 04:33:48 (4520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:53:41 (5028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:53:42 (5028): No heartbeat from core client for 30 sec - exiting 05:28:05 (4936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:28:06 (4936): No heartbeat from core client for 30 sec - exiting 17:36:10 (6460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:36:11 (6460): No heartbeat from core client for 30 sec - exiting 17:36:12 (6460): No heartbeat from core client for 30 sec - exiting 01:34:46 (1060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:34:48 (1060): No heartbeat from core client for 30 sec - exiting 01:34:49 (1060): No heartbeat from core client for 30 sec - exiting 01:34:50 (1060): No heartbeat from core client for 30 sec - exiting 01:34:51 (1060): No heartbeat from core client for 30 sec - exiting 01:34:52 (1060): No heartbeat from core client for 30 sec - exiting 01:34:53 (1060): No heartbeat from core client for 30 sec - exiting 01:34:54 (1060): No heartbeat from core client for 30 sec - exiting 01:34:55 (1060): No heartbeat from core client for 30 sec - exiting 01:34:56 (1060): No heartbeat from core client for 30 sec - exiting 01:34:57 (1060): No heartbeat from core client for 30 sec - exiting 01:37:32 (6452): No heartbeat from core client for 30 sec - exiting 01:37:33 (6452): No heartbeat from core client for 30 sec - exiting 01:37:34 (6452): No heartbeat from core client for 30 sec - exiting 01:37:35 (6452): No heartbeat from core client for 30 sec - exiting 01:37:36 (6452): No heartbeat from core client for 30 sec - exiting 01:37:37 (6452): No heartbeat from core client for 30 sec - exiting 01:37:38 (6452): No heartbeat from core client for 30 sec - exiting 01:37:39 (6452): No heartbeat from core client for 30 sec - exiting 01:37:40 (6452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:09:47 (7424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:09:48 (7424): No heartbeat from core client for 30 sec - exiting 05:09:49 (7424): No heartbeat from core client for 30 sec - exiting 05:39:48 (10056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:39:49 (10056): No heartbeat from core client for 30 sec - exiting 08:12:45 (8528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:12:46 (8528): No heartbeat from core client for 30 sec - exiting 08:12:47 (8528): No heartbeat from core client for 30 sec - exiting 14:51:59 (9144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:52:00 (9144): No heartbeat from core client for 30 sec - exiting 01:35:08 (7056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:35:09 (7056): No heartbeat from core client for 30 sec - exiting 01:35:10 (7056): No heartbeat from core client for 30 sec - exiting 01:35:11 (7056): No heartbeat from core client for 30 sec - exiting 01:35:12 (7056): No heartbeat from core client for 30 sec - exiting 01:35:13 (7056): No heartbeat from core client for 30 sec - exiting 01:35:14 (7056): No heartbeat from core client for 30 sec - exiting 01:35:15 (7056): No heartbeat from core client for 30 sec - exiting 01:35:16 (7056): No heartbeat from core client for 30 sec - exiting 01:35:17 (7056): No heartbeat from core client for 30 sec - exiting 01:35:18 (7056): No heartbeat from core client for 30 sec - exiting 04:56:54 (10876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:56:55 (10876): No heartbeat from core client for 30 sec - exiting 04:56:56 (10876): No heartbeat from core client for 30 sec - exiting 04:56:57 (10876): No heartbeat from core client for 30 sec - exiting 04:56:58 (10876): No heartbeat from core client for 30 sec - exiting 05:57:27 (8372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:57:28 (8372): No heartbeat from core client for 30 sec - exiting 07:27:49 (10296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:27:50 (10296): No heartbeat from core client for 30 sec - exiting 23:05:43 (10832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:05:44 (10832): No heartbeat from core client for 30 sec - exiting 23:05:45 (10832): No heartbeat from core client for 30 sec - exiting 23:08:18 (11612): No heartbeat from core client for 30 sec - exiting 23:08:21 (11612): No heartbeat from core client for 30 sec - exiting 23:08:22 (11612): No heartbeat from core client for 30 sec - exiting 23:08:23 (11612): No heartbeat from core client for 30 sec - exiting 23:08:24 (11612): No heartbeat from core client for 30 sec - exiting 23:08:25 (11612): No heartbeat from core client for 30 sec - exiting 23:08:26 (11612): No heartbeat from core client for 30 sec - exiting 23:08:27 (11612): No heartbeat from core client for 30 sec - exiting 23:08:28 (11612): No heartbeat from core client for 30 sec - exiting 23:08:29 (11612): No heartbeat from core client for 30 sec - exiting 23:08:30 (11612): No heartbeat from core client for 30 sec - exiting 23:08:31 (11612): No heartbeat from core client for 30 sec - exiting 23:08:32 (11612): No heartbeat from core client for 30 sec - exiting 23:08:34 (11612): No heartbeat from core client for 30 sec - exiting 23:08:35 (11612): No heartbeat from core client for 30 sec - exiting 23:08:36 (11612): No heartbeat from core client for 30 sec - exiting 23:08:37 (11612): No heartbeat from core client for 30 sec - exiting 23:08:38 (11612): No heartbeat from core client for 30 sec - exiting 23:08:39 (11612): No heartbeat from core client for 30 sec - exiting 23:08:40 (11612): No heartbeat from core client for 30 sec - exiting 23:08:41 (11612): No heartbeat from core client for 30 sec - exiting 23:08:42 (11612): No heartbeat from core client for 30 sec - exiting 23:08:43 (11612): No heartbeat from core client for 30 sec - exiting 23:08:44 (11612): No heartbeat from core client for 30 sec - exiting 23:08:45 (11612): No heartbeat from core client for 30 sec - exiting 23:08:46 (11612): No heartbeat from core client for 30 sec - exiting 23:08:47 (11612): No heartbeat from core client for 30 sec - exiting 23:08:48 (11612): No heartbeat from core client for 30 sec - exiting 23:08:49 (11612): No heartbeat from core client for 30 sec - exiting 23:08:50 (11612): No heartbeat from core client for 30 sec - exiting 23:08:51 (11612): No heartbeat from core client for 30 sec - exiting 23:08:52 (11612): No heartbeat from core client for 30 sec - exiting 23:08:53 (11612): No heartbeat from core client for 30 sec - exiting 23:08:54 (11612): No heartbeat from core client for 30 sec - exiting 23:08:55 (11612): No heartbeat from core client for 30 sec - exiting 23:09:28 (11612): No heartbeat from core client for 30 sec - exiting 23:09:29 (11612): No heartbeat from core client for 30 sec - exiting 23:09:30 (11612): No heartbeat from core client for 30 sec - exiting 23:09:31 (11612): No heartbeat from core client for 30 sec - exiting 23:09:33 (11612): No heartbeat from core client for 30 sec - exiting 23:09:34 (11612): No heartbeat from core client for 30 sec - exiting 23:09:35 (11612): No heartbeat from core client for 30 sec - exiting 23:09:36 (11612): No heartbeat from core client for 30 sec - exiting 23:09:37 (11612): No heartbeat from core client for 30 sec - exiting 23:09:38 (11612): No heartbeat from core client for 30 sec - exiting 23:09:39 (11612): No heartbeat from core client for 30 sec - exiting 23:09:40 (11612): No heartbeat from core client for 30 sec - exiting 23:09:41 (11612): No heartbeat from core client for 30 sec - exiting 23:09:42 (11612): No heartbeat from core client for 30 sec - exiting 23:09:43 (11612): No heartbeat from core client for 30 sec - exiting 23:09:44 (11612): No heartbeat from core client for 30 sec - exiting 23:09:45 (11612): No heartbeat from core client for 30 sec - exiting 23:09:46 (11612): No heartbeat from core client for 30 sec - exiting 23:09:47 (11612): No heartbeat from core client for 30 sec - exiting 23:09:48 (11612): No heartbeat from core client for 30 sec - exiting 23:09:49 (11612): No heartbeat from core client for 30 sec - exiting 23:09:50 (11612): No heartbeat from core client for 30 sec - exiting 23:09:51 (11612): No heartbeat from core client for 30 sec - exiting 23:09:52 (11612): No heartbeat from core client for 30 sec - exiting 23:09:53 (11612): No heartbeat from core client for 30 sec - exiting 23:09:54 (11612): No heartbeat from core client for 30 sec - exiting 23:09:55 (11612): No heartbeat from core client for 30 sec - exiting 23:09:56 (11612): No heartbeat from core client for 30 sec - exiting 23:09:57 (11612): No heartbeat from core client for 30 sec - exiting 23:09:58 (11612): No heartbeat from core client for 30 sec - exiting 23:09:59 (11612): No heartbeat from core client for 30 sec - exiting 23:10:00 (11612): No heartbeat from core client for 30 sec - exiting 23:10:01 (11612): No heartbeat from core client for 30 sec - exiting 23:10:02 (11612): No heartbeat from core client for 30 sec - exiting 23:10:03 (11612): No heartbeat from core client for 30 sec - exiting 23:10:04 (11612): No heartbeat from core client for 30 sec - exiting 23:10:05 (11612): No heartbeat from core client for 30 sec - exiting 23:10:06 (11612): No heartbeat from core client for 30 sec - exiting 23:10:07 (11612): No heartbeat from core client for 30 sec - exiting 23:10:08 (11612): No heartbeat from core client for 30 sec - exiting 23:10:09 (11612): No heartbeat from core client for 30 sec - exiting 23:10:10 (11612): No heartbeat from core client for 30 sec - exiting 23:10:11 (11612): No heartbeat from core client for 30 sec - exiting 23:10:12 (11612): No heartbeat from core client for 30 sec - exiting 23:10:13 (11612): No heartbeat from core client for 30 sec - exiting 23:10:14 (11612): No heartbeat from core client for 30 sec - exiting 23:10:15 (11612): No heartbeat from core client for 30 sec - exiting 23:10:16 (11612): No heartbeat from core client for 30 sec - exiting 23:10:17 (11612): No heartbeat from core client for 30 sec - exiting 23:10:18 (11612): No heartbeat from core client for 30 sec - exiting 23:10:19 (11612): No heartbeat from core client for 30 sec - exiting 23:10:20 (11612): No heartbeat from core client for 30 sec - exiting 23:10:21 (11612): No heartbeat from core client for 30 sec - exiting 23:10:22 (11612): No heartbeat from core client for 30 sec - exiting 23:10:23 (11612): No heartbeat from core client for 30 sec - exiting 23:10:24 (11612): No heartbeat from core client for 30 sec - exiting 23:10:25 (11612): No heartbeat from core client for 30 sec - exiting 23:10:26 (11612): No heartbeat from core client for 30 sec - exiting 23:10:27 (11612): No heartbeat from core client for 30 sec - exiting 23:10:28 (11612): No heartbeat from core client for 30 sec - exiting 23:10:29 (11612): No heartbeat from core client for 30 sec - exiting 23:10:30 (11612): No heartbeat from core client for 30 sec - exiting 23:10:31 (11612): No heartbeat from core client for 30 sec - exiting 23:10:32 (11612): No heartbeat from core client for 30 sec - exiting 23:10:33 (11612): No heartbeat from core client for 30 sec - exiting 23:10:34 (11612): No heartbeat from core client for 30 sec - exiting 23:10:35 (11612): No heartbeat from core client for 30 sec - exiting 23:10:36 (11612): No heartbeat from core client for 30 sec - exiting 23:10:37 (11612): No heartbeat from core client for 30 sec - exiting 23:10:38 (11612): No heartbeat from core client for 30 sec - exiting 23:10:39 (11612): No heartbeat from core client for 30 sec - exiting 23:10:40 (11612): No heartbeat from core client for 30 sec - exiting 23:10:41 (11612): No heartbeat from core client for 30 sec - exiting 23:10:42 (11612): No heartbeat from core client for 30 sec - exiting 23:10:43 (11612): No heartbeat from core client for 30 sec - exiting 23:10:44 (11612): No heartbeat from core client for 30 sec - exiting 23:10:45 (11612): No heartbeat from core client for 30 sec - exiting 23:10:46 (11612): No heartbeat from core client for 30 sec - exiting 23:10:47 (11612): No heartbeat from core client for 30 sec - exiting 23:10:48 (11612): No heartbeat from core client for 30 sec - exiting 23:10:49 (11612): No heartbeat from core client for 30 sec - exiting 23:10:50 (11612): No heartbeat from core client for 30 sec - exiting 23:10:51 (11612): No heartbeat from core client for 30 sec - exiting 23:10:52 (11612): No heartbeat from core client for 30 sec - exiting 23:10:53 (11612): No heartbeat from core client for 30 sec - exiting 23:10:54 (11612): No heartbeat from core client for 30 sec - exiting 23:10:55 (11612): No heartbeat from core client for 30 sec - exiting 23:10:56 (11612): No heartbeat from core client for 30 sec - exiting 23:10:57 (11612): No heartbeat from core client for 30 sec - exiting 23:10:58 (11612): No heartbeat from core client for 30 sec - exiting 23:10:59 (11612): No heartbeat from core client for 30 sec - exiting 23:11:00 (11612): No heartbeat from core client for 30 sec - exiting 23:11:01 (11612): No heartbeat from core client for 30 sec - exiting 23:11:02 (11612): No heartbeat from core client for 30 sec - exiting 23:11:03 (11612): No heartbeat from core client for 30 sec - exiting 23:11:04 (11612): No heartbeat from core client for 30 sec - exiting 23:11:05 (11612): No heartbeat from core client for 30 sec - exiting 23:11:06 (11612): No heartbeat from core client for 30 sec - exiting 23:11:07 (11612): No heartbeat from core client for 30 sec - exiting 23:11:08 (11612): No heartbeat from core client for 30 sec - exiting 23:11:09 (11612): No heartbeat from core client for 30 sec - exiting 23:11:10 (11612): No heartbeat from core client for 30 sec - exiting 23:11:11 (11612): No heartbeat from core client for 30 sec - exiting 23:11:12 (11612): No heartbeat from core client for 30 sec - exiting 23:11:13 (11612): No heartbeat from core client for 30 sec - exiting 23:11:14 (11612): No heartbeat from core client for 30 sec - exiting 23:11:15 (11612): No heartbeat from core client for 30 sec - exiting 23:11:16 (11612): No heartbeat from core client for 30 sec - exiting 23:11:17 (11612): No heartbeat from core client for 30 sec - exiting 23:11:18 (11612): No heartbeat from core client for 30 sec - exiting 23:11:19 (11612): No heartbeat from core client for 30 sec - exiting 23:11:20 (11612): No heartbeat from core client for 30 sec - exiting 23:11:21 (11612): No heartbeat from core client for 30 sec - exiting 23:11:22 (11612): No heartbeat from core client for 30 sec - exiting 23:11:23 (11612): No heartbeat from core client for 30 sec - exiting 23:11:24 (11612): No heartbeat from core client for 30 sec - exiting 23:11:25 (11612): No heartbeat from core client for 30 sec - exiting 23:11:26 (11612): No heartbeat from core client for 30 sec - exiting 23:11:27 (11612): No heartbeat from core client for 30 sec - exiting 23:11:28 (11612): No heartbeat from core client for 30 sec - exiting 23:11:29 (11612): No heartbeat from core client for 30 sec - exiting 23:11:30 (11612): No heartbeat from core client for 30 sec - exiting 23:11:31 (11612): No heartbeat from core client for 30 sec - exiting 23:11:32 (11612): No heartbeat from core client for 30 sec - exiting 23:11:33 (11612): No heartbeat from core client for 30 sec - exiting 23:11:34 (11612): No heartbeat from core client for 30 sec - exiting 23:11:35 (11612): No heartbeat from core client for 30 sec - exiting 23:11:36 (11612): No heartbeat from core client for 30 sec - exiting 23:11:39 (11612): No heartbeat from core client for 30 sec - exiting 23:11:40 (11612): No heartbeat from core client for 30 sec - exiting 23:11:41 (11612): No heartbeat from core client for 30 sec - exiting 23:11:42 (11612): No heartbeat from core client for 30 sec - exiting 23:11:43 (11612): No heartbeat from core client for 30 sec - exiting 23:11:44 (11612): No heartbeat from core client for 30 sec - exiting 23:11:45 (11612): No heartbeat from core client for 30 sec - exiting 23:11:46 (11612): No heartbeat from core client for 30 sec - exiting 23:11:47 (11612): No heartbeat from core client for 30 sec - exiting 23:11:48 (11612): No heartbeat from core client for 30 sec - exiting 23:11:49 (11612): No heartbeat from core client for 30 sec - exiting 23:11:50 (11612): No heartbeat from core client for 30 sec - exiting 23:11:51 (11612): No heartbeat from core client for 30 sec - exiting 23:11:52 (11612): No heartbeat from core client for 30 sec - exiting 23:11:53 (11612): No heartbeat from core client for 30 sec - exiting 23:11:54 (11612): No heartbeat from core client for 30 sec - exiting 23:11:55 (11612): No heartbeat from core client for 30 sec - exiting 23:11:56 (11612): No heartbeat from core client for 30 sec - exiting 23:11:57 (11612): No heartbeat from core client for 30 sec - exiting 23:11:58 (11612): No heartbeat from core client for 30 sec - exiting 23:11:59 (11612): No heartbeat from core client for 30 sec - exiting 23:12:00 (11612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:12:01 (11612): No heartbeat from core client for 30 sec - exiting 23:12:02 (11612): No heartbeat from core client for 30 sec - exiting 23:12:03 (11612): No heartbeat from core client for 30 sec - exiting 23:12:04 (11612): No heartbeat from core client for 30 sec - exiting 23:12:05 (11612): No heartbeat from core client for 30 sec - exiting 01:42:39 (10572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:49:36 (11460): No heartbeat from core client for 30 sec - exiting 01:49:37 (11460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:07:03 (4344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:07:05 (4344): No heartbeat from core client for 30 sec - exiting 05:07:21 (9200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:07:22 (9200): No heartbeat from core client for 30 sec - exiting 20:58:41 (12524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:58:42 (12524): No heartbeat from core client for 30 sec - exiting 01:41:55 (13496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:00:15 (12628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:00:17 (12628): No heartbeat from core client for 30 sec - exiting 02:00:18 (12628): No heartbeat from core client for 30 sec - exiting 02:00:19 (12628): No heartbeat from core client for 30 sec - exiting 02:30:33 (12368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:31:47 (12304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:31:49 (12304): No heartbeat from core client for 30 sec - exiting </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Mar 2014 20:04:55	1212599	16297626	hadcm3n_n2d7_1880_40_008374029_3	259,200	878,321	3.3886
16 Mar 2014 23:48:00	1212599	16297626	hadcm3n_n2d7_1880_40_008374029_3	233,280	788,396	3.3796
15 Mar 2014 03:14:51	1212599	16297626	hadcm3n_n2d7_1880_40_008374029_3	207,360	699,763	3.3746
13 Mar 2014 06:42:37	1212599	16297626	hadcm3n_n2d7_1880_40_008374029_3	181,440	609,577	3.3597
11 Mar 2014 12:00:47	1212599	16297626	hadcm3n_n2d7_1880_40_008374029_3	155,520	524,305	3.3713
09 Mar 2014 07:40:36	1212599	16297626	hadcm3n_n2d7_1880_40_008374029_3	129,600	435,261	3.3585
07 Mar 2014 13:29:49	1212599	16297626	hadcm3n_n2d7_1880_40_008374029_3	103,680	345,862	3.3359
05 Mar 2014 21:33:57	1212599	16297626	hadcm3n_n2d7_1880_40_008374029_3	77,760	256,117	3.2937
04 Mar 2014 06:54:00	1212599	16297626	hadcm3n_n2d7_1880_40_008374029_3	51,840	170,403	3.2871
02 Mar 2014 21:01:00	1212599	16297626	hadcm3n_n2d7_1880_40_008374029_3	25,920	85,449	3.2966