Task 13353227

Name	hadcm3n_t1sw_1940_40_007444851_1
Workunit	7642354
Created	9 Sep 2011, 11:32:34 UTC
Sent	18 Sep 2011, 17:31:48 UTC
Report deadline	19 Dec 2011, 0:58:59 UTC
Received	7 Oct 2011, 15:44:26 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	25 (0x00000019) Unknown error code
Computer ID	1088030
Run time	13 days 17 hours 15 min 36 sec
CPU time	12 days 20 hours 36 min 25 sec
Validate state	Invalid
Credit	7,776.00
Device peak FLOPS	2.32 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The drive cannot locate a specific area or track on the disk. (0x19) - exit code 25 (0x19) </message> <stderr_txt> , selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... 21:34:48 (3296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:34:51 (3296): No heartbeat from core client for 30 sec - exiting 21:34:52 (3296): No heartbeat from core client for 30 sec - exiting 21:34:53 (3296): No heartbeat from core client for 30 sec - exiting 21:34:54 (3296): No heartbeat from core client for 30 sec - exiting 21:34:55 (3296): No heartbeat from core client for 30 sec - exiting 21:34:56 (3296): No heartbeat from core client for 30 sec - exiting 21:34:57 (3296): No heartbeat from core client for 30 sec - exiting 21:34:59 (3296): No heartbeat from core client for 30 sec - exiting zip error: Could not create output file (was replacing the original zip file) 22:29:53 (512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:29:55 (512): No heartbeat from core client for 30 sec - exiting 22:29:56 (512): No heartbeat from core client for 30 sec - exiting 22:36:16 (4824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:58:29 (4388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:58:32 (4388): No heartbeat from core client for 30 sec - exiting 02:58:33 (4388): No heartbeat from core client for 30 sec - exiting 02:58:34 (4388): No heartbeat from core client for 30 sec - exiting 02:58:35 (4388): No heartbeat from core client for 30 sec - exiting 02:58:36 (4388): No heartbeat from core client for 30 sec - exiting 02:58:37 (4388): No heartbeat from core client for 30 sec - exiting 03:04:09 (4276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:04:11 (4276): No heartbeat from core client for 30 sec - exiting 03:04:12 (4276): No heartbeat from core client for 30 sec - exiting 03:04:13 (4276): No heartbeat from core client for 30 sec - exiting 04:01:39 (3684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:01:42 (3684): No heartbeat from core client for 30 sec - exiting 04:01:43 (3684): No heartbeat from core client for 30 sec - exiting 04:01:45 (3684): No heartbeat from core client for 30 sec - exiting 04:01:46 (3684): No heartbeat from core client for 30 sec - exiting 04:01:47 (3684): No heartbeat from core client for 30 sec - exiting 08:55:11 (2532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:55:13 (2532): No heartbeat from core client for 30 sec - exiting 09:58:15 (2012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:58:17 (2012): No heartbeat from core client for 30 sec - exiting 09:58:18 (2012): No heartbeat from core client for 30 sec - exiting 10:02:24 (4032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:02:26 (4032): No heartbeat from core client for 30 sec - exiting 12:03:26 (3224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:03:27 (3224): No heartbeat from core client for 30 sec - exiting 12:03:28 (3224): No heartbeat from core client for 30 sec - exiting 12:03:29 (3224): No heartbeat from core client for 30 sec - exiting 13:09:54 (3344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:12:24 (4092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:12:25 (4092): No heartbeat from core client for 30 sec - exiting 14:12:26 (4092): No heartbeat from core client for 30 sec - exiting 14:12:27 (4092): No heartbeat from core client for 30 sec - exiting 14:12:29 (4092): No heartbeat from core client for 30 sec - exiting 14:12:30 (4092): No heartbeat from core client for 30 sec - exiting 15:12:25 (432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:12:27 (432): No heartbeat from core client for 30 sec - exiting 15:12:28 (432): No heartbeat from core client for 30 sec - exiting 15:12:29 (432): No heartbeat from core client for 30 sec - exiting 15:16:02 (2272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:19:48 (3368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:17:47 (2248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:17:49 (2248): No heartbeat from core client for 30 sec - exiting 16:17:50 (2248): No heartbeat from core client for 30 sec - exiting 16:17:51 (2248): No heartbeat from core client for 30 sec - exiting 21:58:39 (3800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:58:42 (3800): No heartbeat from core client for 30 sec - exiting 22:09:30 (3832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 22:28:20 (3812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:32:43 (1056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:32:47 (1056): No heartbeat from core client for 30 sec - exiting 23:04:38 (1020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:04:40 (1020): No heartbeat from core client for 30 sec - exiting 23:04:41 (1020): No heartbeat from core client for 30 sec - exiting 23:04:42 (1020): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 23:33:52 (3996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:07:50 (4568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:07:53 (4568): No heartbeat from core client for 30 sec - exiting 00:07:55 (4568): No heartbeat from core client for 30 sec - exiting 00:07:56 (4568): No heartbeat from core client for 30 sec - exiting 00:07:57 (4568): No heartbeat from core client for 30 sec - exiting 00:07:58 (4568): No heartbeat from core client for 30 sec - exiting 00:07:59 (4568): No heartbeat from core client for 30 sec - exiting 00:08:00 (4568): No heartbeat from core client for 30 sec - exiting 00:08:01 (4568): No heartbeat from core client for 30 sec - exiting 00:08:02 (4568): No heartbeat from core client for 30 sec - exiting 00:08:03 (4568): No heartbeat from core client for 30 sec - exiting 00:08:04 (4568): No heartbeat from core client for 30 sec - exiting 02:31:18 (4304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:31:19 (4304): No heartbeat from core client for 30 sec - exiting 02:31:20 (4304): No heartbeat from core client for 30 sec - exiting 02:31:21 (4304): No heartbeat from core client for 30 sec - exiting 02:31:23 (4304): No heartbeat from core client for 30 sec - exiting 02:31:24 (4304): No heartbeat from core client for 30 sec - exiting 02:31:25 (4304): No heartbeat from core client for 30 sec - exiting 02:31:26 (4304): No heartbeat from core client for 30 sec - exiting 02:31:27 (4304): No heartbeat from core client for 30 sec - exiting 02:31:28 (4304): No heartbeat from core client for 30 sec - exiting 02:31:29 (4304): No heartbeat from core client for 30 sec - exiting 04:26:24 (4896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:26:26 (4896): No heartbeat from core client for 30 sec - exiting 04:26:27 (4896): No heartbeat from core client for 30 sec - exiting 04:30:55 (4388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:30:57 (4388): No heartbeat from core client for 30 sec - exiting 04:30:58 (4388): No heartbeat from core client for 30 sec - exiting 04:30:59 (4388): No heartbeat from core client for 30 sec - exiting 05:29:09 (4032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:29:10 (4032): No heartbeat from core client for 30 sec - exiting 05:29:11 (4032): No heartbeat from core client for 30 sec - exiting 05:29:13 (4032): No heartbeat from core client for 30 sec - exiting 05:32:25 (4472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:32:26 (4472): No heartbeat from core client for 30 sec - exiting 05:32:27 (4472): No heartbeat from core client for 30 sec - exiting 06:36:57 (4364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:36:58 (4364): No heartbeat from core client for 30 sec - exiting 06:36:59 (4364): No heartbeat from core client for 30 sec - exiting 06:37:00 (4364): No heartbeat from core client for 30 sec - exiting 07:40:29 (2460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:40:32 (2460): No heartbeat from core client for 30 sec - exiting 07:40:33 (2460): No heartbeat from core client for 30 sec - exiting 07:40:34 (2460): No heartbeat from core client for 30 sec - exiting 07:40:35 (2460): No heartbeat from core client for 30 sec - exiting 07:40:36 (2460): No heartbeat from core client for 30 sec - exiting 07:45:42 (4616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:45:46 (4616): No heartbeat from core client for 30 sec - exiting 07:45:47 (4616): No heartbeat from core client for 30 sec - exiting 07:45:48 (4616): No heartbeat from core client for 30 sec - exiting 07:45:49 (4616): No heartbeat from core client for 30 sec - exiting 07:45:50 (4616): No heartbeat from core client for 30 sec - exiting 07:45:51 (4616): No heartbeat from core client for 30 sec - exiting 07:45:52 (4616): No heartbeat from core client for 30 sec - exiting 07:45:53 (4616): No heartbeat from core client for 30 sec - exiting 07:45:55 (4616): No heartbeat from core client for 30 sec - exiting 07:50:13 (5040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:50:15 (5040): No heartbeat from core client for 30 sec - exiting 07:50:16 (5040): No heartbeat from core client for 30 sec - exiting 07:50:17 (5040): No heartbeat from core client for 30 sec - exiting 11:28:54 (4348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:28:56 (4348): No heartbeat from core client for 30 sec - exiting 11:28:57 (4348): No heartbeat from core client for 30 sec - exiting 11:28:59 (4348): No heartbeat from core client for 30 sec - exiting 11:29:00 (4348): No heartbeat from core client for 30 sec - exiting 11:29:01 (4348): No heartbeat from core client for 30 sec - exiting 11:29:02 (4348): No heartbeat from core client for 30 sec - exiting 11:29:03 (4348): No heartbeat from core client for 30 sec - exiting 11:49:30 (3768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:49:33 (3768): No heartbeat from core client for 30 sec - exiting 11:49:34 (3768): No heartbeat from core client for 30 sec - exiting 11:49:35 (3768): No heartbeat from core client for 30 sec - exiting 11:49:36 (3768): No heartbeat from core client for 30 sec - exiting 11:49:37 (3768): No heartbeat from core client for 30 sec - exiting 11:49:38 (3768): No heartbeat from core client for 30 sec - exiting 11:49:39 (3768): No heartbeat from core client for 30 sec - exiting 12:33:09 (1612): No heartbeat from core client for 30 sec - exiting 12:33:11 (1612): No heartbeat from core client for 30 sec - exiting 12:33:12 (1612): No heartbeat from core client for 30 sec - exiting 12:33:13 (1612): No heartbeat from core client for 30 sec - exiting 12:33:14 (1612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:33:15 (1612): No heartbeat from core client for 30 sec - exiting 12:33:16 (1612): No heartbeat from core client for 30 sec - exiting 16:33:30 (4468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:33:32 (4468): No heartbeat from core client for 30 sec - exiting 16:33:33 (4468): No heartbeat from core client for 30 sec - exiting 17:36:08 (976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:36:09 (976): No heartbeat from core client for 30 sec - exiting 17:36:10 (976): No heartbeat from core client for 30 sec - exiting 20:53:49 (1768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:53:50 (1768): No heartbeat from core client for 30 sec - exiting 21:55:46 (1044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:55:47 (1044): No heartbeat from core client for 30 sec - exiting 21:55:48 (1044): No heartbeat from core client for 30 sec - exiting 23:40:20 (1440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:40:22 (1440): No heartbeat from core client for 30 sec - exiting 23:40:23 (1440): No heartbeat from core client for 30 sec - exiting 00:42:46 (2312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:42:49 (2312): No heartbeat from core client for 30 sec - exiting 00:42:50 (2312): No heartbeat from core client for 30 sec - exiting 00:42:51 (2312): No heartbeat from core client for 30 sec - exiting 00:42:52 (2312): No heartbeat from core client for 30 sec - exiting 00:42:53 (2312): No heartbeat from core client for 30 sec - exiting 00:42:54 (2312): No heartbeat from core client for 30 sec - exiting 01:46:43 (4112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:46:46 (4112): No heartbeat from core client for 30 sec - exiting 01:46:47 (4112): No heartbeat from core client for 30 sec - exiting 01:46:48 (4112): No heartbeat from core client for 30 sec - exiting 01:46:49 (4112): No heartbeat from core client for 30 sec - exiting 01:46:50 (4112): No heartbeat from core client for 30 sec - exiting 01:46:51 (4112): No heartbeat from core client for 30 sec - exiting 01:46:52 (4112): No heartbeat from core client for 30 sec - exiting 01:46:53 (4112): No heartbeat from core client for 30 sec - exiting 01:46:54 (4112): No heartbeat from core client for 30 sec - exiting 03:51:35 (4332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:51:38 (4332): No heartbeat from core client for 30 sec - exiting 03:51:39 (4332): No heartbeat from core client for 30 sec - exiting 03:51:40 (4332): No heartbeat from core client for 30 sec - exiting 03:51:41 (4332): No heartbeat from core client for 30 sec - exiting 03:51:42 (4332): No heartbeat from core client for 30 sec - exiting 03:51:43 (4332): No heartbeat from core client for 30 sec - exiting 03:51:44 (4332): No heartbeat from core client for 30 sec - exiting 03:51:45 (4332): No heartbeat from core client for 30 sec - exiting 05:08:59 (1876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:09:01 (1876): No heartbeat from core client for 30 sec - exiting 05:09:03 (1876): No heartbeat from core client for 30 sec - exiting 05:09:04 (1876): No heartbeat from core client for 30 sec - exiting 06:10:33 (4092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:10:35 (4092): No heartbeat from core client for 30 sec - exiting 06:12:19 (1148): No heartbeat from core client for 30 sec - exiting 06:12:20 (1148): No heartbeat from core client for 30 sec - exiting 06:12:21 (1148): No heartbeat from core client for 30 sec - exiting 06:12:23 (1148): No heartbeat from core client for 30 sec - exiting 06:12:24 (1148): No heartbeat from core client for 30 sec - exiting 06:12:25 (1148): No heartbeat from core client for 30 sec - exiting 06:12:26 (1148): No heartbeat from core client for 30 sec - exiting 06:12:27 (1148): No heartbeat from core client for 30 sec - exiting 06:12:28 (1148): No heartbeat from core client for 30 sec - exiting 06:12:29 (1148): No heartbeat from core client for 30 sec - exiting 06:12:30 (1148): No heartbeat from core client for 30 sec - exiting 06:12:31 (1148): No heartbeat from core client for 30 sec - exiting 06:12:32 (1148): No heartbeat from core client for 30 sec - exiting 06:12:33 (1148): No heartbeat from core client for 30 sec - exiting 06:12:35 (1148): No heartbeat from core client for 30 sec - exiting 06:12:36 (1148): No heartbeat from core client for 30 sec - exiting 06:12:37 (1148): No heartbeat from core client for 30 sec - exiting 06:12:38 (1148): No heartbeat from core client for 30 sec - exiting 06:12:39 (1148): No heartbeat from core client for 30 sec - exiting 06:12:40 (1148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:53:20 (4388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:22:26 (4332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:22:27 (4332): No heartbeat from core client for 30 sec - exiting 12:24:59 (4620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:25:00 (4620): No heartbeat from core client for 30 sec - exiting 12:25:01 (4620): No heartbeat from core client for 30 sec - exiting 12:25:03 (4620): No heartbeat from core client for 30 sec - exiting 12:25:04 (4620): No heartbeat from core client for 30 sec - exiting 13:28:02 (2576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:28:04 (2576): No heartbeat from core client for 30 sec - exiting 13:28:05 (2576): No heartbeat from core client for 30 sec - exiting 17:23:53 (3592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:23:55 (3592): No heartbeat from core client for 30 sec - exiting 18:26:50 (4512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:26:52 (4512): No heartbeat from core client for 30 sec - exiting 18:26:53 (4512): No heartbeat from core client for 30 sec - exiting 18:26:55 (4512): No heartbeat from core client for 30 sec - exiting 22:13:17 (5112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:13:20 (5112): No heartbeat from core client for 30 sec - exiting 22:13:21 (5112): No heartbeat from core client for 30 sec - exiting 22:13:22 (5112): No heartbeat from core client for 30 sec - exiting 22:13:23 (5112): No heartbeat from core client for 30 sec - exiting 22:13:24 (5112): No heartbeat from core client for 30 sec - exiting 22:13:25 (5112): No heartbeat from core client for 30 sec - exiting 23:49:18 (512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:49:20 (512): No heartbeat from core client for 30 sec - exiting 23:49:21 (512): No heartbeat from core client for 30 sec - exiting 23:49:22 (512): No heartbeat from core client for 30 sec - exiting 00:52:38 (4964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:52:39 (4964): No heartbeat from core client for 30 sec - exiting 00:52:40 (4964): No heartbeat from core client for 30 sec - exiting 00:52:41 (4964): No heartbeat from core client for 30 sec - exiting 01:55:24 (4268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:55:27 (4268): No heartbeat from core client for 30 sec - exiting 01:55:28 (4268): No heartbeat from core client for 30 sec - exiting 01:55:29 (4268): No heartbeat from core client for 30 sec - exiting 01:55:30 (4268): No heartbeat from core client for 30 sec - exiting 01:55:31 (4268): No heartbeat from core client for 30 sec - exiting 01:55:32 (4268): No heartbeat from core client for 30 sec - exiting 05:00:38 (1280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:00:40 (1280): No heartbeat from core client for 30 sec - exiting 05:00:41 (1280): No heartbeat from core client for 30 sec - exiting 06:03:56 (1500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:03:59 (1500): No heartbeat from core client for 30 sec - exiting 06:04:00 (1500): No heartbeat from core client for 30 sec - exiting 06:04:01 (1500): No heartbeat from core client for 30 sec - exiting 06:04:02 (1500): No heartbeat from core client for 30 sec - exiting 06:04:03 (1500): No heartbeat from core client for 30 sec - exiting 09:30:41 (4468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:30:43 (4468): No heartbeat from core client for 30 sec - exiting 09:30:44 (4468): No heartbeat from core client for 30 sec - exiting 09:30:45 (4468): No heartbeat from core client for 30 sec - exiting 09:30:46 (4468): No heartbeat from core client for 30 sec - exiting 09:30:47 (4468): No heartbeat from core client for 30 sec - exiting 09:30:48 (4468): No heartbeat from core client for 30 sec - exiting 09:30:49 (4468): No heartbeat from core client for 30 sec - exiting 09:30:50 (4468): No heartbeat from core client for 30 sec - exiting 09:30:51 (4468): No heartbeat from core client for 30 sec - exiting 11:26:51 (1680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:26:53 (1680): No heartbeat from core client for 30 sec - exiting 11:26:54 (1680): No heartbeat from core client for 30 sec - exiting 11:26:56 (1680): No heartbeat from core client for 30 sec - exiting 11:26:57 (1680): No heartbeat from core client for 30 sec - exiting 11:26:58 (1680): No heartbeat from core client for 30 sec - exiting 11:26:59 (1680): No heartbeat from core client for 30 sec - exiting 11:52:16 (792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:52:19 (792): No heartbeat from core client for 30 sec - exiting 11:52:20 (792): No heartbeat from core client for 30 sec - exiting 11:52:21 (792): No heartbeat from core client for 30 sec - exiting 11:52:22 (792): No heartbeat from core client for 30 sec - exiting 11:52:23 (792): No heartbeat from core client for 30 sec - exiting 11:52:24 (792): No heartbeat from core client for 30 sec - exiting 11:52:25 (792): No heartbeat from core client for 30 sec - exiting 12:04:48 (4328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:04:49 (4328): No heartbeat from core client for 30 sec - exiting 12:50:28 (3492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:07:03 (4528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:07:05 (4528): No heartbeat from core client for 30 sec - exiting 13:07:07 (4528): No heartbeat from core client for 30 sec - exiting 13:07:08 (4528): No heartbeat from core client for 30 sec - exiting 13:07:09 (4528): No heartbeat from core client for 30 sec - exiting 14:18:02 (3840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:18:05 (3840): No heartbeat from core client for 30 sec - exiting 14:18:06 (3840): No heartbeat from core client for 30 sec - exiting 14:18:07 (3840): No heartbeat from core client for 30 sec - exiting 14:18:08 (3840): No heartbeat from core client for 30 sec - exiting 14:18:09 (3840): No heartbeat from core client for 30 sec - exiting 14:18:10 (3840): No heartbeat from core client for 30 sec - exiting 14:18:11 (3840): No heartbeat from core client for 30 sec - exiting 14:18:12 (3840): No heartbeat from core client for 30 sec - exiting 14:18:14 (3840): No heartbeat from core client for 30 sec - exiting 14:18:15 (3840): No heartbeat from core client for 30 sec - exiting 14:18:16 (3840): No heartbeat from core client for 30 sec - exiting 14:18:17 (3840): No heartbeat from core client for 30 sec - exiting 14:18:18 (3840): No heartbeat from core client for 30 sec - exiting 16:15:43 (3744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:15:46 (3744): No heartbeat from core client for 30 sec - exiting 16:15:47 (3744): No heartbeat from core client for 30 sec - exiting 16:15:49 (3744): No heartbeat from core client for 30 sec - exiting 16:15:50 (3744): No heartbeat from core client for 30 sec - exiting 16:15:51 (3744): No heartbeat from core client for 30 sec - exiting 16:15:52 (3744): No heartbeat from core client for 30 sec - exiting 16:15:53 (3744): No heartbeat from core client for 30 sec - exiting 16:15:54 (3744): No heartbeat from core client for 30 sec - exiting 16:15:55 (3744): No heartbeat from core client for 30 sec - exiting 16:15:56 (3744): No heartbeat from core client for 30 sec - exiting 16:22:43 (1540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Oct 2011 00:00:52	1088030	13353227	hadcm3n_t1sw_1940_40_007444851_1	648,000	1,070,527	1.6520
06 Oct 2011 09:28:56	1088030	13353227	hadcm3n_t1sw_1940_40_007444851_1	622,080	1,028,324	1.6530
05 Oct 2011 18:59:06	1088030	13353227	hadcm3n_t1sw_1940_40_007444851_1	596,160	987,141	1.6558
05 Oct 2011 04:40:43	1088030	13353227	hadcm3n_t1sw_1940_40_007444851_1	570,240	944,607	1.6565
04 Oct 2011 11:14:05	1088030	13353227	hadcm3n_t1sw_1940_40_007444851_1	544,320	903,429	1.6597
03 Oct 2011 20:34:41	1088030	13353227	hadcm3n_t1sw_1940_40_007444851_1	518,400	861,070	1.6610
03 Oct 2011 04:32:58	1088030	13353227	hadcm3n_t1sw_1940_40_007444851_1	492,480	818,657	1.6623
02 Oct 2011 14:51:12	1088030	13353227	hadcm3n_t1sw_1940_40_007444851_1	466,560	775,955	1.6631
02 Oct 2011 02:25:46	1088030	13353227	hadcm3n_t1sw_1940_40_007444851_1	440,640	732,432	1.6622
01 Oct 2011 13:12:40	1088030	13353227	hadcm3n_t1sw_1940_40_007444851_1	414,720	688,844	1.6610
01 Oct 2011 01:41:52	1088030	13353227	hadcm3n_t1sw_1940_40_007444851_1	388,800	645,234	1.6596
30 Sep 2011 12:54:55	1088030	13353227	hadcm3n_t1sw_1940_40_007444851_1	362,880	601,587	1.6578
30 Sep 2011 00:43:21	1088030	13353227	hadcm3n_t1sw_1940_40_007444851_1	336,960	557,949	1.6558
29 Sep 2011 12:34:06	1088030	13353227	hadcm3n_t1sw_1940_40_007444851_1	311,040	514,411	1.6538
29 Sep 2011 00:30:58	1088030	13353227	hadcm3n_t1sw_1940_40_007444851_1	285,120	471,160	1.6525
28 Sep 2011 12:17:30	1088030	13353227	hadcm3n_t1sw_1940_40_007444851_1	259,200	428,324	1.6525
28 Sep 2011 00:43:25	1088030	13353227	hadcm3n_t1sw_1940_40_007444851_1	233,280	385,348	1.6519
27 Sep 2011 12:45:44	1088030	13353227	hadcm3n_t1sw_1940_40_007444851_1	207,360	342,724	1.6528
27 Sep 2011 00:42:42	1088030	13353227	hadcm3n_t1sw_1940_40_007444851_1	181,440	300,023	1.6536
26 Sep 2011 12:57:35	1088030	13353227	hadcm3n_t1sw_1940_40_007444851_1	155,520	257,331	1.6546