Task 15752521

Name	hadcm3n_4i1x_1940_40_008303217_4
Workunit	8454352
Created	26 Apr 2013, 19:16:44 UTC
Sent	26 Apr 2013, 19:16:49 UTC
Report deadline	27 Jul 2013, 2:44:00 UTC
Received	30 May 2013, 11:38:27 UTC
Server state	Over
Outcome	Computation error
Client state	Aborted by user
Exit status	203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID	738901
Run time	27 days 21 hours 7 min 14 sec
CPU time	22 days 16 hours 5 min 37 sec
Validate state	Invalid
Credit	6,531.84
Device peak FLOPS	1.46 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C91101A write attempt to address 0x408DF940 Engaging BOINC Windows Runtime Debugger... 05:00:49 (580): No heartbeat from core client for 30 sec - exiting 05:00:50 (580): No heartbeat from core client for 30 sec - exiting 05:00:52 (580): No heartbeat from core client for 30 sec - exiting 05:00:53 (580): No heartbeat from core client for 30 sec - exiting 05:00:54 (580): No heartbeat from core client for 30 sec - exiting 05:00:55 (580): No heartbeat from core client for 30 sec - exiting 05:00:56 (580): No heartbeat from core client for 30 sec - exiting 05:00:57 (580): No heartbeat from core client for 30 sec - exiting 05:00:58 (580): No heartbeat from core client for 30 sec - exiting 05:00:59 (580): No heartbeat from core client for 30 sec - exiting 05:01:00 (580): No heartbeat from core client for 30 sec - exiting 05:01:01 (580): No heartbeat from core client for 30 sec - exiting 05:01:02 (580): No heartbeat from core client for 30 sec - exiting 05:01:04 (580): No heartbeat from core client for 30 sec - exiting 05:01:05 (580): No heartbeat from core client for 30 sec - exiting 05:01:06 (580): No heartbeat from core client for 30 sec - exiting 05:01:07 (580): No heartbeat from core client for 30 sec - exiting 05:01:08 (580): No heartbeat from core client for 30 sec - exiting 05:01:09 (580): No heartbeat from core client for 30 sec - exiting 05:01:10 (580): No heartbeat from core client for 30 sec - exiting 05:01:11 (580): No heartbeat from core client for 30 sec - exiting 05:01:12 (580): No heartbeat from core client for 30 sec - exiting 05:01:13 (580): No heartbeat from core client for 30 sec - exiting 05:01:15 (580): No heartbeat from core client for 30 sec - exiting 05:01:16 (580): No heartbeat from core client for 30 sec - exiting 05:01:17 (580): No heartbeat from core client for 30 sec - exiting 05:01:18 (580): No heartbeat from core client for 30 sec - exiting 05:01:19 (580): No heartbeat from core client for 30 sec - exiting 05:01:20 (580): No heartbeat from core client for 30 sec - exiting 08:59:46 (580): No heartbeat from core client for 30 sec - exiting 08:59:47 (580): No heartbeat from core client for 30 sec - exiting 08:59:48 (580): No heartbeat from core client for 30 sec - exiting 08:59:49 (580): No heartbeat from core client for 30 sec - exiting 08:59:50 (580): No heartbeat from core client for 30 sec - exiting 08:59:51 (580): No heartbeat from core client for 30 sec - exiting 08:59:53 (580): No heartbeat from core client for 30 sec - exiting 08:59:54 (580): No heartbeat from core client for 30 sec - exiting 08:59:55 (580): No heartbeat from core client for 30 sec - exiting 08:59:56 (580): No heartbeat from core client for 30 sec - exiting 08:59:57 (580): No heartbeat from core client for 30 sec - exiting 08:59:58 (580): No heartbeat from core client for 30 sec - exiting 08:59:59 (580): No heartbeat from core client for 30 sec - exiting 09:00:00 (580): No heartbeat from core client for 30 sec - exiting 09:00:01 (580): No heartbeat from core client for 30 sec - exiting 09:00:02 (580): No heartbeat from core client for 30 sec - exiting 09:00:03 (580): No heartbeat from core client for 30 sec - exiting 09:00:05 (580): No heartbeat from core client for 30 sec - exiting 09:00:06 (580): No heartbeat from core client for 30 sec - exiting 09:00:07 (580): No heartbeat from core client for 30 sec - exiting 09:00:08 (580): No heartbeat from core client for 30 sec - exiting 09:00:09 (580): No heartbeat from core client for 30 sec - exiting 09:00:10 (580): No heartbeat from core client for 30 sec - exiting 09:00:11 (580): No heartbeat from core client for 30 sec - exiting 09:00:12 (580): No heartbeat from core client for 30 sec - exiting 09:00:13 (580): No heartbeat from core client for 30 sec - exiting 09:00:14 (580): No heartbeat from core client for 30 sec - exiting 09:00:16 (580): No heartbeat from core client for 30 sec - exiting 09:00:17 (580): No heartbeat from core client for 30 sec - exiting 20:58:41 (580): No heartbeat from core client for 30 sec - exiting 20:58:42 (580): No heartbeat from core client for 30 sec - exiting 20:58:43 (580): No heartbeat from core client for 30 sec - exiting 20:58:44 (580): No heartbeat from core client for 30 sec - exiting 20:58:45 (580): No heartbeat from core client for 30 sec - exiting 20:58:46 (580): No heartbeat from core client for 30 sec - exiting 20:58:47 (580): No heartbeat from core client for 30 sec - exiting 20:58:48 (580): No heartbeat from core client for 30 sec - exiting 20:58:49 (580): No heartbeat from core client for 30 sec - exiting 20:58:50 (580): No heartbeat from core client for 30 sec - exiting 20:58:51 (580): No heartbeat from core client for 30 sec - exiting 20:58:53 (580): No heartbeat from core client for 30 sec - exiting 20:58:54 (580): No heartbeat from core client for 30 sec - exiting 20:58:55 (580): No heartbeat from core client for 30 sec - exiting 20:58:56 (580): No heartbeat from core client for 30 sec - exiting 20:58:57 (580): No heartbeat from core client for 30 sec - exiting 20:58:58 (580): No heartbeat from core client for 30 sec - exiting 20:58:59 (580): No heartbeat from core client for 30 sec - exiting 20:59:00 (580): No heartbeat from core client for 30 sec - exiting 20:59:01 (580): No heartbeat from core client for 30 sec - exiting 20:59:02 (580): No heartbeat from core client for 30 sec - exiting 20:59:03 (580): No heartbeat from core client for 30 sec - exiting 20:59:05 (580): No heartbeat from core client for 30 sec - exiting 20:59:06 (580): No heartbeat from core client for 30 sec - exiting 20:59:07 (580): No heartbeat from core client for 30 sec - exiting 20:59:08 (580): No heartbeat from core client for 30 sec - exiting 20:59:09 (580): No heartbeat from core client for 30 sec - exiting 20:59:10 (580): No heartbeat from core client for 30 sec - exiting 20:59:11 (580): No heartbeat from core client for 30 sec - exiting 20:59:12 (580): No heartbeat from core client for 30 sec - exiting 20:59:13 (580): No heartbeat from core client for 30 sec - exiting 00:57:36 (580): No heartbeat from core client for 30 sec - exiting 00:57:37 (580): No heartbeat from core client for 30 sec - exiting 00:57:38 (580): No heartbeat from core client for 30 sec - exiting 00:57:39 (580): No heartbeat from core client for 30 sec - exiting 00:57:40 (580): No heartbeat from core client for 30 sec - exiting 00:57:41 (580): No heartbeat from core client for 30 sec - exiting 00:57:42 (580): No heartbeat from core client for 30 sec - exiting 00:57:43 (580): No heartbeat from core client for 30 sec - exiting 00:57:45 (580): No heartbeat from core client for 30 sec - exiting 00:57:46 (580): No heartbeat from core client for 30 sec - exiting 00:57:47 (580): No heartbeat from core client for 30 sec - exiting 00:57:48 (580): No heartbeat from core client for 30 sec - exiting 00:57:49 (580): No heartbeat from core client for 30 sec - exiting 00:57:50 (580): No heartbeat from core client for 30 sec - exiting 00:57:51 (580): No heartbeat from core client for 30 sec - exiting 00:57:52 (580): No heartbeat from core client for 30 sec - exiting 00:57:53 (580): No heartbeat from core client for 30 sec - exiting 00:57:54 (580): No heartbeat from core client for 30 sec - exiting 00:57:55 (580): No heartbeat from core client for 30 sec - exiting 00:57:57 (580): No heartbeat from core client for 30 sec - exiting 00:57:58 (580): No heartbeat from core client for 30 sec - exiting 00:57:59 (580): No heartbeat from core client for 30 sec - exiting 00:58:00 (580): No heartbeat from core client for 30 sec - exiting 00:58:01 (580): No heartbeat from core client for 30 sec - exiting 00:58:02 (580): No heartbeat from core client for 30 sec - exiting 00:58:03 (580): No heartbeat from core client for 30 sec - exiting 00:58:04 (580): No heartbeat from core client for 30 sec - exiting 00:58:05 (580): No heartbeat from core client for 30 sec - exiting 00:58:06 (580): No heartbeat from core client for 30 sec - exiting 00:58:07 (580): No heartbeat from core client for 30 sec - exiting 04:56:31 (580): No heartbeat from core client for 30 sec - exiting 04:56:32 (580): No heartbeat from core client for 30 sec - exiting 04:56:33 (580): No heartbeat from core client for 30 sec - exiting 04:56:34 (580): No heartbeat from core client for 30 sec - exiting 04:56:35 (580): No heartbeat from core client for 30 sec - exiting 04:56:36 (580): No heartbeat from core client for 30 sec - exiting 04:56:37 (580): No heartbeat from core client for 30 sec - exiting 04:56:38 (580): No heartbeat from core client for 30 sec - exiting 04:56:39 (580): No heartbeat from core client for 30 sec - exiting 04:56:40 (580): No heartbeat from core client for 30 sec - exiting 04:56:42 (580): No heartbeat from core client for 30 sec - exiting 04:56:43 (580): No heartbeat from core client for 30 sec - exiting 04:56:44 (580): No heartbeat from core client for 30 sec - exiting 04:56:45 (580): No heartbeat from core client for 30 sec - exiting 04:56:46 (580): No heartbeat from core client for 30 sec - exiting 04:56:47 (580): No heartbeat from core client for 30 sec - exiting 04:56:48 (580): No heartbeat from core client for 30 sec - exiting 04:56:49 (580): No heartbeat from core client for 30 sec - exiting 04:56:50 (580): No heartbeat from core client for 30 sec - exiting 04:56:51 (580): No heartbeat from core client for 30 sec - exiting 04:56:52 (580): No heartbeat from core client for 30 sec - exiting 04:56:54 (580): No heartbeat from core client for 30 sec - exiting 04:56:55 (580): No heartbeat from core client for 30 sec - exiting 04:56:56 (580): No heartbeat from core client for 30 sec - exiting 04:56:57 (580): No heartbeat from core client for 30 sec - exiting 04:56:58 (580): No heartbeat from core client for 30 sec - exiting 04:56:59 (580): No heartbeat from core client for 30 sec - exiting 04:57:00 (580): No heartbeat from core client for 30 sec - exiting 04:57:01 (580): No heartbeat from core client for 30 sec - exiting 04:57:02 (580): No heartbeat from core client for 30 sec - exiting 04:57:03 (580): No heartbeat from core client for 30 sec - exiting 08:55:26 (580): No heartbeat from core client for 30 sec - exiting 08:55:27 (580): No heartbeat from core client for 30 sec - exiting 08:55:28 (580): No heartbeat from core client for 30 sec - exiting 08:55:29 (580): No heartbeat from core client for 30 sec - exiting 08:55:30 (580): No heartbeat from core client for 30 sec - exiting 08:55:32 (580): No heartbeat from core client for 30 sec - exiting 08:55:33 (580): No heartbeat from core client for 30 sec - exiting 08:55:34 (580): No heartbeat from core client for 30 sec - exiting 08:55:35 (580): No heartbeat from core client for 30 sec - exiting 08:55:36 (580): No heartbeat from core client for 30 sec - exiting 08:55:37 (580): No heartbeat from core client for 30 sec - exiting 08:55:38 (580): No heartbeat from core client for 30 sec - exiting 08:55:39 (580): No heartbeat from core client for 30 sec - exiting 08:55:40 (580): No heartbeat from core client for 30 sec - exiting 08:55:41 (580): No heartbeat from core client for 30 sec - exiting 08:55:43 (580): No heartbeat from core client for 30 sec - exiting 08:55:44 (580): No heartbeat from core client for 30 sec - exiting 08:55:45 (580): No heartbeat from core client for 30 sec - exiting 08:55:46 (580): No heartbeat from core client for 30 sec - exiting 08:55:47 (580): No heartbeat from core client for 30 sec - exiting 08:55:48 (580): No heartbeat from core client for 30 sec - exiting 08:55:49 (580): No heartbeat from core client for 30 sec - exiting 08:55:50 (580): No heartbeat from core client for 30 sec - exiting 08:55:51 (580): No heartbeat from core client for 30 sec - exiting 08:55:52 (580): No heartbeat from core client for 30 sec - exiting 08:55:53 (580): No heartbeat from core client for 30 sec - exiting 08:55:55 (580): No heartbeat from core client for 30 sec - exiting 08:55:56 (580): No heartbeat from core client for 30 sec - exiting 08:55:57 (580): No heartbeat from core client for 30 sec - exiting 08:55:58 (580): No heartbeat from core client for 30 sec - exiting 15:53:47 (580): No heartbeat from core client for 30 sec - exiting 15:53:48 (580): No heartbeat from core client for 30 sec - exiting 15:53:49 (580): No heartbeat from core client for 30 sec - exiting 15:53:50 (580): No heartbeat from core client for 30 sec - exiting 15:53:51 (580): No heartbeat from core client for 30 sec - exiting 15:53:52 (580): No heartbeat from core client for 30 sec - exiting 15:53:53 (580): No heartbeat from core client for 30 sec - exiting 15:53:54 (580): No heartbeat from core client for 30 sec - exiting 15:53:55 (580): No heartbeat from core client for 30 sec - exiting 15:53:56 (580): No heartbeat from core client for 30 sec - exiting 15:53:57 (580): No heartbeat from core client for 30 sec - exiting 15:53:59 (580): No heartbeat from core client for 30 sec - exiting 15:54:00 (580): No heartbeat from core client for 30 sec - exiting 15:54:01 (580): No heartbeat from core client for 30 sec - exiting 15:54:02 (580): No heartbeat from core client for 30 sec - exiting 15:54:03 (580): No heartbeat from core client for 30 sec - exiting 15:54:04 (580): No heartbeat from core client for 30 sec - exiting 15:54:05 (580): No heartbeat from core client for 30 sec - exiting 15:54:06 (580): No heartbeat from core client for 30 sec - exiting 15:54:07 (580): No heartbeat from core client for 30 sec - exiting 15:54:08 (580): No heartbeat from core client for 30 sec - exiting 15:54:10 (580): No heartbeat from core client for 30 sec - exiting 15:54:11 (580): No heartbeat from core client for 30 sec - exiting 15:54:12 (580): No heartbeat from core client for 30 sec - exiting 15:54:13 (580): No heartbeat from core client for 30 sec - exiting 15:54:14 (580): No heartbeat from core client for 30 sec - exiting 15:54:15 (580): No heartbeat from core client for 30 sec - exiting 15:54:16 (580): No heartbeat from core client for 30 sec - exiting 15:54:17 (580): No heartbeat from core client for 30 sec - exiting 15:54:18 (580): No heartbeat from core client for 30 sec - exiting 15:54:19 (580): No heartbeat from core client for 30 sec - exiting 15:54:20 (580): No heartbeat from core client for 30 sec - exiting 15:54:22 (580): No heartbeat from core client for 30 sec - exiting 15:54:23 (580): No heartbeat from core client for 30 sec - exiting 15:54:24 (580): No heartbeat from core client for 30 sec - exiting 15:54:25 (580): No heartbeat from core client for 30 sec - exiting 15:54:26 (580): No heartbeat from core client for 30 sec - exiting 15:54:27 (580): No heartbeat from core client for 30 sec - exiting 15:54:28 (580): No heartbeat from core client for 30 sec - exiting 15:54:29 (580): No heartbeat from core client for 30 sec - exiting 15:54:30 (580): No heartbeat from core client for 30 sec - exiting 21:52:39 (580): No heartbeat from core client for 30 sec - exiting 21:52:40 (580): No heartbeat from core client for 30 sec - exiting 21:52:42 (580): No heartbeat from core client for 30 sec - exiting 21:52:43 (580): No heartbeat from core client for 30 sec - exiting 21:52:44 (580): No heartbeat from core client for 30 sec - exiting 21:52:45 (580): No heartbeat from core client for 30 sec - exiting 21:52:46 (580): No heartbeat from core client for 30 sec - exiting 21:52:47 (580): No heartbeat from core client for 30 sec - exiting 21:52:48 (580): No heartbeat from core client for 30 sec - exiting 21:52:49 (580): No heartbeat from core client for 30 sec - exiting 21:52:50 (580): No heartbeat from core client for 30 sec - exiting 21:52:51 (580): No heartbeat from core client for 30 sec - exiting 21:52:52 (580): No heartbeat from core client for 30 sec - exiting 21:52:54 (580): No heartbeat from core client for 30 sec - exiting 21:52:55 (580): No heartbeat from core client for 30 sec - exiting 21:52:56 (580): No heartbeat from core client for 30 sec - exiting 21:52:57 (580): No heartbeat from core client for 30 sec - exiting 21:52:58 (580): No heartbeat from core client for 30 sec - exiting 21:52:59 (580): No heartbeat from core client for 30 sec - exiting 21:53:00 (580): No heartbeat from core client for 30 sec - exiting 21:53:01 (580): No heartbeat from core client for 30 sec - exiting 21:53:02 (580): No heartbeat from core client for 30 sec - exiting 21:53:03 (580): No heartbeat from core client for 30 sec - exiting 21:53:04 (580): No heartbeat from core client for 30 sec - exiting 21:53:06 (580): No heartbeat from core client for 30 sec - exiting 21:53:07 (580): No heartbeat from core client for 30 sec - exiting 21:53:08 (580): No heartbeat from core client for 30 sec - exiting 21:53:09 (580): No heartbeat from core client for 30 sec - exiting 21:53:10 (580): No heartbeat from core client for 30 sec - exiting 21:53:11 (580): No heartbeat from core client for 30 sec - exiting 21:53:12 (580): No heartbeat from core client for 30 sec - exiting 09:51:29 (580): No heartbeat from core client for 30 sec - exiting 09:51:30 (580): No heartbeat from core client for 30 sec - exiting 09:51:31 (580): No heartbeat from core client for 30 sec - exiting 09:51:32 (580): No heartbeat from core client for 30 sec - exiting 09:51:33 (580): No heartbeat from core client for 30 sec - exiting 09:51:34 (580): No heartbeat from core client for 30 sec - exiting 09:51:35 (580): No heartbeat from core client for 30 sec - exiting 09:51:36 (580): No heartbeat from core client for 30 sec - exiting 09:51:37 (580): No heartbeat from core client for 30 sec - exiting 09:51:38 (580): No heartbeat from core client for 30 sec - exiting 09:51:39 (580): No heartbeat from core client for 30 sec - exiting 09:51:40 (580): No heartbeat from core client for 30 sec - exiting 09:51:41 (580): No heartbeat from core client for 30 sec - exiting 09:51:42 (580): No heartbeat from core client for 30 sec - exiting 09:51:43 (580): No heartbeat from core client for 30 sec - exiting 09:51:44 (580): No heartbeat from core client for 30 sec - exiting 09:51:45 (580): No heartbeat from core client for 30 sec - exiting 09:51:46 (580): No heartbeat from core client for 30 sec - exiting 09:51:47 (580): No heartbeat from core client for 30 sec - exiting 09:51:48 (580): No heartbeat from core client for 30 sec - exiting 09:51:50 (580): No heartbeat from core client for 30 sec - exiting 09:51:51 (580): No heartbeat from core client for 30 sec - exiting 09:51:52 (580): No heartbeat from core client for 30 sec - exiting 09:51:53 (580): No heartbeat from core client for 30 sec - exiting 09:51:54 (580): No heartbeat from core client for 30 sec - exiting 09:51:55 (580): No heartbeat from core client for 30 sec - exiting 09:51:56 (580): No heartbeat from core client for 30 sec - exiting 09:51:57 (580): No heartbeat from core client for 30 sec - exiting 09:51:58 (580): No heartbeat from core client for 30 sec - exiting 09:51:59 (580): No heartbeat from core client for 30 sec - exiting 09:52:00 (580): No heartbeat from core client for 30 sec - exiting 09:52:01 (580): No heartbeat from core client for 30 sec - exiting 09:52:02 (580): No heartbeat from core client for 30 sec - exiting 09:52:03 (580): No heartbeat from core client for 30 sec - exiting 09:52:04 (580): No heartbeat from core client for 30 sec - exiting 09:52:05 (580): No heartbeat from core client for 30 sec - exiting 09:52:06 (580): No heartbeat from core client for 30 sec - exiting 09:52:07 (580): No heartbeat from core client for 30 sec - exiting 09:52:08 (580): No heartbeat from core client for 30 sec - exiting </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 May 2013 05:14:07	738901	15752521	hadcm3n_4i1x_1940_40_008303217_4	544,320	1,958,737	3.5985
25 May 2013 00:54:21	738901	15752521	hadcm3n_4i1x_1940_40_008303217_4	518,400	1,862,512	3.5928
23 May 2013 21:48:39	738901	15752521	hadcm3n_4i1x_1940_40_008303217_4	492,480	1,772,165	3.5985
22 May 2013 18:49:51	738901	15752521	hadcm3n_4i1x_1940_40_008303217_4	466,560	1,682,217	3.6056
21 May 2013 15:30:40	738901	15752521	hadcm3n_4i1x_1940_40_008303217_4	440,640	1,592,425	3.6139
20 May 2013 12:07:02	738901	15752521	hadcm3n_4i1x_1940_40_008303217_4	414,720	1,502,324	3.6225
19 May 2013 09:22:22	738901	15752521	hadcm3n_4i1x_1940_40_008303217_4	388,800	1,412,833	3.6338
18 May 2013 06:02:37	738901	15752521	hadcm3n_4i1x_1940_40_008303217_4	362,880	1,322,758	3.6452
17 May 2013 03:28:24	738901	15752521	hadcm3n_4i1x_1940_40_008303217_4	336,960	1,233,250	3.6599
15 May 2013 23:33:42	738901	15752521	hadcm3n_4i1x_1940_40_008303217_4	311,040	1,142,849	3.6743
14 May 2013 17:22:39	738901	15752521	hadcm3n_4i1x_1940_40_008303217_4	285,120	1,050,454	3.6843
13 May 2013 07:38:10	738901	15752521	hadcm3n_4i1x_1940_40_008303217_4	259,200	954,881	3.6840
11 May 2013 20:04:54	738901	15752521	hadcm3n_4i1x_1940_40_008303217_4	233,280	858,441	3.6799
10 May 2013 01:29:08	738901	15752521	hadcm3n_4i1x_1940_40_008303217_4	207,360	760,015	3.6652
08 May 2013 16:46:07	738901	15752521	hadcm3n_4i1x_1940_40_008303217_4	181,440	665,062	3.6655
07 May 2013 08:21:30	738901	15752521	hadcm3n_4i1x_1940_40_008303217_4	155,520	569,857	3.6642
05 May 2013 22:20:25	738901	15752521	hadcm3n_4i1x_1940_40_008303217_4	129,600	474,238	3.6592
04 May 2013 15:05:29	738901	15752521	hadcm3n_4i1x_1940_40_008303217_4	103,680	380,429	3.6693
03 May 2013 06:53:04	738901	15752521	hadcm3n_4i1x_1940_40_008303217_4	77,760	286,186	3.6804
01 May 2013 21:21:53	738901	15752521	hadcm3n_4i1x_1940_40_008303217_4	51,840	190,818	3.6809