Task 15698462

Name	hadcm3n_3eey_1940_40_008268320_4
Workunit	8423444
Created	1 Apr 2013, 9:14:59 UTC
Sent	1 Apr 2013, 9:18:26 UTC
Report deadline	1 Jul 2013, 16:45:37 UTC
Received	21 Jul 2013, 20:45:31 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1241871
Run time	6 days 11 hours 3 min 55 sec
CPU time	5 days 17 hours 28 min 34 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.26 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> ... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:28:49 (3836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:47:32 (3344): No heartbeat from core client for 30 sec - exiting 08:47:33 (3344): No heartbeat from core client for 30 sec - exiting 08:47:34 (3344): No heartbeat from core client for 30 sec - exiting 08:47:35 (3344): No heartbeat from core client for 30 sec - exiting 08:47:36 (3344): No heartbeat from core client for 30 sec - exiting 08:47:37 (3344): No heartbeat from core client for 30 sec - exiting 08:47:38 (3344): No heartbeat from core client for 30 sec - exiting 08:47:39 (3344): No heartbeat from core client for 30 sec - exiting 08:47:40 (3344): No heartbeat from core client for 30 sec - exiting 08:47:41 (3344): No heartbeat from core client for 30 sec - exiting 08:47:42 (3344): No heartbeat from core client for 30 sec - exiting 08:47:43 (3344): No heartbeat from core client for 30 sec - exiting 08:47:44 (3344): No heartbeat from core client for 30 sec - exiting 08:47:45 (3344): No heartbeat from core client for 30 sec - exiting 08:47:46 (3344): No heartbeat from core client for 30 sec - exiting 08:47:47 (3344): No heartbeat from core client for 30 sec - exiting 08:47:48 (3344): No heartbeat from core client for 30 sec - exiting 08:47:49 (3344): No heartbeat from core client for 30 sec - exiting 08:47:50 (3344): No heartbeat from core client for 30 sec - exiting 08:47:51 (3344): No heartbeat from core client for 30 sec - exiting 08:47:52 (3344): No heartbeat from core client for 30 sec - exiting 08:47:53 (3344): No heartbeat from core client for 30 sec - exiting 08:47:54 (3344): No heartbeat from core client for 30 sec - exiting 08:47:55 (3344): No heartbeat from core client for 30 sec - exiting 08:47:56 (3344): No heartbeat from core client for 30 sec - exiting 08:47:57 (3344): No heartbeat from core client for 30 sec - exiting 08:47:58 (3344): No heartbeat from core client for 30 sec - exiting 08:47:59 (3344): No heartbeat from core client for 30 sec - exiting 08:48:00 (3344): No heartbeat from core client for 30 sec - exiting 08:48:01 (3344): No heartbeat from core client for 30 sec - exiting 08:48:02 (3344): No heartbeat from core client for 30 sec - exiting 08:48:03 (3344): No heartbeat from core client for 30 sec - exiting 08:48:04 (3344): No heartbeat from core client for 30 sec - exiting 08:48:05 (3344): No heartbeat from core client for 30 sec - exiting 08:48:06 (3344): No heartbeat from core client for 30 sec - exiting 08:48:07 (3344): No heartbeat from core client for 30 sec - exiting 08:48:08 (3344): No heartbeat from core client for 30 sec - exiting 08:48:09 (3344): No heartbeat from core client for 30 sec - exiting 08:48:10 (3344): No heartbeat from core client for 30 sec - exiting 08:48:11 (3344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:48:44 (4224): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... 14:51:41 (2596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:53:05 (3904): No heartbeat from core client for 30 sec - exiting 18:53:06 (3904): No heartbeat from core client for 30 sec - exiting 18:53:07 (3904): No heartbeat from core client for 30 sec - exiting 18:53:08 (3904): No heartbeat from core client for 30 sec - exiting 18:53:09 (3904): No heartbeat from core client for 30 sec - exiting 18:53:10 (3904): No heartbeat from core client for 30 sec - exiting 18:53:11 (3904): No heartbeat from core client for 30 sec - exiting 18:53:12 (3904): No heartbeat from core client for 30 sec - exiting 18:53:13 (3904): No heartbeat from core client for 30 sec - exiting 18:53:14 (3904): No heartbeat from core client for 30 sec - exiting 18:53:15 (3904): No heartbeat from core client for 30 sec - exiting 18:53:16 (3904): No heartbeat from core client for 30 sec - exiting 18:53:17 (3904): No heartbeat from core client for 30 sec - exiting 18:53:18 (3904): No heartbeat from core client for 30 sec - exiting 18:53:19 (3904): No heartbeat from core client for 30 sec - exiting 18:53:20 (3904): No heartbeat from core client for 30 sec - exiting 18:53:21 (3904): No heartbeat from core client for 30 sec - exiting 18:53:22 (3904): No heartbeat from core client for 30 sec - exiting 18:53:23 (3904): No heartbeat from core client for 30 sec - exiting 18:53:24 (3904): No heartbeat from core client for 30 sec - exiting 18:53:25 (3904): No heartbeat from core client for 30 sec - exiting 18:53:26 (3904): No heartbeat from core client for 30 sec - exiting 18:53:27 (3904): No heartbeat from core client for 30 sec - exiting 18:53:28 (3904): No heartbeat from core client for 30 sec - exiting 18:53:29 (3904): No heartbeat from core client for 30 sec - exiting 18:53:30 (3904): No heartbeat from core client for 30 sec - exiting 18:53:31 (3904): No heartbeat from core client for 30 sec - exiting 18:53:32 (3904): No heartbeat from core client for 30 sec - exiting 18:53:33 (3904): No heartbeat from core client for 30 sec - exiting 18:53:34 (3904): No heartbeat from core client for 30 sec - exiting 18:53:35 (3904): No heartbeat from core client for 30 sec - exiting 18:53:36 (3904): No heartbeat from core client for 30 sec - exiting 18:53:37 (3904): No heartbeat from core client for 30 sec - exiting 18:53:38 (3904): No heartbeat from core client for 30 sec - exiting 18:53:39 (3904): No heartbeat from core client for 30 sec - exiting 18:53:40 (3904): No heartbeat from core client for 30 sec - exiting 18:53:41 (3904): No heartbeat from core client for 30 sec - exiting 18:53:42 (3904): No heartbeat from core client for 30 sec - exiting 18:53:43 (3904): No heartbeat from core client for 30 sec - exiting 18:53:44 (3904): No heartbeat from core client for 30 sec - exiting 18:53:45 (3904): No heartbeat from core client for 30 sec - exiting 18:53:46 (3904): No heartbeat from core client for 30 sec - exiting 18:53:47 (3904): No heartbeat from core client for 30 sec - exiting 18:53:48 (3904): No heartbeat from core client for 30 sec - exiting 18:53:49 (3904): No heartbeat from core client for 30 sec - exiting 18:53:50 (3904): No heartbeat from core client for 30 sec - exiting 18:53:51 (3904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4780, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 07:06:41 (2188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:04:13 (4144): No heartbeat from core client for 30 sec - exiting 11:04:14 (4144): No heartbeat from core client for 30 sec - exiting 11:04:15 (4144): No heartbeat from core client for 30 sec - exiting 11:04:16 (4144): No heartbeat from core client for 30 sec - exiting 11:04:17 (4144): No heartbeat from core client for 30 sec - exiting 11:04:18 (4144): No heartbeat from core client for 30 sec - exiting 11:04:19 (4144): No heartbeat from core client for 30 sec - exiting 11:04:20 (4144): No heartbeat from core client for 30 sec - exiting 11:04:21 (4144): No heartbeat from core client for 30 sec - exiting 11:04:22 (4144): No heartbeat from core client for 30 sec - exiting 11:04:23 (4144): No heartbeat from core client for 30 sec - exiting 11:04:24 (4144): No heartbeat from core client for 30 sec - exiting 11:04:25 (4144): No heartbeat from core client for 30 sec - exiting 11:04:26 (4144): No heartbeat from core client for 30 sec - exiting 11:04:27 (4144): No heartbeat from core client for 30 sec - exiting 11:04:28 (4144): No heartbeat from core client for 30 sec - exiting 11:04:29 (4144): No heartbeat from core client for 30 sec - exiting 11:04:30 (4144): No heartbeat from core client for 30 sec - exiting 11:04:31 (4144): No heartbeat from core client for 30 sec - exiting 11:04:32 (4144): No heartbeat from core client for 30 sec - exiting 11:04:33 (4144): No heartbeat from core client for 30 sec - exiting 11:04:34 (4144): No heartbeat from core client for 30 sec - exiting 11:04:35 (4144): No heartbeat from core client for 30 sec - exiting 11:04:36 (4144): No heartbeat from core client for 30 sec - exiting 11:04:37 (4144): No heartbeat from core client for 30 sec - exiting 11:04:38 (4144): No heartbeat from core client for 30 sec - exiting 11:04:39 (4144): No heartbeat from core client for 30 sec - exiting 11:04:40 (4144): No heartbeat from core client for 30 sec - exiting 11:04:41 (4144): No heartbeat from core client for 30 sec - exiting 11:04:42 (4144): No heartbeat from core client for 30 sec - exiting 11:04:43 (4144): No heartbeat from core client for 30 sec - exiting 11:04:44 (4144): No heartbeat from core client for 30 sec - exiting 11:04:45 (4144): No heartbeat from core client for 30 sec - exiting 11:04:46 (4144): No heartbeat from core client for 30 sec - exiting 11:04:47 (4144): No heartbeat from core client for 30 sec - exiting 11:04:48 (4144): No heartbeat from core client for 30 sec - exiting 11:04:49 (4144): No heartbeat from core client for 30 sec - exiting 11:04:50 (4144): No heartbeat from core client for 30 sec - exiting 11:04:51 (4144): No heartbeat from core client for 30 sec - exiting 11:04:52 (4144): No heartbeat from core client for 30 sec - exiting 11:04:53 (4144): No heartbeat from core client for 30 sec - exiting 11:04:54 (4144): No heartbeat from core client for 30 sec - exiting 11:04:55 (4144): No heartbeat from core client for 30 sec - exiting 11:04:56 (4144): No heartbeat from core client for 30 sec - exiting 11:04:57 (4144): No heartbeat from core client for 30 sec - exiting 11:04:58 (4144): No heartbeat from core client for 30 sec - exiting 11:04:59 (4144): No heartbeat from core client for 30 sec - exiting 11:05:00 (4144): No heartbeat from core client for 30 sec - exiting 11:05:01 (4144): No heartbeat from core client for 30 sec - exiting 11:05:02 (4144): No heartbeat from core client for 30 sec - exiting 11:05:03 (4144): No heartbeat from core client for 30 sec - exiting 11:05:04 (4144): No heartbeat from core client for 30 sec - exiting 11:05:05 (4144): No heartbeat from core client for 30 sec - exiting 11:05:06 (4144): No heartbeat from core client for 30 sec - exiting 11:05:07 (4144): No heartbeat from core client for 30 sec - exiting 11:05:08 (4144): No heartbeat from core client for 30 sec - exiting 11:05:09 (4144): No heartbeat from core client for 30 sec - exiting 11:05:10 (4144): No heartbeat from core client for 30 sec - exiting 11:05:11 (4144): No heartbeat from core client for 30 sec - exiting 11:05:12 (4144): No heartbeat from core client for 30 sec - exiting 11:05:13 (4144): No heartbeat from core client for 30 sec - exiting 11:05:14 (4144): No heartbeat from core client for 30 sec - exiting 11:05:15 (4144): No heartbeat from core client for 30 sec - exiting 11:05:16 (4144): No heartbeat from core client for 30 sec - exiting 11:05:17 (4144): No heartbeat from core client for 30 sec - exiting 11:05:18 (4144): No heartbeat from core client for 30 sec - exiting 11:05:19 (4144): No heartbeat from core client for 30 sec - exiting 11:05:20 (4144): No heartbeat from core client for 30 sec - exiting 11:05:21 (4144): No heartbeat from core client for 30 sec - exiting 11:05:22 (4144): No heartbeat from core client for 30 sec - exiting 11:05:23 (4144): No heartbeat from core client for 30 sec - exiting 11:05:24 (4144): No heartbeat from core client for 30 sec - exiting 11:05:25 (4144): No heartbeat from core client for 30 sec - exiting 11:05:26 (4144): No heartbeat from core client for 30 sec - exiting 11:05:27 (4144): No heartbeat from core client for 30 sec - exiting 11:05:28 (4144): No heartbeat from core client for 30 sec - exiting 11:05:29 (4144): No heartbeat from core client for 30 sec - exiting 11:05:30 (4144): No heartbeat from core client for 30 sec - exiting 11:05:31 (4144): No heartbeat from core client for 30 sec - exiting 11:05:32 (4144): No heartbeat from core client for 30 sec - exiting 11:05:33 (4144): No heartbeat from core client for 30 sec - exiting 11:05:34 (4144): No heartbeat from core client for 30 sec - exiting 11:05:35 (4144): No heartbeat from core client for 30 sec - exiting 11:05:36 (4144): No heartbeat from core client for 30 sec - exiting 11:05:37 (4144): No heartbeat from core client for 30 sec - exiting 11:05:38 (4144): No heartbeat from core client for 30 sec - exiting 11:05:39 (4144): No heartbeat from core client for 30 sec - exiting 11:05:40 (4144): No heartbeat from core client for 30 sec - exiting 11:05:41 (4144): No heartbeat from core client for 30 sec - exiting 11:05:42 (4144): No heartbeat from core client for 30 sec - exiting 11:05:43 (4144): No heartbeat from core client for 30 sec - exiting 11:05:44 (4144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:16:08 (4188): No heartbeat from core client for 30 sec - exiting 11:16:09 (4188): No heartbeat from core client for 30 sec - exiting 11:16:10 (4188): No heartbeat from core client for 30 sec - exiting 11:16:11 (4188): No heartbeat from core client for 30 sec - exiting 11:16:12 (4188): No heartbeat from core client for 30 sec - exiting 11:16:13 (4188): No heartbeat from core client for 30 sec - exiting 11:16:14 (4188): No heartbeat from core client for 30 sec - exiting 11:16:15 (4188): No heartbeat from core client for 30 sec - exiting 11:16:16 (4188): No heartbeat from core client for 30 sec - exiting 11:16:17 (4188): No heartbeat from core client for 30 sec - exiting 11:16:18 (4188): No heartbeat from core client for 30 sec - exiting 11:16:19 (4188): No heartbeat from core client for 30 sec - exiting 11:16:20 (4188): No heartbeat from core client for 30 sec - exiting 11:16:21 (4188): No heartbeat from core client for 30 sec - exiting 11:16:22 (4188): No heartbeat from core client for 30 sec - exiting 11:16:23 (4188): No heartbeat from core client for 30 sec - exiting 11:16:24 (4188): No heartbeat from core client for 30 sec - exiting 11:16:25 (4188): No heartbeat from core client for 30 sec - exiting 11:16:26 (4188): No heartbeat from core client for 30 sec - exiting 11:16:27 (4188): No heartbeat from core client for 30 sec - exiting 11:16:28 (4188): No heartbeat from core client for 30 sec - exiting 11:16:29 (4188): No heartbeat from core client for 30 sec - exiting 11:16:30 (4188): No heartbeat from core client for 30 sec - exiting 11:16:31 (4188): No heartbeat from core client for 30 sec - exiting 11:16:32 (4188): No heartbeat from core client for 30 sec - exiting 11:16:33 (4188): No heartbeat from core client for 30 sec - exiting 11:16:34 (4188): No heartbeat from core client for 30 sec - exiting 11:16:35 (4188): No heartbeat from core client for 30 sec - exiting 11:16:36 (4188): No heartbeat from core client for 30 sec - exiting 11:16:37 (4188): No heartbeat from core client for 30 sec - exiting 11:16:38 (4188): No heartbeat from core client for 30 sec - exiting 11:16:39 (4188): No heartbeat from core client for 30 sec - exiting 11:16:40 (4188): No heartbeat from core client for 30 sec - exiting 11:16:41 (4188): No heartbeat from core client for 30 sec - exiting 11:16:42 (4188): No heartbeat from core client for 30 sec - exiting 11:16:43 (4188): No heartbeat from core client for 30 sec - exiting 11:16:44 (4188): No heartbeat from core client for 30 sec - exiting 11:16:45 (4188): No heartbeat from core client for 30 sec - exiting 11:16:46 (4188): No heartbeat from core client for 30 sec - exiting 11:16:47 (4188): No heartbeat from core client for 30 sec - exiting 11:16:48 (4188): No heartbeat from core client for 30 sec - exiting 11:16:49 (4188): No heartbeat from core client for 30 sec - exiting 11:16:50 (4188): No heartbeat from core client for 30 sec - exiting 11:16:51 (4188): No heartbeat from core client for 30 sec - exiting 11:16:52 (4188): No heartbeat from core client for 30 sec - exiting 11:16:53 (4188): No heartbeat from core client for 30 sec - exiting 11:16:54 (4188): No heartbeat from core client for 30 sec - exiting 11:16:55 (4188): No heartbeat from core client for 30 sec - exiting 11:16:56 (4188): No heartbeat from core client for 30 sec - exiting 11:16:57 (4188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:17:27 (2952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:21:29 (4136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:38:54 (4392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:12:36 (3676): No heartbeat from core client for 30 sec - exiting 10:12:37 (3676): No heartbeat from core client for 30 sec - exiting 10:12:38 (3676): No heartbeat from core client for 30 sec - exiting 10:12:39 (3676): No heartbeat from core client for 30 sec - exiting 10:12:40 (3676): No heartbeat from core client for 30 sec - exiting 10:12:41 (3676): No heartbeat from core client for 30 sec - exiting 10:12:42 (3676): No heartbeat from core client for 30 sec - exiting 10:12:43 (3676): No heartbeat from core client for 30 sec - exiting 10:12:44 (3676): No heartbeat from core client for 30 sec - exiting 10:12:45 (3676): No heartbeat from core client for 30 sec - exiting 10:12:46 (3676): No heartbeat from core client for 30 sec - exiting 10:12:47 (3676): No heartbeat from core client for 30 sec - exiting 10:12:48 (3676): No heartbeat from core client for 30 sec - exiting 10:12:49 (3676): No heartbeat from core client for 30 sec - exiting 10:12:50 (3676): No heartbeat from core client for 30 sec - exiting 10:12:51 (3676): No heartbeat from core client for 30 sec - exiting 10:12:52 (3676): No heartbeat from core client for 30 sec - exiting 10:12:53 (3676): No heartbeat from core client for 30 sec - exiting 10:12:54 (3676): No heartbeat from core client for 30 sec - exiting 10:12:55 (3676): No heartbeat from core client for 30 sec - exiting 10:12:56 (3676): No heartbeat from core client for 30 sec - exiting 10:12:57 (3676): No heartbeat from core client for 30 sec - exiting 10:12:58 (3676): No heartbeat from core client for 30 sec - exiting 10:12:59 (3676): No heartbeat from core client for 30 sec - exiting 10:13:00 (3676): No heartbeat from core client for 30 sec - exiting 10:13:01 (3676): No heartbeat from core client for 30 sec - exiting 10:13:02 (3676): No heartbeat from core client for 30 sec - exiting 10:13:03 (3676): No heartbeat from core client for 30 sec - exiting 10:13:04 (3676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5040, iMonCtr=1 Model crash detected, will try to restart... 15:16:10 (1832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:10:02 (4288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77CC3AB3 read attempt to address 0x40B2B7C2 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77603AB3 read attempt to address 0x40B2B7C2 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_3eey_1940_40_008268320/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jul 2013 20:56:04	1241871	15698462	hadcm3n_3eey_1940_40_008268320_4	518,400	492,591	0.9502
10 Jul 2013 08:50:57	1241871	15698462	hadcm3n_3eey_1940_40_008268320_4	492,480	465,244	0.9447
13 Jun 2013 17:33:18	1241871	15698462	hadcm3n_3eey_1940_40_008268320_4	466,560	437,378	0.9375
07 Jun 2013 21:52:47	1241871	15698462	hadcm3n_3eey_1940_40_008268320_4	440,640	409,487	0.9293
31 May 2013 21:28:12	1241871	15698462	hadcm3n_3eey_1940_40_008268320_4	414,720	382,232	0.9217
27 May 2013 16:06:48	1241871	15698462	hadcm3n_3eey_1940_40_008268320_4	388,800	356,835	0.9178
26 May 2013 09:40:26	1241871	15698462	hadcm3n_3eey_1940_40_008268320_4	362,880	331,943	0.9147
15 May 2013 16:43:31	1241871	15698462	hadcm3n_3eey_1940_40_008268320_4	336,960	306,389	0.9093
07 May 2013 06:05:59	1241871	15698462	hadcm3n_3eey_1940_40_008268320_4	311,040	280,498	0.9018
05 May 2013 13:00:59	1241871	15698462	hadcm3n_3eey_1940_40_008268320_4	285,120	253,993	0.8908
03 May 2013 21:12:41	1241871	15698462	hadcm3n_3eey_1940_40_008268320_4	259,200	227,136	0.8763
25 Apr 2013 02:04:45	1241871	15698462	hadcm3n_3eey_1940_40_008268320_4	233,280	200,695	0.8603
19 Apr 2013 17:21:46	1241871	15698462	hadcm3n_3eey_1940_40_008268320_4	207,360	174,233	0.8402
11 Apr 2013 20:18:39	1241871	15698462	hadcm3n_3eey_1940_40_008268320_4	181,440	149,188	0.8222
05 Apr 2013 21:47:29	1241871	15698462	hadcm3n_3eey_1940_40_008268320_4	155,520	124,944	0.8034
04 Apr 2013 21:30:06	1241871	15698462	hadcm3n_3eey_1940_40_008268320_4	129,600	101,117	0.7802
03 Apr 2013 21:51:07	1241871	15698462	hadcm3n_3eey_1940_40_008268320_4	103,680	79,062	0.7626
03 Apr 2013 15:35:45	1241871	15698462	hadcm3n_3eey_1940_40_008268320_4	77,760	58,743	0.7554
03 Apr 2013 01:07:32	1241871	15698462	hadcm3n_3eey_1940_40_008268320_4	51,840	38,989	0.7521
02 Apr 2013 11:04:30	1241871	15698462	hadcm3n_3eey_1940_40_008268320_4	25,920	19,910	0.7681