Task 13393835

Name	hadcm3n_yg6z_1900_40_007353845_2
Workunit	7551275
Created	17 Sep 2011, 11:08:15 UTC
Sent	20 Sep 2011, 2:27:50 UTC
Report deadline	20 Dec 2011, 9:55:01 UTC
Received	7 Dec 2011, 17:39:41 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1002087
Run time	17 days 23 hours 55 min 34 sec
CPU time	15 days 4 hours 40 min 59 sec
Validate state	Invalid
Credit	10,575.36
Device peak FLOPS	2.80 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.8.13</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> etVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:12:42 (3548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:58:53 (2696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:26:07 (5036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:39:32 (5540): Can't set up shared mem: -1. Will run in standalone mode. 08:39:38 (3484): Can't set up shared mem: -1. Will run in standalone mode. 09:55:08 (3532): Can't acquire lockfile (32) - waiting 35s 09:55:43 (3532): Can't acquire lockfile (32) - exiting 09:55:43 (3532): Error: The process cannot access the file because it is being used by another process. (0x20) 09:55:44 (2976): Can't acquire lockfile (32) - waiting 35s 09:56:19 (2976): Can't acquire lockfile (32) - exiting 09:56:19 (2976): Error: The process cannot access the file because it is being used by another process. (0x20) 09:56:19 (4352): Can't acquire lockfile (32) - waiting 35s 09:56:54 (4352): Can't acquire lockfile (32) - exiting 09:56:54 (4352): Error: The process cannot access the file because it is being used by another process. (0x20) 09:56:54 (5380): Can't acquire lockfile (32) - waiting 35s 09:57:29 (5380): Can't acquire lockfile (32) - exiting 09:57:29 (5380): Error: The process cannot access the file because it is being used by another process. (0x20) 09:57:29 (3580): Can't acquire lockfile (32) - waiting 35s 09:58:04 (3580): Can't acquire lockfile (32) - exiting 09:58:04 (3580): Error: The process cannot access the file because it is being used by another process. (0x20) 09:58:04 (5680): Can't acquire lockfile (32) - waiting 35s 09:58:39 (5680): Can't acquire lockfile (32) - exiting 09:58:39 (5680): Error: The process cannot access the file because it is being used by another process. (0x20) 09:58:40 (4672): Can't acquire lockfile (32) - waiting 35s 09:59:15 (4672): Can't acquire lockfile (32) - exiting 09:59:15 (4672): Error: The process cannot access the file because it is being used by another process. (0x20) 09:59:15 (4836): Can't acquire lockfile (32) - waiting 35s 09:59:50 (4836): Can't acquire lockfile (32) - exiting 09:59:50 (4836): Error: The process cannot access the file because it is being used by another process. (0x20) 09:59:51 (2560): Can't acquire lockfile (32) - waiting 35s 10:00:26 (2560): Can't acquire lockfile (32) - exiting 10:00:26 (2560): Error: The process cannot access the file because it is being used by another process. (0x20) 10:00:26 (1556): Can't acquire lockfile (32) - waiting 35s 10:01:01 (1556): Can't acquire lockfile (32) - exiting 10:01:01 (1556): Error: The process cannot access the file because it is being used by another process. (0x20) 10:01:02 (272): Can't acquire lockfile (32) - waiting 35s 10:01:37 (272): Can't acquire lockfile (32) - exiting 10:01:37 (272): Error: The process cannot access the file because it is being used by another process. (0x20) 10:01:37 (4712): Can't acquire lockfile (32) - waiting 35s 10:02:12 (4712): Can't acquire lockfile (32) - exiting 10:02:12 (4712): Error: The process cannot access the file because it is being used by another process. (0x20) 10:02:12 (1904): Can't acquire lockfile (32) - waiting 35s 10:02:47 (1904): Can't acquire lockfile (32) - exiting 10:02:47 (1904): Error: The process cannot access the file because it is being used by another process. (0x20) 10:02:48 (4236): Can't acquire lockfile (32) - waiting 35s 10:03:23 (4236): Can't acquire lockfile (32) - exiting 10:03:23 (4236): Error: The process cannot access the file because it is being used by another process. (0x20) 10:03:23 (6024): Can't acquire lockfile (32) - waiting 35s 10:03:58 (6024): Can't acquire lockfile (32) - exiting 10:03:58 (6024): Error: The process cannot access the file because it is being used by another process. (0x20) 10:03:59 (5188): Can't acquire lockfile (32) - waiting 35s 10:04:34 (5188): Can't acquire lockfile (32) - exiting 10:04:34 (5188): Error: The process cannot access the file because it is being used by another process. (0x20) 10:04:35 (3016): Can't acquire lockfile (32) - waiting 35s 10:05:10 (3016): Can't acquire lockfile (32) - exiting 10:05:10 (3016): Error: The process cannot access the file because it is being used by another process. (0x20) 10:05:10 (4064): Can't acquire lockfile (32) - waiting 35s 10:05:45 (4064): Can't acquire lockfile (32) - exiting 10:05:45 (4064): Error: The process cannot access the file because it is being used by another process. (0x20) 10:05:45 (5924): Can't acquire lockfile (32) - waiting 35s 10:06:20 (5924): Can't acquire lockfile (32) - exiting 10:06:20 (5924): Error: The process cannot access the file because it is being used by another process. (0x20) 10:06:20 (5320): Can't acquire lockfile (32) - waiting 35s 10:06:55 (5320): Can't acquire lockfile (32) - exiting 10:06:55 (5320): Error: The process cannot access the file because it is being used by another process. (0x20) 10:06:55 (3988): Can't acquire lockfile (32) - waiting 35s 10:07:30 (3988): Can't acquire lockfile (32) - exiting 10:07:30 (3988): Error: The process cannot access the file because it is being used by another process. (0x20) 10:07:31 (1748): Can't acquire lockfile (32) - waiting 35s 10:08:06 (1748): Can't acquire lockfile (32) - exiting 10:08:06 (1748): Error: The process cannot access the file because it is being used by another process. (0x20) 10:08:06 (2388): Can't acquire lockfile (32) - waiting 35s 10:08:41 (2388): Can't acquire lockfile (32) - exiting 10:08:41 (2388): Error: The process cannot access the file because it is being used by another process. (0x20) 10:08:41 (5336): Can't acquire lockfile (32) - waiting 35s 10:09:16 (5336): Can't acquire lockfile (32) - exiting 10:09:16 (5336): Error: The process cannot access the file because it is being used by another process. (0x20) 10:09:17 (4848): Can't acquire lockfile (32) - waiting 35s 10:09:52 (4848): Can't acquire lockfile (32) - exiting 10:09:52 (4848): Error: The process cannot access the file because it is being used by another process. (0x20) 10:09:52 (5832): Can't acquire lockfile (32) - waiting 35s 10:10:27 (5832): Can't acquire lockfile (32) - exiting 10:10:27 (5832): Error: The process cannot access the file because it is being used by another process. (0x20) 10:10:27 (3948): Can't acquire lockfile (32) - waiting 35s 10:11:02 (3948): Can't acquire lockfile (32) - exiting 10:11:02 (3948): Error: The process cannot access the file because it is being used by another process. (0x20) 10:11:02 (5260): Can't acquire lockfile (32) - waiting 35s 10:11:37 (5260): Can't acquire lockfile (32) - exiting 10:11:37 (5260): Error: The process cannot access the file because it is being used by another process. (0x20) 10:11:37 (6100): Can't acquire lockfile (32) - waiting 35s 10:12:12 (6100): Can't acquire lockfile (32) - exiting 10:12:12 (6100): Error: The process cannot access the file because it is being used by another process. (0x20) 10:12:13 (5672): Can't acquire lockfile (32) - waiting 35s 10:12:48 (5672): Can't acquire lockfile (32) - exiting 10:12:48 (5672): Error: The process cannot access the file because it is being used by another process. (0x20) 10:12:48 (5344): Can't acquire lockfile (32) - waiting 35s 10:13:23 (5344): Can't acquire lockfile (32) - exiting 10:13:23 (5344): Error: The process cannot access the file because it is being used by another process. (0x20) 10:13:23 (4908): Can't acquire lockfile (32) - waiting 35s 10:13:58 (4908): Can't acquire lockfile (32) - exiting 10:13:58 (4908): Error: The process cannot access the file because it is being used by another process. (0x20) 10:13:59 (5284): Can't acquire lockfile (32) - waiting 35s 10:14:34 (5284): Can't acquire lockfile (32) - exiting 10:14:34 (5284): Error: The process cannot access the file because it is being used by another process. (0x20) 10:14:34 (6116): Can't acquire lockfile (32) - waiting 35s 10:15:09 (6116): Can't acquire lockfile (32) - exiting 10:15:09 (6116): Error: The process cannot access the file because it is being used by another process. (0x20) 10:15:09 (6136): Can't acquire lockfile (32) - waiting 35s 10:15:44 (6136): Can't acquire lockfile (32) - exiting 10:15:44 (6136): Error: The process cannot access the file because it is being used by another process. (0x20) 10:15:44 (3604): Can't acquire lockfile (32) - waiting 35s 10:16:19 (3604): Can't acquire lockfile (32) - exiting 10:16:19 (3604): Error: The process cannot access the file because it is being used by another process. (0x20) 10:16:19 (1748): Can't acquire lockfile (32) - waiting 35s 10:16:54 (1748): Can't acquire lockfile (32) - exiting 10:16:54 (1748): Error: The process cannot access the file because it is being used by another process. (0x20) 10:16:54 (5004): Can't acquire lockfile (32) - waiting 35s 10:17:29 (5004): Can't acquire lockfile (32) - exiting 10:17:29 (5004): Error: The process cannot access the file because it is being used by another process. (0x20) 10:17:29 (2976): Can't acquire lockfile (32) - waiting 35s 10:18:04 (2976): Can't acquire lockfile (32) - exiting 10:18:04 (2976): Error: The process cannot access the file because it is being used by another process. (0x20) 10:18:05 (4684): Can't acquire lockfile (32) - waiting 35s 10:18:40 (4684): Can't acquire lockfile (32) - exiting 10:18:40 (4684): Error: The process cannot access the file because it is being used by another process. (0x20) 10:18:40 (2436): Can't acquire lockfile (32) - waiting 35s 10:19:15 (2436): Can't acquire lockfile (32) - exiting 10:19:15 (2436): Error: The process cannot access the file because it is being used by another process. (0x20) 10:19:15 (5048): Can't acquire lockfile (32) - waiting 35s 10:19:50 (5048): Can't acquire lockfile (32) - exiting 10:19:50 (5048): Error: The process cannot access the file because it is being used by another process. (0x20) 10:19:50 (5124): Can't acquire lockfile (32) - waiting 35s 10:20:25 (5124): Can't acquire lockfile (32) - exiting 10:20:25 (5124): Error: The process cannot access the file because it is being used by another process. (0x20) 10:20:25 (3372): Can't acquire lockfile (32) - waiting 35s 10:21:00 (3372): Can't acquire lockfile (32) - exiting 10:21:00 (3372): Error: The process cannot access the file because it is being used by another process. (0x20) 10:21:00 (5436): Can't acquire lockfile (32) - waiting 35s 10:21:35 (5436): Can't acquire lockfile (32) - exiting 10:21:35 (5436): Error: The process cannot access the file because it is being used by another process. (0x20) 10:21:35 (4116): Can't acquire lockfile (32) - waiting 35s 10:22:10 (4116): Can't acquire lockfile (32) - exiting 10:22:10 (4116): Error: The process cannot access the file because it is being used by another process. (0x20) 10:22:10 (5356): Can't acquire lockfile (32) - waiting 35s 10:22:45 (5356): Can't acquire lockfile (32) - exiting 10:22:45 (5356): Error: The process cannot access the file because it is being used by another process. (0x20) 10:22:45 (4332): Can't acquire lockfile (32) - waiting 35s 10:23:20 (4332): Can't acquire lockfile (32) - exiting 10:23:20 (4332): Error: The process cannot access the file because it is being used by another process. (0x20) 10:23:21 (1188): Can't acquire lockfile (32) - waiting 35s 10:23:56 (1188): Can't acquire lockfile (32) - exiting 10:23:56 (1188): Error: The process cannot access the file because it is being used by another process. (0x20) 10:23:56 (6064): Can't acquire lockfile (32) - waiting 35s 10:24:31 (6064): Can't acquire lockfile (32) - exiting 10:24:31 (6064): Error: The process cannot access the file because it is being used by another process. (0x20) 10:24:32 (4564): Can't acquire lockfile (32) - waiting 35s 10:25:07 (4564): Can't acquire lockfile (32) - exiting 10:25:07 (4564): Error: The process cannot access the file because it is being used by another process. (0x20) 10:25:07 (4988): Can't acquire lockfile (32) - waiting 35s 10:25:42 (4988): Can't acquire lockfile (32) - exiting 10:25:42 (4988): Error: The process cannot access the file because it is being used by another process. (0x20) 10:25:42 (6040): Can't acquire lockfile (32) - waiting 35s 10:26:17 (6040): Can't acquire lockfile (32) - exiting 10:26:17 (6040): Error: The process cannot access the file because it is being used by another process. (0x20) 10:26:17 (4660): Can't acquire lockfile (32) - waiting 35s 10:26:52 (4660): Can't acquire lockfile (32) - exiting 10:26:52 (4660): Error: The process cannot access the file because it is being used by another process. (0x20) 10:26:52 (5220): Can't acquire lockfile (32) - waiting 35s 10:27:27 (5220): Can't acquire lockfile (32) - exiting 10:27:27 (5220): Error: The process cannot access the file because it is being used by another process. (0x20) 10:27:28 (4564): Can't acquire lockfile (32) - waiting 35s 10:28:03 (4564): Can't acquire lockfile (32) - exiting 10:28:03 (4564): Error: The process cannot access the file because it is being used by another process. (0x20) 10:28:03 (2244): Can't acquire lockfile (32) - waiting 35s 10:28:38 (2244): Can't acquire lockfile (32) - exiting 10:28:38 (2244): Error: The process cannot access the file because it is being used by another process. (0x20) 10:28:38 (3812): Can't acquire lockfile (32) - waiting 35s 10:29:13 (3812): Can't acquire lockfile (32) - exiting 10:29:13 (3812): Error: The process cannot access the file because it is being used by another process. (0x20) 10:29:13 (3076): Can't acquire lockfile (32) - waiting 35s 10:29:48 (3076): Can't acquire lockfile (32) - exiting 10:29:48 (3076): Error: The process cannot access the file because it is being used by another process. (0x20) 10:29:49 (5932): Can't acquire lockfile (32) - waiting 35s 10:30:24 (5932): Can't acquire lockfile (32) - exiting 10:30:24 (5932): Error: The process cannot access the file because it is being used by another process. (0x20) 10:30:24 (3456): Can't acquire lockfile (32) - waiting 35s 10:30:59 (3456): Can't acquire lockfile (32) - exiting 10:30:59 (3456): Error: The process cannot access the file because it is being used by another process. (0x20) 10:30:59 (4836): Can't acquire lockfile (32) - waiting 35s 10:31:34 (4836): Can't acquire lockfile (32) - exiting 10:31:34 (4836): Error: The process cannot access the file because it is being used by another process. (0x20) 10:31:34 (5852): Can't acquire lockfile (32) - waiting 35s 10:32:09 (5852): Can't acquire lockfile (32) - exiting 10:32:09 (5852): Error: The process cannot access the file because it is being used by another process. (0x20) 10:32:09 (5260): Can't acquire lockfile (32) - waiting 35s 10:32:44 (5260): Can't acquire lockfile (32) - exiting 10:32:44 (5260): Error: The process cannot access the file because it is being used by another process. (0x20) 10:32:44 (5272): Can't acquire lockfile (32) - waiting 35s 10:33:19 (5272): Can't acquire lockfile (32) - exiting 10:33:19 (5272): Error: The process cannot access the file because it is being used by another process. (0x20) 10:33:19 (5056): Can't acquire lockfile (32) - waiting 35s 10:33:54 (5056): Can't acquire lockfile (32) - exiting 10:33:54 (5056): Error: The process cannot access the file because it is being used by another process. (0x20) 10:33:54 (1212): Can't acquire lockfile (32) - waiting 35s 10:34:29 (1212): Can't acquire lockfile (32) - exiting 10:34:29 (1212): Error: The process cannot access the file because it is being used by another process. (0x20) 10:34:29 (4908): Can't acquire lockfile (32) - waiting 35s 10:35:04 (4908): Can't acquire lockfile (32) - exiting 10:35:04 (4908): Error: The process cannot access the file because it is being used by another process. (0x20) 10:35:04 (5424): Can't acquire lockfile (32) - waiting 35s 10:35:39 (5424): Can't acquire lockfile (32) - exiting 10:35:39 (5424): Error: The process cannot access the file because it is being used by another process. (0x20) 10:35:39 (5980): Can't acquire lockfile (32) - waiting 35s 10:36:14 (5980): Can't acquire lockfile (32) - exiting 10:36:14 (5980): Error: The process cannot access the file because it is being used by another process. (0x20) 10:36:15 (4648): Can't acquire lockfile (32) - waiting 35s 10:36:50 (4648): Can't acquire lockfile (32) - exiting 10:36:50 (4648): Error: The process cannot access the file because it is being used by another process. (0x20) 10:36:50 (5348): Can't acquire lockfile (32) - waiting 35s 10:37:25 (5348): Can't acquire lockfile (32) - exiting 10:37:25 (5348): Error: The process cannot access the file because it is being used by another process. (0x20) 10:37:25 (1032): Can't acquire lockfile (32) - waiting 35s 10:38:00 (1032): Can't acquire lockfile (32) - exiting 10:38:00 (1032): Error: The process cannot access the file because it is being used by another process. (0x20) 10:38:00 (1904): Can't acquire lockfile (32) - waiting 35s 10:38:35 (1904): Can't acquire lockfile (32) - exiting 10:38:35 (1904): Error: The process cannot access the file because it is being used by another process. (0x20) 10:38:36 (4040): Can't acquire lockfile (32) - waiting 35s 10:39:11 (4040): Can't acquire lockfile (32) - exiting 10:39:11 (4040): Error: The process cannot access the file because it is being used by another process. (0x20) 10:39:12 (956): Can't acquire lockfile (32) - waiting 35s 10:39:47 (956): Can't acquire lockfile (32) - exiting 10:39:47 (956): Error: The process cannot access the file because it is being used by another process. (0x20) 10:39:47 (3208): Can't acquire lockfile (32) - waiting 35s 10:40:22 (3208): Can't acquire lockfile (32) - exiting 10:40:22 (3208): Error: The process cannot access the file because it is being used by another process. (0x20) 10:40:22 (5344): Can't acquire lockfile (32) - waiting 35s 10:40:57 (5344): Can't acquire lockfile (32) - exiting 10:40:57 (5344): Error: The process cannot access the file because it is being used by another process. (0x20) 10:40:58 (1212): Can't acquire lockfile (32) - waiting 35s 10:41:33 (1212): Can't acquire lockfile (32) - exiting 10:41:33 (1212): Error: The process cannot access the file because it is being used by another process. (0x20) 10:41:33 (4272): Can't acquire lockfile (32) - waiting 35s 10:42:08 (4272): Can't acquire lockfile (32) - exiting 10:42:08 (4272): Error: The process cannot access the file because it is being used by another process. (0x20) 10:42:08 (4216): Can't acquire lockfile (32) - waiting 35s 10:42:43 (4216): Can't acquire lockfile (32) - exiting 10:42:43 (4216): Error: The process cannot access the file because it is being used by another process. (0x20) 10:42:43 (4032): Can't acquire lockfile (32) - waiting 35s 10:43:18 (4032): Can't acquire lockfile (32) - exiting 10:43:18 (4032): Error: The process cannot access the file because it is being used by another process. (0x20) 10:43:19 (5300): Can't acquire lockfile (32) - waiting 35s 10:43:54 (5300): Can't acquire lockfile (32) - exiting 10:43:54 (5300): Error: The process cannot access the file because it is being used by another process. (0x20) 10:43:54 (5852): Can't acquire lockfile (32) - waiting 35s 10:44:29 (5852): Can't acquire lockfile (32) - exiting 10:44:29 (5852): Error: The process cannot access the file because it is being used by another process. (0x20) 10:44:29 (5260): Can't acquire lockfile (32) - waiting 35s 10:45:04 (5260): Can't acquire lockfile (32) - exiting 10:45:04 (5260): Error: The process cannot access the file because it is being used by another process. (0x20) 10:45:05 (3208): Can't acquire lockfile (32) - waiting 35s 10:45:40 (3208): Can't acquire lockfile (32) - exiting 10:45:40 (3208): Error: The process cannot access the file because it is being used by another process. (0x20) 10:45:40 (2712): Can't acquire lockfile (32) - waiting 35s 10:46:15 (2712): Can't acquire lockfile (32) - exiting 10:46:15 (2712): Error: The process cannot access the file because it is being used by another process. (0x20) 10:46:15 (5424): Can't acquire lockfile (32) - waiting 35s 10:46:50 (5424): Can't acquire lockfile (32) - exiting 10:46:50 (5424): Error: The process cannot access the file because it is being used by another process. (0x20) 10:46:50 (6036): Can't acquire lockfile (32) - waiting 35s 10:47:25 (6036): Can't acquire lockfile (32) - exiting 10:47:25 (6036): Error: The process cannot access the file because it is being used by another process. (0x20) 10:47:25 (4684): Can't acquire lockfile (32) - waiting 35s 10:48:00 (4684): Can't acquire lockfile (32) - exiting 10:48:00 (4684): Error: The process cannot access the file because it is being used by another process. (0x20) 10:48:00 (5096): Can't acquire lockfile (32) - waiting 35s 10:48:35 (5096): Can't acquire lockfile (32) - exiting 10:48:35 (5096): Error: The process cannot access the file because it is being used by another process. (0x20) 10:48:35 (5484): Can't acquire lockfile (32) - waiting 35s 10:49:10 (5484): Can't acquire lockfile (32) - exiting 10:49:10 (5484): Error: The process cannot access the file because it is being used by another process. (0x20) 10:49:10 (6012): Can't acquire lockfile (32) - waiting 35s 10:49:45 (6012): Can't acquire lockfile (32) - exiting 10:49:45 (6012): Error: The process cannot access the file because it is being used by another process. (0x20) 10:49:46 (6028): Can't acquire lockfile (32) - waiting 35s 10:50:21 (6028): Can't acquire lockfile (32) - exiting 10:50:21 (6028): Error: The process cannot access the file because it is being used by another process. (0x20) 10:50:21 (2088): Can't acquire lockfile (32) - waiting 35s 10:50:56 (2088): Can't acquire lockfile (32) - exiting 10:50:56 (2088): Error: The process cannot access the file because it is being used by another process. (0x20) 10:50:56 (3948): Can't acquire lockfile (32) - waiting 35s 10:51:31 (3948): Can't acquire lockfile (32) - exiting 10:51:31 (3948): Error: The process cannot access the file because it is being used by another process. (0x20) 10:51:31 (2784): Can't acquire lockfile (32) - waiting 35s 10:52:06 (2784): Can't acquire lockfile (32) - exiting 10:52:06 (2784): Error: The process cannot access the file because it is being used by another process. (0x20) 10:52:06 (4912): Can't acquire lockfile (32) - waiting 35s 10:52:41 (4912): Can't acquire lockfile (32) - exiting 10:52:41 (4912): Error: The process cannot access the file because it is being used by another process. (0x20) 10:52:41 (4348): Can't acquire lockfile (32) - waiting 35s 10:53:16 (4348): Can't acquire lockfile (32) - exiting 10:53:16 (4348): Error: The process cannot access the file because it is being used by another process. (0x20) 10:53:16 (1904): Can't acquire lockfile (32) - waiting 35s 10:53:51 (1904): Can't acquire lockfile (32) - exiting 10:53:51 (1904): Error: The process cannot access the file because it is being used by another process. (0x20) 10:53:52 (4764): Can't acquire lockfile (32) - waiting 35s 10:54:27 (4764): Can't acquire lockfile (32) - exiting 10:54:27 (4764): Error: The process cannot access the file because it is being used by another process. (0x20) </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Dec 2011 14:43:53	1002087	13393835	hadcm3n_yg6z_1900_40_007353845_2	881,280	1,312,198	1.4890
03 Dec 2011 12:22:04	1002087	13393835	hadcm3n_yg6z_1900_40_007353845_2	855,360	1,270,166	1.4849
27 Nov 2011 23:37:37	1002087	13393835	hadcm3n_yg6z_1900_40_007353845_2	829,440	1,230,717	1.4838
27 Nov 2011 07:35:24	1002087	13393835	hadcm3n_yg6z_1900_40_007353845_2	803,520	1,191,703	1.4831
26 Nov 2011 18:38:44	1002087	13393835	hadcm3n_yg6z_1900_40_007353845_2	777,600	1,153,643	1.4836
26 Nov 2011 04:33:35	1002087	13393835	hadcm3n_yg6z_1900_40_007353845_2	751,680	1,116,857	1.4858
25 Nov 2011 14:57:32	1002087	13393835	hadcm3n_yg6z_1900_40_007353845_2	725,760	1,079,944	1.4880
24 Nov 2011 20:36:37	1002087	13393835	hadcm3n_yg6z_1900_40_007353845_2	699,840	1,043,315	1.4908
23 Nov 2011 19:32:13	1002087	13393835	hadcm3n_yg6z_1900_40_007353845_2	673,920	1,003,209	1.4886
23 Nov 2011 00:35:33	1002087	13393835	hadcm3n_yg6z_1900_40_007353845_2	648,000	964,289	1.4881
21 Nov 2011 17:10:45	1002087	13393835	hadcm3n_yg6z_1900_40_007353845_2	622,080	925,791	1.4882
06 Nov 2011 15:08:58	1002087	13393835	hadcm3n_yg6z_1900_40_007353845_2	596,160	887,908	1.4894
31 Oct 2011 16:52:01	1002087	13393835	hadcm3n_yg6z_1900_40_007353845_2	570,240	850,079	1.4907
31 Oct 2011 15:47:03	1002087	13393835	hadcm3n_yg6z_1900_40_007353845_2	544,320	811,278	1.4904
31 Oct 2011 13:16:19	1002087	13393835	hadcm3n_yg6z_1900_40_007353845_2	518,400	772,502	1.4902
31 Oct 2011 13:16:19	1002087	13393835	hadcm3n_yg6z_1900_40_007353845_2	492,480	733,676	1.4898
31 Oct 2011 13:16:18	1002087	13393835	hadcm3n_yg6z_1900_40_007353845_2	466,560	694,883	1.4894
31 Oct 2011 13:16:18	1002087	13393835	hadcm3n_yg6z_1900_40_007353845_2	440,640	656,218	1.4892
31 Oct 2011 13:16:18	1002087	13393835	hadcm3n_yg6z_1900_40_007353845_2	414,720	617,321	1.4885
31 Oct 2011 13:16:18	1002087	13393835	hadcm3n_yg6z_1900_40_007353845_2	388,800	578,537	1.4880