Task 13407360

Name	hadcm3n_u41e_1980_40_007458620_1
Workunit	7656123
Created	22 Sep 2011, 15:37:04 UTC
Sent	22 Sep 2011, 15:37:17 UTC
Report deadline	22 Dec 2011, 23:04:28 UTC
Received	29 Sep 2011, 9:02:05 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	921587
Run time	4 days 13 hours 25 min 38 sec
CPU time	4 days 5 hours 58 min 39 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.88 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> roller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... 19:36:58 (9128): No heartbeat from core client for 30 sec - exiting 19:36:59 (9128): No heartbeat from core client for 30 sec - exiting 19:37:00 (9128): No heartbeat from core client for 30 sec - exiting 19:37:01 (9128): No heartbeat from core client for 30 sec - exiting 19:37:02 (9128): No heartbeat from core client for 30 sec - exiting 19:37:03 (9128): No heartbeat from core client for 30 sec - exiting 19:37:04 (9128): No heartbeat from core client for 30 sec - exiting 19:37:05 (9128): No heartbeat from core client for 30 sec - exiting 19:37:06 (9128): No heartbeat from core client for 30 sec - exiting 19:37:07 (9128): No heartbeat from core client for 30 sec - exiting 19:37:08 (9128): No heartbeat from core client for 30 sec - exiting 19:37:09 (9128): No heartbeat from core client for 30 sec - exiting 19:37:10 (9128): No heartbeat from core client for 30 sec - exiting 19:37:11 (9128): No heartbeat from core client for 30 sec - exiting 19:37:12 (9128): No heartbeat from core client for 30 sec - exiting 19:37:13 (9128): No heartbeat from core client for 30 sec - exiting 19:37:14 (9128): No heartbeat from core client for 30 sec - exiting 19:37:15 (9128): No heartbeat from core client for 30 sec - exiting 19:37:16 (9128): No heartbeat from core client for 30 sec - exiting 19:37:17 (9128): No heartbeat from core client for 30 sec - exiting 19:37:18 (9128): No heartbeat from core client for 30 sec - exiting 19:37:19 (9128): No heartbeat from core client for 30 sec - exiting 19:37:20 (9128): No heartbeat from core client for 30 sec - exiting 19:37:21 (9128): No heartbeat from core client for 30 sec - exiting 19:37:22 (9128): No heartbeat from core client for 30 sec - exiting 19:37:23 (9128): No heartbeat from core client for 30 sec - exiting 19:37:24 (9128): No heartbeat from core client for 30 sec - exiting 19:37:25 (9128): No heartbeat from core client for 30 sec - exiting 19:37:26 (9128): No heartbeat from core client for 30 sec - exiting 19:37:27 (9128): No heartbeat from core client for 30 sec - exiting 19:37:28 (9128): No heartbeat from core client for 30 sec - exiting 19:37:29 (9128): No heartbeat from core client for 30 sec - exiting 19:37:30 (9128): No heartbeat from core client for 30 sec - exiting 19:37:31 (9128): No heartbeat from core client for 30 sec - exiting 19:37:32 (9128): No heartbeat from core client for 30 sec - exiting 19:37:33 (9128): No heartbeat from core client for 30 sec - exiting 19:37:34 (9128): No heartbeat from core client for 30 sec - exiting 19:37:35 (9128): No heartbeat from core client for 30 sec - exiting 19:37:36 (9128): No heartbeat from core client for 30 sec - exiting 19:37:37 (9128): No heartbeat from core client for 30 sec - exiting 19:37:38 (9128): No heartbeat from core client for 30 sec - exiting 19:37:39 (9128): No heartbeat from core client for 30 sec - exiting 19:37:40 (9128): No heartbeat from core client for 30 sec - exiting 19:37:41 (9128): No heartbeat from core client for 30 sec - exiting 19:37:42 (9128): No heartbeat from core client for 30 sec - exiting 19:37:43 (9128): No heartbeat from core client for 30 sec - exiting 19:37:44 (9128): No heartbeat from core client for 30 sec - exiting 19:37:45 (9128): No heartbeat from core client for 30 sec - exiting 19:37:46 (9128): No heartbeat from core client for 30 sec - exiting 19:37:47 (9128): No heartbeat from core client for 30 sec - exiting 19:37:48 (9128): No heartbeat from core client for 30 sec - exiting 19:37:49 (9128): No heartbeat from core client for 30 sec - exiting 19:37:50 (9128): No heartbeat from core client for 30 sec - exiting 19:37:51 (9128): No heartbeat from core client for 30 sec - exiting 19:37:52 (9128): No heartbeat from core client for 30 sec - exiting 19:37:53 (9128): No heartbeat from core client for 30 sec - exiting 19:37:54 (9128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:39:47 (7436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:39:48 (7436): No heartbeat from core client for 30 sec - exiting 19:39:49 (7436): No heartbeat from core client for 30 sec - exiting 19:39:50 (7436): No heartbeat from core client for 30 sec - exiting 19:39:51 (7436): No heartbeat from core client for 30 sec - exiting 19:39:52 (7436): No heartbeat from core client for 30 sec - exiting 19:39:53 (7436): No heartbeat from core client for 30 sec - exiting 19:39:54 (7436): No heartbeat from core client for 30 sec - exiting 19:39:55 (7436): No heartbeat from core client for 30 sec - exiting 19:39:56 (7436): No heartbeat from core client for 30 sec - exiting 19:39:57 (7436): No heartbeat from core client for 30 sec - exiting 19:46:20 (8252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:21 (8140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:23 (8140): No heartbeat from core client for 30 sec - exiting 19:51:24 (8140): No heartbeat from core client for 30 sec - exiting 19:51:25 (8140): No heartbeat from core client for 30 sec - exiting 19:51:26 (8140): No heartbeat from core client for 30 sec - exiting 19:51:27 (8140): No heartbeat from core client for 30 sec - exiting 19:51:28 (8140): No heartbeat from core client for 30 sec - exiting 19:51:29 (8140): No heartbeat from core client for 30 sec - exiting 19:51:30 (8140): No heartbeat from core client for 30 sec - exiting 19:51:31 (8140): No heartbeat from core client for 30 sec - exiting 20:06:24 (7584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:06:25 (7584): No heartbeat from core client for 30 sec - exiting 20:06:26 (7584): No heartbeat from core client for 30 sec - exiting 20:06:27 (7584): No heartbeat from core client for 30 sec - exiting 20:06:28 (7584): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 20:17:40 (5036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:17:41 (5036): No heartbeat from core client for 30 sec - exiting 20:17:42 (5036): No heartbeat from core client for 30 sec - exiting 20:26:25 (3092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:26:26 (3092): No heartbeat from core client for 30 sec - exiting 20:26:27 (3092): No heartbeat from core client for 30 sec - exiting 20:26:28 (3092): No heartbeat from core client for 30 sec - exiting 20:41:27 (4028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:41:28 (4028): No heartbeat from core client for 30 sec - exiting 20:41:29 (4028): No heartbeat from core client for 30 sec - exiting 20:41:30 (4028): No heartbeat from core client for 30 sec - exiting 20:41:31 (4028): No heartbeat from core client for 30 sec - exiting 20:41:32 (4028): No heartbeat from core client for 30 sec - exiting 20:41:33 (4028): No heartbeat from core client for 30 sec - exiting 20:41:34 (4028): No heartbeat from core client for 30 sec - exiting 20:41:35 (4028): No heartbeat from core client for 30 sec - exiting 20:41:36 (4028): No heartbeat from core client for 30 sec - exiting 20:41:37 (4028): No heartbeat from core client for 30 sec - exiting 20:46:28 (4684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:46:29 (4684): No heartbeat from core client for 30 sec - exiting 20:46:30 (4684): No heartbeat from core client for 30 sec - exiting 20:46:31 (4684): No heartbeat from core client for 30 sec - exiting 20:46:32 (4684): No heartbeat from core client for 30 sec - exiting 20:46:33 (4684): No heartbeat from core client for 30 sec - exiting 21:01:30 (4844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:01:31 (4844): No heartbeat from core client for 30 sec - exiting 21:01:32 (4844): No heartbeat from core client for 30 sec - exiting 21:01:33 (4844): No heartbeat from core client for 30 sec - exiting 21:01:34 (4844): No heartbeat from core client for 30 sec - exiting 21:01:35 (4844): No heartbeat from core client for 30 sec - exiting 21:01:36 (4844): No heartbeat from core client for 30 sec - exiting 21:01:37 (4844): No heartbeat from core client for 30 sec - exiting 21:01:38 (4844): No heartbeat from core client for 30 sec - exiting 21:01:39 (4844): No heartbeat from core client for 30 sec - exiting 21:01:40 (4844): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 21:21:32 (1984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:21:33 (1984): No heartbeat from core client for 30 sec - exiting 21:36:34 (5224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:41:34 (7264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:41:35 (7264): No heartbeat from core client for 30 sec - exiting 21:41:36 (7264): No heartbeat from core client for 30 sec - exiting 21:41:37 (7264): No heartbeat from core client for 30 sec - exiting 21:41:38 (7264): No heartbeat from core client for 30 sec - exiting 21:41:39 (7264): No heartbeat from core client for 30 sec - exiting 21:41:40 (7264): No heartbeat from core client for 30 sec - exiting 21:41:41 (7264): No heartbeat from core client for 30 sec - exiting 21:41:42 (7264): No heartbeat from core client for 30 sec - exiting 21:41:43 (7264): No heartbeat from core client for 30 sec - exiting 21:41:44 (7264): No heartbeat from core client for 30 sec - exiting 22:16:36 (6556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:16:37 (6556): No heartbeat from core client for 30 sec - exiting 22:16:38 (6556): No heartbeat from core client for 30 sec - exiting 22:16:39 (6556): No heartbeat from core client for 30 sec - exiting 22:16:40 (6556): No heartbeat from core client for 30 sec - exiting 22:16:41 (6556): No heartbeat from core client for 30 sec - exiting 22:16:42 (6556): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 22:36:40 (7152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:36:41 (7152): No heartbeat from core client for 30 sec - exiting 22:36:42 (7152): No heartbeat from core client for 30 sec - exiting 22:36:43 (7152): No heartbeat from core client for 30 sec - exiting 22:36:44 (7152): No heartbeat from core client for 30 sec - exiting 22:36:45 (7152): No heartbeat from core client for 30 sec - exiting 22:36:46 (7152): No heartbeat from core client for 30 sec - exiting 22:36:47 (7152): No heartbeat from core client for 30 sec - exiting 22:36:48 (7152): No heartbeat from core client for 30 sec - exiting 22:36:49 (7152): No heartbeat from core client for 30 sec - exiting 22:36:50 (7152): No heartbeat from core client for 30 sec - exiting 22:50:45 (4144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:50:46 (4144): No heartbeat from core client for 30 sec - exiting 22:50:47 (4144): No heartbeat from core client for 30 sec - exiting 22:50:48 (4144): No heartbeat from core client for 30 sec - exiting 22:50:49 (4144): No heartbeat from core client for 30 sec - exiting 22:50:50 (4144): No heartbeat from core client for 30 sec - exiting 22:50:51 (4144): No heartbeat from core client for 30 sec - exiting 22:50:52 (4144): No heartbeat from core client for 30 sec - exiting 22:50:53 (4144): No heartbeat from core client for 30 sec - exiting 22:50:54 (4144): No heartbeat from core client for 30 sec - exiting 22:50:55 (4144): No heartbeat from core client for 30 sec - exiting 23:07:17 (6068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:17:18 (7436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:17:19 (7436): No heartbeat from core client for 30 sec - exiting 23:17:20 (7436): No heartbeat from core client for 30 sec - exiting 23:17:21 (7436): No heartbeat from core client for 30 sec - exiting 23:17:22 (7436): No heartbeat from core client for 30 sec - exiting 23:17:23 (7436): No heartbeat from core client for 30 sec - exiting 23:17:24 (7436): No heartbeat from core client for 30 sec - exiting 23:17:25 (7436): No heartbeat from core client for 30 sec - exiting 23:17:26 (7436): No heartbeat from core client for 30 sec - exiting 23:17:27 (7436): No heartbeat from core client for 30 sec - exiting 23:37:21 (9132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:37:22 (9132): No heartbeat from core client for 30 sec - exiting 23:37:23 (9132): No heartbeat from core client for 30 sec - exiting 23:37:24 (9132): No heartbeat from core client for 30 sec - exiting 23:37:25 (9132): No heartbeat from core client for 30 sec - exiting 23:37:26 (9132): No heartbeat from core client for 30 sec - exiting 23:37:27 (9132): No heartbeat from core client for 30 sec - exiting 23:57:22 (8596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:57:23 (8596): No heartbeat from core client for 30 sec - exiting 23:57:24 (8596): No heartbeat from core client for 30 sec - exiting 23:57:25 (8596): No heartbeat from core client for 30 sec - exiting 23:57:26 (8596): No heartbeat from core client for 30 sec - exiting 23:57:27 (8596): No heartbeat from core client for 30 sec - exiting 23:57:28 (8596): No heartbeat from core client for 30 sec - exiting 00:17:17 (8300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:17:18 (8300): No heartbeat from core client for 30 sec - exiting 00:17:19 (8300): No heartbeat from core client for 30 sec - exiting 00:17:20 (8300): No heartbeat from core client for 30 sec - exiting 00:17:21 (8300): No heartbeat from core client for 30 sec - exiting 00:17:22 (8300): No heartbeat from core client for 30 sec - exiting 00:17:23 (8300): No heartbeat from core client for 30 sec - exiting 00:17:24 (8300): No heartbeat from core client for 30 sec - exiting 00:17:25 (8300): No heartbeat from core client for 30 sec - exiting 00:17:26 (8300): No heartbeat from core client for 30 sec - exiting 00:17:27 (8300): No heartbeat from core client for 30 sec - exiting 00:23:37 (5188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:23:38 (5188): No heartbeat from core client for 30 sec - exiting 00:23:39 (5188): No heartbeat from core client for 30 sec - exiting 00:23:40 (5188): No heartbeat from core client for 30 sec - exiting 00:28:37 (9184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:28:38 (9184): No heartbeat from core client for 30 sec - exiting 00:37:04 (5168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:37:05 (5168): No heartbeat from core client for 30 sec - exiting 00:37:06 (5168): No heartbeat from core client for 30 sec - exiting 00:37:07 (5168): No heartbeat from core client for 30 sec - exiting 00:37:08 (5168): No heartbeat from core client for 30 sec - exiting 00:37:09 (5168): No heartbeat from core client for 30 sec - exiting 00:37:10 (5168): No heartbeat from core client for 30 sec - exiting 00:37:11 (5168): No heartbeat from core client for 30 sec - exiting 00:37:12 (5168): No heartbeat from core client for 30 sec - exiting 00:37:13 (5168): No heartbeat from core client for 30 sec - exiting 00:43:37 (8624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:43:38 (8624): No heartbeat from core client for 30 sec - exiting 00:43:39 (8624): No heartbeat from core client for 30 sec - exiting 00:48:38 (6432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:48:39 (6432): No heartbeat from core client for 30 sec - exiting 00:48:40 (6432): No heartbeat from core client for 30 sec - exiting 00:48:41 (6432): No heartbeat from core client for 30 sec - exiting 00:48:42 (6432): No heartbeat from core client for 30 sec - exiting 00:48:43 (6432): No heartbeat from core client for 30 sec - exiting 00:48:44 (6432): No heartbeat from core client for 30 sec - exiting 00:48:45 (6432): No heartbeat from core client for 30 sec - exiting 00:48:46 (6432): No heartbeat from core client for 30 sec - exiting 00:48:47 (6432): No heartbeat from core client for 30 sec - exiting 00:48:48 (6432): No heartbeat from core client for 30 sec - exiting 01:03:39 (8292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:03:40 (8292): No heartbeat from core client for 30 sec - exiting 01:03:41 (8292): No heartbeat from core client for 30 sec - exiting 01:03:42 (8292): No heartbeat from core client for 30 sec - exiting 01:03:43 (8292): No heartbeat from core client for 30 sec - exiting 01:03:44 (8292): No heartbeat from core client for 30 sec - exiting 01:03:45 (8292): No heartbeat from core client for 30 sec - exiting 01:03:46 (8292): No heartbeat from core client for 30 sec - exiting 01:03:47 (8292): No heartbeat from core client for 30 sec - exiting 01:08:40 (8080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:08:41 (8080): No heartbeat from core client for 30 sec - exiting 01:08:42 (8080): No heartbeat from core client for 30 sec - exiting 01:08:43 (8080): No heartbeat from core client for 30 sec - exiting 01:08:44 (8080): No heartbeat from core client for 30 sec - exiting 01:08:45 (8080): No heartbeat from core client for 30 sec - exiting 01:08:46 (8080): No heartbeat from core client for 30 sec - exiting 01:08:47 (8080): No heartbeat from core client for 30 sec - exiting 01:08:48 (8080): No heartbeat from core client for 30 sec - exiting 01:08:49 (8080): No heartbeat from core client for 30 sec - exiting 01:08:50 (8080): No heartbeat from core client for 30 sec - exiting 01:23:41 (7764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:23:42 (7764): No heartbeat from core client for 30 sec - exiting 01:23:43 (7764): No heartbeat from core client for 30 sec - exiting 01:23:44 (7764): No heartbeat from core client for 30 sec - exiting 01:23:45 (7764): No heartbeat from core client for 30 sec - exiting 01:23:46 (7764): No heartbeat from core client for 30 sec - exiting 01:23:47 (7764): No heartbeat from core client for 30 sec - exiting 01:23:48 (7764): No heartbeat from core client for 30 sec - exiting 01:23:49 (7764): No heartbeat from core client for 30 sec - exiting 01:23:50 (7764): No heartbeat from core client for 30 sec - exiting 01:23:51 (7764): No heartbeat from core client for 30 sec - exiting 01:28:42 (5980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:31:22 (988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:31:23 (988): No heartbeat from core client for 30 sec - exiting 01:31:24 (988): No heartbeat from core client for 30 sec - exiting 01:31:25 (988): No heartbeat from core client for 30 sec - exiting 01:31:26 (988): No heartbeat from core client for 30 sec - exiting 01:31:27 (988): No heartbeat from core client for 30 sec - exiting 01:31:28 (988): No heartbeat from core client for 30 sec - exiting 01:31:29 (988): No heartbeat from core client for 30 sec - exiting 01:31:30 (988): No heartbeat from core client for 30 sec - exiting 01:37:11 (5036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:37:12 (5036): No heartbeat from core client for 30 sec - exiting 01:37:13 (5036): No heartbeat from core client for 30 sec - exiting 01:37:14 (5036): No heartbeat from core client for 30 sec - exiting 01:37:15 (5036): No heartbeat from core client for 30 sec - exiting 01:37:16 (5036): No heartbeat from core client for 30 sec - exiting 01:37:17 (5036): No heartbeat from core client for 30 sec - exiting 01:37:18 (5036): No heartbeat from core client for 30 sec - exiting 01:37:19 (5036): No heartbeat from core client for 30 sec - exiting 01:37:20 (5036): No heartbeat from core client for 30 sec - exiting 01:37:21 (5036): No heartbeat from core client for 30 sec - exiting 01:43:44 (4268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:43:45 (4268): No heartbeat from core client for 30 sec - exiting 01:43:46 (4268): No heartbeat from core client for 30 sec - exiting 01:43:47 (4268): No heartbeat from core client for 30 sec - exiting 01:43:48 (4268): No heartbeat from core client for 30 sec - exiting 01:43:49 (4268): No heartbeat from core client for 30 sec - exiting 01:43:50 (4268): No heartbeat from core client for 30 sec - exiting 01:43:51 (4268): No heartbeat from core client for 30 sec - exiting 01:43:52 (4268): No heartbeat from core client for 30 sec - exiting 01:48:45 (3092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:03:46 (8648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:03:47 (8648): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 02:08:47 (6812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:08:48 (6812): No heartbeat from core client for 30 sec - exiting 02:08:49 (6812): No heartbeat from core client for 30 sec - exiting 02:08:50 (6812): No heartbeat from core client for 30 sec - exiting 02:08:51 (6812): No heartbeat from core client for 30 sec - exiting 02:08:52 (6812): No heartbeat from core client for 30 sec - exiting 02:08:53 (6812): No heartbeat from core client for 30 sec - exiting 02:08:54 (6812): No heartbeat from core client for 30 sec - exiting 02:08:55 (6812): No heartbeat from core client for 30 sec - exiting 02:08:56 (6812): No heartbeat from core client for 30 sec - exiting 02:08:57 (6812): No heartbeat from core client for 30 sec - exiting 02:23:49 (5232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:23:50 (5232): No heartbeat from core client for 30 sec - exiting 02:23:51 (5232): No heartbeat from core client for 30 sec - exiting 02:23:52 (5232): No heartbeat from core client for 30 sec - exiting 02:23:53 (5232): No heartbeat from core client for 30 sec - exiting 02:23:54 (5232): No heartbeat from core client for 30 sec - exiting 02:23:55 (5232): No heartbeat from core client for 30 sec - exiting 02:23:56 (5232): No heartbeat from core client for 30 sec - exiting 02:23:57 (5232): No heartbeat from core client for 30 sec - exiting 02:23:58 (5232): No heartbeat from core client for 30 sec - exiting 02:23:59 (5232): No heartbeat from core client for 30 sec - exiting 02:43:53 (4544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:43:54 (4544): No heartbeat from core client for 30 sec - exiting 02:43:55 (4544): No heartbeat from core client for 30 sec - exiting 02:43:56 (4544): No heartbeat from core client for 30 sec - exiting 02:43:57 (4544): No heartbeat from core client for 30 sec - exiting 02:43:58 (4544): No heartbeat from core client for 30 sec - exiting 02:43:59 (4544): No heartbeat from core client for 30 sec - exiting 02:44:00 (4544): No heartbeat from core client for 30 sec - exiting 02:44:01 (4544): No heartbeat from core client for 30 sec - exiting 02:44:02 (4544): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 03:03:57 (8624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:03:58 (8624): No heartbeat from core client for 30 sec - exiting 03:03:59 (8624): No heartbeat from core client for 30 sec - exiting 03:04:00 (8624): No heartbeat from core client for 30 sec - exiting 03:04:01 (8624): No heartbeat from core client for 30 sec - exiting 03:04:02 (8624): No heartbeat from core client for 30 sec - exiting 03:04:03 (8624): No heartbeat from core client for 30 sec - exiting 03:04:04 (8624): No heartbeat from core client for 30 sec - exiting 03:18:58 (8672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:23:59 (10216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:24:00 (10216): No heartbeat from core client for 30 sec - exiting 03:24:01 (10216): No heartbeat from core client for 30 sec - exiting 03:24:02 (10216): No heartbeat from core client for 30 sec - exiting 03:24:03 (10216): No heartbeat from core client for 30 sec - exiting 03:24:04 (10216): No heartbeat from core client for 30 sec - exiting 03:35:20 (6116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:35:21 (6116): No heartbeat from core client for 30 sec - exiting 03:39:01 (9756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:39:02 (9756): No heartbeat from core client for 30 sec - exiting 03:39:03 (9756): No heartbeat from core client for 30 sec - exiting 03:39:04 (9756): No heartbeat from core client for 30 sec - exiting 03:39:05 (9756): No heartbeat from core client for 30 sec - exiting 03:39:06 (9756): No heartbeat from core client for 30 sec - exiting 03:39:07 (9756): No heartbeat from core client for 30 sec - exiting 03:39:08 (9756): No heartbeat from core client for 30 sec - exiting 03:39:09 (9756): No heartbeat from core client for 30 sec - exiting 03:44:01 (6472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:44:02 (6472): No heartbeat from core client for 30 sec - exiting 03:44:03 (6472): No heartbeat from core client for 30 sec - exiting 03:44:04 (6472): No heartbeat from core client for 30 sec - exiting 03:44:05 (6472): No heartbeat from core client for 30 sec - exiting 03:44:06 (6472): No heartbeat from core client for 30 sec - exiting 03:58:04 (8448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:58:05 (8448): No heartbeat from core client for 30 sec - exiting 03:58:06 (8448): No heartbeat from core client for 30 sec - exiting 03:58:07 (8448): No heartbeat from core client for 30 sec - exiting 03:58:08 (8448): No heartbeat from core client for 30 sec - exiting 03:58:09 (8448): No heartbeat from core client for 30 sec - exiting 03:58:10 (8448): No heartbeat from core client for 30 sec - exiting 03:58:11 (8448): No heartbeat from core client for 30 sec - exiting 03:58:12 (8448): No heartbeat from core client for 30 sec - exiting 03:58:13 (8448): No heartbeat from core client for 30 sec - exiting 03:58:14 (8448): No heartbeat from core client for 30 sec - exiting 04:04:35 (9632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:04:36 (9632): No heartbeat from core client for 30 sec - exiting 04:04:37 (9632): No heartbeat from core client for 30 sec - exiting 04:04:38 (9632): No heartbeat from core client for 30 sec - exiting 04:04:39 (9632): No heartbeat from core client for 30 sec - exiting 04:04:40 (9632): No heartbeat from core client for 30 sec - exiting 04:04:41 (9632): No heartbeat from core client for 30 sec - exiting 04:04:42 (9632): No heartbeat from core client for 30 sec - exiting 04:04:43 (9632): No heartbeat from core client for 30 sec - exiting 04:09:36 (9012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:09:37 (9012): No heartbeat from core client for 30 sec - exiting 04:09:38 (9012): No heartbeat from core client for 30 sec - exiting 04:09:39 (9012): No heartbeat from core client for 30 sec - exiting 04:09:40 (9012): No heartbeat from core client for 30 sec - exiting 04:19:17 (1292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:24:48 (10168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:24:49 (10168): No heartbeat from core client for 30 sec - exiting 04:24:50 (10168): No heartbeat from core client for 30 sec - exiting 04:24:51 (10168): No heartbeat from core client for 30 sec - exiting 04:24:52 (10168): No heartbeat from core client for 30 sec - exiting 04:24:53 (10168): No heartbeat from core client for 30 sec - exiting 04:24:54 (10168): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 04:29:48 (7476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:29:49 (7476): No heartbeat from core client for 30 sec - exiting 04:29:50 (7476): No heartbeat from core client for 30 sec - exiting 04:29:51 (7476): No heartbeat from core client for 30 sec - exiting 04:29:52 (7476): No heartbeat from core client for 30 sec - exiting 04:29:53 (7476): No heartbeat from core client for 30 sec - exiting 04:29:54 (7476): No heartbeat from core client for 30 sec - exiting 04:29:55 (7476): No heartbeat from core client for 30 sec - exiting 04:29:56 (7476): No heartbeat from core client for 30 sec - exiting 04:29:57 (7476): No heartbeat from core client for 30 sec - exiting 04:29:58 (7476): No heartbeat from core client for 30 sec - exiting 04:41:36 (4892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:41:37 (4892): No heartbeat from core client for 30 sec - exiting 04:41:38 (4892): No heartbeat from core client for 30 sec - exiting 04:41:39 (4892): No heartbeat from core client for 30 sec - exiting 04:41:40 (4892): No heartbeat from core client for 30 sec - exiting 04:41:41 (4892): No heartbeat from core client for 30 sec - exiting 04:41:42 (4892): No heartbeat from core client for 30 sec - exiting 04:41:43 (4892): No heartbeat from core client for 30 sec - exiting 04:41:44 (4892): No heartbeat from core client for 30 sec - exiting 04:41:45 (4892): No heartbeat from core client for 30 sec - exiting 04:41:46 (4892): No heartbeat from core client for 30 sec - exiting 04:44:49 (9720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:44:50 (9720): No heartbeat from core client for 30 sec - exiting 04:44:51 (9720): No heartbeat from core client for 30 sec - exiting 04:44:52 (9720): No heartbeat from core client for 30 sec - exiting 04:44:53 (9720): No heartbeat from core client for 30 sec - exiting 04:44:54 (9720): No heartbeat from core client for 30 sec - exiting 04:44:55 (9720): No heartbeat from core client for 30 sec - exiting 04:44:56 (9720): No heartbeat from core client for 30 sec - exiting 04:44:57 (9720): No heartbeat from core client for 30 sec - exiting 04:44:58 (9720): No heartbeat from core client for 30 sec - exiting 04:58:39 (9252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:58:40 (9252): No heartbeat from core client for 30 sec - exiting 04:58:41 (9252): No heartbeat from core client for 30 sec - exiting 04:58:42 (9252): No heartbeat from core client for 30 sec - exiting 04:58:43 (9252): No heartbeat from core client for 30 sec - exiting 04:58:44 (9252): No heartbeat from core client for 30 sec - exiting 04:58:45 (9252): No heartbeat from core client for 30 sec - exiting 04:58:46 (9252): No heartbeat from core client for 30 sec - exiting 04:58:47 (9252): No heartbeat from core client for 30 sec - exiting 04:58:48 (9252): No heartbeat from core client for 30 sec - exiting 04:58:49 (9252): No heartbeat from core client for 30 sec - exiting 05:05:11 (9520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:05:12 (9520): No heartbeat from core client for 30 sec - exiting 05:05:13 (9520): No heartbeat from core client for 30 sec - exiting 05:05:14 (9520): No heartbeat from core client for 30 sec - exiting 05:05:15 (9520): No heartbeat from core client for 30 sec - exiting 05:05:16 (9520): No heartbeat from core client for 30 sec - exiting 05:05:17 (9520): No heartbeat from core client for 30 sec - exiting 05:05:18 (9520): No heartbeat from core client for 30 sec - exiting 05:05:19 (9520): No heartbeat from core client for 30 sec - exiting 05:05:20 (9520): No heartbeat from core client for 30 sec - exiting 05:05:21 (9520): No heartbeat from core client for 30 sec - exiting 05:10:13 (5288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:10:14 (5288): No heartbeat from core client for 30 sec - exiting 05:10:15 (5288): No heartbeat from core client for 30 sec - exiting 05:10:16 (5288): No heartbeat from core client for 30 sec - exiting 05:10:17 (5288): No heartbeat from core client for 30 sec - exiting 05:10:18 (5288): No heartbeat from core client for 30 sec - exiting 05:10:19 (5288): No heartbeat from core client for 30 sec - exiting 05:10:20 (5288): No heartbeat from core client for 30 sec - exiting 05:10:21 (5288): No heartbeat from core client for 30 sec - exiting 05:25:14 (5328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:25:15 (5328): No heartbeat from core client for 30 sec - exiting 05:25:16 (5328): No heartbeat from core client for 30 sec - exiting 05:25:17 (5328): No heartbeat from core client for 30 sec - exiting 05:25:18 (5328): No heartbeat from core client for 30 sec - exiting 05:25:19 (5328): No heartbeat from core client for 30 sec - exiting 05:25:20 (5328): No heartbeat from core client for 30 sec - exiting 05:25:21 (5328): No heartbeat from core client for 30 sec - exiting 05:25:22 (5328): No heartbeat from core client for 30 sec - exiting 05:25:23 (5328): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 05:39:31 (9496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:39:32 (9496): No heartbeat from core client for 30 sec - exiting 05:39:33 (9496): No heartbeat from core client for 30 sec - exiting 05:39:34 (9496): No heartbeat from core client for 30 sec - exiting 05:39:35 (9496): No heartbeat from core client for 30 sec - exiting 05:39:36 (9496): No heartbeat from core client for 30 sec - exiting 05:39:37 (9496): No heartbeat from core client for 30 sec - exiting 05:39:38 (9496): No heartbeat from core client for 30 sec - exiting 05:39:39 (9496): No heartbeat from core client for 30 sec - exiting 05:39:40 (9496): No heartbeat from core client for 30 sec - exiting 05:39:41 (9496): No heartbeat from core client for 30 sec - exiting 05:45:37 (6408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:45:38 (6408): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 05:50:39 (4708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:50:40 (4708): No heartbeat from core client for 30 sec - exiting 05:50:41 (4708): No heartbeat from core client for 30 sec - exiting 05:50:42 (4708): No heartbeat from core client for 30 sec - exiting 05:50:43 (4708): No heartbeat from core client for 30 sec - exiting 05:50:44 (4708): No heartbeat from core client for 30 sec - exiting 05:50:45 (4708): No heartbeat from core client for 30 sec - exiting 05:50:46 (4708): No heartbeat from core client for 30 sec - exiting 05:50:47 (4708): No heartbeat from core client for 30 sec - exiting 05:50:48 (4708): No heartbeat from core client for 30 sec - exiting 05:50:49 (4708): No heartbeat from core client for 30 sec - exiting 06:05:39 (8724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:05:40 (8724): No heartbeat from core client for 30 sec - exiting 06:05:41 (8724): No heartbeat from core client for 30 sec - exiting 06:05:42 (8724): No heartbeat from core client for 30 sec - exiting 06:05:43 (8724): No heartbeat from core client for 30 sec - exiting 06:10:40 (9944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:10:41 (9944): No heartbeat from core client for 30 sec - exiting 06:10:42 (9944): No heartbeat from core client for 30 sec - exiting 06:10:43 (9944): No heartbeat from core client for 30 sec - exiting 06:25:41 (4688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:25:42 (4688): No heartbeat from core client for 30 sec - exiting 06:25:43 (4688): No heartbeat from core client for 30 sec - exiting 06:25:44 (4688): No heartbeat from core client for 30 sec - exiting 06:25:45 (4688): No heartbeat from core client for 30 sec - exiting 06:25:46 (4688): No heartbeat from core client for 30 sec - exiting 06:25:47 (4688): No heartbeat from core client for 30 sec - exiting 06:25:48 (4688): No heartbeat from core client for 30 sec - exiting 06:25:49 (4688): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 06:30:42 (8152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:30:43 (8152): No heartbeat from core client for 30 sec - exiting 06:30:44 (8152): No heartbeat from core client for 30 sec - exiting 06:30:45 (8152): No heartbeat from core client for 30 sec - exiting 06:30:46 (8152): No heartbeat from core client for 30 sec - exiting 06:30:47 (8152): No heartbeat from core client for 30 sec - exiting 06:30:48 (8152): No heartbeat from core client for 30 sec - exiting 06:30:49 (8152): No heartbeat from core client for 30 sec - exiting 06:30:50 (8152): No heartbeat from core client for 30 sec - exiting 06:30:51 (8152): No heartbeat from core client for 30 sec - exiting 06:30:52 (8152): No heartbeat from core client for 30 sec - exiting 06:36:29 (10064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:36:30 (10064): No heartbeat from core client for 30 sec - exiting 06:36:31 (10064): No heartbeat from core client for 30 sec - exiting 06:36:32 (10064): No heartbeat from core client for 30 sec - exiting 06:36:33 (10064): No heartbeat from core client for 30 sec - exiting 06:36:34 (10064): No heartbeat from core client for 30 sec - exiting 06:36:35 (10064): No heartbeat from core client for 30 sec - exiting 06:36:36 (10064): No heartbeat from core client for 30 sec - exiting 06:36:37 (10064): No heartbeat from core client for 30 sec - exiting 06:36:38 (10064): No heartbeat from core client for 30 sec - exiting 06:45:44 (492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:00:46 (10024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:00:47 (10024): No heartbeat from core client for 30 sec - exiting 07:05:46 (7484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:05:47 (7484): No heartbeat from core client for 30 sec - exiting 07:05:48 (7484): No heartbeat from core client for 30 sec - exiting 07:05:49 (7484): No heartbeat from core client for 30 sec - exiting 07:20:48 (4168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:25:48 (10164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:25:49 (10164): No heartbeat from core client for 30 sec - exiting 07:25:50 (10164): No heartbeat from core client for 30 sec - exiting 07:25:51 (10164): No heartbeat from core client for 30 sec - exiting 07:25:52 (10164): No heartbeat from core client for 30 sec - exiting 07:25:53 (10164): No heartbeat from core client for 30 sec - exiting 07:25:54 (10164): No heartbeat from core client for 30 sec - exiting 07:25:55 (10164): No heartbeat from core client for 30 sec - exiting 07:25:56 (10164): No heartbeat from core client for 30 sec - exiting 07:25:57 (10164): No heartbeat from core client for 30 sec - exiting 07:37:10 (8812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:37:11 (8812): No heartbeat from core client for 30 sec - exiting 07:37:12 (8812): No heartbeat from core client for 30 sec - exiting 07:37:13 (8812): No heartbeat from core client for 30 sec - exiting 07:37:14 (8812): No heartbeat from core client for 30 sec - exiting 07:37:15 (8812): No heartbeat from core client for 30 sec - exiting 07:37:16 (8812): No heartbeat from core client for 30 sec - exiting 07:37:17 (8812): No heartbeat from core client for 30 sec - exiting 07:37:18 (8812): No heartbeat from core client for 30 sec - exiting 07:37:19 (8812): No heartbeat from core client for 30 sec - exiting 07:37:20 (8812): No heartbeat from core client for 30 sec - exiting 07:40:50 (9664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:40:51 (9664): No heartbeat from core client for 30 sec - exiting 07:40:52 (9664): No heartbeat from core client for 30 sec - exiting 07:40:53 (9664): No heartbeat from core client for 30 sec - exiting 07:40:54 (9664): No heartbeat from core client for 30 sec - exiting 07:40:55 (9664): No heartbeat from core client for 30 sec - exiting 07:40:56 (9664): No heartbeat from core client for 30 sec - exiting 07:40:57 (9664): No heartbeat from core client for 30 sec - exiting 07:40:58 (9664): No heartbeat from core client for 30 sec - exiting 07:40:59 (9664): No heartbeat from core client for 30 sec - exiting 07:41:00 (9664): No heartbeat from core client for 30 sec - exiting 07:45:51 (4392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:45:52 (4392): No heartbeat from core client for 30 sec - exiting 07:45:53 (4392): No heartbeat from core client for 30 sec - exiting 07:45:54 (4392): No heartbeat from core client for 30 sec - exiting 07:45:55 (4392): No heartbeat from core client for 30 sec - exiting 07:45:56 (4392): No heartbeat from core client for 30 sec - exiting 07:45:57 (4392): No heartbeat from core client for 30 sec - exiting 07:45:58 (4392): No heartbeat from core client for 30 sec - exiting 07:45:59 (4392): No heartbeat from core client for 30 sec - exiting 08:00:51 (7212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 08:05:52 (1168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:05:53 (1168): No heartbeat from core client for 30 sec - exiting 08:05:54 (1168): No heartbeat from core client for 30 sec - exiting 08:05:55 (1168): No heartbeat from core client for 30 sec - exiting 08:05:56 (1168): No heartbeat from core client for 30 sec - exiting 08:05:57 (1168): No heartbeat from core client for 30 sec - exiting 08:05:58 (1168): No heartbeat from core client for 30 sec - exiting 08:05:59 (1168): No heartbeat from core client for 30 sec - exiting 08:06:00 (1168): No heartbeat from core client for 30 sec - exiting 08:06:01 (1168): No heartbeat from core client for 30 sec - exiting 08:06:02 (1168): No heartbeat from core client for 30 sec - exiting 08:14:24 (9952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:14:25 (9952): No heartbeat from core client for 30 sec - exiting 08:14:26 (9952): No heartbeat from core client for 30 sec - exiting 08:14:27 (9952): No heartbeat from core client for 30 sec - exiting 08:14:28 (9952): No heartbeat from core client for 30 sec - exiting 08:14:29 (9952): No heartbeat from core client for 30 sec - exiting 08:14:30 (9952): No heartbeat from core client for 30 sec - exiting 08:14:31 (9952): No heartbeat from core client for 30 sec - exiting 08:14:32 (9952): No heartbeat from core client for 30 sec - exiting 08:14:33 (9952): No heartbeat from core client for 30 sec - exiting 08:20:57 (7048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:20:58 (7048): No heartbeat from core client for 30 sec - exiting 08:20:59 (7048): No heartbeat from core client for 30 sec - exiting 08:21:00 (7048): No heartbeat from core client for 30 sec - exiting 08:21:01 (7048): No heartbeat from core client for 30 sec - exiting 08:21:02 (7048): No heartbeat from core client for 30 sec - exiting 08:21:03 (7048): No heartbeat from core client for 30 sec - exiting 08:21:04 (7048): No heartbeat from core client for 30 sec - exiting 08:21:05 (7048): No heartbeat from core client for 30 sec - exiting 08:21:06 (7048): No heartbeat from core client for 30 sec - exiting 08:21:07 (7048): No heartbeat from core client for 30 sec - exiting 08:41:01 (9080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:41:02 (9080): No heartbeat from core client for 30 sec - exiting 08:41:03 (9080): No heartbeat from core client for 30 sec - exiting 08:41:04 (9080): No heartbeat from core client for 30 sec - exiting 08:41:05 (9080): No heartbeat from core client for 30 sec - exiting 08:41:06 (9080): No heartbeat from core client for 30 sec - exiting 08:41:07 (9080): No heartbeat from core client for 30 sec - exiting 08:41:08 (9080): No heartbeat from core client for 30 sec - exiting 08:41:09 (9080): No heartbeat from core client for 30 sec - exiting 08:41:10 (9080): No heartbeat from core client for 30 sec - exiting 08:41:11 (9080): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 08:56:02 (6480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:56:03 (6480): No heartbeat from core client for 30 sec - exiting 08:56:04 (6480): No heartbeat from core client for 30 sec - exiting 08:56:05 (6480): No heartbeat from core client for 30 sec - exiting 08:56:06 (6480): No heartbeat from core client for 30 sec - exiting 08:56:07 (6480): No heartbeat from core client for 30 sec - exiting 08:56:08 (6480): No heartbeat from core client for 30 sec - exiting 08:56:09 (6480): No heartbeat from core client for 30 sec - exiting 08:56:10 (6480): No heartbeat from core client for 30 sec - exiting 08:58:44 (5840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:58:45 (5840): No heartbeat from core client for 30 sec - exiting 08:58:46 (5840): No heartbeat from core client for 30 sec - exiting 08:58:47 (5840): No heartbeat from core client for 30 sec - exiting 08:58:48 (5840): No heartbeat from core client for 30 sec - exiting 08:58:49 (5840): No heartbeat from core client for 30 sec - exiting 08:58:50 (5840): No heartbeat from core client for 30 sec - exiting 08:58:51 (5840): No heartbeat from core client for 30 sec - exiting 08:58:52 (5840): No heartbeat from core client for 30 sec - exiting 08:58:53 (5840): No heartbeat from core client for 30 sec - exiting 08:58:54 (5840): No heartbeat from core client for 30 sec - exiting 09:01:04 (5036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:01:05 (5036): No heartbeat from core client for 30 sec - exiting 09:01:06 (5036): No heartbeat from core client for 30 sec - exiting 09:01:07 (5036): No heartbeat from core client for 30 sec - exiting 09:01:08 (5036): No heartbeat from core client for 30 sec - exiting 09:01:09 (5036): No heartbeat from core client for 30 sec - exiting 09:01:10 (5036): No heartbeat from core client for 30 sec - exiting 09:01:11 (5036): No heartbeat from core client for 30 sec - exiting 09:01:12 (5036): No heartbeat from core client for 30 sec - exiting 09:01:13 (5036): No heartbeat from core client for 30 sec - exiting 09:01:14 (5036): No heartbeat from core client for 30 sec - exiting 09:19:09 (9504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:19:10 (9504): No heartbeat from core client for 30 sec - exiting 09:19:11 (9504): No heartbeat from core client for 30 sec - exiting 09:19:12 (9504): No heartbeat from core client for 30 sec - exiting 09:19:13 (9504): No heartbeat from core client for 30 sec - exiting 09:19:14 (9504): No heartbeat from core client for 30 sec - exiting 09:19:15 (9504): No heartbeat from core client for 30 sec - exiting 09:19:16 (9504): No heartbeat from core client for 30 sec - exiting 09:19:17 (9504): No heartbeat from core client for 30 sec - exiting 09:19:18 (9504): No heartbeat from core client for 30 sec - exiting 09:19:19 (9504): No heartbeat from core client for 30 sec - exiting 09:26:06 (4544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:31:06 (9420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:31:07 (9420): No heartbeat from core client for 30 sec - exiting 09:31:08 (9420): No heartbeat from core client for 30 sec - exiting 09:31:09 (9420): No heartbeat from core client for 30 sec - exiting 09:31:10 (9420): No heartbeat from core client for 30 sec - exiting 09:31:11 (9420): No heartbeat from core client for 30 sec - exiting 09:31:12 (9420): No heartbeat from core client for 30 sec - exiting 09:31:13 (9420): No heartbeat from core client for 30 sec - exiting 09:31:14 (9420): No heartbeat from core client for 30 sec - exiting 09:31:15 (9420): No heartbeat from core client for 30 sec - exiting 09:40:00 (8540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 09:46:08 (9920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9632, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9632, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9632, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9632, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9632, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9632, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Sep 2011 18:40:24	921587	13407360	hadcm3n_u41e_1980_40_007458620_1	259,200	346,803	1.3380
28 Sep 2011 04:41:09	921587	13407360	hadcm3n_u41e_1980_40_007458620_1	233,280	312,220	1.3384
27 Sep 2011 18:46:12	921587	13407360	hadcm3n_u41e_1980_40_007458620_1	207,360	277,799	1.3397
27 Sep 2011 08:27:54	921587	13407360	hadcm3n_u41e_1980_40_007458620_1	181,440	243,281	1.3408
26 Sep 2011 20:48:56	921587	13407360	hadcm3n_u41e_1980_40_007458620_1	155,520	208,742	1.3422
26 Sep 2011 00:39:16	921587	13407360	hadcm3n_u41e_1980_40_007458620_1	129,600	173,789	1.3410
25 Sep 2011 10:41:56	921587	13407360	hadcm3n_u41e_1980_40_007458620_1	103,680	138,906	1.3398
24 Sep 2011 19:29:26	921587	13407360	hadcm3n_u41e_1980_40_007458620_1	77,760	104,035	1.3379
24 Sep 2011 02:37:34	921587	13407360	hadcm3n_u41e_1980_40_007458620_1	51,840	69,476	1.3402
23 Sep 2011 07:47:02	921587	13407360	hadcm3n_u41e_1980_40_007458620_1	25,920	34,860	1.3449