Task 14869247

Name	hadcm3n_o4ka_2060_40_008000688_3
Workunit	8155802
Created	5 Jul 2012, 20:03:29 UTC
Sent	5 Jul 2012, 20:03:48 UTC
Report deadline	5 Oct 2012, 3:30:59 UTC
Received	13 Jul 2012, 14:56:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1207803
Run time	5 days 19 hours 16 min 43 sec
CPU time	5 days 17 hours 57 min 24 sec
Validate state	Invalid
Credit	3,732.48
Device peak FLOPS	2.38 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... 15:25:07 (3728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:25:08 (3728): No heartbeat from core client for 30 sec - exiting 15:35:08 (5336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:35:12 (5336): No heartbeat from core client for 30 sec - exiting 15:35:13 (5336): No heartbeat from core client for 30 sec - exiting 15:35:14 (5336): No heartbeat from core client for 30 sec - exiting 15:35:15 (5336): No heartbeat from core client for 30 sec - exiting 15:35:16 (5336): No heartbeat from core client for 30 sec - exiting 15:35:17 (5336): No heartbeat from core client for 30 sec - exiting 15:35:18 (5336): No heartbeat from core client for 30 sec - exiting 15:35:19 (5336): No heartbeat from core client for 30 sec - exiting 15:35:20 (5336): No heartbeat from core client for 30 sec - exiting 15:35:22 (5336): No heartbeat from core client for 30 sec - exiting 15:35:23 (5336): No heartbeat from core client for 30 sec - exiting 15:35:24 (5336): No heartbeat from core client for 30 sec - exiting 15:35:25 (5336): No heartbeat from core client for 30 sec - exiting 15:35:26 (5336): No heartbeat from core client for 30 sec - exiting 15:35:28 (5336): No heartbeat from core client for 30 sec - exiting 15:35:29 (5336): No heartbeat from core client for 30 sec - exiting 15:35:30 (5336): No heartbeat from core client for 30 sec - exiting 15:35:31 (5336): No heartbeat from core client for 30 sec - exiting 15:35:32 (5336): No heartbeat from core client for 30 sec - exiting 15:43:58 (1020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:47:07 (2944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:48:41 (1932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:48:43 (1932): No heartbeat from core client for 30 sec - exiting 15:55:07 (3324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:55:08 (3324): No heartbeat from core client for 30 sec - exiting 15:56:56 (5992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:58:59 (4008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:06:45 (4728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:06:46 (4728): No heartbeat from core client for 30 sec - exiting 16:06:47 (4728): No heartbeat from core client for 30 sec - exiting 16:06:49 (4728): No heartbeat from core client for 30 sec - exiting 16:06:50 (4728): No heartbeat from core client for 30 sec - exiting 16:06:51 (4728): No heartbeat from core client for 30 sec - exiting 16:09:49 (3672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:10:36 (4524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:11:54 (4956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:21:06 (572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:21:09 (572): No heartbeat from core client for 30 sec - exiting 16:21:11 (572): No heartbeat from core client for 30 sec - exiting 16:21:12 (572): No heartbeat from core client for 30 sec - exiting 16:21:13 (572): No heartbeat from core client for 30 sec - exiting 16:21:14 (572): No heartbeat from core client for 30 sec - exiting 16:21:15 (572): No heartbeat from core client for 30 sec - exiting 16:21:16 (572): No heartbeat from core client for 30 sec - exiting 16:21:17 (572): No heartbeat from core client for 30 sec - exiting 16:21:18 (572): No heartbeat from core client for 30 sec - exiting 16:21:19 (572): No heartbeat from core client for 30 sec - exiting 16:21:20 (572): No heartbeat from core client for 30 sec - exiting 16:21:21 (572): No heartbeat from core client for 30 sec - exiting 16:21:23 (572): No heartbeat from core client for 30 sec - exiting 16:21:24 (572): No heartbeat from core client for 30 sec - exiting 16:21:25 (572): No heartbeat from core client for 30 sec - exiting 16:31:51 (5696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:36:02 (1548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:46:03 (5308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:46:04 (5308): No heartbeat from core client for 30 sec - exiting 16:49:34 (5852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:55:05 (3984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:02:41 (3540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:02:43 (3540): No heartbeat from core client for 30 sec - exiting 17:12:42 (2280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:12:45 (2280): No heartbeat from core client for 30 sec - exiting 17:12:46 (2280): No heartbeat from core client for 30 sec - exiting 17:12:47 (2280): No heartbeat from core client for 30 sec - exiting 17:12:48 (2280): No heartbeat from core client for 30 sec - exiting 17:12:49 (2280): No heartbeat from core client for 30 sec - exiting 17:12:50 (2280): No heartbeat from core client for 30 sec - exiting 17:12:51 (2280): No heartbeat from core client for 30 sec - exiting 17:12:52 (2280): No heartbeat from core client for 30 sec - exiting 17:12:53 (2280): No heartbeat from core client for 30 sec - exiting 17:22:43 (1152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:22:47 (1152): No heartbeat from core client for 30 sec - exiting 17:22:48 (1152): No heartbeat from core client for 30 sec - exiting 17:22:49 (1152): No heartbeat from core client for 30 sec - exiting 17:25:09 (3968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:25:56 (5736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:32:45 (5248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:32:46 (5248): No heartbeat from core client for 30 sec - exiting 17:32:47 (5248): No heartbeat from core client for 30 sec - exiting 17:32:48 (5248): No heartbeat from core client for 30 sec - exiting 17:32:49 (5248): No heartbeat from core client for 30 sec - exiting 17:35:11 (3488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:36:20 (3120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:37:16 (3996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:42:27 (4156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:49:48 (1548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:51:08 (4328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:59:49 (4628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:59:55 (4628): No heartbeat from core client for 30 sec - exiting 17:59:56 (4628): No heartbeat from core client for 30 sec - exiting 17:59:57 (4628): No heartbeat from core client for 30 sec - exiting 18:03:00 (4824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:04:30 (5196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:10:07 (2860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:12:56 (4272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:13:44 (2928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:15:03 (5016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:20:37 (6000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:30:38 (5712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:30:43 (5712): No heartbeat from core client for 30 sec - exiting 18:30:44 (5712): No heartbeat from core client for 30 sec - exiting 18:30:46 (5712): No heartbeat from core client for 30 sec - exiting 18:30:47 (5712): No heartbeat from core client for 30 sec - exiting 18:36:13 (5740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:37:25 (2236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:39:27 (5388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:40:52 (4964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:47:19 (128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:47:20 (128): No heartbeat from core client for 30 sec - exiting 18:49:22 (3844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:51:16 (1912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:58:44 (2492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:11:03 (6052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:12:36 (6052): No heartbeat from core client for 30 sec - exiting 19:12:37 (6052): No heartbeat from core client for 30 sec - exiting 19:12:38 (6052): No heartbeat from core client for 30 sec - exiting 19:12:40 (6052): No heartbeat from core client for 30 sec - exiting 19:12:41 (6052): No heartbeat from core client for 30 sec - exiting 19:12:42 (6052): No heartbeat from core client for 30 sec - exiting 19:12:43 (6052): No heartbeat from core client for 30 sec - exiting 19:12:44 (6052): No heartbeat from core client for 30 sec - exiting 19:12:45 (6052): No heartbeat from core client for 30 sec - exiting 19:12:46 (6052): No heartbeat from core client for 30 sec - exiting 19:12:47 (6052): No heartbeat from core client for 30 sec - exiting 19:12:48 (6052): No heartbeat from core client for 30 sec - exiting 19:12:49 (6052): No heartbeat from core client for 30 sec - exiting 19:18:09 (6108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:20:22 (2476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:22:08 (6012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:27:05 (4916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:29:21 (4248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:38:08 (2024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:38:12 (2024): No heartbeat from core client for 30 sec - exiting 19:38:14 (2024): No heartbeat from core client for 30 sec - exiting 19:38:15 (2024): No heartbeat from core client for 30 sec - exiting 19:38:16 (2024): No heartbeat from core client for 30 sec - exiting 19:38:17 (2024): No heartbeat from core client for 30 sec - exiting 19:38:18 (2024): No heartbeat from core client for 30 sec - exiting 19:38:19 (2024): No heartbeat from core client for 30 sec - exiting 19:38:20 (2024): No heartbeat from core client for 30 sec - exiting 19:38:21 (2024): No heartbeat from core client for 30 sec - exiting 19:38:22 (2024): No heartbeat from core client for 30 sec - exiting 19:38:23 (2024): No heartbeat from core client for 30 sec - exiting 19:42:07 (5940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:48:21 (4776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:48:28 (4776): No heartbeat from core client for 30 sec - exiting 19:48:29 (4776): No heartbeat from core client for 30 sec - exiting 19:48:30 (4776): No heartbeat from core client for 30 sec - exiting 19:51:46 (572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:52:46 (2236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:55:26 (5220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:55:27 (5220): No heartbeat from core client for 30 sec - exiting 19:55:28 (5220): No heartbeat from core client for 30 sec - exiting 19:55:30 (5220): No heartbeat from core client for 30 sec - exiting 19:55:31 (5220): No heartbeat from core client for 30 sec - exiting 20:08:33 (3512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:08:37 (3512): No heartbeat from core client for 30 sec - exiting 20:08:38 (3512): No heartbeat from core client for 30 sec - exiting 20:08:39 (3512): No heartbeat from core client for 30 sec - exiting 20:08:40 (3512): No heartbeat from core client for 30 sec - exiting 20:08:41 (3512): No heartbeat from core client for 30 sec - exiting 20:08:42 (3512): No heartbeat from core client for 30 sec - exiting 20:08:43 (3512): No heartbeat from core client for 30 sec - exiting 20:08:44 (3512): No heartbeat from core client for 30 sec - exiting 20:08:45 (3512): No heartbeat from core client for 30 sec - exiting 20:08:47 (3512): No heartbeat from core client for 30 sec - exiting 20:08:48 (3512): No heartbeat from core client for 30 sec - exiting 20:17:56 (4812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:25:34 (1920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:25:35 (1920): No heartbeat from core client for 30 sec - exiting 20:27:25 (6136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:29:14 (5804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 20:34:35 (6124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:34:36 (6124): No heartbeat from core client for 30 sec - exiting 20:34:37 (6124): No heartbeat from core client for 30 sec - exiting 20:34:38 (6124): No heartbeat from core client for 30 sec - exiting 20:36:34 (4068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 20:42:15 (3760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:42:16 (3760): No heartbeat from core client for 30 sec - exiting 20:42:17 (3760): No heartbeat from core client for 30 sec - exiting 20:42:18 (3760): No heartbeat from core client for 30 sec - exiting 20:49:32 (5892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:49:34 (5892): No heartbeat from core client for 30 sec - exiting 20:49:35 (5892): No heartbeat from core client for 30 sec - exiting 20:49:36 (5892): No heartbeat from core client for 30 sec - exiting 20:49:37 (5892): No heartbeat from core client for 30 sec - exiting 20:49:38 (5892): No heartbeat from core client for 30 sec - exiting 20:49:39 (5892): No heartbeat from core client for 30 sec - exiting 20:53:54 (2496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:55:04 (4396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:56:47 (4268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:04:55 (428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:04:56 (428): No heartbeat from core client for 30 sec - exiting 21:04:57 (428): No heartbeat from core client for 30 sec - exiting 21:04:58 (428): No heartbeat from core client for 30 sec - exiting 21:04:59 (428): No heartbeat from core client for 30 sec - exiting 21:05:01 (428): No heartbeat from core client for 30 sec - exiting 21:05:02 (428): No heartbeat from core client for 30 sec - exiting 21:05:03 (428): No heartbeat from core client for 30 sec - exiting 21:07:23 (4452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:08:07 (408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:15:19 (5124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:15:21 (5124): No heartbeat from core client for 30 sec - exiting 21:15:22 (5124): No heartbeat from core client for 30 sec - exiting 21:15:23 (5124): No heartbeat from core client for 30 sec - exiting 21:15:24 (5124): No heartbeat from core client for 30 sec - exiting 21:15:25 (5124): No heartbeat from core client for 30 sec - exiting 21:20:57 (6128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:30:27 (6132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:30:28 (6132): No heartbeat from core client for 30 sec - exiting 21:30:29 (6132): No heartbeat from core client for 30 sec - exiting 21:30:30 (6132): No heartbeat from core client for 30 sec - exiting 21:30:31 (6132): No heartbeat from core client for 30 sec - exiting 21:33:43 (1820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:36:45 (1788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:45:34 (1428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:45:36 (1428): No heartbeat from core client for 30 sec - exiting 21:45:37 (1428): No heartbeat from core client for 30 sec - exiting 21:45:38 (1428): No heartbeat from core client for 30 sec - exiting 21:45:39 (1428): No heartbeat from core client for 30 sec - exiting 21:45:40 (1428): No heartbeat from core client for 30 sec - exiting 21:45:41 (1428): No heartbeat from core client for 30 sec - exiting 21:45:42 (1428): No heartbeat from core client for 30 sec - exiting 21:45:43 (1428): No heartbeat from core client for 30 sec - exiting 21:47:28 (5944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:48:28 (352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:55:34 (936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:55:42 (936): No heartbeat from core client for 30 sec - exiting 21:55:43 (936): No heartbeat from core client for 30 sec - exiting 21:55:44 (936): No heartbeat from core client for 30 sec - exiting 21:55:45 (936): No heartbeat from core client for 30 sec - exiting 21:55:46 (936): No heartbeat from core client for 30 sec - exiting 21:55:47 (936): No heartbeat from core client for 30 sec - exiting 21:55:48 (936): No heartbeat from core client for 30 sec - exiting 21:57:53 (4424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:58:36 (5420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:00:43 (2396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:02:25 (5240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:10:50 (4408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:10:58 (4408): No heartbeat from core client for 30 sec - exiting 22:10:59 (4408): No heartbeat from core client for 30 sec - exiting 22:11:00 (4408): No heartbeat from core client for 30 sec - exiting 22:11:01 (4408): No heartbeat from core client for 30 sec - exiting 22:11:02 (4408): No heartbeat from core client for 30 sec - exiting 22:11:03 (4408): No heartbeat from core client for 30 sec - exiting 22:11:04 (4408): No heartbeat from core client for 30 sec - exiting 22:11:05 (4408): No heartbeat from core client for 30 sec - exiting 22:13:31 (5228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:14:21 (3452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:16:35 (5692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:17:32 (5544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:26:18 (204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:26:21 (204): No heartbeat from core client for 30 sec - exiting 22:26:22 (204): No heartbeat from core client for 30 sec - exiting 22:26:23 (204): No heartbeat from core client for 30 sec - exiting 22:26:24 (204): No heartbeat from core client for 30 sec - exiting 22:26:25 (204): No heartbeat from core client for 30 sec - exiting 22:26:26 (204): No heartbeat from core client for 30 sec - exiting 22:26:27 (204): No heartbeat from core client for 30 sec - exiting 22:26:28 (204): No heartbeat from core client for 30 sec - exiting 22:26:29 (204): No heartbeat from core client for 30 sec - exiting 22:26:30 (204): No heartbeat from core client for 30 sec - exiting 22:26:32 (204): No heartbeat from core client for 30 sec - exiting 22:26:33 (204): No heartbeat from core client for 30 sec - exiting 22:36:44 (4508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:37:33 (2332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:39:38 (1392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:46:42 (3968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:46:45 (3968): No heartbeat from core client for 30 sec - exiting 22:46:47 (3968): No heartbeat from core client for 30 sec - exiting 22:48:46 (3876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:50:40 (548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:00:23 (5024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:00:57 (5024): No heartbeat from core client for 30 sec - exiting 23:00:58 (5024): No heartbeat from core client for 30 sec - exiting 23:00:59 (5024): No heartbeat from core client for 30 sec - exiting 23:01:00 (5024): No heartbeat from core client for 30 sec - exiting 23:01:01 (5024): No heartbeat from core client for 30 sec - exiting 23:01:02 (5024): No heartbeat from core client for 30 sec - exiting 23:01:03 (5024): No heartbeat from core client for 30 sec - exiting 23:01:05 (5024): No heartbeat from core client for 30 sec - exiting 23:01:06 (5024): No heartbeat from core client for 30 sec - exiting 23:01:07 (5024): No heartbeat from core client for 30 sec - exiting 23:01:08 (5024): No heartbeat from core client for 30 sec - exiting 23:01:09 (5024): No heartbeat from core client for 30 sec - exiting 23:08:22 (5248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:22:37 (3656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:22:48 (3656): No heartbeat from core client for 30 sec - exiting 23:22:49 (3656): No heartbeat from core client for 30 sec - exiting 23:22:50 (3656): No heartbeat from core client for 30 sec - exiting 23:22:51 (3656): No heartbeat from core client for 30 sec - exiting 23:22:53 (3656): No heartbeat from core client for 30 sec - exiting 23:22:54 (3656): No heartbeat from core client for 30 sec - exiting 23:22:55 (3656): No heartbeat from core client for 30 sec - exiting 23:22:56 (3656): No heartbeat from core client for 30 sec - exiting 23:22:57 (3656): No heartbeat from core client for 30 sec - exiting 23:22:58 (3656): No heartbeat from core client for 30 sec - exiting 23:22:59 (3656): No heartbeat from core client for 30 sec - exiting 23:23:00 (3656): No heartbeat from core client for 30 sec - exiting 23:23:01 (3656): No heartbeat from core client for 30 sec - exiting 23:23:02 (3656): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 23:41:28 (3008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:41:30 (3008): No heartbeat from core client for 30 sec - exiting 23:41:31 (3008): No heartbeat from core client for 30 sec - exiting 23:46:38 (76): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:55:00 (1400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:55:03 (1400): No heartbeat from core client for 30 sec - exiting 23:55:04 (1400): No heartbeat from core client for 30 sec - exiting 23:55:05 (1400): No heartbeat from core client for 30 sec - exiting 23:55:06 (1400): No heartbeat from core client for 30 sec - exiting 23:55:07 (1400): No heartbeat from core client for 30 sec - exiting 23:55:08 (1400): No heartbeat from core client for 30 sec - exiting 23:55:10 (1400): No heartbeat from core client for 30 sec - exiting 23:59:25 (4180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:08:02 (4980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:08:04 (4980): No heartbeat from core client for 30 sec - exiting 00:08:05 (4980): No heartbeat from core client for 30 sec - exiting 00:08:06 (4980): No heartbeat from core client for 30 sec - exiting 00:08:07 (4980): No heartbeat from core client for 30 sec - exiting 00:11:22 (56): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:12:36 (560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:13:31 (5652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:15:18 (1484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:23:24 (4876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:23:25 (4876): No heartbeat from core client for 30 sec - exiting 00:23:27 (4876): No heartbeat from core client for 30 sec - exiting 00:23:28 (4876): No heartbeat from core client for 30 sec - exiting 00:26:47 (5932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:28:24 (4348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:29:23 (4516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:38:36 (6100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:38:56 (6100): No heartbeat from core client for 30 sec - exiting 00:38:57 (6100): No heartbeat from core client for 30 sec - exiting 00:38:58 (6100): No heartbeat from core client for 30 sec - exiting 00:38:59 (6100): No heartbeat from core client for 30 sec - exiting 00:39:00 (6100): No heartbeat from core client for 30 sec - exiting 00:39:01 (6100): No heartbeat from core client for 30 sec - exiting 00:39:02 (6100): No heartbeat from core client for 30 sec - exiting 00:39:03 (6100): No heartbeat from core client for 30 sec - exiting 00:39:04 (6100): No heartbeat from core client for 30 sec - exiting 00:39:05 (6100): No heartbeat from core client for 30 sec - exiting 00:39:07 (6100): No heartbeat from core client for 30 sec - exiting 00:39:08 (6100): No heartbeat from core client for 30 sec - exiting 00:39:09 (6100): No heartbeat from core client for 30 sec - exiting 00:39:10 (6100): No heartbeat from core client for 30 sec - exiting 00:39:11 (6100): No heartbeat from core client for 30 sec - exiting 00:53:34 (96): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 01:03:33 (1276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:03:35 (1276): No heartbeat from core client for 30 sec - exiting 01:13:34 (5740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:13:36 (5740): No heartbeat from core client for 30 sec - exiting 01:13:37 (5740): No heartbeat from core client for 30 sec - exiting 01:13:38 (5740): No heartbeat from core client for 30 sec - exiting 01:13:39 (5740): No heartbeat from core client for 30 sec - exiting 01:13:40 (5740): No heartbeat from core client for 30 sec - exiting 01:13:42 (5740): No heartbeat from core client for 30 sec - exiting 01:21:58 (588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:23:01 (4032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:24:18 (5372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:31:32 (1252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:31:36 (1252): No heartbeat from core client for 30 sec - exiting 01:31:37 (1252): No heartbeat from core client for 30 sec - exiting 01:38:00 (4668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:38:01 (4668): No heartbeat from core client for 30 sec - exiting 01:38:03 (4668): No heartbeat from core client for 30 sec - exiting 01:38:04 (4668): No heartbeat from core client for 30 sec - exiting 01:41:48 (4212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:43:00 (3996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:50:08 (952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:50:10 (952): No heartbeat from core client for 30 sec - exiting 01:50:11 (952): No heartbeat from core client for 30 sec - exiting 01:58:05 (5124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:58:06 (5124): No heartbeat from core client for 30 sec - exiting 01:58:07 (5124): No heartbeat from core client for 30 sec - exiting 01:58:08 (5124): No heartbeat from core client for 30 sec - exiting 01:58:09 (5124): No heartbeat from core client for 30 sec - exiting 01:58:11 (5124): No heartbeat from core client for 30 sec - exiting 02:02:23 (4992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:10:22 (3996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:10:23 (3996): No heartbeat from core client for 30 sec - exiting 02:10:24 (3996): No heartbeat from core client for 30 sec - exiting 02:10:26 (3996): No heartbeat from core client for 30 sec - exiting 02:19:15 (5216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:19:17 (5216): No heartbeat from core client for 30 sec - exiting 02:24:14 (4764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:24:16 (4764): No heartbeat from core client for 30 sec - exiting 02:31:50 (1716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:31:55 (1716): No heartbeat from core client for 30 sec - exiting 02:31:56 (1716): No heartbeat from core client for 30 sec - exiting 02:31:57 (1716): No heartbeat from core client for 30 sec - exiting 02:31:58 (1716): No heartbeat from core client for 30 sec - exiting 02:31:59 (1716): No heartbeat from core client for 30 sec - exiting 02:32:00 (1716): No heartbeat from core client for 30 sec - exiting 02:32:01 (1716): No heartbeat from core client for 30 sec - exiting 02:32:02 (1716): No heartbeat from core client for 30 sec - exiting 02:32:03 (1716): No heartbeat from core client for 30 sec - exiting 02:32:04 (1716): No heartbeat from core client for 30 sec - exiting 02:32:05 (1716): No heartbeat from core client for 30 sec - exiting 02:32:07 (1716): No heartbeat from core client for 30 sec - exiting 02:32:08 (1716): No heartbeat from core client for 30 sec - exiting 02:34:10 (352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:36:09 (4704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:45:05 (5208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:45:11 (5208): No heartbeat from core client for 30 sec - exiting 02:45:13 (5208): No heartbeat from core client for 30 sec - exiting 02:45:14 (5208): No heartbeat from core client for 30 sec - exiting 02:45:15 (5208): No heartbeat from core client for 30 sec - exiting 02:45:16 (5208): No heartbeat from core client for 30 sec - exiting 02:45:17 (5208): No heartbeat from core client for 30 sec - exiting 02:45:18 (5208): No heartbeat from core client for 30 sec - exiting 02:45:19 (5208): No heartbeat from core client for 30 sec - exiting 02:45:20 (5208): No heartbeat from core client for 30 sec - exiting 02:45:21 (5208): No heartbeat from core client for 30 sec - exiting 02:45:22 (5208): No heartbeat from core client for 30 sec - exiting 02:45:24 (5208): No heartbeat from core client for 30 sec - exiting 02:45:25 (5208): No heartbeat from core client for 30 sec - exiting 02:45:26 (5208): No heartbeat from core client for 30 sec - exiting 02:45:27 (5208): No heartbeat from core client for 30 sec - exiting 02:45:28 (5208): No heartbeat from core client for 30 sec - exiting 02:45:29 (5208): No heartbeat from core client for 30 sec - exiting 02:45:30 (5208): No heartbeat from core client for 30 sec - exiting 02:49:05 (1728): No heartbeat from core client for 30 sec - exiting 02:49:06 (1728): No heartbeat from core client for 30 sec - exiting 02:49:07 (1728): No heartbeat from core client for 30 sec - exiting 02:49:08 (1728): No heartbeat from core client for 30 sec - exiting 02:49:09 (1728): No heartbeat from core client for 30 sec - exiting 02:49:10 (1728): No heartbeat from core client for 30 sec - exiting 02:49:12 (1728): No heartbeat from core client for 30 sec - exiting 02:49:13 (1728): No heartbeat from core client for 30 sec - exiting 02:49:14 (1728): No heartbeat from core client for 30 sec - exiting 02:49:15 (1728): No heartbeat from core client for 30 sec - exiting 02:49:16 (1728): No heartbeat from core client for 30 sec - exiting 02:49:17 (1728): No heartbeat from core client for 30 sec - exiting 02:49:18 (1728): No heartbeat from core client for 30 sec - exiting 02:49:19 (1728): No heartbeat from core client for 30 sec - exiting 02:49:20 (1728): No heartbeat from core client for 30 sec - exiting 02:49:22 (1728): No heartbeat from core client for 30 sec - exiting 02:49:23 (1728): No heartbeat from core client for 30 sec - exiting 02:49:24 (1728): No heartbeat from core client for 30 sec - exiting 02:49:25 (1728): No heartbeat from core client for 30 sec - exiting 02:49:26 (1728): No heartbeat from core client for 30 sec - exiting 02:49:27 (1728): No heartbeat from core client for 30 sec - exiting 02:49:28 (1728): No heartbeat from core client for 30 sec - exiting 02:49:29 (1728): No heartbeat from core client for 30 sec - exiting 02:49:30 (1728): No heartbeat from core client for 30 sec - exiting 02:49:31 (1728): No heartbeat from core client for 30 sec - exiting 02:49:33 (1728): No heartbeat from core client for 30 sec - exiting 02:49:34 (1728): No heartbeat from core client for 30 sec - exiting 02:49:35 (1728): No heartbeat from core client for 30 sec - exiting 02:49:36 (1728): No heartbeat from core client for 30 sec - exiting 02:49:37 (1728): No heartbeat from core client for 30 sec - exiting 02:49:38 (1728): No heartbeat from core client for 30 sec - exiting 02:49:39 (1728): No heartbeat from core client for 30 sec - exiting 02:49:40 (1728): No heartbeat from core client for 30 sec - exiting 02:49:41 (1728): No heartbeat from core client for 30 sec - exiting 02:49:42 (1728): No heartbeat from core client for 30 sec - exiting 02:49:43 (1728): No heartbeat from core client for 30 sec - exiting 02:49:45 (1728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:49:46 (1728): No heartbeat from core client for 30 sec - exiting 03:00:33 (5844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:02:13 (5412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:13:27 (4656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:13:28 (4656): No heartbeat from core client for 30 sec - exiting 03:13:29 (4656): No heartbeat from core client for 30 sec - exiting 03:25:04 (4192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:25:11 (4192): No heartbeat from core client for 30 sec - exiting 03:25:12 (4192): No heartbeat from core client for 30 sec - exiting 03:25:13 (4192): No heartbeat from core client for 30 sec - exiting 03:31:47 (5404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:39:28 (5472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:39:31 (5472): No heartbeat from core client for 30 sec - exiting 03:39:32 (5472): No heartbeat from core client for 30 sec - exiting 03:39:33 (5472): No heartbeat from core client for 30 sec - exiting 03:39:34 (5472): No heartbeat from core client for 30 sec - exiting 03:39:35 (5472): No heartbeat from core client for 30 sec - exiting 03:43:23 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:52:27 (5716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:52:32 (5716): No heartbeat from core client for 30 sec - exiting 03:52:33 (5716): No heartbeat from core client for 30 sec - exiting 03:52:34 (5716): No heartbeat from core client for 30 sec - exiting 03:52:36 (5716): No heartbeat from core client for 30 sec - exiting 03:52:37 (5716): No heartbeat from core client for 30 sec - exiting 03:52:38 (5716): No heartbeat from core client for 30 sec - exiting 03:52:39 (5716): No heartbeat from core client for 30 sec - exiting 03:52:40 (5716): No heartbeat from core client for 30 sec - exiting 03:52:41 (5716): No heartbeat from core client for 30 sec - exiting 03:52:42 (5716): No heartbeat from core client for 30 sec - exiting 03:52:43 (5716): No heartbeat from core client for 30 sec - exiting 03:52:44 (5716): No heartbeat from core client for 30 sec - exiting 03:52:45 (5716): No heartbeat from core client for 30 sec - exiting 03:52:47 (5716): No heartbeat from core client for 30 sec - exiting 04:04:00 (3932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 04:08:22 (4768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 04:10:34 (4348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 04:11:38 (1428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:12:29 (2472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 04:19:00 (4784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:19:02 (4784): No heartbeat from core client for 30 sec - exiting 04:19:03 (4784): No heartbeat from core client for 30 sec - exiting 04:19:04 (4784): No heartbeat from core client for 30 sec - exiting 04:19:05 (4784): No heartbeat from core client for 30 sec - exiting 04:19:06 (4784): No heartbeat from core client for 30 sec - exiting 04:19:07 (4784): No heartbeat from core client for 30 sec - exiting 04:19:09 (4784): No heartbeat from core client for 30 sec - exiting 04:23:19 (4460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:34:14 (3776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:34:15 (3776): No heartbeat from core client for 30 sec - exiting 04:34:17 (3776): No heartbeat from core client for 30 sec - exiting 04:39:57 (5160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:49:54 (4004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:49:56 (4004): No heartbeat from core client for 30 sec - exiting 04:49:57 (4004): No heartbeat from core client for 30 sec - exiting 04:49:58 (4004): No heartbeat from core client for 30 sec - exiting 04:49:59 (4004): No heartbeat from core client for 30 sec - exiting 04:50:00 (4004): No heartbeat from core client for 30 sec - exiting 04:50:01 (4004): No heartbeat from core client for 30 sec - exiting 04:50:02 (4004): No heartbeat from core client for 30 sec - exiting 04:50:03 (4004): No heartbeat from core client for 30 sec - exiting 04:59:59 (5340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:00:02 (5340): No heartbeat from core client for 30 sec - exiting 05:13:18 (4984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:13:19 (4984): No heartbeat from core client for 30 sec - exiting 05:13:20 (4984): No heartbeat from core client for 30 sec - exiting 05:13:21 (4984): No heartbeat from core client for 30 sec - exiting 05:26:04 (5080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:26:05 (5080): No heartbeat from core client for 30 sec - exiting 05:28:33 (5888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:35:54 (3372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:35:56 (3372): No heartbeat from core client for 30 sec - exiting 05:35:57 (3372): No heartbeat from core client for 30 sec - exiting 05:35:58 (3372): No heartbeat from core client for 30 sec - exiting 05:45:37 (2300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:45:41 (2300): No heartbeat from core client for 30 sec - exiting 05:45:42 (2300): No heartbeat from core client for 30 sec - exiting 05:45:43 (2300): No heartbeat from core client for 30 sec - exiting 05:45:44 (2300): No heartbeat from core client for 30 sec - exiting 05:45:45 (2300): No heartbeat from core client for 30 sec - exiting 05:45:46 (2300): No heartbeat from core client for 30 sec - exiting 05:49:46 (5280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:51:34 (3124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:56:58 (4844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:56:59 (4844): No heartbeat from core client for 30 sec - exiting 05:57:00 (4844): No heartbeat from core client for 30 sec - exiting 05:57:01 (4844): No heartbeat from core client for 30 sec - exiting 05:57:02 (4844): No heartbeat from core client for 30 sec - exiting 05:57:03 (4844): No heartbeat from core client for 30 sec - exiting 05:57:04 (4844): No heartbeat from core client for 30 sec - exiting 05:57:05 (4844): No heartbeat from core client for 30 sec - exiting 05:57:06 (4844): No heartbeat from core client for 30 sec - exiting 06:04:45 (5444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:04:54 (5444): No heartbeat from core client for 30 sec - exiting 06:04:55 (5444): No heartbeat from core client for 30 sec - exiting 06:04:56 (5444): No heartbeat from core client for 30 sec - exiting 06:04:57 (5444): No heartbeat from core client for 30 sec - exiting 06:04:58 (5444): No heartbeat from core client for 30 sec - exiting 06:04:59 (5444): No heartbeat from core client for 30 sec - exiting 06:05:00 (5444): No heartbeat from core client for 30 sec - exiting 06:05:01 (5444): No heartbeat from core client for 30 sec - exiting 06:10:34 (6040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:18:29 (5312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:18:31 (5312): No heartbeat from core client for 30 sec - exiting 06:18:32 (5312): No heartbeat from core client for 30 sec - exiting 06:31:46 (5940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:31:48 (5940): No heartbeat from core client for 30 sec - exiting 06:31:50 (5940): No heartbeat from core client for 30 sec - exiting 06:31:51 (5940): No heartbeat from core client for 30 sec - exiting 06:31:52 (5940): No heartbeat from core client for 30 sec - exiting 06:31:53 (5940): No heartbeat from core client for 30 sec - exiting 06:31:54 (5940): No heartbeat from core client for 30 sec - exiting 06:31:55 (5940): No heartbeat from core client for 30 sec - exiting 06:31:56 (5940): No heartbeat from core client for 30 sec - exiting 06:31:58 (5940): No heartbeat from core client for 30 sec - exiting 06:31:59 (5940): No heartbeat from core client for 30 sec - exiting 06:32:00 (5940): No heartbeat from core client for 30 sec - exiting 06:32:01 (5940): No heartbeat from core client for 30 sec - exiting 06:40:12 (5684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:44:22 (4248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:51:10 (5340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:52:36 (2928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:59:43 (3384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:59:48 (3384): No heartbeat from core client for 30 sec - exiting 07:03:03 (6052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:03:41 (3416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:17:49 (4736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:17:52 (4736): No heartbeat from core client for 30 sec - exiting 07:17:53 (4736): No heartbeat from core client for 30 sec - exiting 07:17:54 (4736): No heartbeat from core client for 30 sec - exiting 07:17:55 (4736): No heartbeat from core client for 30 sec - exiting 07:17:56 (4736): No heartbeat from core client for 30 sec - exiting 07:17:57 (4736): No heartbeat from core client for 30 sec - exiting 07:17:58 (4736): No heartbeat from core client for 30 sec - exiting 07:17:59 (4736): No heartbeat from core client for 30 sec - exiting 07:18:00 (4736): No heartbeat from core client for 30 sec - exiting 07:18:01 (4736): No heartbeat from core client for 30 sec - exiting 07:18:03 (4736): No heartbeat from core client for 30 sec - exiting 07:28:15 (4644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:36:42 (1708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:36:46 (1708): No heartbeat from core client for 30 sec - exiting 07:36:48 (1708): No heartbeat from core client for 30 sec - exiting 07:36:49 (1708): No heartbeat from core client for 30 sec - exiting 07:36:50 (1708): No heartbeat from core client for 30 sec - exiting 07:36:51 (1708): No heartbeat from core client for 30 sec - exiting 07:36:52 (1708): No heartbeat from core client for 30 sec - exiting 07:40:19 (5740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:41:02 (2240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:52:41 (5816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:52:43 (5816): No heartbeat from core client for 30 sec - exiting 07:52:44 (5816): No heartbeat from core client for 30 sec - exiting 07:52:45 (5816): No heartbeat from core client for 30 sec - exiting 07:52:46 (5816): No heartbeat from core client for 30 sec - exiting 07:52:47 (5816): No heartbeat from core client for 30 sec - exiting 07:52:48 (5816): No heartbeat from core client for 30 sec - exiting 07:52:50 (5816): No heartbeat from core client for 30 sec - exiting 08:08:49 (3584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:08:51 (3584): No heartbeat from core client for 30 sec - exiting 08:13:32 (5536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:21:07 (4132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:21:10 (4132): No heartbeat from core client for 30 sec - exiting 08:21:11 (4132): No heartbeat from core client for 30 sec - exiting 08:21:12 (4132): No heartbeat from core client for 30 sec - exiting 08:21:13 (4132): No heartbeat from core client for 30 sec - exiting 08:21:14 (4132): No heartbeat from core client for 30 sec - exiting 08:21:15 (4132): No heartbeat from core client for 30 sec - exiting 08:22:04 (6076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:24:34 (5924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:24:35 (5924): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5476, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5476, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5476, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5476, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5476, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5476, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Jul 2012 22:29:03	1207803	14869247	hadcm3n_o4ka_2060_40_008000688_3	311,040	480,001	1.5432
11 Jul 2012 06:03:11	1207803	14869247	hadcm3n_o4ka_2060_40_008000688_3	285,120	438,775	1.5389
10 Jul 2012 16:56:28	1207803	14869247	hadcm3n_o4ka_2060_40_008000688_3	259,200	392,413	1.5139
10 Jul 2012 03:59:29	1207803	14869247	hadcm3n_o4ka_2060_40_008000688_3	233,280	346,327	1.4846
09 Jul 2012 16:31:41	1207803	14869247	hadcm3n_o4ka_2060_40_008000688_3	207,360	305,557	1.4736
09 Jul 2012 05:44:17	1207803	14869247	hadcm3n_o4ka_2060_40_008000688_3	181,440	264,462	1.4576
08 Jul 2012 16:52:07	1207803	14869247	hadcm3n_o4ka_2060_40_008000688_3	155,520	220,934	1.4206
08 Jul 2012 04:04:07	1207803	14869247	hadcm3n_o4ka_2060_40_008000688_3	129,600	175,837	1.3568
07 Jul 2012 15:21:25	1207803	14869247	hadcm3n_o4ka_2060_40_008000688_3	103,680	130,466	1.2584
07 Jul 2012 00:58:52	1207803	14869247	hadcm3n_o4ka_2060_40_008000688_3	77,760	93,918	1.2078
06 Jul 2012 16:36:05	1207803	14869247	hadcm3n_o4ka_2060_40_008000688_3	51,840	64,600	1.2461
06 Jul 2012 07:28:58	1207803	14869247	hadcm3n_o4ka_2060_40_008000688_3	25,920	33,784	1.3034