Task 15559479

Name	hadcm3n_3g7v_1940_40_008266551_2
Workunit	8421675
Created	27 Jan 2013, 19:57:59 UTC
Sent	27 Jan 2013, 19:59:14 UTC
Report deadline	29 Apr 2013, 3:26:25 UTC
Received	15 Aug 2013, 17:16:53 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1116570
Run time	23 days 18 hours 31 min 32 sec
CPU time	23 days 4 hours 30 min 56 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.63 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code -1073741819 (0xc0000005) </message> <stderr_txt> from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:46:28 (4724): No heartbeat from core client for 30 sec - exiting 18:46:29 (4724): No heartbeat from core client for 30 sec - exiting 18:46:31 (4724): No heartbeat from core client for 30 sec - exiting 18:46:32 (4724): No heartbeat from core client for 30 sec - exiting 18:46:33 (4724): No heartbeat from core client for 30 sec - exiting 18:46:34 (4724): No heartbeat from core client for 30 sec - exiting 18:46:35 (4724): No heartbeat from core client for 30 sec - exiting 18:46:36 (4724): No heartbeat from core client for 30 sec - exiting 18:46:37 (4724): No heartbeat from core client for 30 sec - exiting 18:46:38 (4724): No heartbeat from core client for 30 sec - exiting 18:46:39 (4724): No heartbeat from core client for 30 sec - exiting 18:46:40 (4724): No heartbeat from core client for 30 sec - exiting 18:46:41 (4724): No heartbeat from core client for 30 sec - exiting 18:46:43 (4724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:34:29 (3920): No heartbeat from core client for 30 sec - exiting 08:34:31 (3920): No heartbeat from core client for 30 sec - exiting 08:34:32 (3920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2664, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5608, iMonCtr=1 Model crash detected, will try to restart... 18:14:39 (4740): No heartbeat from core client for 30 sec - exiting 18:14:40 (4740): No heartbeat from core client for 30 sec - exiting 18:14:41 (4740): No heartbeat from core client for 30 sec - exiting 18:14:42 (4740): No heartbeat from core client for 30 sec - exiting 18:14:43 (4740): No heartbeat from core client for 30 sec - exiting 18:14:44 (4740): No heartbeat from core client for 30 sec - exiting 18:14:45 (4740): No heartbeat from core client for 30 sec - exiting 18:14:46 (4740): No heartbeat from core client for 30 sec - exiting 18:14:47 (4740): No heartbeat from core client for 30 sec - exiting 18:14:48 (4740): No heartbeat from core client for 30 sec - exiting 18:14:49 (4740): No heartbeat from core client for 30 sec - exiting 18:14:50 (4740): No heartbeat from core client for 30 sec - exiting 18:14:51 (4740): No heartbeat from core client for 30 sec - exiting 18:14:52 (4740): No heartbeat from core client for 30 sec - exiting 18:14:53 (4740): No heartbeat from core client for 30 sec - exiting 18:14:54 (4740): No heartbeat from core client for 30 sec - exiting 18:14:55 (4740): No heartbeat from core client for 30 sec - exiting 18:14:56 (4740): No heartbeat from core client for 30 sec - exiting 18:14:57 (4740): No heartbeat from core client for 30 sec - exiting 18:14:58 (4740): No heartbeat from core client for 30 sec - exiting 18:14:59 (4740): No heartbeat from core client for 30 sec - exiting 18:15:00 (4740): No heartbeat from core client for 30 sec - exiting 18:15:01 (4740): No heartbeat from core client for 30 sec - exiting 18:15:02 (4740): No heartbeat from core client for 30 sec - exiting 18:15:03 (4740): No heartbeat from core client for 30 sec - exiting 18:15:04 (4740): No heartbeat from core client for 30 sec - exiting 18:15:05 (4740): No heartbeat from core client for 30 sec - exiting 18:15:06 (4740): No heartbeat from core client for 30 sec - exiting 18:15:07 (4740): No heartbeat from core client for 30 sec - exiting 18:15:08 (4740): No heartbeat from core client for 30 sec - exiting 18:15:09 (4740): No heartbeat from core client for 30 sec - exiting 18:15:10 (4740): No heartbeat from core client for 30 sec - exiting 18:15:11 (4740): No heartbeat from core client for 30 sec - exiting 18:15:12 (4740): No heartbeat from core client for 30 sec - exiting 18:15:13 (4740): No heartbeat from core client for 30 sec - exiting 18:15:14 (4740): No heartbeat from core client for 30 sec - exiting 18:15:15 (4740): No heartbeat from core client for 30 sec - exiting 18:15:16 (4740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5224, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4112, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2108, iMonCtr=1 Model crash detected, will try to restart... 18:14:15 (5636): No heartbeat from core client for 30 sec - exiting 18:14:16 (5636): No heartbeat from core client for 30 sec - exiting 18:14:17 (5636): No heartbeat from core client for 30 sec - exiting 18:14:18 (5636): No heartbeat from core client for 30 sec - exiting 18:14:19 (5636): No heartbeat from core client for 30 sec - exiting 18:14:20 (5636): No heartbeat from core client for 30 sec - exiting 18:14:21 (5636): No heartbeat from core client for 30 sec - exiting 18:14:22 (5636): No heartbeat from core client for 30 sec - exiting 18:14:23 (5636): No heartbeat from core client for 30 sec - exiting 18:14:25 (5636): No heartbeat from core client for 30 sec - exiting 18:14:26 (5636): No heartbeat from core client for 30 sec - exiting 18:14:27 (5636): No heartbeat from core client for 30 sec - exiting 18:14:28 (5636): No heartbeat from core client for 30 sec - exiting 18:14:29 (5636): No heartbeat from core client for 30 sec - exiting 18:14:30 (5636): No heartbeat from core client for 30 sec - exiting 18:14:31 (5636): No heartbeat from core client for 30 sec - exiting 18:14:32 (5636): No heartbeat from core client for 30 sec - exiting 18:14:33 (5636): No heartbeat from core client for 30 sec - exiting 18:14:34 (5636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:31:41 (3056): No heartbeat from core client for 30 sec - exiting 07:31:43 (3056): No heartbeat from core client for 30 sec - exiting 07:31:44 (3056): No heartbeat from core client for 30 sec - exiting 07:31:45 (3056): No heartbeat from core client for 30 sec - exiting 07:31:46 (3056): No heartbeat from core client for 30 sec - exiting 07:31:47 (3056): No heartbeat from core client for 30 sec - exiting 07:31:48 (3056): No heartbeat from core client for 30 sec - exiting 07:31:49 (3056): No heartbeat from core client for 30 sec - exiting 07:31:50 (3056): No heartbeat from core client for 30 sec - exiting 07:31:52 (3056): No heartbeat from core client for 30 sec - exiting 07:31:53 (3056): No heartbeat from core client for 30 sec - exiting 07:31:54 (3056): No heartbeat from core client for 30 sec - exiting 07:31:55 (3056): No heartbeat from core client for 30 sec - exiting 07:31:56 (3056): No heartbeat from core client for 30 sec - exiting 07:31:57 (3056): No heartbeat from core client for 30 sec - exiting 07:31:58 (3056): No heartbeat from core client for 30 sec - exiting 07:31:59 (3056): No heartbeat from core client for 30 sec - exiting 07:32:00 (3056): No heartbeat from core client for 30 sec - exiting 07:32:01 (3056): No heartbeat from core client for 30 sec - exiting 07:32:02 (3056): No heartbeat from core client for 30 sec - exiting 07:32:04 (3056): No heartbeat from core client for 30 sec - exiting 07:32:05 (3056): No heartbeat from core client for 30 sec - exiting 07:32:06 (3056): No heartbeat from core client for 30 sec - exiting 07:32:07 (3056): No heartbeat from core client for 30 sec - exiting 07:32:08 (3056): No heartbeat from core client for 30 sec - exiting 07:32:09 (3056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:32:10 (3056): No heartbeat from core client for 30 sec - exiting 07:32:59 (4684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:50:20 (4612): No heartbeat from core client for 30 sec - exiting 13:50:21 (4612): No heartbeat from core client for 30 sec - exiting 13:50:22 (4612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:49:45 (3636): No heartbeat from core client for 30 sec - exiting 08:49:46 (3636): No heartbeat from core client for 30 sec - exiting 08:49:47 (3636): No heartbeat from core client for 30 sec - exiting 08:49:48 (3636): No heartbeat from core client for 30 sec - exiting 08:49:49 (3636): No heartbeat from core client for 30 sec - exiting 08:49:50 (3636): No heartbeat from core client for 30 sec - exiting 08:49:51 (3636): No heartbeat from core client for 30 sec - exiting 08:49:52 (3636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4580, iMonCtr=1 Model crash detected, will try to restart... 08:18:07 (5740): No heartbeat from core client for 30 sec - exiting 08:18:08 (5740): No heartbeat from core client for 30 sec - exiting 08:18:09 (5740): No heartbeat from core client for 30 sec - exiting 08:18:10 (5740): No heartbeat from core client for 30 sec - exiting 08:18:11 (5740): No heartbeat from core client for 30 sec - exiting 08:18:12 (5740): No heartbeat from core client for 30 sec - exiting 08:18:13 (5740): No heartbeat from core client for 30 sec - exiting 08:18:14 (5740): No heartbeat from core client for 30 sec - exiting 08:18:15 (5740): No heartbeat from core client for 30 sec - exiting 08:18:17 (5740): No heartbeat from core client for 30 sec - exiting 08:18:18 (5740): No heartbeat from core client for 30 sec - exiting 08:18:19 (5740): No heartbeat from core client for 30 sec - exiting 08:18:20 (5740): No heartbeat from core client for 30 sec - exiting 08:18:21 (5740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5048, iMonCtr=1 Model crash detected, will try to restart... 18:13:02 (5232): No heartbeat from core client for 30 sec - exiting 18:13:03 (5232): No heartbeat from core client for 30 sec - exiting 18:13:04 (5232): No heartbeat from core client for 30 sec - exiting 18:13:05 (5232): No heartbeat from core client for 30 sec - exiting 18:13:07 (5232): No heartbeat from core client for 30 sec - exiting 18:13:08 (5232): No heartbeat from core client for 30 sec - exiting 18:13:09 (5232): No heartbeat from core client for 30 sec - exiting 18:13:10 (5232): No heartbeat from core client for 30 sec - exiting 18:13:11 (5232): No heartbeat from core client for 30 sec - exiting 18:13:12 (5232): No heartbeat from core client for 30 sec - exiting 18:13:13 (5232): No heartbeat from core client for 30 sec - exiting 18:13:14 (5232): No heartbeat from core client for 30 sec - exiting 18:13:15 (5232): No heartbeat from core client for 30 sec - exiting 18:13:16 (5232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2020, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3020, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3672, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:40:20 (5548): No heartbeat from core client for 30 sec - exiting 07:40:21 (5548): No heartbeat from core client for 30 sec - exiting 07:40:22 (5548): No heartbeat from core client for 30 sec - exiting 07:40:23 (5548): No heartbeat from core client for 30 sec - exiting 07:40:25 (5548): No heartbeat from core client for 30 sec - exiting 07:40:26 (5548): No heartbeat from core client for 30 sec - exiting 07:40:27 (5548): No heartbeat from core client for 30 sec - exiting 07:40:28 (5548): No heartbeat from core client for 30 sec - exiting 07:40:29 (5548): No heartbeat from core client for 30 sec - exiting 07:40:30 (5548): No heartbeat from core client for 30 sec - exiting 07:40:31 (5548): No heartbeat from core client for 30 sec - exiting 07:40:32 (5548): No heartbeat from core client for 30 sec - exiting 07:40:33 (5548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:54:25 (900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4940, iMonCtr=1 Model crash detected, will try to restart... 07:58:54 (4904): No heartbeat from core client for 30 sec - exiting 07:58:55 (4904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:13:57 (5976): No heartbeat from core client for 30 sec - exiting 18:13:58 (5976): No heartbeat from core client for 30 sec - exiting 18:13:59 (5976): No heartbeat from core client for 30 sec - exiting 18:14:00 (5976): No heartbeat from core client for 30 sec - exiting 18:14:01 (5976): No heartbeat from core client for 30 sec - exiting 18:14:02 (5976): No heartbeat from core client for 30 sec - exiting 18:14:03 (5976): No heartbeat from core client for 30 sec - exiting 18:14:05 (5976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:03:56 (2352): No heartbeat from core client for 30 sec - exiting 18:03:57 (2352): No heartbeat from core client for 30 sec - exiting 18:03:58 (2352): No heartbeat from core client for 30 sec - exiting 18:03:59 (2352): No heartbeat from core client for 30 sec - exiting 18:04:00 (2352): No heartbeat from core client for 30 sec - exiting 18:04:02 (2352): No heartbeat from core client for 30 sec - exiting 18:04:03 (2352): No heartbeat from core client for 30 sec - exiting 18:04:04 (2352): No heartbeat from core client for 30 sec - exiting 18:04:05 (2352): No heartbeat from core client for 30 sec - exiting 18:04:06 (2352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:48:04 (2596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:59:54 (4968): No heartbeat from core client for 30 sec - exiting 17:59:56 (4968): No heartbeat from core client for 30 sec - exiting 17:59:57 (4968): No heartbeat from core client for 30 sec - exiting 17:59:58 (4968): No heartbeat from core client for 30 sec - exiting 17:59:59 (4968): No heartbeat from core client for 30 sec - exiting 18:00:00 (4968): No heartbeat from core client for 30 sec - exiting 18:00:01 (4968): No heartbeat from core client for 30 sec - exiting 18:00:02 (4968): No heartbeat from core client for 30 sec - exiting 18:00:03 (4968): No heartbeat from core client for 30 sec - exiting 18:00:04 (4968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:54:28 (2200): No heartbeat from core client for 30 sec - exiting 17:54:29 (2200): No heartbeat from core client for 30 sec - exiting 17:54:30 (2200): No heartbeat from core client for 30 sec - exiting 17:54:31 (2200): No heartbeat from core client for 30 sec - exiting 17:54:32 (2200): No heartbeat from core client for 30 sec - exiting 17:54:34 (2200): No heartbeat from core client for 30 sec - exiting 17:54:35 (2200): No heartbeat from core client for 30 sec - exiting 17:54:36 (2200): No heartbeat from core client for 30 sec - exiting 17:54:37 (2200): No heartbeat from core client for 30 sec - exiting 17:54:38 (2200): No heartbeat from core client for 30 sec - exiting 17:54:39 (2200): No heartbeat from core client for 30 sec - exiting 17:54:40 (2200): No heartbeat from core client for 30 sec - exiting 17:54:41 (2200): No heartbeat from core client for 30 sec - exiting 17:54:42 (2200): No heartbeat from core client for 30 sec - exiting 17:54:43 (2200): No heartbeat from core client for 30 sec - exiting 17:54:44 (2200): No heartbeat from core client for 30 sec - exiting 17:54:46 (2200): No heartbeat from core client for 30 sec - exiting 17:54:47 (2200): No heartbeat from core client for 30 sec - exiting 17:54:48 (2200): No heartbeat from core client for 30 sec - exiting 17:54:49 (2200): No heartbeat from core client for 30 sec - exiting 17:54:50 (2200): No heartbeat from core client for 30 sec - exiting 17:54:51 (2200): No heartbeat from core client for 30 sec - exiting 17:54:52 (2200): No heartbeat from core client for 30 sec - exiting 17:54:53 (2200): No heartbeat from core client for 30 sec - exiting 17:54:54 (2200): No heartbeat from core client for 30 sec - exiting 17:54:55 (2200): No heartbeat from core client for 30 sec - exiting 17:54:56 (2200): No heartbeat from core client for 30 sec - exiting 17:54:58 (2200): No heartbeat from core client for 30 sec - exiting 17:54:59 (2200): No heartbeat from core client for 30 sec - exiting 17:55:00 (2200): No heartbeat from core client for 30 sec - exiting 17:55:01 (2200): No heartbeat from core client for 30 sec - exiting 17:55:02 (2200): No heartbeat from core client for 30 sec - exiting 17:55:03 (2200): No heartbeat from core client for 30 sec - exiting 17:55:04 (2200): No heartbeat from core client for 30 sec - exiting 17:55:05 (2200): No heartbeat from core client for 30 sec - exiting 17:55:06 (2200): No heartbeat from core client for 30 sec - exiting 17:55:07 (2200): No heartbeat from core client for 30 sec - exiting 17:55:08 (2200): No heartbeat from core client for 30 sec - exiting 17:55:10 (2200): No heartbeat from core client for 30 sec - exiting 17:55:11 (2200): No heartbeat from core client for 30 sec - exiting 17:55:12 (2200): No heartbeat from core client for 30 sec - exiting 17:55:13 (2200): No heartbeat from core client for 30 sec - exiting 17:55:14 (2200): No heartbeat from core client for 30 sec - exiting 17:55:15 (2200): No heartbeat from core client for 30 sec - exiting 17:55:16 (2200): No heartbeat from core client for 30 sec - exiting 17:55:17 (2200): No heartbeat from core client for 30 sec - exiting 17:55:18 (2200): No heartbeat from core client for 30 sec - exiting 17:55:19 (2200): No heartbeat from core client for 30 sec - exiting 17:55:20 (2200): No heartbeat from core client for 30 sec - exiting 17:55:22 (2200): No heartbeat from core client for 30 sec - exiting 17:55:23 (2200): No heartbeat from core client for 30 sec - exiting 17:55:24 (2200): No heartbeat from core client for 30 sec - exiting 17:55:25 (2200): No heartbeat from core client for 30 sec - exiting 17:55:26 (2200): No heartbeat from core client for 30 sec - exiting 17:55:27 (2200): No heartbeat from core client for 30 sec - exiting 17:55:28 (2200): No heartbeat from core client for 30 sec - exiting 17:55:29 (2200): No heartbeat from core client for 30 sec - exiting 17:55:30 (2200): No heartbeat from core client for 30 sec - exiting 17:55:31 (2200): No heartbeat from core client for 30 sec - exiting 17:55:33 (2200): No heartbeat from core client for 30 sec - exiting 17:55:34 (2200): No heartbeat from core client for 30 sec - exiting 17:55:35 (2200): No heartbeat from core client for 30 sec - exiting 17:55:36 (2200): No heartbeat from core client for 30 sec - exiting 17:55:37 (2200): No heartbeat from core client for 30 sec - exiting 17:55:38 (2200): No heartbeat from core client for 30 sec - exiting 17:55:39 (2200): No heartbeat from core client for 30 sec - exiting 17:55:40 (2200): No heartbeat from core client for 30 sec - exiting 17:55:41 (2200): No heartbeat from core client for 30 sec - exiting 17:55:42 (2200): No heartbeat from core client for 30 sec - exiting 17:55:43 (2200): No heartbeat from core client for 30 sec - exiting 17:55:45 (2200): No heartbeat from core client for 30 sec - exiting 17:55:46 (2200): No heartbeat from core client for 30 sec - exiting 17:55:47 (2200): No heartbeat from core client for 30 sec - exiting 17:55:48 (2200): No heartbeat from core client for 30 sec - exiting 17:55:49 (2200): No heartbeat from core client for 30 sec - exiting 17:55:50 (2200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:04:51 (496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:06:33 (1512): No heartbeat from core client for 30 sec - exiting 18:06:34 (1512): No heartbeat from core client for 30 sec - exiting 18:06:35 (1512): No heartbeat from core client for 30 sec - exiting 18:06:36 (1512): No heartbeat from core client for 30 sec - exiting 18:06:37 (1512): No heartbeat from core client for 30 sec - exiting 18:06:38 (1512): No heartbeat from core client for 30 sec - exiting 18:06:39 (1512): No heartbeat from core client for 30 sec - exiting 18:06:40 (1512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:23:48 (196): No heartbeat from core client for 30 sec - exiting 20:23:49 (196): No heartbeat from core client for 30 sec - exiting 20:23:50 (196): No heartbeat from core client for 30 sec - exiting 20:23:52 (196): No heartbeat from core client for 30 sec - exiting 20:23:53 (196): No heartbeat from core client for 30 sec - exiting 20:23:54 (196): No heartbeat from core client for 30 sec - exiting 20:23:55 (196): No heartbeat from core client for 30 sec - exiting 20:23:56 (196): No heartbeat from core client for 30 sec - exiting 20:23:57 (196): No heartbeat from core client for 30 sec - exiting 20:23:58 (196): No heartbeat from core client for 30 sec - exiting 20:23:59 (196): No heartbeat from core client for 30 sec - exiting 20:24:00 (196): No heartbeat from core client for 30 sec - exiting 20:24:01 (196): No heartbeat from core client for 30 sec - exiting 20:24:02 (196): No heartbeat from core client for 30 sec - exiting 20:24:04 (196): No heartbeat from core client for 30 sec - exiting 20:24:05 (196): No heartbeat from core client for 30 sec - exiting 20:24:06 (196): No heartbeat from core client for 30 sec - exiting 20:24:07 (196): No heartbeat from core client for 30 sec - exiting 20:24:08 (196): No heartbeat from core client for 30 sec - exiting 20:24:09 (196): No heartbeat from core client for 30 sec - exiting 20:24:10 (196): No heartbeat from core client for 30 sec - exiting 20:24:11 (196): No heartbeat from core client for 30 sec - exiting 20:24:12 (196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:25:49 (5236): No heartbeat from core client for 30 sec - exiting 20:25:50 (5236): No heartbeat from core client for 30 sec - exiting 20:25:51 (5236): No heartbeat from core client for 30 sec - exiting 20:25:52 (5236): No heartbeat from core client for 30 sec - exiting 20:25:53 (5236): No heartbeat from core client for 30 sec - exiting 20:25:54 (5236): No heartbeat from core client for 30 sec - exiting 20:25:55 (5236): No heartbeat from core client for 30 sec - exiting 20:25:56 (5236): No heartbeat from core client for 30 sec - exiting 20:25:57 (5236): No heartbeat from core client for 30 sec - exiting 20:25:58 (5236): No heartbeat from core client for 30 sec - exiting 20:25:59 (5236): No heartbeat from core client for 30 sec - exiting 20:26:00 (5236): No heartbeat from core client for 30 sec - exiting 20:26:01 (5236): No heartbeat from core client for 30 sec - exiting 20:26:02 (5236): No heartbeat from core client for 30 sec - exiting 20:26:03 (5236): No heartbeat from core client for 30 sec - exiting 20:26:04 (5236): No heartbeat from core client for 30 sec - exiting 20:26:05 (5236): No heartbeat from core client for 30 sec - exiting 20:26:06 (5236): No heartbeat from core client for 30 sec - exiting 20:26:01 (5236): No heartbeat from core client for 30 sec - exiting 20:26:02 (5236): No heartbeat from core client for 30 sec - exiting 20:26:03 (5236): No heartbeat from core client for 30 sec - exiting 20:26:04 (5236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:26:45 (4116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:55:06 (5248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:22:33 (5556): No heartbeat from core client for 30 sec - exiting 19:22:34 (5556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:22:35 (5556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3236, iMonCtr=1 Model crash detected, will try to restart... 18:13:18 (5260): No heartbeat from core client for 30 sec - exiting 18:13:19 (5260): No heartbeat from core client for 30 sec - exiting 18:13:20 (5260): No heartbeat from core client for 30 sec - exiting 18:13:21 (5260): No heartbeat from core client for 30 sec - exiting 18:13:22 (5260): No heartbeat from core client for 30 sec - exiting 18:13:23 (5260): No heartbeat from core client for 30 sec - exiting 18:13:24 (5260): No heartbeat from core client for 30 sec - exiting 18:13:25 (5260): No heartbeat from core client for 30 sec - exiting 18:13:26 (5260): No heartbeat from core client for 30 sec - exiting 18:13:27 (5260): No heartbeat from core client for 30 sec - exiting 18:13:29 (5260): No heartbeat from core client for 30 sec - exiting 18:13:30 (5260): No heartbeat from core client for 30 sec - exiting 18:13:31 (5260): No heartbeat from core client for 30 sec - exiting 18:13:32 (5260): No heartbeat from core client for 30 sec - exiting 18:13:33 (5260): No heartbeat from core client for 30 sec - exiting 18:13:34 (5260): No heartbeat from core client for 30 sec - exiting 18:13:35 (5260): No heartbeat from core client for 30 sec - exiting 18:13:36 (5260): No heartbeat from core client for 30 sec - exiting 18:13:37 (5260): No heartbeat from core client for 30 sec - exiting 18:13:38 (5260): No heartbeat from core client for 30 sec - exiting 18:13:39 (5260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:08:46 (148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:53:31 (3668): No heartbeat from core client for 30 sec - exiting 18:53:32 (3668): No heartbeat from core client for 30 sec - exiting 18:53:33 (3668): No heartbeat from core client for 30 sec - exiting 18:53:34 (3668): No heartbeat from core client for 30 sec - exiting 18:53:35 (3668): No heartbeat from core client for 30 sec - exiting 18:53:36 (3668): No heartbeat from core client for 30 sec - exiting 18:53:38 (3668): No heartbeat from core client for 30 sec - exiting 18:53:39 (3668): No heartbeat from core client for 30 sec - exiting 18:53:40 (3668): No heartbeat from core client for 30 sec - exiting 18:53:41 (3668): No heartbeat from core client for 30 sec - exiting 18:53:42 (3668): No heartbeat from core client for 30 sec - exiting 18:53:43 (3668): No heartbeat from core client for 30 sec - exiting 18:53:44 (3668): No heartbeat from core client for 30 sec - exiting 18:53:45 (3668): No heartbeat from core client for 30 sec - exiting 18:53:46 (3668): No heartbeat from core client for 30 sec - exiting 18:53:47 (3668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:53:48 (3668): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 19:08:37 (2488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:08:38 (2488): No heartbeat from core client for 30 sec - exiting 19:09:24 (2916): No heartbeat from core client for 30 sec - exiting 19:09:25 (2916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1640, iMonCtr=1 Model crash detected, will try to restart... 18:09:20 (4376): No heartbeat from core client for 30 sec - exiting 18:09:22 (4376): No heartbeat from core client for 30 sec - exiting 18:09:23 (4376): No heartbeat from core client for 30 sec - exiting 18:09:24 (4376): No heartbeat from core client for 30 sec - exiting 18:09:25 (4376): No heartbeat from core client for 30 sec - exiting 18:09:26 (4376): No heartbeat from core client for 30 sec - exiting 18:09:27 (4376): No heartbeat from core client for 30 sec - exiting 18:09:28 (4376): No heartbeat from core client for 30 sec - exiting 18:09:29 (4376): No heartbeat from core client for 30 sec - exiting 18:09:30 (4376): No heartbeat from core client for 30 sec - exiting 18:09:31 (4376): No heartbeat from core client for 30 sec - exiting 18:09:33 (4376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:09:34 (4376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5884, iMonCtr=1 Model crash detected, will try to restart... 17:47:48 (5868): No heartbeat from core client for 30 sec - exiting 17:47:49 (5868): No heartbeat from core client for 30 sec - exiting 17:47:50 (5868): No heartbeat from core client for 30 sec - exiting 17:47:51 (5868): No heartbeat from core client for 30 sec - exiting 17:47:52 (5868): No heartbeat from core client for 30 sec - exiting 17:47:54 (5868): No heartbeat from core client for 30 sec - exiting 17:47:55 (5868): No heartbeat from core client for 30 sec - exiting 17:47:56 (5868): No heartbeat from core client for 30 sec - exiting 17:47:57 (5868): No heartbeat from core client for 30 sec - exiting 17:47:58 (5868): No heartbeat from core client for 30 sec - exiting 17:47:59 (5868): No heartbeat from core client for 30 sec - exiting 17:48:00 (5868): No heartbeat from core client for 30 sec - exiting 17:48:01 (5868): No heartbeat from core client for 30 sec - exiting 17:48:02 (5868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:11:41 (2720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/3g7vko.pjg2c10 Error converting file to netcdf: dataout/3g7vko.pig2c10 Error converting file to netcdf: dataout/3g7vko.pfg2c10 Error converting file to netcdf: dataout/3g7vka.phg2c10 Error converting file to netcdf: dataout/3g7vka.pgg2c10 Error converting file to netcdf: dataout/3g7vka.peg2c10 Error converting file to netcdf: dataout/3g7vka.pdg2c10 Suspended CPDN Monitor - Suspend request from BOINC... 07:56:41 (5052): No heartbeat from core client for 30 sec - exiting 07:56:43 (5052): No heartbeat from core client for 30 sec - exiting 07:56:44 (5052): No heartbeat from core client for 30 sec - exiting 07:56:45 (5052): No heartbeat from core client for 30 sec - exiting 07:56:46 (5052): No heartbeat from core client for 30 sec - exiting 07:56:47 (5052): No heartbeat from core client for 30 sec - exiting 07:56:48 (5052): No heartbeat from core client for 30 sec - exiting 07:56:49 (5052): No heartbeat from core client for 30 sec - exiting 07:56:50 (5052): No heartbeat from core client for 30 sec - exiting 07:56:51 (5052): No heartbeat from core client for 30 sec - exiting 07:56:52 (5052): No heartbeat from core client for 30 sec - exiting 07:56:54 (5052): No heartbeat from core client for 30 sec - exiting 07:56:55 (5052): No heartbeat from core client for 30 sec - exiting 07:56:56 (5052): No heartbeat from core client for 30 sec - exiting 07:56:57 (5052): No heartbeat from core client for 30 sec - exiting 07:56:58 (5052): No heartbeat from core client for 30 sec - exiting 07:56:59 (5052): No heartbeat from core client for 30 sec - exiting 07:57:00 (5052): No heartbeat from core client for 30 sec - exiting 07:57:01 (5052): No heartbeat from core client for 30 sec - exiting 07:57:02 (5052): No heartbeat from core client for 30 sec - exiting 07:57:03 (5052): No heartbeat from core client for 30 sec - exiting 07:57:04 (5052): No heartbeat from core client for 30 sec - exiting 07:57:06 (5052): No heartbeat from core client for 30 sec - exiting 07:57:07 (5052): No heartbeat from core client for 30 sec - exiting 07:57:08 (5052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:30:25 (5128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4904, iMonCtr=1 Model crash detected, will try to restart... 17:44:03 (3236): No heartbeat from core client for 30 sec - exiting 17:44:04 (3236): No heartbeat from core client for 30 sec - exiting 17:44:05 (3236): No heartbeat from core client for 30 sec - exiting 17:44:07 (3236): No heartbeat from core client for 30 sec - exiting 17:44:08 (3236): No heartbeat from core client for 30 sec - exiting 17:44:09 (3236): No heartbeat from core client for 30 sec - exiting 17:44:10 (3236): No heartbeat from core client for 30 sec - exiting 17:44:11 (3236): No heartbeat from core client for 30 sec - exiting 17:44:12 (3236): No heartbeat from core client for 30 sec - exiting 17:44:13 (3236): No heartbeat from core client for 30 sec - exiting 17:44:14 (3236): No heartbeat from core client for 30 sec - exiting 17:44:15 (3236): No heartbeat from core client for 30 sec - exiting 17:44:16 (3236): No heartbeat from core client for 30 sec - exiting 17:44:17 (3236): No heartbeat from core client for 30 sec - exiting 17:44:19 (3236): No heartbeat from core client for 30 sec - exiting 17:44:20 (3236): No heartbeat from core client for 30 sec - exiting 17:44:21 (3236): No heartbeat from core client for 30 sec - exiting 17:44:22 (3236): No heartbeat from core client for 30 sec - exiting 17:44:23 (3236): No heartbeat from core client for 30 sec - exiting 17:44:24 (3236): No heartbeat from core client for 30 sec - exiting 17:44:25 (3236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:03:05 (1160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:52:15 (3944): No heartbeat from core client for 30 sec - exiting 17:52:16 (3944): No heartbeat from core client for 30 sec - exiting 17:52:17 (3944): No heartbeat from core client for 30 sec - exiting 17:52:18 (3944): No heartbeat from core client for 30 sec - exiting 17:52:19 (3944): No heartbeat from core client for 30 sec - exiting 17:52:21 (3944): No heartbeat from core client for 30 sec - exiting 17:52:22 (3944): No heartbeat from core client for 30 sec - exiting 17:52:23 (3944): No heartbeat from core client for 30 sec - exiting 17:52:24 (3944): No heartbeat from core client for 30 sec - exiting 17:52:25 (3944): No heartbeat from core client for 30 sec - exiting 17:52:26 (3944): No heartbeat from core client for 30 sec - exiting 17:52:27 (3944): No heartbeat from core client for 30 sec - exiting 17:52:28 (3944): No heartbeat from core client for 30 sec - exiting 17:52:29 (3944): No heartbeat from core client for 30 sec - exiting 17:52:30 (3944): No heartbeat from core client for 30 sec - exiting 17:52:31 (3944): No heartbeat from core client for 30 sec - exiting 17:52:33 (3944): No heartbeat from core client for 30 sec - exiting 17:52:34 (3944): No heartbeat from core client for 30 sec - exiting 17:52:35 (3944): No heartbeat from core client for 30 sec - exiting 17:52:36 (3944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:54:23 (5712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:06:24 (5280): No heartbeat from core client for 30 sec - exiting 18:06:25 (5280): No heartbeat from core client for 30 sec - exiting 18:06:27 (5280): No heartbeat from core client for 30 sec - exiting 18:06:28 (5280): No heartbeat from core client for 30 sec - exiting 18:06:29 (5280): No heartbeat from core client for 30 sec - exiting 18:06:30 (5280): No heartbeat from core client for 30 sec - exiting 18:06:31 (5280): No heartbeat from core client for 30 sec - exiting 18:06:32 (5280): No heartbeat from core client for 30 sec - exiting 18:06:33 (5280): No heartbeat from core client for 30 sec - exiting 18:06:34 (5280): No heartbeat from core client for 30 sec - exiting 18:06:35 (5280): No heartbeat from core client for 30 sec - exiting 18:06:36 (5280): No heartbeat from core client for 30 sec - exiting 18:06:37 (5280): No heartbeat from core client for 30 sec - exiting 18:06:39 (5280): No heartbeat from core client for 30 sec - exiting 18:06:40 (5280): No heartbeat from core client for 30 sec - exiting 18:06:41 (5280): No heartbeat from core client for 30 sec - exiting 18:06:42 (5280): No heartbeat from core client for 30 sec - exiting 18:06:43 (5280): No heartbeat from core client for 30 sec - exiting 18:06:44 (5280): No heartbeat from core client for 30 sec - exiting 18:06:45 (5280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:06:46 (5280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 18:28:29 (4312): No heartbeat from core client for 30 sec - exiting 18:28:30 (4312): No heartbeat from core client for 30 sec - exiting 18:28:31 (4312): No heartbeat from core client for 30 sec - exiting 18:28:32 (4312): No heartbeat from core client for 30 sec - exiting 18:28:33 (4312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4540, iMonCtr=1 Model crash detected, will try to restart... 18:34:56 (5144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:37:58 (5656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:48:42 (1116): No heartbeat from core client for 30 sec - exiting 17:48:43 (1116): No heartbeat from core client for 30 sec - exiting 17:48:44 (1116): No heartbeat from core client for 30 sec - exiting 17:48:45 (1116): No heartbeat from core client for 30 sec - exiting 17:48:46 (1116): No heartbeat from core client for 30 sec - exiting 17:48:48 (1116): No heartbeat from core client for 30 sec - exiting 17:48:49 (1116): No heartbeat from core client for 30 sec - exiting 17:48:50 (1116): No heartbeat from core client for 30 sec - exiting 17:48:51 (1116): No heartbeat from core client for 30 sec - exiting 17:48:52 (1116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:48:53 (1116): No heartbeat from core client for 30 sec - exiting 17:48:54 (1116): No heartbeat from core client for 30 sec - exiting 17:48:55 (1116): No heartbeat from core client for 30 sec - exiting 17:48:56 (1116): No heartbeat from core client for 30 sec - exiting 17:48:57 (1116): No heartbeat from core client for 30 sec - exiting 17:48:58 (1116): No heartbeat from core client for 30 sec - exiting 17:49:00 (1116): No heartbeat from core client for 30 sec - exiting 17:49:01 (1116): No heartbeat from core client for 30 sec - exiting 17:49:02 (1116): No heartbeat from core client for 30 sec - exiting 17:55:15 (3340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:19:56 (4520): No heartbeat from core client for 30 sec - exiting 18:19:57 (4520): No heartbeat from core client for 30 sec - exiting 18:19:58 (4520): No heartbeat from core client for 30 sec - exiting 18:19:59 (4520): No heartbeat from core client for 30 sec - exiting 18:20:00 (4520): No heartbeat from core client for 30 sec - exiting 18:20:01 (4520): No heartbeat from core client for 30 sec - exiting 18:20:02 (4520): No heartbeat from core client for 30 sec - exiting 18:20:04 (4520): No heartbeat from core client for 30 sec - exiting 18:20:05 (4520): No heartbeat from core client for 30 sec - exiting 18:20:06 (4520): No heartbeat from core client for 30 sec - exiting 18:20:07 (4520): No heartbeat from core client for 30 sec - exiting 18:20:08 (4520): No heartbeat from core client for 30 sec - exiting 18:20:09 (4520): No heartbeat from core client for 30 sec - exiting 18:20:10 (4520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:20:11 (4520): No heartbeat from core client for 30 sec - exiting 18:20:12 (4520): No heartbeat from core client for 30 sec - exiting 18:20:13 (4520): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:09:02 (2488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:16:02 (2620): No heartbeat from core client for 30 sec - exiting 18:16:04 (2620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:16:05 (2620): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2236, iMonCtr=1 Model crash detected, will try to restart... 08:43:13 (2840): No heartbeat from core client for 30 sec - exiting 08:43:14 (2840): No heartbeat from core client for 30 sec - exiting 08:43:15 (2840): No heartbeat from core client for 30 sec - exiting 08:43:16 (2840): No heartbeat from core client for 30 sec - exiting 08:43:18 (2840): No heartbeat from core client for 30 sec - exiting 08:43:19 (2840): No heartbeat from core client for 30 sec - exiting 08:43:20 (2840): No heartbeat from core client for 30 sec - exiting 08:43:21 (2840): No heartbeat from core client for 30 sec - exiting 08:43:22 (2840): No heartbeat from core client for 30 sec - exiting 08:43:23 (2840): No heartbeat from core client for 30 sec - exiting 08:43:24 (2840): No heartbeat from core client for 30 sec - exiting 08:43:25 (2840): No heartbeat from core client for 30 sec - exiting 08:43:26 (2840): No heartbeat from core client for 30 sec - exiting 08:43:27 (2840): No heartbeat from core client for 30 sec - exiting 08:43:28 (2840): No heartbeat from core client for 30 sec - exiting 08:43:30 (2840): No heartbeat from core client for 30 sec - exiting 08:43:31 (2840): No heartbeat from core client for 30 sec - exiting 08:43:32 (2840): No heartbeat from core client for 30 sec - exiting 08:43:33 (2840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:53:32 (768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:01:05 (2548): No heartbeat from core client for 30 sec - exiting 09:01:06 (2548): No heartbeat from core client for 30 sec - exiting 09:01:07 (2548): No heartbeat from core client for 30 sec - exiting 09:01:08 (2548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2584, iMonCtr=1 Model crash detected, will try to restart... 18:04:30 (3864): No heartbeat from core client for 30 sec - exiting 18:04:31 (3864): No heartbeat from core client for 30 sec - exiting 18:04:32 (3864): No heartbeat from core client for 30 sec - exiting 18:04:33 (3864): No heartbeat from core client for 30 sec - exiting 18:04:34 (3864): No heartbeat from core client for 30 sec - exiting 18:04:35 (3864): No heartbeat from core client for 30 sec - exiting 18:04:36 (3864): No heartbeat from core client for 30 sec - exiting 18:04:38 (3864): No heartbeat from core client for 30 sec - exiting 18:04:39 (3864): No heartbeat from core client for 30 sec - exiting 18:04:40 (3864): No heartbeat from core client for 30 sec - exiting 18:04:41 (3864): No heartbeat from core client for 30 sec - exiting 18:04:42 (3864): No heartbeat from core client for 30 sec - exiting 18:04:43 (3864): No heartbeat from core client for 30 sec - exiting 18:04:44 (3864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:14:23 (3424): No heartbeat from core client for 30 sec - exiting 18:14:24 (3424): No heartbeat from core client for 30 sec - exiting 18:14:26 (3424): No heartbeat from core client for 30 sec - exiting 18:14:27 (3424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:20:11 (6004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:27:21 (4528): No heartbeat from core client for 30 sec - exiting 18:27:22 (4528): No heartbeat from core client for 30 sec - exiting 18:27:23 (4528): No heartbeat from core client for 30 sec - exiting 18:27:24 (4528): No heartbeat from core client for 30 sec - exiting 18:27:25 (4528): No heartbeat from core client for 30 sec - exiting 18:27:26 (4528): No heartbeat from core client for 30 sec - exiting 18:27:27 (4528): No heartbeat from core client for 30 sec - exiting 18:27:29 (4528): No heartbeat from core client for 30 sec - exiting 18:27:30 (4528): No heartbeat from core client for 30 sec - exiting 18:27:31 (4528): No heartbeat from core client for 30 sec - exiting 18:27:32 (4528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:27:33 (4528): No heartbeat from core client for 30 sec - exiting 18:27:34 (4528): No heartbeat from core client for 30 sec - exiting 18:27:35 (4528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:20:45 (5712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... C10:05:08 (4704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:25:16 (1236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1416, iMonCtr=1 Model crash detected, will try to restart... 18:03:47 (3492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=38420, iMonCtr=1 Model crash detected, will try to restart... 20:19:59 (888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4220, iMonCtr=1 Model crash detected, will try to restart... 11:43:33 (2384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:06:16 (3964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:17:40 (3820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:15:36 (2784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:43:38 (1800): No heartbeat from core client for 30 sec - exiting 18:43:39 (1800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2720, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2676, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 20:00:24 (3068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2264, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5852, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:35:19 (2008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:11:18 (6052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:11:19 (6052): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:41:37 (5060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5448, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 12:21:58 (5776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:08:30 (5928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:59:29 (5668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:59:30 (5668): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4032, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5984, iMonCtr=1 Model crash detected, will try to restart... CSuspended CPDN Monitor - Suspend request from BOINC... 18:10:38 (5852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3504, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 19:37:47 (1176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5920, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77B0A5D5 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7753A5D5 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76EFA5D5 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x778CA5D5 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x777CA645 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x00417B59 read attempt to address 0x80000004 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Aug 2013 18:00:10	1116570	15559479	hadcm3n_3g7v_1940_40_008266551_2	1,036,800	2,002,768	1.9317
14 Aug 2013 18:00:10	1116570	15559479	hadcm3n_3g7v_1940_40_008266551_2	1,010,880	1,951,807	1.9308
14 Aug 2013 18:00:10	1116570	15559479	hadcm3n_3g7v_1940_40_008266551_2	984,960	1,902,604	1.9317
14 Aug 2013 18:00:10	1116570	15559479	hadcm3n_3g7v_1940_40_008266551_2	959,040	1,852,762	1.9319
14 Aug 2013 18:00:10	1116570	15559479	hadcm3n_3g7v_1940_40_008266551_2	933,120	1,802,961	1.9322
14 Aug 2013 18:00:10	1116570	15559479	hadcm3n_3g7v_1940_40_008266551_2	907,200	1,753,038	1.9324
23 Jul 2013 21:22:54	1116570	15559479	hadcm3n_3g7v_1940_40_008266551_2	881,280	1,702,520	1.9319
23 Jul 2013 20:30:11	1116570	15559479	hadcm3n_3g7v_1940_40_008266551_2	855,360	1,651,393	1.9306
03 Jun 2013 18:24:05	1116570	15559479	hadcm3n_3g7v_1940_40_008266551_2	829,440	1,601,633	1.9310
29 May 2013 19:53:17	1116570	15559479	hadcm3n_3g7v_1940_40_008266551_2	803,520	1,552,373	1.9320
25 May 2013 18:24:42	1116570	15559479	hadcm3n_3g7v_1940_40_008266551_2	777,600	1,502,979	1.9328
21 May 2013 19:05:36	1116570	15559479	hadcm3n_3g7v_1940_40_008266551_2	751,680	1,453,490	1.9337
19 May 2013 21:10:48	1116570	15559479	hadcm3n_3g7v_1940_40_008266551_2	725,760	1,403,404	1.9337
18 May 2013 09:54:05	1116570	15559479	hadcm3n_3g7v_1940_40_008266551_2	699,840	1,353,372	1.9338
06 May 2013 18:44:43	1116570	15559479	hadcm3n_3g7v_1940_40_008266551_2	673,920	1,303,422	1.9341
04 May 2013 13:27:11	1116570	15559479	hadcm3n_3g7v_1940_40_008266551_2	648,000	1,252,990	1.9336
01 May 2013 06:48:15	1116570	15559479	hadcm3n_3g7v_1940_40_008266551_2	622,080	1,201,891	1.9321
21 Apr 2013 19:52:48	1116570	15559479	hadcm3n_3g7v_1940_40_008266551_2	596,160	1,151,030	1.9307
20 Apr 2013 16:57:40	1116570	15559479	hadcm3n_3g7v_1940_40_008266551_2	570,240	1,099,428	1.9280
12 Apr 2013 18:56:08	1116570	15559479	hadcm3n_3g7v_1940_40_008266551_2	544,320	1,047,779	1.9249