Task 15802677

Name	hadcm3n_n43r_1880_40_008374131_0
Workunit	8524990
Created	29 May 2013, 20:48:54 UTC
Sent	31 May 2013, 17:23:21 UTC
Report deadline	31 Aug 2013, 0:50:32 UTC
Received	1 Jul 2013, 13:10:34 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1186953
Run time	9 days 5 hours 59 min 19 sec
CPU time	8 days 6 hours 1 min 6 sec
Validate state	Invalid
Credit	4,665.60
Device peak FLOPS	2.34 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 47:04 (5068): No heartbeat from core client for 30 sec - exiting 12:47:05 (5068): No heartbeat from core client for 30 sec - exiting 12:47:06 (5068): No heartbeat from core client for 30 sec - exiting 12:47:07 (5068): No heartbeat from core client for 30 sec - exiting 12:47:08 (5068): No heartbeat from core client for 30 sec - exiting 12:47:09 (5068): No heartbeat from core client for 30 sec - exiting 12:47:10 (5068): No heartbeat from core client for 30 sec - exiting 12:47:11 (5068): No heartbeat from core client for 30 sec - exiting 12:47:12 (5068): No heartbeat from core client for 30 sec - exiting 12:47:13 (5068): No heartbeat from core client for 30 sec - exiting 12:47:14 (5068): No heartbeat from core client for 30 sec - exiting 12:47:15 (5068): No heartbeat from core client for 30 sec - exiting 12:47:16 (5068): No heartbeat from core client for 30 sec - exiting 12:47:17 (5068): No heartbeat from core client for 30 sec - exiting 12:47:18 (5068): No heartbeat from core client for 30 sec - exiting 12:47:19 (5068): No heartbeat from core client for 30 sec - exiting 12:47:20 (5068): No heartbeat from core client for 30 sec - exiting 12:47:21 (5068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:59:28 (6032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:00:25 (4596): No heartbeat from core client for 30 sec - exiting 13:00:26 (4596): No heartbeat from core client for 30 sec - exiting 13:00:27 (4596): No heartbeat from core client for 30 sec - exiting 13:00:28 (4596): No heartbeat from core client for 30 sec - exiting 13:00:29 (4596): No heartbeat from core client for 30 sec - exiting 13:00:30 (4596): No heartbeat from core client for 30 sec - exiting 13:00:31 (4596): No heartbeat from core client for 30 sec - exiting 13:00:32 (4596): No heartbeat from core client for 30 sec - exiting 13:00:33 (4596): No heartbeat from core client for 30 sec - exiting 13:00:34 (4596): No heartbeat from core client for 30 sec - exiting 13:00:35 (4596): No heartbeat from core client for 30 sec - exiting 13:00:37 (4596): No heartbeat from core client for 30 sec - exiting 13:00:38 (4596): No heartbeat from core client for 30 sec - exiting 13:00:39 (4596): No heartbeat from core client for 30 sec - exiting 13:00:40 (4596): No heartbeat from core client for 30 sec - exiting 13:00:41 (4596): No heartbeat from core client for 30 sec - exiting 13:00:42 (4596): No heartbeat from core client for 30 sec - exiting 13:00:43 (4596): No heartbeat from core client for 30 sec - exiting 13:00:44 (4596): No heartbeat from core client for 30 sec - exiting 13:00:45 (4596): No heartbeat from core client for 30 sec - exiting 13:00:46 (4596): No heartbeat from core client for 30 sec - exiting 13:00:47 (4596): No heartbeat from core client for 30 sec - exiting 13:00:48 (4596): No heartbeat from core client for 30 sec - exiting 13:00:49 (4596): No heartbeat from core client for 30 sec - exiting 13:00:50 (4596): No heartbeat from core client for 30 sec - exiting 13:00:51 (4596): No heartbeat from core client for 30 sec - exiting 13:00:52 (4596): No heartbeat from core client for 30 sec - exiting 13:00:53 (4596): No heartbeat from core client for 30 sec - exiting 13:00:54 (4596): No heartbeat from core client for 30 sec - exiting 13:00:55 (4596): No heartbeat from core client for 30 sec - exiting 13:00:56 (4596): No heartbeat from core client for 30 sec - exiting 13:00:57 (4596): No heartbeat from core client for 30 sec - exiting 13:00:58 (4596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:04:06 (5156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:05:17 (3928): No heartbeat from core client for 30 sec - exiting 13:05:18 (3928): No heartbeat from core client for 30 sec - exiting 13:05:19 (3928): No heartbeat from core client for 30 sec - exiting 13:05:20 (3928): No heartbeat from core client for 30 sec - exiting 13:05:21 (3928): No heartbeat from core client for 30 sec - exiting 13:05:22 (3928): No heartbeat from core client for 30 sec - exiting 13:05:23 (3928): No heartbeat from core client for 30 sec - exiting 13:05:24 (3928): No heartbeat from core client for 30 sec - exiting 13:05:25 (3928): No heartbeat from core client for 30 sec - exiting 13:05:26 (3928): No heartbeat from core client for 30 sec - exiting 13:05:27 (3928): No heartbeat from core client for 30 sec - exiting 13:05:28 (3928): No heartbeat from core client for 30 sec - exiting 13:05:29 (3928): No heartbeat from core client for 30 sec - exiting 13:05:30 (3928): No heartbeat from core client for 30 sec - exiting 13:05:31 (3928): No heartbeat from core client for 30 sec - exiting 13:05:32 (3928): No heartbeat from core client for 30 sec - exiting 13:05:33 (3928): No heartbeat from core client for 30 sec - exiting 13:05:34 (3928): No heartbeat from core client for 30 sec - exiting 13:05:35 (3928): No heartbeat from core client for 30 sec - exiting 13:05:36 (3928): No heartbeat from core client for 30 sec - exiting 13:05:37 (3928): No heartbeat from core client for 30 sec - exiting 13:05:38 (3928): No heartbeat from core client for 30 sec - exiting 13:05:39 (3928): No heartbeat from core client for 30 sec - exiting 13:05:40 (3928): No heartbeat from core client for 30 sec - exiting 13:05:41 (3928): No heartbeat from core client for 30 sec - exiting 13:05:42 (3928): No heartbeat from core client for 30 sec - exiting 13:05:43 (3928): No heartbeat from core client for 30 sec - exiting 13:05:44 (3928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:09:11 (5880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4748, iMonCtr=1 Model crash detected, will try to restart... 19:26:21 (5488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:33:33 (2640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:33:34 (2640): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:41:41 (2968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:41:42 (2968): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Ocean Restart file copy failed on n43rko.da899g0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:56:00 (5292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:56:01 (5292): No heartbeat from core client for 30 sec - exiting 13:56:02 (5292): No heartbeat from core client for 30 sec - exiting 14:00:21 (5328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:02:39 (5436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:02:40 (5436): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5668, iMonCtr=1 Model crash detected, will try to restart... 15:47:45 (5716): No heartbeat from core client for 30 sec - exiting 15:47:46 (5716): No heartbeat from core client for 30 sec - exiting 15:47:47 (5716): No heartbeat from core client for 30 sec - exiting 15:47:48 (5716): No heartbeat from core client for 30 sec - exiting 15:47:49 (5716): No heartbeat from core client for 30 sec - exiting 15:47:50 (5716): No heartbeat from core client for 30 sec - exiting 15:47:51 (5716): No heartbeat from core client for 30 sec - exiting 15:47:52 (5716): No heartbeat from core client for 30 sec - exiting 15:47:53 (5716): No heartbeat from core client for 30 sec - exiting 15:47:54 (5716): No heartbeat from core client for 30 sec - exiting 15:47:55 (5716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:53:22 (2112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:53:23 (2112): No heartbeat from core client for 30 sec - exiting 06:32:36 (4948): No heartbeat from core client for 30 sec - exiting 06:32:37 (4948): No heartbeat from core client for 30 sec - exiting 06:32:38 (4948): No heartbeat from core client for 30 sec - exiting 06:32:39 (4948): No heartbeat from core client for 30 sec - exiting 06:32:40 (4948): No heartbeat from core client for 30 sec - exiting 06:32:41 (4948): No heartbeat from core client for 30 sec - exiting 06:32:42 (4948): No heartbeat from core client for 30 sec - exiting 06:32:43 (4948): No heartbeat from core client for 30 sec - exiting 06:32:44 (4948): No heartbeat from core client for 30 sec - exiting 06:32:45 (4948): No heartbeat from core client for 30 sec - exiting 06:32:46 (4948): No heartbeat from core client for 30 sec - exiting 06:32:47 (4948): No heartbeat from core client for 30 sec - exiting 06:32:48 (4948): No heartbeat from core client for 30 sec - exiting 06:32:49 (4948): No heartbeat from core client for 30 sec - exiting 06:32:50 (4948): No heartbeat from core client for 30 sec - exiting 06:32:51 (4948): No heartbeat from core client for 30 sec - exiting 06:32:52 (4948): No heartbeat from core client for 30 sec - exiting 06:32:53 (4948): No heartbeat from core client for 30 sec - exiting 06:32:54 (4948): No heartbeat from core client for 30 sec - exiting 06:32:55 (4948): No heartbeat from core client for 30 sec - exiting 06:32:56 (4948): No heartbeat from core client for 30 sec - exiting 06:32:57 (4948): No heartbeat from core client for 30 sec - exiting 06:32:58 (4948): No heartbeat from core client for 30 sec - exiting 06:32:59 (4948): No heartbeat from core client for 30 sec - exiting 06:33:00 (4948): No heartbeat from core client for 30 sec - exiting 06:33:01 (4948): No heartbeat from core client for 30 sec - exiting 06:33:02 (4948): No heartbeat from core client for 30 sec - exiting 06:33:03 (4948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:34:30 (5816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CSuspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5376, iMonCtr=1 Model crash detected, will try to restart... 17:23:12 (4108): No heartbeat from core client for 30 sec - exiting 17:23:13 (4108): No heartbeat from core client for 30 sec - exiting 17:23:14 (4108): No heartbeat from core client for 30 sec - exiting 17:23:15 (4108): No heartbeat from core client for 30 sec - exiting 17:23:16 (4108): No heartbeat from core client for 30 sec - exiting 17:23:17 (4108): No heartbeat from core client for 30 sec - exiting 17:23:18 (4108): No heartbeat from core client for 30 sec - exiting 17:23:19 (4108): No heartbeat from core client for 30 sec - exiting 17:23:20 (4108): No heartbeat from core client for 30 sec - exiting 17:23:21 (4108): No heartbeat from core client for 30 sec - exiting 17:23:22 (4108): No heartbeat from core client for 30 sec - exiting 17:23:23 (4108): No heartbeat from core client for 30 sec - exiting 17:23:24 (4108): No heartbeat from core client for 30 sec - exiting 17:23:25 (4108): No heartbeat from core client for 30 sec - exiting 17:23:26 (4108): No heartbeat from core client for 30 sec - exiting 17:23:27 (4108): No heartbeat from core client for 30 sec - exiting 17:23:28 (4108): No heartbeat from core client for 30 sec - exiting 17:23:29 (4108): No heartbeat from core client for 30 sec - exiting 17:23:30 (4108): No heartbeat from core client for 30 sec - exiting 17:23:31 (4108): No heartbeat from core client for 30 sec - exiting 17:23:32 (4108): No heartbeat from core client for 30 sec - exiting 17:23:33 (4108): No heartbeat from core client for 30 sec - exiting 17:23:34 (4108): No heartbeat from core client for 30 sec - exiting 17:23:35 (4108): No heartbeat from core client for 30 sec - exiting 17:23:36 (4108): No heartbeat from core client for 30 sec - exiting 17:23:37 (4108): No heartbeat from core client for 30 sec - exiting 17:23:38 (4108): No heartbeat from core client for 30 sec - exiting 17:23:39 (4108): No heartbeat from core client for 30 sec - exiting 17:23:40 (4108): No heartbeat from core client for 30 sec - exiting 17:23:41 (4108): No heartbeat from core client for 30 sec - exiting 17:23:42 (4108): No heartbeat from core client for 30 sec - exiting 17:23:43 (4108): No heartbeat from core client for 30 sec - exiting 17:23:44 (4108): No heartbeat from core client for 30 sec - exiting 17:23:45 (4108): No heartbeat from core client for 30 sec - exiting 17:23:46 (4108): No heartbeat from core client for 30 sec - exiting 17:23:47 (4108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4412, iMonCtr=1 Model crash detected, will try to restart... 16:51:41 (5048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3044, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:50:52 (4820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:50:53 (4820): No heartbeat from core client for 30 sec - exiting 09:50:54 (4820): No heartbeat from core client for 30 sec - exiting 09:56:08 (6796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:56:58 (8132): No heartbeat from core client for 30 sec - exiting 09:56:59 (8132): No heartbeat from core client for 30 sec - exiting 09:57:00 (8132): No heartbeat from core client for 30 sec - exiting 09:57:01 (8132): No heartbeat from core client for 30 sec - exiting 09:57:02 (8132): No heartbeat from core client for 30 sec - exiting 09:57:03 (8132): No heartbeat from core client for 30 sec - exiting 09:57:04 (8132): No heartbeat from core client for 30 sec - exiting 09:57:05 (8132): No heartbeat from core client for 30 sec - exiting 09:57:06 (8132): No heartbeat from core client for 30 sec - exiting 09:57:07 (8132): No heartbeat from core client for 30 sec - exiting 09:57:08 (8132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6272, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:28:19 (6016): No heartbeat from core client for 30 sec - exiting 17:28:20 (6016): No heartbeat from core client for 30 sec - exiting 17:28:21 (6016): No heartbeat from core client for 30 sec - exiting 17:28:22 (6016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:40:41 (4596): No heartbeat from core client for 30 sec - exiting 08:40:42 (4596): No heartbeat from core client for 30 sec - exiting 08:40:43 (4596): No heartbeat from core client for 30 sec - exiting 08:40:44 (4596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:40:45 (4596): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:11:10 (5092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:11:11 (5092): No heartbeat from core client for 30 sec - exiting 11:12:39 (4076): No heartbeat from core client for 30 sec - exiting 11:12:40 (4076): No heartbeat from core client for 30 sec - exiting 11:12:41 (4076): No heartbeat from core client for 30 sec - exiting 11:12:42 (4076): No heartbeat from core client for 30 sec - exiting 11:12:43 (4076): No heartbeat from core client for 30 sec - exiting 11:12:44 (4076): No heartbeat from core client for 30 sec - exiting 11:12:45 (4076): No heartbeat from core client for 30 sec - exiting 11:12:46 (4076): No heartbeat from core client for 30 sec - exiting 11:12:47 (4076): No heartbeat from core client for 30 sec - exiting 11:12:48 (4076): No heartbeat from core client for 30 sec - exiting 11:12:49 (4076): No heartbeat from core client for 30 sec - exiting 11:12:50 (4076): No heartbeat from core client for 30 sec - exiting 11:12:51 (4076): No heartbeat from core client for 30 sec - exiting 11:12:52 (4076): No heartbeat from core client for 30 sec - exiting 11:12:53 (4076): No heartbeat from core client for 30 sec - exiting 11:12:54 (4076): No heartbeat from core client for 30 sec - exiting 11:12:55 (4076): No heartbeat from core client for 30 sec - exiting 11:12:56 (4076): No heartbeat from core client for 30 sec - exiting 11:12:57 (4076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:13:28 (5160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:13:29 (5160): No heartbeat from core client for 30 sec - exiting 13:15:08 (3432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:15:45 (1096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:26:57 (5748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:28:15 (5256): No heartbeat from core client for 30 sec - exiting 13:28:16 (5256): No heartbeat from core client for 30 sec - exiting 13:28:17 (5256): No heartbeat from core client for 30 sec - exiting 13:28:18 (5256): No heartbeat from core client for 30 sec - exiting 13:28:19 (5256): No heartbeat from core client for 30 sec - exiting 13:28:20 (5256): No heartbeat from core client for 30 sec - exiting 13:28:21 (5256): No heartbeat from core client for 30 sec - exiting 13:28:22 (5256): No heartbeat from core client for 30 sec - exiting 13:28:23 (5256): No heartbeat from core client for 30 sec - exiting 13:28:24 (5256): No heartbeat from core client for 30 sec - exiting 13:28:25 (5256): No heartbeat from core client for 30 sec - exiting 13:28:26 (5256): No heartbeat from core client for 30 sec - exiting 13:28:27 (5256): No heartbeat from core client for 30 sec - exiting 13:28:28 (5256): No heartbeat from core client for 30 sec - exiting 13:28:29 (5256): No heartbeat from core client for 30 sec - exiting 13:28:30 (5256): No heartbeat from core client for 30 sec - exiting 13:28:31 (5256): No heartbeat from core client for 30 sec - exiting 13:28:32 (5256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:59:26 (2488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:01:09 (4516): No heartbeat from core client for 30 sec - exiting 14:01:10 (4516): No heartbeat from core client for 30 sec - exiting 14:01:11 (4516): No heartbeat from core client for 30 sec - exiting 14:01:12 (4516): No heartbeat from core client for 30 sec - exiting 14:01:13 (4516): No heartbeat from core client for 30 sec - exiting 14:01:14 (4516): No heartbeat from core client for 30 sec - exiting 14:01:15 (4516): No heartbeat from core client for 30 sec - exiting 14:01:16 (4516): No heartbeat from core client for 30 sec - exiting 14:01:17 (4516): No heartbeat from core client for 30 sec - exiting 14:01:18 (4516): No heartbeat from core client for 30 sec - exiting 14:01:19 (4516): No heartbeat from core client for 30 sec - exiting 14:01:20 (4516): No heartbeat from core client for 30 sec - exiting 14:01:21 (4516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:03:10 (5680): No heartbeat from core client for 30 sec - exiting 17:03:11 (5680): No heartbeat from core client for 30 sec - exiting 17:03:12 (5680): No heartbeat from core client for 30 sec - exiting 17:03:13 (5680): No heartbeat from core client for 30 sec - exiting 17:03:14 (5680): No heartbeat from core client for 30 sec - exiting 17:03:15 (5680): No heartbeat from core client for 30 sec - exiting 17:03:16 (5680): No heartbeat from core client for 30 sec - exiting 17:03:17 (5680): No heartbeat from core client for 30 sec - exiting 17:03:18 (5680): No heartbeat from core client for 30 sec - exiting 17:03:19 (5680): No heartbeat from core client for 30 sec - exiting 17:03:20 (5680): No heartbeat from core client for 30 sec - exiting 17:03:21 (5680): No heartbeat from core client for 30 sec - exiting 17:03:22 (5680): No heartbeat from core client for 30 sec - exiting 17:03:23 (5680): No heartbeat from core client for 30 sec - exiting 17:03:24 (5680): No heartbeat from core client for 30 sec - exiting 17:03:25 (5680): No heartbeat from core client for 30 sec - exiting 17:03:26 (5680): No heartbeat from core client for 30 sec - exiting 17:03:27 (5680): No heartbeat from core client for 30 sec - exiting 17:03:28 (5680): No heartbeat from core client for 30 sec - exiting 17:03:29 (5680): No heartbeat from core client for 30 sec - exiting 17:03:30 (5680): No heartbeat from core client for 30 sec - exiting 17:03:31 (5680): No heartbeat from core client for 30 sec - exiting 17:03:32 (5680): No heartbeat from core client for 30 sec - exiting 17:03:33 (5680): No heartbeat from core client for 30 sec - exiting 17:03:34 (5680): No heartbeat from core client for 30 sec - exiting 17:03:35 (5680): No heartbeat from core client for 30 sec - exiting 17:03:36 (5680): No heartbeat from core client for 30 sec - exiting 17:03:37 (5680): No heartbeat from core client for 30 sec - exiting 17:03:38 (5680): No heartbeat from core client for 30 sec - exiting 17:03:39 (5680): No heartbeat from core client for 30 sec - exiting 17:03:40 (5680): No heartbeat from core client for 30 sec - exiting 17:03:41 (5680): No heartbeat from core client for 30 sec - exiting 17:03:42 (5680): No heartbeat from core client for 30 sec - exiting 17:03:43 (5680): No heartbeat from core client for 30 sec - exiting 17:03:44 (5680): No heartbeat from core client for 30 sec - exiting 17:03:45 (5680): No heartbeat from core client for 30 sec - exiting 17:03:46 (5680): No heartbeat from core client for 30 sec - exiting 17:03:47 (5680): No heartbeat from core client for 30 sec - exiting 17:03:48 (5680): No heartbeat from core client for 30 sec - exiting 17:03:49 (5680): No heartbeat from core client for 30 sec - exiting 17:03:50 (5680): No heartbeat from core client for 30 sec - exiting 17:03:51 (5680): No heartbeat from core client for 30 sec - exiting 17:03:52 (5680): No heartbeat from core client for 30 sec - exiting 17:03:53 (5680): No heartbeat from core client for 30 sec - exiting 17:03:54 (5680): No heartbeat from core client for 30 sec - exiting 17:03:55 (5680): No heartbeat from core client for 30 sec - exiting 17:03:56 (5680): No heartbeat from core client for 30 sec - exiting 17:03:57 (5680): No heartbeat from core client for 30 sec - exiting 17:03:58 (5680): No heartbeat from core client for 30 sec - exiting 17:03:59 (5680): No heartbeat from core client for 30 sec - exiting 17:04:00 (5680): No heartbeat from core client for 30 sec - exiting 17:04:01 (5680): No heartbeat from core client for 30 sec - exiting 17:04:02 (5680): No heartbeat from core client for 30 sec - exiting 17:04:03 (5680): No heartbeat from core client for 30 sec - exiting 17:04:04 (5680): No heartbeat from core client for 30 sec - exiting 17:04:05 (5680): No heartbeat from core client for 30 sec - exiting 17:04:06 (5680): No heartbeat from core client for 30 sec - exiting 17:04:07 (5680): No heartbeat from core client for 30 sec - exiting 17:04:08 (5680): No heartbeat from core client for 30 sec - exiting 17:04:09 (5680): No heartbeat from core client for 30 sec - exiting 17:04:10 (5680): No heartbeat from core client for 30 sec - exiting 17:04:11 (5680): No heartbeat from core client for 30 sec - exiting 17:04:12 (5680): No heartbeat from core client for 30 sec - exiting 17:04:13 (5680): No heartbeat from core client for 30 sec - exiting 17:04:14 (5680): No heartbeat from core client for 30 sec - exiting 17:04:15 (5680): No heartbeat from core client for 30 sec - exiting 17:04:16 (5680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:06:59 (3180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:12:01 (3200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:12:59 (5640): No heartbeat from core client for 30 sec - exiting 17:13:00 (5640): No heartbeat from core client for 30 sec - exiting 17:13:01 (5640): No heartbeat from core client for 30 sec - exiting 17:13:02 (5640): No heartbeat from core client for 30 sec - exiting 17:13:03 (5640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6120, iMonCtr=1 Model crash detected, will try to restart... 18:58:49 (4640): No heartbeat from core client for 30 sec - exiting 18:58:50 (4640): No heartbeat from core client for 30 sec - exiting 18:58:51 (4640): No heartbeat from core client for 30 sec - exiting 18:58:52 (4640): No heartbeat from core client for 30 sec - exiting 18:58:53 (4640): No heartbeat from core client for 30 sec - exiting 18:58:54 (4640): No heartbeat from core client for 30 sec - exiting 18:58:55 (4640): No heartbeat from core client for 30 sec - exiting 18:58:56 (4640): No heartbeat from core client for 30 sec - exiting 18:58:57 (4640): No heartbeat from core client for 30 sec - exiting 18:58:58 (4640): No heartbeat from core client for 30 sec - exiting 18:58:59 (4640): No heartbeat from core client for 30 sec - exiting 18:59:00 (4640): No heartbeat from core client for 30 sec - exiting 18:59:01 (4640): No heartbeat from core client for 30 sec - exiting 18:59:02 (4640): No heartbeat from core client for 30 sec - exiting 18:59:03 (4640): No heartbeat from core client for 30 sec - exiting 18:59:04 (4640): No heartbeat from core client for 30 sec - exiting 18:59:05 (4640): No heartbeat from core client for 30 sec - exiting 18:59:06 (4640): No heartbeat from core client for 30 sec - exiting 18:59:07 (4640): No heartbeat from core client for 30 sec - exiting 18:59:08 (4640): No heartbeat from core client for 30 sec - exiting 18:59:09 (4640): No heartbeat from core client for 30 sec - exiting 18:59:10 (4640): No heartbeat from core client for 30 sec - exiting 18:59:11 (4640): No heartbeat from core client for 30 sec - exiting 18:59:12 (4640): No heartbeat from core client for 30 sec - exiting 18:59:13 (4640): No heartbeat from core client for 30 sec - exiting 18:59:14 (4640): No heartbeat from core client for 30 sec - exiting 18:59:15 (4640): No heartbeat from core client for 30 sec - exiting 18:59:16 (4640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5804, iMonCtr=1 Model crash detected, will try to restart... 20:01:57 (5456): No heartbeat from core client for 30 sec - exiting 20:01:58 (5456): No heartbeat from core client for 30 sec - exiting 20:01:59 (5456): No heartbeat from core client for 30 sec - exiting 20:02:00 (5456): No heartbeat from core client for 30 sec - exiting 20:02:01 (5456): No heartbeat from core client for 30 sec - exiting 20:02:02 (5456): No heartbeat from core client for 30 sec - exiting 20:02:03 (5456): No heartbeat from core client for 30 sec - exiting 20:02:04 (5456): No heartbeat from core client for 30 sec - exiting 20:02:05 (5456): No heartbeat from core client for 30 sec - exiting 20:02:06 (5456): No heartbeat from core client for 30 sec - exiting 20:02:07 (5456): No heartbeat from core client for 30 sec - exiting 20:02:08 (5456): No heartbeat from core client for 30 sec - exiting 20:02:09 (5456): No heartbeat from core client for 30 sec - exiting 20:02:10 (5456): No heartbeat from core client for 30 sec - exiting 20:02:11 (5456): No heartbeat from core client for 30 sec - exiting 20:02:12 (5456): No heartbeat from core client for 30 sec - exiting 20:02:13 (5456): No heartbeat from core client for 30 sec - exiting 20:02:14 (5456): No heartbeat from core client for 30 sec - exiting 20:02:15 (5456): No heartbeat from core client for 30 sec - exiting 20:02:16 (5456): No heartbeat from core client for 30 sec - exiting 20:02:17 (5456): No heartbeat from core client for 30 sec - exiting 20:02:18 (5456): No heartbeat from core client for 30 sec - exiting 20:02:19 (5456): No heartbeat from core client for 30 sec - exiting 20:02:20 (5456): No heartbeat from core client for 30 sec - exiting 20:02:21 (5456): No heartbeat from core client for 30 sec - exiting 20:02:22 (5456): No heartbeat from core client for 30 sec - exiting 20:02:23 (5456): No heartbeat from core client for 30 sec - exiting 20:02:24 (5456): No heartbeat from core client for 30 sec - exiting 20:02:25 (5456): No heartbeat from core client for 30 sec - exiting 20:02:26 (5456): No heartbeat from core client for 30 sec - exiting 20:02:27 (5456): No heartbeat from core client for 30 sec - exiting 20:02:28 (5456): No heartbeat from core client for 30 sec - exiting 20:02:29 (5456): No heartbeat from core client for 30 sec - exiting 20:02:30 (5456): No heartbeat from core client for 30 sec - exiting 20:02:31 (5456): No heartbeat from core client for 30 sec - exiting 20:02:32 (5456): No heartbeat from core client for 30 sec - exiting 20:02:33 (5456): No heartbeat from core client for 30 sec - exiting 20:02:34 (5456): No heartbeat from core client for 30 sec - exiting 20:02:35 (5456): No heartbeat from core client for 30 sec - exiting 20:02:36 (5456): No heartbeat from core client for 30 sec - exiting 20:02:37 (5456): No heartbeat from core client for 30 sec - exiting 20:02:38 (5456): No heartbeat from core client for 30 sec - exiting 20:02:39 (5456): No heartbeat from core client for 30 sec - exiting 20:02:40 (5456): No heartbeat from core client for 30 sec - exiting 20:02:41 (5456): No heartbeat from core client for 30 sec - exiting 20:02:42 (5456): No heartbeat from core client for 30 sec - exiting 20:02:43 (5456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:02:44 (5456): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3084, iMonCtr=1 Model crash detected, will try to restart... 16:42:35 (4636): No heartbeat from core client for 30 sec - exiting 16:42:36 (4636): No heartbeat from core client for 30 sec - exiting 16:42:37 (4636): No heartbeat from core client for 30 sec - exiting 16:42:38 (4636): No heartbeat from core client for 30 sec - exiting 16:42:39 (4636): No heartbeat from core client for 30 sec - exiting 16:42:40 (4636): No heartbeat from core client for 30 sec - exiting 16:42:41 (4636): No heartbeat from core client for 30 sec - exiting 16:42:42 (4636): No heartbeat from core client for 30 sec - exiting 16:42:43 (4636): No heartbeat from core client for 30 sec - exiting 16:42:44 (4636): No heartbeat from core client for 30 sec - exiting 16:42:45 (4636): No heartbeat from core client for 30 sec - exiting 16:42:46 (4636): No heartbeat from core client for 30 sec - exiting 16:42:47 (4636): No heartbeat from core client for 30 sec - exiting 16:42:48 (4636): No heartbeat from core client for 30 sec - exiting 16:42:49 (4636): No heartbeat from core client for 30 sec - exiting 16:42:50 (4636): No heartbeat from core client for 30 sec - exiting 16:42:51 (4636): No heartbeat from core client for 30 sec - exiting 16:42:52 (4636): No heartbeat from core client for 30 sec - exiting 16:42:53 (4636): No heartbeat from core client for 30 sec - exiting 16:42:54 (4636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:55:07 (5348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:56:45 (1968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Jul 2013 09:07:37	1186953	15802677	hadcm3n_n43r_1880_40_008374131_0	388,800	674,066	1.7337
25 Jun 2013 17:39:22	1186953	15802677	hadcm3n_n43r_1880_40_008374131_0	362,880	629,847	1.7357
24 Jun 2013 16:39:04	1186953	15802677	hadcm3n_n43r_1880_40_008374131_0	336,960	584,081	1.7334
22 Jun 2013 18:36:30	1186953	15802677	hadcm3n_n43r_1880_40_008374131_0	311,040	537,157	1.7270
21 Jun 2013 18:51:47	1186953	15802677	hadcm3n_n43r_1880_40_008374131_0	285,120	491,985	1.7255
18 Jun 2013 05:47:30	1186953	15802677	hadcm3n_n43r_1880_40_008374131_0	259,200	448,008	1.7284
15 Jun 2013 15:32:31	1186953	15802677	hadcm3n_n43r_1880_40_008374131_0	233,280	402,624	1.7259
13 Jun 2013 19:33:25	1186953	15802677	hadcm3n_n43r_1880_40_008374131_0	207,360	357,411	1.7236
12 Jun 2013 20:37:19	1186953	15802677	hadcm3n_n43r_1880_40_008374131_0	181,440	313,617	1.7285
11 Jun 2013 20:33:38	1186953	15802677	hadcm3n_n43r_1880_40_008374131_0	155,520	267,905	1.7226
10 Jun 2013 10:43:37	1186953	15802677	hadcm3n_n43r_1880_40_008374131_0	129,600	222,791	1.7191
09 Jun 2013 13:46:38	1186953	15802677	hadcm3n_n43r_1880_40_008374131_0	103,680	176,843	1.7057
05 Jun 2013 20:44:24	1186953	15802677	hadcm3n_n43r_1880_40_008374131_0	77,760	132,063	1.6983
02 Jun 2013 19:51:47	1186953	15802677	hadcm3n_n43r_1880_40_008374131_0	51,840	87,840	1.6944
01 Jun 2013 17:17:26	1186953	15802677	hadcm3n_n43r_1880_40_008374131_0	25,920	43,989	1.6971