Task 15939620

Name	hadcm3n_492g_1940_40_008310274_4
Workunit	8461409
Created	25 Aug 2013, 11:26:00 UTC
Sent	25 Aug 2013, 11:26:15 UTC
Report deadline	24 Nov 2013, 18:53:26 UTC
Received	25 Nov 2013, 18:06:45 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1196151
Run time	11 days 6 hours 8 min 43 sec
CPU time	10 days 17 hours 9 min 37 sec
Validate state	Invalid
Credit	8,087.04
Device peak FLOPS	2.65 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> Das Gerät erkennt den Befehl nicht. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 14:39:44 (2892): No heartbeat from core client for 30 sec - exiting 14:39:45 (2892): No heartbeat from core client for 30 sec - exiting 14:39:46 (2892): No heartbeat from core client for 30 sec - exiting 14:39:47 (2892): No heartbeat from core client for 30 sec - exiting 14:39:48 (2892): No heartbeat from core client for 30 sec - exiting 14:39:49 (2892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:43:59 (1080): No heartbeat from core client for 30 sec - exiting 18:44:00 (1080): No heartbeat from core client for 30 sec - exiting 18:44:01 (1080): No heartbeat from core client for 30 sec - exiting 18:44:02 (1080): No heartbeat from core client for 30 sec - exiting 18:44:03 (1080): No heartbeat from core client for 30 sec - exiting 18:44:04 (1080): No heartbeat from core client for 30 sec - exiting 18:44:05 (1080): No heartbeat from core client for 30 sec - exiting 18:44:06 (1080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:38:07 (2600): No heartbeat from core client for 30 sec - exiting 15:38:08 (2600): No heartbeat from core client for 30 sec - exiting 15:38:09 (2600): No heartbeat from core client for 30 sec - exiting 15:38:10 (2600): No heartbeat from core client for 30 sec - exiting 15:38:11 (2600): No heartbeat from core client for 30 sec - exiting 15:38:12 (2600): No heartbeat from core client for 30 sec - exiting 15:38:13 (2600): No heartbeat from core client for 30 sec - exiting 15:38:14 (2600): No heartbeat from core client for 30 sec - exiting 15:38:15 (2600): No heartbeat from core client for 30 sec - exiting 15:38:16 (2600): No heartbeat from core client for 30 sec - exiting 15:38:17 (2600): No heartbeat from core client for 30 sec - exiting 15:38:18 (2600): No heartbeat from core client for 30 sec - exiting 15:38:19 (2600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:14:14 (5656): No heartbeat from core client for 30 sec - exiting 22:14:15 (5656): No heartbeat from core client for 30 sec - exiting 22:14:16 (5656): No heartbeat from core client for 30 sec - exiting 22:14:17 (5656): No heartbeat from core client for 30 sec - exiting 22:14:18 (5656): No heartbeat from core client for 30 sec - exiting 22:14:19 (5656): No heartbeat from core client for 30 sec - exiting 22:14:20 (5656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:53:25 (4964): No heartbeat from core client for 30 sec - exiting 17:53:26 (4964): No heartbeat from core client for 30 sec - exiting 17:53:27 (4964): No heartbeat from core client for 30 sec - exiting 17:53:28 (4964): No heartbeat from core client for 30 sec - exiting 17:53:29 (4964): No heartbeat from core client for 30 sec - exiting 17:53:30 (4964): No heartbeat from core client for 30 sec - exiting 17:53:31 (4964): No heartbeat from core client for 30 sec - exiting 17:53:32 (4964): No heartbeat from core client for 30 sec - exiting 17:53:33 (4964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 04:56:45 (5764): No heartbeat from core client for 30 sec - exiting 04:56:46 (5764): No heartbeat from core client for 30 sec - exiting 04:56:47 (5764): No heartbeat from core client for 30 sec - exiting 04:56:48 (5764): No heartbeat from core client for 30 sec - exiting 04:56:49 (5764): No heartbeat from core client for 30 sec - exiting 04:56:50 (5764): No heartbeat from core client for 30 sec - exiting 04:56:51 (5764): No heartbeat from core client for 30 sec - exiting 04:56:52 (5764): No heartbeat from core client for 30 sec - exiting 04:56:53 (5764): No heartbeat from core client for 30 sec - exiting 04:56:54 (5764): No heartbeat from core client for 30 sec - exiting 04:56:55 (5764): No heartbeat from core client for 30 sec - exiting 04:56:56 (5764): No heartbeat from core client for 30 sec - exiting 04:56:57 (5764): No heartbeat from core client for 30 sec - exiting 04:56:58 (5764): No heartbeat from core client for 30 sec - exiting 04:56:59 (5764): No heartbeat from core client for 30 sec - exiting 04:57:00 (5764): No heartbeat from core client for 30 sec - exiting 04:57:01 (5764): No heartbeat from core client for 30 sec - exiting 04:57:02 (5764): No heartbeat from core client for 30 sec - exiting 04:57:03 (5764): No heartbeat from core client for 30 sec - exiting 04:57:04 (5764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:17:33 (1304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:53:20 (4988): No heartbeat from core client for 30 sec - exiting 20:53:21 (4988): No heartbeat from core client for 30 sec - exiting 20:53:22 (4988): No heartbeat from core client for 30 sec - exiting 20:53:23 (4988): No heartbeat from core client for 30 sec - exiting 20:53:24 (4988): No heartbeat from core client for 30 sec - exiting 20:53:25 (4988): No heartbeat from core client for 30 sec - exiting 20:53:26 (4988): No heartbeat from core client for 30 sec - exiting 20:53:27 (4988): No heartbeat from core client for 30 sec - exiting 20:53:28 (4988): No heartbeat from core client for 30 sec - exiting 20:53:29 (4988): No heartbeat from core client for 30 sec - exiting 20:53:30 (4988): No heartbeat from core client for 30 sec - exiting 20:53:31 (4988): No heartbeat from core client for 30 sec - exiting 20:53:32 (4988): No heartbeat from core client for 30 sec - exiting 20:53:33 (4988): No heartbeat from core client for 30 sec - exiting 20:53:34 (4988): No heartbeat from core client for 30 sec - exiting 20:53:35 (4988): No heartbeat from core client for 30 sec - exiting 20:53:36 (4988): No heartbeat from core client for 30 sec - exiting 20:53:37 (4988): No heartbeat from core client for 30 sec - exiting 20:53:38 (4988): No heartbeat from core client for 30 sec - exiting 20:53:39 (4988): No heartbeat from core client for 30 sec - exiting 20:53:40 (4988): No heartbeat from core client for 30 sec - exiting 20:53:41 (4988): No heartbeat from core client for 30 sec - exiting 20:53:42 (4988): No heartbeat from core client for 30 sec - exiting 20:53:43 (4988): No heartbeat from core client for 30 sec - exiting 20:53:44 (4988): No heartbeat from core client for 30 sec - exiting 20:53:45 (4988): No heartbeat from core client for 30 sec - exiting 20:53:46 (4988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:58:01 (3224): No heartbeat from core client for 30 sec - exiting 13:58:02 (3224): No heartbeat from core client for 30 sec - exiting 13:58:03 (3224): No heartbeat from core client for 30 sec - exiting 13:58:04 (3224): No heartbeat from core client for 30 sec - exiting 13:58:05 (3224): No heartbeat from core client for 30 sec - exiting 13:58:06 (3224): No heartbeat from core client for 30 sec - exiting 13:58:07 (3224): No heartbeat from core client for 30 sec - exiting 13:58:08 (3224): No heartbeat from core client for 30 sec - exiting 13:58:09 (3224): No heartbeat from core client for 30 sec - exiting 13:58:10 (3224): No heartbeat from core client for 30 sec - exiting 13:58:11 (3224): No heartbeat from core client for 30 sec - exiting 13:58:12 (3224): No heartbeat from core client for 30 sec - exiting 13:58:13 (3224): No heartbeat from core client for 30 sec - exiting 13:58:14 (3224): No heartbeat from core client for 30 sec - exiting 13:58:15 (3224): No heartbeat from core client for 30 sec - exiting 13:58:16 (3224): No heartbeat from core client for 30 sec - exiting 13:58:17 (3224): No heartbeat from core client for 30 sec - exiting 13:58:18 (3224): No heartbeat from core client for 30 sec - exiting 13:58:19 (3224): No heartbeat from core client for 30 sec - exiting 13:58:20 (3224): No heartbeat from core client for 30 sec - exiting 13:58:21 (3224): No heartbeat from core client for 30 sec - exiting 13:58:22 (3224): No heartbeat from core client for 30 sec - exiting 13:58:23 (3224): No heartbeat from core client for 30 sec - exiting 13:58:24 (3224): No heartbeat from core client for 30 sec - exiting 13:58:25 (3224): No heartbeat from core client for 30 sec - exiting 13:58:26 (3224): No heartbeat from core client for 30 sec - exiting 13:58:27 (3224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:58:28 (3224): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:13:15 (5068): No heartbeat from core client for 30 sec - exiting 17:13:16 (5068): No heartbeat from core client for 30 sec - exiting 17:13:17 (5068): No heartbeat from core client for 30 sec - exiting 17:13:18 (5068): No heartbeat from core client for 30 sec - exiting 17:13:19 (5068): No heartbeat from core client for 30 sec - exiting 17:13:20 (5068): No heartbeat from core client for 30 sec - exiting 17:13:21 (5068): No heartbeat from core client for 30 sec - exiting 17:13:22 (5068): No heartbeat from core client for 30 sec - exiting 17:13:23 (5068): No heartbeat from core client for 30 sec - exiting 17:13:24 (5068): No heartbeat from core client for 30 sec - exiting 17:13:25 (5068): No heartbeat from core client for 30 sec - exiting 17:13:26 (5068): No heartbeat from core client for 30 sec - exiting 17:13:27 (5068): No heartbeat from core client for 30 sec - exiting 17:13:28 (5068): No heartbeat from core client for 30 sec - exiting 17:13:29 (5068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:26:39 (2000): No heartbeat from core client for 30 sec - exiting 17:26:40 (2000): No heartbeat from core client for 30 sec - exiting 17:26:41 (2000): No heartbeat from core client for 30 sec - exiting 17:26:42 (2000): No heartbeat from core client for 30 sec - exiting 17:26:43 (2000): No heartbeat from core client for 30 sec - exiting 17:26:44 (2000): No heartbeat from core client for 30 sec - exiting 17:26:45 (2000): No heartbeat from core client for 30 sec - exiting 17:26:46 (2000): No heartbeat from core client for 30 sec - exiting 17:26:47 (2000): No heartbeat from core client for 30 sec - exiting 17:26:48 (2000): No heartbeat from core client for 30 sec - exiting 17:26:49 (2000): No heartbeat from core client for 30 sec - exiting 17:26:50 (2000): No heartbeat from core client for 30 sec - exiting 17:26:51 (2000): No heartbeat from core client for 30 sec - exiting 17:26:52 (2000): No heartbeat from core client for 30 sec - exiting 17:26:53 (2000): No heartbeat from core client for 30 sec - exiting 17:26:54 (2000): No heartbeat from core client for 30 sec - exiting 17:26:55 (2000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:08:46 (6036): No heartbeat from core client for 30 sec - exiting 11:08:47 (6036): No heartbeat from core client for 30 sec - exiting 11:08:48 (6036): No heartbeat from core client for 30 sec - exiting 11:08:49 (6036): No heartbeat from core client for 30 sec - exiting 11:08:50 (6036): No heartbeat from core client for 30 sec - exiting 11:08:51 (6036): No heartbeat from core client for 30 sec - exiting 11:08:52 (6036): No heartbeat from core client for 30 sec - exiting 11:08:53 (6036): No heartbeat from core client for 30 sec - exiting 11:08:54 (6036): No heartbeat from core client for 30 sec - exiting 11:08:55 (6036): No heartbeat from core client for 30 sec - exiting 11:08:56 (6036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:09:41 (4956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:11:50 (6068): No heartbeat from core client for 30 sec - exiting 18:11:51 (6068): No heartbeat from core client for 30 sec - exiting 18:11:52 (6068): No heartbeat from core client for 30 sec - exiting 18:11:53 (6068): No heartbeat from core client for 30 sec - exiting 18:11:54 (6068): No heartbeat from core client for 30 sec - exiting 18:11:55 (6068): No heartbeat from core client for 30 sec - exiting 18:11:56 (6068): No heartbeat from core client for 30 sec - exiting 18:11:57 (6068): No heartbeat from core client for 30 sec - exiting 18:11:58 (6068): No heartbeat from core client for 30 sec - exiting 18:11:59 (6068): No heartbeat from core client for 30 sec - exiting 18:12:00 (6068): No heartbeat from core client for 30 sec - exiting 18:12:01 (6068): No heartbeat from core client for 30 sec - exiting 18:12:02 (6068): No heartbeat from core client for 30 sec - exiting 18:12:03 (6068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1680, iMonCtr=1 Model crash detected, will try to restart... 18:05:59 (5880): No heartbeat from core client for 30 sec - exiting 18:06:00 (5880): No heartbeat from core client for 30 sec - exiting 18:06:01 (5880): No heartbeat from core client for 30 sec - exiting 18:06:02 (5880): No heartbeat from core client for 30 sec - exiting 18:06:03 (5880): No heartbeat from core client for 30 sec - exiting 18:06:04 (5880): No heartbeat from core client for 30 sec - exiting 18:06:05 (5880): No heartbeat from core client for 30 sec - exiting 18:06:06 (5880): No heartbeat from core client for 30 sec - exiting 18:06:07 (5880): No heartbeat from core client for 30 sec - exiting 18:06:08 (5880): No heartbeat from core client for 30 sec - exiting 18:06:09 (5880): No heartbeat from core client for 30 sec - exiting 18:06:10 (5880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:22:15 (940): No heartbeat from core client for 30 sec - exiting 16:22:16 (940): No heartbeat from core client for 30 sec - exiting 16:22:17 (940): No heartbeat from core client for 30 sec - exiting 16:22:18 (940): No heartbeat from core client for 30 sec - exiting 16:22:19 (940): No heartbeat from core client for 30 sec - exiting 16:22:20 (940): No heartbeat from core client for 30 sec - exiting 16:22:21 (940): No heartbeat from core client for 30 sec - exiting 16:22:22 (940): No heartbeat from core client for 30 sec - exiting 16:22:23 (940): No heartbeat from core client for 30 sec - exiting 16:22:24 (940): No heartbeat from core client for 30 sec - exiting 16:22:25 (940): No heartbeat from core client for 30 sec - exiting 16:22:26 (940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:21:50 (5704): No heartbeat from core client for 30 sec - exiting 16:21:51 (5704): No heartbeat from core client for 30 sec - exiting 16:21:52 (5704): No heartbeat from core client for 30 sec - exiting 16:21:53 (5704): No heartbeat from core client for 30 sec - exiting 16:21:54 (5704): No heartbeat from core client for 30 sec - exiting 16:21:55 (5704): No heartbeat from core client for 30 sec - exiting 16:21:56 (5704): No heartbeat from core client for 30 sec - exiting 16:21:57 (5704): No heartbeat from core client for 30 sec - exiting 16:21:58 (5704): No heartbeat from core client for 30 sec - exiting 16:21:59 (5704): No heartbeat from core client for 30 sec - exiting 16:22:00 (5704): No heartbeat from core client for 30 sec - exiting 16:22:01 (5704): No heartbeat from core client for 30 sec - exiting 16:22:02 (5704): No heartbeat from core client for 30 sec - exiting 16:22:03 (5704): No heartbeat from core client for 30 sec - exiting 16:22:04 (5704): No heartbeat from core client for 30 sec - exiting 16:22:05 (5704): No heartbeat from core client for 30 sec - exiting 16:22:06 (5704): No heartbeat from core client for 30 sec - exiting 16:22:07 (5704): No heartbeat from core client for 30 sec - exiting 16:22:08 (5704): No heartbeat from core client for 30 sec - exiting 16:22:09 (5704): No heartbeat from core client for 30 sec - exiting 16:22:10 (5704): No heartbeat from core client for 30 sec - exiting 16:22:11 (5704): No heartbeat from core client for 30 sec - exiting 16:22:12 (5704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:22:13 (5704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 20:19:19 (5928): No heartbeat from core client for 30 sec - exiting 20:19:20 (5928): No heartbeat from core client for 30 sec - exiting 20:19:21 (5928): No heartbeat from core client for 30 sec - exiting 20:19:22 (5928): No heartbeat from core client for 30 sec - exiting 20:19:23 (5928): No heartbeat from core client for 30 sec - exiting 20:19:24 (5928): No heartbeat from core client for 30 sec - exiting 20:19:25 (5928): No heartbeat from core client for 30 sec - exiting 20:19:26 (5928): No heartbeat from core client for 30 sec - exiting 20:19:27 (5928): No heartbeat from core client for 30 sec - exiting 20:19:28 (5928): No heartbeat from core client for 30 sec - exiting 20:19:29 (5928): No heartbeat from core client for 30 sec - exiting 20:19:30 (5928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:56:45 (4832): No heartbeat from core client for 30 sec - exiting 13:56:46 (4832): No heartbeat from core client for 30 sec - exiting 13:56:47 (4832): No heartbeat from core client for 30 sec - exiting 13:56:48 (4832): No heartbeat from core client for 30 sec - exiting 13:56:49 (4832): No heartbeat from core client for 30 sec - exiting 13:56:50 (4832): No heartbeat from core client for 30 sec - exiting 13:56:51 (4832): No heartbeat from core client for 30 sec - exiting 13:56:52 (4832): No heartbeat from core client for 30 sec - exiting 13:56:53 (4832): No heartbeat from core client for 30 sec - exiting 13:56:54 (4832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:19:03 (5288): No heartbeat from core client for 30 sec - exiting 22:19:04 (5288): No heartbeat from core client for 30 sec - exiting 22:19:05 (5288): No heartbeat from core client for 30 sec - exiting 22:19:06 (5288): No heartbeat from core client for 30 sec - exiting 22:19:07 (5288): No heartbeat from core client for 30 sec - exiting 22:19:08 (5288): No heartbeat from core client for 30 sec - exiting 22:19:09 (5288): No heartbeat from core client for 30 sec - exiting 22:19:10 (5288): No heartbeat from core client for 30 sec - exiting 22:19:11 (5288): No heartbeat from core client for 30 sec - exiting 22:19:12 (5288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:19:13 (5288): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 21:13:08 (5896): No heartbeat from core client for 30 sec - exiting 21:13:09 (5896): No heartbeat from core client for 30 sec - exiting 21:13:10 (5896): No heartbeat from core client for 30 sec - exiting 21:13:11 (5896): No heartbeat from core client for 30 sec - exiting 21:13:12 (5896): No heartbeat from core client for 30 sec - exiting 21:13:13 (5896): No heartbeat from core client for 30 sec - exiting 21:13:14 (5896): No heartbeat from core client for 30 sec - exiting 21:13:15 (5896): No heartbeat from core client for 30 sec - exiting 21:13:16 (5896): No heartbeat from core client for 30 sec - exiting 21:13:17 (5896): No heartbeat from core client for 30 sec - exiting 21:13:18 (5896): No heartbeat from core client for 30 sec - exiting 21:13:19 (5896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:25:14 (5868): No heartbeat from core client for 30 sec - exiting 16:25:15 (5868): No heartbeat from core client for 30 sec - exiting 16:25:16 (5868): No heartbeat from core client for 30 sec - exiting 16:25:17 (5868): No heartbeat from core client for 30 sec - exiting 16:25:18 (5868): No heartbeat from core client for 30 sec - exiting 16:25:19 (5868): No heartbeat from core client for 30 sec - exiting 16:25:20 (5868): No heartbeat from core client for 30 sec - exiting 16:25:21 (5868): No heartbeat from core client for 30 sec - exiting 16:25:22 (5868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2816, iMonCtr=1 Model crash detected, will try to restart... 12:18:21 (2768): No heartbeat from core client for 30 sec - exiting 12:18:22 (2768): No heartbeat from core client for 30 sec - exiting 12:18:23 (2768): No heartbeat from core client for 30 sec - exiting 12:18:24 (2768): No heartbeat from core client for 30 sec - exiting 12:18:25 (2768): No heartbeat from core client for 30 sec - exiting 12:18:26 (2768): No heartbeat from core client for 30 sec - exiting 12:18:27 (2768): No heartbeat from core client for 30 sec - exiting 12:18:28 (2768): No heartbeat from core client for 30 sec - exiting 12:18:29 (2768): No heartbeat from core client for 30 sec - exiting 12:18:30 (2768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart..BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/492gko.pjg4c10 Error converting file to netcdf: dataout/492gko.pig4c10 Error converting file to netcdf: dataout/492gko.pfg4c10 Error converting file to netcdf: dataout/492gka.phg4c10 Error converting file to netcdf: dataout/492gka.pgg4c10 Error converting file to netcdf: dataout/492gka.peg4c10 Error converting file to netcdf: dataout/492gka.pdg4c10 CPDN Monitor - Quit request from BOINC... 18:00:28 (3292): No heartbeat from core client for 30 sec - exiting 18:00:29 (3292): No heartbeat from core client for 30 sec - exiting 18:00:30 (3292): No heartbeat from core client for 30 sec - exiting 18:00:31 (3292): No heartbeat from core client for 30 sec - exiting 18:00:32 (3292): No heartbeat from core client for 30 sec - exiting 18:00:33 (3292): No heartbeat from core client for 30 sec - exiting 18:00:34 (3292): No heartbeat from core client for 30 sec - exiting 18:00:35 (3292): No heartbeat from core client for 30 sec - exiting 18:00:36 (3292): No heartbeat from core client for 30 sec - exiting 18:00:37 (3292): No heartbeat from core client for 30 sec - exiting 18:00:38 (3292): No heartbeat from core client for 30 sec - exiting 18:00:39 (3292): No heartbeat from core client for 30 sec - exiting 18:00:40 (3292): No heartbeat from core client for 30 sec - exiting 18:00:41 (3292): No heartbeat from core client for 30 sec - exiting 18:00:42 (3292): No heartbeat from core client for 30 sec - exiting 18:00:43 (3292): No heartbeat from core client for 30 sec - exiting 18:00:44 (3292): No heartbeat from core client for 30 sec - exiting 18:00:45 (3292): No heartbeat from core client for 30 sec - exiting 18:00:46 (3292): No heartbeat from core client for 30 sec - exiting 18:00:47 (3292): No heartbeat from core client for 30 sec - exiting 18:00:48 (3292): No heartbeat from core client for 30 sec - exiting 18:00:49 (3292): No heartbeat from core client for 30 sec - exiting 18:00:50 (3292): No heartbeat from core client for 30 sec - exiting 18:00:51 (3292): No heartbeat from core client for 30 sec - exiting 18:00:52 (3292): No heartbeat from core client for 30 sec - exiting 18:00:53 (3292): No heartbeat from core client for 30 sec - exiting 18:00:54 (3292): No heartbeat from core client for 30 sec - exiting 18:00:55 (3292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:04:11 (2704): No heartbeat from core client for 30 sec - exiting 18:04:12 (2704): No heartbeat from core client for 30 sec - exiting 18:04:13 (2704): No heartbeat from core client for 30 sec - exiting 18:04:14 (2704): No heartbeat from core client for 30 sec - exiting 18:04:15 (2704): No heartbeat from core client for 30 sec - exiting 18:04:16 (2704): No heartbeat from core client for 30 sec - exiting 18:04:17 (2704): No heartbeat from core client for 30 sec - exiting 18:04:18 (2704): No heartbeat from core client for 30 sec - exiting 18:04:19 (2704): No heartbeat from core client for 30 sec - exiting 18:04:20 (2704): No heartbeat from core client for 30 sec - exiting 18:04:21 (2704): No heartbeat from core client for 30 sec - exiting 18:04:22 (2704): No heartbeat from core client for 30 sec - exiting 18:04:23 (2704): No heartbeat from core client for 30 sec - exiting 18:04:24 (2704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:15:34 (5584): No heartbeat from core client for 30 sec - exiting 18:15:36 (5584): No heartbeat from core client for 30 sec - exiting 18:15:37 (5584): No heartbeat from core client for 30 sec - exiting 18:15:38 (5584): No heartbeat from core client for 30 sec - exiting 18:15:39 (5584): No heartbeat from core client for 30 sec - exiting 18:15:40 (5584): No heartbeat from core client for 30 sec - exiting 18:15:41 (5584): No heartbeat from core client for 30 sec - exiting 18:15:42 (5584): No heartbeat from core client for 30 sec - exiting 18:15:43 (5584): No heartbeat from core client for 30 sec - exiting 18:15:44 (5584): No heartbeat from core client for 30 sec - exiting 18:15:45 (5584): No heartbeat from core client for 30 sec - exiting 18:15:46 (5584): No heartbeat from core client for 30 sec - exiting 18:15:47 (5584): No heartbeat from core client for 30 sec - exiting 18:15:48 (5584): No heartbeat from core client for 30 sec - exiting 18:15:49 (5584): No heartbeat from core client for 30 sec - exiting 18:15:50 (5584): No heartbeat from core client for 30 sec - exiting 18:15:51 (5584): No heartbeat from core client for 30 sec - exiting 18:15:52 (5584): No heartbeat from core client for 30 sec - exiting 18:15:53 (5584): No heartbeat from core client for 30 sec - exiting 18:15:54 (5584): No heartbeat from core client for 30 sec - exiting 18:15:55 (5584): No heartbeat from core client for 30 sec - exiting 18:15:56 (5584): No heartbeat from core client for 30 sec - exiting 18:15:57 (5584): No heartbeat from core client for 30 sec - exiting 18:15:58 (5584): No heartbeat from core client for 30 sec - exiting 18:15:59 (5584): No heartbeat from core client for 30 sec - exiting 18:16:00 (5584): No heartbeat from core client for 30 sec - exiting 18:16:01 (5584): No heartbeat from core client for 30 sec - exiting 18:16:02 (5584): No heartbeat from core client for 30 sec - exiting 18:16:03 (5584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Nov 2013 20:35:11	1196151	15939620	hadcm3n_492g_1940_40_008310274_4	673,920	921,008	1.3666
19 Nov 2013 16:20:39	1196151	15939620	hadcm3n_492g_1940_40_008310274_4	648,000	885,380	1.3663
10 Nov 2013 21:08:44	1196151	15939620	hadcm3n_492g_1940_40_008310274_4	622,080	850,447	1.3671
05 Nov 2013 15:40:16	1196151	15939620	hadcm3n_492g_1940_40_008310274_4	596,160	814,821	1.3668
03 Nov 2013 17:07:16	1196151	15939620	hadcm3n_492g_1940_40_008310274_4	570,240	778,523	1.3653
30 Oct 2013 17:11:31	1196151	15939620	hadcm3n_492g_1940_40_008310274_4	544,320	742,173	1.3635
27 Oct 2013 17:20:58	1196151	15939620	hadcm3n_492g_1940_40_008310274_4	518,400	706,329	1.3625
26 Oct 2013 10:48:01	1196151	15939620	hadcm3n_492g_1940_40_008310274_4	492,480	670,314	1.3611
26 Oct 2013 00:53:31	1196151	15939620	hadcm3n_492g_1940_40_008310274_4	466,560	634,909	1.3608
24 Oct 2013 14:55:28	1196151	15939620	hadcm3n_492g_1940_40_008310274_4	440,640	598,964	1.3593
22 Oct 2013 11:28:51	1196151	15939620	hadcm3n_492g_1940_40_008310274_4	414,720	563,381	1.3585
20 Oct 2013 15:40:28	1196151	15939620	hadcm3n_492g_1940_40_008310274_4	388,800	527,767	1.3574
17 Oct 2013 21:35:32	1196151	15939620	hadcm3n_492g_1940_40_008310274_4	362,880	491,495	1.3544
15 Oct 2013 17:28:39	1196151	15939620	hadcm3n_492g_1940_40_008310274_4	336,960	456,907	1.3560
13 Oct 2013 17:02:56	1196151	15939620	hadcm3n_492g_1940_40_008310274_4	311,040	421,404	1.3548
28 Sep 2013 15:20:37	1196151	15939620	hadcm3n_492g_1940_40_008310274_4	285,120	385,274	1.3513
23 Sep 2013 15:59:48	1196151	15939620	hadcm3n_492g_1940_40_008310274_4	259,200	348,913	1.3461
17 Sep 2013 11:01:47	1196151	15939620	hadcm3n_492g_1940_40_008310274_4	233,280	312,598	1.3400
15 Sep 2013 19:52:17	1196151	15939620	hadcm3n_492g_1940_40_008310274_4	207,360	276,827	1.3350
12 Sep 2013 13:41:10	1196151	15939620	hadcm3n_492g_1940_40_008310274_4	181,440	241,291	1.3299