Task 15673522

Name	hadcm3n_z8wj_1920_40_008320004_2
Workunit	8471139
Created	20 Mar 2013, 1:47:27 UTC
Sent	20 Mar 2013, 1:47:30 UTC
Report deadline	19 Jun 2013, 9:14:41 UTC
Received	17 May 2013, 3:59:29 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1275312
Run time	4 days 19 hours 55 min 58 sec
CPU time	4 days 1 hours 14 min 58 sec
Validate state	Invalid
Credit	2,177.28
Device peak FLOPS	2.32 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> N Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:21:37 (2684): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:33:02 (4956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:33:03 (4956): No heartbeat from core client for 30 sec - exiting 01:33:10 (4956): No heartbeat from core client for 30 sec - exiting 01:38:00 (4304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:38:03 (4304): No heartbeat from core client for 30 sec - exiting 01:48:01 (2568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:48:02 (2568): No heartbeat from core client for 30 sec - exiting 01:49:57 (3140): No heartbeat from core client for 30 sec - exiting 01:49:58 (3140): No heartbeat from core client for 30 sec - exiting 01:50:00 (3140): No heartbeat from core client for 30 sec - exiting 01:50:03 (3140): No heartbeat from core client for 30 sec - exiting 01:50:05 (3140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:50:07 (3140): No heartbeat from core client for 30 sec - exiting 01:52:12 (4932): No heartbeat from core client for 30 sec - exiting 01:52:14 (4932): No heartbeat from core client for 30 sec - exiting 01:52:17 (4932): No heartbeat from core client for 30 sec - exiting 01:52:19 (4932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:52:22 (4024): Can't acquire lockfile (32) - waiting 35s 01:58:02 (4024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:58:03 (4024): No heartbeat from core client for 30 sec - exiting 01:58:05 (4024): No heartbeat from core client for 30 sec - exiting 01:58:08 (4024): No heartbeat from core client for 30 sec - exiting 01:58:11 (4024): No heartbeat from core client for 30 sec - exiting 02:02:11 (6096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:02:12 (6096): No heartbeat from core client for 30 sec - exiting 02:02:14 (6096): No heartbeat from core client for 30 sec - exiting 02:02:17 (6096): No heartbeat from core client for 30 sec - exiting 02:03:46 (4116): No heartbeat from core client for 30 sec - exiting 02:03:49 (4116): No heartbeat from core client for 30 sec - exiting 02:03:51 (4116): No heartbeat from core client for 30 sec - exiting 02:03:53 (4116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:08:29 (2240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:08:32 (2240): No heartbeat from core client for 30 sec - exiting 02:10:13 (4840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:10:15 (4840): No heartbeat from core client for 30 sec - exiting 02:10:18 (4840): No heartbeat from core client for 30 sec - exiting 02:10:22 (4840): No heartbeat from core client for 30 sec - exiting 02:10:25 (4840): No heartbeat from core client for 30 sec - exiting 02:13:31 (4000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:13:33 (4000): No heartbeat from core client for 30 sec - exiting 02:18:31 (1876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:18:33 (1876): No heartbeat from core client for 30 sec - exiting 02:18:36 (1876): No heartbeat from core client for 30 sec - exiting 02:18:38 (1876): No heartbeat from core client for 30 sec - exiting 02:18:41 (1876): No heartbeat from core client for 30 sec - exiting 02:18:43 (1876): No heartbeat from core client for 30 sec - exiting 02:18:46 (1876): No heartbeat from core client for 30 sec - exiting 02:20:58 (5524): No heartbeat from core client for 30 sec - exiting 02:21:01 (5524): No heartbeat from core client for 30 sec - exiting 02:21:03 (5524): No heartbeat from core client for 30 sec - exiting 02:21:05 (5524): No heartbeat from core client for 30 sec - exiting 02:21:08 (5524): No heartbeat from core client for 30 sec - exiting 02:21:11 (5524): No heartbeat from core client for 30 sec - exiting 02:21:13 (5524): No heartbeat from core client for 30 sec - exiting 02:21:16 (5524): No heartbeat from core client for 30 sec - exiting 02:21:19 (5524): No heartbeat from core client for 30 sec - exiting 02:21:22 (5524): No heartbeat from core client for 30 sec - exiting 02:21:24 (5524): No heartbeat from core client for 30 sec - exiting 02:21:27 (5524): No heartbeat from core client for 30 sec - exiting 02:21:30 (5524): No heartbeat from core client for 30 sec - exiting 02:21:33 (5524): No heartbeat from core client for 30 sec - exiting 02:21:36 (5524): No heartbeat from core client for 30 sec - exiting 02:21:38 (5524): No heartbeat from core client for 30 sec - exiting 02:21:41 (5524): No heartbeat from core client for 30 sec - exiting 02:21:44 (5524): No heartbeat from core client for 30 sec - exiting 02:21:47 (5524): No heartbeat from core client for 30 sec - exiting 02:21:50 (5524): No heartbeat from core client for 30 sec - exiting 02:21:52 (5524): No heartbeat from core client for 30 sec - exiting 02:21:55 (5524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:21:57 (5524): No heartbeat from core client for 30 sec - exiting 02:25:12 (5516): No heartbeat from core client for 30 sec - exiting 02:25:14 (5516): No heartbeat from core client for 30 sec - exiting 02:25:16 (5516): No heartbeat from core client for 30 sec - exiting 02:25:18 (5516): No heartbeat from core client for 30 sec - exiting 02:25:20 (5516): No heartbeat from core client for 30 sec - exiting 02:25:22 (5516): No heartbeat from core client for 30 sec - exiting 02:25:24 (5516): No heartbeat from core client for 30 sec - exiting 02:25:26 (5516): No heartbeat from core client for 30 sec - exiting 02:25:29 (5516): No heartbeat from core client for 30 sec - exiting 02:25:31 (5516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:25:33 (5516): No heartbeat from core client for 30 sec - exiting 02:25:35 (5516): No heartbeat from core client for 30 sec - exiting 02:25:37 (5516): No heartbeat from core client for 30 sec - exiting 02:25:39 (5516): No heartbeat from core client for 30 sec - exiting 02:25:41 (5516): No heartbeat from core client for 30 sec - exiting 02:29:18 (3624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:29:19 (3624): No heartbeat from core client for 30 sec - exiting 02:29:21 (3624): No heartbeat from core client for 30 sec - exiting 02:29:24 (3624): No heartbeat from core client for 30 sec - exiting 02:29:26 (3624): No heartbeat from core client for 30 sec - exiting 02:29:29 (3624): No heartbeat from core client for 30 sec - exiting 02:32:08 (2044): No heartbeat from core client for 30 sec - exiting 02:32:11 (2044): No heartbeat from core client for 30 sec - exiting 02:32:13 (2044): No heartbeat from core client for 30 sec - exiting 02:32:15 (2044): No heartbeat from core client for 30 sec - exiting 02:32:18 (2044): No heartbeat from core client for 30 sec - exiting 02:32:20 (2044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:32:56 (2044): No heartbeat from core client for 30 sec - exiting 02:32:58 (2044): No heartbeat from core client for 30 sec - exiting 02:33:01 (2044): No heartbeat from core client for 30 sec - exiting 02:35:02 (3308): No heartbeat from core client for 30 sec - exiting 02:35:05 (3308): No heartbeat from core client for 30 sec - exiting 02:35:07 (3308): No heartbeat from core client for 30 sec - exiting 02:35:10 (3308): No heartbeat from core client for 30 sec - exiting 02:35:12 (3308): No heartbeat from core client for 30 sec - exiting 02:35:14 (3308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:39:58 (1004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:40:00 (1004): No heartbeat from core client for 30 sec - exiting 02:40:02 (1004): No heartbeat from core client for 30 sec - exiting 02:42:01 (3920): No heartbeat from core client for 30 sec - exiting 02:42:02 (3920): No heartbeat from core client for 30 sec - exiting 02:42:04 (3920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:42:07 (3920): No heartbeat from core client for 30 sec - exiting 02:42:09 (3920): No heartbeat from core client for 30 sec - exiting 02:42:11 (3920): No heartbeat from core client for 30 sec - exiting 02:42:14 (3920): No heartbeat from core client for 30 sec - exiting 02:42:16 (3920): No heartbeat from core client for 30 sec - exiting 02:55:18 (5708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:55:21 (5708): No heartbeat from core client for 30 sec - exiting 02:55:23 (5708): No heartbeat from core client for 30 sec - exiting 02:59:53 (5500): No heartbeat from core client for 30 sec - exiting 02:59:56 (5500): No heartbeat from core client for 30 sec - exiting 02:59:58 (5500): No heartbeat from core client for 30 sec - exiting 03:00:01 (5500): No heartbeat from core client for 30 sec - exiting 03:00:03 (5500): No heartbeat from core client for 30 sec - exiting 03:00:05 (5500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:10:15 (5016): No heartbeat from core client for 30 sec - exiting 19:10:17 (5016): No heartbeat from core client for 30 sec - exiting 19:10:18 (5016): No heartbeat from core client for 30 sec - exiting 19:10:19 (5016): No heartbeat from core client for 30 sec - exiting 19:10:20 (5016): No heartbeat from core client for 30 sec - exiting 19:10:21 (5016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5860, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:13:54 (1740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:13:55 (1740): No heartbeat from core client for 30 sec - exiting 16:13:58 (1740): No heartbeat from core client for 30 sec - exiting 16:14:01 (1740): No heartbeat from core client for 30 sec - exiting 16:18:52 (5368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:18:53 (5368): No heartbeat from core client for 30 sec - exiting 16:18:56 (5368): No heartbeat from core client for 30 sec - exiting 16:18:58 (5368): No heartbeat from core client for 30 sec - exiting 16:19:01 (5368): No heartbeat from core client for 30 sec - exiting 16:20:25 (5296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:20:29 (5296): No heartbeat from core client for 30 sec - exiting 16:20:31 (5296): No heartbeat from core client for 30 sec - exiting 16:20:32 (5296): No heartbeat from core client for 30 sec - exiting 16:22:28 (3996): No heartbeat from core client for 30 sec - exiting 16:22:30 (3996): No heartbeat from core client for 30 sec - exiting 16:22:33 (3996): No heartbeat from core client for 30 sec - exiting 16:22:36 (3996): No heartbeat from core client for 30 sec - exiting 16:22:38 (3996): No heartbeat from core client for 30 sec - exiting 16:22:41 (3996): No heartbeat from core client for 30 sec - exiting 16:22:44 (3996): No heartbeat from core client for 30 sec - exiting 16:22:47 (3996): No heartbeat from core client for 30 sec - exiting 16:22:49 (3996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:28:53 (5024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:28:56 (5024): No heartbeat from core client for 30 sec - exiting 16:58:55 (5524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:58:57 (5524): No heartbeat from core client for 30 sec - exiting 17:01:24 (4484): No heartbeat from core client for 30 sec - exiting 17:01:25 (4484): No heartbeat from core client for 30 sec - exiting 17:01:28 (4484): No heartbeat from core client for 30 sec - exiting 17:01:30 (4484): No heartbeat from core client for 30 sec - exiting 17:01:32 (4484): No heartbeat from core client for 30 sec - exiting 17:01:34 (4484): No heartbeat from core client for 30 sec - exiting 17:01:36 (4484): No heartbeat from core client for 30 sec - exiting 17:01:39 (4484): No heartbeat from core client for 30 sec - exiting 17:01:41 (4484): No heartbeat from core client for 30 sec - exiting 17:01:43 (4484): No heartbeat from core client for 30 sec - exiting 17:01:46 (4484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:01:48 (4484): No heartbeat from core client for 30 sec - exiting 17:01:50 (4484): No heartbeat from core client for 30 sec - exiting 17:01:52 (4484): No heartbeat from core client for 30 sec - exiting 17:01:53 (4484): No heartbeat from core client for 30 sec - exiting 17:01:55 (4484): No heartbeat from core client for 30 sec - exiting 11:37:01 (2148): No heartbeat from core client for 30 sec - exiting 11:37:06 (2148): No heartbeat from core client for 30 sec - exiting 11:37:07 (2148): No heartbeat from core client for 30 sec - exiting 11:37:09 (2148): No heartbeat from core client for 30 sec - exiting 11:37:10 (2148): No heartbeat from core client for 30 sec - exiting 11:37:11 (2148): No heartbeat from core client for 30 sec - exiting 11:37:12 (2148): No heartbeat from core client for 30 sec - exiting 11:37:13 (2148): No heartbeat from core client for 30 sec - exiting 11:37:14 (2148): No heartbeat from core client for 30 sec - exiting 11:37:15 (2148): No heartbeat from core client for 30 sec - exiting 11:37:16 (2148): No heartbeat from core client for 30 sec - exiting 11:37:17 (2148): No heartbeat from core client for 30 sec - exiting 11:37:18 (2148): No heartbeat from core client for 30 sec - exiting 11:37:19 (2148): No heartbeat from core client for 30 sec - exiting 11:37:21 (2148): No heartbeat from core client for 30 sec - exiting 11:37:22 (2148): No heartbeat from core client for 30 sec - exiting 11:37:23 (2148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:37:02 (3616): No heartbeat from core client for 30 sec - exiting 16:37:03 (3616): No heartbeat from core client for 30 sec - exiting 16:37:04 (3616): No heartbeat from core client for 30 sec - exiting 16:37:05 (3616): No heartbeat from core client for 30 sec - exiting 16:37:06 (3616): No heartbeat from core client for 30 sec - exiting 16:37:07 (3616): No heartbeat from core client for 30 sec - exiting 16:37:08 (3616): No heartbeat from core client for 30 sec - exiting 16:37:09 (3616): No heartbeat from core client for 30 sec - exiting 16:37:10 (3616): No heartbeat from core client for 30 sec - exiting 16:37:12 (3616): No heartbeat from core client for 30 sec - exiting 16:37:13 (3616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:32:40 (5212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:11:40 (2328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:21:02 (4644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:21:58 (4996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:22:53 (3500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:41:16 (2200): No heartbeat from core client for 30 sec - exiting 09:41:17 (2200): No heartbeat from core client for 30 sec - exiting 09:41:18 (2200): No heartbeat from core client for 30 sec - exiting 09:41:19 (2200): No heartbeat from core client for 30 sec - exiting 09:41:20 (2200): No heartbeat from core client for 30 sec - exiting 09:41:21 (2200): No heartbeat from core client for 30 sec - exiting 09:41:23 (2200): No heartbeat from core client for 30 sec - exiting 09:41:24 (2200): No heartbeat from core client for 30 sec - exiting 09:41:25 (2200): No heartbeat from core client for 30 sec - exiting 09:41:26 (2200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:39:59 (2588): No heartbeat from core client for 30 sec - exiting 21:40:00 (2588): No heartbeat from core client for 30 sec - exiting 21:40:02 (2588): No heartbeat from core client for 30 sec - exiting 21:40:03 (2588): No heartbeat from core client for 30 sec - exiting 21:40:04 (2588): No heartbeat from core client for 30 sec - exiting 21:40:05 (2588): No heartbeat from core client for 30 sec - exiting 21:40:06 (2588): No heartbeat from core client for 30 sec - exiting 21:40:07 (2588): No heartbeat from core client for 30 sec - exiting 21:40:08 (2588): No heartbeat from core client for 30 sec - exiting 21:40:09 (2588): No heartbeat from core client for 30 sec - exiting 21:40:10 (2588): No heartbeat from core client for 30 sec - exiting 21:40:11 (2588): No heartbeat from core client for 30 sec - exiting 21:40:12 (2588): No heartbeat from core client for 30 sec - exiting 21:40:14 (2588): No heartbeat from core client for 30 sec - exiting 21:40:15 (2588): No heartbeat from core client for 30 sec - exiting 21:40:16 (2588): No heartbeat from core client for 30 sec - exiting 21:40:17 (2588): No heartbeat from core client for 30 sec - exiting 21:40:18 (2588): No heartbeat from core client for 30 sec - exiting 21:40:19 (2588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:45:33 (5756): No heartbeat from core client for 30 sec - exiting 14:45:34 (5756): No heartbeat from core client for 30 sec - exiting 14:45:35 (5756): No heartbeat from core client for 30 sec - exiting 14:45:36 (5756): No heartbeat from core client for 30 sec - exiting 14:45:37 (5756): No heartbeat from core client for 30 sec - exiting 14:45:38 (5756): No heartbeat from core client for 30 sec - exiting 14:45:39 (5756): No heartbeat from core client for 30 sec - exiting 14:45:40 (5756): No heartbeat from core client for 30 sec - exiting 14:45:41 (5756): No heartbeat from core client for 30 sec - exiting 14:45:43 (5756): No heartbeat from core client for 30 sec - exiting 14:45:44 (5756): No heartbeat from core client for 30 sec - exiting 14:45:45 (5756): No heartbeat from core client for 30 sec - exiting 14:45:46 (5756): No heartbeat from core client for 30 sec - exiting 14:45:47 (5756): No heartbeat from core client for 30 sec - exiting 14:45:48 (5756): No heartbeat from core client for 30 sec - exiting 14:45:49 (5756): No heartbeat from core client for 30 sec - exiting 14:45:50 (5756): No heartbeat from core client for 30 sec - exiting 14:45:51 (5756): No heartbeat from core client for 30 sec - exiting 14:45:52 (5756): No heartbeat from core client for 30 sec - exiting 14:45:53 (5756): No heartbeat from core client for 30 sec - exiting 14:45:55 (5756): No heartbeat from core client for 30 sec - exiting 14:45:56 (5756): No heartbeat from core client for 30 sec - exiting 14:45:57 (5756): No heartbeat from core client for 30 sec - exiting 14:45:58 (5756): No heartbeat from core client for 30 sec - exiting 14:45:59 (5756): No heartbeat from core client for 30 sec - exiting 14:46:00 (5756): No heartbeat from core client for 30 sec - exiting 14:46:01 (5756): No heartbeat from core client for 30 sec - exiting 14:46:02 (5756): No heartbeat from core client for 30 sec - exiting 14:46:03 (5756): No heartbeat from core client for 30 sec - exiting 14:46:04 (5756): No heartbeat from core client for 30 sec - exiting 14:46:05 (5756): No heartbeat from core client for 30 sec - exiting 14:46:07 (5756): No heartbeat from core client for 30 sec - exiting 14:46:08 (5756): No heartbeat from core client for 30 sec - exiting 14:46:09 (5756): No heartbeat from core client for 30 sec - exiting 14:46:10 (5756): No heartbeat from core client for 30 sec - exiting 14:46:11 (5756): No heartbeat from core client for 30 sec - exiting 14:46:12 (5756): No heartbeat from core client for 30 sec - exiting 14:46:13 (5756): No heartbeat from core client for 30 sec - exiting 14:46:14 (5756): No heartbeat from core client for 30 sec - exiting 14:46:15 (5756): No heartbeat from core client for 30 sec - exiting 14:46:16 (5756): No heartbeat from core client for 30 sec - exiting 14:46:18 (5756): No heartbeat from core client for 30 sec - exiting 14:46:19 (5756): No heartbeat from core client for 30 sec - exiting 14:46:20 (5756): No heartbeat from core client for 30 sec - exiting 14:46:21 (5756): No heartbeat from core client for 30 sec - exiting 14:46:22 (5756): No heartbeat from core client for 30 sec - exiting 14:46:23 (5756): No heartbeat from core client for 30 sec - exiting 14:46:24 (5756): No heartbeat from core client for 30 sec - exiting 14:46:25 (5756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3476, iMonCtr=1 Model crash detected, will try to restart... 22:11:50 (3684): No heartbeat from core client for 30 sec - exiting 22:11:51 (3684): No heartbeat from core client for 30 sec - exiting 22:11:52 (3684): No heartbeat from core client for 30 sec - exiting 22:11:53 (3684): No heartbeat from core client for 30 sec - exiting 22:11:54 (3684): No heartbeat from core client for 30 sec - exiting 22:11:55 (3684): No heartbeat from core client for 30 sec - exiting 22:11:56 (3684): No heartbeat from core client for 30 sec - exiting 22:11:57 (3684): No heartbeat from core client for 30 sec - exiting 22:11:58 (3684): No heartbeat from core client for 30 sec - exiting 22:12:00 (3684): No heartbeat from core client for 30 sec - exiting 22:12:01 (3684): No heartbeat from core client for 30 sec - exiting 22:12:02 (3684): No heartbeat from core client for 30 sec - exiting 22:12:03 (3684): No heartbeat from core client for 30 sec - exiting 22:12:04 (3684): No heartbeat from core client for 30 sec - exiting 22:12:05 (3684): No heartbeat from core client for 30 sec - exiting 22:12:06 (3684): No heartbeat from core client for 30 sec - exiting 22:12:07 (3684): No heartbeat from core client for 30 sec - exiting 22:12:08 (3684): No heartbeat from core client for 30 sec - exiting 22:12:09 (3684): No heartbeat from core client for 30 sec - exiting 22:12:10 (3684): No heartbeat from core client for 30 sec - exiting 22:12:12 (3684): No heartbeat from core client for 30 sec - exiting 22:12:13 (3684): No heartbeat from core client for 30 sec - exiting 22:12:14 (3684): No heartbeat from core client for 30 sec - exiting 22:12:15 (3684): No heartbeat from core client for 30 sec - exiting 22:12:16 (3684): No heartbeat from core client for 30 sec - exiting 22:12:17 (3684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:45:21 (4832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6608, iMonCtr=1 Model crash detected, will try to restart... 08:01:27 (3724): No heartbeat from core client for 30 sec - exiting 08:01:28 (3724): No heartbeat from core client for 30 sec - exiting 08:01:29 (3724): No heartbeat from core client for 30 sec - exiting 08:01:30 (3724): No heartbeat from core client for 30 sec - exiting 08:01:31 (3724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:01:32 (4908): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5592, iMonCtr=1 Model crash detected, will try to restart... 18:49:15 (3760): No heartbeat from core client for 30 sec - exiting 18:49:16 (3760): No heartbeat from core client for 30 sec - exiting 18:49:17 (3760): No heartbeat from core client for 30 sec - exiting 18:49:18 (3760): No heartbeat from core client for 30 sec - exiting 18:49:19 (3760): No heartbeat from core client for 30 sec - exiting 18:49:20 (3760): No heartbeat from core client for 30 sec - exiting 18:49:21 (3760): No heartbeat from core client for 30 sec - exiting 18:49:23 (3760): No heartbeat from core client for 30 sec - exiting 18:49:24 (3760): No heartbeat from core client for 30 sec - exiting 18:49:25 (3760): No heartbeat from core client for 30 sec - exiting 18:49:26 (3760): No heartbeat from core client for 30 sec - exiting 18:49:27 (3760): No heartbeat from core client for 30 sec - exiting 18:49:28 (3760): No heartbeat from core client for 30 sec - exiting 18:49:29 (3760): No heartbeat from core client for 30 sec - exiting 18:49:30 (3760): No heartbeat from core client for 30 sec - exiting 18:49:31 (3760): No heartbeat from core client for 30 sec - exiting 18:49:32 (3760): No heartbeat from core client for 30 sec - exiting 18:49:33 (3760): No heartbeat from core client for 30 sec - exiting 18:49:35 (3760): No heartbeat from core client for 30 sec - exiting 18:49:36 (3760): No heartbeat from core client for 30 sec - exiting 18:49:37 (3760): No heartbeat from core client for 30 sec - exiting 18:49:38 (3760): No heartbeat from core client for 30 sec - exiting 18:49:39 (3760): No heartbeat from core client for 30 sec - exiting 18:49:40 (3760): No heartbeat from core client for 30 sec - exiting 18:49:41 (3760): No heartbeat from core client for 30 sec - exiting 18:49:42 (3760): No heartbeat from core client for 30 sec - exiting 18:49:43 (3760): No heartbeat from core client for 30 sec - exiting 18:49:44 (3760): No heartbeat from core client for 30 sec - exiting 18:49:45 (3760): No heartbeat from core client for 30 sec - exiting 18:49:47 (3760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3772, iMonCtr=1 Model crash detected, will try to restart... 10:18:45 (3872): No heartbeat from core client for 30 sec - exiting 10:18:46 (3872): No heartbeat from core client for 30 sec - exiting 10:18:47 (3872): No heartbeat from core client for 30 sec - exiting 10:18:48 (3872): No heartbeat from core client for 30 sec - exiting 10:18:49 (3872): No heartbeat from core client for 30 sec - exiting 10:18:50 (3872): No heartbeat from core client for 30 sec - exiting 10:18:51 (3872): No heartbeat from core client for 30 sec - exiting 10:18:52 (3872): No heartbeat from core client for 30 sec - exiting 10:18:53 (3872): No heartbeat from core client for 30 sec - exiting 10:18:55 (3872): No heartbeat from core client for 30 sec - exiting 10:18:56 (3872): No heartbeat from core client for 30 sec - exiting 10:18:57 (3872): No heartbeat from core client for 30 sec - exiting 10:18:58 (3872): No heartbeat from core client for 30 sec - exiting 10:18:59 (3872): No heartbeat from core client for 30 sec - exiting 10:19:00 (3872): No heartbeat from core client for 30 sec - exiting 10:19:01 (3872): No heartbeat from core client for 30 sec - exiting 10:19:02 (3872): No heartbeat from core client for 30 sec - exiting 10:19:03 (3872): No heartbeat from core client for 30 sec - exiting 10:19:04 (3872): No heartbeat from core client for 30 sec - exiting 10:19:05 (3872): No heartbeat from core client for 30 sec - exiting 10:19:07 (3872): No heartbeat from core client for 30 sec - exiting 10:19:08 (3872): No heartbeat from core client for 30 sec - exiting 10:19:09 (3872): No heartbeat from core client for 30 sec - exiting 10:19:10 (3872): No heartbeat from core client for 30 sec - exiting 10:19:11 (3872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4880, iMonCtr=1 Model crash detected, will try to restart... 20:39:01 (4076): No heartbeat from core client for 30 sec - exiting 20:39:02 (4076): No heartbeat from core client for 30 sec - exiting 20:39:03 (4076): No heartbeat from core client for 30 sec - exiting 20:39:04 (4076): No heartbeat from core client for 30 sec - exiting 20:39:05 (4076): No heartbeat from core client for 30 sec - exiting 20:39:06 (4076): No heartbeat from core client for 30 sec - exiting 20:39:08 (4076): No heartbeat from core client for 30 sec - exiting 20:39:09 (4076): No heartbeat from core client for 30 sec - exiting 20:39:10 (4076): No heartbeat from core client for 30 sec - exiting 20:39:11 (4076): No heartbeat from core client for 30 sec - exiting 20:39:12 (4076): No heartbeat from core client for 30 sec - exiting 20:39:13 (4076): No heartbeat from core client for 30 sec - exiting 20:39:14 (4076): No heartbeat from core client for 30 sec - exiting 20:39:15 (4076): No heartbeat from core client for 30 sec - exiting 20:39:16 (4076): No heartbeat from core client for 30 sec - exiting 20:39:17 (4076): No heartbeat from core client for 30 sec - exiting 20:39:19 (4076): No heartbeat from core client for 30 sec - exiting 20:39:20 (4076): No heartbeat from core client for 30 sec - exiting 20:39:21 (4076): No heartbeat from core client for 30 sec - exiting 20:39:22 (4076): No heartbeat from core client for 30 sec - exiting 20:39:23 (4076): No heartbeat from core client for 30 sec - exiting 20:39:24 (4076): No heartbeat from core client for 30 sec - exiting 20:39:25 (4076): No heartbeat from core client for 30 sec - exiting 20:39:26 (4076): No heartbeat from core client for 30 sec - exiting 20:39:27 (4076): No heartbeat from core client for 30 sec - exiting 20:39:28 (4076): No heartbeat from core client for 30 sec - exiting 20:39:29 (4076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:53:57 (4876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:54:46 (3712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:03:42 (1972): No heartbeat from core client for 30 sec - exiting 09:03:43 (1972): No heartbeat from core client for 30 sec - exiting 09:03:44 (1972): No heartbeat from core client for 30 sec - exiting 09:03:45 (1972): No heartbeat from core client for 30 sec - exiting 09:03:46 (1972): No heartbeat from core client for 30 sec - exiting 09:03:47 (1972): No heartbeat from core client for 30 sec - exiting 09:03:48 (1972): No heartbeat from core client for 30 sec - exiting 09:03:49 (1972): No heartbeat from core client for 30 sec - exiting 09:03:50 (1972): No heartbeat from core client for 30 sec - exiting 09:03:51 (1972): No heartbeat from core client for 30 sec - exiting 09:03:52 (1972): No heartbeat from core client for 30 sec - exiting 09:03:53 (1972): No heartbeat from core client for 30 sec - exiting 09:03:54 (1972): No heartbeat from core client for 30 sec - exiting 09:03:55 (1972): No heartbeat from core client for 30 sec - exiting 09:03:56 (1972): No heartbeat from core client for 30 sec - exiting 09:03:57 (1972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:13:37 (4740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:14:42 (2416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:46:25 (3276): No heartbeat from core client for 30 sec - exiting 18:46:27 (3276): No heartbeat from core client for 30 sec - exiting 18:46:28 (3276): No heartbeat from core client for 30 sec - exiting 18:46:29 (3276): No heartbeat from core client for 30 sec - exiting 18:46:30 (3276): No heartbeat from core client for 30 sec - exiting 18:46:31 (3276): No heartbeat from core client for 30 sec - exiting 18:46:32 (3276): No heartbeat from core client for 30 sec - exiting 18:46:33 (3276): No heartbeat from core client for 30 sec - exiting 18:46:34 (3276): No heartbeat from core client for 30 sec - exiting 18:46:35 (3276): No heartbeat from core client for 30 sec - exiting 18:46:36 (3276): No heartbeat from core client for 30 sec - exiting 18:46:38 (3276): No heartbeat from core client for 30 sec - exiting 18:46:39 (3276): No heartbeat from core client for 30 sec - exiting 18:46:40 (3276): No heartbeat from core client for 30 sec - exiting 18:46:41 (3276): No heartbeat from core client for 30 sec - exiting 18:46:42 (3276): No heartbeat from core client for 30 sec - exiting 18:46:43 (3276): No heartbeat from core client for 30 sec - exiting 18:46:44 (3276): No heartbeat from core client for 30 sec - exiting 18:46:45 (3276): No heartbeat from core client for 30 sec - exiting 18:46:46 (3276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:46:11 (3720): No heartbeat from core client for 30 sec - exiting 08:46:12 (3720): No heartbeat from core client for 30 sec - exiting 08:46:13 (3720): No heartbeat from core client for 30 sec - exiting 08:46:14 (3720): No heartbeat from core client for 30 sec - exiting 08:46:15 (3720): No heartbeat from core client for 30 sec - exiting 08:46:16 (3720): No heartbeat from core client for 30 sec - exiting 08:46:18 (3720): No heartbeat from core client for 30 sec - exiting 08:46:19 (3720): No heartbeat from core client for 30 sec - exiting 08:46:20 (3720): No heartbeat from core client for 30 sec - exiting 08:46:21 (3720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:26:24 (4264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:26:27 (4264): No heartbeat from core client for 30 sec - exiting 13:26:29 (4264): No heartbeat from core client for 30 sec - exiting 13:28:13 (2576): No heartbeat from core client for 30 sec - exiting 13:28:14 (2576): No heartbeat from core client for 30 sec - exiting 13:28:18 (2576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:28:20 (2576): No heartbeat from core client for 30 sec - exiting 13:28:21 (2576): No heartbeat from core client for 30 sec - exiting 13:28:22 (2576): No heartbeat from core client for 30 sec - exiting 13:28:24 (2576): No heartbeat from core client for 30 sec - exiting 13:28:25 (2576): No heartbeat from core client for 30 sec - exiting 13:28:26 (2576): No heartbeat from core client for 30 sec - exiting 13:28:27 (2576): No heartbeat from core client for 30 sec - exiting 14:36:31 (4356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:36:32 (4356): No heartbeat from core client for 30 sec - exiting 14:36:35 (4356): No heartbeat from core client for 30 sec - exiting 14:37:58 (2412): No heartbeat from core client for 30 sec - exiting 14:37:59 (2412): No heartbeat from core client for 30 sec - exiting 14:38:01 (2412): No heartbeat from core client for 30 sec - exiting 14:38:03 (2412): No heartbeat from core client for 30 sec - exiting 14:38:05 (2412): No heartbeat from core client for 30 sec - exiting 14:38:08 (2412): No heartbeat from core client for 30 sec - exiting 14:38:10 (2412): No heartbeat from core client for 30 sec - exiting 14:38:12 (2412): No heartbeat from core client for 30 sec - exiting 14:38:14 (2412): No heartbeat from core client for 30 sec - exiting 14:38:16 (2412): No heartbeat from core client for 30 sec - exiting 14:38:17 (2412): No heartbeat from core client for 30 sec - exiting 14:38:19 (2412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:56:32 (1120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:56:34 (1120): No heartbeat from core client for 30 sec - exiting 15:06:33 (1760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:06:34 (1760): No heartbeat from core client for 30 sec - exiting 15:11:33 (2008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:11:35 (2008): No heartbeat from core client for 30 sec - exiting 15:21:35 (4976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:21:37 (4976): No heartbeat from core client for 30 sec - exiting 15:23:06 (2068): No heartbeat from core client for 30 sec - exiting 15:23:07 (2068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:25:03 (2992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:27:14 (4288): No heartbeat from core client for 30 sec - exiting 15:27:15 (4288): No heartbeat from core client for 30 sec - exiting 15:27:17 (4288): No heartbeat from core client for 30 sec - exiting 15:27:19 (4288): No heartbeat from core client for 30 sec - exiting 15:27:21 (4288): No heartbeat from core client for 30 sec - exiting 15:27:23 (4288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:30:10 (5060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:30:12 (5060): No heartbeat from core client for 30 sec - exiting 15:31:10 (2876): No heartbeat from core client for 30 sec - exiting 15:31:13 (2876): No heartbeat from core client for 30 sec - exiting 15:31:14 (2876): No heartbeat from core client for 30 sec - exiting 15:31:15 (2876): No heartbeat from core client for 30 sec - exiting 15:31:16 (2876): No heartbeat from core client for 30 sec - exiting 15:31:18 (2876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:26:19 (3756): No heartbeat from core client for 30 sec - exiting 16:26:20 (3756): No heartbeat from core client for 30 sec - exiting 16:26:22 (3756): No heartbeat from core client for 30 sec - exiting 16:26:23 (3756): No heartbeat from core client for 30 sec - exiting 16:26:24 (3756): No heartbeat from core client for 30 sec - exiting 16:26:25 (3756): No heartbeat from core client for 30 sec - exiting 16:26:26 (3756): No heartbeat from core client for 30 sec - exiting 16:26:27 (3756): No heartbeat from core client for 30 sec - exiting 16:26:28 (3756): No heartbeat from core client for 30 sec - exiting 16:26:29 (3756): No heartbeat from core client for 30 sec - exiting 16:26:30 (3756): No heartbeat from core client for 30 sec - exiting 16:26:31 (3756): No heartbeat from core client for 30 sec - exiting 16:26:32 (3756): No heartbeat from core client for 30 sec - exiting 16:26:34 (3756): No heartbeat from core client for 30 sec - exiting 16:26:35 (3756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:14:17 (2492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:14:20 (2492): No heartbeat from core client for 30 sec - exiting 19:14:22 (2492): No heartbeat from core client for 30 sec - exiting 19:17:25 (1960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:17:26 (1960): No heartbeat from core client for 30 sec - exiting 19:17:28 (1960): No heartbeat from core client for 30 sec - exiting 19:17:30 (1960): No heartbeat from core client for 30 sec - exiting 19:17:32 (1960): No heartbeat from core client for 30 sec - exiting 19:17:34 (1960): No heartbeat from core client for 30 sec - exiting 19:17:36 (1960): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 19:27:23 (1584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:28:31 (4248): No heartbeat from core client for 30 sec - exiting 19:28:32 (4248): No heartbeat from core client for 30 sec - exiting 19:28:34 (4248): No heartbeat from core client for 30 sec - exiting 19:28:36 (4248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:28:38 (4248): No heartbeat from core client for 30 sec - exiting 19:28:41 (4248): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:19:53 (3940): No heartbeat from core client for 30 sec - exiting 20:19:54 (3940): No heartbeat from core client for 30 sec - exiting 20:19:55 (3940): No heartbeat from core client for 30 sec - exiting 20:19:56 (3940): No heartbeat from core client for 30 sec - exiting 20:19:57 (3940): No heartbeat from core client for 30 sec - exiting 20:19:58 (3940): No heartbeat from core client for 30 sec - exiting 20:19:59 (3940): No heartbeat from core client for 30 sec - exiting 20:20:00 (3940): No heartbeat from core client for 30 sec - exiting 20:20:01 (3940): No heartbeat from core client for 30 sec - exiting 20:20:03 (3940): No heartbeat from core client for 30 sec - exiting 20:20:04 (3940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:57:14 (3924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5488, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5488, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 20:17:07 (3812): No heartbeat from core client for 30 sec - exiting 20:17:08 (3812): No heartbeat from core client for 30 sec - exiting 20:17:10 (3812): No heartbeat from core client for 30 sec - exiting 20:17:11 (3812): No heartbeat from core client for 30 sec - exiting 20:17:12 (3812): No heartbeat from core client for 30 sec - exiting 20:17:13 (3812): No heartbeat from core client for 30 sec - exiting 20:17:14 (3812): No heartbeat from core client for 30 sec - exiting 20:17:15 (3812): No heartbeat from core client for 30 sec - exiting 20:17:16 (3812): No heartbeat from core client for 30 sec - exiting 20:17:17 (3812): No heartbeat from core client for 30 sec - exiting 20:17:18 (3812): No heartbeat from core client for 30 sec - exiting 20:17:19 (3812): No heartbeat from core client for 30 sec - exiting 20:17:20 (3812): No heartbeat from core client for 30 sec - exiting 20:17:22 (3812): No heartbeat from core client for 30 sec - exiting 20:17:23 (3812): No heartbeat from core client for 30 sec - exiting 20:17:24 (3812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=364, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=364, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=364, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4120, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 May 2013 18:33:01	1275312	15673522	hadcm3n_z8wj_1920_40_008320004_2	181,440	322,787	1.7790
03 May 2013 20:52:24	1275312	15673522	hadcm3n_z8wj_1920_40_008320004_2	155,520	277,049	1.7814
08 Apr 2013 05:35:55	1275312	15673522	hadcm3n_z8wj_1920_40_008320004_2	129,600	232,263	1.7922
03 Apr 2013 06:09:27	1275312	15673522	hadcm3n_z8wj_1920_40_008320004_2	103,680	187,015	1.8038
01 Apr 2013 10:04:51	1275312	15673522	hadcm3n_z8wj_1920_40_008320004_2	77,760	142,524	1.8329
29 Mar 2013 04:49:07	1275312	15673522	hadcm3n_z8wj_1920_40_008320004_2	51,840	94,892	1.8305
27 Mar 2013 05:36:10	1275312	15673522	hadcm3n_z8wj_1920_40_008320004_2	25,920	49,079	1.8935