Task 12833273

Name	hadcm3n_p70g_1900_40_007226672_1
Workunit	7424912
Created	26 Apr 2011, 15:38:09 UTC
Sent	27 Apr 2011, 0:15:25 UTC
Report deadline	27 Jul 2011, 7:42:36 UTC
Received	5 Jun 2011, 2:59:40 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1044919
Run time	7 days 10 hours 35 min 33 sec
CPU time	5 days 19 hours 2 min 15 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.18 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> 9:42:26 (6380): No heartbeat from core client for 30 sec - exiting 09:42:27 (6380): No heartbeat from core client for 30 sec - exiting 09:42:29 (6380): No heartbeat from core client for 30 sec - exiting 09:42:30 (6380): No heartbeat from core client for 30 sec - exiting 09:42:31 (6380): No heartbeat from core client for 30 sec - exiting 09:42:32 (6380): No heartbeat from core client for 30 sec - exiting 09:42:33 (6380): No heartbeat from core client for 30 sec - exiting 09:42:34 (6380): No heartbeat from core client for 30 sec - exiting 09:42:35 (6380): No heartbeat from core client for 30 sec - exiting 09:42:36 (6380): No heartbeat from core client for 30 sec - exiting 09:42:38 (6380): No heartbeat from core client for 30 sec - exiting 09:42:39 (6380): No heartbeat from core client for 30 sec - exiting 09:42:40 (6380): No heartbeat from core client for 30 sec - exiting 09:42:41 (6380): No heartbeat from core client for 30 sec - exiting 09:42:42 (6380): No heartbeat from core client for 30 sec - exiting 09:42:43 (6380): No heartbeat from core client for 30 sec - exiting 09:42:44 (6380): No heartbeat from core client for 30 sec - exiting 09:42:45 (6380): No heartbeat from core client for 30 sec - exiting 09:42:46 (6380): No heartbeat from core client for 30 sec - exiting 09:42:47 (6380): No heartbeat from core client for 30 sec - exiting 09:42:48 (6380): No heartbeat from core client for 30 sec - exiting 09:42:50 (6380): No heartbeat from core client for 30 sec - exiting 09:42:51 (6380): No heartbeat from core client for 30 sec - exiting 09:42:52 (6380): No heartbeat from core client for 30 sec - exiting 09:42:53 (6380): No heartbeat from core client for 30 sec - exiting 09:42:54 (6380): No heartbeat from core client for 30 sec - exiting 09:42:55 (6380): No heartbeat from core client for 30 sec - exiting 09:42:56 (6380): No heartbeat from core client for 30 sec - exiting 09:42:57 (6380): No heartbeat from core client for 30 sec - exiting 09:42:58 (6380): No heartbeat from core client for 30 sec - exiting 09:42:59 (6380): No heartbeat from core client for 30 sec - exiting 09:43:01 (6380): No heartbeat from core client for 30 sec - exiting 09:43:02 (6380): No heartbeat from core client for 30 sec - exiting 09:43:03 (6380): No heartbeat from core client for 30 sec - exiting 09:43:04 (6380): No heartbeat from core client for 30 sec - exiting 09:43:05 (6380): No heartbeat from core client for 30 sec - exiting 09:43:06 (6380): No heartbeat from core client for 30 sec - exiting 09:43:07 (6380): No heartbeat from core client for 30 sec - exiting 09:43:09 (6380): No heartbeat from core client for 30 sec - exiting 09:43:10 (6380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:43:11 (6380): No heartbeat from core client for 30 sec - exiting 09:43:12 (6380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5476, iMonCtr=1 Model crash detected, will try to restart... 18:17:10 (5204): No heartbeat from core client for 30 sec - exiting 18:17:11 (5204): No heartbeat from core client for 30 sec - exiting 18:17:12 (5204): No heartbeat from core client for 30 sec - exiting 18:17:13 (5204): No heartbeat from core client for 30 sec - exiting 18:17:14 (5204): No heartbeat from core client for 30 sec - exiting 18:17:15 (5204): No heartbeat from core client for 30 sec - exiting 18:17:16 (5204): No heartbeat from core client for 30 sec - exiting 18:17:17 (5204): No heartbeat from core client for 30 sec - exiting 18:17:18 (5204): No heartbeat from core client for 30 sec - exiting 18:17:19 (5204): No heartbeat from core client for 30 sec - exiting 18:17:21 (5204): No heartbeat from core client for 30 sec - exiting 18:17:22 (5204): No heartbeat from core client for 30 sec - exiting 18:17:23 (5204): No heartbeat from core client for 30 sec - exiting 18:17:24 (5204): No heartbeat from core client for 30 sec - exiting 18:17:25 (5204): No heartbeat from core client for 30 sec - exiting 18:17:26 (5204): No heartbeat from core client for 30 sec - exiting 18:17:27 (5204): No heartbeat from core client for 30 sec - exiting 18:17:28 (5204): No heartbeat from core client for 30 sec - exiting 18:17:29 (5204): No heartbeat from core client for 30 sec - exiting 18:17:30 (5204): No heartbeat from core client for 30 sec - exiting 18:17:31 (5204): No heartbeat from core client for 30 sec - exiting 18:17:32 (5204): No heartbeat from core client for 30 sec - exiting 18:17:33 (5204): No heartbeat from core client for 30 sec - exiting 18:17:34 (5204): No heartbeat from core client for 30 sec - exiting 18:17:36 (5204): No heartbeat from core client for 30 sec - exiting 18:17:37 (5204): No heartbeat from core client for 30 sec - exiting 18:17:38 (5204): No heartbeat from core client for 30 sec - exiting 18:17:39 (5204): No heartbeat from core client for 30 sec - exiting 18:17:40 (5204): No heartbeat from core client for 30 sec - exiting 18:17:41 (5204): No heartbeat from core client for 30 sec - exiting 18:17:42 (5204): No heartbeat from core client for 30 sec - exiting 18:17:43 (5204): No heartbeat from core client for 30 sec - exiting 18:17:44 (5204): No heartbeat from core client for 30 sec - exiting 18:17:45 (5204): No heartbeat from core client for 30 sec - exiting 18:17:46 (5204): No heartbeat from core client for 30 sec - exiting 18:17:48 (5204): No heartbeat from core client for 30 sec - exiting 18:17:49 (5204): No heartbeat from core client for 30 sec - exiting 18:17:50 (5204): No heartbeat from core client for 30 sec - exiting 18:17:51 (5204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:16:55 (7028): No heartbeat from core client for 30 sec - exiting 10:16:57 (7028): No heartbeat from core client for 30 sec - exiting 10:16:58 (7028): No heartbeat from core client for 30 sec - exiting 10:16:59 (7028): No heartbeat from core client for 30 sec - exiting 10:17:00 (7028): No heartbeat from core client for 30 sec - exiting 10:17:01 (7028): No heartbeat from core client for 30 sec - exiting 10:17:02 (7028): No heartbeat from core client for 30 sec - exiting 10:17:03 (7028): No heartbeat from core client for 30 sec - exiting 10:17:04 (7028): No heartbeat from core client for 30 sec - exiting 10:17:05 (7028): No heartbeat from core client for 30 sec - exiting 10:17:06 (7028): No heartbeat from core client for 30 sec - exiting 10:17:07 (7028): No heartbeat from core client for 30 sec - exiting 10:17:08 (7028): No heartbeat from core client for 30 sec - exiting 10:17:09 (7028): No heartbeat from core client for 30 sec - exiting 10:17:10 (7028): No heartbeat from core client for 30 sec - exiting 10:17:11 (7028): No heartbeat from core client for 30 sec - exiting 10:17:12 (7028): No heartbeat from core client for 30 sec - exiting 10:17:13 (7028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:20:03 (7052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:20:46 (6852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:22:21 (8960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:24:13 (6096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:24:14 (6096): No heartbeat from core client for 30 sec - exiting 18:24:15 (6096): No heartbeat from core client for 30 sec - exiting 18:24:16 (6096): No heartbeat from core client for 30 sec - exiting 18:24:17 (6096): No heartbeat from core client for 30 sec - exiting 18:24:18 (6096): No heartbeat from core client for 30 sec - exiting 18:24:19 (6096): No heartbeat from core client for 30 sec - exiting 18:24:20 (6096): No heartbeat from core client for 30 sec - exiting 18:24:21 (6096): No heartbeat from core client for 30 sec - exiting 18:24:22 (6096): No heartbeat from core client for 30 sec - exiting 18:24:23 (6096): No heartbeat from core client for 30 sec - exiting 18:25:35 (9040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:25:36 (9040): No heartbeat from core client for 30 sec - exiting 18:25:37 (9040): No heartbeat from core client for 30 sec - exiting 18:25:38 (9040): No heartbeat from core client for 30 sec - exiting 18:25:39 (9040): No heartbeat from core client for 30 sec - exiting 18:25:40 (9040): No heartbeat from core client for 30 sec - exiting 18:25:41 (9040): No heartbeat from core client for 30 sec - exiting 18:25:42 (9040): No heartbeat from core client for 30 sec - exiting 18:25:43 (9040): No heartbeat from core client for 30 sec - exiting 18:25:44 (9040): No heartbeat from core client for 30 sec - exiting 18:25:45 (9040): No heartbeat from core client for 30 sec - exiting 18:26:22 (6000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:27:20 (7072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:29:13 (8640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:30:24 (6752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:31:55 (7772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:32:35 (7588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:33:58 (8184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:34:46 (3040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:35:25 (3876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:37:54 (2648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:38:34 (2512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:38:35 (2512): No heartbeat from core client for 30 sec - exiting 18:38:36 (2512): No heartbeat from core client for 30 sec - exiting 18:38:37 (2512): No heartbeat from core client for 30 sec - exiting 18:38:38 (2512): No heartbeat from core client for 30 sec - exiting 18:38:39 (2512): No heartbeat from core client for 30 sec - exiting 18:38:40 (2512): No heartbeat from core client for 30 sec - exiting 18:38:41 (2512): No heartbeat from core client for 30 sec - exiting 18:38:42 (2512): No heartbeat from core client for 30 sec - exiting 18:38:43 (2512): No heartbeat from core client for 30 sec - exiting forrtl: Access is denied. 18:41:02 (3920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:41:44 (6540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:41:45 (6540): No heartbeat from core client for 30 sec - exiting 18:41:46 (6540): No heartbeat from core client for 30 sec - exiting 18:41:47 (6540): No heartbeat from core client for 30 sec - exiting 18:41:48 (6540): No heartbeat from core client for 30 sec - exiting 18:41:49 (6540): No heartbeat from core client for 30 sec - exiting 18:41:50 (6540): No heartbeat from core client for 30 sec - exiting 18:41:51 (6540): No heartbeat from core client for 30 sec - exiting 18:41:52 (6540): No heartbeat from core client for 30 sec - exiting 18:41:53 (6540): No heartbeat from core client for 30 sec - exiting 18:41:54 (6540): No heartbeat from core client for 30 sec - exiting 18:44:15 (316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:44:16 (316): No heartbeat from core client for 30 sec - exiting 18:44:17 (316): No heartbeat from core client for 30 sec - exiting 18:44:18 (316): No heartbeat from core client for 30 sec - exiting 18:44:19 (316): No heartbeat from core client for 30 sec - exiting 18:44:20 (316): No heartbeat from core client for 30 sec - exiting 18:44:21 (316): No heartbeat from core client for 30 sec - exiting 18:44:22 (316): No heartbeat from core client for 30 sec - exiting 18:44:23 (316): No heartbeat from core client for 30 sec - exiting 18:45:49 (7992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:48:52 (3612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:48:53 (3612): No heartbeat from core client for 30 sec - exiting 18:49:25 (5436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:49:26 (5436): No heartbeat from core client for 30 sec - exiting 18:49:27 (5436): No heartbeat from core client for 30 sec - exiting 18:50:53 (5324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:50:54 (5324): No heartbeat from core client for 30 sec - exiting 18:50:55 (5324): No heartbeat from core client for 30 sec - exiting 18:50:56 (5324): No heartbeat from core client for 30 sec - exiting 18:50:57 (5324): No heartbeat from core client for 30 sec - exiting 18:50:58 (5324): No heartbeat from core client for 30 sec - exiting 18:50:59 (5324): No heartbeat from core client for 30 sec - exiting 18:51:00 (5324): No heartbeat from core client for 30 sec - exiting 18:51:01 (5324): No heartbeat from core client for 30 sec - exiting 18:51:02 (5324): No heartbeat from core client for 30 sec - exiting 18:51:03 (5324): No heartbeat from core client for 30 sec - exiting 19:17:46 (6908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:17:47 (6908): No heartbeat from core client for 30 sec - exiting 19:20:05 (4284): No heartbeat from core client for 30 sec - exiting 19:20:36 (4284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:20:37 (4284): No heartbeat from core client for 30 sec - exiting 19:20:38 (4284): No heartbeat from core client for 30 sec - exiting 19:20:39 (4284): No heartbeat from core client for 30 sec - exiting 19:20:40 (4284): No heartbeat from core client for 30 sec - exiting 19:20:41 (4284): No heartbeat from core client for 30 sec - exiting 19:20:46 (4284): No heartbeat from core client for 30 sec - exiting 19:22:09 (8800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:22:24 (8800): No heartbeat from core client for 30 sec - exiting 19:22:25 (8800): No heartbeat from core client for 30 sec - exiting 19:22:26 (8800): No heartbeat from core client for 30 sec - exiting 19:23:35 (7812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:23:36 (7812): No heartbeat from core client for 30 sec - exiting 19:23:37 (7812): No heartbeat from core client for 30 sec - exiting 19:23:38 (7812): No heartbeat from core client for 30 sec - exiting 19:23:39 (7812): No heartbeat from core client for 30 sec - exiting 19:23:40 (7812): No heartbeat from core client for 30 sec - exiting 19:23:41 (7812): No heartbeat from core client for 30 sec - exiting 19:23:42 (7812): No heartbeat from core client for 30 sec - exiting 19:23:43 (7812): No heartbeat from core client for 30 sec - exiting 19:23:44 (7812): No heartbeat from core client for 30 sec - exiting 19:23:45 (7812): No heartbeat from core client for 30 sec - exiting 19:24:38 (8628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:25:32 (6656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:26:16 (8340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:26:48 (7848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:26:49 (7848): No heartbeat from core client for 30 sec - exiting 19:26:50 (7848): No heartbeat from core client for 30 sec - exiting 19:26:51 (7848): No heartbeat from core client for 30 sec - exiting 19:26:52 (7848): No heartbeat from core client for 30 sec - exiting 19:26:53 (7848): No heartbeat from core client for 30 sec - exiting 19:26:54 (7848): No heartbeat from core client for 30 sec - exiting 19:26:55 (7848): No heartbeat from core client for 30 sec - exiting 19:26:56 (7848): No heartbeat from core client for 30 sec - exiting 19:28:11 (1084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:29:38 (4296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:29:39 (4296): No heartbeat from core client for 30 sec - exiting 19:29:40 (4296): No heartbeat from core client for 30 sec - exiting 19:29:41 (4296): No heartbeat from core client for 30 sec - exiting 19:29:42 (4296): No heartbeat from core client for 30 sec - exiting 19:29:43 (4296): No heartbeat from core client for 30 sec - exiting 19:29:44 (4296): No heartbeat from core client for 30 sec - exiting 19:30:29 (7796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:30:30 (7796): No heartbeat from core client for 30 sec - exiting 19:30:31 (7796): No heartbeat from core client for 30 sec - exiting 19:31:22 (8912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:31:23 (8912): No heartbeat from core client for 30 sec - exiting 19:31:24 (8912): No heartbeat from core client for 30 sec - exiting 19:34:27 (7480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:35:17 (6908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:36:08 (7976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:36:44 (9092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:36:45 (9092): No heartbeat from core client for 30 sec - exiting 19:36:46 (9092): No heartbeat from core client for 30 sec - exiting 19:36:47 (9092): No heartbeat from core client for 30 sec - exiting 19:36:48 (9092): No heartbeat from core client for 30 sec - exiting 19:38:35 (5528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:40:19 (6644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:43:16 (7160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:43:37 (7160): No heartbeat from core client for 30 sec - exiting 19:43:42 (7160): No heartbeat from core client for 30 sec - exiting 19:43:43 (7160): No heartbeat from core client for 30 sec - exiting 19:43:44 (7160): No heartbeat from core client for 30 sec - exiting 19:43:49 (7160): No heartbeat from core client for 30 sec - exiting 19:44:37 (6160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:44:38 (6160): No heartbeat from core client for 30 sec - exiting 19:44:39 (6160): No heartbeat from core client for 30 sec - exiting 19:44:40 (6160): No heartbeat from core client for 30 sec - exiting 19:44:41 (6160): No heartbeat from core client for 30 sec - exiting 19:44:42 (6160): No heartbeat from core client for 30 sec - exiting 19:44:43 (6160): No heartbeat from core client for 30 sec - exiting 19:44:44 (6160): No heartbeat from core client for 30 sec - exiting 19:44:45 (6160): No heartbeat from core client for 30 sec - exiting 19:44:46 (6160): No heartbeat from core client for 30 sec - exiting 19:44:47 (6160): No heartbeat from core client for 30 sec - exiting 19:46:05 (7028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:47:33 (9096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:48:37 (7800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:48:38 (7800): No heartbeat from core client for 30 sec - exiting 19:48:39 (7800): No heartbeat from core client for 30 sec - exiting 19:48:44 (7800): No heartbeat from core client for 30 sec - exiting 19:50:01 (8972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:50:02 (8972): No heartbeat from core client for 30 sec - exiting 19:50:03 (8972): No heartbeat from core client for 30 sec - exiting 19:51:04 (8680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:05 (8680): No heartbeat from core client for 30 sec - exiting 19:51:06 (8680): No heartbeat from core client for 30 sec - exiting 19:52:03 (8468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:52:41 (4932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:52:42 (4932): No heartbeat from core client for 30 sec - exiting 19:54:08 (7296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:56:20 (7356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:56:29 (7356): No heartbeat from core client for 30 sec - exiting 19:57:25 (8116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:59:04 (8116): No heartbeat from core client for 30 sec - exiting 19:59:05 (8116): No heartbeat from core client for 30 sec - exiting 19:59:06 (8116): No heartbeat from core client for 30 sec - exiting 19:59:07 (8116): No heartbeat from core client for 30 sec - exiting 19:59:12 (8116): No heartbeat from core client for 30 sec - exiting 19:59:13 (8116): No heartbeat from core client for 30 sec - exiting 20:01:17 (8376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:01:18 (8376): No heartbeat from core client for 30 sec - exiting 20:01:19 (8376): No heartbeat from core client for 30 sec - exiting 20:01:20 (8376): No heartbeat from core client for 30 sec - exiting 20:01:21 (8376): No heartbeat from core client for 30 sec - exiting 20:01:22 (8376): No heartbeat from core client for 30 sec - exiting 20:01:23 (8376): No heartbeat from core client for 30 sec - exiting 20:01:24 (8376): No heartbeat from core client for 30 sec - exiting 20:01:25 (8376): No heartbeat from core client for 30 sec - exiting 20:01:26 (8376): No heartbeat from core client for 30 sec - exiting 20:01:27 (8376): No heartbeat from core client for 30 sec - exiting 20:02:18 (1084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:02:19 (1084): No heartbeat from core client for 30 sec - exiting 20:03:04 (7712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:03:05 (7712): No heartbeat from core client for 30 sec - exiting 20:03:42 (2992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:04:43 (9032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:04:44 (9032): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3412, iMonCtr=1 Model crash detected, will try to restart... 20:05:57 (3412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:05:58 (3412): No heartbeat from core client for 30 sec - exiting 20:06:34 (8224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:07:25 (7900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:08:23 (8964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:08:24 (8964): No heartbeat from core client for 30 sec - exiting 20:08:25 (8964): No heartbeat from core client for 30 sec - exiting 20:09:34 (8984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:11:14 (8912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:12:14 (7840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:12:15 (7840): No heartbeat from core client for 30 sec - exiting 20:12:16 (7840): No heartbeat from core client for 30 sec - exiting 20:12:17 (7840): No heartbeat from core client for 30 sec - exiting 20:12:18 (7840): No heartbeat from core client for 30 sec - exiting 20:13:25 (7028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:14:32 (2960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:15:45 (8008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:16:22 (3440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:37:37 (7760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:38:41 (8904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:39:47 (10432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:43:34 (10616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:43:35 (10616): No heartbeat from core client for 30 sec - exiting 16:44:59 (2992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:46:21 (9288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:50:14 (10456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:51:43 (10632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:52:15 (9640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:52:16 (9640): No heartbeat from core client for 30 sec - exiting 16:57:03 (11112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:57:04 (11112): No heartbeat from core client for 30 sec - exiting 16:58:13 (10560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:02:47 (3992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:03:33 (9556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:05:24 (6672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:05:56 (10640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:06:54 (5760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:08:30 (10656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:11:11 (10460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:17:22 (7428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:22:03 (6316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 17:28:48 (11764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:31:15 (8656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:32:22 (12132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:15:16 (13476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:15:24 (13476): No heartbeat from core client for 30 sec - exiting 08:15:25 (13476): No heartbeat from core client for 30 sec - exiting 08:15:26 (13476): No heartbeat from core client for 30 sec - exiting 08:15:27 (13476): No heartbeat from core client for 30 sec - exiting 08:15:28 (13476): No heartbeat from core client for 30 sec - exiting 08:15:29 (13476): No heartbeat from core client for 30 sec - exiting 08:15:30 (13476): No heartbeat from core client for 30 sec - exiting 08:15:31 (13476): No heartbeat from core client for 30 sec - exiting 08:15:32 (13476): No heartbeat from core client for 30 sec - exiting 08:16:42 (13700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:16:43 (13700): No heartbeat from core client for 30 sec - exiting 08:16:44 (13700): No heartbeat from core client for 30 sec - exiting 08:20:58 (2900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:24:00 (12188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:24:01 (12188): No heartbeat from core client for 30 sec - exiting 08:24:02 (12188): No heartbeat from core client for 30 sec - exiting 08:24:03 (12188): No heartbeat from core client for 30 sec - exiting 08:24:04 (12188): No heartbeat from core client for 30 sec - exiting 08:24:05 (12188): No heartbeat from core client for 30 sec - exiting 08:24:06 (12188): No heartbeat from core client for 30 sec - exiting 08:24:07 (12188): No heartbeat from core client for 30 sec - exiting 08:24:09 (12188): No heartbeat from core client for 30 sec - exiting 08:27:50 (10416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:27:53 (10416): No heartbeat from core client for 30 sec - exiting 08:30:05 (7260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 08:40:02 (13276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:40:03 (13276): No heartbeat from core client for 30 sec - exiting 08:40:04 (13276): No heartbeat from core client for 30 sec - exiting 08:40:05 (13276): No heartbeat from core client for 30 sec - exiting 08:40:06 (13276): No heartbeat from core client for 30 sec - exiting 08:40:07 (13276): No heartbeat from core client for 30 sec - exiting 08:40:08 (13276): No heartbeat from core client for 30 sec - exiting 08:40:09 (13276): No heartbeat from core client for 30 sec - exiting 08:40:10 (13276): No heartbeat from core client for 30 sec - exiting 08:40:11 (13276): No heartbeat from core client for 30 sec - exiting 08:40:12 (13276): No heartbeat from core client for 30 sec - exiting 08:43:24 (14264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:45:18 (12968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:46:20 (6064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:23 (13520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:50:26 (11800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:52:22 (12324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:52:23 (12324): No heartbeat from core client for 30 sec - exiting 08:55:13 (14264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:55:22 (14264): No heartbeat from core client for 30 sec - exiting 08:55:23 (14264): No heartbeat from core client for 30 sec - exiting 08:55:24 (14264): No heartbeat from core client for 30 sec - exiting 08:55:25 (14264): No heartbeat from core client for 30 sec - exiting 08:55:26 (14264): No heartbeat from core client for 30 sec - exiting 08:56:46 (11576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:57:49 (8676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:02:42 (12528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:02:51 (12528): No heartbeat from core client for 30 sec - exiting 09:02:52 (12528): No heartbeat from core client for 30 sec - exiting 09:02:53 (12528): No heartbeat from core client for 30 sec - exiting 09:02:54 (12528): No heartbeat from core client for 30 sec - exiting 09:02:55 (12528): No heartbeat from core client for 30 sec - exiting 09:02:56 (12528): No heartbeat from core client for 30 sec - exiting 09:02:57 (12528): No heartbeat from core client for 30 sec - exiting 09:02:58 (12528): No heartbeat from core client for 30 sec - exiting 09:03:31 (13372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:05:09 (13328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:05:10 (13328): No heartbeat from core client for 30 sec - exiting 09:05:11 (13328): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 09:16:29 (13260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:16:30 (13260): No heartbeat from core client for 30 sec - exiting 09:16:31 (13260): No heartbeat from core client for 30 sec - exiting 09:16:32 (13260): No heartbeat from core client for 30 sec - exiting 09:19:38 (13548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:19:39 (13548): No heartbeat from core client for 30 sec - exiting 09:19:40 (13548): No heartbeat from core client for 30 sec - exiting 09:19:41 (13548): No heartbeat from core client for 30 sec - exiting 09:22:08 (13160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:23:17 (10320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:23:18 (10320): No heartbeat from core client for 30 sec - exiting 09:23:19 (10320): No heartbeat from core client for 30 sec - exiting 09:23:20 (10320): No heartbeat from core client for 30 sec - exiting 09:23:21 (10320): No heartbeat from core client for 30 sec - exiting 09:23:22 (10320): No heartbeat from core client for 30 sec - exiting 09:23:23 (10320): No heartbeat from core client for 30 sec - exiting 09:23:24 (10320): No heartbeat from core client for 30 sec - exiting forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3228, iMonCtr=1 Model crash detected, will try to restart... 09:24:56 (3228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:25:37 (12744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1080, iMonCtr=1 Model crash detected, will try to restart... 09:27:20 (1080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:27:21 (1080): No heartbeat from core client for 30 sec - exiting 09:27:22 (1080): No heartbeat from core client for 30 sec - exiting 09:28:17 (12336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:30:11 (3096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:31:58 (4248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:34:10 (10844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:34:11 (10844): No heartbeat from core client for 30 sec - exiting 09:34:12 (10844): No heartbeat from core client for 30 sec - exiting 09:37:10 (9676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:37:14 (9676): No heartbeat from core client for 30 sec - exiting 09:37:15 (9676): No heartbeat from core client for 30 sec - exiting 09:37:16 (9676): No heartbeat from core client for 30 sec - exiting 09:38:50 (12940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:38:51 (12940): No heartbeat from core client for 30 sec - exiting 09:38:52 (12940): No heartbeat from core client for 30 sec - exiting 09:38:53 (12940): No heartbeat from core client for 30 sec - exiting 09:40:28 (14520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:41:19 (14760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:42:53 (14876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:43:46 (15128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:45:08 (15244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:45:47 (12912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:47:06 (9396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:47:32 (9396): No heartbeat from core client for 30 sec - exiting 09:47:33 (9396): No heartbeat from core client for 30 sec - exiting 09:47:34 (9396): No heartbeat from core client for 30 sec - exiting 09:47:35 (9396): No heartbeat from core client for 30 sec - exiting 09:47:36 (9396): No heartbeat from core client for 30 sec - exiting 09:47:37 (9396): No heartbeat from core client for 30 sec - exiting 09:47:38 (9396): No heartbeat from core client for 30 sec - exiting 09:48:23 (12584): No heartbeat from core client for 30 sec - exiting 09:48:24 (12584): No heartbeat from core client for 30 sec - exiting 09:48:25 (12584): No heartbeat from core client for 30 sec - exiting 09:48:26 (12584): No heartbeat from core client for 30 sec - exiting 09:48:27 (12584): No heartbeat from core client for 30 sec - exiting 09:48:28 (12584): No heartbeat from core client for 30 sec - exiting 09:48:29 (12584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:48:30 (12584): No heartbeat from core client for 30 sec - exiting 09:48:31 (12584): No heartbeat from core client for 30 sec - exiting 09:48:32 (12584): No heartbeat from core client for 30 sec - exiting 09:54:39 (14704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:54:40 (14704): No heartbeat from core client for 30 sec - exiting 09:54:41 (14704): No heartbeat from core client for 30 sec - exiting 09:54:42 (14704): No heartbeat from core client for 30 sec - exiting 09:54:43 (14704): No heartbeat from core client for 30 sec - exiting 09:57:52 (13104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... forrtl: Access is denied. 09:59:09 (13108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:01:01 (14684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:02:14 (14652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:02:47 (15076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:02:48 (15076): No heartbeat from core client for 30 sec - exiting 10:02:49 (15076): No heartbeat from core client for 30 sec - exiting 10:02:50 (15076): No heartbeat from core client for 30 sec - exiting 10:02:51 (15076): No heartbeat from core client for 30 sec - exiting 10:02:52 (15076): No heartbeat from core client for 30 sec - exiting 10:02:53 (15076): No heartbeat from core client for 30 sec - exiting 10:02:54 (15076): No heartbeat from core client for 30 sec - exiting 10:02:55 (15076): No heartbeat from core client for 30 sec - exiting 10:02:56 (15076): No heartbeat from core client for 30 sec - exiting 10:02:57 (15076): No heartbeat from core client for 30 sec - exiting 10:05:24 (15144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:05:25 (15144): No heartbeat from core client for 30 sec - exiting 10:05:26 (15144): No heartbeat from core client for 30 sec - exiting 10:05:27 (15144): No heartbeat from core client for 30 sec - exiting 10:07:10 (15096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:08:17 (6532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:08:18 (6532): No heartbeat from core client for 30 sec - exiting 10:08:19 (6532): No heartbeat from core client for 30 sec - exiting 10:08:20 (6532): No heartbeat from core client for 30 sec - exiting 10:08:21 (6532): No heartbeat from core client for 30 sec - exiting 10:08:22 (6532): No heartbeat from core client for 30 sec - exiting 10:08:23 (6532): No heartbeat from core client for 30 sec - exiting 10:08:24 (6532): No heartbeat from core client for 30 sec - exiting 10:08:25 (6532): No heartbeat from core client for 30 sec - exiting 10:09:31 (11424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:11:30 (13160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:11:31 (13160): No heartbeat from core client for 30 sec - exiting 10:11:32 (13160): No heartbeat from core client for 30 sec - exiting 10:11:33 (13160): No heartbeat from core client for 30 sec - exiting 10:12:56 (14508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:12:57 (14508): No heartbeat from core client for 30 sec - exiting 10:14:49 (15264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:15:35 (15004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:15:36 (15004): No heartbeat from core client for 30 sec - exiting 10:15:37 (15004): No heartbeat from core client for 30 sec - exiting 10:16:37 (14600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:18:43 (12516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:23:00 (9252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:23:03 (9252): No heartbeat from core client for 30 sec - exiting 10:23:04 (9252): No heartbeat from core client for 30 sec - exiting 10:23:05 (9252): No heartbeat from core client for 30 sec - exiting 10:23:06 (9252): No heartbeat from core client for 30 sec - exiting 10:23:07 (9252): No heartbeat from core client for 30 sec - exiting 10:23:08 (9252): No heartbeat from core client for 30 sec - exiting 10:23:09 (9252): No heartbeat from core client for 30 sec - exiting 10:23:10 (9252): No heartbeat from core client for 30 sec - exiting 10:23:11 (9252): No heartbeat from core client for 30 sec - exiting 10:24:33 (13108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:25:07 (14680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:27:26 (14776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:27:28 (14776): No heartbeat from core client for 30 sec - exiting 10:27:29 (14776): No heartbeat from core client for 30 sec - exiting 10:27:30 (14776): No heartbeat from core client for 30 sec - exiting 10:27:31 (14776): No heartbeat from core client for 30 sec - exiting 10:27:32 (14776): No heartbeat from core client for 30 sec - exiting 10:27:33 (14776): No heartbeat from core client for 30 sec - exiting 10:27:34 (14776): No heartbeat from core client for 30 sec - exiting 10:27:35 (14776): No heartbeat from core client for 30 sec - exiting 10:27:36 (14776): No heartbeat from core client for 30 sec - exiting 10:27:37 (14776): No heartbeat from core client for 30 sec - exiting 10:28:26 (14552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:30:56 (14480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:31:03 (14480): No heartbeat from core client for 30 sec - exiting 10:31:04 (14480): No heartbeat from core client for 30 sec - exiting 10:31:05 (14480): No heartbeat from core client for 30 sec - exiting 10:31:06 (14480): No heartbeat from core client for 30 sec - exiting 10:31:07 (14480): No heartbeat from core client for 30 sec - exiting 10:31:08 (14480): No heartbeat from core client for 30 sec - exiting 10:31:09 (14480): No heartbeat from core client for 30 sec - exiting 10:31:10 (14480): No heartbeat from core client for 30 sec - exiting 10:31:11 (14480): No heartbeat from core client for 30 sec - exiting 10:31:12 (14480): No heartbeat from core client for 30 sec - exiting 10:33:18 (14588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:34:47 (6796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:35:43 (8696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:38:05 (14816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:41:02 (15112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:41:53 (14316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:42:31 (14760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:44:04 (15248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:45:08 (9220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:46:14 (12580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:47:12 (13780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:48:42 (12536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:49:48 (15016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:49:49 (15016): No heartbeat from core client for 30 sec - exiting 10:49:50 (15016): No heartbeat from core client for 30 sec - exiting 10:50:42 (14412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:50:43 (14412): No heartbeat from core client for 30 sec - exiting 10:50:44 (14412): No heartbeat from core client for 30 sec - exiting 10:50:45 (14412): No heartbeat from core client for 30 sec - exiting 10:50:46 (14412): No heartbeat from core client for 30 sec - exiting 10:50:47 (14412): No heartbeat from core client for 30 sec - exiting 10:51:24 (3064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:51:34 (3064): No heartbeat from core client for 30 sec - exiting 10:53:12 (14400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:54:34 (15340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:54:35 (15340): No heartbeat from core client for 30 sec - exiting 10:54:36 (15340): No heartbeat from core client for 30 sec - exiting 10:54:37 (15340): No heartbeat from core client for 30 sec - exiting 10:54:38 (15340): No heartbeat from core client for 30 sec - exiting 10:54:39 (15340): No heartbeat from core client for 30 sec - exiting 10:54:40 (15340): No heartbeat from core client for 30 sec - exiting 10:54:41 (15340): No heartbeat from core client for 30 sec - exiting 10:54:42 (15340): No heartbeat from core client for 30 sec - exiting 10:54:43 (15340): No heartbeat from core client for 30 sec - exiting 10:54:44 (15340): No heartbeat from core client for 30 sec - exiting 10:56:14 (13632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:57:31 (12408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:00:09 (14528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:00:27 (14528): No heartbeat from core client for 30 sec - exiting 11:00:28 (14528): No heartbeat from core client for 30 sec - exiting 11:00:29 (14528): No heartbeat from core client for 30 sec - exiting 11:00:30 (14528): No heartbeat from core client for 30 sec - exiting 11:00:31 (14528): No heartbeat from core client for 30 sec - exiting 11:00:32 (14528): No heartbeat from core client for 30 sec - exiting 11:00:33 (14528): No heartbeat from core client for 30 sec - exiting 11:00:34 (14528): No heartbeat from core client for 30 sec - exiting 11:00:35 (14528): No heartbeat from core client for 30 sec - exiting 11:01:53 (14900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:03:07 (14640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:04:28 (9364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:04:29 (9364): No heartbeat from core client for 30 sec - exiting 11:04:30 (9364): No heartbeat from core client for 30 sec - exiting 11:05:41 (14940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:05:42 (14940): No heartbeat from core client for 30 sec - exiting 11:05:43 (14940): No heartbeat from core client for 30 sec - exiting 11:07:46 (14704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:09:10 (13156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:09:11 (13156): No heartbeat from core client for 30 sec - exiting 11:09:12 (13156): No heartbeat from core client for 30 sec - exiting 11:09:13 (13156): No heartbeat from core client for 30 sec - exiting 11:09:49 (14684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:09:50 (14684): No heartbeat from core client for 30 sec - exiting 11:09:51 (14684): No heartbeat from core client for 30 sec - exiting 11:11:02 (976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:11:43 (14088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:11:44 (14088): No heartbeat from core client for 30 sec - exiting 11:11:45 (14088): No heartbeat from core client for 30 sec - exiting 11:11:46 (14088): No heartbeat from core client for 30 sec - exiting 11:11:47 (14088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:24:09 (8928): No heartbeat from core client for 30 sec - exiting 18:24:10 (8928): No heartbeat from core client for 30 sec - exiting 18:24:11 (8928): No heartbeat from core client for 30 sec - exiting 18:24:12 (8928): No heartbeat from core client for 30 sec - exiting 18:24:13 (8928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:48:28 (10724): No heartbeat from core client for 30 sec - exiting 12:48:30 (10724): No heartbeat from core client for 30 sec - exiting 12:48:31 (10724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2740, iMonCtr=1 Model crash detected, will try to restart... 16:56:35 (7012): No heartbeat from core client for 30 sec - exiting 16:56:36 (7012): No heartbeat from core client for 30 sec - exiting 16:56:37 (7012): No heartbeat from core client for 30 sec - exiting 16:56:38 (7012): No heartbeat from core client for 30 sec - exiting 16:56:39 (7012): No heartbeat from core client for 30 sec - exiting 16:56:40 (7012): No heartbeat from core client for 30 sec - exiting 16:56:41 (7012): No heartbeat from core client for 30 sec - exiting 16:56:42 (7012): No heartbeat from core client for 30 sec - exiting 16:56:44 (7012): No heartbeat from core client for 30 sec - exiting 16:56:45 (7012): No heartbeat from core client for 30 sec - exiting 16:56:46 (7012): No heartbeat from core client for 30 sec - exiting 16:56:47 (7012): No heartbeat from core client for 30 sec - exiting 16:56:48 (7012): No heartbeat from core client for 30 sec - exiting 16:56:49 (7012): No heartbeat from core client for 30 sec - exiting 16:56:50 (7012): No heartbeat from core client for 30 sec - exiting 16:56:51 (7012): No heartbeat from core client for 30 sec - exiting 16:56:52 (7012): No heartbeat from core client for 30 sec - exiting 16:56:53 (7012): No heartbeat from core client for 30 sec - exiting 16:56:55 (7012): No heartbeat from core client for 30 sec - exiting 16:56:56 (7012): No heartbeat from core client for 30 sec - exiting 16:56:57 (7012): No heartbeat from core client for 30 sec - exiting 16:56:58 (7012): No heartbeat from core client for 30 sec - exiting 16:56:59 (7012): No heartbeat from core client for 30 sec - exiting 16:57:01 (7012): No heartbeat from core client for 30 sec - exiting 16:57:02 (7012): No heartbeat from core client for 30 sec - exiting 16:57:03 (7012): No heartbeat from core client for 30 sec - exiting 16:57:04 (7012): No heartbeat from core client for 30 sec - exiting 16:57:05 (7012): No heartbeat from core client for 30 sec - exiting 16:57:06 (7012): No heartbeat from core client for 30 sec - exiting 16:57:07 (7012): No heartbeat from core client for 30 sec - exiting 16:57:08 (7012): No heartbeat from core client for 30 sec - exiting 16:57:09 (7012): No heartbeat from core client for 30 sec - exiting 16:57:10 (7012): No heartbeat from core client for 30 sec - exiting 16:57:12 (7012): No heartbeat from core client for 30 sec - exiting 16:57:13 (7012): No heartbeat from core client for 30 sec - exiting 16:57:14 (7012): No heartbeat from core client for 30 sec - exiting 16:57:15 (7012): No heartbeat from core client for 30 sec - exiting 16:57:17 (7012): No heartbeat from core client for 30 sec - exiting 16:57:18 (7012): No heartbeat from core client for 30 sec - exiting 16:57:19 (7012): No heartbeat from core client for 30 sec - exiting 16:57:20 (7012): No heartbeat from core client for 30 sec - exiting 16:57:21 (7012): No heartbeat from core client for 30 sec - exiting 16:57:22 (7012): No heartbeat from core client for 30 sec - exiting 16:57:24 (7012): No heartbeat from core client for 30 sec - exiting 16:57:25 (7012): No heartbeat from core client for 30 sec - exiting 16:57:26 (7012): No heartbeat from core client for 30 sec - exiting 16:57:27 (7012): No heartbeat from core client for 30 sec - exiting 16:57:28 (7012): No heartbeat from core client for 30 sec - exiting 16:57:30 (7012): No heartbeat from core client for 30 sec - exiting 16:57:31 (7012): No heartbeat from core client for 30 sec - exiting 16:57:32 (7012): No heartbeat from core client for 30 sec - exiting 16:57:33 (7012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:18:15 (4384): No heartbeat from core client for 30 sec - exiting 17:18:16 (4384): No heartbeat from core client for 30 sec - exiting 17:18:17 (4384): No heartbeat from core client for 30 sec - exiting 17:18:19 (4384): No heartbeat from core client for 30 sec - exiting 17:18:20 (4384): No heartbeat from core client for 30 sec - exiting 17:18:21 (4384): No heartbeat from core client for 30 sec - exiting 17:18:22 (4384): No heartbeat from core client for 30 sec - exiting 17:18:23 (4384): No heartbeat from core client for 30 sec - exiting 17:18:24 (4384): No heartbeat from core client for 30 sec - exiting 17:18:25 (4384): No heartbeat from core client for 30 sec - exiting 17:18:26 (4384): No heartbeat from core client for 30 sec - exiting 17:18:27 (4384): No heartbeat from core client for 30 sec - exiting 17:18:28 (4384): No heartbeat from core client for 30 sec - exiting 17:18:30 (4384): No heartbeat from core client for 30 sec - exiting 17:18:31 (4384): No heartbeat from core client for 30 sec - exiting 17:18:32 (4384): No heartbeat from core client for 30 sec - exiting 17:18:33 (4384): No heartbeat from core client for 30 sec - exiting 17:18:34 (4384): No heartbeat from core client for 30 sec - exiting 17:18:35 (4384): No heartbeat from core client for 30 sec - exiting 17:18:37 (4384): No heartbeat from core client for 30 sec - exiting 17:18:38 (4384): No heartbeat from core client for 30 sec - exiting 17:18:39 (4384): No heartbeat from core client for 30 sec - exiting 17:18:40 (4384): No heartbeat from core client for 30 sec - exiting 17:18:43 (4384): No heartbeat from core client for 30 sec - exiting 17:18:44 (4384): No heartbeat from core client for 30 sec - exiting 17:18:45 (4384): No heartbeat from core client for 30 sec - exiting 17:18:46 (4384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x774A3232 read attempt to address 0x40A2F5BD Engaging BOINC Windows Runtime Debugger... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6688, selfPID=6688, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x774A3232 read attempt to address 0x40A2F5BD Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_p70g_1900_40_007226672/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Jun 2011 01:23:06	1044919	12833273	hadcm3n_p70g_1900_40_007226672_1	259,200	497,732	1.9203
02 Jun 2011 03:54:58	1044919	12833273	hadcm3n_p70g_1900_40_007226672_1	233,280	444,405	1.9050
29 May 2011 08:57:49	1044919	12833273	hadcm3n_p70g_1900_40_007226672_1	207,360	394,280	1.9014
28 May 2011 05:43:44	1044919	12833273	hadcm3n_p70g_1900_40_007226672_1	181,440	345,888	1.9063
23 May 2011 02:19:42	1044919	12833273	hadcm3n_p70g_1900_40_007226672_1	155,520	296,418	1.9060
21 May 2011 00:09:18	1044919	12833273	hadcm3n_p70g_1900_40_007226672_1	129,600	246,494	1.9020
17 May 2011 23:12:36	1044919	12833273	hadcm3n_p70g_1900_40_007226672_1	103,680	197,946	1.9092
14 May 2011 08:24:04	1044919	12833273	hadcm3n_p70g_1900_40_007226672_1	77,760	147,759	1.9002
10 May 2011 10:37:26	1044919	12833273	hadcm3n_p70g_1900_40_007226672_1	51,840	97,033	1.8718
09 May 2011 10:32:47	1044919	12833273	hadcm3n_p70g_1900_40_007226672_1	25,920	50,399	1.9444