climateprediction.net home page
Task 15196824

Task 15196824

Name hadcm3n_o25e_2100_40_008169075_1
Workunit 8324199
Created 28 Aug 2012, 16:59:23 UTC
Sent 28 Aug 2012, 18:09:21 UTC
Report deadline 28 Nov 2012, 1:36:32 UTC
Received 19 Sep 2012, 20:33:49 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 3 (0x00000003) Unknown error code
Computer ID 1188461
Run time 13 days 11 hours 32 min 56 sec
CPU time 12 days 22 hours 58 min 20 sec
Validate state Invalid
Credit 11,819.52
Device peak FLOPS 3.29 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.0.28</core_client_version>
<![CDATA[
<message>
The system cannot find the path specified. (0x3) - exit code 3 (0x3)
</message>
<stderr_txt>
o heartbeat from core client for 30 sec - exiting
23:01:05 (9856): No heartbeat from core client for 30 sec - exiting
23:01:06 (9856): No heartbeat from core client for 30 sec - exiting
23:01:07 (9856): No heartbeat from core client for 30 sec - exiting
23:01:08 (9856): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
23:04:49 (8420): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:04:50 (8420): No heartbeat from core client for 30 sec - exiting
23:04:51 (8420): No heartbeat from core client for 30 sec - exiting
23:04:52 (8420): No heartbeat from core client for 30 sec - exiting
23:04:53 (8420): No heartbeat from core client for 30 sec - exiting
23:04:54 (8420): No heartbeat from core client for 30 sec - exiting
23:04:55 (8420): No heartbeat from core client for 30 sec - exiting
23:04:56 (8420): No heartbeat from core client for 30 sec - exiting
23:04:57 (8420): No heartbeat from core client for 30 sec - exiting
23:04:58 (8420): No heartbeat from core client for 30 sec - exiting
23:04:59 (8420): No heartbeat from core client for 30 sec - exiting
23:06:54 (11248): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:06:55 (11248): No heartbeat from core client for 30 sec - exiting
23:06:56 (11248): No heartbeat from core client for 30 sec - exiting
23:06:57 (11248): No heartbeat from core client for 30 sec - exiting
23:06:58 (11248): No heartbeat from core client for 30 sec - exiting
23:06:59 (11248): No heartbeat from core client for 30 sec - exiting
23:07:00 (11248): No heartbeat from core client for 30 sec - exiting
23:07:01 (11248): No heartbeat from core client for 30 sec - exiting
23:07:02 (11248): No heartbeat from core client for 30 sec - exiting
23:07:03 (11248): No heartbeat from core client for 30 sec - exiting
23:07:04 (11248): No heartbeat from core client for 30 sec - exiting
23:10:55 (1608): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:10:56 (1608): No heartbeat from core client for 30 sec - exiting
23:10:57 (1608): No heartbeat from core client for 30 sec - exiting
23:10:58 (1608): No heartbeat from core client for 30 sec - exiting
23:10:59 (1608): No heartbeat from core client for 30 sec - exiting
23:11:00 (1608): No heartbeat from core client for 30 sec - exiting
23:11:01 (1608): No heartbeat from core client for 30 sec - exiting
23:11:02 (1608): No heartbeat from core client for 30 sec - exiting
23:11:03 (1608): No heartbeat from core client for 30 sec - exiting
23:11:04 (1608): No heartbeat from core client for 30 sec - exiting
23:11:05 (1608): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
23:14:48 (9120): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:14:49 (9120): No heartbeat from core client for 30 sec - exiting
23:14:50 (9120): No heartbeat from core client for 30 sec - exiting
23:14:51 (9120): No heartbeat from core client for 30 sec - exiting
23:14:52 (9120): No heartbeat from core client for 30 sec - exiting
23:14:53 (9120): No heartbeat from core client for 30 sec - exiting
23:14:54 (9120): No heartbeat from core client for 30 sec - exiting
23:14:55 (9120): No heartbeat from core client for 30 sec - exiting
23:14:56 (9120): No heartbeat from core client for 30 sec - exiting
23:14:57 (9120): No heartbeat from core client for 30 sec - exiting
23:14:58 (9120): No heartbeat from core client for 30 sec - exiting
23:17:01 (9660): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:17:02 (9660): No heartbeat from core client for 30 sec - exiting
23:17:03 (9660): No heartbeat from core client for 30 sec - exiting
23:17:04 (9660): No heartbeat from core client for 30 sec - exiting
23:17:05 (9660): No heartbeat from core client for 30 sec - exiting
23:17:06 (9660): No heartbeat from core client for 30 sec - exiting
23:17:07 (9660): No heartbeat from core client for 30 sec - exiting
23:17:08 (9660): No heartbeat from core client for 30 sec - exiting
23:17:09 (9660): No heartbeat from core client for 30 sec - exiting
23:17:10 (9660): No heartbeat from core client for 30 sec - exiting
23:17:11 (9660): No heartbeat from core client for 30 sec - exiting
23:20:58 (984): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:20:59 (984): No heartbeat from core client for 30 sec - exiting
23:21:00 (984): No heartbeat from core client for 30 sec - exiting
23:21:01 (984): No heartbeat from core client for 30 sec - exiting
23:21:02 (984): No heartbeat from core client for 30 sec - exiting
23:21:03 (984): No heartbeat from core client for 30 sec - exiting
23:21:04 (984): No heartbeat from core client for 30 sec - exiting
23:21:05 (984): No heartbeat from core client for 30 sec - exiting
23:21:06 (984): No heartbeat from core client for 30 sec - exiting
23:21:07 (984): No heartbeat from core client for 30 sec - exiting
23:21:08 (984): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
23:24:46 (11016): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:24:47 (11016): No heartbeat from core client for 30 sec - exiting
23:24:48 (11016): No heartbeat from core client for 30 sec - exiting
23:24:49 (11016): No heartbeat from core client for 30 sec - exiting
23:24:50 (11016): No heartbeat from core client for 30 sec - exiting
23:24:51 (11016): No heartbeat from core client for 30 sec - exiting
23:24:52 (11016): No heartbeat from core client for 30 sec - exiting
23:24:53 (11016): No heartbeat from core client for 30 sec - exiting
23:24:54 (11016): No heartbeat from core client for 30 sec - exiting
23:24:55 (11016): No heartbeat from core client for 30 sec - exiting
23:26:47 (11064): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:26:48 (11064): No heartbeat from core client for 30 sec - exiting
23:26:49 (11064): No heartbeat from core client for 30 sec - exiting
23:26:50 (11064): No heartbeat from core client for 30 sec - exiting
23:26:51 (11064): No heartbeat from core client for 30 sec - exiting
23:26:52 (11064): No heartbeat from core client for 30 sec - exiting
23:26:53 (11064): No heartbeat from core client for 30 sec - exiting
23:26:54 (11064): No heartbeat from core client for 30 sec - exiting
23:26:55 (11064): No heartbeat from core client for 30 sec - exiting
23:26:56 (11064): No heartbeat from core client for 30 sec - exiting
23:26:57 (11064): No heartbeat from core client for 30 sec - exiting
Atmos Restart file copy failed on o25eka.daw1270
23:28:44 (3748): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:28:45 (3748): No heartbeat from core client for 30 sec - exiting
23:28:46 (3748): No heartbeat from core client for 30 sec - exiting
23:28:47 (3748): No heartbeat from core client for 30 sec - exiting
23:28:48 (3748): No heartbeat from core client for 30 sec - exiting
23:28:49 (3748): No heartbeat from core client for 30 sec - exiting
23:28:50 (3748): No heartbeat from core client for 30 sec - exiting
23:28:51 (3748): No heartbeat from core client for 30 sec - exiting
23:28:52 (3748): No heartbeat from core client for 30 sec - exiting
23:28:53 (3748): No heartbeat from core client for 30 sec - exiting
23:28:54 (3748): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
23:30:52 (10000): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
23:32:46 (10460): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:32:47 (10460): No heartbeat from core client for 30 sec - exiting
23:32:48 (10460): No heartbeat from core client for 30 sec - exiting
23:32:49 (10460): No heartbeat from core client for 30 sec - exiting
23:32:50 (10460): No heartbeat from core client for 30 sec - exiting
23:32:51 (10460): No heartbeat from core client for 30 sec - exiting
23:34:48 (11228): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
23:36:45 (7068): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:36:46 (7068): No heartbeat from core client for 30 sec - exiting
23:36:47 (7068): No heartbeat from core client for 30 sec - exiting
23:36:48 (7068): No heartbeat from core client for 30 sec - exiting
23:36:49 (7068): No heartbeat from core client for 30 sec - exiting
23:36:50 (7068): No heartbeat from core client for 30 sec - exiting
23:36:51 (7068): No heartbeat from core client for 30 sec - exiting
23:36:52 (7068): No heartbeat from core client for 30 sec - exiting
23:36:53 (7068): No heartbeat from core client for 30 sec - exiting
23:36:54 (7068): No heartbeat from core client for 30 sec - exiting
23:36:55 (7068): No heartbeat from core client for 30 sec - exiting
23:38:46 (564): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:38:47 (564): No heartbeat from core client for 30 sec - exiting
23:38:48 (564): No heartbeat from core client for 30 sec - exiting
23:38:49 (564): No heartbeat from core client for 30 sec - exiting
23:38:50 (564): No heartbeat from core client for 30 sec - exiting
23:38:51 (564): No heartbeat from core client for 30 sec - exiting
23:38:52 (564): No heartbeat from core client for 30 sec - exiting
23:38:53 (564): No heartbeat from core client for 30 sec - exiting
23:38:54 (564): No heartbeat from core client for 30 sec - exiting
23:38:55 (564): No heartbeat from core client for 30 sec - exiting
23:38:56 (564): No heartbeat from core client for 30 sec - exiting
23:40:41 (9708): No heartbeat from core client for 30 sec - exiting
23:40:42 (9708): No heartbeat from core client for 30 sec - exiting
23:40:43 (9708): No heartbeat from core client for 30 sec - exiting
23:40:44 (9708): No heartbeat from core client for 30 sec - exiting
23:40:45 (9708): No heartbeat from core client for 30 sec - exiting
23:40:46 (9708): No heartbeat from core client for 30 sec - exiting
23:40:47 (9708): No heartbeat from core client for 30 sec - exiting
23:40:48 (9708): No heartbeat from core client for 30 sec - exiting
23:40:49 (9708): No heartbeat from core client for 30 sec - exiting
23:40:50 (9708): No heartbeat from core client for 30 sec - exiting
23:40:51 (9708): No heartbeat from core client for 30 sec - exiting
23:40:52 (9708): No heartbeat from core client for 30 sec - exiting
23:40:53 (9708): No heartbeat from core client for 30 sec - exiting
23:40:54 (9708): No heartbeat from core client for 30 sec - exiting
23:40:55 (9708): No heartbeat from core client for 30 sec - exiting
23:40:56 (9708): No heartbeat from core client for 30 sec - exiting
23:40:57 (9708): No heartbeat from core client for 30 sec - exiting
23:40:58 (9708): No heartbeat from core client for 30 sec - exiting
23:40:59 (9708): No heartbeat from core client for 30 sec - exiting
23:41:00 (9708): No heartbeat from core client for 30 sec - exiting
23:41:01 (9708): No heartbeat from core client for 30 sec - exiting
23:41:02 (9708): No heartbeat from core client for 30 sec - exiting
23:41:03 (9708): No heartbeat from core client for 30 sec - exiting
23:41:04 (9708): No heartbeat from core client for 30 sec - exiting
23:41:05 (9708): No heartbeat from core client for 30 sec - exiting
23:41:06 (9708): No heartbeat from core client for 30 sec - exiting
23:41:07 (9708): No heartbeat from core client for 30 sec - exiting
23:41:08 (9708): No heartbeat from core client for 30 sec - exiting
23:41:09 (9708): No heartbeat from core client for 30 sec - exiting
23:41:10 (9708): No heartbeat from core client for 30 sec - exiting
23:41:11 (9708): No heartbeat from core client for 30 sec - exiting
23:41:12 (9708): No heartbeat from core client for 30 sec - exiting
23:41:13 (9708): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
23:42:23 (9924): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
23:44:34 (10156): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:46:44 (10704): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:46:45 (10704): No heartbeat from core client for 30 sec - exiting
23:46:46 (10704): No heartbeat from core client for 30 sec - exiting
23:46:47 (10704): No heartbeat from core client for 30 sec - exiting
23:46:48 (10704): No heartbeat from core client for 30 sec - exiting
23:46:49 (10704): No heartbeat from core client for 30 sec - exiting
23:46:50 (10704): No heartbeat from core client for 30 sec - exiting
23:46:51 (10704): No heartbeat from core client for 30 sec - exiting
23:46:52 (10704): No heartbeat from core client for 30 sec - exiting
23:46:53 (10704): No heartbeat from core client for 30 sec - exiting
23:46:54 (10704): No heartbeat from core client for 30 sec - exiting
23:50:03 (10112): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:59:04 (9996): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:59:05 (9996): No heartbeat from core client for 30 sec - exiting
00:00:24 (8872): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:02:55 (11012): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:02:56 (11012): No heartbeat from core client for 30 sec - exiting
00:02:57 (11012): No heartbeat from core client for 30 sec - exiting
00:02:58 (11012): No heartbeat from core client for 30 sec - exiting
00:02:59 (11012): No heartbeat from core client for 30 sec - exiting
00:03:00 (11012): No heartbeat from core client for 30 sec - exiting
00:03:01 (11012): No heartbeat from core client for 30 sec - exiting
00:03:02 (11012): No heartbeat from core client for 30 sec - exiting
00:03:03 (11012): No heartbeat from core client for 30 sec - exiting
00:03:04 (11012): No heartbeat from core client for 30 sec - exiting
00:03:05 (11012): No heartbeat from core client for 30 sec - exiting
00:06:47 (10620): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:06:48 (10620): No heartbeat from core client for 30 sec - exiting
00:06:49 (10620): No heartbeat from core client for 30 sec - exiting
00:06:50 (10620): No heartbeat from core client for 30 sec - exiting
00:06:51 (10620): No heartbeat from core client for 30 sec - exiting
00:06:52 (10620): No heartbeat from core client for 30 sec - exiting
00:06:53 (10620): No heartbeat from core client for 30 sec - exiting
00:06:54 (10620): No heartbeat from core client for 30 sec - exiting
00:06:55 (10620): No heartbeat from core client for 30 sec - exiting
00:06:56 (10620): No heartbeat from core client for 30 sec - exiting
00:06:57 (10620): No heartbeat from core client for 30 sec - exiting
00:09:05 (6228): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:09:06 (6228): No heartbeat from core client for 30 sec - exiting
00:09:07 (6228): No heartbeat from core client for 30 sec - exiting
00:09:08 (6228): No heartbeat from core client for 30 sec - exiting
00:09:09 (6228): No heartbeat from core client for 30 sec - exiting
00:09:10 (6228): No heartbeat from core client for 30 sec - exiting
00:09:11 (6228): No heartbeat from core client for 30 sec - exiting
00:09:12 (6228): No heartbeat from core client for 30 sec - exiting
00:09:13 (6228): No heartbeat from core client for 30 sec - exiting
00:09:14 (6228): No heartbeat from core client for 30 sec - exiting
00:09:15 (6228): No heartbeat from core client for 30 sec - exiting
00:24:43 (6596): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:24:44 (6596): No heartbeat from core client for 30 sec - exiting
00:24:45 (6596): No heartbeat from core client for 30 sec - exiting
00:24:46 (6596): No heartbeat from core client for 30 sec - exiting
00:24:47 (6596): No heartbeat from core client for 30 sec - exiting
00:24:48 (6596): No heartbeat from core client for 30 sec - exiting
00:24:49 (6596): No heartbeat from core client for 30 sec - exiting
00:24:50 (6596): No heartbeat from core client for 30 sec - exiting
00:24:51 (6596): No heartbeat from core client for 30 sec - exiting
00:24:52 (6596): No heartbeat from core client for 30 sec - exiting
00:24:53 (6596): No heartbeat from core client for 30 sec - exiting
00:30:38 (11220): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:30:39 (11220): No heartbeat from core client for 30 sec - exiting
00:30:40 (11220): No heartbeat from core client for 30 sec - exiting
00:30:41 (11220): No heartbeat from core client for 30 sec - exiting
00:30:42 (11220): No heartbeat from core client for 30 sec - exiting
00:30:43 (11220): No heartbeat from core client for 30 sec - exiting
00:30:44 (11220): No heartbeat from core client for 30 sec - exiting
00:30:45 (11220): No heartbeat from core client for 30 sec - exiting
00:30:46 (11220): No heartbeat from core client for 30 sec - exiting
00:30:47 (11220): No heartbeat from core client for 30 sec - exiting
00:30:48 (11220): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
00:33:05 (6980): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:33:06 (6980): No heartbeat from core client for 30 sec - exiting
00:33:07 (6980): No heartbeat from core client for 30 sec - exiting
00:33:08 (6980): No heartbeat from core client for 30 sec - exiting
00:33:09 (6980): No heartbeat from core client for 30 sec - exiting
00:33:10 (6980): No heartbeat from core client for 30 sec - exiting
00:33:11 (6980): No heartbeat from core client for 30 sec - exiting
00:33:12 (6980): No heartbeat from core client for 30 sec - exiting
00:33:13 (6980): No heartbeat from core client for 30 sec - exiting
00:33:14 (6980): No heartbeat from core client for 30 sec - exiting
00:33:15 (6980): No heartbeat from core client for 30 sec - exiting
00:34:50 (10864): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:34:51 (10864): No heartbeat from core client for 30 sec - exiting
00:34:52 (10864): No heartbeat from core client for 30 sec - exiting
00:34:53 (10864): No heartbeat from core client for 30 sec - exiting
00:34:54 (10864): No heartbeat from core client for 30 sec - exiting
00:34:55 (10864): No heartbeat from core client for 30 sec - exiting
00:34:56 (10864): No heartbeat from core client for 30 sec - exiting
00:34:57 (10864): No heartbeat from core client for 30 sec - exiting
00:34:58 (10864): No heartbeat from core client for 30 sec - exiting
00:34:59 (10864): No heartbeat from core client for 30 sec - exiting
00:35:00 (10864): No heartbeat from core client for 30 sec - exiting
00:38:56 (576): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:38:57 (576): No heartbeat from core client for 30 sec - exiting
00:38:58 (576): No heartbeat from core client for 30 sec - exiting
00:38:59 (576): No heartbeat from core client for 30 sec - exiting
00:39:00 (576): No heartbeat from core client for 30 sec - exiting
00:39:01 (576): No heartbeat from core client for 30 sec - exiting
00:39:02 (576): No heartbeat from core client for 30 sec - exiting
00:39:03 (576): No heartbeat from core client for 30 sec - exiting
00:39:04 (576): No heartbeat from core client for 30 sec - exiting
00:39:05 (576): No heartbeat from core client for 30 sec - exiting
00:39:06 (576): No heartbeat from core client for 30 sec - exiting
00:44:52 (10420): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:44:53 (10420): No heartbeat from core client for 30 sec - exiting
00:44:54 (10420): No heartbeat from core client for 30 sec - exiting
00:44:55 (10420): No heartbeat from core client for 30 sec - exiting
00:44:56 (10420): No heartbeat from core client for 30 sec - exiting
00:44:57 (10420): No heartbeat from core client for 30 sec - exiting
00:44:58 (10420): No heartbeat from core client for 30 sec - exiting
00:44:59 (10420): No heartbeat from core client for 30 sec - exiting
00:45:00 (10420): No heartbeat from core client for 30 sec - exiting
00:45:01 (10420): No heartbeat from core client for 30 sec - exiting
00:56:12 (10664): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
01:00:57 (11156): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:00:58 (11156): No heartbeat from core client for 30 sec - exiting
01:00:59 (11156): No heartbeat from core client for 30 sec - exiting
01:01:00 (11156): No heartbeat from core client for 30 sec - exiting
01:01:01 (11156): No heartbeat from core client for 30 sec - exiting
01:01:02 (11156): No heartbeat from core client for 30 sec - exiting
01:01:03 (11156): No heartbeat from core client for 30 sec - exiting
01:01:04 (11156): No heartbeat from core client for 30 sec - exiting
01:01:05 (11156): No heartbeat from core client for 30 sec - exiting
01:01:06 (11156): No heartbeat from core client for 30 sec - exiting
01:01:07 (11156): No heartbeat from core client for 30 sec - exiting
01:25:07 (10688): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:25:08 (10688): No heartbeat from core client for 30 sec - exiting
01:25:09 (10688): No heartbeat from core client for 30 sec - exiting
01:25:10 (10688): No heartbeat from core client for 30 sec - exiting
01:25:11 (10688): No heartbeat from core client for 30 sec - exiting
01:25:12 (10688): No heartbeat from core client for 30 sec - exiting
01:25:45 (7288): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
01:45:00 (9500): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:45:01 (9500): No heartbeat from core client for 30 sec - exiting
01:45:02 (9500): No heartbeat from core client for 30 sec - exiting
01:45:03 (9500): No heartbeat from core client for 30 sec - exiting
01:45:04 (9500): No heartbeat from core client for 30 sec - exiting
01:45:37 (5108): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
02:05:01 (1740): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:05:02 (1740): No heartbeat from core client for 30 sec - exiting
02:05:03 (1740): No heartbeat from core client for 30 sec - exiting
02:05:04 (1740): No heartbeat from core client for 30 sec - exiting
02:05:05 (1740): No heartbeat from core client for 30 sec - exiting
02:22:56 (10376): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:22:57 (10376): No heartbeat from core client for 30 sec - exiting
02:22:58 (10376): No heartbeat from core client for 30 sec - exiting
02:22:59 (10376): No heartbeat from core client for 30 sec - exiting
02:23:00 (10376): No heartbeat from core client for 30 sec - exiting
02:23:01 (10376): No heartbeat from core client for 30 sec - exiting
02:23:02 (10376): No heartbeat from core client for 30 sec - exiting
02:23:03 (10376): No heartbeat from core client for 30 sec - exiting
02:23:04 (10376): No heartbeat from core client for 30 sec - exiting
02:23:05 (10376): No heartbeat from core client for 30 sec - exiting
02:23:06 (10376): No heartbeat from core client for 30 sec - exiting
02:23:49 (11188): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
02:31:05 (9484): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:31:06 (9484): No heartbeat from core client for 30 sec - exiting
02:31:07 (9484): No heartbeat from core client for 30 sec - exiting
02:31:08 (9484): No heartbeat from core client for 30 sec - exiting
02:31:09 (9484): No heartbeat from core client for 30 sec - exiting
02:31:10 (9484): No heartbeat from core client for 30 sec - exiting
02:31:11 (9484): No heartbeat from core client for 30 sec - exiting
02:31:12 (9484): No heartbeat from core client for 30 sec - exiting
02:31:13 (9484): No heartbeat from core client for 30 sec - exiting
02:31:14 (9484): No heartbeat from core client for 30 sec - exiting
02:31:15 (9484): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
02:36:54 (8104): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:36:55 (8104): No heartbeat from core client for 30 sec - exiting
02:36:56 (8104): No heartbeat from core client for 30 sec - exiting
02:36:57 (8104): No heartbeat from core client for 30 sec - exiting
02:36:58 (8104): No heartbeat from core client for 30 sec - exiting
02:36:59 (8104): No heartbeat from core client for 30 sec - exiting
02:37:00 (8104): No heartbeat from core client for 30 sec - exiting
02:37:01 (8104): No heartbeat from core client for 30 sec - exiting
02:37:02 (8104): No heartbeat from core client for 30 sec - exiting
02:37:03 (8104): No heartbeat from core client for 30 sec - exiting
02:37:04 (8104): No heartbeat from core client for 30 sec - exiting
02:41:06 (7588): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:41:07 (7588): No heartbeat from core client for 30 sec - exiting
02:41:08 (7588): No heartbeat from core client for 30 sec - exiting
02:41:09 (7588): No heartbeat from core client for 30 sec - exiting
02:41:10 (7588): No heartbeat from core client for 30 sec - exiting
02:41:11 (7588): No heartbeat from core client for 30 sec - exiting
02:41:12 (7588): No heartbeat from core client for 30 sec - exiting
02:41:13 (7588): No heartbeat from core client for 30 sec - exiting
02:41:14 (7588): No heartbeat from core client for 30 sec - exiting
02:41:15 (7588): No heartbeat from core client for 30 sec - exiting
02:41:16 (7588): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
02:51:52 (6824): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
03:01:07 (6968): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:01:08 (6968): No heartbeat from core client for 30 sec - exiting
03:01:09 (6968): No heartbeat from core client for 30 sec - exiting
03:01:10 (6968): No heartbeat from core client for 30 sec - exiting
03:01:11 (6968): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
03:11:09 (10320): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:11:10 (10320): No heartbeat from core client for 30 sec - exiting
03:11:11 (10320): No heartbeat from core client for 30 sec - exiting
03:11:12 (10320): No heartbeat from core client for 30 sec - exiting
03:11:13 (10320): No heartbeat from core client for 30 sec - exiting
03:11:14 (10320): No heartbeat from core client for 30 sec - exiting
03:11:15 (10320): No heartbeat from core client for 30 sec - exiting
03:11:16 (10320): No heartbeat from core client for 30 sec - exiting
03:11:17 (10320): No heartbeat from core client for 30 sec - exiting
03:11:18 (10320): No heartbeat from core client for 30 sec - exiting
03:11:19 (10320): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
03:21:10 (8060): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:21:11 (8060): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
03:31:10 (10496): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:31:11 (10496): No heartbeat from core client for 30 sec - exiting
03:31:12 (10496): No heartbeat from core client for 30 sec - exiting
03:31:13 (10496): No heartbeat from core client for 30 sec - exiting
03:31:14 (10496): No heartbeat from core client for 30 sec - exiting
03:31:15 (10496): No heartbeat from core client for 30 sec - exiting
03:31:16 (10496): No heartbeat from core client for 30 sec - exiting
03:31:17 (10496): No heartbeat from core client for 30 sec - exiting
03:31:18 (10496): No heartbeat from core client for 30 sec - exiting
03:31:19 (10496): No heartbeat from core client for 30 sec - exiting
03:31:20 (10496): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
03:42:45 (9484): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:42:46 (9484): No heartbeat from core client for 30 sec - exiting
03:42:47 (9484): No heartbeat from core client for 30 sec - exiting
03:42:48 (9484): No heartbeat from core client for 30 sec - exiting
03:42:49 (9484): No heartbeat from core client for 30 sec - exiting
03:42:50 (9484): No heartbeat from core client for 30 sec - exiting
03:42:51 (9484): No heartbeat from core client for 30 sec - exiting
03:42:52 (9484): No heartbeat from core client for 30 sec - exiting
03:42:53 (9484): No heartbeat from core client for 30 sec - exiting
03:42:54 (9484): No heartbeat from core client for 30 sec - exiting
03:42:55 (9484): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
03:43:59 (956): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:44:49 (10124): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
forrtl: There is not enough space on the disk.

Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10484, iMonCtr=1
Model crash detected, will try to restart...
Ocean Restart file copy failed on o25eko.daw1610
Ocean Restart file copy failed on o25eko.daw17k0
Ocean Restart file copy failed on o25eko.daw1a30
Ocean Restart file copy failed on o25eko.daw1ao0
Ocean Restart file copy failed on o25eko.daw1co0
Atmos Hold Restart file rename failed on atmos_restart.hold
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.daw2240
Ocean Restart file copy failed on o25eko.daw24a0
Ocean Restart file copy failed on o25eko.daw25b0
Ocean Restart file copy failed on o25eko.daw2620
Ocean Restart file copy failed on o25eko.daw26a0
Ocean Restart file copy failed on o25eko.daw26u0
19:17:20 (7804): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.daw3110
Ocean Restart file copy failed on o25eko.daw3140
Ocean Restart file copy failed on o25eko.daw3520
Ocean Restart file copy failed on o25eko.daw36n0
Ocean Restart file copy failed on o25eko.daw36t0
Ocean Restart file copy failed on o25eko.daw3750
Ocean Restart file copy failed on o25eko.daw37g0
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.daw37r0
Ocean Restart file copy failed on o25eko.daw3820
Atmos Hold Restart file rename failed on atmos_restart.hold
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.daw3bh0
Ocean Restart file copy failed on o25eko.daw3bo0
Ocean Restart file copy failed on o25eko.daw3br0
Ocean Restart file copy failed on o25eko.daw3cn0
Ocean Restart file copy failed on o25eko.daw42l0
Ocean Restart file copy failed on o25eko.daw42u0
Ocean Restart file copy failed on o25eko.daw44i0
Ocean Restart file copy failed on o25eko.daw44u0
Suspended CPDN Monitor - Suspend request from BOINC...
Ocean Restart file copy failed on o25eko.daw45m0
Ocean Restart file copy failed on o25eko.daw46c0
Suspended CPDN Monitor - Suspend request from BOINC...
Ocean Restart file copy failed on o25eko.daw47i0
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.daw47p0
Ocean Restart file copy failed on o25eko.daw47t0
Ocean Restart file copy failed on o25eko.daw49g0
Ocean Restart file copy failed on o25eko.daw49j0
Ocean Restart file copy failed on o25eko.daw4ch0
Ocean Restart file copy failed on o25eko.daw51j0
Suspended CPDN Monitor - Suspend request from BOINC...
Ocean Restart file copy failed on o25eko.daw52l0
Ocean Restart file copy failed on o25eko.daw53i0
Ocean Restart file copy failed on o25eko.daw5490
Ocean Restart file copy failed on o25eko.daw57i0
Ocean Restart file copy failed on o25eko.daw58u0
Ocean Restart file copy failed on o25eko.daw5980
Ocean Restart file copy failed on o25eko.daw59p0
Ocean Restart file copy failed on o25eko.daw5ai0
Ocean Restart file copy failed on o25eko.daw5an0
Ocean Restart file copy failed on o25eko.daw5bm0
Ocean Restart file copy failed on o25eko.daw5c50
Ocean Restart file copy failed on o25eko.daw61j0
Ocean Restart file copy failed on o25eko.daw62l0
Ocean Restart file copy failed on o25eko.daw62m0
Ocean Restart file copy failed on o25eko.daw62n0
Ocean Restart file copy failed on o25eko.daw63k0
Atmos Hold Restart file rename failed on atmos_restart.hold
Atmos Hold Restart file rename failed on atmos_restart.hold
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.daw66k0
Ocean Restart file copy failed on o25eko.daw6820
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.daw6bq0
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.daw7240
Ocean Restart file copy failed on o25eko.daw72b0
Ocean Restart file copy failed on o25eko.daw72q0
Ocean Restart file copy failed on o25eko.daw73d0
Ocean Restart file copy failed on o25eko.daw79a0
Ocean Restart file copy failed on o25eko.daw79l0
Ocean Restart file copy failed on o25eko.daw7b10
Ocean Restart file copy failed on o25eko.daw7b50
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.daw7c70
Ocean Restart file copy failed on o25eko.daw7cl0
Ocean Restart file copy failed on o25eko.daw82o0
Ocean Restart file copy failed on o25eko.daw83f0
Ocean Restart file copy failed on o25eko.daw84d0
Ocean Restart file copy failed on o25eko.daw85i0
Ocean Restart file copy failed on o25eko.daw86i0
Ocean Restart file copy failed on o25eko.daw86m0
Ocean Restart file copy failed on o25eko.daw86u0
Ocean Restart file copy failed on o25eko.daw87n0
Ocean Restart file copy failed on o25eko.daw88f0
Ocean Restart file copy failed on o25eko.daw88j0
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.daw8ao0
Ocean Restart file copy failed on o25eko.daw8aq0
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.daw8bk0
Ocean Restart file copy failed on o25eko.daw8bt0
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.daw8cg0
Ocean Restart file copy failed on o25eko.daw8cm0
Ocean Restart file copy failed on o25eko.daw8co0
Ocean Restart file copy failed on o25eko.daw91g0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Ocean Restart file copy failed on o25eko.daw94k0
Ocean Restart file copy failed on o25eko.daw94n0
Ocean Restart file copy failed on o25eko.daw95p0
Ocean Restart file copy failed on o25eko.daw97k0
Ocean Restart file copy failed on o25eko.daw9840
Ocean Restart file copy failed on o25eko.daw98m0
Ocean Restart file copy failed on o25eko.daw9bm0
Ocean Restart file copy failed on o25eko.daw9cs0
Ocean Restart file copy failed on o25eko.dax01a0
Ocean Restart file copy failed on o25eko.dax01g0
Ocean Restart file copy failed on o25eko.dax02j0
Suspended CPDN Monitor - Suspend request from BOINC...
Ocean Restart file copy failed on o25eko.dax0380
Ocean Restart file copy failed on o25eko.dax03o0
Ocean Restart file copy failed on o25eko.dax03q0
Atmos Hold Restart file rename failed on atmos_restart.hold
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.dax07m0
Ocean Restart file copy failed on o25eko.dax08t0
Atmos Hold Restart file rename failed on atmos_restart.hold
Suspended CPDN Monitor - Suspend request from BOINC...
Ocean Restart file copy failed on o25eko.dax1250
Ocean Restart file copy failed on o25eko.dax12d0
Ocean Restart file copy failed on o25eko.dax13l0
Ocean Restart file copy failed on o25eko.dax1580
Ocean Restart file copy failed on o25eko.dax18p0
Ocean Restart file copy failed on o25eko.dax1ad0
Ocean Restart file copy failed on o25eko.dax1c40
Ocean Restart file copy failed on o25eko.dax21q0
Ocean Restart file copy failed on o25eko.dax2340
Ocean Restart file copy failed on o25eko.dax2590
Ocean Restart file copy failed on o25eko.dax25k0
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.dax26r0
Atmos Hold Restart file rename failed on atmos_restart.hold
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.dax2a60
Ocean Restart file copy failed on o25eko.dax2b60
Ocean Restart file copy failed on o25eko.dax32b0
Ocean Restart file copy failed on o25eko.dax32e0
Ocean Restart file copy failed on o25eko.dax32k0
Ocean Restart file copy failed on o25eko.dax34j0
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.dax36f0
Ocean Restart file copy failed on o25eko.dax3780
Ocean Restart file copy failed on o25eko.dax37g0
Ocean Restart file copy failed on o25eko.dax37m0
Ocean Restart file copy failed on o25eko.dax38q0
Ocean Restart file copy failed on o25eko.dax39b0
Ocean Restart file copy failed on o25eko.dax39o0
Ocean Restart file copy failed on o25eko.dax41q0
Ocean Restart file copy failed on o25eko.dax4410
Ocean Restart file copy failed on o25eko.dax44d0
Ocean Restart file copy failed on o25eko.dax46a0
Ocean Restart file copy failed on o25eko.dax48e0
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.dax4ai0
Ocean Restart file copy failed on o25eko.dax4c30
Ocean Restart file copy failed on o25eko.dax4c60
Ocean Restart file copy failed on o25eko.dax4cf0
Ocean Restart file copy failed on o25eko.dax4ck0
Ocean Restart file copy failed on o25eko.dax4cq0
Suspended CPDN Monitor - Suspend request from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.dax52i0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Ocean Restart file copy failed on o25eko.dax56b0
Ocean Restart file copy failed on o25eko.dax56o0
Ocean Restart file copy failed on o25eko.dax57d0
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.dax5ac0
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.dax5ao0
Ocean Restart file copy failed on o25eko.dax5c20
Ocean Restart file copy failed on o25eko.dax5c50
Ocean Restart file copy failed on o25eko.dax5c70
Ocean Restart file copy failed on o25eko.dax5cg0
Ocean Restart file copy failed on o25eko.dax5cu0
Ocean Restart file copy failed on o25eko.dax6390
Ocean Restart file copy failed on o25eko.dax64d0
Ocean Restart file copy failed on o25eko.dax64s0
Ocean Restart file copy failed on o25eko.dax67t0
Ocean Restart file copy failed on o25eko.dax69h0
Ocean Restart file copy failed on o25eko.dax6bo0
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.dax72i0
Ocean Restart file copy failed on o25eko.dax74i0
Ocean Restart file copy failed on o25eko.dax74l0
Ocean Restart file copy failed on o25eko.dax75l0
Ocean Restart file copy failed on o25eko.dax76t0
Ocean Restart file copy failed on o25eko.dax77u0
Ocean Restart file copy failed on o25eko.dax7ak0
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.dax7cu0
Atmos Hold Restart file rename failed on atmos_restart.hold
Atmos Hold Restart file rename failed on atmos_restart.hold
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.dax86i0
Ocean Restart file copy failed on o25eko.dax87c0
Ocean Restart file copy failed on o25eko.dax8980
Ocean Restart file copy failed on o25eko.dax89n0
Ocean Restart file copy failed on o25eko.dax8ag0
Ocean Restart file copy failed on o25eko.dax8au0
Ocean Restart file copy failed on o25eko.dax8b90
Atmos Hold Restart file rename failed on atmos_restart.hold
Ocean Restart file copy failed on o25eko.dax9150
Ocean Restart file copy failed on o25eko.dax92l0
Ocean Restart file copy failed on o25eko.dax9330
Ocean Restart file copy failed on o25eko.dax93q0
Ocean Restart file copy failed on o25eko.dax9510
Ocean Restart file copy failed on o25eko.dax95a0
Ocean Restart file copy failed on o25eko.dax96s0
22:18:46 (5324): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:18:47 (5324): No heartbeat from core client for 30 sec - exiting
22:18:48 (5324): No heartbeat from core client for 30 sec - exiting
22:18:49 (5324): No heartbeat from core client for 30 sec - exiting
22:18:50 (5324): No heartbeat from core client for 30 sec - exiting
22:18:51 (5324): No heartbeat from core client for 30 sec - exiting
22:18:52 (5324): No heartbeat from core client for 30 sec - exiting
22:18:53 (5324): No heartbeat from core client for 30 sec - exiting
22:18:54 (5324): No heartbeat from core client for 30 sec - exiting
22:18:55 (5324): No heartbeat from core client for 30 sec - exiting
22:18:56 (5324): No heartbeat from core client for 30 sec - exiting
22:18:57 (5324): No heartbeat from core client for 30 sec - exiting
22:18:58 (5324): No heartbeat from core client for 30 sec - exiting
22:18:59 (5324): No heartbeat from core client for 30 sec - exiting
22:19:00 (5324): No heartbeat from core client for 30 sec - exiting
22:19:01 (5324): No heartbeat from core client for 30 sec - exiting
22:19:02 (5324): No heartbeat from core client for 30 sec - exiting
22:19:03 (5324): No heartbeat from core client for 30 sec - exiting
22:19:04 (5324): No heartbeat from core client for 30 sec - exiting
22:19:05 (5324): No heartbeat from core client for 30 sec - exiting
22:19:06 (5324): No heartbeat from core client for 30 sec - exiting
22:19:07 (5324): No heartbeat from core client for 30 sec - exiting
22:38:46 (6300): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:38:47 (6300): No heartbeat from core client for 30 sec - exiting
22:38:48 (6300): No heartbeat from core client for 30 sec - exiting
22:38:49 (6300): No heartbeat from core client for 30 sec - exiting
22:38:50 (6300): No heartbeat from core client for 30 sec - exiting
22:38:51 (6300): No heartbeat from core client for 30 sec - exiting
22:38:52 (6300): No heartbeat from core client for 30 sec - exiting
22:38:53 (6300): No heartbeat from core client for 30 sec - exiting
22:58:44 (2444): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:58:46 (2444): No heartbeat from core client for 30 sec - exiting
22:58:47 (2444): No heartbeat from core client for 30 sec - exiting
22:58:48 (2444): No heartbeat from core client for 30 sec - exiting
22:58:49 (2444): No heartbeat from core client for 30 sec - exiting
22:58:50 (2444): No heartbeat from core client for 30 sec - exiting
22:58:51 (2444): No heartbeat from core client for 30 sec - exiting
22:58:52 (2444): No heartbeat from core client for 30 sec - exiting
22:58:53 (2444): No heartbeat from core client for 30 sec - exiting
22:58:54 (2444): No heartbeat from core client for 30 sec - exiting
22:58:55 (2444): No heartbeat from core client for 30 sec - exiting
22:59:56 (8416): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
23:08:47 (6552): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:08:48 (6552): No heartbeat from core client for 30 sec - exiting
23:08:49 (6552): No heartbeat from core client for 30 sec - exiting
23:08:50 (6552): No heartbeat from core client for 30 sec - exiting
23:08:51 (6552): No heartbeat from core client for 30 sec - exiting
23:08:52 (6552): No heartbeat from core client for 30 sec - exiting
23:08:53 (6552): No heartbeat from core client for 30 sec - exiting
23:08:54 (6552): No heartbeat from core client for 30 sec - exiting
23:08:55 (6552): No heartbeat from core client for 30 sec - exiting
23:08:56 (6552): No heartbeat from core client for 30 sec - exiting
23:08:57 (6552): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
23:18:44 (1064): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:18:45 (1064): No heartbeat from core client for 30 sec - exiting
23:18:46 (1064): No heartbeat from core client for 30 sec - exiting
23:18:47 (1064): No heartbeat from core client for 30 sec - exiting
23:18:48 (1064): No heartbeat from core client for 30 sec - exiting
23:18:49 (1064): No heartbeat from core client for 30 sec - exiting
23:18:50 (1064): No heartbeat from core client for 30 sec - exiting
23:18:51 (1064): No heartbeat from core client for 30 sec - exiting
23:18:52 (1064): No heartbeat from core client for 30 sec - exiting
23:18:53 (1064): No heartbeat from core client for 30 sec - exiting
23:18:54 (1064): No heartbeat from core client for 30 sec - exiting
Ocean Restart file copy failed on o25eko.dax9940
Atmos Hold Restart file rename failed on atmos_restart.hold
23:48:44 (7896): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:48:45 (7896): No heartbeat from core client for 30 sec - exiting
23:48:46 (7896): No heartbeat from core client for 30 sec - exiting
23:48:47 (7896): No heartbeat from core client for 30 sec - exiting
23:48:48 (7896): No heartbeat from core client for 30 sec - exiting
23:48:49 (7896): No heartbeat from core client for 30 sec - exiting
23:48:50 (7896): No heartbeat from core client for 30 sec - exiting
00:07:50 (8876): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:14:53 (7368): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:14:54 (7368): No heartbeat from core client for 30 sec - exiting
00:14:55 (7368): No heartbeat from core client for 30 sec - exiting
00:14:56 (7368): No heartbeat from core client for 30 sec - exiting
00:14:57 (7368): No heartbeat from core client for 30 sec - exiting
00:14:58 (7368): No heartbeat from core client for 30 sec - exiting
00:14:59 (7368): No heartbeat from core client for 30 sec - exiting
00:15:00 (7368): No heartbeat from core client for 30 sec - exiting
00:15:01 (7368): No heartbeat from core client for 30 sec - exiting
00:15:02 (7368): No heartbeat from core client for 30 sec - exiting
00:15:03 (7368): No heartbeat from core client for 30 sec - exiting
00:21:16 (10960): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:21:17 (10960): No heartbeat from core client for 30 sec - exiting
00:21:18 (10960): No heartbeat from core client for 30 sec - exiting
00:21:19 (10960): No heartbeat from core client for 30 sec - exiting
00:21:20 (10960): No heartbeat from core client for 30 sec - exiting
00:21:21 (10960): No heartbeat from core client for 30 sec - exiting
00:21:22 (10960): No heartbeat from core client for 30 sec - exiting
00:21:23 (10960): No heartbeat from core client for 30 sec - exiting
00:21:24 (10960): No heartbeat from core client for 30 sec - exiting
00:21:25 (10960): No heartbeat from core client for 30 sec - exiting
00:21:26 (10960): No heartbeat from core client for 30 sec - exiting
00:24:55 (10300): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:34:53 (2436): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:34:54 (2436): No heartbeat from core client for 30 sec - exiting
00:34:55 (2436): No heartbeat from core client for 30 sec - exiting
00:34:56 (2436): No heartbeat from core client for 30 sec - exiting
00:34:57 (2436): No heartbeat from core client for 30 sec - exiting
00:34:58 (2436): No heartbeat from core client for 30 sec - exiting
00:36:53 (9116): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:36:54 (9116): No heartbeat from core client for 30 sec - exiting
00:36:55 (9116): No heartbeat from core client for 30 sec - exiting
00:36:56 (9116): No heartbeat from core client for 30 sec - exiting
00:36:57 (9116): No heartbeat from core client for 30 sec - exiting
00:36:58 (9116): No heartbeat from core client for 30 sec - exiting
00:36:59 (9116): No heartbeat from core client for 30 sec - exiting
00:37:00 (9116): No heartbeat from core client for 30 sec - exiting
00:37:01 (9116): No heartbeat from core client for 30 sec - exiting
00:37:02 (9116): No heartbeat from core client for 30 sec - exiting
00:37:03 (9116): No heartbeat from core client for 30 sec - exiting
01:02:48 (9968): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:02:49 (9968): No heartbeat from core client for 30 sec - exiting
01:02:50 (9968): No heartbeat from core client for 30 sec - exiting
01:02:51 (9968): No heartbeat from core client for 30 sec - exiting
01:02:52 (9968): No heartbeat from core client for 30 sec - exiting
01:02:53 (9968): No heartbeat from core client for 30 sec - exiting
01:02:54 (9968): No heartbeat from core client for 30 sec - exiting
01:02:55 (9968): No heartbeat from core client for 30 sec - exiting
01:02:56 (9968): No heartbeat from core client for 30 sec - exiting
01:02:57 (9968): No heartbeat from core client for 30 sec - exiting
01:02:58 (9968): No heartbeat from core client for 30 sec - exiting
01:04:19 (10336): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:06:57 (5332): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:06:58 (5332): No heartbeat from core client for 30 sec - exiting
01:06:59 (5332): No heartbeat from core client for 30 sec - exiting
01:07:00 (5332): No heartbeat from core client for 30 sec - exiting
01:07:01 (5332): No heartbeat from core client for 30 sec - exiting
01:52:44 (4012): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:52:45 (4012): No heartbeat from core client for 30 sec - exiting
01:52:46 (4012): No heartbeat from core client for 30 sec - exiting
01:52:47 (4012): No heartbeat from core client for 30 sec - exiting
01:52:48 (4012): No heartbeat from core client for 30 sec - exiting
01:52:49 (4012): No heartbeat from core client for 30 sec - exiting
01:52:50 (4012): No heartbeat from core client for 30 sec - exiting
01:52:51 (4012): No heartbeat from core client for 30 sec - exiting
01:52:52 (4012): No heartbeat from core client for 30 sec - exiting
01:52:53 (4012): No heartbeat from core client for 30 sec - exiting
01:52:54 (4012): No heartbeat from core client for 30 sec - exiting
01:58:01 (6552): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
02:14:20 (10412): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:15:44 (7728): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
02:18:54 (10076): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:18:55 (10076): No heartbeat from core client for 30 sec - exiting
02:18:56 (10076): No heartbeat from core client for 30 sec - exiting
02:18:57 (10076): No heartbeat from core client for 30 sec - exiting
02:18:58 (10076): No heartbeat from core client for 30 sec - exiting
02:18:59 (10076): No heartbeat from core client for 30 sec - exiting
02:19:00 (10076): No heartbeat from core client for 30 sec - exiting
02:19:01 (10076): No heartbeat from core client for 30 sec - exiting
02:19:02 (10076): No heartbeat from core client for 30 sec - exiting
02:19:03 (10076): No heartbeat from core client for 30 sec - exiting
02:19:04 (10076): No heartbeat from core client for 30 sec - exiting
02:24:46 (4820): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:24:47 (4820): No heartbeat from core client for 30 sec - exiting
02:24:48 (4820): No heartbeat from core client for 30 sec - exiting
02:24:49 (4820): No heartbeat from core client for 30 sec - exiting
02:24:50 (4820): No heartbeat from core client for 30 sec - exiting
02:24:51 (4820): No heartbeat from core client for 30 sec - exiting
02:24:52 (4820): No heartbeat from core client for 30 sec - exiting
02:24:53 (4820): No heartbeat from core client for 30 sec - exiting
02:24:54 (4820): No heartbeat from core client for 30 sec - exiting
02:24:55 (4820): No heartbeat from core client for 30 sec - exiting
02:24:56 (4820): No heartbeat from core client for 30 sec - exiting
02:42:44 (5652): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:42:45 (5652): No heartbeat from core client for 30 sec - exiting
02:42:46 (5652): No heartbeat from core client for 30 sec - exiting
02:42:47 (5652): No heartbeat from core client for 30 sec - exiting
02:42:48 (5652): No heartbeat from core client for 30 sec - exiting
02:42:49 (5652): No heartbeat from core client for 30 sec - exiting
02:42:50 (5652): No heartbeat from core client for 30 sec - exiting
02:42:51 (5652): No heartbeat from core client for 30 sec - exiting
02:42:52 (5652): No heartbeat from core client for 30 sec - exiting
02:42:53 (5652): No heartbeat from core client for 30 sec - exiting
02:42:54 (5652): No heartbeat from core client for 30 sec - exiting
02:48:47 (7700): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:48:48 (7700): No heartbeat from core client for 30 sec - exiting
02:48:49 (7700): No heartbeat from core client for 30 sec - exiting
02:48:50 (7700): No heartbeat from core client for 30 sec - exiting
02:48:51 (7700): No heartbeat from core client for 30 sec - exiting
02:48:52 (7700): No heartbeat from core client for 30 sec - exiting
02:48:53 (7700): No heartbeat from core client for 30 sec - exiting
02:48:54 (7700): No heartbeat from core client for 30 sec - exiting
02:48:55 (7700): No heartbeat from core client for 30 sec - exiting
02:48:56 (7700): No heartbeat from core client for 30 sec - exiting
02:48:57 (7700): No heartbeat from core client for 30 sec - exiting
02:49:41 (1372): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:52:54 (5332): No heartbeat from core client for 30 sec - exiting
02:52:55 (5332): No heartbeat from core client for 30 sec - exiting
02:52:56 (5332): No heartbeat from core client for 30 sec - exiting
02:52:57 (5332): No heartbeat from core client for 30 sec - exiting
02:52:58 (5332): No heartbeat from core client for 30 sec - exiting
02:52:59 (5332): No heartbeat from core client for 30 sec - exiting
02:53:00 (5332): No heartbeat from core client for 30 sec - exiting
02:53:01 (5332): No heartbeat from core client for 30 sec - exiting
02:53:02 (5332): No heartbeat from core client for 30 sec - exiting
02:53:03 (5332): No heartbeat from core client for 30 sec - exiting
02:53:04 (5332): No heartbeat from core client for 30 sec - exiting
02:53:05 (5332): No heartbeat from core client for 30 sec - exiting
02:53:06 (5332): No heartbeat from core client for 30 sec - exiting
02:53:07 (5332): No heartbeat from core client for 30 sec - exiting
02:53:08 (5332): No heartbeat from core client for 30 sec - exiting
02:53:09 (5332): No heartbeat from core client for 30 sec - exiting
02:53:10 (5332): No heartbeat from core client for 30 sec - exiting
02:53:11 (5332): No heartbeat from core client for 30 sec - exiting
02:53:12 (5332): No heartbeat from core client for 30 sec - exiting
02:53:13 (5332): No heartbeat from core client for 30 sec - exiting
02:53:14 (5332): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
02:58:47 (10128): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:58:48 (10128): No heartbeat from core client for 30 sec - exiting
02:58:49 (10128): No heartbeat from core client for 30 sec - exiting
02:58:50 (10128): No heartbeat from core client for 30 sec - exiting
02:58:51 (10128): No heartbeat from core client for 30 sec - exiting
02:58:52 (10128): No heartbeat from core client for 30 sec - exiting
02:58:53 (10128): No heartbeat from core client for 30 sec - exiting
02:58:54 (10128): No heartbeat from core client for 30 sec - exiting
02:58:55 (10128): No heartbeat from core client for 30 sec - exiting
02:58:56 (10128): No heartbeat from core client for 30 sec - exiting
02:58:57 (10128): No heartbeat from core client for 30 sec - exiting
03:16:47 (9916): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:16:48 (9916): No heartbeat from core client for 30 sec - exiting
03:16:49 (9916): No heartbeat from core client for 30 sec - exiting
03:16:50 (9916): No heartbeat from core client for 30 sec - exiting
03:16:51 (9916): No heartbeat from core client for 30 sec - exiting
03:16:52 (9916): No heartbeat from core client for 30 sec - exiting
03:16:53 (9916): No heartbeat from core client for 30 sec - exiting
03:16:54 (9916): No heartbeat from core client for 30 sec - exiting
03:16:55 (9916): No heartbeat from core client for 30 sec - exiting
03:16:56 (9916): No heartbeat from core client for 30 sec - exiting
03:16:57 (9916): No heartbeat from core client for 30 sec - exiting
03:18:10 (8932): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
03:24:41 (2748): No heartbeat from core client for 30 sec - exiting
03:24:42 (2748): No heartbeat from core client for 30 sec - exiting
03:24:43 (2748): No heartbeat from core client for 30 sec - exiting
03:24:44 (2748): No heartbeat from core client for 30 sec - exiting
03:24:45 (2748): No heartbeat from core client for 30 sec - exiting
03:24:46 (2748): No heartbeat from core client for 30 sec - exiting
03:24:47 (2748): No heartbeat from core client for 30 sec - exiting
03:24:48 (2748): No heartbeat from core client for 30 sec - exiting
03:24:49 (2748): No heartbeat from core client for 30 sec - exiting
03:24:50 (2748): No heartbeat from core client for 30 sec - exiting
03:24:51 (2748): No heartbeat from core client for 30 sec - exiting
03:24:52 (2748): No heartbeat from core client for 30 sec - exiting
03:24:53 (2748): No heartbeat from core client for 30 sec - exiting
03:24:54 (2748): No heartbeat from core client for 30 sec - exiting
03:24:55 (2748): No heartbeat from core client for 30 sec - exiting
03:24:56 (2748): No heartbeat from core client for 30 sec - exiting
03:24:57 (2748): No heartbeat from core client for 30 sec - exiting
03:24:58 (2748): No heartbeat from core client for 30 sec - exiting
03:24:59 (2748): No heartbeat from core client for 30 sec - exiting
03:25:00 (2748): No heartbeat from core client for 30 sec - exiting
03:25:01 (2748): No heartbeat from core client for 30 sec - exiting
03:25:02 (2748): No heartbeat from core client for 30 sec - exiting
03:25:03 (2748): No heartbeat from core client for 30 sec - exiting
03:25:04 (2748): No heartbeat from core client for 30 sec - exiting
03:25:05 (2748): No heartbeat from core client for 30 sec - exiting
03:25:06 (2748): No heartbeat from core client for 30 sec - exiting
03:25:07 (2748): No heartbeat from core client for 30 sec - exiting
03:25:08 (2748): No heartbeat from core client for 30 sec - exiting
03:25:09 (2748): No heartbeat from core client for 30 sec - exiting
03:25:10 (2748): No heartbeat from core client for 30 sec - exiting
03:25:11 (2748): No heartbeat from core client for 30 sec - exiting
03:25:12 (2748): No heartbeat from core client for 30 sec - exiting
03:25:13 (2748): No heartbeat from core client for 30 sec - exiting
03:25:14 (2748): No heartbeat from core client for 30 sec - exiting
03:25:15 (2748): No heartbeat from core client for 30 sec - exiting
03:25:16 (2748): No heartbeat from core client for 30 sec - exiting
03:25:17 (2748): No heartbeat from core client for 30 sec - exiting
03:25:18 (2748): No heartbeat from core client for 30 sec - exiting
03:25:19 (2748): No heartbeat from core client for 30 sec - exiting
03:25:20 (2748): No heartbeat from core client for 30 sec - exiting
03:25:21 (2748): No heartbeat from core client for 30 sec - exiting
03:25:22 (2748): No heartbeat from core client for 30 sec - exiting
03:25:23 (2748): No heartbeat from core client for 30 sec - exiting
03:25:24 (2748): No heartbeat from core client for 30 sec - exiting
03:25:25 (2748): No heartbeat from core client for 30 sec - exiting
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITHEAD: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
19 Sep 2012 06:37:36 1188461 15196824 hadcm3n_o25e_2100_40_008169075_1 984,960 1,090,947 1.1076
18 Sep 2012 22:33:40 1188461 15196824 hadcm3n_o25e_2100_40_008169075_1 959,040 1,062,266 1.1076
18 Sep 2012 14:36:45 1188461 15196824 hadcm3n_o25e_2100_40_008169075_1 933,120 1,033,853 1.1080
18 Sep 2012 06:29:57 1188461 15196824 hadcm3n_o25e_2100_40_008169075_1 907,200 1,004,999 1.1078
17 Sep 2012 14:31:32 1188461 15196824 hadcm3n_o25e_2100_40_008169075_1 881,280 975,772 1.1072
17 Sep 2012 06:24:41 1188461 15196824 hadcm3n_o25e_2100_40_008169075_1 855,360 946,942 1.1071
16 Sep 2012 22:22:33 1188461 15196824 hadcm3n_o25e_2100_40_008169075_1 829,440 918,174 1.1070
16 Sep 2012 14:15:54 1188461 15196824 hadcm3n_o25e_2100_40_008169075_1 803,520 889,295 1.1067
16 Sep 2012 06:54:04 1188461 15196824 hadcm3n_o25e_2100_40_008169075_1 777,600 859,839 1.1058
15 Sep 2012 22:01:48 1188461 15196824 hadcm3n_o25e_2100_40_008169075_1 751,680 830,764 1.1052
15 Sep 2012 13:23:39 1188461 15196824 hadcm3n_o25e_2100_40_008169075_1 725,760 802,127 1.1052
15 Sep 2012 05:11:49 1188461 15196824 hadcm3n_o25e_2100_40_008169075_1 699,840 773,215 1.1048
14 Sep 2012 20:54:15 1188461 15196824 hadcm3n_o25e_2100_40_008169075_1 673,920 744,200 1.1043
14 Sep 2012 12:33:24 1188461 15196824 hadcm3n_o25e_2100_40_008169075_1 648,000 715,191 1.1037
14 Sep 2012 04:11:24 1188461 15196824 hadcm3n_o25e_2100_40_008169075_1 622,080 686,112 1.1029
13 Sep 2012 19:58:00 1188461 15196824 hadcm3n_o25e_2100_40_008169075_1 596,160 657,405 1.1027
13 Sep 2012 11:58:02 1188461 15196824 hadcm3n_o25e_2100_40_008169075_1 570,240 629,010 1.1031
13 Sep 2012 04:36:12 1188461 15196824 hadcm3n_o25e_2100_40_008169075_1 544,320 600,379 1.1030
12 Sep 2012 11:55:21 1188461 15196824 hadcm3n_o25e_2100_40_008169075_1 518,400 572,331 1.1040
12 Sep 2012 02:53:11 1188461 15196824 hadcm3n_o25e_2100_40_008169075_1 492,480 543,675 1.1040


©2024 cpdn.org