climateprediction.net home page
Task 14290746

Task 14290746

Name hadcm3n_y83n_1940_40_007833850_1
Workunit 7988962
Created 19 Mar 2012, 13:42:09 UTC
Sent 20 Mar 2012, 0:54:24 UTC
Report deadline 19 Jun 2012, 8:21:35 UTC
Received 2 Jul 2012, 15:48:07 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1195688
Run time 39 days 8 hours 9 min 55 sec
CPU time 37 days 0 hours 38 min 4 sec
Validate state Invalid
Credit 12,130.56
Device peak FLOPS 1.30 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
 No heartbeat from core client for 30 sec - exiting
18:41:01 (1693): No heartbeat from core client for 30 sec - exiting
18:41:02 (1693): No heartbeat from core client for 30 sec - exiting
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/atmos_restart.day
18:41:37 (1693): No heartbeat from core client for 30 sec - exiting
18:42:57 (1693): No heartbeat from core client for 30 sec - exiting
18:42:59 (1693): No heartbeat from core client for 30 sec - exiting
18:43:00 (1693): No heartbeat from core client for 30 sec - exiting
18:43:01 (1693): No heartbeat from core client for 30 sec - exiting
18:43:02 (1693): No heartbeat from core client for 30 sec - exiting
18:43:03 (1693): No heartbeat from core client for 30 sec - exiting
18:43:04 (1693): No heartbeat from core client for 30 sec - exiting
18:43:05 (1693): No heartbeat from core client for 30 sec - exiting
18:43:06 (1693): No heartbeat from core client for 30 sec - exiting
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/ocean_restart.day
CPDN Monitor - No 'heartbeat' from BOINC...
18:43:41 (1787): No heartbeat from core client for 30 sec - exiting
18:43:42 (1787): No heartbeat from core client for 30 sec - exiting
18:43:43 (1787): No heartbeat from core client for 30 sec - exiting
18:43:44 (1787): No heartbeat from core client for 30 sec - exiting
18:43:45 (1787): No heartbeat from core client for 30 sec - exiting
18:43:46 (1787): No heartbeat from core client for 30 sec - exiting
18:43:47 (1787): No heartbeat from core client for 30 sec - exiting
18:43:48 (1787): No heartbeat from core client for 30 sec - exiting
18:43:49 (1787): No heartbeat from core client for 30 sec - exiting
18:43:50 (1787): No heartbeat from core client for 30 sec - exiting
18:43:51 (1787): No heartbeat from core client for 30 sec - exiting
18:43:52 (1787): No heartbeat from core client for 30 sec - exiting
18:43:53 (1787): No heartbeat from core client for 30 sec - exiting
18:43:54 (1787): No heartbeat from core client for 30 sec - exiting
18:43:55 (1787): No heartbeat from core client for 30 sec - exiting
18:43:56 (1787): No heartbeat from core client for 30 sec - exiting
18:43:57 (1787): No heartbeat from core client for 30 sec - exiting
18:43:58 (1787): No heartbeat from core client for 30 sec - exiting
18:43:59 (1787): No heartbeat from core client for 30 sec - exiting
18:44:00 (1787): No heartbeat from core client for 30 sec - exiting
18:44:01 (1787): No heartbeat from core client for 30 sec - exiting
18:44:02 (1787): No heartbeat from core client for 30 sec - exiting
18:44:03 (1787): No heartbeat from core client for 30 sec - exiting
18:44:04 (1787): No heartbeat from core client for 30 sec - exiting
18:44:05 (1787): No heartbeat from core client for 30 sec - exiting
18:44:06 (1787): No heartbeat from core client for 30 sec - exiting
18:44:07 (1787): No heartbeat from core client for 30 sec - exiting
18:44:08 (1787): No heartbeat from core client for 30 sec - exiting
18:44:09 (1787): No heartbeat from core client for 30 sec - exiting
18:44:10 (1787): No heartbeat from core client for 30 sec - exiting
18:44:11 (1787): No heartbeat from core client for 30 sec - exiting
18:44:12 (1787): No heartbeat from core client for 30 sec - exiting
18:44:13 (1787): No heartbeat from core client for 30 sec - exiting
18:44:14 (1787): No heartbeat from core client for 30 sec - exiting
18:44:15 (1787): No heartbeat from core client for 30 sec - exiting
18:44:16 (1787): No heartbeat from core client for 30 sec - exiting
18:44:17 (1787): No heartbeat from core client for 30 sec - exiting
18:44:18 (1787): No heartbeat from core client for 30 sec - exiting
18:44:19 (1787): No heartbeat from core client for 30 sec - exiting
18:44:20 (1787): No heartbeat from core client for 30 sec - exiting
18:44:21 (1787): No heartbeat from core client for 30 sec - exiting
18:44:22 (1787): No heartbeat from core client for 30 sec - exiting
18:44:23 (1787): No heartbeat from core client for 30 sec - exiting
18:44:24 (1787): No heartbeat from core client for 30 sec - exiting
18:44:25 (1787): No heartbeat from core client for 30 sec - exiting
18:44:26 (1787): No heartbeat from core client for 30 sec - exiting
18:44:27 (1787): No heartbeat from core client for 30 sec - exiting
18:44:28 (1787): No heartbeat from core client for 30 sec - exiting
18:44:29 (1787): No heartbeat from core client for 30 sec - exiting
18:44:30 (1787): No heartbeat from core client for 30 sec - exiting
18:44:31 (1787): No heartbeat from core client for 30 sec - exiting
18:45:03 (1787): No heartbeat from core client for 30 sec - exiting
18:45:04 (1787): No heartbeat from core client for 30 sec - exiting
18:45:05 (1787): No heartbeat from core client for 30 sec - exiting
18:45:06 (1787): No heartbeat from core client for 30 sec - exiting
18:45:07 (1787): No heartbeat from core client for 30 sec - exiting
18:45:08 (1787): No heartbeat from core client for 30 sec - exiting
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/atmos_restart.day
18:45:15 (1787): No heartbeat from core client for 30 sec - exiting
18:46:37 (1787): No heartbeat from core client for 30 sec - exiting
18:46:38 (1787): No heartbeat from core client for 30 sec - exiting
18:46:39 (1787): No heartbeat from core client for 30 sec - exiting
18:46:40 (1787): No heartbeat from core client for 30 sec - exiting
18:46:41 (1787): No heartbeat from core client for 30 sec - exiting
18:46:42 (1787): No heartbeat from core client for 30 sec - exiting
18:46:43 (1787): No heartbeat from core client for 30 sec - exiting
18:46:44 (1787): No heartbeat from core client for 30 sec - exiting
18:46:45 (1787): No heartbeat from core client for 30 sec - exiting
18:46:46 (1787): No heartbeat from core client for 30 sec - exiting
18:46:47 (1787): No heartbeat from core client for 30 sec - exiting
18:46:48 (1787): No heartbeat from core client for 30 sec - exiting
18:46:49 (1787): No heartbeat from core client for 30 sec - exiting
18:46:50 (1787): No heartbeat from core client for 30 sec - exiting
18:46:51 (1787): No heartbeat from core client for 30 sec - exiting
18:46:52 (1787): No heartbeat from core client for 30 sec - exiting
18:46:53 (1787): No heartbeat from core client for 30 sec - exiting
18:46:54 (1787): No heartbeat from core client for 30 sec - exiting
18:46:55 (1787): No heartbeat from core client for 30 sec - exiting
18:46:56 (1787): No heartbeat from core client for 30 sec - exiting
18:46:57 (1787): No heartbeat from core client for 30 sec - exiting
18:46:58 (1787): No heartbeat from core client for 30 sec - exiting
18:46:59 (1787): No heartbeat from core client for 30 sec - exiting
18:47:00 (1787): No heartbeat from core client for 30 sec - exiting
18:47:01 (1787): No heartbeat from core client for 30 sec - exiting
18:47:02 (1787): No heartbeat from core client for 30 sec - exiting
18:47:03 (1787): No heartbeat from core client for 30 sec - exiting
18:47:04 (1787): No heartbeat from core client for 30 sec - exiting
18:47:05 (1787): No heartbeat from core client for 30 sec - exiting
18:47:06 (1787): No heartbeat from core client for 30 sec - exiting
18:47:07 (1787): No heartbeat from core client for 30 sec - exiting
18:47:08 (1787): No heartbeat from core client for 30 sec - exiting
18:47:09 (1787): No heartbeat from core client for 30 sec - exiting
18:47:10 (1787): No heartbeat from core client for 30 sec - exiting
18:47:11 (1787): No heartbeat from core client for 30 sec - exiting
18:47:12 (1787): No heartbeat from core client for 30 sec - exiting
18:47:13 (1787): No heartbeat from core client for 30 sec - exiting
18:47:14 (1787): No heartbeat from core client for 30 sec - exiting
18:47:15 (1787): No heartbeat from core client for 30 sec - exiting
18:47:16 (1787): No heartbeat from core client for 30 sec - exiting
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/ocean_restart.day
18:47:17 (1787): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:47:48 (1878): No heartbeat from core client for 30 sec - exiting
18:47:49 (1878): No heartbeat from core client for 30 sec - exiting
18:47:50 (1878): No heartbeat from core client for 30 sec - exiting
18:47:51 (1878): No heartbeat from core client for 30 sec - exiting
18:47:52 (1878): No heartbeat from core client for 30 sec - exiting
18:47:53 (1878): No heartbeat from core client for 30 sec - exiting
18:47:54 (1878): No heartbeat from core client for 30 sec - exiting
18:47:55 (1878): No heartbeat from core client for 30 sec - exiting
18:47:56 (1878): No heartbeat from core client for 30 sec - exiting
18:47:57 (1878): No heartbeat from core client for 30 sec - exiting
18:47:58 (1878): No heartbeat from core client for 30 sec - exiting
18:47:59 (1878): No heartbeat from core client for 30 sec - exiting
18:48:00 (1878): No heartbeat from core client for 30 sec - exiting
18:48:01 (1878): No heartbeat from core client for 30 sec - exiting
18:48:02 (1878): No heartbeat from core client for 30 sec - exiting
18:48:04 (1878): No heartbeat from core client for 30 sec - exiting
18:48:05 (1878): No heartbeat from core client for 30 sec - exiting
18:48:06 (1878): No heartbeat from core client for 30 sec - exiting
18:48:07 (1878): No heartbeat from core client for 30 sec - exiting
18:48:08 (1878): No heartbeat from core client for 30 sec - exiting
18:48:09 (1878): No heartbeat from core client for 30 sec - exiting
18:48:10 (1878): No heartbeat from core client for 30 sec - exiting
18:48:11 (1878): No heartbeat from core client for 30 sec - exiting
18:48:12 (1878): No heartbeat from core client for 30 sec - exiting
18:48:13 (1878): No heartbeat from core client for 30 sec - exiting
18:48:14 (1878): No heartbeat from core client for 30 sec - exiting
18:48:15 (1878): No heartbeat from core client for 30 sec - exiting
18:48:16 (1878): No heartbeat from core client for 30 sec - exiting
18:48:17 (1878): No heartbeat from core client for 30 sec - exiting
18:48:18 (1878): No heartbeat from core client for 30 sec - exiting
18:48:19 (1878): No heartbeat from core client for 30 sec - exiting
18:48:20 (1878): No heartbeat from core client for 30 sec - exiting
18:48:21 (1878): No heartbeat from core client for 30 sec - exiting
18:48:22 (1878): No heartbeat from core client for 30 sec - exiting
18:48:23 (1878): No heartbeat from core client for 30 sec - exiting
18:48:24 (1878): No heartbeat from core client for 30 sec - exiting
18:48:25 (1878): No heartbeat from core client for 30 sec - exiting
18:48:26 (1878): No heartbeat from core client for 30 sec - exiting
18:48:27 (1878): No heartbeat from core client for 30 sec - exiting
18:48:28 (1878): No heartbeat from core client for 30 sec - exiting
18:48:29 (1878): No heartbeat from core client for 30 sec - exiting
18:48:30 (1878): No heartbeat from core client for 30 sec - exiting
18:48:31 (1878): No heartbeat from core client for 30 sec - exiting
18:48:32 (1878): No heartbeat from core client for 30 sec - exiting
18:48:33 (1878): No heartbeat from core client for 30 sec - exiting
18:48:34 (1878): No heartbeat from core client for 30 sec - exiting
18:48:35 (1878): No heartbeat from core client for 30 sec - exiting
18:48:36 (1878): No heartbeat from core client for 30 sec - exiting
18:48:37 (1878): No heartbeat from core client for 30 sec - exiting
18:48:38 (1878): No heartbeat from core client for 30 sec - exiting
18:48:39 (1878): No heartbeat from core client for 30 sec - exiting
18:48:40 (1878): No heartbeat from core client for 30 sec - exiting
18:48:41 (1878): No heartbeat from core client for 30 sec - exiting
18:48:42 (1878): No heartbeat from core client for 30 sec - exiting
18:48:43 (1878): No heartbeat from core client for 30 sec - exiting
18:48:44 (1878): No heartbeat from core client for 30 sec - exiting
18:48:45 (1878): No heartbeat from core client for 30 sec - exiting
18:48:46 (1878): No heartbeat from core client for 30 sec - exiting
18:48:47 (1878): No heartbeat from core client for 30 sec - exiting
18:48:48 (1878): No heartbeat from core client for 30 sec - exiting
18:48:49 (1878): No heartbeat from core client for 30 sec - exiting
18:48:50 (1878): No heartbeat from core client for 30 sec - exiting
18:48:51 (1878): No heartbeat from core client for 30 sec - exiting
18:48:52 (1878): No heartbeat from core client for 30 sec - exiting
18:48:53 (1878): No heartbeat from core client for 30 sec - exiting
18:48:54 (1878): No heartbeat from core client for 30 sec - exiting
18:48:55 (1878): No heartbeat from core client for 30 sec - exiting
18:48:56 (1878): No heartbeat from core client for 30 sec - exiting
18:48:57 (1878): No heartbeat from core client for 30 sec - exiting
18:48:58 (1878): No heartbeat from core client for 30 sec - exiting
18:48:59 (1878): No heartbeat from core client for 30 sec - exiting
18:49:00 (1878): No heartbeat from core client for 30 sec - exiting
18:49:01 (1878): No heartbeat from core client for 30 sec - exiting
18:49:02 (1878): No heartbeat from core client for 30 sec - exiting
18:49:03 (1878): No heartbeat from core client for 30 sec - exiting
18:49:04 (1878): No heartbeat from core client for 30 sec - exiting
18:49:05 (1878): No heartbeat from core client for 30 sec - exiting
18:49:06 (1878): No heartbeat from core client for 30 sec - exiting
18:49:07 (1878): No heartbeat from core client for 30 sec - exiting
18:49:08 (1878): No heartbeat from core client for 30 sec - exiting
18:49:09 (1878): No heartbeat from core client for 30 sec - exiting
18:49:10 (1878): No heartbeat from core client for 30 sec - exiting
18:49:11 (1878): No heartbeat from core client for 30 sec - exiting
18:49:12 (1878): No heartbeat from core client for 30 sec - exiting
18:49:13 (1878): No heartbeat from core client for 30 sec - exiting
18:49:14 (1878): No heartbeat from core client for 30 sec - exiting
18:49:15 (1878): No heartbeat from core client for 30 sec - exiting
18:49:16 (1878): No heartbeat from core client for 30 sec - exiting
18:49:17 (1878): No heartbeat from core client for 30 sec - exiting
18:49:18 (1878): No heartbeat from core client for 30 sec - exiting
18:49:19 (1878): No heartbeat from core client for 30 sec - exiting
18:49:20 (1878): No heartbeat from core client for 30 sec - exiting
18:49:21 (1878): No heartbeat from core client for 30 sec - exiting
18:49:22 (1878): No heartbeat from core client for 30 sec - exiting
18:49:23 (1878): No heartbeat from core client for 30 sec - exiting
18:49:24 (1878): No heartbeat from core client for 30 sec - exiting
18:49:25 (1878): No heartbeat from core client for 30 sec - exiting
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/atmos_restart.day
18:49:26 (1878): No heartbeat from core client for 30 sec - exiting
18:49:57 (1878): No heartbeat from core client for 30 sec - exiting
18:49:58 (1878): No heartbeat from core client for 30 sec - exiting
18:49:59 (1878): No heartbeat from core client for 30 sec - exiting
18:50:00 (1878): No heartbeat from core client for 30 sec - exiting
18:50:01 (1878): No heartbeat from core client for 30 sec - exiting
18:50:02 (1878): No heartbeat from core client for 30 sec - exiting
18:50:03 (1878): No heartbeat from core client for 30 sec - exiting
18:50:04 (1878): No heartbeat from core client for 30 sec - exiting
18:50:05 (1878): No heartbeat from core client for 30 sec - exiting
18:50:06 (1878): No heartbeat from core client for 30 sec - exiting
18:50:07 (1878): No heartbeat from core client for 30 sec - exiting
18:50:08 (1878): No heartbeat from core client for 30 sec - exiting
18:50:49 (1878): No heartbeat from core client for 30 sec - exiting
18:50:50 (1878): No heartbeat from core client for 30 sec - exiting
18:50:51 (1878): No heartbeat from core client for 30 sec - exiting
18:50:52 (1878): No heartbeat from core client for 30 sec - exiting
18:50:53 (1878): No heartbeat from core client for 30 sec - exiting
18:50:54 (1878): No heartbeat from core client for 30 sec - exiting
18:50:55 (1878): No heartbeat from core client for 30 sec - exiting
18:50:56 (1878): No heartbeat from core client for 30 sec - exiting
18:50:57 (1878): No heartbeat from core client for 30 sec - exiting
18:50:58 (1878): No heartbeat from core client for 30 sec - exiting
18:50:59 (1878): No heartbeat from core client for 30 sec - exiting
18:51:00 (1878): No heartbeat from core client for 30 sec - exiting
18:51:01 (1878): No heartbeat from core client for 30 sec - exiting
18:51:02 (1878): No heartbeat from core client for 30 sec - exiting
18:51:03 (1878): No heartbeat from core client for 30 sec - exiting
18:51:04 (1878): No heartbeat from core client for 30 sec - exiting
18:51:05 (1878): No heartbeat from core client for 30 sec - exiting
18:51:06 (1878): No heartbeat from core client for 30 sec - exiting
18:51:07 (1878): No heartbeat from core client for 30 sec - exiting
18:51:08 (1878): No heartbeat from core client for 30 sec - exiting
18:51:09 (1878): No heartbeat from core client for 30 sec - exiting
18:51:10 (1878): No heartbeat from core client for 30 sec - exiting
18:51:11 (1878): No heartbeat from core client for 30 sec - exiting
18:51:12 (1878): No heartbeat from core client for 30 sec - exiting
18:51:13 (1878): No heartbeat from core client for 30 sec - exiting
18:51:14 (1878): No heartbeat from core client for 30 sec - exiting
18:51:15 (1878): No heartbeat from core client for 30 sec - exiting
18:51:16 (1878): No heartbeat from core client for 30 sec - exiting
18:51:17 (1878): No heartbeat from core client for 30 sec - exiting
18:51:18 (1878): No heartbeat from core client for 30 sec - exiting
18:51:19 (1878): No heartbeat from core client for 30 sec - exiting
18:51:20 (1878): No heartbeat from core client for 30 sec - exiting
18:51:21 (1878): No heartbeat from core client for 30 sec - exiting
18:51:22 (1878): No heartbeat from core client for 30 sec - exiting
18:51:23 (1878): No heartbeat from core client for 30 sec - exiting
18:51:24 (1878): No heartbeat from core client for 30 sec - exiting
18:51:25 (1878): No heartbeat from core client for 30 sec - exiting
18:51:26 (1878): No heartbeat from core client for 30 sec - exiting
18:51:27 (1878): No heartbeat from core client for 30 sec - exiting
18:51:28 (1878): No heartbeat from core client for 30 sec - exiting
18:51:29 (1878): No heartbeat from core client for 30 sec - exiting
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/ocean_restart.day
CPDN Monitor - No 'heartbeat' from BOINC...
18:52:01 (1958): No heartbeat from core client for 30 sec - exiting
18:52:02 (1958): No heartbeat from core client for 30 sec - exiting
18:52:03 (1958): No heartbeat from core client for 30 sec - exiting
18:52:04 (1958): No heartbeat from core client for 30 sec - exiting
18:52:05 (1958): No heartbeat from core client for 30 sec - exiting
18:52:06 (1958): No heartbeat from core client for 30 sec - exiting
18:52:07 (1958): No heartbeat from core client for 30 sec - exiting
18:52:08 (1958): No heartbeat from core client for 30 sec - exiting
18:52:09 (1958): No heartbeat from core client for 30 sec - exiting
18:52:10 (1958): No heartbeat from core client for 30 sec - exiting
18:52:11 (1958): No heartbeat from core client for 30 sec - exiting
18:52:42 (1958): No heartbeat from core client for 30 sec - exiting
18:52:43 (1958): No heartbeat from core client for 30 sec - exiting
18:52:44 (1958): No heartbeat from core client for 30 sec - exiting
18:52:45 (1958): No heartbeat from core client for 30 sec - exiting
18:52:46 (1958): No heartbeat from core client for 30 sec - exiting
18:52:47 (1958): No heartbeat from core client for 30 sec - exiting
18:52:48 (1958): No heartbeat from core client for 30 sec - exiting
18:52:49 (1958): No heartbeat from core client for 30 sec - exiting
18:52:50 (1958): No heartbeat from core client for 30 sec - exiting
18:52:51 (1958): No heartbeat from core client for 30 sec - exiting
18:52:52 (1958): No heartbeat from core client for 30 sec - exiting
18:52:53 (1958): No heartbeat from core client for 30 sec - exiting
18:52:54 (1958): No heartbeat from core client for 30 sec - exiting
18:52:55 (1958): No heartbeat from core client for 30 sec - exiting
18:52:56 (1958): No heartbeat from core client for 30 sec - exiting
18:52:57 (1958): No heartbeat from core client for 30 sec - exiting
18:52:58 (1958): No heartbeat from core client for 30 sec - exiting
18:52:59 (1958): No heartbeat from core client for 30 sec - exiting
18:53:00 (1958): No heartbeat from core client for 30 sec - exiting
18:53:01 (1958): No heartbeat from core client for 30 sec - exiting
18:53:02 (1958): No heartbeat from core client for 30 sec - exiting
18:53:03 (1958): No heartbeat from core client for 30 sec - exiting
18:53:04 (1958): No heartbeat from core client for 30 sec - exiting
18:53:05 (1958): No heartbeat from core client for 30 sec - exiting
18:53:06 (1958): No heartbeat from core client for 30 sec - exiting
18:53:07 (1958): No heartbeat from core client for 30 sec - exiting
18:53:08 (1958): No heartbeat from core client for 30 sec - exiting
18:53:09 (1958): No heartbeat from core client for 30 sec - exiting
18:53:10 (1958): No heartbeat from core client for 30 sec - exiting
18:53:11 (1958): No heartbeat from core client for 30 sec - exiting
18:53:12 (1958): No heartbeat from core client for 30 sec - exiting
18:53:13 (1958): No heartbeat from core client for 30 sec - exiting
18:53:14 (1958): No heartbeat from core client for 30 sec - exiting
18:53:15 (1958): No heartbeat from core client for 30 sec - exiting
18:53:16 (1958): No heartbeat from core client for 30 sec - exiting
18:53:17 (1958): No heartbeat from core client for 30 sec - exiting
18:53:18 (1958): No heartbeat from core client for 30 sec - exiting
18:53:19 (1958): No heartbeat from core client for 30 sec - exiting
18:53:20 (1958): No heartbeat from core client for 30 sec - exiting
18:53:21 (1958): No heartbeat from core client for 30 sec - exiting
18:53:22 (1958): No heartbeat from core client for 30 sec - exiting
18:53:23 (1958): No heartbeat from core client for 30 sec - exiting
18:53:24 (1958): No heartbeat from core client for 30 sec - exiting
18:53:25 (1958): No heartbeat from core client for 30 sec - exiting
18:53:26 (1958): No heartbeat from core client for 30 sec - exiting
18:53:27 (1958): No heartbeat from core client for 30 sec - exiting
18:53:28 (1958): No heartbeat from core client for 30 sec - exiting
18:53:29 (1958): No heartbeat from core client for 30 sec - exiting
18:53:30 (1958): No heartbeat from core client for 30 sec - exiting
18:53:31 (1958): No heartbeat from core client for 30 sec - exiting
18:53:32 (1958): No heartbeat from core client for 30 sec - exiting
18:53:33 (1958): No heartbeat from core client for 30 sec - exiting
18:53:34 (1958): No heartbeat from core client for 30 sec - exiting
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/atmos_restart.day
18:53:35 (1958): No heartbeat from core client for 30 sec - exiting
18:54:47 (1958): No heartbeat from core client for 30 sec - exiting
18:54:58 (1958): No heartbeat from core client for 30 sec - exiting
18:54:59 (1958): No heartbeat from core client for 30 sec - exiting
18:55:00 (1958): No heartbeat from core client for 30 sec - exiting
18:55:01 (1958): No heartbeat from core client for 30 sec - exiting
18:55:02 (1958): No heartbeat from core client for 30 sec - exiting
18:55:03 (1958): No heartbeat from core client for 30 sec - exiting
18:55:04 (1958): No heartbeat from core client for 30 sec - exiting
18:55:05 (1958): No heartbeat from core client for 30 sec - exiting
18:55:06 (1958): No heartbeat from core client for 30 sec - exiting
18:55:07 (1958): No heartbeat from core client for 30 sec - exiting
18:55:08 (1958): No heartbeat from core client for 30 sec - exiting
18:55:09 (1958): No heartbeat from core client for 30 sec - exiting
18:55:10 (1958): No heartbeat from core client for 30 sec - exiting
18:55:11 (1958): No heartbeat from core client for 30 sec - exiting
18:55:12 (1958): No heartbeat from core client for 30 sec - exiting
18:55:13 (1958): No heartbeat from core client for 30 sec - exiting
18:55:14 (1958): No heartbeat from core client for 30 sec - exiting
18:55:15 (1958): No heartbeat from core client for 30 sec - exiting
18:55:16 (1958): No heartbeat from core client for 30 sec - exiting
18:55:17 (1958): No heartbeat from core client for 30 sec - exiting
18:55:18 (1958): No heartbeat from core client for 30 sec - exiting
18:55:19 (1958): No heartbeat from core client for 30 sec - exiting
18:55:20 (1958): No heartbeat from core client for 30 sec - exiting
18:55:21 (1958): No heartbeat from core client for 30 sec - exiting
18:55:22 (1958): No heartbeat from core client for 30 sec - exiting
18:55:23 (1958): No heartbeat from core client for 30 sec - exiting
18:55:24 (1958): No heartbeat from core client for 30 sec - exiting
18:55:25 (1958): No heartbeat from core client for 30 sec - exiting
18:55:26 (1958): No heartbeat from core client for 30 sec - exiting
18:55:27 (1958): No heartbeat from core client for 30 sec - exiting
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/ocean_restart.day
CPDN Monitor - No 'heartbeat' from BOINC...
18:56:11 (2092): No heartbeat from core client for 30 sec - exiting
18:56:12 (2092): No heartbeat from core client for 30 sec - exiting
18:56:13 (2092): No heartbeat from core client for 30 sec - exiting
18:56:14 (2092): No heartbeat from core client for 30 sec - exiting
18:56:15 (2092): No heartbeat from core client for 30 sec - exiting
18:56:16 (2092): No heartbeat from core client for 30 sec - exiting
18:56:17 (2092): No heartbeat from core client for 30 sec - exiting
18:56:18 (2092): No heartbeat from core client for 30 sec - exiting
18:56:19 (2092): No heartbeat from core client for 30 sec - exiting
18:56:20 (2092): No heartbeat from core client for 30 sec - exiting
18:56:21 (2092): No heartbeat from core client for 30 sec - exiting
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/atmos_restart.day
18:58:14 (2092): No heartbeat from core client for 30 sec - exiting
18:58:15 (2092): No heartbeat from core client for 30 sec - exiting
18:58:16 (2092): No heartbeat from core client for 30 sec - exiting
18:58:17 (2092): No heartbeat from core client for 30 sec - exiting
18:58:18 (2092): No heartbeat from core client for 30 sec - exiting
18:58:19 (2092): No heartbeat from core client for 30 sec - exiting
18:58:20 (2092): No heartbeat from core client for 30 sec - exiting
18:58:21 (2092): No heartbeat from core client for 30 sec - exiting
18:58:22 (2092): No heartbeat from core client for 30 sec - exiting
18:58:23 (2092): No heartbeat from core client for 30 sec - exiting
18:58:24 (2092): No heartbeat from core client for 30 sec - exiting
18:59:36 (2092): No heartbeat from core client for 30 sec - exiting
18:59:37 (2092): No heartbeat from core client for 30 sec - exiting
18:59:38 (2092): No heartbeat from core client for 30 sec - exiting
18:59:39 (2092): No heartbeat from core client for 30 sec - exiting
18:59:40 (2092): No heartbeat from core client for 30 sec - exiting
18:59:41 (2092): No heartbeat from core client for 30 sec - exiting
18:59:42 (2092): No heartbeat from core client for 30 sec - exiting
18:59:43 (2092): No heartbeat from core client for 30 sec - exiting
18:59:44 (2092): No heartbeat from core client for 30 sec - exiting
18:59:45 (2092): No heartbeat from core client for 30 sec - exiting
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/ocean_restart.day
CPDN Monitor - No 'heartbeat' from BOINC...
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/atmos_restart.day
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/ocean_restart.day
CPDN Monitor - Quit request from BOINC...
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/atmos_restart.day
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/ocean_restart.day
19:28:44 (1522): No heartbeat from core client for 30 sec - exiting

BUFFIN: Read Failed: Input/output error
BUFFIN: C I/O Error ferror - Unit 21 - Return code = 1
CPDN Monitor - No 'heartbeat' from BOINC...
19:30:47 (1908):cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/atmos_restart.day
 No heartbeat from core client for 30 sec - exiting
19:30:59 (1908): No heartbeat from core client for 30 sec - exiting
19:31:00 (1908): No heartbeat from core client for 30 sec - exiting
19:31:01 (1908): No heartbeat from core client for 30 sec - exiting
19:31:02 (1908): No heartbeat from core client for 30 sec - exiting
19:31:03 (1908): No heartbeat from core client for 30 sec - exiting
19:31:04 (1908): No heartbeat from core client for 30 sec - exiting
19:31:41 (1908): No heartbeat from core client for 30 sec - exiting
19:31:42 (1908): No heartbeat from core client for 30 sec - exiting
19:31:43 (1908): No heartbeat from core client for 30 sec - exiting
19:31:44 (1908): No heartbeat from core client for 30 sec - exiting
19:31:45 (1908): No heartbeat from core client for 30 sec - exiting
19:31:46 (1908): No heartbeat from core client for 30 sec - exiting
19:31:47 (1908): No heartbeat from core client for 30 sec - exiting
19:31:48 (1908): No heartbeat from core client for 30 sec - exiting
19:31:49 (1908): No heartbeat from core client for 30 sec - exiting
19:31:50 (1908): No heartbeat from core client for 30 sec - exiting
19:31:51 (1908): No heartbeat from core client for 30 sec - exiting
19:31:52 (1908): No heartbeat from core client for 30 sec - exiting
19:31:53 (1908): No heartbeat from core client for 30 sec - exiting
19:31:54 (1908): No heartbeat from core client for 30 sec - exiting
19:31:55 (1908): No heartbeat from core client for 30 sec - exiting
19:31:56 (1908): No heartbeat from core client for 30 sec - exiting
19:31:57 (1908): No heartbeat from core client for 30 sec - exiting
19:31:58 (1908): No heartbeat from core client for 30 sec - exiting
19:31:59 (1908): No heartbeat from core client for 30 sec - exiting
19:32:00 (1908): No heartbeat from core client for 30 sec - exiting
19:32:01 (1908): No heartbeat from core client for 30 sec - exiting
19:32:02 (1908): No heartbeat from core client for 30 sec - exiting
19:32:03 (1908): No heartbeat from core client for 30 sec - exiting
19:32:04 (1908): No heartbeat from core client for 30 sec - exiting
19:32:05 (1908): No heartbeat from core client for 30 sec - exiting
19:32:06 (1908): No heartbeat from core client for 30 sec - exiting
19:32:07 (1908): No heartbeat from core client for 30 sec - exiting
19:32:08 (1908): No heartbeat from core client for 30 sec - exiting
19:32:09 (1908): No heartbeat from core client for 30 sec - exiting
19:32:10 (1908): No heartbeat from core client for 30 sec - exiting
19:32:11 (1908): No heartbeat from core client for 30 sec - exiting
19:32:12 (1908): No heartbeat from core client for 30 sec - exiting
19:32:13 (1908): No heartbeat from core client for 30 sec - exiting
19:32:14 (1908): No heartbeat from core client for 30 sec - exiting
19:32:15 (1908): No heartbeat from core client for 30 sec - exiting
19:32:16 (1908): No heartbeat from core client for 30 sec - exiting
19:32:17 (1908): No heartbeat from core client for 30 sec - exiting
19:32:18 (1908): No heartbeat from core client for 30 sec - exiting
19:32:19 (1908): No heartbeat from core client for 30 sec - exiting
19:32:20 (1908): No heartbeat from core client for 30 sec - exiting
19:32:21 (1908): No heartbeat from core client for 30 sec - exiting
19:32:22 (1908): No heartbeat from core client for 30 sec - exiting
19:32:23 (1908): No heartbeat from core client for 30 sec - exiting
19:32:24 (1908): No heartbeat from core client for 30 sec - exiting
19:32:25 (1908): No heartbeat from core client for 30 sec - exiting
19:32:26 (1908): No heartbeat from core client for 30 sec - exiting
19:32:27 (1908): No heartbeat from core client for 30 sec - exiting
19:32:28 (1908): No heartbeat from core client for 30 sec - exiting
19:32:29 (1908): No heartbeat from core client for 30 sec - exiting
19:32:30 (1908): No heartbeat from core client for 30 sec - exiting
19:32:31 (1908): No heartbeat from core client for 30 sec - exiting
19:32:32 (1908): No heartbeat from core client for 30 sec - exiting
19:32:33 (1908): No heartbeat from core client for 30 sec - exiting
19:32:34 (1908): No heartbeat from core client for 30 sec - exiting
19:32:35 (1908): No heartbeat from core client for 30 sec - exiting
19:32:36 (1908): No heartbeat from core client for 30 sec - exiting
19:32:37 (1908): No heartbeat from core client for 30 sec - exiting
19:32:38 (1908): No heartbeat from core client for 30 sec - exiting
19:32:39 (1908): No heartbeat from core client for 30 sec - exiting
19:32:40 (1908): No heartbeat from core client for 30 sec - exiting
19:32:41 (1908): No heartbeat from core client for 30 sec - exiting
19:32:42 (1908): No heartbeat from core client for 30 sec - exiting
19:32:43 (1908): No heartbeat from core client for 30 sec - exiting
19:32:44 (1908): No heartbeat from core client for 30 sec - exiting
19:32:45 (1908): No heartbeat from core client for 30 sec - exiting
19:32:46 (1908): No heartbeat from core client for 30 sec - exiting
19:32:47 (1908): No heartbeat from core client for 30 sec - exiting
19:32:48 (1908): No heartbeat from core client for 30 sec - exiting
19:32:49 (1908): No heartbeat from core client for 30 sec - exiting
19:32:50 (1908): No heartbeat from core client for 30 sec - exiting
19:32:51 (1908): No heartbeat from core client for 30 sec - exiting
19:32:52 (1908): No heartbeat from core client for 30 sec - exiting
19:32:53 (1908): No heartbeat from core client for 30 sec - exiting
19:32:54 (1908): No heartbeat from core client for 30 sec - exiting
19:32:55 (1908): No heartbeat from core client for 30 sec - exiting
19:32:56 (1908): No heartbeat from core client for 30 sec - exiting
19:32:57 (1908): No heartbeat from core client for 30 sec - exiting
19:32:58 (1908): No heartbeat from core client for 30 sec - exiting
19:32:59 (1908): No heartbeat from core client for 30 sec - exiting
19:33:00 (1908): No heartbeat from core client for 30 sec - exiting
19:33:01 (1908): No heartbeat from core client for 30 sec - exiting
19:33:02 (1908): No heartbeat from core client for 30 sec - exiting
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/ocean_restart.day
CPDN Monitor - No 'heartbeat' from BOINC...
19:33:36 (2050): No heartbeat from core client for 30 sec - exiting
19:33:48 (2050): No heartbeat from core client for 30 sec - exiting
19:33:49 (2050): No heartbeat from core client for 30 sec - exiting
19:34:31 (2050): No heartbeat from core client for 30 sec - exiting
19:34:32 (2050): No heartbeat from core client for 30 sec - exiting
19:34:33 (2050): No heartbeat from core client for 30 sec - exiting
19:34:34 (2050): No heartbeat from core client for 30 sec - exiting
19:34:35 (2050): No heartbeat from core client for 30 sec - exiting
19:34:36 (2050): No heartbeat from core client for 30 sec - exiting
19:34:37 (2050): No heartbeat from core client for 30 sec - exiting
19:34:38 (2050): No heartbeat from core client for 30 sec - exiting
19:34:39 (2050): No heartbeat from core client for 30 sec - exiting
19:34:40 (2050): No heartbeat from core client for 30 sec - exiting
19:34:41 (2050): No heartbeat from core client for 30 sec - exiting
19:34:42 (2050): No heartbeat from core client for 30 sec - exiting
19:34:43 (2050): No heartbeat from core client for 30 sec - exiting
19:34:44 (2050): No heartbeat from core client for 30 sec - exiting
19:34:45 (2050): No heartbeat from core client for 30 sec - exiting
19:34:46 (2050): No heartbeat from core client for 30 sec - exiting
19:34:47 (2050): No heartbeat from core client for 30 sec - exiting
19:34:48 (2050): No heartbeat from core client for 30 sec - exiting
19:34:49 (2050): No heartbeat from core client for 30 sec - exiting
19:34:50 (2050): No heartbeat from core client for 30 sec - exiting
19:34:51 (2050): No heartbeat from core client for 30 sec - exiting
19:34:52 (2050): No heartbeat from core client for 30 sec - exiting
19:34:53 (2050): No heartbeat from core client for 30 sec - exiting
19:34:54 (2050): No heartbeat from core client for 30 sec - exiting
19:34:55 (2050): No heartbeat from core client for 30 sec - exiting
19:34:56 (2050): No heartbeat from core client for 30 sec - exiting
19:34:57 (2050): No heartbeat from core client for 30 sec - exiting
19:34:58 (2050): No heartbeat from core client for 30 sec - exiting
19:34:59 (2050): No heartbeat from core client for 30 sec - exiting
19:35:00 (2050): No heartbeat from core client for 30 sec - exiting
19:35:01 (2050): No heartbeat from core client for 30 sec - exiting
19:35:02 (2050): No heartbeat from core client for 30 sec - exiting
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/atmos_restart.day
19:35:42 (2050): No heartbeat from core client for 30 sec - exiting
19:35:43 (2050): No heartbeat from core client for 30 sec - exiting
19:35:44 (2050): No heartbeat from core client for 30 sec - exiting
19:35:45 (2050): No heartbeat from core client for 30 sec - exiting
19:35:46 (2050): No heartbeat from core client for 30 sec - exiting
19:35:47 (2050): No heartbeat from core client for 30 sec - exiting
19:35:48 (2050): No heartbeat from core client for 30 sec - exiting
19:35:49 (2050): No heartbeat from core client for 30 sec - exiting
19:35:50 (2050): No heartbeat from core client for 30 sec - exiting
19:35:51 (2050): No heartbeat from core client for 30 sec - exiting
19:35:52 (2050): No heartbeat from core client for 30 sec - exiting
19:35:53 (2050): No heartbeat from core client for 30 sec - exiting
19:35:54 (2050): No heartbeat from core client for 30 sec - exiting
19:35:55 (2050): No heartbeat from core client for 30 sec - exiting
19:35:56 (2050): No heartbeat from core client for 30 sec - exiting
19:35:57 (2050): No heartbeat from core client for 30 sec - exiting
19:35:58 (2050): No heartbeat from core client for 30 sec - exiting
19:35:59 (2050): No heartbeat from core client for 30 sec - exiting
19:36:00 (2050): No heartbeat from core client for 30 sec - exiting
19:36:01 (2050): No heartbeat from core client for 30 sec - exiting
19:36:02 (2050): No heartbeat from core client for 30 sec - exiting
19:36:03 (2050): No heartbeat from core client for 30 sec - exiting
19:36:04 (2050): No heartbeat from core client for 30 sec - exiting
19:36:05 (2050): No heartbeat from core client for 30 sec - exiting
19:36:06 (2050): No heartbeat from core client for 30 sec - exiting
19:36:07 (2050): No heartbeat from core client for 30 sec - exiting
19:36:08 (2050): No heartbeat from core client for 30 sec - exiting
19:36:09 (2050): No heartbeat from core client for 30 sec - exiting
19:36:10 (2050): No heartbeat from core client for 30 sec - exiting
19:36:11 (2050): No heartbeat from core client for 30 sec - exiting
19:36:12 (2050): No heartbeat from core client for 30 sec - exiting
19:36:13 (2050): No heartbeat from core client for 30 sec - exiting
19:36:14 (2050): No heartbeat from core client for 30 sec - exiting
19:36:15 (2050): No heartbeat from core client for 30 sec - exiting
19:36:16 (2050): No heartbeat from core client for 30 sec - exiting
19:36:17 (2050): No heartbeat from core client for 30 sec - exiting
19:36:18 (2050): No heartbeat from core client for 30 sec - exiting
19:36:19 (2050): No heartbeat from core client for 30 sec - exiting
19:36:20 (2050): No heartbeat from core client for 30 sec - exiting
19:36:21 (2050): No heartbeat from core client for 30 sec - exiting
19:36:22 (2050): No heartbeat from core client for 30 sec - exiting
19:36:23 (2050): No heartbeat from core client for 30 sec - exiting
19:36:24 (2050): No heartbeat from core client for 30 sec - exiting
19:36:25 (2050): No heartbeat from core client for 30 sec - exiting
19:36:26 (2050): No heartbeat from core client for 30 sec - exiting
19:36:27 (2050): No heartbeat from core client for 30 sec - exiting
19:36:28 (2050): No heartbeat from core client for 30 sec - exiting
19:36:29 (2050): No heartbeat from core client for 30 sec - exiting
19:36:30 (2050): No heartbeat from core client for 30 sec - exiting
19:36:31 (2050): No heartbeat from core client for 30 sec - exiting
19:36:32 (2050): No heartbeat from core client for 30 sec - exiting
19:36:33 (2050): No heartbeat from core client for 30 sec - exiting
19:36:34 (2050): No heartbeat from core client for 30 sec - exiting
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/ocean_restart.day
CPDN Monitor - No 'heartbeat' from BOINC...
19:37:50 (2220): No heartbeat from core client for 30 sec - exiting
19:37:51 (2220): No heartbeat from core client for 30 sec - exiting
19:37:52 (2220): No heartbeat from core client for 30 sec - exiting
19:37:53 (2220): No heartbeat from core client for 30 sec - exiting
19:37:54 (2220): No heartbeat from core client for 30 sec - exiting
19:37:55 (2220): No heartbeat from core client for 30 sec - exiting
19:37:56 (2220): No heartbeat from core client for 30 sec - exiting
19:37:57 (2220): No heartbeat from core client for 30 sec - exiting
19:37:58 (2220): No heartbeat from core client for 30 sec - exiting
19:37:59 (2220): No heartbeat from core client for 30 sec - exiting
19:38:00 (2220): No heartbeat from core client for 30 sec - exiting
19:38:01 (2220): No heartbeat from core client for 30 sec - exiting
19:38:02 (2220): No heartbeat from core client for 30 sec - exiting
19:38:03 (2220): No heartbeat from core client for 30 sec - exiting
19:38:04 (2220): No heartbeat from core client for 30 sec - exiting
19:38:05 (2220): No heartbeat from core client for 30 sec - exiting
19:38:06 (2220): No heartbeat from core client for 30 sec - exiting
19:38:07 (2220): No heartbeat from core client for 30 sec - exiting
19:38:08 (2220): No heartbeat from core client for 30 sec - exiting
19:38:09 (2220): No heartbeat from core client for 30 sec - exiting
19:38:10 (2220): No heartbeat from core client for 30 sec - exiting
19:38:11 (2220): No heartbeat from core client for 30 sec - exiting
19:38:12 (2220): No heartbeat from core client for 30 sec - exiting
19:38:13 (2220): No heartbeat from core client for 30 sec - exiting
19:38:14 (2220): No heartbeat from core client for 30 sec - exiting
19:38:15 (2220): No heartbeat from core client for 30 sec - exiting
19:38:16 (2220): No heartbeat from core client for 30 sec - exiting
19:38:17 (2220): No heartbeat from core client for 30 sec - exiting
19:38:18 (2220): No heartbeat from core client for 30 sec - exiting
19:38:19 (2220): No heartbeat from core client for 30 sec - exiting
19:38:20 (2220): No heartbeat from core client for 30 sec - exiting
19:38:21 (2220): No heartbeat from core client for 30 sec - exiting
19:38:22 (2220): No heartbeat from core client for 30 sec - exiting
19:38:23 (2220): No heartbeat from core client for 30 sec - exiting
19:38:24 (2220): No heartbeat from core client for 30 sec - exiting
19:38:25 (2220): No heartbeat from core client for 30 sec - exiting
19:38:26 (2220): No heartbeat from core client for 30 sec - exiting
19:38:27 (2220): No heartbeat from core client for 30 sec - exiting
19:38:28 (2220): No heartbeat from core client for 30 sec - exiting
19:38:29 (2220): No heartbeat from core client for 30 sec - exiting
19:38:30 (2220): No heartbeat from core client for 30 sec - exiting
19:38:31 (2220): No heartbeat from core client for 30 sec - exiting
19:38:32 (2220): No heartbeat from core client for 30 sec - exiting
19:38:33 (2220): No heartbeat from core client for 30 sec - exiting
19:38:34 (2220): No heartbeat from core client for 30 sec - exiting
19:38:35 (2220): No heartbeat from core client for 30 sec - exiting
19:38:36 (2220): No heartbeat from core client for 30 sec - exiting
19:38:37 (2220): No heartbeat from core client for 30 sec - exiting
19:38:38 (2220): No heartbeat from core client for 30 sec - exiting
19:38:39 (2220): No heartbeat from core client for 30 sec - exiting
19:38:40 (2220): No heartbeat from core client for 30 sec - exiting
19:38:41 (2220): No heartbeat from core client for 30 sec - exiting
19:38:42 (2220): No heartbeat from core client for 30 sec - exiting
19:38:43 (2220): No heartbeat from core client for 30 sec - exiting
19:38:44 (2220): No heartbeat from core client for 30 sec - exiting
19:38:45 (2220): No heartbeat from core client for 30 sec - exiting
19:38:46 (2220): No heartbeat from core client for 30 sec - exiting
19:38:47 (2220): No heartbeat from core client for 30 sec - exiting
19:38:48 (2220): No heartbeat from core client for 30 sec - exiting
19:38:49 (2220): No heartbeat from core client for 30 sec - exiting
19:38:50 (2220): No heartbeat from core client for 30 sec - exiting
19:38:51 (2220): No heartbeat from core client for 30 sec - exiting
19:38:52 (2220): No heartbeat from core client for 30 sec - exiting
19:38:53 (2220): No heartbeat from core client for 30 sec - exiting
19:38:54 (2220): No heartbeat from core client for 30 sec - exiting
19:38:55 (2220): No heartbeat from core client for 30 sec - exiting
19:38:56 (2220): No heartbeat from core client for 30 sec - exiting
19:38:57 (2220): No heartbeat from core client for 30 sec - exiting
19:38:58 (2220): No heartbeat from core client for 30 sec - exiting
19:38:59 (2220): No heartbeat from core client for 30 sec - exiting
19:39:00 (2220): No heartbeat from core client for 30 sec - exiting
19:39:01 (2220): No heartbeat from core client for 30 sec - exiting
19:39:02 (2220): No heartbeat from core client for 30 sec - exiting
19:39:03 (2220): No heartbeat from core client for 30 sec - exiting
19:39:04 (2220): No heartbeat from core client for 30 sec - exiting
19:39:05 (2220): No heartbeat from core client for 30 sec - exiting
19:39:06 (2220): No heartbeat from core client for 30 sec - exiting
19:39:07 (2220): No heartbeat from core client for 30 sec - exiting
19:39:08 (2220): No heartbeat from core client for 30 sec - exiting
19:39:09 (2220): No heartbeat from core client for 30 sec - exiting
19:39:10 (2220): No heartbeat from core client for 30 sec - exiting
19:39:11 (2220): No heartbeat from core client for 30 sec - exiting
19:39:12 (2220): No heartbeat from core client for 30 sec - exiting
19:39:13 (2220): No heartbeat from core client for 30 sec - exiting
19:39:14 (2220): No heartbeat from core client for 30 sec - exiting
19:39:15 (2220): No heartbeat from core client for 30 sec - exiting
19:39:16 (2220): No heartbeat from core client for 30 sec - exiting
19:39:17 (2220): No heartbeat from core client for 30 sec - exiting
19:39:18 (2220): No heartbeat from core client for 30 sec - exiting
19:39:19 (2220): No heartbeat from core client for 30 sec - exiting
19:39:20 (2220): No heartbeat from core client for 30 sec - exiting
19:39:21 (2220): No heartbeat from core client for 30 sec - exiting
19:39:22 (2220): No heartbeat from core client for 30 sec - exiting
19:39:23 (2220): No heartbeat from core client for 30 sec - exiting
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/atmos_restart.day
19:39:54 (2220): No heartbeat from core client for 30 sec - exiting
19:39:55 (2220): No heartbeat from core client for 30 sec - exiting
19:39:56 (2220): No heartbeat from core client for 30 sec - exiting
19:39:57 (2220): No heartbeat from core client for 30 sec - exiting
19:39:58 (2220): No heartbeat from core client for 30 sec - exiting
19:39:59 (2220): No heartbeat from core client for 30 sec - exiting
19:40:00 (2220): No heartbeat from core client for 30 sec - exiting
19:40:01 (2220): No heartbeat from core client for 30 sec - exiting
19:40:02 (2220): No heartbeat from core client for 30 sec - exiting
19:40:03 (2220): No heartbeat from core client for 30 sec - exiting
19:40:04 (2220): No heartbeat from core client for 30 sec - exiting
19:40:05 (2220): No heartbeat from core client for 30 sec - exiting
19:40:06 (2220): No heartbeat from core client for 30 sec - exiting
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/ocean_restart.day
CPDN Monitor - No 'heartbeat' from BOINC...
19:41:59 (2363): No heartbeat from core client for 30 sec - exiting
19:42:00 (2363): No heartbeat from core client for 30 sec - exiting
19:42:01 (2363): No heartbeat from core client for 30 sec - exiting
19:42:02 (2363): No heartbeat from core client for 30 sec - exiting
19:42:03 (2363): No heartbeat from core client for 30 sec - exiting
19:42:04 (2363): No heartbeat from core client for 30 sec - exiting
19:42:05 (2363): No heartbeat from core client for 30 sec - exiting
19:42:06 (2363): No heartbeat from core client for 30 sec - exiting
19:42:07 (2363): No heartbeat from core client for 30 sec - exiting
19:42:08 (2363): No heartbeat from core client for 30 sec - exiting
19:42:41 (2363): No heartbeat from core client for 30 sec - exiting
19:42:42 (2363): No heartbeat from core client for 30 sec - exiting
19:42:43 (2363): No heartbeat from core client for 30 sec - exiting
19:42:44 (2363): No heartbeat from core client for 30 sec - exiting
19:42:45 (2363): No heartbeat from core client for 30 sec - exiting
19:42:46 (2363): No heartbeat from core client for 30 sec - exiting
19:42:47 (2363): No heartbeat from core client for 30 sec - exiting
19:42:48 (2363): No heartbeat from core client for 30 sec - exiting
19:42:49 (2363): No heartbeat from core client for 30 sec - exiting
19:42:50 (2363): No heartbeat from core client for 30 sec - exiting
19:42:51 (2363): No heartbeat from core client for 30 sec - exiting
19:42:52 (2363): No heartbeat from core client for 30 sec - exiting
19:42:53 (2363): No heartbeat from core client for 30 sec - exiting
19:42:54 (2363): No heartbeat from core client for 30 sec - exiting
19:42:55 (2363): No heartbeat from core client for 30 sec - exiting
19:42:56 (2363): No heartbeat from core client for 30 sec - exiting
19:42:57 (2363): No heartbeat from core client for 30 sec - exiting
19:42:58 (2363): No heartbeat from core client for 30 sec - exiting
19:42:59 (2363): No heartbeat from core client for 30 sec - exiting
19:43:00 (2363): No heartbeat from core client for 30 sec - exiting
19:43:01 (2363): No heartbeat from core client for 30 sec - exiting
19:43:02 (2363): No heartbeat from core client for 30 sec - exiting
19:43:03 (2363): No heartbeat from core client for 30 sec - exiting
19:43:04 (2363): No heartbeat from core client for 30 sec - exiting
19:43:05 (2363): No heartbeat from core client for 30 sec - exiting
19:43:06 (2363): No heartbeat from core client for 30 sec - exiting
19:43:07 (2363): No heartbeat from core client for 30 sec - exiting
19:43:08 (2363): No heartbeat from core client for 30 sec - exiting
19:43:09 (2363): No heartbeat from core client for 30 sec - exiting
19:43:10 (2363): No heartbeat from core client for 30 sec - exiting
19:43:11 (2363): No heartbeat from core client for 30 sec - exiting
19:43:12 (2363): No heartbeat from core client for 30 sec - exiting
19:43:13 (2363): No heartbeat from core client for 30 sec - exiting
19:43:14 (2363): No heartbeat from core client for 30 sec - exiting
19:43:15 (2363): No heartbeat from core client for 30 sec - exiting
19:43:16 (2363): No heartbeat from core client for 30 sec - exiting
19:43:17 (2363): No heartbeat from core client for 30 sec - exiting
19:43:18 (2363): No heartbeat from core client for 30 sec - exiting
19:43:19 (2363): No heartbeat from core client for 30 sec - exiting
19:43:20 (2363): No heartbeat from core client for 30 sec - exiting
19:43:21 (2363): No heartbeat from core client for 30 sec - exiting
19:43:22 (2363): No heartbeat from core client for 30 sec - exiting
19:43:23 (2363): No heartbeat from core client for 30 sec - exiting
19:43:24 (2363): No heartbeat from core client for 30 sec - exiting
19:43:25 (2363): No heartbeat from core client for 30 sec - exiting
19:43:26 (2363): No heartbeat from core client for 30 sec - exiting
19:43:27 (2363): No heartbeat from core client for 30 sec - exiting
19:43:28 (2363): No heartbeat from core client for 30 sec - exiting
19:43:29 (2363): No heartbeat from core client for 30 sec - exiting
19:43:30 (2363): No heartbeat from core client for 30 sec - exiting
19:43:31 (2363): No heartbeat from core client for 30 sec - exiting
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/atmos_restart.day
19:43:32 (2363): No heartbeat from core client for 30 sec - exiting
19:43:33 (2363): No heartbeat from core client for 30 sec - exiting
19:43:34 (2363): No heartbeat from core client for 30 sec - exiting
19:43:35 (2363): No heartbeat from core client for 30 sec - exiting
19:43:36 (2363): No heartbeat from core client for 30 sec - exiting
19:43:37 (2363): No heartbeat from core client for 30 sec - exiting
19:43:38 (2363): No heartbeat from core client for 30 sec - exiting
19:43:39 (2363): No heartbeat from core client for 30 sec - exiting
19:43:40 (2363): No heartbeat from core client for 30 sec - exiting
19:43:41 (2363): No heartbeat from core client for 30 sec - exiting
19:43:42 (2363): No heartbeat from core client for 30 sec - exiting
19:43:43 (2363): No heartbeat from core client for 30 sec - exiting
19:43:44 (2363): No heartbeat from core client for 30 sec - exiting
19:43:45 (2363): No heartbeat from core client for 30 sec - exiting
19:43:46 (2363): No heartbeat from core client for 30 sec - exiting
19:43:47 (2363): No heartbeat from core client for 30 sec - exiting
19:43:48 (2363): No heartbeat from core client for 30 sec - exiting
19:43:49 (2363): No heartbeat from core client for 30 sec - exiting
19:43:50 (2363): No heartbeat from core client for 30 sec - exiting
19:43:51 (2363): No heartbeat from core client for 30 sec - exiting
19:43:52 (2363): No heartbeat from core client for 30 sec - exiting
19:43:53 (2363): No heartbeat from core client for 30 sec - exiting
19:43:54 (2363): No heartbeat from core client for 30 sec - exiting
19:43:55 (2363): No heartbeat from core client for 30 sec - exiting
19:43:56 (2363): No heartbeat from core client for 30 sec - exiting
19:43:57 (2363): No heartbeat from core client for 30 sec - exiting
19:43:58 (2363): No heartbeat from core client for 30 sec - exiting
19:43:59 (2363): No heartbeat from core client for 30 sec - exiting
19:44:00 (2363): No heartbeat from core client for 30 sec - exiting
19:44:01 (2363): No heartbeat from core client for 30 sec - exiting
19:44:02 (2363): No heartbeat from core client for 30 sec - exiting
19:44:03 (2363): No heartbeat from core client for 30 sec - exiting
19:44:04 (2363): No heartbeat from core client for 30 sec - exiting
19:44:05 (2363): No heartbeat from core client for 30 sec - exiting
19:44:06 (2363): No heartbeat from core client for 30 sec - exiting
19:44:07 (2363): No heartbeat from core client for 30 sec - exiting
19:44:08 (2363): No heartbeat from core client for 30 sec - exiting
19:44:09 (2363): No heartbeat from core client for 30 sec - exiting
19:44:10 (2363): No heartbeat from core client for 30 sec - exiting
19:44:11 (2363): No heartbeat from core client for 30 sec - exiting
19:44:12 (2363): No heartbeat from core client for 30 sec - exiting
19:44:13 (2363): No heartbeat from core client for 30 sec - exiting
19:44:14 (2363): No heartbeat from core client for 30 sec - exiting
19:44:15 (2363): No heartbeat from core client for 30 sec - exiting
19:44:16 (2363): No heartbeat from core client for 30 sec - exiting
19:44:17 (2363): No heartbeat from core client for 30 sec - exiting
19:44:18 (2363): No heartbeat from core client for 30 sec - exiting
19:44:19 (2363): No heartbeat from core client for 30 sec - exiting
19:44:20 (2363): No heartbeat from core client for 30 sec - exiting
19:44:21 (2363): No heartbeat from core client for 30 sec - exiting
19:44:22 (2363): No heartbeat from core client for 30 sec - exiting
19:44:23 (2363): No heartbeat from core client for 30 sec - exiting
19:44:24 (2363): No heartbeat from core client for 30 sec - exiting
19:44:25 (2363): No heartbeat from core client for 30 sec - exiting
19:44:26 (2363): No heartbeat from core client for 30 sec - exiting
19:44:27 (2363): No heartbeat from core client for 30 sec - exiting
19:44:28 (2363): No heartbeat from core client for 30 sec - exiting
19:44:29 (2363): No heartbeat from core client for 30 sec - exiting
19:44:30 (2363): No heartbeat from core client for 30 sec - exiting
19:44:31 (2363): No heartbeat from core client for 30 sec - exiting
19:44:32 (2363): No heartbeat from core client for 30 sec - exiting
19:44:33 (2363): No heartbeat from core client for 30 sec - exiting
19:44:34 (2363): No heartbeat from core client for 30 sec - exiting
19:44:35 (2363): No heartbeat from core client for 30 sec - exiting
19:44:36 (2363): No heartbeat from core client for 30 sec - exiting
19:44:37 (2363): No heartbeat from core client for 30 sec - exiting
19:44:38 (2363): No heartbeat from core client for 30 sec - exiting
19:44:39 (2363): No heartbeat from core client for 30 sec - exiting
19:44:40 (2363): No heartbeat from core client for 30 sec - exiting
19:44:41 (2363): No heartbeat from core client for 30 sec - exiting
19:44:42 (2363): No heartbeat from core client for 30 sec - exiting
19:44:43 (2363): No heartbeat from core client for 30 sec - exiting
19:44:44 (2363): No heartbeat from core client for 30 sec - exiting
19:44:45 (2363): No heartbeat from core client for 30 sec - exiting
19:44:46 (2363): No heartbeat from core client for 30 sec - exiting
19:44:47 (2363): No heartbeat from core client for 30 sec - exiting
19:44:48 (2363): No heartbeat from core client for 30 sec - exiting
19:44:49 (2363): No heartbeat from core client for 30 sec - exiting
19:44:50 (2363): No heartbeat from core client for 30 sec - exiting
19:44:51 (2363): No heartbeat from core client for 30 sec - exiting
19:44:52 (2363): No heartbeat from core client for 30 sec - exiting
19:44:53 (2363): No heartbeat from core client for 30 sec - exiting
19:44:54 (2363): No heartbeat from core client for 30 sec - exiting
19:44:55 (2363): No heartbeat from core client for 30 sec - exiting
19:44:56 (2363): No heartbeat from core client for 30 sec - exiting
19:44:57 (2363): No heartbeat from core client for 30 sec - exiting
19:44:58 (2363): No heartbeat from core client for 30 sec - exiting
19:44:59 (2363): No heartbeat from core client for 30 sec - exiting
19:45:00 (2363): No heartbeat from core client for 30 sec - exiting
19:45:01 (2363): No heartbeat from core client for 30 sec - exiting
19:45:02 (2363): No heartbeat from core client for 30 sec - exiting
19:45:03 (2363): No heartbeat from core client for 30 sec - exiting
19:45:04 (2363): No heartbeat from core client for 30 sec - exiting
19:45:05 (2363): No heartbeat from core client for 30 sec - exiting
19:45:06 (2363): No heartbeat from core client for 30 sec - exiting
19:45:07 (2363): No heartbeat from core client for 30 sec - exiting
19:45:08 (2363): No heartbeat from core client for 30 sec - exiting
19:45:09 (2363): No heartbeat from core client for 30 sec - exiting
19:45:10 (2363): No heartbeat from core client for 30 sec - exiting
19:45:11 (2363): No heartbeat from core client for 30 sec - exiting
19:45:12 (2363): No heartbeat from core client for 30 sec - exiting
19:45:13 (2363): No heartbeat from core client for 30 sec - exiting
19:45:14 (2363): No heartbeat from core client for 30 sec - exiting
19:45:15 (2363): No heartbeat from core client for 30 sec - exiting
19:45:16 (2363): No heartbeat from core client for 30 sec - exiting
19:45:17 (2363): No heartbeat from core client for 30 sec - exiting
19:45:18 (2363): No heartbeat from core client for 30 sec - exiting
19:45:19 (2363): No heartbeat from core client for 30 sec - exiting
19:45:20 (2363): No heartbeat from core client for 30 sec - exiting
19:45:21 (2363): No heartbeat from core client for 30 sec - exiting
19:45:22 (2363): No heartbeat from core client for 30 sec - exiting
19:45:23 (2363): No heartbeat from core client for 30 sec - exiting
19:45:24 (2363): No heartbeat from core client for 30 sec - exiting
19:45:25 (2363): No heartbeat from core client for 30 sec - exiting
19:45:26 (2363): No heartbeat from core client for 30 sec - exiting
19:45:27 (2363): No heartbeat from core client for 30 sec - exiting
19:45:28 (2363): No heartbeat from core client for 30 sec - exiting
19:45:29 (2363): No heartbeat from core client for 30 sec - exiting
19:45:30 (2363): No heartbeat from core client for 30 sec - exiting
19:45:31 (2363): No heartbeat from core client for 30 sec - exiting
19:45:32 (2363): No heartbeat from core client for 30 sec - exiting
19:45:33 (2363): No heartbeat from core client for 30 sec - exiting
19:45:34 (2363): No heartbeat from core client for 30 sec - exiting
19:45:35 (2363): No heartbeat from core client for 30 sec - exiting
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/ocean_restart.day
CPDN Monitor - No 'heartbeat' from BOINC...
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/atmos_restart.day
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/ocean_restart.day

BUFFIN: Read Failed: Input/output error
BUFFIN: C I/O Error ferror - Unit 21 - Return code = 1

Model crashed: READDUMP: BAD BUFFIN OF DATA                                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/atmos_restart.day
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/ocean_restart.day

BUFFIN: Read Failed: Input/output error
BUFFIN: C I/O Error ferror - Unit 21 - Return code = 1

Model crashed: READDUMP: BAD BUFFIN OF DATA                                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/atmos_restart.day
cpdnmonitor: error reading file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_y83n_1940_40_007833850/dataout/ocean_restart.day

BUFFIN: Read Failed: Input/output error
BUFFIN: C I/O Error ferror - Unit 21 - Return code = 1

Model crashed: READDUMP: BAD BUFFIN OF DATA                                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
29 Jun 2012 14:28:11 1195688 14290746 hadcm3n_y83n_1940_40_007833850_1 1,010,880 3,168,278 3.1342
26 Jun 2012 17:25:31 1195688 14290746 hadcm3n_y83n_1940_40_007833850_1 984,960 3,083,980 3.1311
22 Jun 2012 21:04:22 1195688 14290746 hadcm3n_y83n_1940_40_007833850_1 959,040 2,996,275 3.1242
18 Jun 2012 21:35:00 1195688 14290746 hadcm3n_y83n_1940_40_007833850_1 933,120 2,909,135 3.1176
17 Jun 2012 05:06:24 1195688 14290746 hadcm3n_y83n_1940_40_007833850_1 907,200 2,820,845 3.1094
15 Jun 2012 17:20:57 1195688 14290746 hadcm3n_y83n_1940_40_007833850_1 881,280 2,740,170 3.1093
11 Jun 2012 09:46:17 1195688 14290746 hadcm3n_y83n_1940_40_007833850_1 855,360 2,662,079 3.1122
06 Jun 2012 11:39:58 1195688 14290746 hadcm3n_y83n_1940_40_007833850_1 829,440 2,579,929 3.1104
03 Jun 2012 17:05:05 1195688 14290746 hadcm3n_y83n_1940_40_007833850_1 803,520 2,497,248 3.1079
01 Jun 2012 19:06:37 1195688 14290746 hadcm3n_y83n_1940_40_007833850_1 777,600 2,408,552 3.0974
28 May 2012 23:07:30 1195688 14290746 hadcm3n_y83n_1940_40_007833850_1 751,680 2,322,472 3.0897
26 May 2012 15:55:48 1195688 14290746 hadcm3n_y83n_1940_40_007833850_1 725,760 2,220,468 3.0595
24 May 2012 19:49:24 1195688 14290746 hadcm3n_y83n_1940_40_007833850_1 699,840 2,129,984 3.0435
22 May 2012 18:35:17 1195688 14290746 hadcm3n_y83n_1940_40_007833850_1 673,920 2,049,129 3.0406
21 May 2012 00:53:11 1195688 14290746 hadcm3n_y83n_1940_40_007833850_1 648,000 1,966,789 3.0352
19 May 2012 15:02:10 1195688 14290746 hadcm3n_y83n_1940_40_007833850_1 622,080 1,890,740 3.0394
17 May 2012 15:39:49 1195688 14290746 hadcm3n_y83n_1940_40_007833850_1 596,160 1,812,082 3.0396
15 May 2012 09:54:13 1195688 14290746 hadcm3n_y83n_1940_40_007833850_1 570,240 1,736,824 3.0458
11 May 2012 23:19:56 1195688 14290746 hadcm3n_y83n_1940_40_007833850_1 544,320 1,648,538 3.0286
08 May 2012 18:33:03 1195688 14290746 hadcm3n_y83n_1940_40_007833850_1 518,400 1,570,874 3.0302


©2024 climateprediction.net