climateprediction.net home page
Task 15805126

Task 15805126

Name hadcm3n_n3o8_1880_40_008376235_0
Workunit 8527094
Created 30 May 2013, 2:07:44 UTC
Sent 30 May 2013, 2:16:32 UTC
Report deadline 29 Aug 2013, 9:43:43 UTC
Received 1 Jun 2013, 20:21:56 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1282401
Run time 2 days 6 hours 52 min 24 sec
CPU time 2 days 5 hours 32 min 19 sec
Validate state Invalid
Credit 933.12
Device peak FLOPS 1.99 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
05:12:22 (36887): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:36:10 (37989): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:40:34 (38264): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:45:34 (39002): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:45:35 (39002): No heartbeat from core client for 30 sec - exiting
06:45:36 (39002): No heartbeat from core client for 30 sec - exiting
06:45:37 (39002): No heartbeat from core client for 30 sec - exiting
06:45:38 (39002): No heartbeat from core client for 30 sec - exiting
06:45:39 (39002): No heartbeat from core client for 30 sec - exiting
06:45:40 (39002): No heartbeat from core client for 30 sec - exiting
06:45:41 (39002): No heartbeat from core client for 30 sec - exiting
06:45:42 (39002): No heartbeat from core client for 30 sec - exiting
06:45:43 (39002): No heartbeat from core client for 30 sec - exiting
06:45:44 (39002): No heartbeat from core client for 30 sec - exiting
06:45:45 (39002): No heartbeat from core client for 30 sec - exiting
06:45:46 (39002): No heartbeat from core client for 30 sec - exiting
06:45:47 (39002): No heartbeat from core client for 30 sec - exiting
06:45:48 (39002): No heartbeat from core client for 30 sec - exiting
06:45:49 (39002): No heartbeat from core client for 30 sec - exiting
09:04:30 (39188): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:04:31 (39188): No heartbeat from core client for 30 sec - exiting
09:04:32 (39188): No heartbeat from core client for 30 sec - exiting
09:04:33 (39188): No heartbeat from core client for 30 sec - exiting
10:36:02 (40808): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:40:28 (41788): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:40:29 (41788): No heartbeat from core client for 30 sec - exiting
10:40:30 (41788): No heartbeat from core client for 30 sec - exiting
10:40:31 (41788): No heartbeat from core client for 30 sec - exiting
10:40:32 (41788): No heartbeat from core client for 30 sec - exiting
10:40:33 (41788): No heartbeat from core client for 30 sec - exiting
10:40:34 (41788): No heartbeat from core client for 30 sec - exiting
10:40:35 (41788): No heartbeat from core client for 30 sec - exiting
10:40:36 (41788): No heartbeat from core client for 30 sec - exiting
10:40:37 (41788): No heartbeat from core client for 30 sec - exiting
10:40:38 (41788): No heartbeat from core client for 30 sec - exiting
10:40:39 (41788): No heartbeat from core client for 30 sec - exiting
10:45:30 (42014): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:45:31 (42014): No heartbeat from core client for 30 sec - exiting
14:03:47 (42159): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:08:55 (44055): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:08:56 (44055): No heartbeat from core client for 30 sec - exiting
14:08:57 (44055): No heartbeat from core client for 30 sec - exiting
14:08:58 (44055): No heartbeat from core client for 30 sec - exiting
14:08:59 (44055): No heartbeat from core client for 30 sec - exiting
14:09:00 (44055): No heartbeat from core client for 30 sec - exiting
14:09:01 (44055): No heartbeat from core client for 30 sec - exiting
14:09:02 (44055): No heartbeat from core client for 30 sec - exiting
14:09:03 (44055): No heartbeat from core client for 30 sec - exiting
14:13:24 (44205): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:13:25 (44205): No heartbeat from core client for 30 sec - exiting
14:13:26 (44205): No heartbeat from core client for 30 sec - exiting
14:13:27 (44205): No heartbeat from core client for 30 sec - exiting
14:13:28 (44205): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
14:51:27 (44436): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:51:28 (44436): No heartbeat from core client for 30 sec - exiting
15:01:02 (44945): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:05:47 (45153): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
15:47:25 (45368): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:26:39 (45900): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:31:37 (46386): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:31:38 (46386): No heartbeat from core client for 30 sec - exiting
16:31:39 (46386): No heartbeat from core client for 30 sec - exiting
16:31:40 (46386): No heartbeat from core client for 30 sec - exiting
16:43:00 (46595): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:03:45 (46813): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:03:46 (46813): No heartbeat from core client for 30 sec - exiting
17:03:47 (46813): No heartbeat from core client for 30 sec - exiting
17:08:56 (47083): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:08:57 (47083): No heartbeat from core client for 30 sec - exiting
17:29:13 (47193): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:38:36 (47529): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:51:39 (47753): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:51:40 (47753): No heartbeat from core client for 30 sec - exiting
17:51:41 (47753): No heartbeat from core client for 30 sec - exiting
17:51:42 (47753): No heartbeat from core client for 30 sec - exiting
17:51:43 (47753): No heartbeat from core client for 30 sec - exiting
17:51:44 (47753): No heartbeat from core client for 30 sec - exiting
17:51:45 (47753): No heartbeat from core client for 30 sec - exiting
17:51:46 (47753): No heartbeat from core client for 30 sec - exiting
17:51:47 (47753): No heartbeat from core client for 30 sec - exiting
17:51:48 (47753): No heartbeat from core client for 30 sec - exiting
17:51:49 (47753): No heartbeat from core client for 30 sec - exiting
17:51:50 (47753): No heartbeat from core client for 30 sec - exiting
18:19:10 (47938): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:19:11 (47938): No heartbeat from core client for 30 sec - exiting
18:19:12 (47938): No heartbeat from core client for 30 sec - exiting
18:19:13 (47938): No heartbeat from core client for 30 sec - exiting
18:23:44 (48265): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:41:08 (48476): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:41:09 (48476): No heartbeat from core client for 30 sec - exiting
18:41:10 (48476): No heartbeat from core client for 30 sec - exiting
19:51:14 (48799): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:51:15 (48799): No heartbeat from core client for 30 sec - exiting
19:56:00 (49580): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:56:01 (49580): No heartbeat from core client for 30 sec - exiting
19:56:02 (49580): No heartbeat from core client for 30 sec - exiting
19:56:03 (49580): No heartbeat from core client for 30 sec - exiting
19:56:04 (49580): No heartbeat from core client for 30 sec - exiting
19:56:05 (49580): No heartbeat from core client for 30 sec - exiting
19:56:06 (49580): No heartbeat from core client for 30 sec - exiting
19:56:07 (49580): No heartbeat from core client for 30 sec - exiting
19:56:08 (49580): No heartbeat from core client for 30 sec - exiting
19:56:09 (49580): No heartbeat from core client for 30 sec - exiting
19:56:10 (49580): No heartbeat from core client for 30 sec - exiting
19:56:11 (49580): No heartbeat from core client for 30 sec - exiting
19:56:12 (49580): No heartbeat from core client for 30 sec - exiting
19:56:13 (49580): No heartbeat from core client for 30 sec - exiting
19:56:14 (49580): No heartbeat from core client for 30 sec - exiting
19:56:15 (49580): No heartbeat from core client for 30 sec - exiting
19:56:16 (49580): No heartbeat from core client for 30 sec - exiting
19:56:17 (49580): No heartbeat from core client for 30 sec - exiting
19:56:18 (49580): No heartbeat from core client for 30 sec - exiting
19:56:19 (49580): No heartbeat from core client for 30 sec - exiting
19:56:20 (49580): No heartbeat from core client for 30 sec - exiting
19:56:21 (49580): No heartbeat from core client for 30 sec - exiting
19:56:22 (49580): No heartbeat from core client for 30 sec - exiting
19:56:23 (49580): No heartbeat from core client for 30 sec - exiting
19:56:24 (49580): No heartbeat from core client for 30 sec - exiting
19:56:25 (49580): No heartbeat from core client for 30 sec - exiting
20:00:33 (49769): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:12:14 (49963): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:17:03 (50730): No heartbeat from core client for 30 sec - exiting
21:17:04 (50730): No heartbeat from core client for 30 sec - exiting
21:17:05 (50730): No heartbeat from core client for 30 sec - exiting
21:17:06 (50730): No heartbeat from core client for 30 sec - exiting
21:17:07 (50730): No heartbeat from core client for 30 sec - exiting
21:17:08 (50730): No heartbeat from core client for 30 sec - exiting
21:17:09 (50730): No heartbeat from core client for 30 sec - exiting
21:17:10 (50730): No heartbeat from core client for 30 sec - exiting
21:17:11 (50730): No heartbeat from core client for 30 sec - exiting
21:17:12 (50730): No heartbeat from core client for 30 sec - exiting
21:17:13 (50730): No heartbeat from core client for 30 sec - exiting
21:17:14 (50730): No heartbeat from core client for 30 sec - exiting
21:17:15 (50730): No heartbeat from core client for 30 sec - exiting
21:17:16 (50730): No heartbeat from core client for 30 sec - exiting
21:17:17 (50730): No heartbeat from core client for 30 sec - exiting
21:17:18 (50730): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:14:02 (50924): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:18:12 (54334): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:18:13 (54334): No heartbeat from core client for 30 sec - exiting
03:18:14 (54334): No heartbeat from core client for 30 sec - exiting
03:18:15 (54334): No heartbeat from core client for 30 sec - exiting
03:18:16 (54334): No heartbeat from core client for 30 sec - exiting
03:18:17 (54334): No heartbeat from core client for 30 sec - exiting
03:18:18 (54334): No heartbeat from core client for 30 sec - exiting
03:18:19 (54334): No heartbeat from core client for 30 sec - exiting
03:18:20 (54334): No heartbeat from core client for 30 sec - exiting
03:18:21 (54334): No heartbeat from core client for 30 sec - exiting
03:18:22 (54334): No heartbeat from core client for 30 sec - exiting
03:18:23 (54334): No heartbeat from core client for 30 sec - exiting
03:18:24 (54334): No heartbeat from core client for 30 sec - exiting
03:18:25 (54334): No heartbeat from core client for 30 sec - exiting
03:18:26 (54334): No heartbeat from core client for 30 sec - exiting
03:18:27 (54334): No heartbeat from core client for 30 sec - exiting
03:18:28 (54334): No heartbeat from core client for 30 sec - exiting
03:18:29 (54334): No heartbeat from core client for 30 sec - exiting
03:41:29 (54517): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:41:30 (54517): No heartbeat from core client for 30 sec - exiting
03:41:31 (54517): No heartbeat from core client for 30 sec - exiting
03:41:32 (54517): No heartbeat from core client for 30 sec - exiting
03:58:24 (54998): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:03:00 (55302): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:03:01 (55302): No heartbeat from core client for 30 sec - exiting
04:03:02 (55302): No heartbeat from core client for 30 sec - exiting
04:03:03 (55302): No heartbeat from core client for 30 sec - exiting
04:07:30 (55490): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:11:41 (55670): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:11:42 (55670): No heartbeat from core client for 30 sec - exiting
04:11:43 (55670): No heartbeat from core client for 30 sec - exiting
04:11:44 (55670): No heartbeat from core client for 30 sec - exiting
06:42:21 (55852): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:42:22 (55852): No heartbeat from core client for 30 sec - exiting
06:42:23 (55852): No heartbeat from core client for 30 sec - exiting
06:42:24 (55852): No heartbeat from core client for 30 sec - exiting
06:42:25 (55852): No heartbeat from core client for 30 sec - exiting
06:42:26 (55852): No heartbeat from core client for 30 sec - exiting
06:45:51 (57327): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:58:35 (57493): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:58:36 (57493): No heartbeat from core client for 30 sec - exiting
06:58:37 (57493): No heartbeat from core client for 30 sec - exiting
06:58:38 (57493): No heartbeat from core client for 30 sec - exiting
06:58:39 (57493): No heartbeat from core client for 30 sec - exiting
06:58:40 (57493): No heartbeat from core client for 30 sec - exiting
06:58:41 (57493): No heartbeat from core client for 30 sec - exiting
09:12:06 (57696): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:12:07 (57696): No heartbeat from core client for 30 sec - exiting
09:12:08 (57696): No heartbeat from core client for 30 sec - exiting
09:12:09 (57696): No heartbeat from core client for 30 sec - exiting
09:12:10 (57696): No heartbeat from core client for 30 sec - exiting
09:12:11 (57696): No heartbeat from core client for 30 sec - exiting
09:12:12 (57696): No heartbeat from core client for 30 sec - exiting
09:12:13 (57696): No heartbeat from core client for 30 sec - exiting
11:24:11 (59284): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:24:12 (59284): No heartbeat from core client for 30 sec - exiting
11:24:13 (59284): No heartbeat from core client for 30 sec - exiting
11:24:14 (59284): No heartbeat from core client for 30 sec - exiting
11:24:15 (59284): No heartbeat from core client for 30 sec - exiting
11:24:16 (59284): No heartbeat from core client for 30 sec - exiting
11:24:17 (59284): No heartbeat from core client for 30 sec - exiting
11:24:18 (59284): No heartbeat from core client for 30 sec - exiting
11:24:19 (59284): No heartbeat from core client for 30 sec - exiting
11:24:20 (59284): No heartbeat from core client for 30 sec - exiting
11:24:21 (59284): No heartbeat from core client for 30 sec - exiting
11:28:48 (60536): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:33:44 (60688): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:33:45 (60688): No heartbeat from core client for 30 sec - exiting
11:33:46 (60688): No heartbeat from core client for 30 sec - exiting
11:33:47 (60688): No heartbeat from core client for 30 sec - exiting
11:33:48 (60688): No heartbeat from core client for 30 sec - exiting
11:33:49 (60688): No heartbeat from core client for 30 sec - exiting
11:33:50 (60688): No heartbeat from core client for 30 sec - exiting
11:33:51 (60688): No heartbeat from core client for 30 sec - exiting
11:33:52 (60688): No heartbeat from core client for 30 sec - exiting
11:33:53 (60688): No heartbeat from core client for 30 sec - exiting
11:33:54 (60688): No heartbeat from core client for 30 sec - exiting
11:38:10 (60854): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:38:11 (60854): No heartbeat from core client for 30 sec - exiting
11:38:12 (60854): No heartbeat from core client for 30 sec - exiting
11:38:13 (60854): No heartbeat from core client for 30 sec - exiting
11:38:14 (60854): No heartbeat from core client for 30 sec - exiting
11:38:15 (60854): No heartbeat from core client for 30 sec - exiting
11:38:16 (60854): No heartbeat from core client for 30 sec - exiting
11:38:17 (60854): No heartbeat from core client for 30 sec - exiting
11:38:18 (60854): No heartbeat from core client for 30 sec - exiting
11:38:19 (60854): No heartbeat from core client for 30 sec - exiting
11:38:20 (60854): No heartbeat from core client for 30 sec - exiting
11:38:21 (60854): No heartbeat from core client for 30 sec - exiting
11:38:22 (60854): No heartbeat from core client for 30 sec - exiting
11:38:23 (60854): No heartbeat from core client for 30 sec - exiting
11:38:24 (60854): No heartbeat from core client for 30 sec - exiting
11:38:25 (60854): No heartbeat from core client for 30 sec - exiting
11:38:26 (60854): No heartbeat from core client for 30 sec - exiting
13:10:59 (61026): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:11:00 (61026): No heartbeat from core client for 30 sec - exiting
13:11:01 (61026): No heartbeat from core client for 30 sec - exiting
13:11:02 (61026): No heartbeat from core client for 30 sec - exiting
13:11:03 (61026): No heartbeat from core client for 30 sec - exiting
13:11:04 (61026): No heartbeat from core client for 30 sec - exiting
13:11:05 (61026): No heartbeat from core client for 30 sec - exiting
13:11:06 (61026): No heartbeat from core client for 30 sec - exiting
13:11:07 (61026): No heartbeat from core client for 30 sec - exiting
13:11:08 (61026): No heartbeat from core client for 30 sec - exiting
13:11:09 (61026): No heartbeat from core client for 30 sec - exiting
13:11:10 (61026): No heartbeat from core client for 30 sec - exiting
13:14:41 (61923): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:14:42 (61923): No heartbeat from core client for 30 sec - exiting
13:14:43 (61923): No heartbeat from core client for 30 sec - exiting
15:37:05 (62029): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:16:07 (63400): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:16:08 (63400): No heartbeat from core client for 30 sec - exiting
17:16:09 (63400): No heartbeat from core client for 30 sec - exiting
17:16:10 (63400): No heartbeat from core client for 30 sec - exiting
17:16:11 (63400): No heartbeat from core client for 30 sec - exiting
17:16:12 (63400): No heartbeat from core client for 30 sec - exiting
17:16:13 (63400): No heartbeat from core client for 30 sec - exiting
17:16:14 (63400): No heartbeat from core client for 30 sec - exiting
17:20:28 (64347): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:24:54 (64541): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:04:59 (64692): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:09:33 (986): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:09:34 (986): No heartbeat from core client for 30 sec - exiting
20:09:35 (986): No heartbeat from core client for 30 sec - exiting
20:09:36 (986): No heartbeat from core client for 30 sec - exiting
20:09:37 (986): No heartbeat from core client for 30 sec - exiting
20:09:38 (986): No heartbeat from core client for 30 sec - exiting
20:09:39 (986): No heartbeat from core client for 30 sec - exiting
20:09:40 (986): No heartbeat from core client for 30 sec - exiting
20:09:41 (986): No heartbeat from core client for 30 sec - exiting
20:09:42 (986): No heartbeat from core client for 30 sec - exiting
20:14:05 (1169): No heartbeat from core client for 30 sec - exiting
20:14:06 (1169): No heartbeat from core client for 30 sec - exiting
20:14:07 (1169): No heartbeat from core client for 30 sec - exiting
20:14:08 (1169): No heartbeat from core client for 30 sec - exiting
20:14:09 (1169): No heartbeat from core client for 30 sec - exiting
20:14:10 (1169): No heartbeat from core client for 30 sec - exiting
20:14:11 (1169): No heartbeat from core client for 30 sec - exiting
20:14:12 (1169): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:31:19 (1354): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:35:21 (1646): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:35:22 (1646): No heartbeat from core client for 30 sec - exiting
20:35:23 (1646): No heartbeat from core client for 30 sec - exiting
20:35:24 (1646): No heartbeat from core client for 30 sec - exiting
20:35:25 (1646): No heartbeat from core client for 30 sec - exiting
20:35:26 (1646): No heartbeat from core client for 30 sec - exiting
20:35:27 (1646): No heartbeat from core client for 30 sec - exiting
20:35:28 (1646): No heartbeat from core client for 30 sec - exiting
20:35:29 (1646): No heartbeat from core client for 30 sec - exiting
20:35:30 (1646): No heartbeat from core client for 30 sec - exiting
20:35:31 (1646): No heartbeat from core client for 30 sec - exiting
20:35:32 (1646): No heartbeat from core client for 30 sec - exiting
20:35:33 (1646): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
20:41:51 (1819): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:41:52 (1819): No heartbeat from core client for 30 sec - exiting
21:10:10 (2034): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
22:12:56 (2450): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:23:39 (3194): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:23:40 (3194): No heartbeat from core client for 30 sec - exiting
00:23:41 (3194): No heartbeat from core client for 30 sec - exiting
00:23:42 (3194): No heartbeat from core client for 30 sec - exiting
00:23:43 (3194): No heartbeat from core client for 30 sec - exiting
01:21:05 (4428): No heartbeat from core client for 30 sec - exiting
01:21:06 (4428): No heartbeat from core client for 30 sec - exiting
01:21:07 (4428): No heartbeat from core client for 30 sec - exiting
01:21:08 (4428): No heartbeat from core client for 30 sec - exiting
01:21:09 (4428): No heartbeat from core client for 30 sec - exiting
01:21:10 (4428): No heartbeat from core client for 30 sec - exiting
01:21:11 (4428): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:11:47 (5063): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:11:48 (5063): No heartbeat from core client for 30 sec - exiting
03:11:49 (5063): No heartbeat from core client for 30 sec - exiting
03:11:50 (5063): No heartbeat from core client for 30 sec - exiting
03:20:50 (6148): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:12:08 (6346): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:16:07 (7476): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:16:08 (7476): No heartbeat from core client for 30 sec - exiting
05:16:09 (7476): No heartbeat from core client for 30 sec - exiting
05:41:04 (7646): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:41:05 (7646): No heartbeat from core client for 30 sec - exiting
05:41:06 (7646): No heartbeat from core client for 30 sec - exiting
05:41:07 (7646): No heartbeat from core client for 30 sec - exiting
05:41:08 (7646): No heartbeat from core client for 30 sec - exiting
05:45:28 (7962): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:50:25 (8123): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:50:26 (8123): No heartbeat from core client for 30 sec - exiting
05:50:27 (8123): No heartbeat from core client for 30 sec - exiting
05:50:28 (8123): No heartbeat from core client for 30 sec - exiting
05:50:29 (8123): No heartbeat from core client for 30 sec - exiting
05:50:30 (8123): No heartbeat from core client for 30 sec - exiting
10:41:53 (8289): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:41:54 (8289): No heartbeat from core client for 30 sec - exiting
10:41:55 (8289): No heartbeat from core client for 30 sec - exiting
11:42:23 (11249): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:46:56 (11959): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:46:57 (11959): No heartbeat from core client for 30 sec - exiting
11:46:58 (11959): No heartbeat from core client for 30 sec - exiting
11:46:59 (11959): No heartbeat from core client for 30 sec - exiting
11:47:00 (11959): No heartbeat from core client for 30 sec - exiting
11:47:01 (11959): No heartbeat from core client for 30 sec - exiting
11:47:02 (11959): No heartbeat from core client for 30 sec - exiting
11:47:03 (11959): No heartbeat from core client for 30 sec - exiting
11:47:04 (11959): No heartbeat from core client for 30 sec - exiting
11:47:05 (11959): No heartbeat from core client for 30 sec - exiting
12:20:14 (12117): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:24:45 (12496): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:24:46 (12496): No heartbeat from core client for 30 sec - exiting
12:24:47 (12496): No heartbeat from core client for 30 sec - exiting
12:24:48 (12496): No heartbeat from core client for 30 sec - exiting
12:24:49 (12496): No heartbeat from core client for 30 sec - exiting
12:24:50 (12496): No heartbeat from core client for 30 sec - exiting
12:24:51 (12496): No heartbeat from core client for 30 sec - exiting
12:30:02 (12653): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:30:03 (12653): No heartbeat from core client for 30 sec - exiting
12:38:45 (12796): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:57:15 (12994): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:59:15 (13447): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:03:22 (14203): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:03:23 (14203): No heartbeat from core client for 30 sec - exiting
14:03:24 (14203): No heartbeat from core client for 30 sec - exiting
14:03:25 (14203): No heartbeat from core client for 30 sec - exiting
14:03:26 (14203): No heartbeat from core client for 30 sec - exiting
14:03:27 (14203): No heartbeat from core client for 30 sec - exiting
14:08:20 (14343): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:12:41 (14471): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:12:42 (14471): No heartbeat from core client for 30 sec - exiting
14:12:43 (14471): No heartbeat from core client for 30 sec - exiting
19:05:03 (14628): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:05:04 (14628): No heartbeat from core client for 30 sec - exiting
19:05:05 (14628): No heartbeat from core client for 30 sec - exiting
19:05:06 (14628): No heartbeat from core client for 30 sec - exiting
19:05:07 (14628): No heartbeat from core client for 30 sec - exiting
19:05:08 (14628): No heartbeat from core client for 30 sec - exiting
19:05:09 (14628): No heartbeat from core client for 30 sec - exiting
19:05:10 (14628): No heartbeat from core client for 30 sec - exiting
19:32:58 (17283): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:38:05 (17627): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:38:06 (17627): No heartbeat from core client for 30 sec - exiting
19:38:07 (17627): No heartbeat from core client for 30 sec - exiting
19:38:08 (17627): No heartbeat from core client for 30 sec - exiting
19:38:09 (17627): No heartbeat from core client for 30 sec - exiting
19:38:10 (17627): No heartbeat from core client for 30 sec - exiting
19:38:11 (17627): No heartbeat from core client for 30 sec - exiting
19:38:12 (17627): No heartbeat from core client for 30 sec - exiting
19:38:13 (17627): No heartbeat from core client for 30 sec - exiting
19:38:14 (17627): No heartbeat from core client for 30 sec - exiting
19:38:15 (17627): No heartbeat from core client for 30 sec - exiting
19:38:16 (17627): No heartbeat from core client for 30 sec - exiting
19:38:17 (17627): No heartbeat from core client for 30 sec - exiting
19:38:18 (17627): No heartbeat from core client for 30 sec - exiting
19:38:19 (17627): No heartbeat from core client for 30 sec - exiting
19:42:58 (17793): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:42:59 (17793): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
19:47:02 (17959): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:47:03 (17959): No heartbeat from core client for 30 sec - exiting
19:47:04 (17959): No heartbeat from core client for 30 sec - exiting
19:47:05 (17959): No heartbeat from core client for 30 sec - exiting
19:47:06 (17959): No heartbeat from core client for 30 sec - exiting
19:47:07 (17959): No heartbeat from core client for 30 sec - exiting
19:47:08 (17959): No heartbeat from core client for 30 sec - exiting
19:47:09 (17959): No heartbeat from core client for 30 sec - exiting
19:47:10 (17959): No heartbeat from core client for 30 sec - exiting
19:47:11 (17959): No heartbeat from core client for 30 sec - exiting
19:47:12 (17959): No heartbeat from core client for 30 sec - exiting
19:47:13 (17959): No heartbeat from core client for 30 sec - exiting
19:47:14 (17959): No heartbeat from core client for 30 sec - exiting
19:47:15 (17959): No heartbeat from core client for 30 sec - exiting
19:47:16 (17959): No heartbeat from core client for 30 sec - exiting
19:47:17 (17959): No heartbeat from core client for 30 sec - exiting
19:47:18 (17959): No heartbeat from core client for 30 sec - exiting
19:47:19 (17959): No heartbeat from core client for 30 sec - exiting
19:47:20 (17959): No heartbeat from core client for 30 sec - exiting
19:47:21 (17959): No heartbeat from core client for 30 sec - exiting
19:47:22 (17959): No heartbeat from core client for 30 sec - exiting
19:47:23 (17959): No heartbeat from core client for 30 sec - exiting
19:47:24 (17959): No heartbeat from core client for 30 sec - exiting
20:31:53 (18130): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:37:02 (18628): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:37:03 (18628): No heartbeat from core client for 30 sec - exiting
20:37:04 (18628): No heartbeat from core client for 30 sec - exiting
20:37:05 (18628): No heartbeat from core client for 30 sec - exiting
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf77c1400]
[0xf77c1425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75de1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf75e1825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75c94d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=18805, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7715400]
[0xf7715425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75321df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7535825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf751d4d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=18805, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf779c400]
[0xf779c425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75b91df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf75bc825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75a44d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=18805, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7761400]
[0xf7761425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf757e1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7581825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75694d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=18805, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7752400]
[0xf7752425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf756f1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7572825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf755a4d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=18805, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf772d400]
[0xf772d425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf754a1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf754d825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75354d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=18805, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
01 Jun 2013 18:36:05 1282401 15805126 hadcm3n_n3o8_1880_40_008376235_0 77,760 189,635 2.4387
31 May 2013 21:28:12 1282401 15805126 hadcm3n_n3o8_1880_40_008376235_0 51,840 127,235 2.4544
31 May 2013 01:28:25 1282401 15805126 hadcm3n_n3o8_1880_40_008376235_0 25,920 65,293 2.5190


©2024 climateprediction.net