climateprediction.net home page
Task 15793274

Task 15793274

Name hadcm3n_4jaj_1980_40_008361161_2
Workunit 8512020
Created 22 May 2013, 15:07:47 UTC
Sent 22 May 2013, 15:07:55 UTC
Report deadline 21 Aug 2013, 22:35:06 UTC
Received 2 Jun 2013, 21:23:17 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1282401
Run time 10 days 11 hours 56 min 29 sec
CPU time 10 days 6 hours 7 min 2 sec
Validate state Invalid
Credit 3,732.48
Device peak FLOPS 2.01 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
17:25:14 (2338): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:25:18 (2338): No heartbeat from core client for 30 sec - exiting
09:35:20 (3009): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
07:56:34 (13139): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:54:28 (52355): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:28:04 (10386): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:12:21 (14762): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:40:34 (37905): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:45:34 (38940): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:45:35 (38940): No heartbeat from core client for 30 sec - exiting
06:45:36 (38940): No heartbeat from core client for 30 sec - exiting
06:45:37 (38940): No heartbeat from core client for 30 sec - exiting
06:45:38 (38940): No heartbeat from core client for 30 sec - exiting
06:45:39 (38940): No heartbeat from core client for 30 sec - exiting
06:45:40 (38940): No heartbeat from core client for 30 sec - exiting
06:45:41 (38940): No heartbeat from core client for 30 sec - exiting
06:45:42 (38940): No heartbeat from core client for 30 sec - exiting
06:45:43 (38940): No heartbeat from core client for 30 sec - exiting
06:45:44 (38940): No heartbeat from core client for 30 sec - exiting
06:45:45 (38940): No heartbeat from core client for 30 sec - exiting
06:45:46 (38940): No heartbeat from core client for 30 sec - exiting
06:45:47 (38940): No heartbeat from core client for 30 sec - exiting
06:45:48 (38940): No heartbeat from core client for 30 sec - exiting
06:45:49 (38940): No heartbeat from core client for 30 sec - exiting
06:45:50 (38940): No heartbeat from core client for 30 sec - exiting
09:04:31 (39115): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:36:02 (40750): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:40:28 (41738): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:40:29 (41738): No heartbeat from core client for 30 sec - exiting
10:40:30 (41738): No heartbeat from core client for 30 sec - exiting
10:40:31 (41738): No heartbeat from core client for 30 sec - exiting
10:40:32 (41738): No heartbeat from core client for 30 sec - exiting
10:40:33 (41738): No heartbeat from core client for 30 sec - exiting
10:40:34 (41738): No heartbeat from core client for 30 sec - exiting
10:40:35 (41738): No heartbeat from core client for 30 sec - exiting
10:40:36 (41738): No heartbeat from core client for 30 sec - exiting
10:40:37 (41738): No heartbeat from core client for 30 sec - exiting
10:40:38 (41738): No heartbeat from core client for 30 sec - exiting
10:40:39 (41738): No heartbeat from core client for 30 sec - exiting
10:45:31 (41955): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:03:47 (42103): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:13:25 (44017): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:13:26 (44017): No heartbeat from core client for 30 sec - exiting
14:13:27 (44017): No heartbeat from core client for 30 sec - exiting
14:13:28 (44017): No heartbeat from core client for 30 sec - exiting
14:13:29 (44017): No heartbeat from core client for 30 sec - exiting
14:51:27 (44392): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:01:02 (44901): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:01:03 (44901): No heartbeat from core client for 30 sec - exiting
15:01:04 (44901): No heartbeat from core client for 30 sec - exiting
15:01:05 (44901): No heartbeat from core client for 30 sec - exiting
15:01:06 (44901): No heartbeat from core client for 30 sec - exiting
15:05:46 (45109): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:42:25 (45331): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:26:39 (45775): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:31:38 (46330): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:43:00 (46536): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:03:46 (46780): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:29:13 (47049): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:38:37 (47489): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:19:10 (47715): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:23:44 (48217): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:28:22 (48437): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:41:08 (48629): No heartbeat from core client for 30 sec - exiting
18:41:09 (48629): No heartbeat from core client for 30 sec - exiting
18:41:10 (48629): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:51:14 (48841): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:56:00 (49613): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:00:34 (49799): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:01:06 (49799): No heartbeat from core client for 30 sec - exiting
21:12:14 (49995): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:17:02 (50762): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:21:10 (50968): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:14:02 (51130): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:14:03 (51130): No heartbeat from core client for 30 sec - exiting
03:18:26 (54366): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:18:27 (54366): No heartbeat from core client for 30 sec - exiting
03:18:28 (54366): No heartbeat from core client for 30 sec - exiting
03:18:29 (54366): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
03:41:29 (54553): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:58:24 (55006): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:03:00 (55306): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:07:31 (55495): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:11:40 (55675): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:42:20 (55857): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:45:52 (57331): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:58:36 (57497): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:12:06 (57698): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:33:43 (59290): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:38:10 (60805): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:38:11 (60805): No heartbeat from core client for 30 sec - exiting
11:38:12 (60805): No heartbeat from core client for 30 sec - exiting
11:38:13 (60805): No heartbeat from core client for 30 sec - exiting
11:38:14 (60805): No heartbeat from core client for 30 sec - exiting
11:38:15 (60805): No heartbeat from core client for 30 sec - exiting
11:38:16 (60805): No heartbeat from core client for 30 sec - exiting
11:38:17 (60805): No heartbeat from core client for 30 sec - exiting
11:38:18 (60805): No heartbeat from core client for 30 sec - exiting
11:38:19 (60805): No heartbeat from core client for 30 sec - exiting
11:38:20 (60805): No heartbeat from core client for 30 sec - exiting
11:38:21 (60805): No heartbeat from core client for 30 sec - exiting
11:38:22 (60805): No heartbeat from core client for 30 sec - exiting
11:38:23 (60805): No heartbeat from core client for 30 sec - exiting
11:38:24 (60805): No heartbeat from core client for 30 sec - exiting
11:38:25 (60805): No heartbeat from core client for 30 sec - exiting
11:38:26 (60805): No heartbeat from core client for 30 sec - exiting
15:37:05 (60977): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:20:28 (63369): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:24:54 (64491): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:04:58 (64647): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:09:33 (962): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:14:05 (1143): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:31:18 (1322): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:35:22 (1622): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:35:23 (1622): No heartbeat from core client for 30 sec - exiting
20:35:24 (1622): No heartbeat from core client for 30 sec - exiting
20:35:25 (1622): No heartbeat from core client for 30 sec - exiting
20:35:26 (1622): No heartbeat from core client for 30 sec - exiting
20:35:27 (1622): No heartbeat from core client for 30 sec - exiting
20:35:28 (1622): No heartbeat from core client for 30 sec - exiting
20:35:29 (1622): No heartbeat from core client for 30 sec - exiting
20:35:30 (1622): No heartbeat from core client for 30 sec - exiting
20:35:31 (1622): No heartbeat from core client for 30 sec - exiting
20:35:32 (1622): No heartbeat from core client for 30 sec - exiting
20:35:33 (1622): No heartbeat from core client for 30 sec - exiting
20:41:51 (1791): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:10:09 (2005): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:21:05 (2416): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:21:06 (2416): No heartbeat from core client for 30 sec - exiting
01:21:07 (2416): No heartbeat from core client for 30 sec - exiting
01:21:08 (2416): No heartbeat from core client for 30 sec - exiting
01:21:09 (2416): No heartbeat from core client for 30 sec - exiting
01:21:10 (2416): No heartbeat from core client for 30 sec - exiting
01:21:11 (2416): No heartbeat from core client for 30 sec - exiting
03:11:46 (5017): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:20:50 (6122): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:12:08 (6325): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
05:16:07 (7466): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:16:08 (7466): No heartbeat from core client for 30 sec - exiting

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
05:41:04 (7633): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:45:27 (7950): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:50:25 (8108): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:50:26 (8108): No heartbeat from core client for 30 sec - exiting
05:50:27 (8108): No heartbeat from core client for 30 sec - exiting
05:50:28 (8108): No heartbeat from core client for 30 sec - exiting
05:50:29 (8108): No heartbeat from core client for 30 sec - exiting
10:41:53 (8274): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:42:22 (11237): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:42:55 (11932): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:46:56 (12056): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:46:57 (12056): No heartbeat from core client for 30 sec - exiting
11:46:58 (12056): No heartbeat from core client for 30 sec - exiting
11:46:59 (12056): No heartbeat from core client for 30 sec - exiting
11:47:00 (12056): No heartbeat from core client for 30 sec - exiting
11:47:01 (12056): No heartbeat from core client for 30 sec - exiting
11:47:02 (12056): No heartbeat from core client for 30 sec - exiting
11:47:03 (12056): No heartbeat from core client for 30 sec - exiting
11:47:04 (12056): No heartbeat from core client for 30 sec - exiting
11:47:05 (12056): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
12:20:13 (12221): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:24:45 (12582): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:30:02 (12741): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:30:03 (12741): No heartbeat from core client for 30 sec - exiting
12:38:45 (12886): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:57:16 (13074): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:02:21 (13452): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:59:15 (13605): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:03:22 (14202): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:12:41 (14338): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:05:03 (14561): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:32:58 (17226): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:38:05 (17572): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:38:06 (17572): No heartbeat from core client for 30 sec - exiting
19:38:07 (17572): No heartbeat from core client for 30 sec - exiting
19:38:08 (17572): No heartbeat from core client for 30 sec - exiting
19:38:09 (17572): No heartbeat from core client for 30 sec - exiting
19:38:10 (17572): No heartbeat from core client for 30 sec - exiting
19:38:11 (17572): No heartbeat from core client for 30 sec - exiting
19:38:12 (17572): No heartbeat from core client for 30 sec - exiting
19:38:13 (17572): No heartbeat from core client for 30 sec - exiting
19:38:14 (17572): No heartbeat from core client for 30 sec - exiting
19:38:15 (17572): No heartbeat from core client for 30 sec - exiting
19:38:16 (17572): No heartbeat from core client for 30 sec - exiting
19:38:17 (17572): No heartbeat from core client for 30 sec - exiting
19:38:18 (17572): No heartbeat from core client for 30 sec - exiting
19:42:57 (17741): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:47:02 (17910): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:47:03 (17910): No heartbeat from core client for 30 sec - exiting
19:47:04 (17910): No heartbeat from core client for 30 sec - exiting
19:47:05 (17910): No heartbeat from core client for 30 sec - exiting
19:47:06 (17910): No heartbeat from core client for 30 sec - exiting
19:47:07 (17910): No heartbeat from core client for 30 sec - exiting
19:47:08 (17910): No heartbeat from core client for 30 sec - exiting
19:47:09 (17910): No heartbeat from core client for 30 sec - exiting
19:47:10 (17910): No heartbeat from core client for 30 sec - exiting
19:47:11 (17910): No heartbeat from core client for 30 sec - exiting
19:47:12 (17910): No heartbeat from core client for 30 sec - exiting
19:47:13 (17910): No heartbeat from core client for 30 sec - exiting
19:47:14 (17910): No heartbeat from core client for 30 sec - exiting
19:47:15 (17910): No heartbeat from core client for 30 sec - exiting
19:47:16 (17910): No heartbeat from core client for 30 sec - exiting
19:47:17 (17910): No heartbeat from core client for 30 sec - exiting
19:47:18 (17910): No heartbeat from core client for 30 sec - exiting
19:47:19 (17910): No heartbeat from core client for 30 sec - exiting
19:47:20 (17910): No heartbeat from core client for 30 sec - exiting
19:47:21 (17910): No heartbeat from core client for 30 sec - exiting
19:47:22 (17910): No heartbeat from core client for 30 sec - exiting
19:47:23 (17910): No heartbeat from core client for 30 sec - exiting
19:47:24 (17910): No heartbeat from core client for 30 sec - exiting
20:31:53 (18078): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:31:55 (18078): No heartbeat from core client for 30 sec - exiting
20:37:02 (18576): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:37:03 (18576): No heartbeat from core client for 30 sec - exiting
20:37:04 (18576): No heartbeat from core client for 30 sec - exiting
20:37:05 (18576): No heartbeat from core client for 30 sec - exiting
20:41:10 (18750): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:41:11 (18750): No heartbeat from core client for 30 sec - exiting
20:41:12 (18750): No heartbeat from core client for 30 sec - exiting
20:41:13 (18750): No heartbeat from core client for 30 sec - exiting
20:41:14 (18750): No heartbeat from core client for 30 sec - exiting
20:41:15 (18750): No heartbeat from core client for 30 sec - exiting
22:09:32 (18926): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:14:06 (19803): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:14:07 (19803): No heartbeat from core client for 30 sec - exiting
22:44:11 (19957): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:48:26 (20335): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:48:27 (20335): No heartbeat from core client for 30 sec - exiting
22:48:28 (20335): No heartbeat from core client for 30 sec - exiting
22:48:29 (20335): No heartbeat from core client for 30 sec - exiting
22:48:30 (20335): No heartbeat from core client for 30 sec - exiting
22:48:31 (20335): No heartbeat from core client for 30 sec - exiting
22:48:32 (20335): No heartbeat from core client for 30 sec - exiting
22:48:33 (20335): No heartbeat from core client for 30 sec - exiting
22:48:34 (20335): No heartbeat from core client for 30 sec - exiting
22:48:35 (20335): No heartbeat from core client for 30 sec - exiting
23:12:52 (20493): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:17:35 (20855): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:34:06 (21017): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:34:07 (21017): No heartbeat from core client for 30 sec - exiting
23:34:08 (21017): No heartbeat from core client for 30 sec - exiting
23:42:56 (21280): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:42:57 (21280): No heartbeat from core client for 30 sec - exiting
23:47:36 (21475): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:44:14 (21639): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:44:15 (21639): No heartbeat from core client for 30 sec - exiting
02:48:21 (23531): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:48:22 (23531): No heartbeat from core client for 30 sec - exiting
02:48:23 (23531): No heartbeat from core client for 30 sec - exiting
02:48:24 (23531): No heartbeat from core client for 30 sec - exiting
02:48:25 (23531): No heartbeat from core client for 30 sec - exiting
02:48:26 (23531): No heartbeat from core client for 30 sec - exiting
02:48:27 (23531): No heartbeat from core client for 30 sec - exiting
02:48:28 (23531): No heartbeat from core client for 30 sec - exiting
02:48:29 (23531): No heartbeat from core client for 30 sec - exiting
02:48:30 (23531): No heartbeat from core client for 30 sec - exiting
02:48:31 (23531): No heartbeat from core client for 30 sec - exiting
02:53:18 (23682): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:53:19 (23682): No heartbeat from core client for 30 sec - exiting
02:53:20 (23682): No heartbeat from core client for 30 sec - exiting
02:53:21 (23682): No heartbeat from core client for 30 sec - exiting
02:53:22 (23682): No heartbeat from core client for 30 sec - exiting
02:57:21 (23859): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:01:40 (24021): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:01:41 (24021): No heartbeat from core client for 30 sec - exiting
03:01:42 (24021): No heartbeat from core client for 30 sec - exiting
03:01:43 (24021): No heartbeat from core client for 30 sec - exiting
03:01:44 (24021): No heartbeat from core client for 30 sec - exiting
03:01:45 (24021): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
04:13:15 (24189): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:44:38 (24917): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:49:04 (25780): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:49:05 (25780): No heartbeat from core client for 30 sec - exiting
05:49:06 (25780): No heartbeat from core client for 30 sec - exiting
05:49:07 (25780): No heartbeat from core client for 30 sec - exiting
05:49:08 (25780): No heartbeat from core client for 30 sec - exiting
05:49:09 (25780): No heartbeat from core client for 30 sec - exiting
05:53:33 (25939): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:53:34 (25939): No heartbeat from core client for 30 sec - exiting
05:53:35 (25939): No heartbeat from core client for 30 sec - exiting
05:53:36 (25939): No heartbeat from core client for 30 sec - exiting
05:53:37 (25939): No heartbeat from core client for 30 sec - exiting
05:53:38 (25939): No heartbeat from core client for 30 sec - exiting
05:53:39 (25939): No heartbeat from core client for 30 sec - exiting
05:53:40 (25939): No heartbeat from core client for 30 sec - exiting
05:53:41 (25939): No heartbeat from core client for 30 sec - exiting
05:53:42 (25939): No heartbeat from core client for 30 sec - exiting
05:53:43 (25939): No heartbeat from core client for 30 sec - exiting
05:53:44 (25939): No heartbeat from core client for 30 sec - exiting
05:53:45 (25939): No heartbeat from core client for 30 sec - exiting
05:53:46 (25939): No heartbeat from core client for 30 sec - exiting
05:57:57 (26097): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:57:58 (26097): No heartbeat from core client for 30 sec - exiting
05:57:59 (26097): No heartbeat from core client for 30 sec - exiting
05:58:00 (26097): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
08:25:20 (26268): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:29:40 (28024): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:34:00 (28172): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:46:00 (28329): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:50:15 (28705): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:04:50 (28876): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:04:51 (28876): No heartbeat from core client for 30 sec - exiting
12:04:52 (28876): No heartbeat from core client for 30 sec - exiting
12:04:53 (28876): No heartbeat from core client for 30 sec - exiting
12:04:54 (28876): No heartbeat from core client for 30 sec - exiting
12:04:55 (28876): No heartbeat from core client for 30 sec - exiting
12:04:56 (28876): No heartbeat from core client for 30 sec - exiting
12:04:57 (28876): No heartbeat from core client for 30 sec - exiting
12:04:58 (28876): No heartbeat from core client for 30 sec - exiting
13:51:17 (30719): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:51:18 (30719): No heartbeat from core client for 30 sec - exiting
13:51:19 (30719): No heartbeat from core client for 30 sec - exiting
13:51:20 (30719): No heartbeat from core client for 30 sec - exiting
13:51:21 (30719): No heartbeat from core client for 30 sec - exiting
13:51:22 (30719): No heartbeat from core client for 30 sec - exiting
13:51:23 (30719): No heartbeat from core client for 30 sec - exiting
13:51:24 (30719): No heartbeat from core client for 30 sec - exiting
13:51:25 (30719): No heartbeat from core client for 30 sec - exiting
13:51:26 (30719): No heartbeat from core client for 30 sec - exiting
13:51:27 (30719): No heartbeat from core client for 30 sec - exiting
13:51:28 (30719): No heartbeat from core client for 30 sec - exiting
13:51:29 (30719): No heartbeat from core client for 30 sec - exiting
13:51:30 (30719): No heartbeat from core client for 30 sec - exiting
13:51:31 (30719): No heartbeat from core client for 30 sec - exiting
13:51:32 (30719): No heartbeat from core client for 30 sec - exiting
13:51:33 (30719): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
14:00:03 (31835): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:39:20 (32071): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:40:44 (34083): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:44:57 (35530): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:44:58 (35530): No heartbeat from core client for 30 sec - exiting
19:44:59 (35530): No heartbeat from core client for 30 sec - exiting
19:45:00 (35530): No heartbeat from core client for 30 sec - exiting
19:45:01 (35530): No heartbeat from core client for 30 sec - exiting
19:45:02 (35530): No heartbeat from core client for 30 sec - exiting
19:45:03 (35530): No heartbeat from core client for 30 sec - exiting
19:45:04 (35530): No heartbeat from core client for 30 sec - exiting
19:49:16 (35682): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:53:51 (35842): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:53:52 (35842): No heartbeat from core client for 30 sec - exiting
19:53:53 (35842): No heartbeat from core client for 30 sec - exiting
19:53:54 (35842): No heartbeat from core client for 30 sec - exiting
19:53:55 (35842): No heartbeat from core client for 30 sec - exiting
19:53:56 (35842): No heartbeat from core client for 30 sec - exiting
19:53:57 (35842): No heartbeat from core client for 30 sec - exiting
19:53:58 (35842): No heartbeat from core client for 30 sec - exiting
19:53:59 (35842): No heartbeat from core client for 30 sec - exiting
19:54:00 (35842): No heartbeat from core client for 30 sec - exiting
19:54:01 (35842): No heartbeat from core client for 30 sec - exiting
20:40:28 (36008): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:40:29 (36008): No heartbeat from core client for 30 sec - exiting
20:40:30 (36008): No heartbeat from core client for 30 sec - exiting
20:40:31 (36008): No heartbeat from core client for 30 sec - exiting
20:40:32 (36008): No heartbeat from core client for 30 sec - exiting
20:40:33 (36008): No heartbeat from core client for 30 sec - exiting
20:40:34 (36008): No heartbeat from core client for 30 sec - exiting
20:40:35 (36008): No heartbeat from core client for 30 sec - exiting
20:40:36 (36008): No heartbeat from core client for 30 sec - exiting
20:40:37 (36008): No heartbeat from core client for 30 sec - exiting
20:40:38 (36008): No heartbeat from core client for 30 sec - exiting
20:40:39 (36008): No heartbeat from core client for 30 sec - exiting
20:40:40 (36008): No heartbeat from core client for 30 sec - exiting
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf77a2400]
[0xf77a2425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75bf1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf75c2825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75aa4d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=36548, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7793400]
[0xf7793425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75b01df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf75b3825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf759b4d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=36548, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf77d4400]
[0xf77d4425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75f11df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf75f4825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75dc4d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=36548, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf775b400]
[0xf775b425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75781df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf757b825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75634d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=36548, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7760400]
[0xf7760425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf757d1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7580825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75684d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=36548, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf77b1400]
[0xf77b1425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75ce1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf75d1825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75b94d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=36548, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
02 Jun 2013 02:26:25 1282401 15793274 hadcm3n_4jaj_1980_40_008361161_2 311,040 831,263 2.6725
01 Jun 2013 04:10:29 1282401 15793274 hadcm3n_4jaj_1980_40_008361161_2 285,120 767,227 2.6909
31 May 2013 08:16:04 1282401 15793274 hadcm3n_4jaj_1980_40_008361161_2 259,200 703,789 2.7152
30 May 2013 10:14:42 1282401 15793274 hadcm3n_4jaj_1980_40_008361161_2 233,280 640,855 2.7471
29 May 2013 10:38:33 1282401 15793274 hadcm3n_4jaj_1980_40_008361161_2 207,360 561,523 2.7080
28 May 2013 12:30:04 1282401 15793274 hadcm3n_4jaj_1980_40_008361161_2 181,440 485,415 2.6753
27 May 2013 16:06:47 1282401 15793274 hadcm3n_4jaj_1980_40_008361161_2 155,520 415,561 2.6721
26 May 2013 20:48:25 1282401 15793274 hadcm3n_4jaj_1980_40_008361161_2 129,600 345,914 2.6691
25 May 2013 23:42:18 1282401 15793274 hadcm3n_4jaj_1980_40_008361161_2 103,680 276,008 2.6621
25 May 2013 03:20:24 1282401 15793274 hadcm3n_4jaj_1980_40_008361161_2 77,760 205,957 2.6486
24 May 2013 07:52:36 1282401 15793274 hadcm3n_4jaj_1980_40_008361161_2 51,840 136,736 2.6377
23 May 2013 11:39:04 1282401 15793274 hadcm3n_4jaj_1980_40_008361161_2 25,920 68,234 2.6325


©2024 climateprediction.net