climateprediction.net home page
Task 16204743

Task 16204743

Name hadcm3n_o65w_1980_40_008388853_4
Workunit 8539712
Created 13 Jan 2014, 4:16:38 UTC
Sent 13 Jan 2014, 4:16:41 UTC
Report deadline 14 Apr 2014, 11:43:52 UTC
Received 10 Feb 2014, 8:20:20 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1290855
Run time 11 days 14 hours 5 min 52 sec
CPU time 11 days 11 hours 17 min 27 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 3.22 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.1.0</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
02:59:03 (6700): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:07:22 (7395): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:40:08 (7752): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:56:27 (8510): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:56:28 (8510): No heartbeat from core client for 30 sec - exiting
06:56:29 (8510): No heartbeat from core client for 30 sec - exiting
06:56:30 (8510): No heartbeat from core client for 30 sec - exiting
06:56:31 (8510): No heartbeat from core client for 30 sec - exiting
07:22:39 (8678): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:51:23 (8942): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:32:44 (9236): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:44:39 (9441): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
11:34:43 (14815): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:53:39 (14932): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:20:51 (15176): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:42:32 (15377): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:04:06 (15546): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
14:25:42 (15892): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
15:51:06 (16327): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:51:10 (16327): No heartbeat from core client for 30 sec - exiting
15:59:47 (16386): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:02:17 (16551): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
23:43:21 (23422): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
00:22:31 (23586): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:22:32 (23586): No heartbeat from core client for 30 sec - exiting
00:22:33 (23586): No heartbeat from core client for 30 sec - exiting
00:22:34 (23586): No heartbeat from core client for 30 sec - exiting
00:22:35 (23586): No heartbeat from core client for 30 sec - exiting
00:27:38 (23666): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:27:42 (23666): No heartbeat from core client for 30 sec - exiting
00:32:52 (23722): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:40:48 (23779): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:43:15 (23863): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:58:56 (23894): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:58:59 (23894): No heartbeat from core client for 30 sec - exiting
00:59:00 (23894): No heartbeat from core client for 30 sec - exiting
00:59:01 (23894): No heartbeat from core client for 30 sec - exiting
00:59:02 (23894): No heartbeat from core client for 30 sec - exiting
00:59:03 (23894): No heartbeat from core client for 30 sec - exiting
00:59:04 (23894): No heartbeat from core client for 30 sec - exiting
01:04:37 (24039): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:09:38 (24108): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
01:33:44 (27407): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:13:16 (30074): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:13:43 (30074): No heartbeat from core client for 30 sec - exiting
10:13:44 (30074): No heartbeat from core client for 30 sec - exiting
10:13:45 (30074): No heartbeat from core client for 30 sec - exiting
10:13:46 (30074): No heartbeat from core client for 30 sec - exiting
10:13:47 (30074): No heartbeat from core client for 30 sec - exiting
10:13:48 (30074): No heartbeat from core client for 30 sec - exiting
10:16:07 (1947): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:22:33 (1976): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:23:12 (1976): No heartbeat from core client for 30 sec - exiting
10:23:13 (1976): No heartbeat from core client for 30 sec - exiting
10:23:14 (1976): No heartbeat from core client for 30 sec - exiting
10:39:08 (2035): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:39:38 (2035): No heartbeat from core client for 30 sec - exiting
10:39:39 (2035): No heartbeat from core client for 30 sec - exiting
10:45:08 (2154): No heartbeat from core client for 30 sec - exiting
10:45:18 (2154): No heartbeat from core client for 30 sec - exiting
10:45:19 (2154): No heartbeat from core client for 30 sec - exiting
10:45:20 (2154): No heartbeat from core client for 30 sec - exiting
10:45:21 (2154): No heartbeat from core client for 30 sec - exiting
10:45:22 (2154): No heartbeat from core client for 30 sec - exiting
10:45:23 (2154): No heartbeat from core client for 30 sec - exiting
10:45:24 (2154): No heartbeat from core client for 30 sec - exiting
10:45:25 (2154): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Error: Input file: dataout/o65wko.pji5c10 is not a valid UM file.
Error converting file to netcdf: dataout/o65wko.pji5c10
Error: Input file: dataout/o65wko.pii5c10 is not a valid UM file.
Error converting file to netcdf: dataout/o65wko.pii5c10
Error: Input file: dataout/o65wko.pfi5c10 is not a valid UM file.
Error converting file to netcdf: dataout/o65wko.pfi5c10
Error: Input file: dataout/o65wka.phi5c10 is not a valid UM file.
Error converting file to netcdf: dataout/o65wka.phi5c10
Error: Input file: dataout/o65wka.pgi5c10 is not a valid UM file.
Error converting file to netcdf: dataout/o65wka.pgi5c10
Error: Input file: dataout/o65wka.pei5c10 is not a valid UM file.
Error converting file to netcdf: dataout/o65wka.pei5c10
Error: Input file: dataout/o65wka.pdi5c10 is not a valid UM file.
Error converting file to netcdf: dataout/o65wka.pdi5c10
10:50:54 (2221): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:58:21 (2255): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:14:09 (2326): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:17:55 (2496): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:18:05 (2496): No heartbeat from core client for 30 sec - exiting
11:18:06 (2496): No heartbeat from core client for 30 sec - exiting
11:18:07 (2496): No heartbeat from core client for 30 sec - exiting
11:18:08 (2496): No heartbeat from core client for 30 sec - exiting
11:18:09 (2496): No heartbeat from core client for 30 sec - exiting
11:18:10 (2496): No heartbeat from core client for 30 sec - exiting
11:18:11 (2496): No heartbeat from core client for 30 sec - exiting
11:18:12 (2496): No heartbeat from core client for 30 sec - exiting
11:18:13 (2496): No heartbeat from core client for 30 sec - exiting
11:18:14 (2496): No heartbeat from core client for 30 sec - exiting
11:18:15 (2496): No heartbeat from core client for 30 sec - exiting
11:22:54 (2532): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:35:35 (2583): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
17:00:02 (3790): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
17:54:55 (4002): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:57:23 (4049): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:19:32 (4071): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:27:12 (4197): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
23:07:55 (6494): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:15:28 (6544): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:15:40 (6544): No heartbeat from core client for 30 sec - exiting
23:15:41 (6544): No heartbeat from core client for 30 sec - exiting
23:15:42 (6544): No heartbeat from core client for 30 sec - exiting
23:15:43 (6544): No heartbeat from core client for 30 sec - exiting
23:15:44 (6544): No heartbeat from core client for 30 sec - exiting
23:15:45 (6544): No heartbeat from core client for 30 sec - exiting
23:15:46 (6544): No heartbeat from core client for 30 sec - exiting
23:44:31 (6615): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:44:48 (6615): No heartbeat from core client for 30 sec - exiting
23:44:49 (6615): No heartbeat from core client for 30 sec - exiting
23:44:50 (6615): No heartbeat from core client for 30 sec - exiting
23:44:51 (6615): No heartbeat from core client for 30 sec - exiting
23:44:52 (6615): No heartbeat from core client for 30 sec - exiting
23:44:53 (6615): No heartbeat from core client for 30 sec - exiting
23:44:54 (6615): No heartbeat from core client for 30 sec - exiting
23:44:55 (6615): No heartbeat from core client for 30 sec - exiting
23:44:56 (6615): No heartbeat from core client for 30 sec - exiting
23:49:15 (6836): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:55:41 (6876): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:32:01 (7246): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:37:55 (7364): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:47:21 (8037): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:16:58 (8074): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:52:01 (8169): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
07:07:44 (8485): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:10:02 (8562): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:15:38 (8596): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:16:11 (8596): No heartbeat from core client for 30 sec - exiting
07:16:12 (8596): No heartbeat from core client for 30 sec - exiting
07:16:13 (8596): No heartbeat from core client for 30 sec - exiting
07:16:14 (8596): No heartbeat from core client for 30 sec - exiting
07:20:41 (8652): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:25:27 (8696): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:27:51 (8748): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:47:06 (8782): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:21:53 (8964): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:55:13 (9124): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:57:45 (9202): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:17:58 (9227): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:20:11 (9305): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:29:23 (9325): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:31:56 (9361): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:43:11 (9372): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
11:14:06 (9854): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:16:46 (9898): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:17:14 (9898): No heartbeat from core client for 30 sec - exiting
11:17:15 (9898): No heartbeat from core client for 30 sec - exiting
11:17:16 (9898): No heartbeat from core client for 30 sec - exiting
11:17:17 (9898): No heartbeat from core client for 30 sec - exiting
11:17:18 (9898): No heartbeat from core client for 30 sec - exiting
11:17:19 (9898): No heartbeat from core client for 30 sec - exiting
11:17:20 (9898): No heartbeat from core client for 30 sec - exiting
11:17:21 (9898): No heartbeat from core client for 30 sec - exiting
11:20:10 (9923): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:26:32 (9945): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:43:55 (9964): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:44:01 (9964): No heartbeat from core client for 30 sec - exiting
11:44:02 (9964): No heartbeat from core client for 30 sec - exiting
11:44:03 (9964): No heartbeat from core client for 30 sec - exiting
11:44:04 (9964): No heartbeat from core client for 30 sec - exiting
11:44:05 (9964): No heartbeat from core client for 30 sec - exiting
11:44:06 (9964): No heartbeat from core client for 30 sec - exiting
11:44:07 (9964): No heartbeat from core client for 30 sec - exiting
11:51:15 (10018): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
12:08:34 (10199): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:16:48 (10225): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
14:02:30 (10701): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:02:44 (10701): No heartbeat from core client for 30 sec - exiting
14:02:45 (10701): No heartbeat from core client for 30 sec - exiting
14:02:46 (10701): No heartbeat from core client for 30 sec - exiting
14:02:47 (10701): No heartbeat from core client for 30 sec - exiting
14:05:05 (10741): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:24:47 (13570): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:25:08 (13570): No heartbeat from core client for 30 sec - exiting
10:25:09 (13570): No heartbeat from core client for 30 sec - exiting
10:25:10 (13570): No heartbeat from core client for 30 sec - exiting
10:27:22 (15686): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:28:28 (15686): No heartbeat from core client for 30 sec - exiting
10:28:29 (15686): No heartbeat from core client for 30 sec - exiting
10:28:30 (15686): No heartbeat from core client for 30 sec - exiting
10:28:31 (15686): No heartbeat from core client for 30 sec - exiting
10:28:32 (15686): No heartbeat from core client for 30 sec - exiting
10:28:33 (15686): No heartbeat from core client for 30 sec - exiting
10:30:44 (15719): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:31:19 (15719): No heartbeat from core client for 30 sec - exiting
10:31:20 (15719): No heartbeat from core client for 30 sec - exiting
10:31:21 (15719): No heartbeat from core client for 30 sec - exiting
10:31:22 (15719): No heartbeat from core client for 30 sec - exiting
10:31:23 (15719): No heartbeat from core client for 30 sec - exiting
10:31:24 (15719): No heartbeat from core client for 30 sec - exiting
10:31:25 (15719): No heartbeat from core client for 30 sec - exiting
10:31:26 (15719): No heartbeat from core client for 30 sec - exiting
10:31:27 (15719): No heartbeat from core client for 30 sec - exiting
10:31:28 (15719): No heartbeat from core client for 30 sec - exiting
10:35:23 (15752): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:38:46 (15801): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:39:06 (15801): No heartbeat from core client for 30 sec - exiting
10:39:07 (15801): No heartbeat from core client for 30 sec - exiting
10:39:08 (15801): No heartbeat from core client for 30 sec - exiting
10:39:09 (15801): No heartbeat from core client for 30 sec - exiting
10:39:10 (15801): No heartbeat from core client for 30 sec - exiting
10:44:22 (15833): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:44:58 (15833): No heartbeat from core client for 30 sec - exiting
10:44:59 (15833): No heartbeat from core client for 30 sec - exiting
10:45:00 (15833): No heartbeat from core client for 30 sec - exiting
10:45:01 (15833): No heartbeat from core client for 30 sec - exiting
10:45:02 (15833): No heartbeat from core client for 30 sec - exiting
10:45:03 (15833): No heartbeat from core client for 30 sec - exiting
10:45:04 (15833): No heartbeat from core client for 30 sec - exiting
10:45:05 (15833): No heartbeat from core client for 30 sec - exiting
10:45:06 (15833): No heartbeat from core client for 30 sec - exiting
10:45:07 (15833): No heartbeat from core client for 30 sec - exiting
10:45:08 (15833): No heartbeat from core client for 30 sec - exiting
10:48:36 (15891): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:48:39 (15891): No heartbeat from core client for 30 sec - exiting
10:48:40 (15891): No heartbeat from core client for 30 sec - exiting
10:48:41 (15891): No heartbeat from core client for 30 sec - exiting
10:48:42 (15891): No heartbeat from core client for 30 sec - exiting
10:48:43 (15891): No heartbeat from core client for 30 sec - exiting
10:48:44 (15891): No heartbeat from core client for 30 sec - exiting
10:48:45 (15891): No heartbeat from core client for 30 sec - exiting
10:48:46 (15891): No heartbeat from core client for 30 sec - exiting
10:48:47 (15891): No heartbeat from core client for 30 sec - exiting
10:48:48 (15891): No heartbeat from core client for 30 sec - exiting
10:48:49 (15891): No heartbeat from core client for 30 sec - exiting
10:48:50 (15891): No heartbeat from core client for 30 sec - exiting
11:01:17 (15929): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:11:14 (16025): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:34:33 (16186): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:36:43 (16215): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:47:05 (16240): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:47:21 (16240): No heartbeat from core client for 30 sec - exiting
11:51:29 (16287): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:56:15 (16305): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
21:45:09 (18126): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
21:45:16 (18126): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
01:37:13 (18517): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:37:14 (18517): No heartbeat from core client for 30 sec - exiting
01:37:15 (18517): No heartbeat from core client for 30 sec - exiting
01:37:16 (18517): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
02:05:10 (19346): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:07:52 (19412): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:07:53 (19412): No heartbeat from core client for 30 sec - exiting
02:07:54 (19412): No heartbeat from core client for 30 sec - exiting
02:07:55 (19412): No heartbeat from core client for 30 sec - exiting
02:15:11 (19437): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
03:15:42 (19605): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
03:55:03 (19827): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:57:21 (19860): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:57:28 (19860): No heartbeat from core client for 30 sec - exiting
03:57:29 (19860): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
07:18:24 (20453): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:27:43 (20482): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:39:40 (20527): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
11:14:41 (21250): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:26:54 (21288): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:29:06 (21334): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:33:02 (21347): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:35:30 (21370): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:44:31 (21381): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
12:43:42 (21542): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:46:09 (21622): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:50:01 (21640): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:50:07 (21640): No heartbeat from core client for 30 sec - exiting
12:50:08 (21640): No heartbeat from core client for 30 sec - exiting
12:50:09 (21640): No heartbeat from core client for 30 sec - exiting
12:50:10 (21640): No heartbeat from core client for 30 sec - exiting
12:50:11 (21640): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 15 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:26:38 (23017): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:26:53 (23017): No heartbeat from core client for 30 sec - exiting
08:26:54 (23017): No heartbeat from core client for 30 sec - exiting
08:26:55 (23017): No heartbeat from core client for 30 sec - exiting
08:26:56 (23017): No heartbeat from core client for 30 sec - exiting
08:26:57 (23017): No heartbeat from core client for 30 sec - exiting
08:38:35 (23855): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:41:02 (23878): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:41:04 (23878): No heartbeat from core client for 30 sec - exiting
08:41:05 (23878): No heartbeat from core client for 30 sec - exiting
08:41:06 (23878): No heartbeat from core client for 30 sec - exiting
08:41:07 (23878): No heartbeat from core client for 30 sec - exiting
08:41:08 (23878): No heartbeat from core client for 30 sec - exiting
08:56:58 (23905): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
11:59:19 (11946): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:59:24 (11946): No heartbeat from core client for 30 sec - exiting
11:59:25 (11946): No heartbeat from core client for 30 sec - exiting
11:59:26 (11946): No heartbeat from core client for 30 sec - exiting
11:59:27 (11946): No heartbeat from core client for 30 sec - exiting
11:59:28 (11946): No heartbeat from core client for 30 sec - exiting
11:59:29 (11946): No heartbeat from core client for 30 sec - exiting
11:59:30 (11946): No heartbeat from core client for 30 sec - exiting
11:59:31 (11946): No heartbeat from core client for 30 sec - exiting
12:18:52 (12024): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
12:32:43 (12108): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:35:16 (12133): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:43:07 (12158): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:46:17 (12192): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:46:34 (12192): No heartbeat from core client for 30 sec - exiting
12:46:35 (12192): No heartbeat from core client for 30 sec - exiting
12:46:36 (12192): No heartbeat from core client for 30 sec - exiting
12:46:37 (12192): No heartbeat from core client for 30 sec - exiting
12:46:38 (12192): No heartbeat from core client for 30 sec - exiting
12:46:39 (12192): No heartbeat from core client for 30 sec - exiting
12:46:40 (12192): No heartbeat from core client for 30 sec - exiting
12:46:41 (12192): No heartbeat from core client for 30 sec - exiting
12:46:42 (12192): No heartbeat from core client for 30 sec - exiting
12:46:43 (12192): No heartbeat from core client for 30 sec - exiting
12:49:41 (12217): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:54:54 (12230): No heartbeat from core client for 30 sec - exiting
12:55:03 (12230): No heartbeat from core client for 30 sec - exiting
12:55:59 (12230): No heartbeat from core client for 30 sec - exiting
12:56:35 (12230): No heartbeat from core client for 30 sec - exiting
12:56:36 (12230): No heartbeat from core client for 30 sec - exiting
12:56:37 (12230): No heartbeat from core client for 30 sec - exiting
12:56:38 (12230): No heartbeat from core client for 30 sec - exiting
12:56:39 (12230): No heartbeat from core client for 30 sec - exiting
12:56:40 (12230): No heartbeat from core client for 30 sec - exiting
12:56:41 (12230): No heartbeat from core client for 30 sec - exiting
12:56:42 (12230): No heartbeat from core client for 30 sec - exiting
12:56:43 (12230): No heartbeat from core client for 30 sec - exiting
12:58:22 (12230): No heartbeat from core client for 30 sec - exiting
12:58:23 (12230): No heartbeat from core client for 30 sec - exiting
12:58:24 (12230): No heartbeat from core client for 30 sec - exiting
12:58:25 (12230): No heartbeat from core client for 30 sec - exiting
12:58:26 (12230): No heartbeat from core client for 30 sec - exiting
12:58:27 (12230): No heartbeat from core client for 30 sec - exiting
12:58:28 (12230): No heartbeat from core client for 30 sec - exiting
12:58:29 (12230): No heartbeat from core client for 30 sec - exiting
12:58:30 (12230): No heartbeat from core client for 30 sec - exiting
12:58:31 (12230): No heartbeat from core client for 30 sec - exiting
12:58:32 (12230): No heartbeat from core client for 30 sec - exiting
12:58:33 (12230): No heartbeat from core client for 30 sec - exiting
12:58:34 (12230): No heartbeat from core client for 30 sec - exiting
12:58:35 (12230): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:59:52 (12270): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:02:13 (12309): No heartbeat from core client for 30 sec - exiting
13:02:14 (12309): No heartbeat from core client for 30 sec - exiting
13:02:15 (12309): No heartbeat from core client for 30 sec - exiting
13:02:16 (12309): No heartbeat from core client for 30 sec - exiting
13:02:17 (12309): No heartbeat from core client for 30 sec - exiting
13:02:18 (12309): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
13:08:47 (12332): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:13:48 (12363): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:24:37 (12393): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
13:43:31 (12484): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:58:40 (12516): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:03:29 (12573): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:14:45 (12620): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:17:56 (12666): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:17:57 (12666): No heartbeat from core client for 30 sec - exiting
14:17:58 (12666): No heartbeat from core client for 30 sec - exiting
14:17:59 (12666): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (14 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf77bf400]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x806c0d5]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x806e5f2]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8072509]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8077f47]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x80781a3]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e1b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf749a963]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
10 Feb 2014 08:22:06 1290855 16204743 hadcm3n_o65w_1980_40_008388853_4 777,600 991,042 1.2745
09 Feb 2014 22:50:18 1290855 16204743 hadcm3n_o65w_1980_40_008388853_4 751,680 958,884 1.2757
09 Feb 2014 13:51:44 1290855 16204743 hadcm3n_o65w_1980_40_008388853_4 725,760 927,824 1.2784
09 Feb 2014 05:14:56 1290855 16204743 hadcm3n_o65w_1980_40_008388853_4 699,840 897,020 1.2818
08 Feb 2014 20:48:13 1290855 16204743 hadcm3n_o65w_1980_40_008388853_4 673,920 866,771 1.2862
02 Feb 2014 16:16:31 1290855 16204743 hadcm3n_o65w_1980_40_008388853_4 648,000 834,712 1.2881
02 Feb 2014 05:47:57 1290855 16204743 hadcm3n_o65w_1980_40_008388853_4 622,080 802,088 1.2894
01 Feb 2014 18:05:37 1290855 16204743 hadcm3n_o65w_1980_40_008388853_4 596,160 767,619 1.2876
31 Jan 2014 11:49:50 1290855 16204743 hadcm3n_o65w_1980_40_008388853_4 570,240 728,202 1.2770
28 Jan 2014 11:11:53 1290855 16204743 hadcm3n_o65w_1980_40_008388853_4 544,320 691,954 1.2712
27 Jan 2014 23:54:29 1290855 16204743 hadcm3n_o65w_1980_40_008388853_4 518,400 658,198 1.2697
27 Jan 2014 06:17:09 1290855 16204743 hadcm3n_o65w_1980_40_008388853_4 492,480 623,888 1.2668
26 Jan 2014 19:04:50 1290855 16204743 hadcm3n_o65w_1980_40_008388853_4 466,560 590,413 1.2655
26 Jan 2014 07:46:52 1290855 16204743 hadcm3n_o65w_1980_40_008388853_4 440,640 556,772 1.2636
25 Jan 2014 21:44:52 1290855 16204743 hadcm3n_o65w_1980_40_008388853_4 414,720 522,866 1.2608
25 Jan 2014 11:22:39 1290855 16204743 hadcm3n_o65w_1980_40_008388853_4 388,800 490,192 1.2608
25 Jan 2014 00:55:43 1290855 16204743 hadcm3n_o65w_1980_40_008388853_4 362,880 457,643 1.2611
24 Jan 2014 15:11:13 1290855 16204743 hadcm3n_o65w_1980_40_008388853_4 336,960 425,252 1.2620
24 Jan 2014 13:58:35 1290855 16204743 hadcm3n_o65w_1980_40_008388853_4 311,040 393,936 1.2665
24 Jan 2014 13:58:35 1290855 16204743 hadcm3n_o65w_1980_40_008388853_4 285,120 363,234 1.2740


©2024 climateprediction.net