climateprediction.net home page
Task 15940632

Task 15940632

Name hadcm3n_3ftj_1980_40_008317909_4
Workunit 8469044
Created 26 Aug 2013, 8:10:27 UTC
Sent 26 Aug 2013, 8:10:37 UTC
Report deadline 25 Nov 2013, 15:37:48 UTC
Received 12 Nov 2013, 17:22:30 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 801038
Run time 24 days 10 hours 53 min 42 sec
CPU time 24 days 10 hours 53 min 42 sec
Validate state Invalid
Credit 7,776.00
Device peak FLOPS 1.44 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>5.10.30</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:03:01 (3732): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:03:02 (3732): No heartbeat from core client for 30 sec - exiting
19:01:59 (3712): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:20:10 (684): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:20:11 (684): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
10:45:29 (520): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:13:26 (3712): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:28:22 (3748): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:28:24 (3748): No heartbeat from core client for 30 sec - exiting
04:02:37 (2284): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:10:43 (3784): No heartbeat from core client for 30 sec - exiting
04:10:44 (3784): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:10:45 (3784): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
19:47:47 (3692): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:19:42 (2076): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:19:44 (2076): No heartbeat from core client for 30 sec - exiting
02:19:45 (2076): No heartbeat from core client for 30 sec - exiting
03:54:35 (2428): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:54:37 (2428): No heartbeat from core client for 30 sec - exiting
23:35:05 (2436): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:35:06 (2436): No heartbeat from core client for 30 sec - exiting
23:35:07 (2436): No heartbeat from core client for 30 sec - exiting
23:35:08 (2436): No heartbeat from core client for 30 sec - exiting
23:35:10 (2436): No heartbeat from core client for 30 sec - exiting
23:35:11 (2436): No heartbeat from core client for 30 sec - exiting
23:41:53 (3272): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:41:55 (3272): No heartbeat from core client for 30 sec - exiting
23:41:56 (3272): No heartbeat from core client for 30 sec - exiting
01:09:54 (2748): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:09:55 (2748): No heartbeat from core client for 30 sec - exiting
07:15:08 (3896): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:15:10 (3896): No heartbeat from core client for 30 sec - exiting
07:15:11 (3896): No heartbeat from core client for 30 sec - exiting
16:25:18 (3548): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:25:20 (3548): No heartbeat from core client for 30 sec - exiting
16:25:21 (3548): No heartbeat from core client for 30 sec - exiting
16:25:22 (3548): No heartbeat from core client for 30 sec - exiting
16:25:23 (3548): No heartbeat from core client for 30 sec - exiting
18:53:17 (3068): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:06:24 (1948): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:06:25 (1948): No heartbeat from core client for 30 sec - exiting
02:06:26 (1948): No heartbeat from core client for 30 sec - exiting
02:28:51 (2648): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:28:52 (2648): No heartbeat from core client for 30 sec - exiting
09:06:32 (1932): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:06:34 (1932): No heartbeat from core client for 30 sec - exiting
09:06:35 (1932): No heartbeat from core client for 30 sec - exiting
15:34:02 (2428): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:34:04 (2428): No heartbeat from core client for 30 sec - exiting
15:34:05 (2428): No heartbeat from core client for 30 sec - exiting
19:16:17 (2708): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:16:18 (2708): No heartbeat from core client for 30 sec - exiting
19:16:19 (2708): No heartbeat from core client for 30 sec - exiting
01:17:05 (1124): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:17:06 (1124): No heartbeat from core client for 30 sec - exiting
01:17:07 (1124): No heartbeat from core client for 30 sec - exiting
01:17:08 (1124): No heartbeat from core client for 30 sec - exiting
01:17:09 (1124): No heartbeat from core client for 30 sec - exiting
02:07:02 (1332): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:07:04 (1332): No heartbeat from core client for 30 sec - exiting
05:50:46 (880): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:50:47 (880): No heartbeat from core client for 30 sec - exiting
05:50:48 (880): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:24:30 (2388): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:24:31 (2388): No heartbeat from core client for 30 sec - exiting
02:24:32 (2388): No heartbeat from core client for 30 sec - exiting
02:55:33 (3608): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:55:34 (3608): No heartbeat from core client for 30 sec - exiting
02:55:35 (3608): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
11:14:05 (2912): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:55:39 (1944): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:55:40 (1944): No heartbeat from core client for 30 sec - exiting
13:55:41 (1944): No heartbeat from core client for 30 sec - exiting
01:15:52 (1780): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:15:53 (1780): No heartbeat from core client for 30 sec - exiting
03:38:03 (2764): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:38:05 (2764): No heartbeat from core client for 30 sec - exiting
03:38:06 (2764): No heartbeat from core client for 30 sec - exiting
03:38:07 (2764): No heartbeat from core client for 30 sec - exiting
03:49:06 (3676): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:49:08 (3676): No heartbeat from core client for 30 sec - exiting
15:49:53 (2784): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:49:55 (2784): No heartbeat from core client for 30 sec - exiting
15:49:56 (2784): No heartbeat from core client for 30 sec - exiting
15:49:57 (2784): No heartbeat from core client for 30 sec - exiting
15:49:58 (2784): No heartbeat from core client for 30 sec - exiting
23:50:40 (2296): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
01:13:09 (2564): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:13:10 (2564): No heartbeat from core client for 30 sec - exiting
20:51:35 (840): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:51:37 (840): No heartbeat from core client for 30 sec - exiting
20:51:38 (840): No heartbeat from core client for 30 sec - exiting
20:51:39 (840): No heartbeat from core client for 30 sec - exiting
20:51:40 (840): No heartbeat from core client for 30 sec - exiting
20:58:54 (908): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:58:56 (908): No heartbeat from core client for 30 sec - exiting
21:05:28 (544): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:05:30 (544): No heartbeat from core client for 30 sec - exiting
03:06:17 (2788): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:06:18 (2788): No heartbeat from core client for 30 sec - exiting
04:39:36 (2752): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:39:37 (2752): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
20:35:48 (1872): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:35:49 (1872): No heartbeat from core client for 30 sec - exiting
20:35:50 (1872): No heartbeat from core client for 30 sec - exiting
20:35:51 (1872): No heartbeat from core client for 30 sec - exiting
04:09:06 (2432): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:09:07 (2432): No heartbeat from core client for 30 sec - exiting
04:09:08 (2432): No heartbeat from core client for 30 sec - exiting
04:09:10 (2432): No heartbeat from core client for 30 sec - exiting
04:09:11 (2432): No heartbeat from core client for 30 sec - exiting
16:57:58 (2448): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:57:59 (2448): No heartbeat from core client for 30 sec - exiting
17:05:16 (868): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:05:18 (868): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
14:36:16 (2336): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:36:17 (2336): No heartbeat from core client for 30 sec - exiting
23:50:36 (3692): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:50:37 (3692): No heartbeat from core client for 30 sec - exiting
23:50:38 (3692): No heartbeat from core client for 30 sec - exiting
23:50:40 (3692): No heartbeat from core client for 30 sec - exiting
23:50:41 (3692): No heartbeat from core client for 30 sec - exiting
01:04:16 (2132): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:04:18 (2132): No heartbeat from core client for 30 sec - exiting
01:04:19 (2132): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
10:40:51 (360): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:06:42 (236): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:06:43 (236): No heartbeat from core client for 30 sec - exiting
01:06:44 (236): No heartbeat from core client for 30 sec - exiting
03:46:02 (1400): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:24:17 (2296): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:24:19 (2296): No heartbeat from core client for 30 sec - exiting
09:24:20 (2296): No heartbeat from core client for 30 sec - exiting
09:24:21 (2296): No heartbeat from core client for 30 sec - exiting
09:24:22 (2296): No heartbeat from core client for 30 sec - exiting
18:18:57 (2784): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:18:59 (2784): No heartbeat from core client for 30 sec - exiting
21:38:47 (1688): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:38:49 (1688): No heartbeat from core client for 30 sec - exiting
06:33:52 (2796): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:33:54 (2796): No heartbeat from core client for 30 sec - exiting
06:33:55 (2796): No heartbeat from core client for 30 sec - exiting
20:57:45 (3248): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:57:47 (3248): No heartbeat from core client for 30 sec - exiting
14:10:45 (3584): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:10:47 (3584): No heartbeat from core client for 30 sec - exiting
14:10:48 (3584): No heartbeat from core client for 30 sec - exiting
14:10:49 (3584): No heartbeat from core client for 30 sec - exiting
14:10:50 (3584): No heartbeat from core client for 30 sec - exiting
03:38:04 (896): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:38:05 (896): No heartbeat from core client for 30 sec - exiting
04:51:46 (888): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:51:47 (888): No heartbeat from core client for 30 sec - exiting
06:31:54 (2980): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:31:56 (2980): No heartbeat from core client for 30 sec - exiting
08:28:20 (3740): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:28:22 (3740): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
17:48:55 (2676): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:48:57 (2676): No heartbeat from core client for 30 sec - exiting
17:48:58 (2676): No heartbeat from core client for 30 sec - exiting
17:48:59 (2676): No heartbeat from core client for 30 sec - exiting
17:49:00 (2676): No heartbeat from core client for 30 sec - exiting
01:15:03 (3884): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:15:05 (3884): No heartbeat from core client for 30 sec - exiting
10:23:30 (2880): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:23:32 (2880): No heartbeat from core client for 30 sec - exiting
17:43:51 (192): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:43:53 (192): No heartbeat from core client for 30 sec - exiting
21:52:19 (2248): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:24:25 (3964): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:24:27 (3964): No heartbeat from core client for 30 sec - exiting
13:54:11 (2104): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:54:13 (2104): No heartbeat from core client for 30 sec - exiting
13:54:14 (2104): No heartbeat from core client for 30 sec - exiting
14:33:30 (2096): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:33:32 (2096): No heartbeat from core client for 30 sec - exiting
22:39:22 (3640): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:39:23 (3640): No heartbeat from core client for 30 sec - exiting
22:39:24 (3640): No heartbeat from core client for 30 sec - exiting
01:32:59 (3616): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:33:00 (3616): No heartbeat from core client for 30 sec - exiting
01:33:02 (3616): No heartbeat from core client for 30 sec - exiting
01:33:03 (3616): No heartbeat from core client for 30 sec - exiting
01:33:04 (3616): No heartbeat from core client for 30 sec - exiting
01:33:05 (3616): No heartbeat from core client for 30 sec - exiting
01:41:08 (2324): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:01:12 (2592): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:01:13 (2592): No heartbeat from core client for 30 sec - exiting
02:09:17 (2492): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:09:18 (2492): No heartbeat from core client for 30 sec - exiting
02:09:19 (2492): No heartbeat from core client for 30 sec - exiting
02:26:59 (1348): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:27:00 (1348): No heartbeat from core client for 30 sec - exiting
03:10:25 (2200): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:10:30 (2200): No heartbeat from core client for 30 sec - exiting
08:06:03 (3472): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:06:04 (3472): No heartbeat from core client for 30 sec - exiting
08:06:05 (3472): No heartbeat from core client for 30 sec - exiting
12:01:34 (3908): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:01:36 (3908): No heartbeat from core client for 30 sec - exiting
14:08:57 (508): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:08:58 (508): No heartbeat from core client for 30 sec - exiting
14:08:59 (508): No heartbeat from core client for 30 sec - exiting
01:06:17 (2076): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:06:19 (2076): No heartbeat from core client for 30 sec - exiting
01:52:30 (1892): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
12 Nov 2013 09:06:57 801038 15940632 hadcm3n_3ftj_1980_40_008317909_4 648,000 2,115,313 3.2644
11 Nov 2013 04:55:50 801038 15940632 hadcm3n_3ftj_1980_40_008317909_4 622,080 2,030,638 3.2643
10 Nov 2013 01:21:05 801038 15940632 hadcm3n_3ftj_1980_40_008317909_4 596,160 1,946,686 3.2654
08 Nov 2013 22:23:48 801038 15940632 hadcm3n_3ftj_1980_40_008317909_4 570,240 1,862,350 3.2659
07 Nov 2013 18:43:06 801038 15940632 hadcm3n_3ftj_1980_40_008317909_4 544,320 1,777,514 3.2656
19 Sep 2013 16:21:37 801038 15940632 hadcm3n_3ftj_1980_40_008317909_4 518,400 1,692,243 3.2644
18 Sep 2013 13:47:29 801038 15940632 hadcm3n_3ftj_1980_40_008317909_4 492,480 1,607,412 3.2639
17 Sep 2013 11:02:41 801038 15940632 hadcm3n_3ftj_1980_40_008317909_4 466,560 1,522,144 3.2625
16 Sep 2013 07:56:33 801038 15940632 hadcm3n_3ftj_1980_40_008317909_4 440,640 1,437,179 3.2616
15 Sep 2013 04:57:50 801038 15940632 hadcm3n_3ftj_1980_40_008317909_4 414,720 1,352,466 3.2612
14 Sep 2013 02:25:30 801038 15940632 hadcm3n_3ftj_1980_40_008317909_4 388,800 1,267,244 3.2594
12 Sep 2013 22:28:39 801038 15940632 hadcm3n_3ftj_1980_40_008317909_4 362,880 1,182,758 3.2594
11 Sep 2013 19:34:15 801038 15940632 hadcm3n_3ftj_1980_40_008317909_4 336,960 1,097,039 3.2557
10 Sep 2013 16:11:31 801038 15940632 hadcm3n_3ftj_1980_40_008317909_4 311,040 1,012,757 3.2560
09 Sep 2013 13:10:49 801038 15940632 hadcm3n_3ftj_1980_40_008317909_4 285,120 928,007 3.2548
08 Sep 2013 10:17:38 801038 15940632 hadcm3n_3ftj_1980_40_008317909_4 259,200 843,609 3.2547
07 Sep 2013 07:08:34 801038 15940632 hadcm3n_3ftj_1980_40_008317909_4 233,280 758,427 3.2511
06 Sep 2013 04:00:20 801038 15940632 hadcm3n_3ftj_1980_40_008317909_4 207,360 674,436 3.2525
05 Sep 2013 00:31:11 801038 15940632 hadcm3n_3ftj_1980_40_008317909_4 181,440 590,581 3.2550
03 Sep 2013 21:21:23 801038 15940632 hadcm3n_3ftj_1980_40_008317909_4 155,520 506,423 3.2563


©2024 climateprediction.net