climateprediction.net home page
Task 17351966

Task 17351966

Name hadcm3n_x0et_1940_40_009147800_0
Workunit 9278136
Created 6 Nov 2014, 12:23:23 UTC
Sent 6 Nov 2014, 12:27:17 UTC
Report deadline 5 Feb 2015, 19:54:28 UTC
Received 8 Dec 2014, 11:04:01 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1338595
Run time 5 days 16 hours 43 min 29 sec
CPU time 5 days 14 hours 52 min 22 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 2.47 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
09:03:18 (3406): No heartbeat from core client for 30 sec - exiting
09:03:30 (3406): No heartbeat from core client for 30 sec - exiting
09:03:31 (3406): No heartbeat from core client for 30 sec - exiting
09:03:32 (3406): No heartbeat from core client for 30 sec - exiting
09:03:33 (3406): No heartbeat from core client for 30 sec - exiting
09:03:34 (3406): No heartbeat from core client for 30 sec - exiting
09:03:35 (3406): No heartbeat from core client for 30 sec - exiting
09:03:36 (3406): No heartbeat from core client for 30 sec - exiting
09:03:37 (3406): No heartbeat from core client for 30 sec - exiting
09:03:38 (3406): No heartbeat from core client for 30 sec - exiting
09:03:39 (3406): No heartbeat from core client for 30 sec - exiting
09:03:40 (3406): No heartbeat from core client for 30 sec - exiting
09:03:41 (3406): No heartbeat from core client for 30 sec - exiting
09:03:42 (3406): No heartbeat from core client for 30 sec - exiting
09:03:43 (3406): No heartbeat from core client for 30 sec - exiting
09:03:44 (3406): No heartbeat from core client for 30 sec - exiting
09:03:45 (3406): No heartbeat from core client for 30 sec - exiting
09:03:46 (3406): No heartbeat from core client for 30 sec - exiting
09:03:47 (3406): No heartbeat from core client for 30 sec - exiting
09:03:48 (3406): No heartbeat from core client for 30 sec - exiting
09:03:49 (3406): No heartbeat from core client for 30 sec - exiting
09:03:50 (3406): No heartbeat from core client for 30 sec - exiting
09:03:51 (3406): No heartbeat from core client for 30 sec - exiting
09:03:52 (3406): No heartbeat from core client for 30 sec - exiting
09:03:53 (3406): No heartbeat from core client for 30 sec - exiting
09:03:54 (3406): No heartbeat from core client for 30 sec - exiting
09:03:55 (3406): No heartbeat from core client for 30 sec - exiting
09:03:56 (3406): No heartbeat from core client for 30 sec - exiting
09:03:57 (3406): No heartbeat from core client for 30 sec - exiting
09:03:58 (3406): No heartbeat from core client for 30 sec - exiting
09:03:59 (3406): No heartbeat from core client for 30 sec - exiting
09:04:00 (3406): No heartbeat from core client for 30 sec - exiting
09:04:01 (3406): No heartbeat from core client for 30 sec - exiting
09:04:02 (3406): No heartbeat from core client for 30 sec - exiting
09:04:03 (3406): No heartbeat from core client for 30 sec - exiting
09:04:04 (3406): No heartbeat from core client for 30 sec - exiting
09:04:05 (3406): No heartbeat from core client for 30 sec - exiting
09:04:06 (3406): No heartbeat from core client for 30 sec - exiting
09:04:07 (3406): No heartbeat from core client for 30 sec - exiting
09:04:08 (3406): No heartbeat from core client for 30 sec - exiting
09:04:09 (3406): No heartbeat from core client for 30 sec - exiting
09:04:10 (3406): No heartbeat from core client for 30 sec - exiting
09:04:11 (3406): No heartbeat from core client for 30 sec - exiting
09:04:12 (3406): No heartbeat from core client for 30 sec - exiting
09:04:13 (3406): No heartbeat from core client for 30 sec - exiting
09:04:14 (3406): No heartbeat from core client for 30 sec - exiting
09:04:15 (3406): No heartbeat from core client for 30 sec - exiting
09:04:16 (3406): No heartbeat from core client for 30 sec - exiting
09:04:17 (3406): No heartbeat from core client for 30 sec - exiting
09:04:18 (3406): No heartbeat from core client for 30 sec - exiting
09:04:19 (3406): No heartbeat from core client for 30 sec - exiting
09:04:20 (3406): No heartbeat from core client for 30 sec - exiting
09:04:21 (3406): No heartbeat from core client for 30 sec - exiting
09:04:22 (3406): No heartbeat from core client for 30 sec - exiting
09:04:23 (3406): No heartbeat from core client for 30 sec - exiting
09:04:24 (3406): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
15:58:55 (3415): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:17:28 (3698): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
11:38:36 (3380): No heartbeat from core client for 30 sec - exiting
11:38:37 (3380): No heartbeat from core client for 30 sec - exiting
11:38:38 (3380): No heartbeat from core client for 30 sec - exiting
11:38:39 (3380): No heartbeat from core client for 30 sec - exiting
11:38:40 (3380): No heartbeat from core client for 30 sec - exiting
11:38:41 (3380): No heartbeat from core client for 30 sec - exiting
11:38:42 (3380): No heartbeat from core client for 30 sec - exiting
11:38:43 (3380): No heartbeat from core client for 30 sec - exiting
11:38:44 (3380): No heartbeat from core client for 30 sec - exiting
11:38:45 (3380): No heartbeat from core client for 30 sec - exiting
11:38:46 (3380): No heartbeat from core client for 30 sec - exiting
11:38:47 (3380): No heartbeat from core client for 30 sec - exiting
11:38:48 (3380): No heartbeat from core client for 30 sec - exiting
11:38:49 (3380): No heartbeat from core client for 30 sec - exiting
11:38:50 (3380): No heartbeat from core client for 30 sec - exiting
11:38:51 (3380): No heartbeat from core client for 30 sec - exiting
11:38:52 (3380): No heartbeat from core client for 30 sec - exiting
11:38:53 (3380): No heartbeat from core client for 30 sec - exiting
11:38:54 (3380): No heartbeat from core client for 30 sec - exiting
11:38:55 (3380): No heartbeat from core client for 30 sec - exiting
11:38:56 (3380): No heartbeat from core client for 30 sec - exiting
11:38:57 (3380): No heartbeat from core client for 30 sec - exiting
11:38:58 (3380): No heartbeat from core client for 30 sec - exiting
11:38:59 (3380): No heartbeat from core client for 30 sec - exiting
11:39:00 (3380): No heartbeat from core client for 30 sec - exiting
11:39:01 (3380): No heartbeat from core client for 30 sec - exiting
11:39:02 (3380): No heartbeat from core client for 30 sec - exiting
11:39:03 (3380): No heartbeat from core client for 30 sec - exiting
11:39:04 (3380): No heartbeat from core client for 30 sec - exiting
11:39:05 (3380): No heartbeat from core client for 30 sec - exiting
11:39:06 (3380): No heartbeat from core client for 30 sec - exiting
11:39:07 (3380): No heartbeat from core client for 30 sec - exiting
11:39:08 (3380): No heartbeat from core client for 30 sec - exiting
11:39:11 (3380): No heartbeat from core client for 30 sec - exiting
11:39:12 (3380): No heartbeat from core client for 30 sec - exiting
11:39:13 (3380): No heartbeat from core client for 30 sec - exiting
11:39:14 (3380): No heartbeat from core client for 30 sec - exiting
11:39:15 (3380): No heartbeat from core client for 30 sec - exiting
11:39:16 (3380): No heartbeat from core client for 30 sec - exiting
11:39:17 (3380): No heartbeat from core client for 30 sec - exiting
11:39:18 (3380): No heartbeat from core client for 30 sec - exiting
11:39:19 (3380): No heartbeat from core client for 30 sec - exiting
11:39:20 (3380): No heartbeat from core client for 30 sec - exiting
11:39:21 (3380): No heartbeat from core client for 30 sec - exiting
11:39:22 (3380): No heartbeat from core client for 30 sec - exiting
11:39:23 (3380): No heartbeat from core client for 30 sec - exiting
11:39:24 (3380): No heartbeat from core client for 30 sec - exiting
11:39:25 (3380): No heartbeat from core client for 30 sec - exiting
11:39:26 (3380): No heartbeat from core client for 30 sec - exiting
11:39:27 (3380): No heartbeat from core client for 30 sec - exiting
11:39:28 (3380): No heartbeat from core client for 30 sec - exiting
11:39:29 (3380): No heartbeat from core client for 30 sec - exiting
11:39:30 (3380): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
09:07:11 (3398): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
15:54:53 (3390): No heartbeat from core client for 30 sec - exiting
15:54:56 (3390): No heartbeat from core client for 30 sec - exiting
15:54:57 (3390): No heartbeat from core client for 30 sec - exiting
15:54:58 (3390): No heartbeat from core client for 30 sec - exiting
15:54:59 (3390): No heartbeat from core client for 30 sec - exiting
15:55:00 (3390): No heartbeat from core client for 30 sec - exiting
15:55:01 (3390): No heartbeat from core client for 30 sec - exiting
15:55:02 (3390): No heartbeat from core client for 30 sec - exiting
15:55:03 (3390): No heartbeat from core client for 30 sec - exiting
15:55:04 (3390): No heartbeat from core client for 30 sec - exiting
15:55:05 (3390): No heartbeat from core client for 30 sec - exiting
15:55:06 (3390): No heartbeat from core client for 30 sec - exiting
15:55:07 (3390): No heartbeat from core client for 30 sec - exiting
15:55:08 (3390): No heartbeat from core client for 30 sec - exiting
15:55:09 (3390): No heartbeat from core client for 30 sec - exiting
15:55:10 (3390): No heartbeat from core client for 30 sec - exiting
15:55:11 (3390): No heartbeat from core client for 30 sec - exiting
15:55:12 (3390): No heartbeat from core client for 30 sec - exiting
15:55:13 (3390): No heartbeat from core client for 30 sec - exiting
15:55:14 (3390): No heartbeat from core client for 30 sec - exiting
15:55:15 (3390): No heartbeat from core client for 30 sec - exiting
15:55:16 (3390): No heartbeat from core client for 30 sec - exiting
15:55:17 (3390): No heartbeat from core client for 30 sec - exiting
15:55:18 (3390): No heartbeat from core client for 30 sec - exiting
15:55:19 (3390): No heartbeat from core client for 30 sec - exiting
15:55:20 (3390): No heartbeat from core client for 30 sec - exiting
15:55:21 (3390): No heartbeat from core client for 30 sec - exiting
15:55:22 (3390): No heartbeat from core client for 30 sec - exiting
15:55:23 (3390): No heartbeat from core client for 30 sec - exiting
15:55:24 (3390): No heartbeat from core client for 30 sec - exiting
15:55:25 (3390): No heartbeat from core client for 30 sec - exiting
15:55:26 (3390): No heartbeat from core client for 30 sec - exiting
15:55:27 (3390): No heartbeat from core client for 30 sec - exiting
15:55:28 (3390): No heartbeat from core client for 30 sec - exiting
15:55:29 (3390): No heartbeat from core client for 30 sec - exiting
15:55:30 (3390): No heartbeat from core client for 30 sec - exiting
15:55:32 (3390): No heartbeat from core client for 30 sec - exiting
15:55:33 (3390): No heartbeat from core client for 30 sec - exiting
15:55:34 (3390): No heartbeat from core client for 30 sec - exiting
15:55:35 (3390): No heartbeat from core client for 30 sec - exiting
15:55:36 (3390): No heartbeat from core client for 30 sec - exiting
15:55:37 (3390): No heartbeat from core client for 30 sec - exiting
15:55:38 (3390): No heartbeat from core client for 30 sec - exiting
15:55:39 (3390): No heartbeat from core client for 30 sec - exiting
15:55:40 (3390): No heartbeat from core client for 30 sec - exiting
15:55:41 (3390): No heartbeat from core client for 30 sec - exiting
15:55:42 (3390): No heartbeat from core client for 30 sec - exiting
15:55:43 (3390): No heartbeat from core client for 30 sec - exiting
15:55:44 (3390): No heartbeat from core client for 30 sec - exiting
15:55:45 (3390): No heartbeat from core client for 30 sec - exiting
15:55:46 (3390): No heartbeat from core client for 30 sec - exiting
15:55:47 (3390): No heartbeat from core client for 30 sec - exiting
15:55:48 (3390): No heartbeat from core client for 30 sec - exiting
15:55:49 (3390): No heartbeat from core client for 30 sec - exiting
15:55:50 (3390): No heartbeat from core client for 30 sec - exiting
15:55:51 (3390): No heartbeat from core client for 30 sec - exiting
15:55:52 (3390): No heartbeat from core client for 30 sec - exiting
15:55:53 (3390): No heartbeat from core client for 30 sec - exiting
15:55:54 (3390): No heartbeat from core client for 30 sec - exiting
15:55:55 (3390): No heartbeat from core client for 30 sec - exiting
15:55:56 (3390): No heartbeat from core client for 30 sec - exiting
15:55:57 (3390): No heartbeat from core client for 30 sec - exiting
15:55:58 (3390): No heartbeat from core client for 30 sec - exiting
15:55:59 (3390): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (!prev): 0x084096e0 ***
======= Backtrace: =========
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x70c91)[0xf74d0c91]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x724f8)[0xf74d24f8]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(cfree+0x6d)[0xf74d563d]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x1f)[0xf76554bf]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xf7476e46]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:01 23331484                           /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 23331484                           /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
08345000-08445000 rw-p 00000000 00:00 0                                  [heap]
f6e00000-f6e21000 rw-p 00000000 00:00 0 
f6e21000-f6f00000 ---p 00000000 00:00 0 
f6fe2000-f745d000 rw-s 00000000 08:01 23341101                           /var/lib/boinc-client/slots/4/136515
f745d000-f7460000 rw-p 00000000 00:00 0 
f7460000-f75bf000 r-xp 00000000 08:01 12321589                           /lib/i386-linux-gnu/i686/cmov/libc-2.13.so
f75bf000-f75c1000 r--p 0015f000 08:01 12321589                           /lib/i386-linux-gnu/i686/cmov/libc-2.13.so
f75c1000-f75c2000 rw-p 00161000 08:01 12321589                           /lib/i386-linux-gnu/i686/cmov/libc-2.13.so
f75c2000-f75c5000 rw-p 00000000 00:00 0 
f75c5000-f75e1000 r-xp 00000000 08:01 12321560                           /lib/i386-linux-gnu/libgcc_s.so.1
f75e1000-f75e2000 rw-p 0001b000 08:01 12321560                           /lib/i386-linux-gnu/libgcc_s.so.1
f75e2000-f7606000 r-xp 00000000 08:01 12321593                           /lib/i386-linux-gnu/i686/cmov/libm-2.13.so
f7606000-f7607000 r--p 00023000 08:01 12321593                           /lib/i386-linux-gnu/i686/cmov/libm-2.13.so
f7607000-f7608000 rw-p 00024000 08:01 12321593                           /lib/i386-linux-gnu/i686/cmov/libm-2.13.so
f7608000-f76e8000 r-xp 00000000 08:01 13904349                           /usr/lib/i386-linux-gnu/libstdc++.so.6.0.17
f76e8000-f76ec000 r--p 000e0000 08:01 13904349                           /usr/lib/i386-linux-gnu/libstdc++.so.6.0.17
f76ec000-f76ed000 rw-p 000e4000 08:01 13904349                           /usr/lib/i386-linux-gnu/libstdc++.so.6.0.17
f76ed000-f76f5000 rw-p 00000000 00:00 0 
f76f5000-f76f7000 r-xp 00000000 08:01 12321592                           /lib/i386-linux-gnu/i686/cmov/libdl-2.13.so
f76f7000-f76f8000 r--p 00001000 08:01 12321592                           /lib/i386-linux-gnu/i686/cmov/libdl-2.13.so
f76f8000-f76f9000 rw-p 00002000 08:01 12321592                           /lib/i386-linux-gnu/i686/cmov/libdl-2.13.so
f76f9000-f770e000 r-xp 00000000 08:01 12321584                           /lib/i386-linux-gnu/i686/cmov/libpthread-2.13.so
f770e000-f770f000 r--p 00014000 08:01 12321584                           /lib/i386-linux-gnu/i686/cmov/libpthread-2.13.so
f770f000-f7710000 rw-p 00015000 08:01 12321584                           /lib/i386-linux-gnu/i686/cmov/libpthread-2.13.so
f7710000-f7712000 rw-p 00000000 00:00 0 
f7724000-f7725000 rw-p 00000000 00:00 0 
f7725000-f7726000 ---p 00000000 00:00 0 
f7726000-f7729000 rw-p 00000000 00:00 0 
f7729000-f772b000 rw-s 00000000 08:01 23341130                           /var/lib/boinc-client/slots/4/boinc_mmap_file
f772b000-f772d000 rw-p 00000000 00:00 0 
f772d000-f772e000 r-xp 00000000 00:00 0                                  [vdso]
f772e000-f774a000 r-xp 00000000 08:01 12321496                           /lib/i386-linux-gnu/ld-2.13.so
f774a000-f774b000 r--p 0001b000 08:01 12321496                           /lib/i386-linux-gnu/ld-2.13.so
f774b000-f774c000 rw-p 0001c000 08:01 12321496                           /lib/i386-linux-gnu/ld-2.13.so
ffa2c000-ffa9b000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (17 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf772d400]
[0xf772d425]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(gsignal+0x51)[0xf748a661]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(abort+0x182)[0xf748da92]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x66ba5)[0xf74c6ba5]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x70c91)[0xf74d0c91]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x724f8)[0xf74d24f8]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(cfree+0x6d)[0xf74d563d]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x1f)[0xf76554bf]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xf7476e46]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Dec 2014 11:05:40 1338595 17351966 hadcm3n_x0et_1940_40_009147800_0 259,200 485,540 1.8732
04 Dec 2014 13:49:13 1338595 17351966 hadcm3n_x0et_1940_40_009147800_0 233,280 437,408 1.8750
02 Dec 2014 09:42:43 1338595 17351966 hadcm3n_x0et_1940_40_009147800_0 207,360 389,195 1.8769
28 Nov 2014 10:43:45 1338595 17351966 hadcm3n_x0et_1940_40_009147800_0 181,440 340,466 1.8765
25 Nov 2014 10:36:44 1338595 17351966 hadcm3n_x0et_1940_40_009147800_0 155,520 292,835 1.8829
20 Nov 2014 11:31:06 1338595 17351966 hadcm3n_x0et_1940_40_009147800_0 129,600 244,781 1.8887
17 Nov 2014 14:22:30 1338595 17351966 hadcm3n_x0et_1940_40_009147800_0 103,680 196,913 1.8992
14 Nov 2014 09:48:36 1338595 17351966 hadcm3n_x0et_1940_40_009147800_0 77,760 149,047 1.9168
12 Nov 2014 09:08:10 1338595 17351966 hadcm3n_x0et_1940_40_009147800_0 51,840 99,666 1.9226
10 Nov 2014 11:06:14 1338595 17351966 hadcm3n_x0et_1940_40_009147800_0 25,920 49,825 1.9223


©2024 climateprediction.net