climateprediction.net home page
Task 12920233

Task 12920233

Name hadcm3n_o0ss_1940_40_007264722_1
Workunit 7462962
Created 2 Jun 2011, 1:10:36 UTC
Sent 2 Jun 2011, 1:10:38 UTC
Report deadline 1 Sep 2011, 8:37:49 UTC
Received 24 Jun 2011, 22:32:33 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1094376
Run time
CPU time 15 days 18 hours 6 min 7 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.02 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.4.5</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 62 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Error: Input file: dataout/o0ssko.pjf0c10 is not a valid UM file.
Error converting file to netcdf: dataout/o0ssko.pjf0c10
Error: Input file: dataout/o0ssko.pif0c10 is not a valid UM file.
Error converting file to netcdf: dataout/o0ssko.pif0c10
Error: Input file: dataout/o0ssko.pff0c10 is not a valid UM file.
Error converting file to netcdf: dataout/o0ssko.pff0c10
Error: Input file: dataout/o0ssko.pcf0c10 is not a valid UM file.
Error converting file to netcdf: dataout/o0ssko.pcf0c10
Error: Input file: dataout/o0ssko.pbf0c10 is not a valid UM file.
Error converting file to netcdf: dataout/o0ssko.pbf0c10
Error: Input file: dataout/o0ssko.paf0c10 is not a valid UM file.
Error converting file to netcdf: dataout/o0ssko.paf0c10
Error: Input file: dataout/o0sska.phf0c10 is not a valid UM file.
Error converting file to netcdf: dataout/o0sska.phf0c10
Error: Input file: dataout/o0sska.pgf0c10 is not a valid UM file.
Error converting file to netcdf: dataout/o0sska.pgf0c10
Error: Input file: dataout/o0sska.pef0c10 is not a valid UM file.
Error converting file to netcdf: dataout/o0sska.pef0c10
Error: Input file: dataout/o0sska.pdf0c10 is not a valid UM file.
Error converting file to netcdf: dataout/o0sska.pdf0c10
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0982f850 ***
======= Backtrace: =========
/lib32/libc.so.6[0xf7561da1]
/lib32/libc.so.6[0xf75634d2]
/lib32/libc.so.6(cfree+0x6d)[0xf75665ad]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf7737a61]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf7737abd]
hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf750cb56]
hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:01 7209044                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 7209044                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
097da000-0983f000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f7079000-f74f4000 rw-s 00000000 08:01 7472791                            /var/lib/boinc-client/slots/0/136985
f74f4000-f74f6000 rw-p 00000000 00:00 0 
f74f6000-f7635000 r-xp 00000000 08:01 4456592                            /lib32/libc-2.10.1.so
f7635000-f7637000 r--p 0013e000 08:01 4456592                            /lib32/libc-2.10.1.so
f7637000-f7638000 rw-p 00140000 08:01 4456592                            /lib32/libc-2.10.1.so
f7638000-f763b000 rw-p 00000000 00:00 0 
f763b000-f7657000 r-xp 00000000 08:01 1154                               /usr/lib32/libgcc_s.so.1
f7657000-f7658000 r--p 0001b000 08:01 1154                               /usr/lib32/libgcc_s.so.1
f7658000-f7659000 rw-p 0001c000 08:01 1154                               /usr/lib32/libgcc_s.so.1
f7659000-f767d000 r-xp 00000000 08:01 4456596                            /lib32/libm-2.10.1.so
f767d000-f767e000 r--p 00023000 08:01 4456596                            /lib32/libm-2.10.1.so
f767e000-f767f000 rw-p 00024000 08:01 4456596                            /lib32/libm-2.10.1.so
f767f000-f7765000 r-xp 00000000 08:01 4031                               /usr/lib32/libstdc++.so.6.0.13
f7765000-f7769000 r--p 000e6000 08:01 4031                               /usr/lib32/libstdc++.so.6.0.13
f7769000-f776a000 rw-p 000ea000 08:01 4031                               /usr/lib32/libstdc++.so.6.0.13
f776a000-f7771000 rw-p 00000000 00:00 0 
f7771000-f7773000 r-xp 00000000 08:01 4456595                            /lib32/libdl-2.10.1.so
f7773000-f7774000 r--p 00001000 08:01 4456595                            /lib32/libdl-2.10.1.so
f7774000-f7775000 rw-p 00002000 08:01 4456595                            /lib32/libdl-2.10.1.so
f7775000-f7776000 rw-p 00000000 00:00 0 
f7776000-f778b000 r-xp 00000000 08:01 4456606                            /lib32/libpthread-2.10.1.so
f778b000-f778c000 r--p 00014000 08:01 4456606                            /lib32/libpthread-2.10.1.so
f778c000-f778d000 rw-p 00015000 08:01 4456606                            /lib32/libpthread-2.10.1.so
f778d000-f778f000 rw-p 00000000 00:00 0 
f77a2000-f77a3000 rw-p 00000000 00:00 0 
f77a3000-f77a4000 ---p 00000000 00:00 0 
f77a4000-f77a7000 rw-p 00000000 00:00 0 
f77a7000-f77a9000 rw-s 00000000 08:01 7472788                            /var/lib/boinc-client/slots/0/boinc_mmap_file
f77a9000-f77ab000 rw-p 00000000 00:00 0 
f77ab000-f77ac000 r-xp 00000000 00:00 0                                  [vdso]
f77ac000-f77c8000 r-xp 00000000 08:01 4456491                            /lib32/ld-2.10.1.so
f77c8000-f77c9000 r--p 0001b000 08:01 4456491                            /lib32/ld-2.10.1.so
f77c9000-f77ca000 rw-p 0001c000 08:01 4456491                            /lib32/ld-2.10.1.so
ffd2b000-ffd9a000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf77ab400]
[0xf77ab430]
/lib32/libc.so.6(gsignal+0x51)[0xf75207d1]
/lib32/libc.so.6(abort+0x182)[0xf7523c32]
/lib32/libc.so.6[0xf7557c95]
/lib32/libc.so.6[0xf7561da1]
/lib32/libc.so.6[0xf75634d2]
/lib32/libc.so.6(cfree+0x6d)[0xf75665ad]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf7737a61]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf7737abd]
hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf750cb56]
hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
24 Jun 2011 21:32:35 1094376 12920233 hadcm3n_o0ss_1940_40_007264722_1 518,400 1,361,161 2.6257
23 Jun 2011 18:56:42 1094376 12920233 hadcm3n_o0ss_1940_40_007264722_1 492,480 1,292,547 2.6246
22 Jun 2011 19:46:59 1094376 12920233 hadcm3n_o0ss_1940_40_007264722_1 466,560 1,224,110 2.6237
21 Jun 2011 18:49:32 1094376 12920233 hadcm3n_o0ss_1940_40_007264722_1 440,640 1,154,657 2.6204
20 Jun 2011 21:12:36 1094376 12920233 hadcm3n_o0ss_1940_40_007264722_1 414,720 1,085,579 2.6176
20 Jun 2011 01:32:41 1094376 12920233 hadcm3n_o0ss_1940_40_007264722_1 388,800 1,016,576 2.6147
19 Jun 2011 22:04:40 1094376 12920233 hadcm3n_o0ss_1940_40_007264722_1 362,880 947,496 2.6110
19 Jun 2011 22:02:34 1094376 12920233 hadcm3n_o0ss_1940_40_007264722_1 336,960 878,746 2.6079
17 Jun 2011 08:15:23 1094376 12920233 hadcm3n_o0ss_1940_40_007264722_1 311,040 809,094 2.6013
15 Jun 2011 20:40:31 1094376 12920233 hadcm3n_o0ss_1940_40_007264722_1 285,120 739,856 2.5949
14 Jun 2011 22:59:59 1094376 12920233 hadcm3n_o0ss_1940_40_007264722_1 259,200 670,939 2.5885
14 Jun 2011 02:49:42 1094376 12920233 hadcm3n_o0ss_1940_40_007264722_1 233,280 602,791 2.5840
13 Jun 2011 06:48:29 1094376 12920233 hadcm3n_o0ss_1940_40_007264722_1 207,360 533,265 2.5717
12 Jun 2011 11:34:15 1094376 12920233 hadcm3n_o0ss_1940_40_007264722_1 181,440 464,292 2.5589
11 Jun 2011 17:35:05 1094376 12920233 hadcm3n_o0ss_1940_40_007264722_1 155,520 397,491 2.5559
10 Jun 2011 20:12:47 1094376 12920233 hadcm3n_o0ss_1940_40_007264722_1 129,600 331,881 2.5608
09 Jun 2011 20:11:34 1094376 12920233 hadcm3n_o0ss_1940_40_007264722_1 103,680 266,765 2.5730
09 Jun 2011 01:22:16 1094376 12920233 hadcm3n_o0ss_1940_40_007264722_1 77,760 200,552 2.5791
08 Jun 2011 06:34:02 1094376 12920233 hadcm3n_o0ss_1940_40_007264722_1 51,840 134,298 2.5906
07 Jun 2011 11:11:05 1094376 12920233 hadcm3n_o0ss_1940_40_007264722_1 25,920 68,267 2.6338


©2024 cpdn.org