climateprediction.net (CPDN) home page
Task 16031043

Task 16031043

Name hadcm3n_4eps_2020_40_008393208_1
Workunit 8544067
Created 23 Sep 2013, 9:20:51 UTC
Sent 23 Sep 2013, 9:44:46 UTC
Report deadline 23 Dec 2013, 17:11:57 UTC
Received 4 Dec 2013, 5:53:32 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1029390
Run time 20 days 23 hours 23 min 56 sec
CPU time 20 days 17 hours 12 min 38 sec
Validate state Invalid
Credit 12,130.56
Device peak FLOPS 0.83 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.12.22</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Error: Input file: dataout/4epsko.pjn7c10 is not a valid UM file.
Error converting file to netcdf: dataout/4epsko.pjn7c10
Error: Input file: dataout/4epsko.pin7c10 is not a valid UM file.
Error converting file to netcdf: dataout/4epsko.pin7c10
Error: Input file: dataout/4epsko.pfn7c10 is not a valid UM file.
Error converting file to netcdf: dataout/4epsko.pfn7c10
Error: Input file: dataout/4epska.phn7c10 is not a valid UM file.
Error converting file to netcdf: dataout/4epska.phn7c10
Error: Input file: dataout/4epska.pgn7c10 is not a valid UM file.
Error converting file to netcdf: dataout/4epska.pgn7c10
Error: Input file: dataout/4epska.pen7c10 is not a valid UM file.
Error converting file to netcdf: dataout/4epska.pen7c10
Error: Input file: dataout/4epska.pdn7c10 is not a valid UM file.
Error converting file to netcdf: dataout/4epska.pdn7c10
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Error: Input file: dataout/4epsko.pjp6c10 is not a valid UM file.
Error converting file to netcdf: dataout/4epsko.pjp6c10
Error: Input file: dataout/4epsko.pip6c10 is not a valid UM file.
Error converting file to netcdf: dataout/4epsko.pip6c10
Error: Input file: dataout/4epsko.pfp6c10 is not a valid UM file.
Error converting file to netcdf: dataout/4epsko.pfp6c10
Error: Input file: dataout/4epska.php6c10 is not a valid UM file.
Error converting file to netcdf: dataout/4epska.php6c10
Error: Input file: dataout/4epska.pgp6c10 is not a valid UM file.
Error converting file to netcdf: dataout/4epska.pgp6c10
Error: Input file: dataout/4epska.pep6c10 is not a valid UM file.
Error converting file to netcdf: dataout/4epska.pep6c10
Error: Input file: dataout/4epska.pdp6c10 is not a valid UM file.
Error converting file to netcdf: dataout/4epska.pdp6c10
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 2 received, exiting...
Called boinc_finish
Signal 2 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation
Stack trace (14 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xffffe400]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x806c0d5]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x806e5f2]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8072509]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8077f47]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x80781a3]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e1b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf74287a3]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
01 Dec 2013 11:23:48 1029390 16031043 hadcm3n_4eps_2020_40_008393208_1 1,010,880 1,744,828 1.7260
29 Nov 2013 02:02:51 1029390 16031043 hadcm3n_4eps_2020_40_008393208_1 984,960 1,699,317 1.7253
26 Nov 2013 19:52:19 1029390 16031043 hadcm3n_4eps_2020_40_008393208_1 959,040 1,654,737 1.7254
25 Nov 2013 02:39:38 1029390 16031043 hadcm3n_4eps_2020_40_008393208_1 933,120 1,610,358 1.7258
23 Nov 2013 11:42:47 1029390 16031043 hadcm3n_4eps_2020_40_008393208_1 907,200 1,565,484 1.7256
21 Nov 2013 05:47:20 1029390 16031043 hadcm3n_4eps_2020_40_008393208_1 881,280 1,518,826 1.7234
19 Nov 2013 04:38:07 1029390 16031043 hadcm3n_4eps_2020_40_008393208_1 855,360 1,473,258 1.7224
17 Nov 2013 04:17:39 1029390 16031043 hadcm3n_4eps_2020_40_008393208_1 829,440 1,426,961 1.7204
15 Nov 2013 06:15:22 1029390 16031043 hadcm3n_4eps_2020_40_008393208_1 803,520 1,381,683 1.7195
13 Nov 2013 06:55:50 1029390 16031043 hadcm3n_4eps_2020_40_008393208_1 777,600 1,337,676 1.7203
11 Nov 2013 04:05:39 1029390 16031043 hadcm3n_4eps_2020_40_008393208_1 751,680 1,293,610 1.7210
09 Nov 2013 09:56:11 1029390 16031043 hadcm3n_4eps_2020_40_008393208_1 725,760 1,248,795 1.7207
07 Nov 2013 09:35:49 1029390 16031043 hadcm3n_4eps_2020_40_008393208_1 699,840 1,202,247 1.7179
05 Nov 2013 09:58:22 1029390 16031043 hadcm3n_4eps_2020_40_008393208_1 673,920 1,156,318 1.7158
03 Nov 2013 09:38:11 1029390 16031043 hadcm3n_4eps_2020_40_008393208_1 648,000 1,111,286 1.7149
01 Nov 2013 11:33:07 1029390 16031043 hadcm3n_4eps_2020_40_008393208_1 622,080 1,066,866 1.7150
30 Oct 2013 11:39:33 1029390 16031043 hadcm3n_4eps_2020_40_008393208_1 596,160 1,022,987 1.7160
24 Oct 2013 12:01:52 1029390 16031043 hadcm3n_4eps_2020_40_008393208_1 570,240 977,487 1.7142
24 Oct 2013 00:14:34 1029390 16031043 hadcm3n_4eps_2020_40_008393208_1 544,320 935,557 1.7188
22 Oct 2013 13:35:37 1029390 16031043 hadcm3n_4eps_2020_40_008393208_1 518,400 892,655 1.7219


©2024 cpdn.org