 |
|
| Name | hadcm3n_8cav_1980_40_008725362_1 |
| Workunit | 8871340 |
| Created | 31 Jul 2014, 8:27:20 UTC |
| Sent | 31 Jul 2014, 8:28:06 UTC |
| Report deadline | 30 Oct 2014, 15:55:17 UTC |
| Received | 29 Oct 2014, 15:34:52 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 193 (0x000000C1) EXIT_SIGNAL |
| Computer ID | 1245110 |
| Run time | 25 days 3 hours 27 min 25 sec |
| CPU time | 24 days 7 hours 38 min 42 sec |
| Validate state | Invalid |
| Credit | 12,441.60 |
| Device peak FLOPS | 1.55 GFLOPS |
| Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
| Stderr | <core_client_version>6.6.41</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/8cavko.pji3c10 is not a valid UM file. Error converting file to netcdf: dataout/8cavko.pji3c10 Error: Input file: dataout/8cavko.pii3c10 is not a valid UM file. Error converting file to netcdf: dataout/8cavko.pii3c10 Error: Input file: dataout/8cavko.pfi3c10 is not a valid UM file. Error converting file to netcdf: dataout/8cavko.pfi3c10 Error: Input file: dataout/8cavka.phi3c10 is not a valid UM file. Error converting file to netcdf: dataout/8cavka.phi3c10 Error: Input file: dataout/8cavka.pgi3c10 is not a valid UM file. Error converting file to netcdf: dataout/8cavka.pgi3c10 Error: Input file: dataout/8cavka.pei3c10 is not a valid UM file. Error converting file to netcdf: dataout/8cavka.pei3c10 Error: Input file: dataout/8cavka.pdi3c10 is not a valid UM file. Error converting file to netcdf: dataout/8cavka.pdi3c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12033, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/8cavko.pjk9c10 is not a valid UM file. Error converting file to netcdf: dataout/8cavko.pjk9c10 Error: Input file: dataout/8cavko.pik9c10 is not a valid UM file. Error converting file to netcdf: dataout/8cavko.pik9c10 Error: Input file: dataout/8cavko.pfk9c10 is not a valid UM file. Error converting file to netcdf: dataout/8cavko.pfk9c10 Error: Input file: dataout/8cavka.phk9c10 is not a valid UM file. Error converting file to netcdf: dataout/8cavka.phk9c10 Error: Input file: dataout/8cavka.pgk9c10 is not a valid UM file. Error converting file to netcdf: dataout/8cavka.pgk9c10 Error: Input file: dataout/8cavka.pek9c10 is not a valid UM file. Error converting file to netcdf: dataout/8cavka.pek9c10 Error: Input file: dataout/8cavka.pdk9c10 is not a valid UM file. Error converting file to netcdf: dataout/8cavka.pdk9c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/8cavko.pjl2c10 is not a valid UM file. Error converting file to netcdf: dataout/8cavko.pjl2c10 Error: Input file: dataout/8cavko.pil2c10 is not a valid UM file. Error converting file to netcdf: dataout/8cavko.pil2c10 Error: Input file: dataout/8cavko.pfl2c10 is not a valid UM file. Error converting file to netcdf: dataout/8cavko.pfl2c10 Error: Input file: dataout/8cavka.phl2c10 is not a valid UM file. Error converting file to netcdf: dataout/8cavka.phl2c10 Error: Input file: dataout/8cavka.pgl2c10 is not a valid UM file. Error converting file to netcdf: dataout/8cavka.pgl2c10 Error: Input file: dataout/8cavka.pel2c10 is not a valid UM file. Error converting file to netcdf: dataout/8cavka.pel2c10 Error: Input file: dataout/8cavka.pdl2c10 is not a valid UM file. Error converting file to netcdf: dataout/8cavka.pdl2c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: free(): invalid next size (normal): 0x08733b78 *** ======= Backtrace: ========= /lib/i386-linux-gnu/libc.so.6(+0x75b12)[0xb7476b12] /usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x1f)[0xb769e51f] /usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdaPv+0x1b)[0xb769e57b] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xb741a4d3] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 08:01 9047675 /home/huo/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rwxp 0009b000 08:01 9047675 /home/huo/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rwxp 00000000 00:00 0 08676000-08770000 rwxp 00000000 00:00 0 [heap] b6e00000-b6e21000 rwxp 00000000 00:00 0 b6e21000-b6f00000 ---p 00000000 00:00 0 b6f83000-b73fe000 rwxs 00000000 08:01 8789114 /home/huo/BOINC/slots/8/137010 b73fe000-b7401000 rwxp 00000000 00:00 0 b7401000-b75a5000 r-xp 00000000 08:01 265913 /lib/i386-linux-gnu/libc-2.15.so b75a5000-b75a7000 r-xp 001a4000 08:01 265913 /lib/i386-linux-gnu/libc-2.15.so b75a7000-b75a8000 rwxp 001a6000 08:01 265913 /lib/i386-linux-gnu/libc-2.15.so b75a8000-b75ab000 rwxp 00000000 00:00 0 b75ab000-b75c7000 r-xp 00000000 08:01 263092 /lib/i386-linux-gnu/libgcc_s.so.1 b75c7000-b75c8000 r-xp 0001b000 08:01 263092 /lib/i386-linux-gnu/libgcc_s.so.1 b75c8000-b75c9000 rwxp 0001c000 08:01 263092 /lib/i386-linux-gnu/libgcc_s.so.1 b75c9000-b75f3000 r-xp 00000000 08:01 269114 /lib/i386-linux-gnu/libm-2.15.so b75f3000-b75f4000 r-xp 00029000 08:01 269114 /lib/i386-linux-gnu/libm-2.15.so b75f4000-b75f5000 rwxp 0002a000 08:01 269114 /lib/i386-linux-gnu/libm-2.15.so b75f5000-b76cd000 r-xp 00000000 08:01 3412945 /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16 b76cd000-b76ce000 ---p 000d8000 08:01 3412945 /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16 b76ce000-b76d2000 r-xp 000d8000 08:01 3412945 /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16 b76d2000-b76d3000 rwxp 000dc000 08:01 3412945 /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16 b76d3000-b76db000 rwxp 00000000 00:00 0 b76db000-b76de000 r-xp 00000000 08:01 269106 /lib/i386-linux-gnu/libdl-2.15.so b76de000-b76df000 r-xp 00002000 08:01 269106 /lib/i386-linux-gnu/libdl-2.15.so b76df000-b76e0000 rwxp 00003000 08:01 269106 /lib/i386-linux-gnu/libdl-2.15.so b76e0000-b76f7000 r-xp 00000000 08:01 269113 /lib/i386-linux-gnu/libpthread-2.15.so b76f7000-b76f8000 r-xp 00016000 08:01 269113 /lib/i386-linux-gnu/libpthread-2.15.so b76f8000-b76f9000 rwxp 00017000 08:01 269113 /lib/i386-linux-gnu/libpthread-2.15.so b76f9000-b76fb000 rwxp 00000000 00:00 0 b7703000-b7705000 rwxp 00000000 00:00 0 b7705000-b7706000 ---p 00000000 00:00 0 b7706000-b7709000 rwxp 00000000 00:00 0 b7709000-b770b000 rwxs 00000000 08:01 8789111 /home/huo/BOINC/slots/8/boinc_mmap_file b770b000-b770d000 rwxp 00000000 00:00 0 b770d000-b770e000 r-xp 00000000 00:00 0 [vdso] b770e000-b772e000 r-xp 00000000 08:01 269117 /lib/i386-linux-gnu/ld-2.15.so b772e000-b772f000 r-xp 0001f000 08:01 269117 /lib/i386-linux-gnu/ld-2.15.so b772f000-b7730000 rwxp 00020000 08:01 269117 /lib/i386-linux-gnu/ld-2.15.so bfd26000-bfd96000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (17 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xb770d400] [0xb770d424] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xb742ee0f] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xb7432455] /lib/i386-linux-gnu/libc.so.6(+0x6afca)[0xb746bfca] /lib/i386-linux-gnu/libc.so.6(+0x75b12)[0xb7476b12] /usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x1f)[0xb769e51f] /usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdaPv+0x1b)[0xb769e57b] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xb741a4d3] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]> |
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 29 Oct 2014 15:38:18 | 1245110 | 16832454 | hadcm3n_8cav_1980_40_008725362_1 | 1,036,800 | 2,101,119 | 2.0265 |
| 24 Oct 2014 15:46:49 | 1245110 | 16832454 | hadcm3n_8cav_1980_40_008725362_1 | 1,010,880 | 2,048,882 | 2.0268 |
| 22 Oct 2014 15:35:00 | 1245110 | 16832454 | hadcm3n_8cav_1980_40_008725362_1 | 984,960 | 1,995,053 | 2.0255 |
| 11 Oct 2014 02:31:45 | 1245110 | 16832454 | hadcm3n_8cav_1980_40_008725362_1 | 959,040 | 1,941,828 | 2.0248 |
| 03 Oct 2014 08:51:54 | 1245110 | 16832454 | hadcm3n_8cav_1980_40_008725362_1 | 933,120 | 1,888,120 | 2.0234 |
| 15 Sep 2014 22:47:56 | 1245110 | 16832454 | hadcm3n_8cav_1980_40_008725362_1 | 907,200 | 1,835,962 | 2.0238 |
| 15 Sep 2014 05:08:41 | 1245110 | 16832454 | hadcm3n_8cav_1980_40_008725362_1 | 881,280 | 1,784,489 | 2.0249 |
| 14 Sep 2014 13:40:40 | 1245110 | 16832454 | hadcm3n_8cav_1980_40_008725362_1 | 855,360 | 1,732,763 | 2.0258 |
| 13 Sep 2014 21:56:19 | 1245110 | 16832454 | hadcm3n_8cav_1980_40_008725362_1 | 829,440 | 1,680,504 | 2.0261 |
| 13 Sep 2014 01:39:02 | 1245110 | 16832454 | hadcm3n_8cav_1980_40_008725362_1 | 803,520 | 1,628,346 | 2.0265 |
| 12 Sep 2014 09:49:44 | 1245110 | 16832454 | hadcm3n_8cav_1980_40_008725362_1 | 777,600 | 1,575,384 | 2.0260 |
| 11 Sep 2014 16:43:43 | 1245110 | 16832454 | hadcm3n_8cav_1980_40_008725362_1 | 751,680 | 1,522,565 | 2.0255 |
| 02 Sep 2014 09:13:37 | 1245110 | 16832454 | hadcm3n_8cav_1980_40_008725362_1 | 725,760 | 1,470,627 | 2.0263 |
| 31 Aug 2014 13:45:45 | 1245110 | 16832454 | hadcm3n_8cav_1980_40_008725362_1 | 699,840 | 1,418,729 | 2.0272 |
| 30 Aug 2014 02:27:28 | 1245110 | 16832454 | hadcm3n_8cav_1980_40_008725362_1 | 673,920 | 1,366,637 | 2.0279 |
| 22 Aug 2014 01:08:26 | 1245110 | 16832454 | hadcm3n_8cav_1980_40_008725362_1 | 648,000 | 1,314,072 | 2.0279 |
| 21 Aug 2014 07:23:00 | 1245110 | 16832454 | hadcm3n_8cav_1980_40_008725362_1 | 622,080 | 1,261,713 | 2.0282 |
| 20 Aug 2014 12:20:26 | 1245110 | 16832454 | hadcm3n_8cav_1980_40_008725362_1 | 596,160 | 1,209,601 | 2.0290 |
| 19 Aug 2014 02:00:36 | 1245110 | 16832454 | hadcm3n_8cav_1980_40_008725362_1 | 570,240 | 1,156,674 | 2.0284 |
| 18 Aug 2014 08:50:17 | 1245110 | 16832454 | hadcm3n_8cav_1980_40_008725362_1 | 544,320 | 1,103,990 | 2.0282 |
©2024 cpdn.org