 |
|
| Name | hadcm3n_ygj7_2020_40_008340488_0 |
| Workunit | 8491349 |
| Created | 29 Mar 2013, 2:29:44 UTC |
| Sent | 29 Mar 2013, 8:42:26 UTC |
| Report deadline | 28 Jun 2013, 16:09:37 UTC |
| Received | 13 Jun 2013, 0:12:15 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 193 (0x000000C1) EXIT_SIGNAL |
| Computer ID | 1177999 |
| Run time | 19 days 12 hours 41 min 22 sec |
| CPU time | 15 days 16 hours 8 min 6 sec |
| Validate state | Invalid |
| Credit | 9,331.20 |
| Device peak FLOPS | 1.65 GFLOPS |
| Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
| Stderr | <core_client_version>6.12.34</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:07:22 (12624): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 62 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/ygj7ko.pjp0c10 is not a valid UM file. Error converting file to netcdf: dataout/ygj7ko.pjp0c10 Error: Input file: dataout/ygj7ko.pip0c10 is not a valid UM file. Error converting file to netcdf: dataout/ygj7ko.pip0c10 Error: Input file: dataout/ygj7ko.pfp0c10 is not a valid UM file. Error converting file to netcdf: dataout/ygj7ko.pfp0c10 Error: Input file: dataout/ygj7ko.pcp0c10 is not a valid UM file. Error converting file to netcdf: dataout/ygj7ko.pcp0c10 Error: Input file: dataout/ygj7ko.pbp0c10 is not a valid UM file. Error converting file to netcdf: dataout/ygj7ko.pbp0c10 Error: Input file: dataout/ygj7ko.pap0c10 is not a valid UM file. Error converting file to netcdf: dataout/ygj7ko.pap0c10 Error: Input file: dataout/ygj7ka.php0c10 is not a valid UM file. Error converting file to netcdf: dataout/ygj7ka.php0c10 Error: Input file: dataout/ygj7ka.pgp0c10 is not a valid UM file. Error converting file to netcdf: dataout/ygj7ka.pgp0c10 Error: Input file: dataout/ygj7ka.pep0c10 is not a valid UM file. Error converting file to netcdf: dataout/ygj7ka.pep0c10 Error: Input file: dataout/ygj7ka.pdp0c10 is not a valid UM file. Error converting file to netcdf: dataout/ygj7ka.pdp0c10 *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08f29d20 *** ======= Backtrace: ========= /lib/libc.so.6(-0xffa8e1cf)[0x33fe31] /lib/libc.so.6(-0xffa8ba8f)[0x342571] /usr/lib/libstdc++.so.6(_ZdlPv+0x22)[0x5bcdf2] /usr/lib/libstdc++.so.6(_ZdaPv+0x1e)[0x5bce4e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xe6)[0x2e5ce6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 001e6000-0020e000 r-xp 00000000 fd:01 2360745 /lib/libm-2.12.so 0020e000-0020f000 r--p 00027000 fd:01 2360745 /lib/libm-2.12.so 0020f000-00210000 rw-p 00028000 fd:01 2360745 /lib/libm-2.12.so 002b1000-002ce000 r-xp 00000000 fd:01 2361939 /lib/libgcc_s-4.4.7-20120601.so.1 002ce000-002cf000 rw-p 0001d000 fd:01 2361939 /lib/libgcc_s-4.4.7-20120601.so.1 002cf000-0045f000 r-xp 00000000 fd:01 2360739 /lib/libc-2.12.so 0045f000-00460000 ---p 00190000 fd:01 2360739 /lib/libc-2.12.so 00460000-00462000 r--p 00190000 fd:01 2360739 /lib/libc-2.12.so 00462000-00463000 rw-p 00192000 fd:01 2360739 /lib/libc-2.12.so 00463000-00466000 rw-p 00000000 00:00 0 004df000-004fd000 r-xp 00000000 fd:01 2360738 /lib/ld-2.12.so 004fd000-004fe000 r--p 0001d000 fd:01 2360738 /lib/ld-2.12.so 004fe000-004ff000 rw-p 0001e000 fd:01 2360738 /lib/ld-2.12.so 00510000-005ef000 r-xp 00000000 fd:01 2109491 /usr/lib/libstdc++.so.6.0.13 005ef000-005f3000 r--p 000de000 fd:01 2109491 /usr/lib/libstdc++.so.6.0.13 005f3000-005f4000 rw-p 000e2000 fd:01 2109491 /usr/lib/libstdc++.so.6.0.13 005f4000-005fb000 rw-p 00000000 00:00 0 0069a000-0069d000 r-xp 00000000 fd:01 2360740 /lib/libdl-2.12.so 0069d000-0069e000 r--p 00002000 fd:01 2360740 /lib/libdl-2.12.so 0069e000-0069f000 rw-p 00003000 fd:01 2360740 /lib/libdl-2.12.so 006a1000-006b8000 r-xp 00000000 fd:01 2360774 /lib/libpthread-2.12.so 006b8000-006b9000 r--p 00016000 fd:01 2360774 /lib/libpthread-2.12.so 006b9000-006ba000 rw-p 00017000 fd:01 2360774 /lib/libpthread-2.12.so 006ba000-006bc000 rw-p 00000000 00:00 0 00b12000-00b13000 r-xp 00000000 00:00 0 [vdso] 08048000-080e3000 r-xp 00000000 fd:04 12584023 /home/adi/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 fd:04 12584023 /home/adi/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 08ed4000-08f5b000 rw-p 00000000 00:00 0 [heap] f7200000-f7221000 rw-p 00000000 00:00 0 f7221000-f7300000 ---p 00000000 00:00 0 f732e000-f77a9000 rw-s 00000000 fd:04 12845443 /home/adi/boinc/slots/10/136165 f77a9000-f77ac000 rw-p 00000000 00:00 0 f77c5000-f77c7000 rw-p 00000000 00:00 0 f77c7000-f77c8000 ---p 00000000 00:00 0 f77c8000-f77cb000 rw-p 00000000 00:00 0 f77cb000-f77cd000 rw-s 00000000 fd:04 12845440 /home/adi/boinc/slots/10/boinc_mmap_file f77cd000-f77ce000 rw-p 00000000 00:00 0 ffb43000-ffbb3000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (18 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xb12400] [0xb12430] /lib/libc.so.6(gsignal+0x51)[0x2f9b11] /lib/libc.so.6(abort+0x17a)[0x2fb3ea] /lib/libc.so.6(-0xffa9462b)[0x3399d5] /lib/libc.so.6(-0xffa8e1cf)[0x33fe31] /lib/libc.so.6(-0xffa8ba8f)[0x342571] /usr/lib/libstdc++.so.6(_ZdlPv+0x22)[0x5bcdf2] /usr/lib/libstdc++.so.6(_ZdaPv+0x1e)[0x5bce4e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xe6)[0x2e5ce6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]> |
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 13 Jun 2013 00:15:34 | 1177999 | 15691648 | hadcm3n_ygj7_2020_40_008340488_0 | 777,600 | 1,354,080 | 1.7414 |
| 11 Jun 2013 22:15:24 | 1177999 | 15691648 | hadcm3n_ygj7_2020_40_008340488_0 | 751,680 | 1,307,493 | 1.7394 |
| 11 Jun 2013 06:17:13 | 1177999 | 15691648 | hadcm3n_ygj7_2020_40_008340488_0 | 725,760 | 1,260,535 | 1.7368 |
| 10 Jun 2013 14:25:04 | 1177999 | 15691648 | hadcm3n_ygj7_2020_40_008340488_0 | 699,840 | 1,214,477 | 1.7354 |
| 08 Jun 2013 04:31:53 | 1177999 | 15691648 | hadcm3n_ygj7_2020_40_008340488_0 | 673,920 | 1,168,523 | 1.7339 |
| 06 Jun 2013 06:40:13 | 1177999 | 15691648 | hadcm3n_ygj7_2020_40_008340488_0 | 648,000 | 1,123,718 | 1.7341 |
| 05 Jun 2013 15:38:20 | 1177999 | 15691648 | hadcm3n_ygj7_2020_40_008340488_0 | 622,080 | 1,076,940 | 1.7312 |
| 05 Jun 2013 00:51:57 | 1177999 | 15691648 | hadcm3n_ygj7_2020_40_008340488_0 | 596,160 | 1,030,569 | 1.7287 |
| 04 Jun 2013 07:54:29 | 1177999 | 15691648 | hadcm3n_ygj7_2020_40_008340488_0 | 570,240 | 983,608 | 1.7249 |
| 03 Jun 2013 14:48:44 | 1177999 | 15691648 | hadcm3n_ygj7_2020_40_008340488_0 | 544,320 | 935,435 | 1.7185 |
| 01 Jun 2013 12:30:49 | 1177999 | 15691648 | hadcm3n_ygj7_2020_40_008340488_0 | 518,400 | 889,820 | 1.7165 |
| 31 May 2013 09:21:30 | 1177999 | 15691648 | hadcm3n_ygj7_2020_40_008340488_0 | 492,480 | 842,608 | 1.7109 |
| 30 May 2013 09:19:23 | 1177999 | 15691648 | hadcm3n_ygj7_2020_40_008340488_0 | 466,560 | 795,576 | 1.7052 |
| 29 May 2013 07:47:38 | 1177999 | 15691648 | hadcm3n_ygj7_2020_40_008340488_0 | 440,640 | 747,841 | 1.6972 |
| 28 May 2013 04:37:10 | 1177999 | 15691648 | hadcm3n_ygj7_2020_40_008340488_0 | 414,720 | 702,121 | 1.6930 |
| 27 May 2013 00:56:14 | 1177999 | 15691648 | hadcm3n_ygj7_2020_40_008340488_0 | 388,800 | 656,066 | 1.6874 |
| 20 Apr 2013 21:43:32 | 1177999 | 15691648 | hadcm3n_ygj7_2020_40_008340488_0 | 362,880 | 610,792 | 1.6832 |
| 16 Apr 2013 00:51:28 | 1177999 | 15691648 | hadcm3n_ygj7_2020_40_008340488_0 | 336,960 | 567,038 | 1.6828 |
| 15 Apr 2013 13:18:16 | 1177999 | 15691648 | hadcm3n_ygj7_2020_40_008340488_0 | 311,040 | 522,684 | 1.6804 |
| 14 Apr 2013 17:11:20 | 1177999 | 15691648 | hadcm3n_ygj7_2020_40_008340488_0 | 285,120 | 478,735 | 1.6791 |
©2024 cpdn.org