 |
|
| Name | hadcm3n_zk4l_1960_40_008370094_0 |
| Workunit | 8520953 |
| Created | 20 May 2013, 16:43:55 UTC |
| Sent | 20 May 2013, 16:44:20 UTC |
| Report deadline | 20 Aug 2013, 0:11:31 UTC |
| Received | 25 Jun 2013, 2:21:00 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 193 (0x000000C1) EXIT_SIGNAL |
| Computer ID | 1128992 |
| Run time | 29 days 3 hours 13 min 24 sec |
| CPU time | 22 days 7 hours 19 min 12 sec |
| Validate state | Invalid |
| Credit | 12,441.60 |
| Device peak FLOPS | 2.95 GFLOPS |
| Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
| Stderr | <core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 62 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/zk4lko.pji0c10 is not a valid UM file. Error converting file to netcdf: dataout/zk4lko.pji0c10 Error: Input file: dataout/zk4lko.pii0c10 is not a valid UM file. Error converting file to netcdf: dataout/zk4lko.pii0c10 Error: Input file: dataout/zk4lko.pfi0c10 is not a valid UM file. Error converting file to netcdf: dataout/zk4lko.pfi0c10 Error: Input file: dataout/zk4lko.pci0c10 is not a valid UM file. Error converting file to netcdf: dataout/zk4lko.pci0c10 Error: Input file: dataout/zk4lko.pbi0c10 is not a valid UM file. Error converting file to netcdf: dataout/zk4lko.pbi0c10 Error: Input file: dataout/zk4lko.pai0c10 is not a valid UM file. Error converting file to netcdf: dataout/zk4lko.pai0c10 Error: Input file: dataout/zk4lka.phi0c10 is not a valid UM file. Error converting file to netcdf: dataout/zk4lka.phi0c10 Error: Input file: dataout/zk4lka.pgi0c10 is not a valid UM file. Error converting file to netcdf: dataout/zk4lka.pgi0c10 Error: Input file: dataout/zk4lka.pei0c10 is not a valid UM file. Error converting file to netcdf: dataout/zk4lka.pei0c10 Error: Input file: dataout/zk4lka.pdi0c10 is not a valid UM file. Error converting file to netcdf: dataout/zk4lka.pdi0c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0973ff10 *** ======= Backtrace: ========= /lib32/libc.so.6(+0x6bff1)[0xf7554ff1] /lib32/libc.so.6(+0x6d880)[0xf7556880] /lib32/libc.so.6(cfree+0x6d)[0xf755992d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf77307b1] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf773080d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe7)[0xf74ffce7] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 08:05 10748114 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:05 10748114 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 096ea000-09750000 rw-p 00000000 00:00 0 [heap] f6f00000-f6f21000 rw-p 00000000 00:00 0 f6f21000-f7000000 ---p 00000000 00:00 0 f706b000-f74e6000 rw-s 00000000 08:05 11141491 /var/lib/boinc-client/slots/2/136860 f74e6000-f74e9000 rw-p 00000000 00:00 0 f74e9000-f763d000 r-xp 00000000 08:05 262196 /lib32/libc-2.12.1.so f763d000-f763e000 ---p 00154000 08:05 262196 /lib32/libc-2.12.1.so f763e000-f7640000 r--p 00154000 08:05 262196 /lib32/libc-2.12.1.so f7640000-f7641000 rw-p 00156000 08:05 262196 /lib32/libc-2.12.1.so f7641000-f7644000 rw-p 00000000 00:00 0 f7644000-f765e000 r-xp 00000000 08:05 3021812 /usr/lib32/libgcc_s.so.1 f765e000-f765f000 r--p 00019000 08:05 3021812 /usr/lib32/libgcc_s.so.1 f765f000-f7660000 rw-p 0001a000 08:05 3021812 /usr/lib32/libgcc_s.so.1 f7660000-f7684000 r-xp 00000000 08:05 262200 /lib32/libm-2.12.1.so f7684000-f7685000 r--p 00023000 08:05 262200 /lib32/libm-2.12.1.so f7685000-f7686000 rw-p 00024000 08:05 262200 /lib32/libm-2.12.1.so f7686000-f7765000 r-xp 00000000 08:05 3021815 /usr/lib32/libstdc++.so.6.0.14 f7765000-f7769000 r--p 000de000 08:05 3021815 /usr/lib32/libstdc++.so.6.0.14 f7769000-f776a000 rw-p 000e2000 08:05 3021815 /usr/lib32/libstdc++.so.6.0.14 f776a000-f7771000 rw-p 00000000 00:00 0 f7771000-f7773000 r-xp 00000000 08:05 262199 /lib32/libdl-2.12.1.so f7773000-f7774000 r--p 00001000 08:05 262199 /lib32/libdl-2.12.1.so f7774000-f7775000 rw-p 00002000 08:05 262199 /lib32/libdl-2.12.1.so f7775000-f7776000 rw-p 00000000 00:00 0 f7776000-f778b000 r-xp 00000000 08:05 262210 /lib32/libpthread-2.12.1.so f778b000-f778c000 r--p 00014000 08:05 262210 /lib32/libpthread-2.12.1.so f778c000-f778d000 rw-p 00015000 08:05 262210 /lib32/libpthread-2.12.1.so f778d000-f778f000 rw-p 00000000 00:00 0 f77a1000-f77a2000 rw-p 00000000 00:00 0 f77a2000-f77a3000 ---p 00000000 00:00 0 f77a3000-f77a6000 rw-p 00000000 00:00 0 f77a6000-f77a8000 rw-s 00000000 08:05 11141382 /var/lib/boinc-client/slots/2/boinc_mmap_file f77a8000-f77aa000 rw-p 00000000 00:00 0 f77aa000-f77ab000 r-xp 00000000 00:00 0 [vdso] f77ab000-f77c7000 r-xp 00000000 08:05 262193 /lib32/ld-2.12.1.so f77c7000-f77c8000 r--p 0001b000 08:05 262193 /lib32/ld-2.12.1.so f77c8000-f77c9000 rw-p 0001c000 08:05 262193 /lib32/ld-2.12.1.so ff9b2000-ffa22000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf77aa400] [0xf77aa430] /lib32/libc.so.6(gsignal+0x51)[0xf7513a01] /lib32/libc.so.6(abort+0x182)[0xf7516e42] /lib32/libc.so.6(+0x61f15)[0xf754af15] /lib32/libc.so.6(+0x6bff1)[0xf7554ff1] /lib32/libc.so.6(+0x6d880)[0xf7556880] /lib32/libc.so.6(cfree+0x6d)[0xf755992d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf77307b1] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf773080d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe7)[0xf74ffce7] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]> |
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 25 Jun 2013 01:22:52 | 1128992 | 15791269 | hadcm3n_zk4l_1960_40_008370094_0 | 1,036,800 | 1,927,150 | 1.8587 |
| 24 Jun 2013 05:48:34 | 1128992 | 15791269 | hadcm3n_zk4l_1960_40_008370094_0 | 1,010,880 | 1,879,336 | 1.8591 |
| 23 Jun 2013 06:45:53 | 1128992 | 15791269 | hadcm3n_zk4l_1960_40_008370094_0 | 984,960 | 1,831,271 | 1.8592 |
| 22 Jun 2013 00:45:30 | 1128992 | 15791269 | hadcm3n_zk4l_1960_40_008370094_0 | 959,040 | 1,782,585 | 1.8587 |
| 20 Jun 2013 22:17:22 | 1128992 | 15791269 | hadcm3n_zk4l_1960_40_008370094_0 | 933,120 | 1,734,223 | 1.8585 |
| 19 Jun 2013 21:21:46 | 1128992 | 15791269 | hadcm3n_zk4l_1960_40_008370094_0 | 907,200 | 1,686,113 | 1.8586 |
| 18 Jun 2013 18:41:26 | 1128992 | 15791269 | hadcm3n_zk4l_1960_40_008370094_0 | 881,280 | 1,637,710 | 1.8583 |
| 17 Jun 2013 15:33:39 | 1128992 | 15791269 | hadcm3n_zk4l_1960_40_008370094_0 | 855,360 | 1,589,306 | 1.8581 |
| 16 Jun 2013 10:26:32 | 1128992 | 15791269 | hadcm3n_zk4l_1960_40_008370094_0 | 829,440 | 1,541,988 | 1.8591 |
| 15 Jun 2013 10:50:35 | 1128992 | 15791269 | hadcm3n_zk4l_1960_40_008370094_0 | 803,520 | 1,495,213 | 1.8608 |
| 14 Jun 2013 11:44:02 | 1128992 | 15791269 | hadcm3n_zk4l_1960_40_008370094_0 | 777,600 | 1,447,002 | 1.8609 |
| 13 Jun 2013 20:19:18 | 1128992 | 15791269 | hadcm3n_zk4l_1960_40_008370094_0 | 751,680 | 1,404,251 | 1.8682 |
| 12 Jun 2013 22:59:43 | 1128992 | 15791269 | hadcm3n_zk4l_1960_40_008370094_0 | 725,760 | 1,355,425 | 1.8676 |
| 12 Jun 2013 02:23:11 | 1128992 | 15791269 | hadcm3n_zk4l_1960_40_008370094_0 | 699,840 | 1,307,356 | 1.8681 |
| 11 Jun 2013 07:07:34 | 1128992 | 15791269 | hadcm3n_zk4l_1960_40_008370094_0 | 673,920 | 1,258,622 | 1.8676 |
| 10 Jun 2013 10:18:27 | 1128992 | 15791269 | hadcm3n_zk4l_1960_40_008370094_0 | 648,000 | 1,208,260 | 1.8646 |
| 09 Jun 2013 12:16:02 | 1128992 | 15791269 | hadcm3n_zk4l_1960_40_008370094_0 | 622,080 | 1,156,628 | 1.8593 |
| 08 Jun 2013 13:15:34 | 1128992 | 15791269 | hadcm3n_zk4l_1960_40_008370094_0 | 596,160 | 1,106,701 | 1.8564 |
| 07 Jun 2013 15:56:26 | 1128992 | 15791269 | hadcm3n_zk4l_1960_40_008370094_0 | 570,240 | 1,056,438 | 1.8526 |
| 06 Jun 2013 20:48:57 | 1128992 | 15791269 | hadcm3n_zk4l_1960_40_008370094_0 | 544,320 | 1,005,895 | 1.8480 |
©2024 climateprediction.net