 |
|
| Name | hadcm3n_7l5a_1980_40_008438689_1 |
| Workunit | 8589545 |
| Created | 14 Jan 2014, 7:21:17 UTC |
| Sent | 14 Jan 2014, 7:23:54 UTC |
| Report deadline | 15 Apr 2014, 14:51:05 UTC |
| Received | 4 Feb 2014, 13:29:18 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 193 (0x000000C1) EXIT_SIGNAL |
| Computer ID | 1298771 |
| Run time | 15 days 9 hours 1 min 47 sec |
| CPU time | 15 days 6 hours 44 min |
| Validate state | Invalid |
| Credit | 6,220.80 |
| Device peak FLOPS | 1.79 GFLOPS |
| Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
| Stderr | <core_client_version>7.0.27</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:20:17 (16443): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 00:22:20 (16489): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 00:24:26 (16533): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 00:26:58 (16575): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 00:28:47 (16619): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 00:31:04 (16657): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 00:33:23 (16694): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 00:35:28 (16732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 00:37:42 (16769): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 00:39:35 (16804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 00:41:33 (16845): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: free(): invalid next size (normal): 0x08eccfe0 *** ======= Backtrace: ========= /lib/i386-linux-gnu/libc.so.6(+0x75ee2)[0xf7446ee2] /usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x1f)[0xf766e51f] /usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdaPv+0x1b)[0xf766e57b] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf73ea4d3] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 08:01 6165698 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:01 6165698 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 08e0f000-08f09000 rw-p 00000000 00:00 0 [heap] f6e00000-f6e21000 rw-p 00000000 00:00 0 f6e21000-f6f00000 ---p 00000000 00:00 0 f6f53000-f73ce000 rw-s 00000000 08:01 6291963 /var/lib/boinc-client/slots/17/135875 f73ce000-f73d1000 rw-p 00000000 00:00 0 f73d1000-f7575000 r-xp 00000000 08:01 14024936 /lib/i386-linux-gnu/libc-2.15.so f7575000-f7577000 r--p 001a4000 08:01 14024936 /lib/i386-linux-gnu/libc-2.15.so f7577000-f7578000 rw-p 001a6000 08:01 14024936 /lib/i386-linux-gnu/libc-2.15.so f7578000-f757b000 rw-p 00000000 00:00 0 f757b000-f7597000 r-xp 00000000 08:01 14024913 /lib/i386-linux-gnu/libgcc_s.so.1 f7597000-f7598000 r--p 0001b000 08:01 14024913 /lib/i386-linux-gnu/libgcc_s.so.1 f7598000-f7599000 rw-p 0001c000 08:01 14024913 /lib/i386-linux-gnu/libgcc_s.so.1 f7599000-f75c3000 r-xp 00000000 08:01 14024931 /lib/i386-linux-gnu/libm-2.15.so f75c3000-f75c4000 r--p 00029000 08:01 14024931 /lib/i386-linux-gnu/libm-2.15.so f75c4000-f75c5000 rw-p 0002a000 08:01 14024931 /lib/i386-linux-gnu/libm-2.15.so f75c5000-f769d000 r-xp 00000000 08:01 141237 /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16 f769d000-f769e000 ---p 000d8000 08:01 141237 /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16 f769e000-f76a2000 r--p 000d8000 08:01 141237 /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16 f76a2000-f76a3000 rw-p 000dc000 08:01 141237 /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16 f76a3000-f76ab000 rw-p 00000000 00:00 0 f76ab000-f76ae000 r-xp 00000000 08:01 14024935 /lib/i386-linux-gnu/libdl-2.15.so f76ae000-f76af000 r--p 00002000 08:01 14024935 /lib/i386-linux-gnu/libdl-2.15.so f76af000-f76b0000 rw-p 00003000 08:01 14024935 /lib/i386-linux-gnu/libdl-2.15.so f76b0000-f76c7000 r-xp 00000000 08:01 14024925 /lib/i386-linux-gnu/libpthread-2.15.so f76c7000-f76c8000 r--p 00016000 08:01 14024925 /lib/i386-linux-gnu/libpthread-2.15.so f76c8000-f76c9000 rw-p 00017000 08:01 14024925 /lib/i386-linux-gnu/libpthread-2.15.so f76c9000-f76cb000 rw-p 00000000 00:00 0 f76dc000-f76de000 rw-p 00000000 00:00 0 f76de000-f76df000 ---p 00000000 00:00 0 f76df000-f76e2000 rw-p 00000000 00:00 0 [stack:25633] f76e2000-f76e4000 rw-s 00000000 08:01 6291625 /var/lib/boinc-client/slots/17/boinc_mmap_file f76e4000-f76e6000 rw-p 00000000 00:00 0 f76e6000-f76e7000 r-xp 00000000 00:00 0 [vdso] f76e7000-f7707000 r-xp 00000000 08:01 14024926 /lib/i386-linux-gnu/ld-2.15.so f7707000-f7708000 r--p 0001f000 08:01 14024926 /lib/i386-linux-gnu/ld-2.15.so f7708000-f7709000 rw-p 00020000 08:01 14024926 /lib/i386-linux-gnu/ld-2.15.so fff56000-fffc5000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (17 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf76e6400] [0xf76e6425] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf73ff1df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7402825] /lib/i386-linux-gnu/libc.so.6(+0x6b39a)[0xf743c39a] /lib/i386-linux-gnu/libc.so.6(+0x75ee2)[0xf7446ee2] /usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x1f)[0xf766e51f] /usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdaPv+0x1b)[0xf766e57b] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf73ea4d3] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]> |
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 03 Feb 2014 13:32:05 | 1298771 | 16231775 | hadcm3n_7l5a_1980_40_008438689_1 | 518,400 | 1,320,234 | 2.5467 |
| 02 Feb 2014 13:49:28 | 1298771 | 16231775 | hadcm3n_7l5a_1980_40_008438689_1 | 492,480 | 1,253,979 | 2.5463 |
| 01 Feb 2014 16:55:06 | 1298771 | 16231775 | hadcm3n_7l5a_1980_40_008438689_1 | 466,560 | 1,186,675 | 2.5435 |
| 31 Jan 2014 21:24:38 | 1298771 | 16231775 | hadcm3n_7l5a_1980_40_008438689_1 | 440,640 | 1,119,122 | 2.5398 |
| 31 Jan 2014 07:38:31 | 1298771 | 16231775 | hadcm3n_7l5a_1980_40_008438689_1 | 414,720 | 1,051,165 | 2.5346 |
| 31 Jan 2014 07:38:31 | 1298771 | 16231775 | hadcm3n_7l5a_1980_40_008438689_1 | 388,800 | 985,583 | 2.5349 |
| 31 Jan 2014 07:38:31 | 1298771 | 16231775 | hadcm3n_7l5a_1980_40_008438689_1 | 362,880 | 919,848 | 2.5349 |
| 26 Jan 2014 23:00:48 | 1298771 | 16231775 | hadcm3n_7l5a_1980_40_008438689_1 | 336,960 | 851,851 | 2.5280 |
| 26 Jan 2014 02:56:04 | 1298771 | 16231775 | hadcm3n_7l5a_1980_40_008438689_1 | 311,040 | 783,628 | 2.5194 |
| 24 Jan 2014 13:02:45 | 1298771 | 16231775 | hadcm3n_7l5a_1980_40_008438689_1 | 285,120 | 717,842 | 2.5177 |
| 24 Jan 2014 10:34:55 | 1298771 | 16231775 | hadcm3n_7l5a_1980_40_008438689_1 | 259,200 | 650,486 | 2.5096 |
| 22 Jan 2014 17:26:12 | 1298771 | 16231775 | hadcm3n_7l5a_1980_40_008438689_1 | 233,280 | 583,564 | 2.5016 |
| 21 Jan 2014 19:05:24 | 1298771 | 16231775 | hadcm3n_7l5a_1980_40_008438689_1 | 207,360 | 518,156 | 2.4988 |
| 20 Jan 2014 20:02:13 | 1298771 | 16231775 | hadcm3n_7l5a_1980_40_008438689_1 | 181,440 | 450,620 | 2.4836 |
| 20 Jan 2014 01:13:43 | 1298771 | 16231775 | hadcm3n_7l5a_1980_40_008438689_1 | 155,520 | 383,609 | 2.4666 |
| 18 Jan 2014 01:00:18 | 1298771 | 16231775 | hadcm3n_7l5a_1980_40_008438689_1 | 129,600 | 320,768 | 2.4751 |
| 17 Jan 2014 07:31:54 | 1298771 | 16231775 | hadcm3n_7l5a_1980_40_008438689_1 | 103,680 | 257,880 | 2.4873 |
| 16 Jan 2014 13:39:36 | 1298771 | 16231775 | hadcm3n_7l5a_1980_40_008438689_1 | 77,760 | 193,830 | 2.4927 |
| 15 Jan 2014 19:40:12 | 1298771 | 16231775 | hadcm3n_7l5a_1980_40_008438689_1 | 51,840 | 129,403 | 2.4962 |
| 15 Jan 2014 01:22:05 | 1298771 | 16231775 | hadcm3n_7l5a_1980_40_008438689_1 | 25,920 | 64,091 | 2.4726 |
©2024 cpdn.org