 |
|
| Name | hadcm3n_ym4w_1980_40_007833183_0 |
| Workunit | 7988295 |
| Created | 19 Mar 2012, 2:08:54 UTC |
| Sent | 19 Mar 2012, 2:09:41 UTC |
| Report deadline | 18 Jun 2012, 9:36:52 UTC |
| Received | 17 Apr 2012, 0:02:08 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 193 (0x000000C1) EXIT_SIGNAL |
| Computer ID | 1185009 |
| Run time | 19 days 8 hours 12 min 19 sec |
| CPU time | 18 days 23 hours 47 min 51 sec |
| Validate state | Invalid |
| Credit | 9,331.20 |
| Device peak FLOPS | 2.44 GFLOPS |
| Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
| Stderr | <core_client_version>6.12.34</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> 23:52:21 (6393): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:16:35 (8267): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:18:35 (8314): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:22:05 (8350): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:28:57 (8382): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:37:38 (8415): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:38:54 (8453): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:39:53 (8485): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:28:25 (8509): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:42:28 (8547): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:06:03 (8579): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:46:44 (8612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:48:00 (8643): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:49:29 (8675): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:52:02 (8691): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:53:18 (8732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:59:46 (19284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:02:11 (2636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:03:59 (2666): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:07:19 (2696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:55:07 (2734): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:54:56 (4300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:05:22 (4496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:21:13 (13701): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:31:21 (13729): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:35:16 (13756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:04:09 (21310): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:37:59 (23468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:40:36 (24915): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:43:43 (25074): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:48:30 (25249): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:01:24 (2067): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:04:16 (2830): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:06:36 (8882): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:10:54 (9149): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:13:58 (9678): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:18:30 (10070): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:21:27 (10653): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:24:28 (11035): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:27:52 (11392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:31:52 (11775): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:35:50 (12265): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:43:04 (12752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:47:15 (13630): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:50:09 (14135): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:54:01 (14517): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:21:24 (14990): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:00:36 (22460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:02:57 (31733): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:06:19 (31884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:09:02 (32269): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:12:06 (32583): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:09:28 (477): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:37:39 (18217): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:02:55 (2010): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:04:06 (11485): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:05:35 (11517): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:08:12 (11549): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:09:59 (11581): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:14:21 (11613): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:04:52 (11673): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:15:40 (11711): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:16:55 (11743): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:17:33 (11779): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:20:40 (11807): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:02:53 (11847): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:05:02 (24998): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:09:06 (25038): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:14:06 (25082): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:20:03 (25129): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:28:08 (25180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:33:58 (25246): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:40:08 (25295): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:47:28 (25362): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:04:21 (25501): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:05:14 (26905): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:07:40 (26953): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:21:26 (27017): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:22:38 (27965): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:25:07 (28019): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:27:30 (28082): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:00:36 (28142): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:34:13 (26797): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 02:36:41 (20106): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x098bac68 *** ======= Backtrace: ========= /lib32/libc.so.6(+0x6bff1)[0xf74c6ff1] /lib32/libc.so.6(+0x6d880)[0xf74c8880] /lib32/libc.so.6(cfree+0x6d)[0xf74cb92d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76a27b1] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76a280d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe7)[0xf7471ce7] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 08:01 26740438 /usr/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:01 26740438 /usr/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 09865000-098ca000 rw-p 00000000 00:00 0 [heap] f6e00000-f6e21000 rw-p 00000000 00:00 0 f6e21000-f6f00000 ---p 00000000 00:00 0 f6fdd000-f7458000 rw-s 00000000 08:01 29360359 /usr/BOINC/slots/2/137890 f7458000-f745b000 rw-p 00000000 00:00 0 f745b000-f75af000 r-xp 00000000 08:01 6291607 /lib32/libc-2.12.1.so f75af000-f75b0000 ---p 00154000 08:01 6291607 /lib32/libc-2.12.1.so f75b0000-f75b2000 r--p 00154000 08:01 6291607 /lib32/libc-2.12.1.so f75b2000-f75b3000 rw-p 00156000 08:01 6291607 /lib32/libc-2.12.1.so f75b3000-f75b6000 rw-p 00000000 00:00 0 f75b6000-f75d0000 r-xp 00000000 08:01 23074874 /usr/lib32/libgcc_s.so.1 f75d0000-f75d1000 r--p 00019000 08:01 23074874 /usr/lib32/libgcc_s.so.1 f75d1000-f75d2000 rw-p 0001a000 08:01 23074874 /usr/lib32/libgcc_s.so.1 f75d2000-f75f6000 r-xp 00000000 08:01 6291611 /lib32/libm-2.12.1.so f75f6000-f75f7000 r--p 00023000 08:01 6291611 /lib32/libm-2.12.1.so f75f7000-f75f8000 rw-p 00024000 08:01 6291611 /lib32/libm-2.12.1.so f75f8000-f76d7000 r-xp 00000000 08:01 23074877 /usr/lib32/libstdc++.so.6.0.14 f76d7000-f76db000 r--p 000de000 08:01 23074877 /usr/lib32/libstdc++.so.6.0.14 f76db000-f76dc000 rw-p 000e2000 08:01 23074877 /usr/lib32/libstdc++.so.6.0.14 f76dc000-f76e3000 rw-p 00000000 00:00 0 f76e3000-f76e5000 r-xp 00000000 08:01 6291610 /lib32/libdl-2.12.1.so f76e5000-f76e6000 r--p 00001000 08:01 6291610 /lib32/libdl-2.12.1.so f76e6000-f76e7000 rw-p 00002000 08:01 6291610 /lib32/libdl-2.12.1.so f76e7000-f76e8000 rw-p 00000000 00:00 0 f76e8000-f76fd000 r-xp 00000000 08:01 6291621 /lib32/libpthread-2.12.1.so f76fd000-f76fe000 r--p 00014000 08:01 6291621 /lib32/libpthread-2.12.1.so f76fe000-f76ff000 rw-p 00015000 08:01 6291621 /lib32/libpthread-2.12.1.so f76ff000-f7701000 rw-p 00000000 00:00 0 f7715000-f7716000 rw-p 00000000 00:00 0 f7716000-f7717000 ---p 00000000 00:00 0 f7717000-f771a000 rw-p 00000000 00:00 0 f771a000-f771c000 rw-s 00000000 08:01 29360356 /usr/BOINC/slots/2/boinc_mmap_file f771c000-f771e000 rw-p 00000000 00:00 0 f771e000-f771f000 r-xp 00000000 00:00 0 [vdso] f771f000-f773b000 r-xp 00000000 08:01 6291604 /lib32/ld-2.12.1.so f773b000-f773c000 r--p 0001b000 08:01 6291604 /lib32/ld-2.12.1.so f773c000-f773d000 rw-p 0001c000 08:01 6291604 /lib32/ld-2.12.1.so ffd7f000-ffdef000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf771e400] [0xf771e430] /lib32/libc.so.6(gsignal+0x51)[0xf7485a01] /lib32/libc.so.6(abort+0x182)[0xf7488e42] /lib32/libc.so.6(+0x61f15)[0xf74bcf15] /lib32/libc.so.6(+0x6bff1)[0xf74c6ff1] /lib32/libc.so.6(+0x6d880)[0xf74c8880] /lib32/libc.so.6(cfree+0x6d)[0xf74cb92d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76a27b1] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76a280d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe7)[0xf7471ce7] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]> |
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 17 Apr 2012 00:04:00 | 1185009 | 14287479 | hadcm3n_ym4w_1980_40_007833183_0 | 777,600 | 1,640,867 | 2.1102 |
| 16 Apr 2012 22:01:48 | 1185009 | 14287479 | hadcm3n_ym4w_1980_40_007833183_0 | 751,680 | 1,588,416 | 2.1132 |
| 15 Apr 2012 22:01:22 | 1185009 | 14287479 | hadcm3n_ym4w_1980_40_007833183_0 | 725,760 | 1,534,773 | 2.1147 |
| 15 Apr 2012 01:41:58 | 1185009 | 14287479 | hadcm3n_ym4w_1980_40_007833183_0 | 699,840 | 1,478,540 | 2.1127 |
| 14 Apr 2012 22:07:01 | 1185009 | 14287479 | hadcm3n_ym4w_1980_40_007833183_0 | 673,920 | 1,421,114 | 2.1087 |
| 13 Apr 2012 22:04:21 | 1185009 | 14287479 | hadcm3n_ym4w_1980_40_007833183_0 | 648,000 | 1,363,867 | 2.1047 |
| 13 Apr 2012 01:13:53 | 1185009 | 14287479 | hadcm3n_ym4w_1980_40_007833183_0 | 622,080 | 1,307,922 | 2.1025 |
| 12 Apr 2012 22:05:27 | 1185009 | 14287479 | hadcm3n_ym4w_1980_40_007833183_0 | 596,160 | 1,251,092 | 2.0986 |
| 11 Apr 2012 22:02:24 | 1185009 | 14287479 | hadcm3n_ym4w_1980_40_007833183_0 | 570,240 | 1,195,647 | 2.0967 |
| 11 Apr 2012 00:02:00 | 1185009 | 14287479 | hadcm3n_ym4w_1980_40_007833183_0 | 544,320 | 1,139,106 | 2.0927 |
| 10 Apr 2012 22:03:44 | 1185009 | 14287479 | hadcm3n_ym4w_1980_40_007833183_0 | 518,400 | 1,082,523 | 2.0882 |
| 09 Apr 2012 22:05:00 | 1185009 | 14287479 | hadcm3n_ym4w_1980_40_007833183_0 | 492,480 | 1,025,843 | 2.0830 |
| 09 Apr 2012 00:05:01 | 1185009 | 14287479 | hadcm3n_ym4w_1980_40_007833183_0 | 466,560 | 969,786 | 2.0786 |
| 08 Apr 2012 22:01:37 | 1185009 | 14287479 | hadcm3n_ym4w_1980_40_007833183_0 | 440,640 | 913,182 | 2.0724 |
| 07 Apr 2012 22:01:52 | 1185009 | 14287479 | hadcm3n_ym4w_1980_40_007833183_0 | 414,720 | 856,279 | 2.0647 |
| 06 Apr 2012 23:16:40 | 1185009 | 14287479 | hadcm3n_ym4w_1980_40_007833183_0 | 388,800 | 799,643 | 2.0567 |
| 06 Apr 2012 22:15:32 | 1185009 | 14287479 | hadcm3n_ym4w_1980_40_007833183_0 | 362,880 | 743,554 | 2.0490 |
| 05 Apr 2012 22:09:29 | 1185009 | 14287479 | hadcm3n_ym4w_1980_40_007833183_0 | 336,960 | 691,554 | 2.0523 |
| 05 Apr 2012 01:12:51 | 1185009 | 14287479 | hadcm3n_ym4w_1980_40_007833183_0 | 311,040 | 638,604 | 2.0531 |
| 04 Apr 2012 22:09:30 | 1185009 | 14287479 | hadcm3n_ym4w_1980_40_007833183_0 | 285,120 | 585,392 | 2.0531 |
©2024 cpdn.org