 |
|
| Name | hadcm3n_4fze_1940_40_008306437_0 |
| Workunit | 8457572 |
| Created | 7 Feb 2013, 9:53:57 UTC |
| Sent | 7 Feb 2013, 9:58:53 UTC |
| Report deadline | 9 May 2013, 17:26:04 UTC |
| Received | 4 Mar 2013, 11:38:21 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 193 (0x000000C1) EXIT_SIGNAL |
| Computer ID | 1120190 |
| Run time | 15 days 12 hours 8 min 21 sec |
| CPU time | 15 days 9 hours 52 min 48 sec |
| Validate state | Invalid |
| Credit | 9,331.20 |
| Device peak FLOPS | 2.47 GFLOPS |
| Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
| Stderr | <core_client_version>7.0.27</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:18:44 (2433): No heartbeat from core client for 30 sec - exiting 15:18:49 (2433): No heartbeat from core client for 30 sec - exiting 15:18:52 (2433): No heartbeat from core client for 30 sec - exiting 15:18:54 (2433): No heartbeat from core client for 30 sec - exiting 15:18:55 (2433): No heartbeat from core client for 30 sec - exiting 15:18:56 (2433): No heartbeat from core client for 30 sec - exiting 15:18:57 (2433): No heartbeat from core client for 30 sec - exiting 15:18:58 (2433): No heartbeat from core client for 30 sec - exiting 15:19:00 (2433): No heartbeat from core client for 30 sec - exiting 15:19:01 (2433): No heartbeat from core client for 30 sec - exiting 15:19:02 (2433): No heartbeat from core client for 30 sec - exiting 15:19:03 (2433): No heartbeat from core client for 30 sec - exiting 15:19:04 (2433): No heartbeat from core client for 30 sec - exiting 15:19:05 (2433): No heartbeat from core client for 30 sec - exiting 15:19:06 (2433): No heartbeat from core client for 30 sec - exiting 15:19:07 (2433): No heartbeat from core client for 30 sec - exiting 15:19:08 (2433): No heartbeat from core client for 30 sec - exiting 15:19:09 (2433): No heartbeat from core client for 30 sec - exiting 15:19:10 (2433): No heartbeat from core client for 30 sec - exiting 15:19:11 (2433): No heartbeat from core client for 30 sec - exiting 15:19:14 (2433): No heartbeat from core client for 30 sec - exiting 15:19:15 (2433): No heartbeat from core client for 30 sec - exiting 15:19:16 (2433): No heartbeat from core client for 30 sec - exiting 15:19:17 (2433): No heartbeat from core client for 30 sec - exiting 15:19:18 (2433): No heartbeat from core client for 30 sec - exiting 15:19:19 (2433): No heartbeat from core client for 30 sec - exiting 15:19:20 (2433): No heartbeat from core client for 30 sec - exiting 15:19:21 (2433): No heartbeat from core client for 30 sec - exiting 15:19:22 (2433): No heartbeat from core client for 30 sec - exiting 15:19:23 (2433): No heartbeat from core client for 30 sec - exiting 15:19:24 (2433): No heartbeat from core client for 30 sec - exiting 15:19:25 (2433): No heartbeat from core client for 30 sec - exiting 15:19:26 (2433): No heartbeat from core client for 30 sec - exiting 15:19:27 (2433): No heartbeat from core client for 30 sec - exiting 15:19:28 (2433): No heartbeat from core client for 30 sec - exiting 15:19:29 (2433): No heartbeat from core client for 30 sec - exiting 15:19:30 (2433): No heartbeat from core client for 30 sec - exiting 15:19:37 (2433): No heartbeat from core client for 30 sec - exiting 15:19:38 (2433): No heartbeat from core client for 30 sec - exiting 15:19:39 (2433): No heartbeat from core client for 30 sec - exiting 15:19:40 (2433): No heartbeat from core client for 30 sec - exiting 15:19:41 (2433): No heartbeat from core client for 30 sec - exiting 15:19:42 (2433): No heartbeat from core client for 30 sec - exiting 15:19:43 (2433): No heartbeat from core client for 30 sec - exiting 15:19:44 (2433): No heartbeat from core client for 30 sec - exiting 15:19:45 (2433): No heartbeat from core client for 30 sec - exiting 15:19:46 (2433): No heartbeat from core client for 30 sec - exiting 15:19:50 (2433): No heartbeat from core client for 30 sec - exiting 15:19:51 (2433): No heartbeat from core client for 30 sec - exiting 15:19:52 (2433): No heartbeat from core client for 30 sec - exiting 15:19:54 (2433): No heartbeat from core client for 30 sec - exiting 15:19:55 (2433): No heartbeat from core client for 30 sec - exiting 15:19:56 (2433): No heartbeat from core client for 30 sec - exiting 15:19:57 (2433): No heartbeat from core client for 30 sec - exiting 15:19:58 (2433): No heartbeat from core client for 30 sec - exiting 15:19:59 (2433): No heartbeat from core client for 30 sec - exiting 15:20:00 (2433): No heartbeat from core client for 30 sec - exiting 15:20:01 (2433): No heartbeat from core client for 30 sec - exiting 15:20:02 (2433): No heartbeat from core client for 30 sec - exiting 15:20:03 (2433): No heartbeat from core client for 30 sec - exiting 15:20:04 (2433): No heartbeat from core client for 30 sec - exiting 15:20:05 (2433): No heartbeat from core client for 30 sec - exiting 15:20:06 (2433): No heartbeat from core client for 30 sec - exiting 15:20:07 (2433): No heartbeat from core client for 30 sec - exiting 15:20:08 (2433): No heartbeat from core client for 30 sec - exiting 15:20:09 (2433): No heartbeat from core client for 30 sec - exiting 15:20:10 (2433): No heartbeat from core client for 30 sec - exiting 15:20:11 (2433): No heartbeat from core client for 30 sec - exiting 15:20:12 (2433): No heartbeat from core client for 30 sec - exiting 15:20:13 (2433): No heartbeat from core client for 30 sec - exiting 15:20:14 (2433): No heartbeat from core client for 30 sec - exiting 15:20:15 (2433): No heartbeat from core client for 30 sec - exiting 15:20:16 (2433): No heartbeat from core client for 30 sec - exiting 15:20:17 (2433): No heartbeat from core client for 30 sec - exiting 15:20:18 (2433): No heartbeat from core client for 30 sec - exiting 15:20:19 (2433): No heartbeat from core client for 30 sec - exiting 15:20:20 (2433): No heartbeat from core client for 30 sec - exiting 15:20:21 (2433): No heartbeat from core client for 30 sec - exiting 15:20:22 (2433): No heartbeat from core client for 30 sec - exiting 15:20:23 (2433): No heartbeat from core client for 30 sec - exiting 15:20:24 (2433): No heartbeat from core client for 30 sec - exiting 15:20:25 (2433): No heartbeat from core client for 30 sec - exiting 15:20:26 (2433): No heartbeat from core client for 30 sec - exiting 15:20:27 (2433): No heartbeat from core client for 30 sec - exiting 15:20:28 (2433): No heartbeat from core client for 30 sec - exiting 15:20:29 (2433): No heartbeat from core client for 30 sec - exiting 15:20:30 (2433): No heartbeat from core client for 30 sec - exiting 15:20:31 (2433): No heartbeat from core client for 30 sec - exiting 15:20:32 (2433): No heartbeat from core client for 30 sec - exiting 15:20:33 (2433): No heartbeat from core client for 30 sec - exiting 15:20:34 (2433): No heartbeat from core client for 30 sec - exiting 15:20:35 (2433): No heartbeat from core client for 30 sec - exiting 15:20:36 (2433): No heartbeat from core client for 30 sec - exiting 15:20:37 (2433): No heartbeat from core client for 30 sec - exiting 15:20:38 (2433): No heartbeat from core client for 30 sec - exiting 15:20:39 (2433): No heartbeat from core client for 30 sec - exiting 15:20:40 (2433): No heartbeat from core client for 30 sec - exiting 15:20:41 (2433): No heartbeat from core client for 30 sec - exiting 15:20:42 (2433): No heartbeat from core client for 30 sec - exiting 15:20:43 (2433): No heartbeat from core client for 30 sec - exiting 15:20:44 (2433): No heartbeat from core client for 30 sec - exiting 15:20:45 (2433): No heartbeat from core client for 30 sec - exiting 15:20:46 (2433): No heartbeat from core client for 30 sec - exiting 15:20:47 (2433): No heartbeat from core client for 30 sec - exiting 15:20:48 (2433): No heartbeat from core client for 30 sec - exiting 15:20:49 (2433): No heartbeat from core client for 30 sec - exiting 15:20:50 (2433): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:22:21 (2633): No heartbeat from core client for 30 sec - exiting 17:22:23 (2633): No heartbeat from core client for 30 sec - exiting 17:22:24 (2633): No heartbeat from core client for 30 sec - exiting 17:22:25 (2633): No heartbeat from core client for 30 sec - exiting 17:22:26 (2633): No heartbeat from core client for 30 sec - exiting 17:22:27 (2633): No heartbeat from core client for 30 sec - exiting 17:22:28 (2633): No heartbeat from core client for 30 sec - exiting 17:22:29 (2633): No heartbeat from core client for 30 sec - exiting 17:22:30 (2633): No heartbeat from core client for 30 sec - exiting 17:22:31 (2633): No heartbeat from core client for 30 sec - exiting 17:22:32 (2633): No heartbeat from core client for 30 sec - exiting 17:22:33 (2633): No heartbeat from core client for 30 sec - exiting 17:22:34 (2633): No heartbeat from core client for 30 sec - exiting 17:22:37 (2633): No heartbeat from core client for 30 sec - exiting 17:22:38 (2633): No heartbeat from core client for 30 sec - exiting 17:22:39 (2633): No heartbeat from core client for 30 sec - exiting 17:22:40 (2633): No heartbeat from core client for 30 sec - exiting 17:22:41 (2633): No heartbeat from core client for 30 sec - exiting 17:22:42 (2633): No heartbeat from core client for 30 sec - exiting 17:22:43 (2633): No heartbeat from core client for 30 sec - exiting 17:22:44 (2633): No heartbeat from core client for 30 sec - exiting 17:22:45 (2633): No heartbeat from core client for 30 sec - exiting 17:22:46 (2633): No heartbeat from core client for 30 sec - exiting 17:22:47 (2633): No heartbeat from core client for 30 sec - exiting 17:22:48 (2633): No heartbeat from core client for 30 sec - exiting 17:22:49 (2633): No heartbeat from core client for 30 sec - exiting 17:22:50 (2633): No heartbeat from core client for 30 sec - exiting 17:22:51 (2633): No heartbeat from core client for 30 sec - exiting 17:22:52 (2633): No heartbeat from core client for 30 sec - exiting 17:22:54 (2633): No heartbeat from core client for 30 sec - exiting 17:22:55 (2633): No heartbeat from core client for 30 sec - exiting 17:22:56 (2633): No heartbeat from core client for 30 sec - exiting 17:22:58 (2633): No heartbeat from core client for 30 sec - exiting 17:22:59 (2633): No heartbeat from core client for 30 sec - exiting 17:23:00 (2633): No heartbeat from core client for 30 sec - exiting 17:23:01 (2633): No heartbeat from core client for 30 sec - exiting 17:23:02 (2633): No heartbeat from core client for 30 sec - exiting 17:23:03 (2633): No heartbeat from core client for 30 sec - exiting 17:23:04 (2633): No heartbeat from core client for 30 sec - exiting 17:23:05 (2633): No heartbeat from core client for 30 sec - exiting 17:23:06 (2633): No heartbeat from core client for 30 sec - exiting 17:23:07 (2633): No heartbeat from core client for 30 sec - exiting 17:23:17 (2633): No heartbeat from core client for 30 sec - exiting 17:23:19 (2633): No heartbeat from core client for 30 sec - exiting 17:23:21 (2633): No heartbeat from core client for 30 sec - exiting 17:23:22 (2633): No heartbeat from core client for 30 sec - exiting 17:23:24 (2633): No heartbeat from core client for 30 sec - exiting 17:23:28 (2633): No heartbeat from core client for 30 sec - exiting 17:23:30 (2633): No heartbeat from core client for 30 sec - exiting 17:23:31 (2633): No heartbeat from core client for 30 sec - exiting 17:23:32 (2633): No heartbeat from core client for 30 sec - exiting 17:23:33 (2633): No heartbeat from core client for 30 sec - exiting 17:23:34 (2633): No heartbeat from core client for 30 sec - exiting 17:23:35 (2633): No heartbeat from core client for 30 sec - exiting 17:23:36 (2633): No heartbeat from core client for 30 sec - exiting 17:23:37 (2633): No heartbeat from core client for 30 sec - exiting 17:23:38 (2633): No heartbeat from core client for 30 sec - exiting 17:23:39 (2633): No heartbeat from core client for 30 sec - exiting 17:23:40 (2633): No heartbeat from core client for 30 sec - exiting 17:23:41 (2633): No heartbeat from core client for 30 sec - exiting 17:23:42 (2633): No heartbeat from core client for 30 sec - exiting 17:23:43 (2633): No heartbeat from core client for 30 sec - exiting 17:23:44 (2633): No heartbeat from core client for 30 sec - exiting 17:23:45 (2633): No heartbeat from core client for 30 sec - exiting 17:23:46 (2633): No heartbeat from core client for 30 sec - exiting 17:23:47 (2633): No heartbeat from core client for 30 sec - exiting 17:23:48 (2633): No heartbeat from core client for 30 sec - exiting 17:23:49 (2633): No heartbeat from core client for 30 sec - exiting 17:23:50 (2633): No heartbeat from core client for 30 sec - exiting 17:23:51 (2633): No heartbeat from core client for 30 sec - exiting 17:23:52 (2633): No heartbeat from core client for 30 sec - exiting 17:23:53 (2633): No heartbeat from core client for 30 sec - exiting 17:23:54 (2633): No heartbeat from core client for 30 sec - exiting 17:23:55 (2633): No heartbeat from core client for 30 sec - exiting 17:23:56 (2633): No heartbeat from core client for 30 sec - exiting 17:23:57 (2633): No heartbeat from core client for 30 sec - exiting 17:23:58 (2633): No heartbeat from core client for 30 sec - exiting 17:23:59 (2633): No heartbeat from core client for 30 sec - exiting 17:24:00 (2633): No heartbeat from core client for 30 sec - exiting 17:24:01 (2633): No heartbeat from core client for 30 sec - exiting 17:24:02 (2633): No heartbeat from core client for 30 sec - exiting 17:24:03 (2633): No heartbeat from core client for 30 sec - exiting 17:24:04 (2633): No heartbeat from core client for 30 sec - exiting 17:24:05 (2633): No heartbeat from core client for 30 sec - exiting 17:24:06 (2633): No heartbeat from core client for 30 sec - exiting 17:24:07 (2633): No heartbeat from core client for 30 sec - exiting 17:24:08 (2633): No heartbeat from core client for 30 sec - exiting 17:24:09 (2633): No heartbeat from core client for 30 sec - exiting 17:24:10 (2633): No heartbeat from core client for 30 sec - exiting 17:24:11 (2633): No heartbeat from core client for 30 sec - exiting 17:24:12 (2633): No heartbeat from core client for 30 sec - exiting 17:24:13 (2633): No heartbeat from core client for 30 sec - exiting 17:24:14 (2633): No heartbeat from core client for 30 sec - exiting 17:24:15 (2633): No heartbeat from core client for 30 sec - exiting 17:24:16 (2633): No heartbeat from core client for 30 sec - exiting 17:24:17 (2633): No heartbeat from core client for 30 sec - exiting 17:24:18 (2633): No heartbeat from core client for 30 sec - exiting 17:24:19 (2633): No heartbeat from core client for 30 sec - exiting 17:24:20 (2633): No heartbeat from core client for 30 sec - exiting 17:24:21 (2633): No heartbeat from core client for 30 sec - exiting 17:24:22 (2633): No heartbeat from core client for 30 sec - exiting 17:24:23 (2633): No heartbeat from core client for 30 sec - exiting 17:24:24 (2633): No heartbeat from core client for 30 sec - exiting 17:24:25 (2633): No heartbeat from core client for 30 sec - exiting 17:24:26 (2633): No heartbeat from core client for 30 sec - exiting 17:24:27 (2633): No heartbeat from core client for 30 sec - exiting 17:24:28 (2633): No heartbeat from core client for 30 sec - exiting 17:24:29 (2633): No heartbeat from core client for 30 sec - exiting 17:24:30 (2633): No heartbeat from core client for 30 sec - exiting 17:24:34 (2633): No heartbeat from core client for 30 sec - exiting 17:24:35 (2633): No heartbeat from core client for 30 sec - exiting 17:24:36 (2633): No heartbeat from core client for 30 sec - exiting 17:24:37 (2633): No heartbeat from core client for 30 sec - exiting 17:24:38 (2633): No heartbeat from core client for 30 sec - exiting 17:24:39 (2633): No heartbeat from core client for 30 sec - exiting 17:24:40 (2633): No heartbeat from core client for 30 sec - exiting 17:24:41 (2633): No heartbeat from core client for 30 sec - exiting 17:24:42 (2633): No heartbeat from core client for 30 sec - exiting 17:24:43 (2633): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:00:36 (3766): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:00:39 (3766): No heartbeat from core client for 30 sec - exiting 17:00:40 (3766): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:59:17 (2505): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:59:20 (2505): No heartbeat from core client for 30 sec - exiting 08:59:21 (2505): No heartbeat from core client for 30 sec - exiting 08:59:22 (2505): No heartbeat from core client for 30 sec - exiting 08:59:23 (2505): No heartbeat from core client for 30 sec - exiting 08:59:24 (2505): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:46:14 (2661): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:56:54 (2436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:57:01 (2436): No heartbeat from core client for 30 sec - exiting 09:57:02 (2436): No heartbeat from core client for 30 sec - exiting 09:57:03 (2436): No heartbeat from core client for 30 sec - exiting 09:57:04 (2436): No heartbeat from core client for 30 sec - exiting 09:57:05 (2436): No heartbeat from core client for 30 sec - exiting 09:57:06 (2436): No heartbeat from core client for 30 sec - exiting 09:57:11 (2436): No heartbeat from core client for 30 sec - exiting 09:57:12 (2436): No heartbeat from core client for 30 sec - exiting 09:57:13 (2436): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (14 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf776b400] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x806c0d5] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x806e5f2] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8072509] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8077f47] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x80781a3] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e1b] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf745f4d3] Exiting... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2404, selfPID=2404, iMonCtr=1 </stderr_txt> ]]> |
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 04 Mar 2013 11:39:17 | 1120190 | 15592755 | hadcm3n_4fze_1940_40_008306437_0 | 777,600 | 1,331,562 | 1.7124 |
| 28 Feb 2013 15:25:28 | 1120190 | 15592755 | hadcm3n_4fze_1940_40_008306437_0 | 751,680 | 1,286,436 | 1.7114 |
| 28 Feb 2013 02:11:00 | 1120190 | 15592755 | hadcm3n_4fze_1940_40_008306437_0 | 725,760 | 1,240,458 | 1.7092 |
| 27 Feb 2013 13:40:14 | 1120190 | 15592755 | hadcm3n_4fze_1940_40_008306437_0 | 699,840 | 1,194,720 | 1.7071 |
| 26 Feb 2013 10:00:41 | 1120190 | 15592755 | hadcm3n_4fze_1940_40_008306437_0 | 673,920 | 1,149,650 | 1.7059 |
| 22 Feb 2013 12:40:04 | 1120190 | 15592755 | hadcm3n_4fze_1940_40_008306437_0 | 648,000 | 1,104,579 | 1.7046 |
| 21 Feb 2013 08:04:30 | 1120190 | 15592755 | hadcm3n_4fze_1940_40_008306437_0 | 622,080 | 1,059,687 | 1.7035 |
| 20 Feb 2013 03:42:03 | 1120190 | 15592755 | hadcm3n_4fze_1940_40_008306437_0 | 596,160 | 1,014,959 | 1.7025 |
| 19 Feb 2013 15:15:49 | 1120190 | 15592755 | hadcm3n_4fze_1940_40_008306437_0 | 570,240 | 970,195 | 1.7014 |
| 18 Feb 2013 11:38:56 | 1120190 | 15592755 | hadcm3n_4fze_1940_40_008306437_0 | 544,320 | 928,357 | 1.7055 |
| 18 Feb 2013 01:01:31 | 1120190 | 15592755 | hadcm3n_4fze_1940_40_008306437_0 | 518,400 | 890,147 | 1.7171 |
| 17 Feb 2013 14:25:24 | 1120190 | 15592755 | hadcm3n_4fze_1940_40_008306437_0 | 492,480 | 852,178 | 1.7304 |
| 17 Feb 2013 03:25:56 | 1120190 | 15592755 | hadcm3n_4fze_1940_40_008306437_0 | 466,560 | 812,944 | 1.7424 |
| 16 Feb 2013 14:45:33 | 1120190 | 15592755 | hadcm3n_4fze_1940_40_008306437_0 | 440,640 | 767,618 | 1.7421 |
| 16 Feb 2013 03:02:46 | 1120190 | 15592755 | hadcm3n_4fze_1940_40_008306437_0 | 414,720 | 722,559 | 1.7423 |
| 15 Feb 2013 07:36:55 | 1120190 | 15592755 | hadcm3n_4fze_1940_40_008306437_0 | 388,800 | 677,076 | 1.7415 |
| 14 Feb 2013 19:06:11 | 1120190 | 15592755 | hadcm3n_4fze_1940_40_008306437_0 | 362,880 | 630,507 | 1.7375 |
| 14 Feb 2013 05:50:06 | 1120190 | 15592755 | hadcm3n_4fze_1940_40_008306437_0 | 336,960 | 585,364 | 1.7372 |
| 13 Feb 2013 17:16:08 | 1120190 | 15592755 | hadcm3n_4fze_1940_40_008306437_0 | 311,040 | 540,492 | 1.7377 |
| 13 Feb 2013 04:45:31 | 1120190 | 15592755 | hadcm3n_4fze_1940_40_008306437_0 | 285,120 | 495,707 | 1.7386 |
©2024 cpdn.org