 |
|
| Name | hadcm3n_o1m7_2140_40_008268966_4 |
| Workunit | 8424090 |
| Created | 1 Feb 2013, 5:03:46 UTC |
| Sent | 1 Feb 2013, 5:05:21 UTC |
| Report deadline | 3 May 2013, 12:32:32 UTC |
| Received | 14 Mar 2013, 5:03:00 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 22 (0x00000016) Unknown error code |
| Computer ID | 1231328 |
| Run time | 23 days 7 hours 22 min 26 sec |
| CPU time | 15 days 12 hours 50 min 38 sec |
| Validate state | Invalid |
| Credit | 9,331.20 |
| Device peak FLOPS | 3.01 GFLOPS |
| Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin |
| Stderr | <core_client_version>7.0.31</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:29:15 (54808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:29:20 (54808): No heartbeat from core client for 30 sec - exiting 04:29:21 (54808): No heartbeat from core client for 30 sec - exiting 04:29:22 (54808): No heartbeat from core client for 30 sec - exiting 04:29:23 (54808): No heartbeat from core client for 30 sec - exiting 04:29:24 (54808): No heartbeat from core client for 30 sec - exiting 04:29:25 (54808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:20:54 (15639): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:20:55 (15639): No heartbeat from core client for 30 sec - exiting 02:20:56 (15639): No heartbeat from core client for 30 sec - exiting 02:20:57 (15639): No heartbeat from core client for 30 sec - exiting 02:20:58 (15639): No heartbeat from core client for 30 sec - exiting 02:20:59 (15639): No heartbeat from core client for 30 sec - exiting 02:21:00 (15639): No heartbeat from core client for 30 sec - exiting 02:21:01 (15639): No heartbeat from core client for 30 sec - exiting 02:21:02 (15639): No heartbeat from core client for 30 sec - exiting 02:21:03 (15639): No heartbeat from core client for 30 sec - exiting 02:21:04 (15639): No heartbeat from core client for 30 sec - exiting 02:21:05 (15639): No heartbeat from core client for 30 sec - exiting 02:21:06 (15639): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:06:19 (77369): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:06:25 (77369): No heartbeat from core client for 30 sec - exiting 21:06:26 (77369): No heartbeat from core client for 30 sec - exiting 21:06:27 (77369): No heartbeat from core client for 30 sec - exiting 21:06:28 (77369): No heartbeat from core client for 30 sec - exiting 21:06:29 (77369): No heartbeat from core client for 30 sec - exiting 21:06:30 (77369): No heartbeat from core client for 30 sec - exiting 03:58:18 (78606): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:58:21 (78606): No heartbeat from core client for 30 sec - exiting 03:58:22 (78606): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 10:55:45 AM No files match the supplied pattern. MainError: 10:55:45 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... 19:54:08 (7293): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:34:59 (8115): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:35:03 (8115): No heartbeat from core client for 30 sec - exiting 22:35:04 (8115): No heartbeat from core client for 30 sec - exiting 22:35:05 (8115): No heartbeat from core client for 30 sec - exiting 22:35:06 (8115): No heartbeat from core client for 30 sec - exiting 22:35:07 (8115): No heartbeat from core client for 30 sec - exiting 22:35:08 (8115): No heartbeat from core client for 30 sec - exiting 22:35:09 (8115): No heartbeat from core client for 30 sec - exiting 22:35:10 (8115): No heartbeat from core client for 30 sec - exiting 22:35:11 (8115): No heartbeat from core client for 30 sec - exiting 01:50:34 (9164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:06:47 (19391): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:06:52 (19391): No heartbeat from core client for 30 sec - exiting 18:06:53 (19391): No heartbeat from core client for 30 sec - exiting 18:06:54 (19391): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:56:27 (19915): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:06:59 (19961): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... MainError: 05:22:26 AM No files match the supplied pattern. MainError: 05:22:26 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... 08:00:31 (20026): No heartbeat from core client for 30 sec - exiting 18:39:53 (30346): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:39:54 (30346): No heartbeat from core client for 30 sec - exiting 18:39:55 (30346): No heartbeat from core client for 30 sec - exiting 18:39:56 (30346): No heartbeat from core client for 30 sec - exiting 21:30:11 (30636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... MainError: 02:34:41 PM No files match the supplied pattern. MainError: 02:34:41 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... 18:07:48 (40411): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:07:52 (40411): No heartbeat from core client for 30 sec - exiting 18:07:53 (40411): No heartbeat from core client for 30 sec - exiting 18:07:54 (40411): No heartbeat from core client for 30 sec - exiting 18:07:55 (40411): No heartbeat from core client for 30 sec - exiting 18:07:56 (40411): No heartbeat from core client for 30 sec - exiting 18:07:57 (40411): No heartbeat from core client for 30 sec - exiting 18:07:58 (40411): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 20:58:09 (40692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 04:19:01 AM No files match the supplied pattern. MainError: 04:19:01 AM No files match the supplied pattern. 06:27:35 (50313): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:29:44 (55378): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:29:45 (55378): No heartbeat from core client for 30 sec - exiting 06:29:46 (55378): No heartbeat from core client for 30 sec - exiting 06:29:47 (55378): No heartbeat from core client for 30 sec - exiting 06:29:48 (55378): No heartbeat from core client for 30 sec - exiting 06:29:49 (55378): No heartbeat from core client for 30 sec - exiting 06:29:50 (55378): No heartbeat from core client for 30 sec - exiting 06:29:51 (55378): No heartbeat from core client for 30 sec - exiting 06:29:52 (55378): No heartbeat from core client for 30 sec - exiting 06:29:53 (55378): No heartbeat from core client for 30 sec - exiting 06:29:54 (55378): No heartbeat from core client for 30 sec - exiting 06:29:55 (55378): No heartbeat from core client for 30 sec - exiting 06:29:56 (55378): No heartbeat from core client for 30 sec - exiting 06:29:57 (55378): No heartbeat from core client for 30 sec - exiting 06:29:58 (55378): No heartbeat from core client for 30 sec - exiting 06:29:59 (55378): No heartbeat from core client for 30 sec - exiting 06:30:00 (55378): No heartbeat from core client for 30 sec - exiting 06:30:01 (55378): No heartbeat from core client for 30 sec - exiting 06:30:02 (55378): No heartbeat from core client for 30 sec - exiting 06:30:03 (55378): No heartbeat from core client for 30 sec - exiting 06:30:04 (55378): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 19:01:16 (59943): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:01:18 (59943): No heartbeat from core client for 30 sec - exiting 19:01:19 (59943): No heartbeat from core client for 30 sec - exiting 19:01:20 (59943): No heartbeat from core client for 30 sec - exiting MainError: 10:20:51 AM No files match the supplied pattern. MainError: 10:20:51 AM No files match the supplied pattern. 06:55:33 (60367): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:22:39 (69459): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:53:47 (71578): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:53:50 (71578): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 20:05:21 (79024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... MainError: 05:16:59 AM No files match the supplied pattern. MainError: 05:17:00 AM No files match the supplied pattern. 05:06:19 (79864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:06:21 (79864): No heartbeat from core client for 30 sec - exiting 05:06:22 (79864): No heartbeat from core client for 30 sec - exiting 05:06:23 (79864): No heartbeat from core client for 30 sec - exiting 05:06:24 (79864): No heartbeat from core client for 30 sec - exiting 05:06:25 (79864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 03:45:36 AM No files match the supplied pattern. MainError: 03:45:36 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 02:37:27 AM No files match the supplied pattern. MainError: 02:37:27 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... 00:06:45 (32873): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:06:48 (32873): No heartbeat from core client for 30 sec - exiting 01:46:56 (35298): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:46:58 (35298): No heartbeat from core client for 30 sec - exiting 01:46:59 (35298): No heartbeat from core client for 30 sec - exiting 01:47:00 (35298): No heartbeat from core client for 30 sec - exiting 01:47:01 (35298): No heartbeat from core client for 30 sec - exiting MainError: 12:09:37 AM No files match the supplied pattern. MainError: 12:09:37 AM No files match the supplied pattern. 07:12:31 (35953): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 05:14:55 (42022): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:15:00 (42022): No heartbeat from core client for 30 sec - exiting 05:15:01 (42022): No heartbeat from core client for 30 sec - exiting 05:15:02 (42022): No heartbeat from core client for 30 sec - exiting 05:15:03 (42022): No heartbeat from core client for 30 sec - exiting 05:15:04 (42022): No heartbeat from core client for 30 sec - exiting 05:15:05 (42022): No heartbeat from core client for 30 sec - exiting 05:15:06 (42022): No heartbeat from core client for 30 sec - exiting 05:15:07 (42022): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 18:02:27 (52329): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... MainError: 07:16:32 AM No files match the supplied pattern. MainError: 07:16:32 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... 18:30:16 (63051): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:50:59 (63975): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:51:01 (63975): No heartbeat from core client for 30 sec - exiting 00:51:02 (63975): No heartbeat from core client for 30 sec - exiting 00:51:03 (63975): No heartbeat from core client for 30 sec - exiting 00:51:04 (63975): No heartbeat from core client for 30 sec - exiting 00:51:05 (63975): No heartbeat from core client for 30 sec - exiting 00:51:06 (63975): No heartbeat from core client for 30 sec - exiting 00:51:07 (63975): No heartbeat from core client for 30 sec - exiting 00:51:08 (63975): No heartbeat from core client for 30 sec - exiting 00:51:09 (63975): No heartbeat from core client for 30 sec - exiting 00:51:10 (63975): No heartbeat from core client for 30 sec - exiting 00:51:11 (63975): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 18:53:11 (73754): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Error converting file to netcdf: dataout/o1m7ka.ph11c10 Error converting file to netcdf: dataout/o1m7ka.pg11c10 Error converting file to netcdf: dataout/o1m7ka.pe11c10 MainError: 03:14:43 AM No files match the supplied pattern. MainError: 03:14:43 AM No files match the supplied pattern. BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]> |
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 14 Mar 2013 03:18:15 | 1231328 | 15577346 | hadcm3n_o1m7_2140_40_008268966_4 | 777,600 | 1,345,169 | 1.7299 |
| 12 Mar 2013 07:21:08 | 1231328 | 15577346 | hadcm3n_o1m7_2140_40_008268966_4 | 751,680 | 1,296,895 | 1.7253 |
| 10 Mar 2013 12:12:15 | 1231328 | 15577346 | hadcm3n_o1m7_2140_40_008268966_4 | 725,760 | 1,248,503 | 1.7203 |
| 09 Mar 2013 02:40:56 | 1231328 | 15577346 | hadcm3n_o1m7_2140_40_008268966_4 | 699,840 | 1,199,771 | 1.7144 |
| 07 Mar 2013 03:48:47 | 1231328 | 15577346 | hadcm3n_o1m7_2140_40_008268966_4 | 673,920 | 1,150,177 | 1.7067 |
| 05 Mar 2013 05:19:53 | 1231328 | 15577346 | hadcm3n_o1m7_2140_40_008268966_4 | 648,000 | 1,101,567 | 1.6999 |
| 03 Mar 2013 10:21:14 | 1231328 | 15577346 | hadcm3n_o1m7_2140_40_008268966_4 | 622,080 | 1,053,778 | 1.6940 |
| 02 Mar 2013 04:21:16 | 1231328 | 15577346 | hadcm3n_o1m7_2140_40_008268966_4 | 596,160 | 1,009,609 | 1.6935 |
| 28 Feb 2013 14:35:17 | 1231328 | 15577346 | hadcm3n_o1m7_2140_40_008268966_4 | 570,240 | 967,337 | 1.6964 |
| 27 Feb 2013 05:26:03 | 1231328 | 15577346 | hadcm3n_o1m7_2140_40_008268966_4 | 544,320 | 918,654 | 1.6877 |
| 25 Feb 2013 11:45:47 | 1231328 | 15577346 | hadcm3n_o1m7_2140_40_008268966_4 | 518,400 | 871,981 | 1.6821 |
| 24 Feb 2013 04:03:30 | 1231328 | 15577346 | hadcm3n_o1m7_2140_40_008268966_4 | 492,480 | 826,699 | 1.6786 |
| 22 Feb 2013 12:02:38 | 1231328 | 15577346 | hadcm3n_o1m7_2140_40_008268966_4 | 466,560 | 782,977 | 1.6782 |
| 21 Feb 2013 06:44:12 | 1231328 | 15577346 | hadcm3n_o1m7_2140_40_008268966_4 | 440,640 | 739,771 | 1.6789 |
| 19 Feb 2013 13:10:14 | 1231328 | 15577346 | hadcm3n_o1m7_2140_40_008268966_4 | 414,720 | 696,120 | 1.6785 |
| 18 Feb 2013 07:33:03 | 1231328 | 15577346 | hadcm3n_o1m7_2140_40_008268966_4 | 388,800 | 652,774 | 1.6789 |
| 16 Feb 2013 15:40:43 | 1231328 | 15577346 | hadcm3n_o1m7_2140_40_008268966_4 | 362,880 | 609,078 | 1.6785 |
| 15 Feb 2013 09:57:22 | 1231328 | 15577346 | hadcm3n_o1m7_2140_40_008268966_4 | 336,960 | 565,437 | 1.6781 |
| 14 Feb 2013 04:09:45 | 1231328 | 15577346 | hadcm3n_o1m7_2140_40_008268966_4 | 311,040 | 522,221 | 1.6790 |
| 12 Feb 2013 12:00:39 | 1231328 | 15577346 | hadcm3n_o1m7_2140_40_008268966_4 | 285,120 | 479,268 | 1.6809 |
©2024 cpdn.org