 |
|
| Name | famous_xrm6_1999_200_007097621_1 |
| Workunit | 7300921 |
| Created | 22 Mar 2011, 18:42:43 UTC |
| Sent | 22 Mar 2011, 18:42:47 UTC |
| Report deadline | 22 Jun 2011, 2:09:58 UTC |
| Received | 3 Apr 2011, 19:38:39 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 22 (0x00000016) Unknown error code |
| Computer ID | 1053245 |
| Run time | 7 days 10 hours 59 min 1 sec |
| CPU time | 7 days 9 hours 19 min 40 sec |
| Validate state | Invalid |
| Credit | 3,551.47 |
| Device peak FLOPS | 2.12 GFLOPS |
| Application version | UK Met Office FAMOUS v6.11 i686-pc-linux-gnu |
| Stderr | <core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... (1132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (1132): No heartbeat from core client for 30 sec - exiting (1132): No heartbeat from core client for 30 sec - exiting (1132): No heartbeat from core client for 30 sec - exiting (1132): No heartbeat from core client for 30 sec - exiting (1132): No heartbeat from core client for 30 sec - exiting (1132): No heartbeat from core client for 30 sec - exiting (1132): No heartbeat from core client for 30 sec - exiting (1132): No heartbeat from core client for 30 sec - exiting (1132): No heartbeat from core client for 30 sec - exiting (1132): No heartbeat from core client for 30 sec - exiting (1132): No heartbeat from core client for 30 sec - exiting (1132): No heartbeat from core client for 30 sec - exiting (2955): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (3008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (3029): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (3042): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (3068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (3095): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (3095): No heartbeat from core client for 30 sec - exiting (3095): No heartbeat from core client for 30 sec - exiting (3095): No heartbeat from core client for 30 sec - exiting (3095): No heartbeat from core client for 30 sec - exiting (3141): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (3159): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (3159): No heartbeat from core client for 30 sec - exiting (3159): No heartbeat from core client for 30 sec - exiting BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 (3358): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 (3375): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (3375): No heartbeat from core client for 30 sec - exiting (3375): No heartbeat from core client for 30 sec - exiting (3375): No heartbeat from core client for 30 sec - exiting (3375): No heartbeat from core client for 30 sec - exiting (3375): No heartbeat from core client for 30 sec - exiting (3600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (3658): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 (7645): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (10023): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (10054): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (10101): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (10124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (10124): No heartbeat from core client for 30 sec - exiting (10124): No heartbeat from core client for 30 sec - exiting (10124): No heartbeat from core client for 30 sec - exiting (10124): No heartbeat from core client for 30 sec - exiting (10372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (10398): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (10672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (10702): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (10739): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (10789): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (10806): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (10862): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (28425): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (28519): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (28540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (28582): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (28625): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (735): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (735): No heartbeat from core client for 30 sec - exiting (735): No heartbeat from core client for 30 sec - exiting (735): No heartbeat from core client for 30 sec - exiting (735): No heartbeat from core client for 30 sec - exiting (735): No heartbeat from core client for 30 sec - exiting (802): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (818): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (878): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... (1097): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (1097): No heartbeat from core client for 30 sec - exiting (1097): No heartbeat from core client for 30 sec - exiting (1097): No heartbeat from core client for 30 sec - exiting (1097): No heartbeat from core client for 30 sec - exiting (1125): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (1139): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (1139): No heartbeat from core client for 30 sec - exiting (1139): No heartbeat from core client for 30 sec - exiting (1139): No heartbeat from core client for 30 sec - exiting (1139): No heartbeat from core client for 30 sec - exiting (1139): No heartbeat from core client for 30 sec - exiting (1139): No heartbeat from core client for 30 sec - exiting (1139): No heartbeat from core client for 30 sec - exiting (1139): No heartbeat from core client for 30 sec - exiting (1139): No heartbeat from core client for 30 sec - exiting (1139): No heartbeat from core client for 30 sec - exiting (1139): No heartbeat from core client for 30 sec - exiting (1139): No heartbeat from core client for 30 sec - exiting (1139): No heartbeat from core client for 30 sec - exiting (1139): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (6583): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6990): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7014): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting (7014): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... (7080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (11863): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (12280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (12302): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (12302): No heartbeat from core client for 30 sec - exiting (12302): No heartbeat from core client for 30 sec - exiting (12302): No heartbeat from core client for 30 sec - exiting (12302): No heartbeat from core client for 30 sec - exiting (12302): No heartbeat from core client for 30 sec - exiting (12302): No heartbeat from core client for 30 sec - exiting (12347): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (12347): No heartbeat from core client for 30 sec - exiting (12384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (12384): No heartbeat from core client for 30 sec - exiting (12384): No heartbeat from core client for 30 sec - exiting (12384): No heartbeat from core client for 30 sec - exiting (12384): No heartbeat from core client for 30 sec - exiting (12593): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (12623): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (12623): No heartbeat from core client for 30 sec - exiting (12623): No heartbeat from core client for 30 sec - exiting (12623): No heartbeat from core client for 30 sec - exiting (12623): No heartbeat from core client for 30 sec - exiting (12623): No heartbeat from core client for 30 sec - exiting (12858): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (12887): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (12887): No heartbeat from core client for 30 sec - exiting (12887): No heartbeat from core client for 30 sec - exiting (12887): No heartbeat from core client for 30 sec - exiting (12887): No heartbeat from core client for 30 sec - exiting (12887): No heartbeat from core client for 30 sec - exiting (12931): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (18992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (18992): No heartbeat from core client for 30 sec - exiting (18992): No heartbeat from core client for 30 sec - exiting (18992): No heartbeat from core client for 30 sec - exiting (18992): No heartbeat from core client for 30 sec - exiting (19088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (19113): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (19167): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (24073): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24127): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24203): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24211): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24493): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24493): No heartbeat from core client for 30 sec - exiting (24493): No heartbeat from core client for 30 sec - exiting (24571): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24873): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24873): No heartbeat from core client for 30 sec - exiting (24873): No heartbeat from core client for 30 sec - exiting (24873): No heartbeat from core client for 30 sec - exiting (24948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (29703): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (30895): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (30972): No heartbeat from core client for 30 sec - exiting (30972): No heartbeat from core client for 30 sec - exiting (30972): No heartbeat from core client for 30 sec - exiting (30972): No heartbeat from core client for 30 sec - exiting (30972): No heartbeat from core client for 30 sec - exiting (30972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (31025): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (31064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (31115): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (31146): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (31146): No heartbeat from core client for 30 sec - exiting (31146): No heartbeat from core client for 30 sec - exiting (31146): No heartbeat from core client for 30 sec - exiting (31146): No heartbeat from core client for 30 sec - exiting (31146): No heartbeat from core client for 30 sec - exiting (31146): No heartbeat from core client for 30 sec - exiting (31146): No heartbeat from core client for 30 sec - exiting (31146): No heartbeat from core client for 30 sec - exiting (31146): No heartbeat from core client for 30 sec - exiting (31146): No heartbeat from core client for 30 sec - exiting (31146): No heartbeat from core client for 30 sec - exiting (31146): No heartbeat from core client for 30 sec - exiting (31208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (4166): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (4224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (4317): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (4400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (4400): No heartbeat from core client for 30 sec - exiting (4400): No heartbeat from core client for 30 sec - exiting (4400): No heartbeat from core client for 30 sec - exiting (4400): No heartbeat from core client for 30 sec - exiting (4400): No heartbeat from core client for 30 sec - exiting (4529): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (4591): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (4632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (4632): No heartbeat from core client for 30 sec - exiting (4632): No heartbeat from core client for 30 sec - exiting (4632): No heartbeat from core client for 30 sec - exiting (4632): No heartbeat from core client for 30 sec - exiting (4879): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (4879): No heartbeat from core client for 30 sec - exiting (4879): No heartbeat from core client for 30 sec - exiting (4879): No heartbeat from core client for 30 sec - exiting (4879): No heartbeat from core client for 30 sec - exiting (4879): No heartbeat from core client for 30 sec - exiting (4879): No heartbeat from core client for 30 sec - exiting (4879): No heartbeat from core client for 30 sec - exiting (4879): No heartbeat from core client for 30 sec - exiting (4929): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (4968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (4968): No heartbeat from core client for 30 sec - exiting (4968): No heartbeat from core client for 30 sec - exiting (4968): No heartbeat from core client for 30 sec - exiting (4968): No heartbeat from core client for 30 sec - exiting (4968): No heartbeat from core client for 30 sec - exiting (5257): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( (5377): called boinc_finish </stderr_txt> ]]> |
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 03 Apr 2011 16:59:46 | 1053245 | 12684022 | famous_xrm6_1999_200_007097621_1 | 1,076,426 | 632,183 | 0.5873 |
| 03 Apr 2011 15:20:47 | 1053245 | 12684022 | famous_xrm6_1999_200_007097621_1 | 1,067,066 | 626,592 | 0.5872 |
| 03 Apr 2011 13:33:43 | 1053245 | 12684022 | famous_xrm6_1999_200_007097621_1 | 1,057,706 | 621,036 | 0.5872 |
| 03 Apr 2011 11:46:49 | 1053245 | 12684022 | famous_xrm6_1999_200_007097621_1 | 1,048,346 | 615,425 | 0.5870 |
| 03 Apr 2011 08:28:44 | 1053245 | 12684022 | famous_xrm6_1999_200_007097621_1 | 1,038,986 | 609,848 | 0.5870 |
| 03 Apr 2011 06:56:10 | 1053245 | 12684022 | famous_xrm6_1999_200_007097621_1 | 1,029,626 | 604,287 | 0.5869 |
| 03 Apr 2011 05:30:09 | 1053245 | 12684022 | famous_xrm6_1999_200_007097621_1 | 1,020,266 | 598,725 | 0.5868 |
| 03 Apr 2011 00:00:34 | 1053245 | 12684022 | famous_xrm6_1999_200_007097621_1 | 1,010,906 | 593,231 | 0.5868 |
| 02 Apr 2011 22:29:14 | 1053245 | 12684022 | famous_xrm6_1999_200_007097621_1 | 1,001,546 | 587,761 | 0.5869 |
| 02 Apr 2011 20:57:38 | 1053245 | 12684022 | famous_xrm6_1999_200_007097621_1 | 992,186 | 582,227 | 0.5868 |
| 02 Apr 2011 19:27:05 | 1053245 | 12684022 | famous_xrm6_1999_200_007097621_1 | 982,826 | 576,712 | 0.5868 |
| 02 Apr 2011 12:18:00 | 1053245 | 12684022 | famous_xrm6_1999_200_007097621_1 | 973,466 | 571,225 | 0.5868 |
| 02 Apr 2011 10:24:54 | 1053245 | 12684022 | famous_xrm6_1999_200_007097621_1 | 964,106 | 565,738 | 0.5868 |
| 02 Apr 2011 08:53:06 | 1053245 | 12684022 | famous_xrm6_1999_200_007097621_1 | 954,746 | 560,234 | 0.5868 |
| 02 Apr 2011 07:16:06 | 1053245 | 12684022 | famous_xrm6_1999_200_007097621_1 | 945,386 | 554,687 | 0.5867 |
| 02 Apr 2011 05:43:46 | 1053245 | 12684022 | famous_xrm6_1999_200_007097621_1 | 936,026 | 549,143 | 0.5867 |
| 02 Apr 2011 04:11:05 | 1053245 | 12684022 | famous_xrm6_1999_200_007097621_1 | 926,666 | 543,672 | 0.5867 |
| 02 Apr 2011 02:33:59 | 1053245 | 12684022 | famous_xrm6_1999_200_007097621_1 | 917,306 | 538,175 | 0.5867 |
| 02 Apr 2011 00:46:30 | 1053245 | 12684022 | famous_xrm6_1999_200_007097621_1 | 907,946 | 532,614 | 0.5866 |
| 01 Apr 2011 23:14:03 | 1053245 | 12684022 | famous_xrm6_1999_200_007097621_1 | 898,586 | 527,100 | 0.5866 |
©2024 cpdn.org