Name | famous_v8ec_599_200_006696650_6 |
Workunit | 6899903 |
Created | 10 Mar 2011, 21:46:31 UTC |
Sent | 10 Mar 2011, 21:46:39 UTC |
Report deadline | 10 Jun 2011, 5:13:50 UTC |
Received | 14 Mar 2011, 14:59:05 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 22 (0x00000016) Unknown error code |
Computer ID | 1115458 |
Run time | 2 days 13 hours 18 min 33 sec |
CPU time | 2 days 12 hours 33 min 7 sec |
Validate state | Invalid |
Credit | 2,841.20 |
Device peak FLOPS | 2.46 GFLOPS |
Application version | UK Met Office FAMOUS v6.11 i686-apple-darwin |
Stderr | <core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.6 build 10J567 Thu Mar 10 23:58:10 2011 0 0x0048fdcf PrintBacktrace (in famous_um_6.11_i686-apple-darwin) + 1221 1 0x0049054a boinc_catch_signal (in famous_um_6.11_i686-apple-darwin) + 474 2 0x93f8546b 0x93f8546b 3 0xffffffff 0xffffffff 4 0x0134e6b3 0x134e6b3 5 0x0134d44f 0x134d44f 6 0x002eeac6 readcntl (in famous_um_6.11_i686-apple-darwin) + 2598 7 0x003f55ea um_setup (in famous_um_6.11_i686-apple-darwin) + 458 8 0x00452abd um_shell (in famous_um_6.11_i686-apple-darwin) + 11429 9 0x004698c0 main (in famous_um_6.11_i686-apple-darwin) + 1112 10 0x000026b6 _start (in famous_um_6.11_i686-apple-darwin) + 216 11 0x000025dd start (in famous_um_6.11_i686-apple-darwin) + 41 12 0x00000003 0x00000003 (in famous_um_6.11_i686-apple-darwin) Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc41c edx: 0x93f1f0fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc458 esp: 0xbfffc41c ss: 0x0000001f efl: 0x00000206 eip: 0x93f1f0fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v8ec_599_200_006696650/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v8ec_599_200_006696650/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v8ec_599_200_006696650/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v8ec_599_200_006696650/lib/libirc.dylib 0x93f1e000 - 0x940c5fff /usr/lib/libSystem.B.dylib 0x964da000 - 0x964e8fff /usr/lib/libz.1.dylib 0x9749a000 - 0x9749dfff /usr/lib/system/libmathCommon.A.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10780, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.6 build 10J567 Fri Mar 11 00:07:51 2011 0 0x0048fdcf PrintBacktrace (in famous_um_6.11_i686-apple-darwin) + 1221 1 0x0049054a boinc_catch_signal (in famous_um_6.11_i686-apple-darwin) + 474 2 0x93f8546b 0x93f8546b 3 0xffffffff 0xffffffff 4 0x0134e6b3 0x134e6b3 5 0x0134d44f 0x134d44f 6 0x002eeac6 readcntl (in famous_um_6.11_i686-apple-darwin) + 2598 7 0x003f55ea um_setup (in famous_um_6.11_i686-apple-darwin) + 458 8 0x00452abd um_shell (in famous_um_6.11_i686-apple-darwin) + 11429 9 0x004698c0 main (in famous_um_6.11_i686-apple-darwin) + 1112 10 0x000026b6 _start (in famous_um_6.11_i686-apple-darwin) + 216 11 0x000025dd start (in famous_um_6.11_i686-apple-darwin) + 41 12 0x00000003 0x00000003 (in famous_um_6.11_i686-apple-darwin) Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc41c edx: 0x93f1f0fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc458 esp: 0xbfffc41c ss: 0x0000001f efl: 0x00000206 eip: 0x93f1f0fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v8ec_599_200_006696650/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v8ec_599_200_006696650/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v8ec_599_200_006696650/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v8ec_599_200_006696650/lib/libirc.dylib 0x93f1e000 - 0x940c5fff /usr/lib/libSystem.B.dylib 0x964da000 - 0x964e8fff /usr/lib/libz.1.dylib 0x9749a000 - 0x9749dfff /usr/lib/system/libmathCommon.A.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10920, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.6 build 10J567 Fri Mar 11 14:06:45 2011 0 0x0048fdcf PrintBacktrace (in famous_um_6.11_i686-apple-darwin) + 1221 1 0x0049054a boinc_catch_signal (in famous_um_6.11_i686-apple-darwin) + 474 2 0x913e746b 0x913e746b 3 0xffffffff 0xffffffff 4 0x0134e6b3 0x134e6b3 5 0x0134d44f 0x134d44f 6 0x002eeac6 readcntl (in famous_um_6.11_i686-apple-darwin) + 2598 7 0x003f55ea um_setup (in famous_um_6.11_i686-apple-darwin) + 458 8 0x00452abd um_shell (in famous_um_6.11_i686-apple-darwin) + 11429 9 0x004698c0 main (in famous_um_6.11_i686-apple-darwin) + 1112 10 0x000026b6 _start (in famous_um_6.11_i686-apple-darwin) + 216 11 0x000025dd start (in famous_um_6.11_i686-apple-darwin) + 41 Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc41c edx: 0x913810fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc458 esp: 0xbfffc41c ss: 0x0000001f efl: 0x00000206 eip: 0x913810fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v8ec_599_200_006696650/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v8ec_599_200_006696650/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v8ec_599_200_006696650/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v8ec_599_200_006696650/lib/libirc.dylib 0x91380000 - 0x91527fff /usr/lib/libSystem.B.dylib 0x919fc000 - 0x91a0afff /usr/lib/libz.1.dylib 0x91aee000 - 0x91af1fff /usr/lib/system/libmathCommon.A.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2879, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.6 build 10J567 Fri Mar 11 17:45:41 2011 0 0x0048fdcf PrintBacktrace (in famous_um_6.11_i686-apple-darwin) + 1221 1 0x0049054a boinc_catch_signal (in famous_um_6.11_i686-apple-darwin) + 474 2 0x913e746b 0x913e746b 3 0xffffffff 0xffffffff 4 0x0134e6b3 0x134e6b3 5 0x0134d44f 0x134d44f 6 0x002eeac6 readcntl (in famous_um_6.11_i686-apple-darwin) + 2598 7 0x003f55ea um_setup (in famous_um_6.11_i686-apple-darwin) + 458 8 0x00452abd um_shell (in famous_um_6.11_i686-apple-darwin) + 11429 9 0x004698c0 main (in famous_um_6.11_i686-apple-darwin) + 1112 10 0x000026b6 _start (in famous_um_6.11_i686-apple-darwin) + 216 11 0x000025dd start (in famous_um_6.11_i686-apple-darwin) + 41 Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc41c edx: 0x913810fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc458 esp: 0xbfffc41c ss: 0x0000001f efl: 0x00000206 eip: 0x913810fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v8ec_599_200_006696650/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v8ec_599_200_006696650/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v8ec_599_200_006696650/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v8ec_599_200_006696650/lib/libirc.dylib 0x91380000 - 0x91527fff /usr/lib/libSystem.B.dylib 0x919fc000 - 0x91a0afff /usr/lib/libz.1.dylib 0x91aee000 - 0x91af1fff /usr/lib/system/libmathCommon.A.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6576, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (17261): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.6 build 10J567 Sat Mar 12 21:16:50 2011 0 0x0048fdcf PrintBacktrace (in famous_um_6.11_i686-apple-darwin) + 1221 1 0x0049054a boinc_catch_signal (in famous_um_6.11_i686-apple-darwin) + 474 2 0x913e746b 0x913e746b 3 0xffffffff 0xffffffff 4 0x0134e6b3 0x134e6b3 5 0x0134d44f 0x134d44f 6 0x002eeac6 readcntl (in famous_um_6.11_i686-apple-darwin) + 2598 7 0x003f55ea um_setup (in famous_um_6.11_i686-apple-darwin) + 458 8 0x00452abd um_shell (in famous_um_6.11_i686-apple-darwin) + 11429 9 0x004698c0 main (in famous_um_6.11_i686-apple-darwin) + 1112 10 0x000026b6 _start (in famous_um_6.11_i686-apple-darwin) + 216 11 0x000025dd start (in famous_um_6.11_i686-apple-darwin) + 41 Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc41c edx: 0x913810fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc458 esp: 0xbfffc41c ss: 0x0000001f efl: 0x00000206 eip: 0x913810fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v8ec_599_200_006696650/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v8ec_599_200_006696650/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v8ec_599_200_006696650/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v8ec_599_200_006696650/lib/libirc.dylib 0x91380000 - 0x91527fff /usr/lib/libSystem.B.dylib 0x919fc000 - 0x91a0afff /usr/lib/libz.1.dylib 0x91aee000 - 0x91af1fff /usr/lib/system/libmathCommon.A.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=21110, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( (32194): called boinc_finish </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
14 Mar 2011 14:18:41 | 1115458 | 12658515 | famous_v8ec_599_200_006696650_6 | 861,146 | 215,483 | 0.2502 |
14 Mar 2011 13:38:52 | 1115458 | 12658515 | famous_v8ec_599_200_006696650_6 | 851,786 | 213,072 | 0.2501 |
14 Mar 2011 12:58:49 | 1115458 | 12658515 | famous_v8ec_599_200_006696650_6 | 842,426 | 210,658 | 0.2501 |
14 Mar 2011 12:16:59 | 1115458 | 12658515 | famous_v8ec_599_200_006696650_6 | 833,066 | 208,246 | 0.2500 |
14 Mar 2011 11:36:20 | 1115458 | 12658515 | famous_v8ec_599_200_006696650_6 | 823,706 | 205,831 | 0.2499 |
14 Mar 2011 10:55:45 | 1115458 | 12658515 | famous_v8ec_599_200_006696650_6 | 814,346 | 203,424 | 0.2498 |
14 Mar 2011 10:10:12 | 1115458 | 12658515 | famous_v8ec_599_200_006696650_6 | 804,986 | 201,009 | 0.2497 |
14 Mar 2011 09:29:29 | 1115458 | 12658515 | famous_v8ec_599_200_006696650_6 | 795,626 | 198,597 | 0.2496 |
14 Mar 2011 08:48:40 | 1115458 | 12658515 | famous_v8ec_599_200_006696650_6 | 786,266 | 196,185 | 0.2495 |
14 Mar 2011 08:07:41 | 1115458 | 12658515 | famous_v8ec_599_200_006696650_6 | 776,906 | 193,771 | 0.2494 |
14 Mar 2011 07:26:55 | 1115458 | 12658515 | famous_v8ec_599_200_006696650_6 | 767,546 | 191,356 | 0.2493 |
14 Mar 2011 06:46:12 | 1115458 | 12658515 | famous_v8ec_599_200_006696650_6 | 758,186 | 188,947 | 0.2492 |
14 Mar 2011 06:05:09 | 1115458 | 12658515 | famous_v8ec_599_200_006696650_6 | 748,826 | 186,536 | 0.2491 |
14 Mar 2011 05:28:02 | 1115458 | 12658515 | famous_v8ec_599_200_006696650_6 | 739,466 | 184,123 | 0.2490 |
14 Mar 2011 04:45:11 | 1115458 | 12658515 | famous_v8ec_599_200_006696650_6 | 730,106 | 181,711 | 0.2489 |
14 Mar 2011 04:04:04 | 1115458 | 12658515 | famous_v8ec_599_200_006696650_6 | 720,746 | 179,299 | 0.2488 |
14 Mar 2011 03:22:57 | 1115458 | 12658515 | famous_v8ec_599_200_006696650_6 | 711,386 | 176,886 | 0.2486 |
14 Mar 2011 02:41:19 | 1115458 | 12658515 | famous_v8ec_599_200_006696650_6 | 702,026 | 174,474 | 0.2485 |
14 Mar 2011 02:02:26 | 1115458 | 12658515 | famous_v8ec_599_200_006696650_6 | 692,666 | 172,060 | 0.2484 |
14 Mar 2011 01:19:54 | 1115458 | 12658515 | famous_v8ec_599_200_006696650_6 | 683,306 | 169,643 | 0.2483 |
©2024 cpdn.org