climateprediction.net home page
Task 11868498

Task 11868498

Name famous_v350_599_200_006689834_5
Workunit 6893087
Created 5 Sep 2010, 9:35:31 UTC
Sent 12 Sep 2010, 3:11:21 UTC
Report deadline 12 Dec 2010, 10:38:32 UTC
Received 21 Sep 2010, 10:46:00 UTC
Server state Over
Outcome Computation error
Client state Done
Exit status -226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID 13421
Run time
CPU time 1 days 23 hours 1 min 53 sec
Validate state Invalid
Credit 1,636.81
Device peak FLOPS 3.03 GFLOPS
Application version UK Met Office FAMOUS v6.11
windows_intelx86
Stderr
<core_client_version>5.10.45</core_client_version>
<![CDATA[
<message>
too many normally harmless exit(s)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:46:31 (5564): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
17:50:58 (2624): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:05:28 (5524): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0
Model crash detected, will try to restart...
18:31:10 (1032): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:48:15 (4928): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:48:17 (4928): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
23:39:16 (2480): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:41:58 (6032): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:42:14 (5188): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
20:43:29 (368): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:50:49 (4780): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
18:37:55 (2988): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:58:43 (2932): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
19:39:13 (3924): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:57:47 (1972): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
19:58:27 (1568): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: Result too large
BUFFIN: C I/O Error feof - Unit 60 - Return code = 16

BUFFIN: Read Failed: Result too large
BUFFIN: C I/O Error feof - Unit 61 - Return code = 16

BUFFIN: Read Failed: Result too large
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16

BUFFIN: Read Failed: Result too large
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
CPDN Monitor - Quit request from BOINC...
22:03:18 (5108): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:03:44 (5108): No heartbeat from core client for 30 sec - exiting
22:03:45 (5108): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
22:54:10 (5276): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
23:26:30 (3424): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:36:28 (2764): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
09:15:59 (4420): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
10:38:19 (6104): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
11:40:54 (988): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
12:18:57 (3744): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0
Model crash detected, will try to restart...
13:29:08 (2764): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:57:25 (4196): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:00:53 (400): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:01:15 (400): No heartbeat from core client for 30 sec - exiting
14:01:21 (400): No heartbeat from core client for 30 sec - exiting
14:01:22 (400): No heartbeat from core client for 30 sec - exiting
14:01:23 (400): No heartbeat from core client for 30 sec - exiting
14:01:24 (400): No heartbeat from core client for 30 sec - exiting
14:03:01 (1484): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:05:43 (2420): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:07:07 (2420): No heartbeat from core client for 30 sec - exiting
14:11:05 (6012): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:11:37 (6012): No heartbeat from core client for 30 sec - exiting
14:38:10 (4728): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
15:43:33 (4316): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:23:17 (5064): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
01:20:59 (4512): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:17:51 (5412): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:17:52 (5412): No heartbeat from core client for 30 sec - exiting

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
03:18:12 (5324): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:21:39 (4692): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:20:53 (2592): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:30:26 (4604): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:30:28 (4604): No heartbeat from core client for 30 sec - exiting
07:34:32 (6036): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
08:21:40 (4408): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:43:03 (4360): No heartbeat from core client for 30 sec - exiting
08:43:08 (4360): No heartbeat from core client for 30 sec - exiting
08:43:09 (4360): No heartbeat from core client for 30 sec - exiting
08:43:10 (4360): No heartbeat from core client for 30 sec - exiting
08:43:11 (4360): No heartbeat from core client for 30 sec - exiting
08:43:12 (4360): No heartbeat from core client for 30 sec - exiting
08:43:13 (4360): No heartbeat from core client for 30 sec - exiting
08:43:14 (4360): No heartbeat from core client for 30 sec - exiting
08:43:16 (4360): No heartbeat from core client for 30 sec - exiting
08:43:17 (4360): No heartbeat from core client for 30 sec - exiting
08:43:18 (4360): No heartbeat from core client for 30 sec - exiting
08:43:21 (4360): No heartbeat from core client for 30 sec - exiting
08:43:22 (4360): No heartbeat from core client for 30 sec - exiting
08:43:23 (4360): No heartbeat from core client for 30 sec - exiting
08:43:25 (4360): No heartbeat from core client for 30 sec - exiting
08:43:26 (4360): No heartbeat from core client for 30 sec - exiting
08:43:27 (4360): No heartbeat from core client for 30 sec - exiting
08:43:28 (4360): No heartbeat from core client for 30 sec - exiting
08:43:29 (4360): No heartbeat from core client for 30 sec - exiting
08:43:30 (4360): No heartbeat from core client for 30 sec - exiting
08:43:31 (4360): No heartbeat from core client for 30 sec - exiting
08:43:32 (4360): No heartbeat from core client for 30 sec - exiting
08:43:33 (4360): No heartbeat from core client for 30 sec - exiting
08:43:35 (4360): No heartbeat from core client for 30 sec - exiting
08:43:36 (4360): No heartbeat from core client for 30 sec - exiting
08:43:37 (4360): No heartbeat from core client for 30 sec - exiting
08:43:38 (4360): No heartbeat from core client for 30 sec - exiting
08:43:39 (4360): No heartbeat from core client for 30 sec - exiting
08:43:40 (4360): No heartbeat from core client for 30 sec - exiting
08:43:41 (4360): No heartbeat from core client for 30 sec - exiting
08:43:42 (4360): No heartbeat from core client for 30 sec - exiting
08:43:43 (4360): No heartbeat from core client for 30 sec - exiting
08:43:45 (4360): No heartbeat from core client for 30 sec - exiting
08:43:46 (4360): No heartbeat from core client for 30 sec - exiting
08:43:47 (4360): No heartbeat from core client for 30 sec - exiting
08:43:48 (4360): No heartbeat from core client for 30 sec - exiting
08:43:49 (4360): No heartbeat from core client for 30 sec - exiting
08:43:50 (4360): No heartbeat from core client for 30 sec - exiting
08:43:51 (4360): No heartbeat from core client for 30 sec - exiting
08:43:52 (4360): No heartbeat from core client for 30 sec - exiting
08:43:54 (4360): No heartbeat from core client for 30 sec - exiting
08:43:55 (4360): No heartbeat from core client for 30 sec - exiting
08:43:56 (4360): No heartbeat from core client for 30 sec - exiting
08:43:57 (4360): No heartbeat from core client for 30 sec - exiting
08:43:58 (4360): No heartbeat from core client for 30 sec - exiting
08:43:59 (4360): No heartbeat from core client for 30 sec - exiting
08:44:00 (4360): No heartbeat from core client for 30 sec - exiting
08:44:01 (4360): No heartbeat from core client for 30 sec - exiting
08:44:02 (4360): No heartbeat from core client for 30 sec - exiting
08:44:04 (4360): No heartbeat from core client for 30 sec - exiting
08:44:05 (4360): No heartbeat from core client for 30 sec - exiting
08:44:10 (4360): No heartbeat from core client for 30 sec - exiting
08:44:11 (4360): No heartbeat from core client for 30 sec - exiting
08:44:12 (4360): No heartbeat from core client for 30 sec - exiting
08:44:13 (4360): No heartbeat from core client for 30 sec - exiting
08:44:14 (4360): No heartbeat from core client for 30 sec - exiting
08:44:15 (4360): No heartbeat from core client for 30 sec - exiting
08:44:16 (4360): No heartbeat from core client for 30 sec - exiting
08:44:18 (4360): No heartbeat from core client for 30 sec - exiting
08:44:19 (4360): No heartbeat from core client for 30 sec - exiting
08:44:20 (4360): No heartbeat from core client for 30 sec - exiting
08:44:21 (4360): No heartbeat from core client for 30 sec - exiting
08:44:22 (4360): No heartbeat from core client for 30 sec - exiting
08:44:23 (4360): No heartbeat from core client for 30 sec - exiting
08:44:24 (4360): No heartbeat from core client for 30 sec - exiting
08:44:25 (4360): No heartbeat from core client for 30 sec - exiting
08:44:27 (4360): No heartbeat from core client for 30 sec - exiting
08:44:28 (4360): No heartbeat from core client for 30 sec - exiting
08:44:29 (4360): No heartbeat from core client for 30 sec - exiting
08:44:30 (4360): No heartbeat from core client for 30 sec - exiting
08:44:31 (4360): No heartbeat from core client for 30 sec - exiting
08:44:32 (4360): No heartbeat from core client for 30 sec - exiting
08:44:33 (4360): No heartbeat from core client for 30 sec - exiting
08:44:34 (4360): No heartbeat from core client for 30 sec - exiting
08:44:36 (4360): No heartbeat from core client for 30 sec - exiting
08:44:37 (4360): No heartbeat from core client for 30 sec - exiting
08:44:42 (4360): No heartbeat from core client for 30 sec - exiting
08:44:43 (4360): No heartbeat from core client for 30 sec - exiting
08:44:44 (4360): No heartbeat from core client for 30 sec - exiting
08:44:45 (4360): No heartbeat from core client for 30 sec - exiting
08:44:46 (4360): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
09:52:16 (5260): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:21:49 (2984): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:01:07 (5456): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:12:43 (4808): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
13:14:13 (5772): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
17:02:38 (5604): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
MainError:	09:03:59 PM	No files match the supplied pattern.
MainError:	09:03:59 PM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
17:30:19 (4780): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: Result too large
BUFFIN: C I/O Error feof - Unit 60 - Return code = 16

BUFFIN: Read Failed: Result too large
BUFFIN: C I/O Error feof - Unit 61 - Return code = 16

BUFFIN: Read Failed: Result too large
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16

BUFFIN: Read Failed: Result too large
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
20 Sep 2010 04:04:58 13421 11868498 famous_v350_599_200_006689834_5 496,106 169,069 0.3408
20 Sep 2010 03:20:56 13421 11868498 famous_v350_599_200_006689834_5 486,746 165,894 0.3408
20 Sep 2010 03:20:56 13421 11868498 famous_v350_599_200_006689834_5 477,386 162,717 0.3408
20 Sep 2010 03:20:56 13421 11868498 famous_v350_599_200_006689834_5 468,026 159,576 0.3410
19 Sep 2010 23:18:34 13421 11868498 famous_v350_599_200_006689834_5 458,666 156,420 0.3410
19 Sep 2010 21:07:01 13421 11868498 famous_v350_599_200_006689834_5 449,306 153,338 0.3413
19 Sep 2010 19:51:28 13421 11868498 famous_v350_599_200_006689834_5 439,946 150,120 0.3412
19 Sep 2010 18:57:31 13421 11868498 famous_v350_599_200_006689834_5 430,586 146,989 0.3414
19 Sep 2010 18:04:10 13421 11868498 famous_v350_599_200_006689834_5 421,226 143,871 0.3416
19 Sep 2010 16:49:04 13421 11868498 famous_v350_599_200_006689834_5 411,866 140,688 0.3416
19 Sep 2010 15:04:50 13421 11868498 famous_v350_599_200_006689834_5 402,506 137,691 0.3421
19 Sep 2010 14:00:49 13421 11868498 famous_v350_599_200_006689834_5 393,146 134,704 0.3426
19 Sep 2010 12:51:42 13421 11868498 famous_v350_599_200_006689834_5 383,786 131,569 0.3428
19 Sep 2010 11:38:53 13421 11868498 famous_v350_599_200_006689834_5 374,426 128,642 0.3436
19 Sep 2010 10:35:51 13421 11868498 famous_v350_599_200_006689834_5 365,066 125,389 0.3435
19 Sep 2010 09:32:29 13421 11868498 famous_v350_599_200_006689834_5 355,706 122,138 0.3434
19 Sep 2010 08:29:27 13421 11868498 famous_v350_599_200_006689834_5 346,346 119,040 0.3437
19 Sep 2010 07:26:37 13421 11868498 famous_v350_599_200_006689834_5 336,986 116,089 0.3445
19 Sep 2010 06:23:14 13421 11868498 famous_v350_599_200_006689834_5 327,626 112,792 0.3443
19 Sep 2010 05:25:37 13421 11868498 famous_v350_599_200_006689834_5 318,266 109,661 0.3446


©2024 cpdn.org