climateprediction.net home page
Task 20433361

Task 20433361

Name wah2_global_b5q1_199812_25_577_011044003_0
Workunit 11044003
Created 30 May 2017, 11:13:06 UTC
Sent 30 May 2017, 12:06:59 UTC
Report deadline 12 May 2018, 17:26:59 UTC
Received 11 Jun 2017, 10:40:26 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1432632
Run time 1 days 13 hours 8 min 1 sec
CPU time 1 days 12 hours 37 min 15 sec
Validate state Invalid
Credit 3,994.09
Device peak FLOPS 4.45 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 240.08 MB
Peak swap size 168.76 MB
Peak disk usage 21.50 MB
Stderr
<core_client_version>7.6.33</core_client_version>
<![CDATA[
<stderr_txt>
22:08:47 (7608): start_timer_thread(): CreateThread() failed, errno 0
22:08:48 (7260): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:32:12 (15368): start_timer_thread(): CreateThread() failed, errno 0
12:32:13 (5076): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:41:32 (1080): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:46:08 (8008): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:47:46 (7668): start_timer_thread(): CreateThread() failed, errno 0
17:47:47 (11080): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:57:49 (5848): start_timer_thread(): CreateThread() failed, errno 0
17:57:51 (7772): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:01:31 (14084): start_timer_thread(): CreateThread() failed, errno 0
18:01:32 (11744): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:57:55 (4492): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:01:31 (7392): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
00:16:03 (6508): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
00:27:26 (5212): start_timer_thread(): CreateThread() failed, errno 0
00:27:28 (6876): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:12:27 (15012): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:43:10 (11992): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:54:48 (1884): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:01:31 (5612): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:11:35 (6836): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:39:43 (13336): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:46:09 (3196): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:56:05 (10816): start_timer_thread(): CreateThread() failed, errno 0
19:56:08 (5648): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
12:30:51 (15784): start_timer_thread(): CreateThread() failed, errno 0
12:30:52 (14760): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:56:46 (1300): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:11:59 (12536): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:48:37 (8652): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:35:20 (17232): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
17:47:28 (16236): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:57:25 (17388): start_timer_thread(): CreateThread() failed, errno 0
17:57:26 (11812): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:05:09 (13364): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:35:50 (6964): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
23:18:44 (17240): start_timer_thread(): CreateThread() failed, errno 0
23:18:46 (16236): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
00:42:18 (13080): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:49:54 (16336): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:10:00 (2388): start_timer_thread(): CreateThread() failed, errno 0
15:10:01 (3472): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
15:31:07 (13640): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
15:41:02 (16644): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:01:32 (11528): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:25:21 (1028): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:35:17 (4916): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:31:36 (16952): start_timer_thread(): CreateThread() failed, errno 0
20:31:39 (16332): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:43:55 (1192): start_timer_thread(): CreateThread() failed, errno 0
22:43:56 (15816): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:50:21 (5876): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
23:01:31 (376): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:56:28 (4064): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:01:32 (12660): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:53:37 (17368): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:36:39 (16480): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
17:46:35 (12332): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:01:32 (7360): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:11:34 (1084): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:14:05 (10320): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:34:23 (9916): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:44:20 (17348): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:01:32 (1112): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:01:31 (16928): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
23:04:50 (10552): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
23:14:54 (13556): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:27:32 (11712): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:31:10 (15684): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:51:04 (7216): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:01:31 (15676): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:01:31 (2564): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:01:31 (2496): start_timer_thread(): CreateThread() failed, errno 0
20:01:33 (5792): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
14:17:42 (16800): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:34:59 (1952): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:38:06 (15220): start_timer_thread(): CreateThread() failed, errno 0
14:38:07 (368): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:50:07 (11744): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:01:31 (5600): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:18:27 (8112): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:28:22 (14320): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:50:06 (2028): start_timer_thread(): CreateThread() failed, errno 0
17:50:07 (8484): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:01:31 (3832): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:57:15 (10964): start_timer_thread(): CreateThread() failed, errno 0
18:57:17 (13956): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:01:31 (12264): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:38:08 (12336): start_timer_thread(): CreateThread() failed, errno 0
19:38:10 (15440): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
23:50:53 (3120): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
03:15:05 (14248): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:25:00 (6724): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:01:31 (13432): start_timer_thread(): CreateThread() failed, errno 0
04:01:33 (10716): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
05:01:31 (9524): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
06:01:31 (7644): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
10:44:40 (11376): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
10:54:36 (12636): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:33:09 (13196): start_timer_thread(): CreateThread() failed, errno 0
19:33:11 (11932): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:53:41 (2308): start_timer_thread(): CreateThread() failed, errno 0
20:53:43 (11956): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:32:31 (15776): start_timer_thread(): CreateThread() failed, errno 0
22:32:32 (16748): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
23:09:57 (11916): start_timer_thread(): CreateThread() failed, errno 0
23:09:58 (8624): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
12:57:15 (7260): start_timer_thread(): CreateThread() failed, errno 0
12:57:16 (3208): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:23:52 (15564): start_timer_thread(): CreateThread() failed, errno 0
15:23:53 (1288): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:26:45 (4588): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:36:40 (8860): start_timer_thread(): CreateThread() failed, errno 0
16:36:41 (7920): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:01:31 (2456): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:01:31 (14816): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:10:51 (15776): start_timer_thread(): CreateThread() failed, errno 0
20:10:52 (11284): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:20:46 (8520): start_timer_thread(): CreateThread() failed, errno 0
20:20:47 (10156): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
12:31:14 (10636): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:29:31 (14620): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:39:34 (6360): start_timer_thread(): CreateThread() failed, errno 0
17:39:36 (11456): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:15:39 (16456): start_timer_thread(): CreateThread() failed, errno 0
18:15:40 (17028): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:25:35 (15680): start_timer_thread(): CreateThread() failed, errno 0
18:25:36 (532): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:38:06 (11016): start_timer_thread(): CreateThread() failed, errno 0
18:38:07 (9676): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:48:01 (12884): start_timer_thread(): CreateThread() failed, errno 0
BUFFIN: C I/O Error feof - Unit 61 - Return code = 16
BUFFIN: C I/O Error feof - Unit 62 - Return code = 16
18:48:02 (5368): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:01:31 (9344): start_timer_thread(): CreateThread() failed, errno 0
19:01:32 (9000): start_timer_thread(): CreateThread() failed, errno 0
Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=9344, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9000, selfPID=9000, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9000, selfPID=17280, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
19:01:38 (17280): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>wah2_global_b5q1_199812_25_577_011044003_0_r1774277217_22.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_b5q1_199812_25_577_011044003_0_r1774277217_23.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_b5q1_199812_25_577_011044003_0_r1774277217_24.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_b5q1_199812_25_577_011044003_0_r1774277217_25.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_b5q1_199812_25_577_011044003_0_r1774277217_restart.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>

</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
11 Jun 2017 08:44:35 1432632 20433361 wah2_global_b5q1_199812_25_577_011044003_0 60,547 131,398 2.1702
10 Jun 2017 07:55:29 1432632 20433361 wah2_global_b5q1_199812_25_577_011044003_0 57,667 125,003 2.1677
08 Jun 2017 19:35:03 1432632 20433361 wah2_global_b5q1_199812_25_577_011044003_0 54,787 118,926 2.1707
08 Jun 2017 09:39:11 1432632 20433361 wah2_global_b5q1_199812_25_577_011044003_0 51,907 112,828 2.1737
07 Jun 2017 10:31:11 1432632 20433361 wah2_global_b5q1_199812_25_577_011044003_0 49,027 107,026 2.1830
07 Jun 2017 08:28:32 1432632 20433361 wah2_global_b5q1_199812_25_577_011044003_0 46,147 101,167 2.1923
06 Jun 2017 12:20:46 1432632 20433361 wah2_global_b5q1_199812_25_577_011044003_0 43,267 95,335 2.2034
06 Jun 2017 04:01:25 1432632 20433361 wah2_global_b5q1_199812_25_577_011044003_0 40,387 89,375 2.2130
03 Jun 2017 07:52:01 1432632 20433361 wah2_global_b5q1_199812_25_577_011044003_0 37,507 83,381 2.2231
01 Jun 2017 02:50:40 1432632 20433361 wah2_global_b5q1_199812_25_577_011044003_0 34,627 77,139 2.2277
31 May 2017 18:19:38 1432632 20433361 wah2_global_b5q1_199812_25_577_011044003_0 31,747 70,748 2.2285
31 May 2017 16:16:16 1432632 20433361 wah2_global_b5q1_199812_25_577_011044003_0 28,867 64,296 2.2273
31 May 2017 15:14:40 1432632 20433361 wah2_global_b5q1_199812_25_577_011044003_0 25,987 57,751 2.2223
31 May 2017 13:14:17 1432632 20433361 wah2_global_b5q1_199812_25_577_011044003_0 23,107 51,225 2.2169
31 May 2017 11:13:13 1432632 20433361 wah2_global_b5q1_199812_25_577_011044003_0 20,227 44,789 2.2143
31 May 2017 09:13:22 1432632 20433361 wah2_global_b5q1_199812_25_577_011044003_0 17,347 38,262 2.2057
31 May 2017 07:10:05 1432632 20433361 wah2_global_b5q1_199812_25_577_011044003_0 14,467 31,792 2.1976
31 May 2017 05:11:25 1432632 20433361 wah2_global_b5q1_199812_25_577_011044003_0 11,587 25,330 2.1861
31 May 2017 04:10:00 1432632 20433361 wah2_global_b5q1_199812_25_577_011044003_0 8,707 19,013 2.1836
30 May 2017 15:57:17 1432632 20433361 wah2_global_b5q1_199812_25_577_011044003_0 5,827 12,591 2.1608


©2024 cpdn.org