climateprediction.net home page
Task 21047350

Task 21047350

Name wah2_pnw25_zpv4_199712_24_533_010954615_1
Workunit 10954615
Created 14 Feb 2018, 11:51:37 UTC
Sent 14 Feb 2018, 11:52:31 UTC
Report deadline 27 Jan 2019, 17:12:31 UTC
Received 20 Feb 2018, 21:13:19 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID 1377966
Run time 5 days 15 hours 39 min
CPU time 5 days 11 hours 43 min 54 sec
Validate state Invalid
Credit 14,458.52
Device peak FLOPS 2.80 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 117.86 MB
Peak swap size 123.08 MB
Peak disk usage 0.02 MB
Stderr
<core_client_version>7.8.3</core_client_version>
<![CDATA[
<message>
finish file present too long</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
SETPOS: Unit 61 to Word Address -198 Failed with Error Code -1

Model crashed: SETPOS: Unit 61 to Word Address -198 Failed with Error Code -1
Leaving CPDN_ain::Monitor...
15:01:11 (7076): called boinc_finish(0)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Abort request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0429B12C

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 02/20/18 15:11:24
Install Directory : 
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000152000 C:\ProgramData\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000779a0000 000000000018d000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.16299.248) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.16299.15

ModLoad: 0000000075fe0000 00000000000d0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.16299.15

ModLoad: 0000000064680000 000000000002f000 C:\Program Files (x86)\AVG\Antivirus\aswhookx.dll (18.1.3.23126) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : r:\sources\2018_0123_122256\build\avgast\RU_NTDLL-lH-Y2A!Win32_vs140\bin\Release_Unicode_NTDLL_vs140\Win32\aswhookx.pdb
    File Version          : 18.1.3.23126
    Company Name          : AVG Technologies CZ, s.r.o.
    Product Name          : AVG
    Product Version       : 18.1.3.23126

ModLoad: 0000000076130000 00000000001d7000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.16299.248) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.16299.15

ModLoad: 0000000076eb0000 0000000000175000 C:\WINDOWS\System32\USER32.dll (6.2.16299.125) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.16299.15

ModLoad: 00000000773b0000 0000000000016000 C:\WINDOWS\System32\win32u.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : wwin32u.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.16299.15

ModLoad: 0000000077230000 0000000000022000 C:\WINDOWS\System32\GDI32.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.16299.15

ModLoad: 00000000763e0000 000000000015e000 C:\WINDOWS\System32\gdi32full.dll (6.2.16299.98) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32full.pdb
    File Version          : 10.0.16299.98 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.16299.98

ModLoad: 00000000760b0000 000000000007c000 C:\WINDOWS\System32\msvcp_win.dll (6.2.16299.248) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.16299.248 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.16299.248

ModLoad: 00000000748c0000 0000000000117000 C:\WINDOWS\System32\ucrtbase.dll (6.2.16299.248) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.16299.248 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.16299.248

ModLoad: 0000000076540000 0000000000078000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.16299.192) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.16299.15

ModLoad: 00000000772f0000 00000000000bd000 C:\WINDOWS\System32\msvcrt.dll (7.0.16299.125) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.16299.125 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.16299.125

ModLoad: 0000000076310000 0000000000043000 C:\WINDOWS\System32\sechost.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.16299.15

ModLoad: 00000000746a0000 00000000000be000 C:\WINDOWS\System32\RPCRT4.dll (6.2.16299.192) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.16299.15

ModLoad: 00000000743c0000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.16299.192) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 10.0.16299.192 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.16299.192

ModLoad: 00000000743b0000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.16299.15

ModLoad: 0000000075f80000 0000000000057000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.16299.98) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.16299.98 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.16299.98

ModLoad: 0000000074b30000 0000000000025000 C:\WINDOWS\System32\IMM32.DLL (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.16299.15

ModLoad: 0000000076bd0000 0000000000246000 C:\WINDOWS\System32\combase.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.16299.15

ModLoad: 00000000734b0000 0000000000181000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.16299.15

ModLoad: 0000000073950000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.16299.15



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 22, Write: 0, Other 356

- I/O Transfers Counters -
Read: 0, Write: 2703, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 97104, QuotaPeakPagedPoolUsage: 97200
QuotaNonPagedPoolUsage: 8016, QuotaPeakNonPagedPoolUsage: 8576

- Virtual Memory Usage -
VirtualSize: 87859200, PeakVirtualSize: 88035328

- Pagefile Usage -
PagefileUsage: 3694592, PeakPagefileUsage: 3694592

- Working Set Size -
WorkingSetSize: 6479872, PeakWorkingSetSize: 6856704, PageFaultCount: 2027

*** Dump of thread ID 11208 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 2343750.000000, User Time: 0.000000, Wait Time: 32775.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0429B12C

- Registers -
eax=00000065 ebx=004b63b9 ecx=0019de08 edx=0429b12c esi=0019dbc0 edi=0019de38
eip=0048ee46 esp=0019db54 ebp=0019dde4
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010202

- Callstack -
ChildEBP RetAddr  Args to Child
0019dde4 0048161c 0019de08 004b63b8 00000000 0019de38 wah2_8.24_windows_intelx86!+0x0 
0019de28 0044fa52 0429b12c 004b63b8 004b6484 00000421 wah2_8.24_windows_intelx86!+0x0 
0019de48 00496e90 0000000b 00000000 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 
0019de60 00485ca1 c0000005 0019de94 00490c54 00000000 wah2_8.24_windows_intelx86!+0x0 
0019ff80 75ff8654 002f3000 75ff8630 a6eeae67 0019ffdc wah2_8.24_windows_intelx86!+0x0 
0019ff94 77a04a77 002f3000 a74d2f58 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0019ffdc 77a04a47 ffffffff 77a29eb8 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
0019ffec 00000000 00485cce 002f3000 00000000 78746341 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 10344 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 32774.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=00000001
eip=77a0eacc esp=043bfcdc ebp=043bfd40
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
043bfd40 7623287f 00000064 00000000 043bff80 00478b44 ntdll!ZwDelayExecution+0x0 
043bfd50 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 
043bff80 75ff8654 00000000 75ff8630 a2ccae67 043bffdc wah2_8.24_windows_intelx86!+0x0 
043bff94 77a04a77 00000000 a36f2f58 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
043bffdc 77a04a47 ffffffff 77a29eb8 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
043bffec 00000000 00478b20 00000000 00000000 0a7dc8c6 ntdll!RtlGetAppContainerNamedObjectPath+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
20 Feb 2018 15:22:10 1377966 21047350 wah2_pnw25_zpv4_199712_24_533_010954615_1 219,179 472,405 2.1553
19 Feb 2018 21:47:58 1377966 21047350 wah2_pnw25_zpv4_199712_24_533_010954615_1 207,659 447,498 2.1550
19 Feb 2018 14:52:13 1377966 21047350 wah2_pnw25_zpv4_199712_24_533_010954615_1 196,139 422,961 2.1564
19 Feb 2018 07:52:27 1377966 21047350 wah2_pnw25_zpv4_199712_24_533_010954615_1 184,619 397,936 2.1554
19 Feb 2018 00:38:39 1377966 21047350 wah2_pnw25_zpv4_199712_24_533_010954615_1 173,099 372,733 2.1533
18 Feb 2018 15:53:37 1377966 21047350 wah2_pnw25_zpv4_199712_24_533_010954615_1 161,579 347,671 2.1517
18 Feb 2018 08:25:45 1377966 21047350 wah2_pnw25_zpv4_199712_24_533_010954615_1 150,059 322,387 2.1484
18 Feb 2018 01:15:47 1377966 21047350 wah2_pnw25_zpv4_199712_24_533_010954615_1 138,539 297,355 2.1464
17 Feb 2018 18:11:17 1377966 21047350 wah2_pnw25_zpv4_199712_24_533_010954615_1 127,019 272,284 2.1436
17 Feb 2018 11:11:03 1377966 21047350 wah2_pnw25_zpv4_199712_24_533_010954615_1 115,499 247,358 2.1416
17 Feb 2018 04:02:45 1377966 21047350 wah2_pnw25_zpv4_199712_24_533_010954615_1 103,979 222,186 2.1368
16 Feb 2018 21:05:11 1377966 21047350 wah2_pnw25_zpv4_199712_24_533_010954615_1 92,459 197,667 2.1379
16 Feb 2018 14:19:27 1377966 21047350 wah2_pnw25_zpv4_199712_24_533_010954615_1 80,939 173,285 2.1409
16 Feb 2018 07:20:31 1377966 21047350 wah2_pnw25_zpv4_199712_24_533_010954615_1 69,419 148,456 2.1385
16 Feb 2018 00:00:52 1377966 21047350 wah2_pnw25_zpv4_199712_24_533_010954615_1 57,899 123,562 2.1341
15 Feb 2018 16:54:50 1377966 21047350 wah2_pnw25_zpv4_199712_24_533_010954615_1 46,379 98,995 2.1345
15 Feb 2018 09:43:38 1377966 21047350 wah2_pnw25_zpv4_199712_24_533_010954615_1 34,859 74,493 2.1370
15 Feb 2018 02:34:40 1377966 21047350 wah2_pnw25_zpv4_199712_24_533_010954615_1 23,339 49,884 2.1374
14 Feb 2018 19:15:19 1377966 21047350 wah2_pnw25_zpv4_199712_24_533_010954615_1 11,819 25,170 2.1296


©2024 cpdn.org