climateprediction.net home page
Task 21668414

Task 21668414

Name wah2_sam50_n1cu_201412_24_814_011839790_2
Workunit 11839790
Created 17 May 2019, 4:29:55 UTC
Sent 17 May 2019, 4:48:24 UTC
Report deadline 28 Apr 2020, 10:08:24 UTC
Received 6 Dec 2019, 7:00:11 UTC
Server state Over
Outcome Computation error
Client state Aborted by user
Exit status 203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID 1237118
Run time 12 days 14 hours 3 min 43 sec
CPU time 10 days 15 hours 31 min 2 sec
Validate state Invalid
Credit 14,458.52
Device peak FLOPS 2.29 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 221.98 MB
Peak swap size 188.53 MB
Peak disk usage 150.79 MB
Stderr 
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
aborted by user</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00463007 read attempt to address 0x009903AC

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 05/17/19 09:34:58
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\Program Files\BOINC\\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\Program Files\BOINC\\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Program Files\BOINC\\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Program Files\BOINC\\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\1;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000152000 C:\ProgramData\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000076db0000 0000000000142000 C:\Windows\SYSTEM32\ntdll.dll (6.1.7601.24441) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 000000006b300000 0000000000010000 D:\Programme\Sicherheit\Avast\aswhook.dll (19.2.4.1879) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : D:\BUILD\work\01\c0cb082698b95679\idp\build\avgast\RU_NTDLL-lH-Y2A!Win32_vs141\bin\Release_Unicode_NTDLL_vs141\Win32\aswhook.pdb
    File Version          : 19.2.4.1879
    Company Name          : AVAST Software
    Product Name          : Avast
    Product Version       : 19.2.4.1879

ModLoad: 0000000075fe0000 00000000000d5000 C:\Windows\system32\kernel32.dll (6.1.7601.24441) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7601.18015

ModLoad: 0000000074af0000 000000000004b000 C:\Windows\system32\KERNELBASE.dll (6.1.7601.24441) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7601.18015

ModLoad: 0000000076ce0000 00000000000c9000 C:\Windows\system32\USER32.dll (6.1.7601.23594) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7601.17514

ModLoad: 0000000076410000 000000000004e000 C:\Windows\system32\GDI32.dll (6.1.7601.24440) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 6.1.7601.24440 (win7sp1_ldr.190416-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24440

ModLoad: 0000000075f70000 000000000000a000 C:\Windows\system32\LPK.dll (6.1.7601.24439) (-exported- Symbols Loaded)
    Linked PDB Filename   : lpk.pdb
    File Version          : 6.1.7601.24439 (win7sp1_ldr.190413-2027)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24439

ModLoad: 0000000074df0000 000000000009d000 C:\Windows\system32\USP10.dll (1.626.7601.24440) (-exported- Symbols Loaded)
    Linked PDB Filename   : usp10.pdb
    File Version          : 1.0626.7601.24440 (win7sp1_ldr.190416-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft(R) Uniscribe Unicode script processor
    Product Version       : 1.0626.7601.24440

ModLoad: 0000000076360000 00000000000ac000 C:\Windows\system32\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.7601.17744 (win7sp1_gdr.111215-1535)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.7601.17744

ModLoad: 0000000076c30000 00000000000a1000 C:\Windows\system32\ADVAPI32.dll (6.1.7601.24441) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 6.1.7601.24441 (win7sp1_ldr.190418-1735)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7601.24441

ModLoad: 0000000075f50000 0000000000019000 C:\Windows\SYSTEM32\sechost.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000760c0000 00000000000a2000 C:\Windows\system32\RPCRT4.dll (6.1.7601.24441) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 0000000076fb0000 000000000001f000 C:\Windows\system32\IMM32.DLL (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000074e90000 00000000000cd000 C:\Windows\system32\MSCTF.dll (6.1.7601.23915) (-exported- Symbols Loaded)
    Linked PDB Filename   : msctf.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 0000000072f30000 0000000000021000 C:\Windows\system32\ntmarta.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntmarta.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 0000000076310000 0000000000045000 C:\Windows\system32\WLDAP32.dll (6.1.7601.23889) (-exported- Symbols Loaded)
    Linked PDB Filename   : wldap32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 0000000074990000 000000000004c000 C:\Windows\system32\apphelp.dll (6.1.7601.18777) (-exported- Symbols Loaded)
    Linked PDB Filename   : apphelp.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7601.17514

ModLoad: 000000006e6a0000 00000000000eb000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000073f50000 0000000000009000 C:\Windows\system32\version.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 18201, Write: 0, Other 65254

- I/O Transfers Counters -
Read: 0, Write: 3079, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 89960, QuotaPeakPagedPoolUsage: 89960
QuotaNonPagedPoolUsage: 2952, QuotaPeakNonPagedPoolUsage: 3324

- Virtual Memory Usage -
VirtualSize: 93495296, PeakVirtualSize: 93495296

- Pagefile Usage -
PagefileUsage: 1748992, PeakPagefileUsage: 2785280

- Working Set Size -
WorkingSetSize: 43683840, PeakWorkingSetSize: 77668352, PageFaultCount: 20071

*** Dump of thread ID 4612 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 516406.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00463007 read attempt to address 0x009903AC

- Registers -
eax=00000015 ebx=80000000 ecx=00000000 edx=76df6c04 esi=008c0020 edi=00000000
eip=00463007 esp=052afe90 ebp=052afe94
cs=001b  ss=0023  ds=0023  es=0023  fs=003b  gs=0000             efl=00010216

- Callstack -
ChildEBP RetAddr  Args to Child
052afe94 0044826f 008c0020 00000000 008c0020 80000000 wah2_8.24_windows_intelx86!+0x0 
052afeac 0044fa68 008c0020 00000000 0051d6b0 052afefc wah2_8.24_windows_intelx86!+0x0 
052afec0 004856fc 00000015 19587efe 00000001 00000006 wah2_8.24_windows_intelx86!+0x0 
052afefc 76044cf4 00000006 1959ac69 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 
052aff88 7602ef3c 00000006 052affd4 76e13618 80000006 kernel32!CtrlRoutine+0x0 
052aff94 76e13618 80000006 73a64d72 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
052affd4 76e135eb 76044c6b 80000006 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
052affec 00000000 76044c6b 80000006 00000000 3f70d0c1 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 6632 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 32343750.000000, User Time: 70781248.000000, Wait Time: 516402.000000

- Registers -
eax=00000062 ebx=00000050 ecx=0012fd3c edx=0012ed44 esi=0012ed80 edi=00000000
eip=76df6c04 esp=0012ed3c ebp=0012eda4
cs=001b  ss=0023  ds=0023  es=0023  fs=003b  gs=0000             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
0012eda4 74af1818 000000c8 00000000 0012edc8 00468ec1 ntdll!KiFastSystemCallRet+0x0 
0012edb4 00468ec1 000000c8 000000c8 00000000 0012ee00 KERNELBASE!Sleep+0x0 
0012edc8 00407a89 a0000000 027f9999 00000000 004d0c50 wah2_8.24_windows_intelx86!+0x0 
0012ee00 004092c5 00000000 1c607d4a 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 
0012fd48 004094b7 0012fef8 00409535 004d1370 0012fd68 wah2_8.24_windows_intelx86!+0x0 
0012fd50 00409535 004d1370 0012fd68 002c26e0 0012fd68 wah2_8.24_windows_intelx86!+0x0 
0012fef8 00485c7b 00400000 00000000 002c271e 0000000a wah2_8.24_windows_intelx86!+0x0 
0012ff88 7602ef3c 7ffdf000 0012ffd4 76e13618 7ffdf000 wah2_8.24_windows_intelx86!+0x0 
0012ff94 76e13618 7ffdf000 769e4d72 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0012ffd4 76e135eb 00485cce 7ffdf000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
0012ffec 00000000 00485cce 7ffdf000 00000000 78746341 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 5756 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 156250.000000, User Time: 312500.000000, Wait Time: 516404.000000

- Registers -
eax=00000062 ebx=00000000 ecx=74af189f edx=00bbfce8 esi=00bbfd24 edi=00000000
eip=76df6c04 esp=00bbfce0 ebp=00bbfd48
cs=001b  ss=0023  ds=0023  es=0023  fs=003b  gs=0000             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
00bbfd48 74af1818 00000064 00000000 00bbff88 00478b44 ntdll!KiFastSystemCallRet+0x0 
00bbfd58 00478b44 00000064 00000000 00000000 00000000 KERNELBASE!Sleep+0x0 
00bbff88 7602ef3c 00000000 00bbffd4 76e13618 00000000 wah2_8.24_windows_intelx86!+0x0 
00bbff94 76e13618 00000000 76374d72 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
00bbffd4 76e135eb 00478b20 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
00bbffec 00000000 00478b20 00000000 00000000 32686177 ntdll!RtlInitializeExceptionChain+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7432, selfPID=7432, iMonCtr=1
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7432, selfPID=6452, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3312, selfPID=3312, iMonCtr=1
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3312, selfPID=6316, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5788, selfPID=5788, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
01 Aug 2019 06:22:55 1237118 21668414 wah2_sam50_n1cu_201412_24_814_011839790_2 219,179 894,630 4.0817
31 Jul 2019 05:17:35 1237118 21668414 wah2_sam50_n1cu_201412_24_814_011839790_2 207,659 845,433 4.0713
30 Jul 2019 04:01:50 1237118 21668414 wah2_sam50_n1cu_201412_24_814_011839790_2 196,139 796,459 4.0607
29 Jul 2019 04:28:17 1237118 21668414 wah2_sam50_n1cu_201412_24_814_011839790_2 184,619 748,210 4.0527
28 Jul 2019 10:37:03 1237118 21668414 wah2_sam50_n1cu_201412_24_814_011839790_2 173,099 700,677 4.0478
27 Jul 2019 14:53:51 1237118 21668414 wah2_sam50_n1cu_201412_24_814_011839790_2 161,579 653,000 4.0414
26 Jul 2019 11:19:30 1237118 21668414 wah2_sam50_n1cu_201412_24_814_011839790_2 150,059 603,087 4.0190
25 Jul 2019 18:41:20 1237118 21668414 wah2_sam50_n1cu_201412_24_814_011839790_2 138,539 556,684 4.0182
25 Jul 2019 01:05:05 1237118 21668414 wah2_sam50_n1cu_201412_24_814_011839790_2 127,019 510,550 4.0195
24 Jul 2019 06:30:55 1237118 21668414 wah2_sam50_n1cu_201412_24_814_011839790_2 115,499 458,472 3.9695
23 Jul 2019 14:52:57 1237118 21668414 wah2_sam50_n1cu_201412_24_814_011839790_2 103,979 412,868 3.9707
23 Jul 2019 00:16:41 1237118 21668414 wah2_sam50_n1cu_201412_24_814_011839790_2 92,459 366,029 3.9588
22 Jul 2019 08:06:47 1237118 21668414 wah2_sam50_n1cu_201412_24_814_011839790_2 80,939 320,645 3.9616
21 Jul 2019 17:05:09 1237118 21668414 wah2_sam50_n1cu_201412_24_814_011839790_2 69,419 275,393 3.9671
21 Jul 2019 04:16:18 1237118 21668414 wah2_sam50_n1cu_201412_24_814_011839790_2 57,899 229,787 3.9688
20 Jul 2019 15:37:20 1237118 21668414 wah2_sam50_n1cu_201412_24_814_011839790_2 46,379 184,980 3.9884
19 Jul 2019 18:41:21 1237118 21668414 wah2_sam50_n1cu_201412_24_814_011839790_2 34,859 142,162 4.0782
19 Jul 2019 01:30:10 1237118 21668414 wah2_sam50_n1cu_201412_24_814_011839790_2 23,339 95,072 4.0735
19 May 2019 13:43:35 1237118 21668414 wah2_sam50_n1cu_201412_24_814_011839790_2 11,819 47,388 4.0095


©2024 cpdn.org