climateprediction.net home page
Task 21636653

Task 21636653

Name wah2_sam50_n09c_201612_25_811_011829048_0
Workunit 11829048
Created 24 Apr 2019, 6:27:53 UTC
Sent 25 Apr 2019, 6:54:51 UTC
Report deadline 6 Apr 2020, 12:14:51 UTC
Received 11 May 2019, 20:44:41 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID 960526
Run time 2 days 23 hours 15 min 16 sec
CPU time 2 days 22 hours 26 min 15 sec
Validate state Invalid
Credit 15,978.39
Device peak FLOPS 5.74 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 224.46 MB
Peak swap size 188.27 MB
Peak disk usage 44.26 MB
Stderr 
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
finish file present too long</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=19860, selfPID=19860, iMonCtr=1
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=19860, selfPID=15772, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
No Process Handle
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7760, selfPID=7760, iMonCtr=1
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7760, selfPID=14484, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3212, selfPID=3212, iMonCtr=1
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3212, selfPID=4172, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=22628, selfPID=22628, iMonCtr=1
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=22628, selfPID=11008, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12332, selfPID=12332, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12332, selfPID=2548, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16748, selfPID=16748, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16748, selfPID=16912, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1884, selfPID=17476, iMonCtr=1
No Process Handle
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1884, selfPID=1884, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15364, selfPID=23872, iMonCtr=1
No Process Handle
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15364, selfPID=15364, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8792, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15436, selfPID=10612, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
03:23:36 (10612): called boinc_finish(0)
CPDN Monitor - Abort request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0273812C

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 05/11/19 14:43:34
Install Directory : 
Data Directory    : R:\temp\Zitt_tmp\BOINC
Project Symstore  : 
LoadLibraryA( R:\temp\Zitt_tmp\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( R:\temp\Zitt_tmp\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( R:\temp\Zitt_tmp\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( R:\temp\Zitt_tmp\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: R:\temp\Zitt_tmp\BOINC\projects\climateprediction.net;R:\temp\Zitt_tmp\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000152000 R:\temp\Zitt_tmp\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077510000 0000000000190000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.17134.556) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 10.0.17134.228 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.228

ModLoad: 0000000075330000 00000000000e0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.17134.706) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 10.0.17134.376 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.376

ModLoad: 0000000074060000 00000000001e4000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.17134.556) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 10.0.17134.376 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.376

ModLoad: 00000000742a0000 000000000018d000 C:\WINDOWS\System32\USER32.dll (6.2.17134.376) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000075230000 0000000000017000 C:\WINDOWS\System32\win32u.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wwin32u.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000074440000 0000000000022000 C:\WINDOWS\System32\GDI32.dll (6.2.17134.285) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 10.0.17134.285 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.285

ModLoad: 0000000075b60000 0000000000164000 C:\WINDOWS\System32\gdi32full.dll (6.2.17134.706) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32full.pdb
    File Version          : 10.0.17134.706 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.706

ModLoad: 0000000075250000 000000000007d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.17134.619) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.17134.619 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.619

ModLoad: 00000000749d0000 000000000011d000 C:\WINDOWS\System32\ucrtbase.dll (6.2.17134.677) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.17134.677 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.677

ModLoad: 0000000075d20000 0000000000078000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.17134.471) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000073df0000 00000000000bf000 C:\WINDOWS\System32\msvcrt.dll (7.0.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.17134.1

ModLoad: 0000000075cd0000 0000000000044000 C:\WINDOWS\System32\sechost.dll (6.2.17134.319) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000073f50000 00000000000c0000 C:\WINDOWS\System32\RPCRT4.dll (6.2.17134.648) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000073dd0000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.17134.376) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 10.0.17134.376 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.376

ModLoad: 0000000073dc0000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000075b00000 0000000000058000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.17134.471) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.17134.471 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.471

ModLoad: 00000000744d0000 0000000000026000 C:\WINDOWS\System32\IMM32.DLL (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 000000006b5e0000 0000000000182000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000072b90000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 6624, Write: 0, Other 37293

- I/O Transfers Counters -
Read: 0, Write: 1713, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 91936, QuotaPeakPagedPoolUsage: 92096
QuotaNonPagedPoolUsage: 8896, QuotaPeakNonPagedPoolUsage: 9048

- Virtual Memory Usage -
VirtualSize: 58347520, PeakVirtualSize: 58347520

- Pagefile Usage -
PagefileUsage: 4268032, PeakPagefileUsage: 4268032

- Working Set Size -
WorkingSetSize: 6389760, PeakWorkingSetSize: 6389760, PageFaultCount: 1904

*** Dump of thread ID 12656 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 11562500.000000, User Time: 11718750.000000, Wait Time: 4407997.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0273812C

- Registers -
eax=00000065 ebx=004b63b9 ecx=0019dc88 edx=0273812c esi=0019da40 edi=0019dcb8
eip=0048ee46 esp=0019d9d4 ebp=0019dc64
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010202

- Callstack -
ChildEBP RetAddr  Args to Child
0019dc64 0048161c 0019dc88 004b63b8 00000000 0019dcb8 wah2_8.24_windows_intelx86!+0x0 
0019dca8 0044fa52 0273812c 004b63b8 004b6484 00000421 wah2_8.24_windows_intelx86!+0x0 
0019dcc8 00496e90 0000000b 00000000 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 
0019dce0 00485ca1 c0000005 0019dd14 00490c54 00000000 wah2_8.24_windows_intelx86!+0x0 
0019ff80 75348494 0022b000 75348470 6cddc8fe 0019ffdc wah2_8.24_windows_intelx86!+0x0 
0019ff94 775741c8 0022b000 f40ea37a 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0019ffdc 77574198 ffffffff 7758f35e 00000000 00000000 ntdll!RtlAreBitsSet+0x0 
0019ffec 00000000 00485cce 0022b000 00000000 78746341 ntdll!RtlAreBitsSet+0x0 

*** Dump of thread ID 22492 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 4406659.000000

- Registers -
eax=00000000 ebx=006e51a8 ecx=00000000 edx=00000000 esi=006e4fe8 edi=006e2a08
eip=7757c58c esp=008dfdc8 ebp=008dff80
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
008dff80 75348494 006e2a08 75348470 6c49c8fe 008dffdc ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
008dff94 775741c8 006e2a08 f49aa37a 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
008dffdc 77574198 ffffffff 7758f35e 00000000 00000000 ntdll!RtlAreBitsSet+0x0 
008dffec 00000000 77561440 006e2a08 00000000 00000000 ntdll!RtlAreBitsSet+0x0 

*** Dump of thread ID 22496 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 4406659.000000

- Registers -
eax=00000000 ebx=006e5af8 ecx=00000000 edx=00000000 esi=006e5938 edi=006e2a08
eip=7757c58c esp=00a1fdc8 ebp=00a1ff80
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
00a1ff80 75348494 006e2a08 75348470 6c65c8fe 00a1ffdc ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
00a1ff94 775741c8 006e2a08 f4b6a37a 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
00a1ffdc 77574198 ffffffff 7758f35e 00000000 00000000 ntdll!RtlAreBitsSet+0x0 
00a1ffec 00000000 77561440 006e2a08 00000000 00000000 ntdll!RtlAreBitsSet+0x0 

*** Dump of thread ID 22500 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 4406659.000000

- Registers -
eax=00000000 ebx=006e8e90 ecx=00000000 edx=00000000 esi=006e8cd0 edi=006e2a08
eip=7757c58c esp=00b5fdc8 ebp=00b5ff80
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
00b5ff80 75348494 006e2a08 75348470 6c71c8fe 00b5ffdc ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
00b5ff94 775741c8 006e2a08 f4a2a37a 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
00b5ffdc 77574198 ffffffff 7758f35e 00000000 00000000 ntdll!RtlAreBitsSet+0x0 
00b5ffec 00000000 77561440 006e2a08 00000000 00000000 ntdll!RtlAreBitsSet+0x0 

*** Dump of thread ID 22508 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 4407994.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=00000001
eip=7757ac1c esp=0266fcdc ebp=0266fd40
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
0266fd40 7416717f 00000064 00000000 0266ff80 00478b44 ntdll!ZwDelayExecution+0x0 
0266fd50 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 
0266ff80 75348494 00000000 75348470 6ea2c8fe 0266ffdc wah2_8.24_windows_intelx86!+0x0 
0266ff94 775741c8 00000000 f671a37a 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0266ffdc 77574198 ffffffff 7758f35e 00000000 00000000 ntdll!RtlAreBitsSet+0x0 
0266ffec 00000000 00478b20 00000000 00000000 00000000 ntdll!RtlAreBitsSet+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
11 May 2019 07:50:39 960526 21636653 wah2_sam50_n09c_201612_25_811_011829048_0 242,219 249,488 1.0300
11 May 2019 04:45:39 960526 21636653 wah2_sam50_n09c_201612_25_811_011829048_0 230,699 237,661 1.0302
10 May 2019 02:31:45 960526 21636653 wah2_sam50_n09c_201612_25_811_011829048_0 219,179 225,948 1.0309
09 May 2019 03:10:58 960526 21636653 wah2_sam50_n09c_201612_25_811_011829048_0 207,659 213,874 1.0299
08 May 2019 17:56:02 960526 21636653 wah2_sam50_n09c_201612_25_811_011829048_0 196,139 201,951 1.0296
08 May 2019 03:43:07 960526 21636653 wah2_sam50_n09c_201612_25_811_011829048_0 184,619 189,790 1.0280
07 May 2019 03:38:51 960526 21636653 wah2_sam50_n09c_201612_25_811_011829048_0 173,099 177,954 1.0280
06 May 2019 07:48:39 960526 21636653 wah2_sam50_n09c_201612_25_811_011829048_0 161,579 166,192 1.0285
06 May 2019 04:28:14 960526 21636653 wah2_sam50_n09c_201612_25_811_011829048_0 150,059 154,277 1.0281
06 May 2019 00:36:44 960526 21636653 wah2_sam50_n09c_201612_25_811_011829048_0 138,539 142,606 1.0294
05 May 2019 21:21:40 960526 21636653 wah2_sam50_n09c_201612_25_811_011829048_0 127,019 130,852 1.0302
05 May 2019 06:47:49 960526 21636653 wah2_sam50_n09c_201612_25_811_011829048_0 115,499 119,113 1.0313
03 May 2019 06:22:45 960526 21636653 wah2_sam50_n09c_201612_25_811_011829048_0 103,979 107,009 1.0291
03 May 2019 03:17:24 960526 21636653 wah2_sam50_n09c_201612_25_811_011829048_0 92,459 95,083 1.0284
03 May 2019 00:12:17 960526 21636653 wah2_sam50_n09c_201612_25_811_011829048_0 80,939 83,368 1.0300
02 May 2019 02:15:35 960526 21636653 wah2_sam50_n09c_201612_25_811_011829048_0 69,419 71,559 1.0308
01 May 2019 06:06:47 960526 21636653 wah2_sam50_n09c_201612_25_811_011829048_0 57,899 59,929 1.0351
30 Apr 2019 05:04:57 960526 21636653 wah2_sam50_n09c_201612_25_811_011829048_0 46,379 47,782 1.0303
29 Apr 2019 06:07:03 960526 21636653 wah2_sam50_n09c_201612_25_811_011829048_0 34,859 35,791 1.0267
28 Apr 2019 06:28:51 960526 21636653 wah2_sam50_n09c_201612_25_811_011829048_0 23,339 24,006 1.0286


©2024 cpdn.org