climateprediction.net home page
Task 21524446

Task 21524446

Name wah2_safr50_n2nf_201612_24_791_011758441_0
Workunit 11758441
Created 7 Mar 2019, 10:55:02 UTC
Sent 25 Mar 2019, 12:59:03 UTC
Report deadline 6 Mar 2020, 18:19:03 UTC
Received 30 Mar 2019, 17:00:44 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID 1458939
Run time 4 days 6 hours 4 min 34 sec
CPU time 3 days 23 hours 36 min 51 sec
Validate state Invalid
Credit 13,698.58
Device peak FLOPS 4.73 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 257.43 MB
Peak swap size 220.07 MB
Peak disk usage 105.91 MB
Stderr 
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
finish file present too long</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Global Worker:: CPDN process is not running, exiting, CRetVao = 1,nchecktID=0,rselfPoD=le31::4,C PiMN nCror=e2
s is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16660, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
12:49:28 (16660): called boinc_finish(0)
CPDN Monitor - Abort request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0265812C

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 03/30/19 12:54:47
Install Directory : 
Data Directory    : K:\Drivers & Utilities\Utilities\BOINC\ProgramData\ASCENSIONII
Project Symstore  : 
LoadLibraryA( K:\Drivers & Utilities\Utilities\BOINC\ProgramData\ASCENSIONII\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( K:\Drivers & Utilities\Utilities\BOINC\ProgramData\ASCENSIONII\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( K:\Drivers & Utilities\Utilities\BOINC\ProgramData\ASCENSIONII\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( K:\Drivers & Utilities\Utilities\BOINC\ProgramData\ASCENSIONII\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: K:\Drivers & Utilities\Utilities\BOINC\ProgramData\ASCENSIONII\projects\climateprediction.net;K:\Drivers & Utilities\Utilities\BOINC\ProgramData\ASCENSIONII\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000152000 K:\Drivers & Utilities\Utilities\BOINC\ProgramData\ASCENSIONII\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077e30000 000000000019c000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.17763.292) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000077890000 00000000000e0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.17763.379) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000077080000 00000000001fa000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.17763.348) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000076030000 0000000000199000 C:\WINDOWS\System32\USER32.dll (6.2.17763.168) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000077e00000 0000000000017000 C:\WINDOWS\System32\win32u.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wwin32u.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000075fd0000 0000000000023000 C:\WINDOWS\System32\GDI32.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 00000000754c0000 0000000000167000 C:\WINDOWS\System32\gdi32full.dll (6.2.17763.316) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32full.pdb
    File Version          : 10.0.17763.316 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.316

ModLoad: 0000000077970000 0000000000080000 C:\WINDOWS\System32\msvcp_win.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000076df0000 0000000000122000 C:\WINDOWS\System32\ucrtbase.dll (6.2.17763.348) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.17763.348 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.348

ModLoad: 0000000077280000 000000000007e000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000076750000 00000000000c0000 C:\WINDOWS\System32\msvcrt.dll (7.0.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.17763.1

ModLoad: 00000000765d0000 0000000000079000 C:\WINDOWS\System32\sechost.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 00000000757a0000 00000000000bf000 C:\WINDOWS\System32\RPCRT4.dll (6.2.17763.379) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 00000000754a0000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000075490000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 00000000763d0000 0000000000062000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 00000000765a0000 0000000000025000 C:\WINDOWS\System32\IMM32.DLL (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000075290000 000000000018f000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000074fa0000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 5689, Write: 0, Other 32494

- I/O Transfers Counters -
Read: 0, Write: 33147, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 93104, QuotaPeakPagedPoolUsage: 93264
QuotaNonPagedPoolUsage: 9032, QuotaPeakNonPagedPoolUsage: 9320

- Virtual Memory Usage -
VirtualSize: 56287232, PeakVirtualSize: 56287232

- Pagefile Usage -
PagefileUsage: 4046848, PeakPagefileUsage: 4046848

- Working Set Size -
WorkingSetSize: 6217728, PeakWorkingSetSize: 6221824, PageFaultCount: 1811

*** Dump of thread ID 18412 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 15937500.000000, User Time: 13593750.000000, Wait Time: 15645.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0265812C

- Registers -
eax=00000065 ebx=004b63b9 ecx=0019dc00 edx=0265812c esi=0019d9b8 edi=0019dc30
eip=0048ee46 esp=0019d94c ebp=0019dbdc
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010202

- Callstack -
ChildEBP RetAddr  Args to Child
0019dbdc 0048161c 0019dc00 004b63b8 00000000 0019dc30 wah2_8.24_windows_intelx86!+0x0 
0019dc20 0044fa52 0265812c 004b63b8 004b6484 00000421 wah2_8.24_windows_intelx86!+0x0 
0019dc40 00496e90 0000000b 00000000 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 
0019dc58 00485ca1 c0000005 0019dc8c 00490c54 00000000 wah2_8.24_windows_intelx86!+0x0 
0019ff70 778b0179 00291000 778b0160 0019ffdc 77e9662d wah2_8.24_windows_intelx86!+0x0 
0019ff80 77e9662d 00291000 d955582e 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0019ffdc 77e965fd ffffffff 77eb5195 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
0019ffec 00000000 00485cce 00291000 00000000 78746341 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 15120 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 14256.000000

- Registers -
eax=00000000 ebx=00735888 ecx=00000000 edx=00000000 esi=007356c8 edi=007344f0
eip=77ea216c esp=0092fdb4 ebp=0092ff70
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
0092ff70 778b0179 007344f0 778b0160 0092ffdc 77e9662d ntdll!NtWaitForWorkViaWorkerFactory+0x0 
0092ff80 77e9662d 007344f0 d9de582e 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0092ffdc 77e965fd ffffffff 77eb5195 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
0092ffec 00000000 77e7e230 007344f0 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 18232 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 14256.000000

- Registers -
eax=00000000 ebx=00736678 ecx=00000000 edx=00000000 esi=007364b8 edi=007344f0
eip=77ea216c esp=00a2fdb4 ebp=00a2ff70
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
00a2ff70 778b0179 007344f0 778b0160 00a2ffdc 77e9662d ntdll!NtWaitForWorkViaWorkerFactory+0x0 
00a2ff80 77e9662d 007344f0 d9ee582e 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
00a2ffdc 77e965fd ffffffff 77eb5195 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
00a2ffec 00000000 77e7e230 007344f0 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 15012 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 14256.000000

- Registers -
eax=00000000 ebx=007399e8 ecx=00000000 edx=00000000 esi=00739828 edi=007344f0
eip=77ea216c esp=00b2fdb4 ebp=00b2ff70
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
00b2ff70 778b0179 007344f0 778b0160 00b2ffdc 77e9662d ntdll!NtWaitForWorkViaWorkerFactory+0x0 
00b2ff80 77e9662d 007344f0 d9fe582e 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
00b2ffdc 77e965fd ffffffff 77eb5195 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
00b2ffec 00000000 77e7e230 007344f0 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 10852 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 15641.000000

- Registers -
eax=00000000 ebx=0258fd0c ecx=00000000 edx=00000000 esi=00000000 edi=0258fd0c
eip=77ea07ec esp=0258fccc ebp=0258fd30
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
0258fd30 7718dabf 00000064 00000000 0258ff70 00478b44 ntdll!ZwDelayExecution+0x0 
0258fd40 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 
0258ff70 778b0179 00000000 778b0160 0258ffdc 77e9662d wah2_8.24_windows_intelx86!+0x0 
0258ff80 77e9662d 00000000 db14582e 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0258ffdc 77e965fd ffffffff 77eb5195 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
0258ffec 00000000 00478b20 00000000 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
30 Mar 2019 14:48:43 1458939 21524446 wah2_safr50_n2nf_201612_24_791_011758441_0 207,659 338,921 1.6321
30 Mar 2019 08:57:51 1458939 21524446 wah2_safr50_n2nf_201612_24_791_011758441_0 196,139 321,594 1.6396
30 Mar 2019 01:41:11 1458939 21524446 wah2_safr50_n2nf_201612_24_791_011758441_0 184,619 303,819 1.6457
29 Mar 2019 19:56:57 1458939 21524446 wah2_safr50_n2nf_201612_24_791_011758441_0 173,099 285,401 1.6488
29 Mar 2019 13:15:55 1458939 21524446 wah2_safr50_n2nf_201612_24_791_011758441_0 161,579 267,089 1.6530
29 Mar 2019 06:19:39 1458939 21524446 wah2_safr50_n2nf_201612_24_791_011758441_0 150,059 248,554 1.6564
28 Mar 2019 22:01:35 1458939 21524446 wah2_safr50_n2nf_201612_24_791_011758441_0 138,539 229,681 1.6579
28 Mar 2019 15:41:24 1458939 21524446 wah2_safr50_n2nf_201612_24_791_011758441_0 127,019 209,931 1.6528
28 Mar 2019 11:23:35 1458939 21524446 wah2_safr50_n2nf_201612_24_791_011758441_0 115,499 191,669 1.6595
28 Mar 2019 11:22:16 1458939 21524446 wah2_safr50_n2nf_201612_24_791_011758441_0 103,979 172,136 1.6555
28 Mar 2019 11:20:59 1458939 21524446 wah2_safr50_n2nf_201612_24_791_011758441_0 92,459 152,938 1.6541
28 Mar 2019 11:19:08 1458939 21524446 wah2_safr50_n2nf_201612_24_791_011758441_0 80,939 132,785 1.6406
27 Mar 2019 03:27:13 1458939 21524446 wah2_safr50_n2nf_201612_24_791_011758441_0 69,419 114,151 1.6444
26 Mar 2019 21:32:45 1458939 21524446 wah2_safr50_n2nf_201612_24_791_011758441_0 57,899 95,088 1.6423
26 Mar 2019 15:26:46 1458939 21524446 wah2_safr50_n2nf_201612_24_791_011758441_0 46,379 77,345 1.6677
26 Mar 2019 10:07:34 1458939 21524446 wah2_safr50_n2nf_201612_24_791_011758441_0 34,859 59,220 1.6988
26 Mar 2019 02:55:36 1458939 21524446 wah2_safr50_n2nf_201612_24_791_011758441_0 23,339 40,811 1.7486
25 Mar 2019 19:13:13 1458939 21524446 wah2_safr50_n2nf_201612_24_791_011758441_0 11,819 18,897 1.5989


©2024 cpdn.org