climateprediction.net home page
Task 21593700

Task 21593700

Name wah2_safr50_a1yv_201612_24_790_011753807_1
Workunit 11753807
Created 4 Apr 2019, 17:35:09 UTC
Sent 4 Apr 2019, 17:56:57 UTC
Report deadline 16 Mar 2020, 23:16:57 UTC
Received 13 Apr 2019, 8:53:22 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 1315603
Run time 8 days 3 hours 13 min 15 sec
CPU time 8 days 1 hours 58 min 38 sec
Validate state Invalid
Credit 14,458.52
Device peak FLOPS 4.14 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 258.35 MB
Peak swap size 223.10 MB
Peak disk usage 89.91 MB
Stderr
<core_client_version>7.6.33</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code -529697949 (0xe06d7363)
</message>
<stderr_txt>


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x74CDC54F

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 04/13/19 09:04:01
Install Directory : 
Data Directory    : D:\UserData\BOINC
Project Symstore  : 
LoadLibraryA( D:\UserData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( D:\UserData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\UserData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\UserData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: D:\UserData\BOINC\projects\climateprediction.net\wah2_safr50_a1yv_201612_24_790_011753807;D:\UserData\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000152000 D:\UserData\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000773c0000 0000000000180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.24335) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 6.1.7601.24335 (win7sp1_ldr_escrow.181228-0954)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24335

ModLoad: 0000000074d20000 0000000000110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.24335) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 6.1.7601.24335 (win7sp1_ldr_escrow.181228-0954)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24335

ModLoad: 0000000074cd0000 0000000000047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.24335) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18015

ModLoad: 0000000076910000 0000000000100000 C:\Windows\syswow64\USER32.dll (6.1.7601.23594) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000076bb0000 0000000000090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.24308) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 6.1.7601.24308 (win7sp1_ldr.181111-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24308

ModLoad: 0000000074e30000 000000000000a000 C:\Windows\syswow64\LPK.dll (6.1.7601.24280) (-exported- Symbols Loaded)
    Linked PDB Filename   : wlpk.pdb
    File Version          : 6.1.7601.24280 (win7sp1_ldr.181006-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24280

ModLoad: 0000000076d80000 000000000009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.23894) (-exported- Symbols Loaded)
    Linked PDB Filename   : usp10.pdb
    File Version          : 1.0626.7601.23894 (win7sp1_ldr.170816-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft(R) Uniscribe Unicode script processor
    Product Version       : 1.0626.7601.23894

ModLoad: 0000000076840000 00000000000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.7601.17744 (win7sp1_gdr.111215-1535)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.7601.17744

ModLoad: 0000000074ff0000 00000000000a1000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.24335) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 6.1.7601.24335 (win7sp1_ldr_escrow.181228-0954)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24335

ModLoad: 0000000076fc0000 0000000000019000 C:\Windows\SysWOW64\sechost.dll (6.1.7601.18869) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000076ed0000 00000000000f0000 C:\Windows\syswow64\RPCRT4.dll (6.1.7601.24335) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000074ae0000 0000000000060000 C:\Windows\syswow64\SspiCli.dll (6.1.7601.24335) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 6.1.7601.24335 (win7sp1_ldr_escrow.181228-0954)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24335

ModLoad: 0000000074ad0000 000000000000c000 C:\Windows\syswow64\CRYPTBASE.dll (6.1.7601.24335) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 6.1.7601.24335 (win7sp1_ldr_escrow.181228-0954)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24335

ModLoad: 0000000076b40000 0000000000060000 C:\Windows\system32\IMM32.DLL (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000075d40000 00000000000cd000 C:\Windows\syswow64\MSCTF.dll (6.1.7601.23915) (-exported- Symbols Loaded)
    Linked PDB Filename   : msctf.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000074850000 0000000000070000 C:\Program Files\AppSense\Environment Manager\Agent\Wow64\EmLoader.dll (10.1.566.2) (-exported- Symbols Loaded)
    Linked PDB Filename   : F:\Builds\17778\EM\10.1-Hotfix\Sources\EM\Client\Output\Win32\Release\PrivatePDBs\EMLoader.pdb
    File Version          : 10.1.566.2
    Company Name          : Ivanti
    Product Name          : Ivanti Environment Manager 10.1 HF2 (FR2)
    Product Version       : 10.1.566.2

ModLoad: 0000000076290000 000000000015f000 C:\Windows\syswow64\ole32.dll (6.1.7601.24291) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 6.1.7601.24291 (win7sp1_ldr_escrow.181110-1429)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24291

ModLoad: 0000000074840000 0000000000003000 C:\Windows\system32\api-ms-win-core-synch-l1-2-0.DLL (10.0.14393.2247) (-exported- Symbols Loaded)
    Linked PDB Filename   : api-ms-win-core-synch-l1-2-0.pdb
    File Version          : 10.0.14393.2247 (rs1_release.180421-1922)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.2247

ModLoad: 0000000074800000 0000000000039000 C:\Program Files (x86)\AppSense\Application Manager\Agent\AMLdrAppInit.dll (10.1.423.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : F:\Builds\17766\AM\10_1_FR2_MSP\Sources\AM\Output\Win32\Release\PrivatePDBs\AMLdrAppInit.pdb
    File Version          : 10.1.423.0
    Company Name          : Ivanti
    Product Name          : Ivanti Application Control 10.1 (FR2)
    Product Version       : 10.1.423.0

ModLoad: 00000000746f0000 0000000000106000 C:\Program Files (x86)\AppSense\Application Manager\Agent\AMAppHook.dll (10.1.423.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : F:\Builds\17766\AM\10_1_FR2_MSP\Sources\AM\Output\Win32\Release\PrivatePDBs\AMAppHook.pdb
    File Version          : 10.1.423.0
    Company Name          : Ivanti
    Product Name          : Ivanti Application Control 10.1 (FR2)
    Product Version       : 10.1.423.0

ModLoad: 0000000075f60000 0000000000035000 C:\Windows\syswow64\WS2_32.dll (6.1.7601.23451) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000074c10000 0000000000006000 C:\Windows\syswow64\NSI.dll (6.1.7601.23889) (-exported- Symbols Loaded)
    Linked PDB Filename   : nsi.pdb
    File Version          : 6.1.7601.23889 (win7sp1_ldr.170810-1615)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.23889

ModLoad: 00000000750a0000 0000000000c4c000 C:\Windows\syswow64\SHELL32.dll (6.1.7601.24234) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000076200000 0000000000057000 C:\Windows\syswow64\SHLWAPI.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000746e0000 0000000000009000 C:\Windows\system32\VERSION.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000718f0000 0000000000246000 C:\Windows\system32\msi.dll (5.0.7601.24195) (-exported- Symbols Loaded)
    Linked PDB Filename   : msi.pdb
    File Version          : 5.0.7601.24195
    Company Name          : Microsoft Corporation
    Product Name          : Windows Installer - Unicode
    Product Version       : 5.0.7601.24195

ModLoad: 0000000074690000 0000000000042000 C:\Windows\system32\wevtapi.dll (6.1.7600.16385) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : wevtapi.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 000000006ecb0000 0000000000021000 C:\Windows\system32\ntmarta.dll (6.1.7600.16385) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : ntmarta.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075cf0000 0000000000045000 C:\Windows\syswow64\WLDAP32.dll (6.1.7601.23889) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : wldap32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 000000006faa0000 0000000000012000 C:\Windows\system32\MPR.dll (6.1.7600.16385) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : mpr.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 000000006edc0000 000000000004c000 C:\Windows\system32\apphelp.dll (6.1.7601.19050) (-exported- Symbols Loaded)
    Linked PDB Filename   : apphelp.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000688c0000 0000000000086000 D:\UserData\BOINC\projects\climateprediction.net\wah2_se_8.24_windows_intelx86.dll (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : F:\cpdn\cpdn\cpdnboinc\monitor\win_build\Release\umtonc.pdb

ModLoad: 0000000065690000 00000000000eb000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 1248405, Write: 0, Other 1009433

- I/O Transfers Counters -
Read: 0, Write: 29475, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 279720, QuotaPeakPagedPoolUsage: 279720
QuotaNonPagedPoolUsage: 10816, QuotaPeakNonPagedPoolUsage: 11376

- Virtual Memory Usage -
VirtualSize: 152936448, PeakVirtualSize: 203743232

- Pagefile Usage -
PagefileUsage: 4915200, PeakPagefileUsage: 55922688

- Working Set Size -
WorkingSetSize: 44650496, PeakWorkingSetSize: 134103040, PageFaultCount: 653163

*** Dump of thread ID 8216 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 571119680.000000, User Time: 3355893504.000000, Wait Time: 363630944.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x74CDC54F

- Registers -
eax=0018e6a4 ebx=07340048 ecx=00000003 edx=00000000 esi=6892922c edi=6893c450
eip=74cdc54f esp=0018e6a4 ebp=0018e6f4
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000212

- Callstack -
ChildEBP RetAddr  Args to Child
0018e6f4 6890caf9 e06d7363 00000001 00000003 0018e720 KERNELBASE!RaiseException+0x0 
0018e72c 68909ebc 0018e73c 689359d8 6892922c 6892b27c wah2_se_8.24_windows_intelx86!+0x0 
0018e74c 688ce42b 03073300 07340048 004e4d99 009b80d8 wah2_se_8.24_windows_intelx86!+0x0 
0018e768 688c29b1 0018e7a0 0018e88c 0018e874 0018e868 wah2_se_8.24_windows_intelx86!+0x0 
0018e9b0 688cefac 06f97d80 0018ea45 00000000 0018eb4c wah2_se_8.24_windows_intelx86!+0x0 
0018eb4c 0040bdf2 004e4d98 004e4ed0 004e4c90 00000000 wah2_se_8.24_windows_intelx86!+0x0 
0018eb84 00401f39 00808f28 00808f60 00808f60 00000000 wah2_8.24_windows_intelx86!+0x0 
0018ebd8 004021ad 000007e2 00000007 00000000 004cefe0 wah2_8.24_windows_intelx86!+0x0 
0018eda0 00402703 000007e2 00000007 025a0040 0018ee00 wah2_8.24_windows_intelx86!+0x0 
0018edb4 0040724e 000007e2 025a0040 004cefe0 004a56b0 wah2_8.24_windows_intelx86!+0x0 
0018ee00 004092c5 00000000 63b01e6e 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 
0018fd48 004094b7 0018fef8 00409535 004d1370 0018fd68 wah2_8.24_windows_intelx86!+0x0 
0018fd50 00409535 004d1370 0018fd68 009c2790 0018fd68 wah2_8.24_windows_intelx86!+0x0 
0018fef8 00485c7b 00400000 00000000 009c27ce 0000000a wah2_8.24_windows_intelx86!+0x0 
0018ff88 74d3343d 7efde000 0018ffd4 773f9802 7efde000 wah2_8.24_windows_intelx86!+0x0 
0018ff94 773f9802 7efde000 5f6ef710 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0018ffd4 773f97d5 00485cce 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
0018ffec 00000000 00485cce 7efde000 00000000 003a0043 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 10236 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 3744024.000000, User Time: 1716011.000000, Wait Time: 363630944.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=0259fd24 edi=00000000
eip=773dfdc1 esp=0259fce0 ebp=0259fd48
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
0259fd48 74ce460c 00000064 00000000 0259ff88 00478b44 ntdll!NtDelayExecution+0x0 
0259fd58 00478b44 00000064 00000000 00000000 00000000 KERNELBASE!Sleep+0x0 
0259ff88 74d3343d 00000000 0259ffd4 773f9802 00000000 wah2_8.24_windows_intelx86!+0x0 
0259ff94 773f9802 00000000 5d2ff710 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0259ffd4 773f97d5 00478b20 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
0259ffec 00000000 00478b20 00000000 00000000 32686177 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 7832 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 363177152.000000

- Registers -
eax=00000000 ebx=7740f524 ecx=00000000 edx=00000000 esi=00a3bcf0 edi=00000000
eip=773e018d esp=06c8fdf4 ebp=06c8ff88
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
06c8ff88 74d3343d 00000000 06c8ffd4 773f9802 00a3bcf0 ntdll!NtWaitForMultipleObjects+0x0 
06c8ff94 773f9802 00a3bcf0 59bef710 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
06c8ffd4 773f97d5 7740f583 00a3bcf0 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
06c8ffec 00000000 7740f583 00a3bcf0 00000000 00000010 ntdll!RtlInitializeExceptionChain+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
No Process Handle
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7440, selfPID=7440, iMonCtr=1
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7440, selfPID=10800, iMonCtr=1

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
12 Apr 2019 22:19:39 1315603 21593700 wah2_safr50_a1yv_201612_24_790_011753807_1 219,179 662,829 3.0241
12 Apr 2019 12:29:07 1315603 21593700 wah2_safr50_a1yv_201612_24_790_011753807_1 207,659 627,957 3.0240
12 Apr 2019 03:01:01 1315603 21593700 wah2_safr50_a1yv_201612_24_790_011753807_1 196,139 592,779 3.0222
11 Apr 2019 17:00:02 1315603 21593700 wah2_safr50_a1yv_201612_24_790_011753807_1 184,619 558,025 3.0226
11 Apr 2019 07:09:03 1315603 21593700 wah2_safr50_a1yv_201612_24_790_011753807_1 173,099 522,849 3.0205
10 Apr 2019 21:13:20 1315603 21593700 wah2_safr50_a1yv_201612_24_790_011753807_1 161,579 487,681 3.0182
10 Apr 2019 11:06:52 1315603 21593700 wah2_safr50_a1yv_201612_24_790_011753807_1 150,059 451,623 3.0096
10 Apr 2019 00:55:29 1315603 21593700 wah2_safr50_a1yv_201612_24_790_011753807_1 138,539 415,005 2.9956
09 Apr 2019 16:06:46 1315603 21593700 wah2_safr50_a1yv_201612_24_790_011753807_1 127,019 380,649 2.9968
09 Apr 2019 06:26:07 1315603 21593700 wah2_safr50_a1yv_201612_24_790_011753807_1 115,499 345,940 2.9952
08 Apr 2019 19:59:11 1315603 21593700 wah2_safr50_a1yv_201612_24_790_011753807_1 103,979 311,844 2.9991
08 Apr 2019 11:03:27 1315603 21593700 wah2_safr50_a1yv_201612_24_790_011753807_1 92,459 277,215 2.9982
08 Apr 2019 00:46:45 1315603 21593700 wah2_safr50_a1yv_201612_24_790_011753807_1 80,939 242,459 2.9956
07 Apr 2019 15:16:37 1315603 21593700 wah2_safr50_a1yv_201612_24_790_011753807_1 69,419 208,512 3.0037
07 Apr 2019 05:30:45 1315603 21593700 wah2_safr50_a1yv_201612_24_790_011753807_1 57,899 173,530 2.9971
06 Apr 2019 19:59:58 1315603 21593700 wah2_safr50_a1yv_201612_24_790_011753807_1 46,379 139,169 3.0007
06 Apr 2019 10:21:15 1315603 21593700 wah2_safr50_a1yv_201612_24_790_011753807_1 34,859 104,877 3.0086
06 Apr 2019 00:38:53 1315603 21593700 wah2_safr50_a1yv_201612_24_790_011753807_1 23,339 70,092 3.0032
05 Apr 2019 14:58:33 1315603 21593700 wah2_safr50_a1yv_201612_24_790_011753807_1 11,819 35,368 2.9925


©2024 climateprediction.net