climateprediction.net home page
Task 21666748

Task 21666748

Name wah2_sam50_n54w_201412_24_814_011844028_1
Workunit 11844028
Created 14 May 2019, 15:42:23 UTC
Sent 14 May 2019, 16:19:05 UTC
Report deadline 25 Apr 2020, 21:39:05 UTC
Received 6 Jun 2019, 12:22:51 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID 1485461
Run time 3 days 21 hours 1 min 7 sec
CPU time 3 days 14 hours 21 min
Validate state Invalid
Credit 6,859.15
Device peak FLOPS 4.75 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 222.03 MB
Peak swap size 188.33 MB
Peak disk usage 150.79 MB
Stderr 
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
finish file present too long</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15348, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
GCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16
GCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16

GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16

GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16

Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=21896, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=22768, selfPID=19428, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12564, selfPID=16192, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3908, selfPID=17372, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
20:15:58 (17372): called boinc_finish(0)
CPDN Monitor - Abort request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0282912C

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 06/04/19 14:30:24
Install Directory : 
Data Directory    : D:\Documents\BOINC
Project Symstore  : 
LoadLibraryA( D:\Documents\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( D:\Documents\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: D:\Documents\BOINC\projects\climateprediction.net;D:\Documents\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000152000 D:\Documents\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000774c0000 000000000019c000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.17763.475) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 10.0.17763.526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17763.526

ModLoad: 0000000075650000 00000000000e0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.17763.475) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 10.0.17763.526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17763.526

ModLoad: 0000000075f40000 00000000001fa000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.17763.475) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 10.0.17763.526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17763.526

ModLoad: 00000000754b0000 0000000000199000 C:\WINDOWS\System32\USER32.dll (6.2.17763.168) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 10.0.17763.526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17763.526

ModLoad: 0000000075730000 0000000000017000 C:\WINDOWS\System32\win32u.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wwin32u.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000076190000 0000000000023000 C:\WINDOWS\System32\GDI32.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000076650000 0000000000167000 C:\WINDOWS\System32\gdi32full.dll (6.2.17763.475) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32full.pdb
    File Version          : 10.0.17763.475 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.475

ModLoad: 00000000761c0000 0000000000080000 C:\WINDOWS\System32\msvcp_win.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000076820000 0000000000122000 C:\WINDOWS\System32\ucrtbase.dll (6.2.17763.404) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.17763.404 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.404

ModLoad: 0000000075100000 000000000007e000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.17763.526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17763.526

ModLoad: 0000000076240000 00000000000c0000 C:\WINDOWS\System32\msvcrt.dll (7.0.17763.475) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.17763.475 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.17763.475

ModLoad: 0000000077010000 0000000000079000 C:\WINDOWS\System32\sechost.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000076950000 00000000000bf000 C:\WINDOWS\System32\RPCRT4.dll (6.2.17763.379) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 10.0.17763.526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17763.526

ModLoad: 0000000074b30000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000074b20000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 00000000772d0000 0000000000062000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000076a10000 0000000000025000 C:\WINDOWS\System32\IMM32.DLL (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 000000006e130000 000000000018f000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 00000000749d0000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 4092, Write: 0, Other 24526

- I/O Transfers Counters -
Read: 0, Write: 1715, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 93392, QuotaPeakPagedPoolUsage: 93552
QuotaNonPagedPoolUsage: 9984, QuotaPeakNonPagedPoolUsage: 10272

- Virtual Memory Usage -
VirtualSize: 58011648, PeakVirtualSize: 58011648

- Pagefile Usage -
PagefileUsage: 4431872, PeakPagefileUsage: 4431872

- Working Set Size -
WorkingSetSize: 6361088, PeakWorkingSetSize: 6455296, PageFaultCount: 1977

*** Dump of thread ID 10660 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 3281250.000000, User Time: 5000000.000000, Wait Time: 3873.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0282912C

- Registers -
eax=00000065 ebx=004b63b9 ecx=0019dc00 edx=0282912c esi=0019d9b8 edi=0019dc30
eip=0048ee46 esp=0019d94c ebp=0019dbdc
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010202

- Callstack -
ChildEBP RetAddr  Args to Child
0019dbdc 0048161c 0019dc00 004b63b8 00000000 0019dc30 wah2_8.24_windows_intelx86!+0x0 
0019dc20 0044fa52 0282912c 004b63b8 004b6484 00000421 wah2_8.24_windows_intelx86!+0x0 
0019dc40 00496e90 0000000b 00000000 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 
0019dc58 00485ca1 c0000005 0019dc8c 00490c54 00000000 wah2_8.24_windows_intelx86!+0x0 
0019ff70 75670419 002ec000 75670400 0019ffdc 7752662d wah2_8.24_windows_intelx86!+0x0 
0019ff80 7752662d 002ec000 45aa3507 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0019ffdc 775265fd ffffffff 775451b8 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
0019ffec 00000000 00485cce 002ec000 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 11060 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 2402.000000

- Registers -
eax=00000000 ebx=007c5868 ecx=00000000 edx=00000000 esi=007c56a8 edi=007c4358
eip=7753216c esp=00a8fdb4 ebp=00a8ff70
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
00a8ff70 75670419 007c4358 75670400 00a8ffdc 7752662d ntdll!NtWaitForWorkViaWorkerFactory+0x0 
00a8ff80 7752662d 007c4358 451b3507 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
00a8ffdc 775265fd ffffffff 775451b8 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
00a8ffec 00000000 7750e230 007c4358 00000000 62613c00 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 11008 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 2402.000000

- Registers -
eax=00000000 ebx=007c62d8 ecx=00000000 edx=00000000 esi=007c6118 edi=007c4358
eip=7753216c esp=00bbfdb4 ebp=00bbff70
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
00bbff70 75670419 007c4358 75670400 00bbffdc 7752662d ntdll!NtWaitForWorkViaWorkerFactory+0x0 
00bbff80 7752662d 007c4358 45083507 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
00bbffdc 775265fd ffffffff 775451b8 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
00bbffec 00000000 7750e230 007c4358 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 11028 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 2402.000000

- Registers -
eax=00000000 ebx=007c6990 ecx=00000000 edx=00000000 esi=007c67d0 edi=007c4358
eip=7753216c esp=00cbfdb4 ebp=00cbff70
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
00cbff70 75670419 007c4358 75670400 00cbffdc 7752662d ntdll!NtWaitForWorkViaWorkerFactory+0x0 
00cbff80 7752662d 007c4358 45783507 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
00cbffdc 775265fd ffffffff 775451b8 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
00cbffec 00000000 7750e230 007c4358 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 11080 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 3869.000000

- Registers -
eax=00000000 ebx=0275fd0c ecx=00000000 edx=00000000 esi=00000000 edi=0275fd0c
eip=775307ec esp=0275fccc ebp=0275fd30
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
0275fd30 7604dbdf 00000064 00000000 0275ff70 00478b44 ntdll!ZwDelayExecution+0x0 
0275fd40 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 
0275ff70 75670419 00000000 75670400 0275ffdc 7752662d wah2_8.24_windows_intelx86!+0x0 
0275ff80 7752662d 00000000 47c63507 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0275ffdc 775265fd ffffffff 775451b8 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
0275ffec 00000000 00478b20 00000000 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
06 Jun 2019 12:27:36 1485461 21666748 wah2_sam50_n54w_201412_24_814_011844028_1 103,979 297,828 2.8643
06 Jun 2019 12:27:36 1485461 21666748 wah2_sam50_n54w_201412_24_814_011844028_1 92,459 279,757 3.0257
06 Jun 2019 12:27:36 1485461 21666748 wah2_sam50_n54w_201412_24_814_011844028_1 80,939 250,393 3.0936
28 May 2019 15:52:41 1485461 21666748 wah2_sam50_n54w_201412_24_814_011844028_1 69,419 214,627 3.0918
27 May 2019 12:29:14 1485461 21666748 wah2_sam50_n54w_201412_24_814_011844028_1 57,899 179,378 3.0981
23 May 2019 16:25:33 1485461 21666748 wah2_sam50_n54w_201412_24_814_011844028_1 46,379 143,553 3.0952
22 May 2019 10:03:36 1485461 21666748 wah2_sam50_n54w_201412_24_814_011844028_1 34,859 107,783 3.0920
20 May 2019 14:01:17 1485461 21666748 wah2_sam50_n54w_201412_24_814_011844028_1 23,339 72,049 3.0871
16 May 2019 15:45:27 1485461 21666748 wah2_sam50_n54w_201412_24_814_011844028_1 11,819 36,713 3.1063


©2024 climateprediction.net