climateprediction.net home page
Task 20795184

Task 20795184

Name wah2_pnw25_rnyl_200512_24_666_011292672_0
Workunit 11292672
Created 1 Oct 2017, 13:52:20 UTC
Sent 28 Oct 2017, 21:48:37 UTC
Report deadline 11 Oct 2018, 3:08:37 UTC
Received 29 Nov 2017, 22:44:11 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID 1339864
Run time 16 days 17 hours 50 min 53 sec
CPU time 9 days 18 hours 21 min 21 sec
Validate state Invalid
Credit 14,458.52
Device peak FLOPS 3.61 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 238.33 MB
Peak swap size 165.87 MB
Peak disk usage 1.64 MB
Stderr
<core_client_version>7.8.3</core_client_version>
<![CDATA[
<message>
finish file present too long</message>
<stderr_txt>
17:50:59 (17372): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
10:22:07 (9648): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:57:51 (9720): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:26:33 (16024): start_timer_thread(): CreateThread() failed, errno 0
20:26:37 (17780): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:31:16 (9728): start_timer_thread(): CreateThread() failed, errno 0
15:31:18 (12040): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:05:43 (14176): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
18:05:45 (8500): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
02:48:54 (6772): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:03:04 (1360): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:37:39 (18788): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
03:31:25 (13804): start_timer_thread(): CreateThread() failed, errno 0
03:31:26 (10276): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
06:28:20 (16376): start_timer_thread(): CreateThread() failed, errno 0
06:28:21 (7836): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:02:14 (18008): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
00:35:34 (17264): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
02:22:59 (6456): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:54:28 (10572): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
10:33:16 (14232): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
11:46:26 (14184): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:13:34 (12644): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:29:25 (14004): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
23:20:35 (6236): start_timer_thread(): CreateThread() failed, errno 0
23:20:37 (14896): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:58:09 (4752): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:24:07 (11992): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
23:07:29 (11280): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
01:51:26 (18672): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:33:05 (9976): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
06:54:10 (6064): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
10:51:38 (14580): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:53:29 (2556): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:08:09 (7448): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:56:48 (2924): start_timer_thread(): CreateThread() failed, errno 0
04:56:50 (15096): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:49:53 (16484): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
05:46:21 (17872): start_timer_thread(): CreateThread() failed, errno 0
05:46:24 (3384): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
06:33:51 (17200): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:34:20 (18964): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
05:36:58 (6564): start_timer_thread(): CreateThread() failed, errno 0
05:37:00 (10308): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
09:16:30 (9484): start_timer_thread(): CreateThread() failed, errno 0
09:16:34 (13576): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:33:45 (13268): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:45:49 (5028): start_timer_thread(): CreateThread() failed, errno 0
21:45:51 (2012): start_timer_thread(): CreateThread() failed, errno 0
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2012, selfPID=16548, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
16:23:10 (9400): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
12:01:56 (7432): start_timer_thread(): CreateThread() failed, errno 0
12:01:58 (16636): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:20:42 (9096): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:36:11 (2544): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14588, selfPID=8632, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
16:32:26 (8632): called boinc_finish(0)
CPDN Monitor - Abort request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0267A12C

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 11/29/17 16:44:04
Install Directory : 
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000152000 C:\ProgramData\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077210000 000000000018e000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.15063.608) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 10.0.15063.608 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Syst&#232;me d&#146;exploitation Microsoft&#174; Windows&#174;
    Product Version       : 10.0.15063.608

ModLoad: 0000000074680000 00000000000d0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.15063.296) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 10.0.15063.608 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Syst&#232;me d&#146;exploitation Microsoft&#174; Windows&#174;
    Product Version       : 10.0.15063.608

ModLoad: 0000000074f50000 00000000001c2000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.15063.726) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 10.0.15063.608 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Syst&#232;me d&#146;exploitation Microsoft&#174; Windows&#174;
    Product Version       : 10.0.15063.608

ModLoad: 0000000074120000 000000000013c000 C:\WINDOWS\System32\USER32.dll (6.2.15063.726) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 10.0.15063.0 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Syst&#232;me d&#146;exploitation MicrosoftMD WindowsMD
    Product Version       : 10.0.15063.0

ModLoad: 00000000765b0000 0000000000016000 C:\WINDOWS\System32\win32u.dll (6.2.15063.608) (-exported- Symbols Loaded)
    Linked PDB Filename   : wwin32u.pdb
    File Version          : 10.0.15063.608 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.608

ModLoad: 00000000771e0000 0000000000021000 C:\WINDOWS\System32\GDI32.dll (6.2.15063.483) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 10.0.15063.483 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.483

ModLoad: 0000000074260000 0000000000158000 C:\WINDOWS\System32\gdi32full.dll (6.2.15063.674) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32full.pdb
    File Version          : 10.0.15063.674 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.674

ModLoad: 0000000077160000 0000000000079000 C:\WINDOWS\System32\msvcp_win.dll (6.2.15063.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.15063.0 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.0

ModLoad: 0000000074d10000 0000000000118000 C:\WINDOWS\System32\ucrtbase.dll (6.2.15063.674) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.15063.674 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.674

ModLoad: 0000000075140000 0000000000077000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.15063.674) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.15063.0 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Syst&#232;me d&#146;exploitation Microsoft&#174; Windows&#174;
    Product Version       : 10.0.15063.0

ModLoad: 0000000074e30000 00000000000bd000 C:\WINDOWS\System32\msvcrt.dll (7.0.15063.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.15063.0 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.15063.0

ModLoad: 0000000074c80000 0000000000041000 C:\WINDOWS\System32\sechost.dll (6.2.15063.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.15063.0 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.0

ModLoad: 00000000745c0000 00000000000c0000 C:\WINDOWS\System32\RPCRT4.dll (6.2.15063.674) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 10.0.15063.0 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Syst&#232;me d&#146;exploitation Microsoft&#174; Windows&#174;
    Product Version       : 10.0.15063.0

ModLoad: 0000000073ce0000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.15063.674) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 10.0.15063.674 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.674

ModLoad: 0000000073cd0000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.15063.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.15063.0 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.0

ModLoad: 0000000074560000 0000000000057000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.15063.726) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.15063.726 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.726

ModLoad: 0000000076580000 0000000000025000 C:\WINDOWS\System32\IMM32.DLL (6.2.15063.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 10.0.15063.0 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.0

ModLoad: 0000000073160000 000000000015d000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.15063.447) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.15063.447 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.447

ModLoad: 0000000073770000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.15063.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.15063.0 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.0



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 1563, Write: 0, Other 13499

- I/O Transfers Counters -
Read: 0, Write: 1936, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 90504, QuotaPeakPagedPoolUsage: 90640
QuotaNonPagedPoolUsage: 7808, QuotaPeakNonPagedPoolUsage: 8912

- Virtual Memory Usage -
VirtualSize: 51482624, PeakVirtualSize: 54456320

- Pagefile Usage -
PagefileUsage: 3391488, PeakPagefileUsage: 3391488

- Working Set Size -
WorkingSetSize: 6279168, PeakWorkingSetSize: 6279168, PageFaultCount: 1851

*** Dump of thread ID 11648 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 2656250.000000, User Time: 3750000.000000, Wait Time: 42174.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0267A12C

- Registers -
eax=00000065 ebx=004b63b9 ecx=0019d8e8 edx=0267a12c esi=0019d6a0 edi=0019d918
eip=0048ee46 esp=0019d634 ebp=0019d8c4
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010202

- Callstack -
ChildEBP RetAddr  Args to Child
0019d8c4 0048161c 0019d8e8 004b63b8 00000000 0019d918 wah2_8.24_windows_intelx86!+0x0 
0019d908 0044fa52 0267a12c 004b63b8 004b6484 00000421 wah2_8.24_windows_intelx86!+0x0 
0019d928 00496e90 0000000b 00000000 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 
0019d940 00485ca1 c0000005 0019d974 00490c54 00000000 wah2_8.24_windows_intelx86!+0x0 
0019ff80 74698744 00324000 74698720 f1364d67 0019ffdc wah2_8.24_windows_intelx86!+0x0 
0019ff94 7727582d 00324000 d8468698 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0019ffdc 772757fd ffffffff 77296382 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
0019ffec 00000000 00485cce 00324000 00000000 78746341 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 8600 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 42173.000000

- Registers -
eax=00000000 ebx=025afd1c ecx=00000000 edx=00000000 esi=00000000 edi=00000001
eip=7728205c esp=025afcdc ebp=025afd40
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
025afd40 750448cf 00000064 00000000 025aff80 00478b44 ntdll!NtDelayExecution+0x0 
025afd50 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 
025aff80 74698744 00000000 74698720 f3754d67 025affdc wah2_8.24_windows_intelx86!+0x0 
025aff94 7727582d 00000000 da058698 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
025affdc 772757fd ffffffff 77296382 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
025affec 00000000 00478b20 00000000 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
29 Nov 2017 04:25:21 1339864 20795184 wah2_pnw25_rnyl_200512_24_666_011292672_0 219,179 829,985 3.7868
27 Nov 2017 11:46:04 1339864 20795184 wah2_pnw25_rnyl_200512_24_666_011292672_0 207,659 785,356 3.7820
26 Nov 2017 11:59:46 1339864 20795184 wah2_pnw25_rnyl_200512_24_666_011292672_0 196,139 740,373 3.7747
25 Nov 2017 11:13:34 1339864 20795184 wah2_pnw25_rnyl_200512_24_666_011292672_0 184,619 693,531 3.7566
23 Nov 2017 02:27:16 1339864 20795184 wah2_pnw25_rnyl_200512_24_666_011292672_0 173,099 651,137 3.7616
22 Nov 2017 05:23:58 1339864 20795184 wah2_pnw25_rnyl_200512_24_666_011292672_0 161,579 614,447 3.8028
21 Nov 2017 08:58:48 1339864 20795184 wah2_pnw25_rnyl_200512_24_666_011292672_0 150,059 575,299 3.8338
20 Nov 2017 03:40:09 1339864 20795184 wah2_pnw25_rnyl_200512_24_666_011292672_0 138,539 532,708 3.8452
19 Nov 2017 12:32:45 1339864 20795184 wah2_pnw25_rnyl_200512_24_666_011292672_0 127,019 488,540 3.8462
16 Nov 2017 12:27:51 1339864 20795184 wah2_pnw25_rnyl_200512_24_666_011292672_0 115,499 446,368 3.8647
14 Nov 2017 00:29:56 1339864 20795184 wah2_pnw25_rnyl_200512_24_666_011292672_0 103,979 403,792 3.8834
12 Nov 2017 10:43:18 1339864 20795184 wah2_pnw25_rnyl_200512_24_666_011292672_0 92,459 358,536 3.8778
11 Nov 2017 08:00:01 1339864 20795184 wah2_pnw25_rnyl_200512_24_666_011292672_0 80,939 316,425 3.9094
09 Nov 2017 02:36:15 1339864 20795184 wah2_pnw25_rnyl_200512_24_666_011292672_0 69,419 272,322 3.9229
08 Nov 2017 16:40:01 1339864 20795184 wah2_pnw25_rnyl_200512_24_666_011292672_0 57,899 228,900 3.9534
06 Nov 2017 22:15:23 1339864 20795184 wah2_pnw25_rnyl_200512_24_666_011292672_0 46,379 186,962 4.0312
05 Nov 2017 06:46:17 1339864 20795184 wah2_pnw25_rnyl_200512_24_666_011292672_0 34,859 138,296 3.9673
02 Nov 2017 23:39:51 1339864 20795184 wah2_pnw25_rnyl_200512_24_666_011292672_0 23,339 89,124 3.8187
31 Oct 2017 07:08:01 1339864 20795184 wah2_pnw25_rnyl_200512_24_666_011292672_0 11,819 45,832 3.8778


©2024 climateprediction.net