Task 21864426

Name	wah2_anz50_a1ou_201012_31_860_011979805_0
Workunit	11979805
Created	24 Dec 2019, 17:23:53 UTC
Sent	24 Dec 2019, 22:21:24 UTC
Report deadline	6 Dec 2020, 3:41:24 UTC
Received	7 Jan 2020, 22:30:31 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1496348
Run time	11 days 23 hours 32 min 14 sec
CPU time	10 days 8 hours 4 min 39 sec
Validate state	Invalid
Credit	19,018.14
Device peak FLOPS	3.62 GFLOPS
Application version	Weather At Home 2 (wah2) v8.24 windows_intelx86
Peak working set size	231.80 MB
Peak swap size	195.50 MB
Peak disk usage	67.22 MB
Stderr	<core_client_version>7.14.2</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17752, selfPID=9828, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7416, selfPID=15940, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7416, selfPID=7416, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1500, selfPID=1500, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3152, selfPID=3152, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3152, selfPID=19392, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11668, selfPID=11660, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x74E62CF2 Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 7.7.0 Dump Timestamp : 01/07/20 23:27:58 Install Directory : Data Directory : E:\Boing data Project Symstore : LoadLibraryA( E:\Boing data\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( E:\Boing data\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( E:\Boing data\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( E:\Boing data\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: E:\Boing data\projects\climateprediction.net\wah2_anz50_a1ou_201012_31_860_011979805;E:\Boing data\projects\climateprediction.net ModLoad: 0000000000ab0000 00000000008f0000 E:\Boing data\projects\climateprediction.net\wah2rm3m2t_um_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : F:\cpdn\cpdn\cpdnboinc\monitor\win_build\WAH2 Release\wah2rm3m2t.pdb ModLoad: 0000000077c10000 0000000000190000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.17134.799) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 10.0.17134.1124 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 10.0.17134.1124 ModLoad: 00000000746a0000 00000000000e0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.17134.753) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 10.0.17134.858 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 10.0.17134.858 ModLoad: 0000000074d50000 00000000001e4000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.17134.885) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 10.0.17134.858 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 10.0.17134.858 ModLoad: 0000000075a10000 000000000018d000 C:\WINDOWS\System32\USER32.dll (6.2.17134.376) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 10.0.17134.1124 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 10.0.17134.1124 ModLoad: 0000000076280000 0000000000017000 C:\WINDOWS\System32\win32u.dll (6.2.17134.1) (-exported- Symbols Loaded) Linked PDB Filename : wwin32u.pdb File Version : 10.0.17134.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.1 ModLoad: 00000000763f0000 0000000000022000 C:\WINDOWS\System32\GDI32.dll (6.2.17134.285) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 10.0.17134.285 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.285 ModLoad: 0000000077930000 0000000000164000 C:\WINDOWS\System32\gdi32full.dll (6.2.17134.885) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32full.pdb File Version : 10.0.17134.885 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.885 ModLoad: 0000000074c80000 000000000007d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.17134.619) (-exported- Symbols Loaded) Linked PDB Filename : msvcp_win.pdb File Version : 10.0.17134.619 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.619 ModLoad: 0000000074a80000 000000000011d000 C:\WINDOWS\System32\ucrtbase.dll (6.2.17134.677) (-nosymbols- Symbols Loaded) Linked PDB Filename : ucrtbase.pdb File Version : 10.0.17134.677 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.677 ModLoad: 0000000074930000 0000000000078000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.17134.471) (-nosymbols- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 10.0.17134.1124 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 10.0.17134.1124 ModLoad: 0000000075230000 00000000000bf000 C:\WINDOWS\System32\msvcrt.dll (7.0.17134.1) (-nosymbols- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.17134.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.17134.1 ModLoad: 0000000074500000 0000000000044000 C:\WINDOWS\System32\sechost.dll (6.2.17134.319) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 10.0.17134.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.1 ModLoad: 0000000076330000 00000000000c0000 C:\WINDOWS\System32\RPCRT4.dll (6.2.17134.648) (-nosymbols- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 10.0.17134.1124 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 10.0.17134.1124 ModLoad: 00000000744e0000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.17134.376) (-nosymbols- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 10.0.17134.376 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.376 ModLoad: 00000000744d0000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.17134.1) (-nosymbols- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 10.0.17134.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.1 ModLoad: 00000000778d0000 0000000000057000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.17134.885) (-nosymbols- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 10.0.17134.885 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.885 ModLoad: 00000000753b0000 0000000000019000 C:\WINDOWS\System32\imagehlp.dll (6.2.17134.1) (-nosymbols- Symbols Loaded) Linked PDB Filename : imagehlp.pdb File Version : 10.0.17134.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.1 ModLoad: 0000000074a50000 0000000000026000 C:\WINDOWS\System32\IMM32.DLL (6.2.17134.1) (-nosymbols- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 10.0.17134.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.1 ModLoad: 00000000722e0000 0000000000182000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.17134.1) (-nosymbols- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 10.0.17134.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.1 ModLoad: 0000000073220000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.17134.1) (-nosymbols- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 10.0.17134.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.1 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 4, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 54, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 250856, QuotaPeakPagedPoolUsage: 250968 QuotaNonPagedPoolUsage: 9168, QuotaPeakNonPagedPoolUsage: 9168 - Virtual Memory Usage - VirtualSize: 1919827968, PeakVirtualSize: 1919827968 - Pagefile Usage - PagefileUsage: 25440256, PeakPagefileUsage: 40280064 - Working Set Size - WorkingSetSize: 5947392, PeakWorkingSetSize: 5947392, PageFaultCount: 1545 * Dump of thread ID 28600 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 14261226.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x74E62CF2 - Registers - eax=12d1f268 ebx=014ba000 ecx=00000003 edx=00000000 esi=00e438a0 edi=00f2d6ac eip=74e62cf2 esp=12d1f268 ebp=12d1f2c4 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000212 - Callstack - ChildEBP RetAddr Args to Child 12d1f2c4 00de9707 e06d7363 00000001 00000003 12d1f2f0 KERNELBASE!RaiseException+0x0 12d1f2fc 00de62d1 12d1f30c 00e60274 00e438a0 00e58584 wah2rm3m2t_um_8.24_windows_inte!+0x0 12d1f31c 00ab6521 00fd9f80 01000000 00ab90b9 48d20000 wah2rm3m2t_um_8.24_windows_inte!+0x0 12d1f74c 00de86ea 00ab0000 00000000 12ee4ccf 0000000a wah2rm3m2t_um_8.24_windows_inte!+0x0 12d1f7dc 746b8494 014ba000 746b8470 27b41def 12d1f838 wah2rm3m2t_um_8.24_windows_inte!+0x0 12d1f7f0 77c741c8 014ba000 2413cc45 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 12d1f838 77c74198 ffffffff 77c8f35b 00000000 00000000 ntdll!RtlAreBitsSet+0x0 12d1f848 00000000 00de873d 014ba000 00000000 00000000 ntdll!RtlAreBitsSet+0x0 * Dump of thread ID 25512 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 14261221.000000 - Registers - eax=00000000 ebx=12ee5ad8 ecx=00000000 edx=00000000 esi=12ee5918 edi=12ee4910 eip=77c7c58c esp=246ffcbc ebp=246ffe74 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 246ffe74 746b8494 12ee4910 746b8470 110a1497 246ffed0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 246ffe88 77c741c8 12ee4910 12adcaad 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 246ffed0 77c74198 ffffffff 77c8f35b 00000000 00000000 ntdll!RtlAreBitsSet+0x0 246ffee0 00000000 77c61440 12ee4910 00000000 00000000 ntdll!RtlAreBitsSet+0x0 * Dump of thread ID 29552 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 14261221.000000 - Registers - eax=00000000 ebx=12ee66d0 ecx=00000000 edx=00000000 esi=12ee6510 edi=12ee4910 eip=77c7c58c esp=35e1fd14 ebp=35e1fecc cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206 - Callstack - ChildEBP RetAddr Args to Child 35e1fecc 746b8494 12ee4910 746b8470 008414ff 35e1ff28 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 35e1fee0 77c741c8 12ee4910 0323cb55 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 35e1ff28 77c74198 ffffffff 77c8f35b 00000000 00000000 ntdll!RtlAreBitsSet+0x0 35e1ff38 00000000 77c61440 12ee4910 00000000 00000000 ntdll!RtlAreBitsSet+0x0 * Dump of thread ID 22632 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 14261221.000000 - Registers - eax=00000000 ebx=12ee6b08 ecx=00000000 edx=00000000 esi=12ee6948 edi=12ee4910 eip=77c7c58c esp=4753f954 ebp=4753fb0c cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 4753fb0c 746b8494 12ee4910 746b8470 7236113f 4753fb68 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 4753fb20 77c741c8 12ee4910 7191cf15 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 4753fb68 77c74198 ffffffff 77c8f35b 00000000 00000000 ntdll!RtlAreBitsSet+0x0 4753fb78 00000000 77c61440 12ee4910 00000000 00000000 ntdll!RtlAreBitsSet+0x0 * Dump of thread ID 27884 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 14261222.000000 - Registers - eax=00d6a6b0 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=00000001 eip=77c7ac1c esp=701cf928 ebp=701cf98c cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206 - Callstack - ChildEBP RetAddr Args to Child 701cf98c 74e585bf 00000064 00000000 701cfbcc 00d6a6d4 ntdll!ZwDelayExecution+0x0 701cf99c 00d6a6d4 00000064 00d6a6b0 00d6a6b0 00000000 KERNELBASE!Sleep+0x0 701cfbcc 746b8494 00000000 746b8470 457911ff 701cfc28 wah2rm3m2t_um_8.24_windows_inte!+0x0 701cfbe0 77c741c8 00000000 46dec855 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 701cfc28 77c74198 ffffffff 77c8f35b 00000000 00000000 ntdll!RtlAreBitsSet+0x0 701cfc38 00000000 00d6a6b0 00000000 00000000 00000000 ntdll!RtlAreBitsSet+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=22260, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_ain::Monitor... 23:28:02 (22260): called boinc_finish(0) </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>wah2_anz50_a1ou_201012_31_860_011979805_0_r19608736_26.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_anz50_a1ou_201012_31_860_011979805_0_r19608736_27.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_anz50_a1ou_201012_31_860_011979805_0_r19608736_28.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_anz50_a1ou_201012_31_860_011979805_0_r19608736_29.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_anz50_a1ou_201012_31_860_011979805_0_r19608736_30.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_anz50_a1ou_201012_31_860_011979805_0_r19608736_31.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Jan 2020 10:37:20	1496348	21864426	wah2_anz50_a1ou_201012_31_860_011979805_0	288,299	867,802	3.0101
07 Jan 2020 00:37:24	1496348	21864426	wah2_anz50_a1ou_201012_31_860_011979805_0	276,779	835,951	3.0203
06 Jan 2020 07:59:56	1496348	21864426	wah2_anz50_a1ou_201012_31_860_011979805_0	265,259	803,669	3.0298
05 Jan 2020 21:49:00	1496348	21864426	wah2_anz50_a1ou_201012_31_860_011979805_0	253,739	771,745	3.0415
05 Jan 2020 11:11:44	1496348	21864426	wah2_anz50_a1ou_201012_31_860_011979805_0	242,219	739,436	3.0528
05 Jan 2020 00:04:11	1496348	21864426	wah2_anz50_a1ou_201012_31_860_011979805_0	230,699	706,474	3.0623
04 Jan 2020 13:48:06	1496348	21864426	wah2_anz50_a1ou_201012_31_860_011979805_0	219,179	674,300	3.0765
04 Jan 2020 02:45:28	1496348	21864426	wah2_anz50_a1ou_201012_31_860_011979805_0	207,659	640,406	3.0839
03 Jan 2020 15:47:49	1496348	21864426	wah2_anz50_a1ou_201012_31_860_011979805_0	196,139	606,872	3.0941
03 Jan 2020 04:34:15	1496348	21864426	wah2_anz50_a1ou_201012_31_860_011979805_0	184,619	573,588	3.1069
02 Jan 2020 03:05:15	1496348	21864426	wah2_anz50_a1ou_201012_31_860_011979805_0	173,099	539,049	3.1141
01 Jan 2020 16:43:53	1496348	21864426	wah2_anz50_a1ou_201012_31_860_011979805_0	161,579	503,785	3.1179
31 Dec 2019 23:33:00	1496348	21864426	wah2_anz50_a1ou_201012_31_860_011979805_0	150,059	469,751	3.1304
31 Dec 2019 05:39:38	1496348	21864426	wah2_anz50_a1ou_201012_31_860_011979805_0	138,539	438,331	3.1640
30 Dec 2019 17:59:44	1496348	21864426	wah2_anz50_a1ou_201012_31_860_011979805_0	127,019	406,956	3.2039
29 Dec 2019 23:46:11	1496348	21864426	wah2_anz50_a1ou_201012_31_860_011979805_0	115,499	373,820	3.2366
29 Dec 2019 13:03:20	1496348	21864426	wah2_anz50_a1ou_201012_31_860_011979805_0	103,979	339,469	3.2648
29 Dec 2019 02:25:55	1496348	21864426	wah2_anz50_a1ou_201012_31_860_011979805_0	92,459	304,830	3.2969
28 Dec 2019 13:33:41	1496348	21864426	wah2_anz50_a1ou_201012_31_860_011979805_0	80,939	267,352	3.3031
28 Dec 2019 01:22:33	1496348	21864426	wah2_anz50_a1ou_201012_31_860_011979805_0	69,419	229,084	3.3000