Task 20734808

Name	wah2_pnw25_c81p_190312_49_658_011246192_0
Workunit	11246192
Created	15 Sep 2017, 11:05:05 UTC
Sent	16 Sep 2017, 8:12:59 UTC
Report deadline	29 Aug 2018, 13:32:59 UTC
Received	26 Sep 2017, 9:41:39 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID	1339864
Run time	8 days 1 hours 31 min 37 sec
CPU time	7 days 5 hours 45 min 1 sec
Validate state	Invalid
Credit	10,658.83
Device peak FLOPS	3.62 GFLOPS
Application version	Weather At Home 2 (wah2) v8.24 windows_intelx86
Peak working set size	214.12 MB
Peak swap size	165.86 MB
Peak disk usage	0.02 MB
Stderr	<core_client_version>7.6.33</core_client_version> <![CDATA[ <message> finish file present too long </message> <stderr_txt> 04:15:35 (12732): start_timer_thread(): CreateThread() failed, errno 0 04:15:37 (7580): start_timer_thread(): CreateThread() failed, errno 0 Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c81p_190312_49_658_011246192/dataout\c81pga.pda3dec Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c81p_190312_49_658_011246192/dataout\c81pga.pda4feb Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c81p_190312_49_658_011246192/dataout\c81pga.pda4mar Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c81p_190312_49_658_011246192/dataout\c81pga.pda4apr Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c81p_190312_49_658_011246192/dataout\c81pga.pda4may Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c81p_190312_49_658_011246192/dataout\c81pga.pda4jun CPDN Monitor - Quit request from BOINC... 17:56:57 (14060): start_timer_thread(): CreateThread() failed, errno 0 Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c81p_190312_49_658_011246192/dataout\c81pga.pda4jul CPDN Monitor - Quit request from BOINC... 15:30:33 (18872): start_timer_thread(): CreateThread() failed, errno 0 15:30:35 (19348): start_timer_thread(): CreateThread() failed, errno 0 Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c81p_190312_49_658_011246192/dataout\c81pga.pda4aug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:34:22 (6420): start_timer_thread(): CreateThread() failed, errno 0 02:34:24 (4836): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 08:50:41 (18516): start_timer_thread(): CreateThread() failed, errno 0 08:50:43 (16476): start_timer_thread(): CreateThread() failed, errno 0 Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c81p_190312_49_658_011246192/dataout\c81pga.pda4sep Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c81p_190312_49_658_011246192/dataout\c81pga.pda4oct Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c81p_190312_49_658_011246192/dataout\c81pga.pda4nov Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_c81p_190312_49_658_011246192/dataout\c81pga.pda4dec CPDN Monitor - Quit request from BOINC... 15:29:13 (7720): start_timer_thread(): CreateThread() failed, errno 0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16424, selfPID=19920, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_ain::Monitor... 04:25:45 (19920): called boinc_finish(0) CPDN Monitor - Abort request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0271812C Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 7.7.0 Dump Timestamp : 09/26/17 04:40:40 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 0000000000400000 0000000000152000 C:\ProgramData\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 0000000077170000 000000000018e000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.15063.608) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 10.0.15063.608 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 10.0.15063.608 ModLoad: 0000000075030000 00000000000d0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.15063.296) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 10.0.15063.608 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 10.0.15063.608 ModLoad: 0000000074e60000 00000000001c2000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.15063.608) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 10.0.15063.608 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 10.0.15063.608 ModLoad: 00000000749f0000 000000000013c000 C:\WINDOWS\System32\USER32.dll (6.2.15063.608) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Système dexploitation MicrosoftMD WindowsMD Product Version : 10.0.15063.0 ModLoad: 0000000074cd0000 0000000000016000 C:\WINDOWS\System32\win32u.dll (6.2.15063.608) (-exported- Symbols Loaded) Linked PDB Filename : wwin32u.pdb File Version : 10.0.15063.608 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.608 ModLoad: 0000000074080000 0000000000021000 C:\WINDOWS\System32\GDI32.dll (6.2.15063.483) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 10.0.15063.483 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.483 ModLoad: 0000000077000000 0000000000158000 C:\WINDOWS\System32\gdi32full.dll (6.2.15063.608) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32full.pdb File Version : 10.0.15063.608 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.608 ModLoad: 0000000076f80000 0000000000079000 C:\WINDOWS\System32\msvcp_win.dll (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : msvcp_win.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 00000000748d0000 0000000000118000 C:\WINDOWS\System32\ucrtbase.dll (6.2.15063.447) (-exported- Symbols Loaded) Linked PDB Filename : ucrtbase.pdb File Version : 10.0.15063.447 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.447 ModLoad: 0000000076e10000 0000000000077000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 10.0.15063.0 ModLoad: 0000000075850000 00000000000bd000 C:\WINDOWS\System32\msvcrt.dll (7.0.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.15063.0 ModLoad: 0000000074200000 0000000000041000 C:\WINDOWS\System32\sechost.dll (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 0000000076d20000 00000000000c0000 C:\WINDOWS\System32\RPCRT4.dll (6.2.15063.447) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 10.0.15063.0 ModLoad: 0000000073c40000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 0000000073c30000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 00000000740b0000 0000000000057000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.15063.138) (-exported- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 10.0.15063.138 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.138 ModLoad: 0000000074310000 0000000000025000 C:\WINDOWS\System32\IMM32.DLL (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 000000006fb70000 000000000015d000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.15063.447) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 10.0.15063.447 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.447 ModLoad: 0000000073b60000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 430, Write: 0, Other 3659 - I/O Transfers Counters - Read: 0, Write: 1946, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 90504, QuotaPeakPagedPoolUsage: 90640 QuotaNonPagedPoolUsage: 8624, QuotaPeakNonPagedPoolUsage: 9048 - Virtual Memory Usage - VirtualSize: 55296000, PeakVirtualSize: 55296000 - Pagefile Usage - PagefileUsage: 3309568, PeakPagefileUsage: 3309568 - Working Set Size - WorkingSetSize: 6254592, PeakWorkingSetSize: 6287360, PageFaultCount: 1841 * Dump of thread ID 9464 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 1250000.000000, User Time: 1250000.000000, Wait Time: 54483.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0271812C - Registers - eax=00000065 ebx=004b63b9 ecx=0019d8e8 edx=0271812c esi=0019d6a0 edi=0019d918 eip=0048ee46 esp=0019d634 ebp=0019d8c4 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010202 - Callstack - ChildEBP RetAddr Args to Child 0019d8c4 0048161c 0019d8e8 004b63b8 00000000 0019d918 wah2_8.24_windows_intelx86!+0x0 0019d908 0044fa52 0271812c 004b63b8 004b6484 00000421 wah2_8.24_windows_intelx86!+0x0 0019d928 00496e90 0000000b 00000000 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 0019d940 00485ca1 c0000005 0019d974 00490c54 00000000 wah2_8.24_windows_intelx86!+0x0 0019ff80 75048744 003ed000 75048720 37691fe8 0019ffdc wah2_8.24_windows_intelx86!+0x0 0019ff94 771d582d 003ed000 f8e5fe64 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0019ffdc 771d57fd ffffffff 771f637a 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 0019ffec 00000000 00485cce 003ed000 00000000 78746341 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 13568 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 53107.000000 - Registers - eax=00000000 ebx=00684b20 ecx=00000000 edx=00000000 esi=00687fd8 edi=00688198 eip=771e396c esp=0087fd7c ebp=0087ff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 0087ff80 75048744 00684b20 75048720 37f71fe8 0087ffdc ntdll!ZwWaitForWorkViaWorkerFactory+0x0 0087ff94 771d582d 00684b20 f87bfe64 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0087ffdc 771d57fd ffffffff 771f637a 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 0087ffec 00000000 771aa470 00684b20 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 13644 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 53107.000000 - Registers - eax=00000000 ebx=00684b20 ecx=00000000 edx=00000000 esi=0068a8e0 edi=0068aaa0 eip=771e396c esp=009bfd7c ebp=009bff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 009bff80 75048744 00684b20 75048720 37eb1fe8 009bffdc ntdll!ZwWaitForWorkViaWorkerFactory+0x0 009bff94 771d582d 00684b20 f867fe64 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 009bffdc 771d57fd ffffffff 771f637a 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 009bffec 00000000 771aa470 00684b20 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 13652 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 53107.000000 - Registers - eax=00000000 ebx=00684b20 ecx=00000000 edx=00000000 esi=00689fa8 edi=0068a168 eip=771e396c esp=00affd7c ebp=00afff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 00afff80 75048744 00684b20 75048720 37df1fe8 00afffdc ntdll!ZwWaitForWorkViaWorkerFactory+0x0 00afff94 771d582d 00684b20 f853fe64 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 00afffdc 771d57fd ffffffff 771f637a 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 00afffec 00000000 771aa470 00684b20 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 13548 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 54478.000000 - Registers - eax=00000000 ebx=0264fd1c ecx=00000000 edx=00000000 esi=00000000 edi=00000001 eip=771e205c esp=0264fcdc ebp=0264fd40 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 0264fd40 74f5354f 00000064 00000000 0264ff80 00478b44 ntdll!NtDelayExecution+0x0 0264fd50 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 0264ff80 75048744 00000000 75048720 35141fe8 0264ffdc wah2_8.24_windows_intelx86!+0x0 0264ff94 771d582d 00000000 fa98fe64 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0264ffdc 771d57fd ffffffff 771f637a 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 0264ffec 00000000 00478b20 00000000 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Sep 2017 10:23:39	1339864	20734808	wah2_pnw25_c81p_190312_49_658_011246192_0	161,579	609,074	3.7695
26 Sep 2017 10:04:25	1339864	20734808	wah2_pnw25_c81p_190312_49_658_011246192_0	150,059	561,528	3.7420
24 Sep 2017 13:48:25	1339864	20734808	wah2_pnw25_c81p_190312_49_658_011246192_0	138,539	517,836	3.7378
24 Sep 2017 01:51:04	1339864	20734808	wah2_pnw25_c81p_190312_49_658_011246192_0	127,019	476,156	3.7487
23 Sep 2017 14:41:27	1339864	20734808	wah2_pnw25_c81p_190312_49_658_011246192_0	115,499	437,304	3.7862
22 Sep 2017 07:42:28	1339864	20734808	wah2_pnw25_c81p_190312_49_658_011246192_0	103,979	397,068	3.8187
21 Sep 2017 04:03:00	1339864	20734808	wah2_pnw25_c81p_190312_49_658_011246192_0	92,459	345,350	3.7352
19 Sep 2017 23:09:31	1339864	20734808	wah2_pnw25_c81p_190312_49_658_011246192_0	80,939	293,465	3.6258
19 Sep 2017 08:29:45	1339864	20734808	wah2_pnw25_c81p_190312_49_658_011246192_0	69,419	246,518	3.5512
18 Sep 2017 21:30:45	1339864	20734808	wah2_pnw25_c81p_190312_49_658_011246192_0	57,899	207,953	3.5917
18 Sep 2017 09:46:57	1339864	20734808	wah2_pnw25_c81p_190312_49_658_011246192_0	46,379	167,232	3.6058
17 Sep 2017 20:45:05	1339864	20734808	wah2_pnw25_c81p_190312_49_658_011246192_0	34,859	123,323	3.5378
17 Sep 2017 08:35:15	1339864	20734808	wah2_pnw25_c81p_190312_49_658_011246192_0	23,339	81,256	3.4816
16 Sep 2017 20:14:27	1339864	20734808	wah2_pnw25_c81p_190312_49_658_011246192_0	11,819	40,171	3.3988