Task 20769764

Name	wah2_pnw25_r9x1_199912_24_664_011268968_0
Workunit	11268968
Created	28 Sep 2017, 21:49:07 UTC
Sent	28 Sep 2017, 21:59:03 UTC
Report deadline	11 Sep 2018, 3:19:03 UTC
Received	22 Oct 2017, 22:48:27 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID	1425602
Run time	3 days 13 hours 55 min 8 sec
CPU time	3 days 2 hours 17 min 11 sec
Validate state	Invalid
Credit	3,819.41
Device peak FLOPS	2.05 GFLOPS
Application version	Weather At Home 2 (wah2) v8.24 windows_intelx86
Peak working set size	186.63 MB
Peak swap size	165.85 MB
Peak disk usage	3.26 MB
Stderr	<core_client_version>7.8.2</core_client_version> <![CDATA[ <message> finish file present too long </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:57:31 (3488): start_timer_thread(): CreateThread() failed, errno 0 10:57:32 (7288): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 11:12:05 (12588): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:31:00 (7680): start_timer_thread(): CreateThread() failed, errno 0 11:31:02 (12660): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:47:41 (12488): start_timer_thread(): CreateThread() failed, errno 0 11:47:42 (10516): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:11:34 (13984): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:20:37 (15212): start_timer_thread(): CreateThread() failed, errno 0 12:20:39 (3556): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6056, selfPID=6056, iMonCtr=2 09:31:00 (13768): start_timer_thread(): CreateThread() failed, errno 0 09:31:02 (6232): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:11:10 (14044): start_timer_thread(): CreateThread() failed, errno 0 10:11:11 (5352): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:28:13 (10564): start_timer_thread(): CreateThread() failed, errno 0 10:28:14 (7000): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:31:35 (1440): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:44:10 (5796): start_timer_thread(): CreateThread() failed, errno 0 10:44:11 (6604): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:46:14 (9108): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:31:56 (8252): start_timer_thread(): CreateThread() failed, errno 0 21:31:58 (13256): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 11:00:32 (16076): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 11:13:33 (11016): start_timer_thread(): CreateThread() failed, errno 0 11:13:34 (14228): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:51:31 (860): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 11:38:28 (6820): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:08:30 (11292): start_timer_thread(): CreateThread() failed, errno 0 13:08:32 (16180): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:09:52 (13448): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=324, selfPID=13616, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_ain::Monitor... 17:49:19 (13616): called boinc_finish(0) CPDN Monitor - Abort request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0272C12C Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 7.7.0 Dump Timestamp : 10/22/17 14:48:49 Install Directory : C:\Program Files (x86)\BOINC\ Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\Program Files (x86)\BOINC\\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\Program Files (x86)\BOINC\\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\Program Files (x86)\BOINC\\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\Program Files (x86)\BOINC\\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 0000000000400000 0000000000152000 C:\ProgramData\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 0000000076e80000 000000000018e000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.15063.608) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 10.0.15063.608 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.608 ModLoad: 0000000076c30000 00000000000d0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.15063.296) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 10.0.15063.608 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.608 ModLoad: 00000000747e0000 00000000001c2000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.15063.674) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 10.0.15063.608 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.608 ModLoad: 0000000074b90000 000000000013c000 C:\WINDOWS\System32\USER32.dll (6.2.15063.674) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 0000000074ee0000 0000000000016000 C:\WINDOWS\System32\win32u.dll (6.2.15063.608) (-exported- Symbols Loaded) Linked PDB Filename : wwin32u.pdb File Version : 10.0.15063.608 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.608 ModLoad: 0000000073e20000 0000000000021000 C:\WINDOWS\System32\GDI32.dll (6.2.15063.483) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 10.0.15063.483 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.483 ModLoad: 0000000076d00000 0000000000158000 C:\WINDOWS\System32\gdi32full.dll (6.2.15063.674) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32full.pdb File Version : 10.0.15063.674 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.674 ModLoad: 0000000074230000 0000000000079000 C:\WINDOWS\System32\msvcp_win.dll (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : msvcp_win.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 0000000076ab0000 0000000000118000 C:\WINDOWS\System32\ucrtbase.dll (6.2.15063.674) (-exported- Symbols Loaded) Linked PDB Filename : ucrtbase.pdb File Version : 10.0.15063.674 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.674 ModLoad: 0000000073980000 0000000000077000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.15063.674) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 0000000074fa0000 00000000000bd000 C:\WINDOWS\System32\msvcrt.dll (7.0.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.15063.0 ModLoad: 00000000756b0000 0000000000041000 C:\WINDOWS\System32\sechost.dll (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 0000000074580000 00000000000c0000 C:\WINDOWS\System32\RPCRT4.dll (6.2.15063.674) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 0000000073950000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.15063.674) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 10.0.15063.674 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.674 ModLoad: 0000000073940000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 0000000073e60000 0000000000057000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.15063.138) (-exported- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 10.0.15063.138 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.138 ModLoad: 0000000073ec0000 0000000000025000 C:\WINDOWS\System32\IMM32.DLL (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 000000006cff0000 000000000015d000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.15063.447) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 10.0.15063.447 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.447 ModLoad: 0000000073620000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 8594, Write: 0, Other 76798 - I/O Transfers Counters - Read: 0, Write: 2254, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 90512, QuotaPeakPagedPoolUsage: 90640 QuotaNonPagedPoolUsage: 8624, QuotaPeakNonPagedPoolUsage: 8912 - Virtual Memory Usage - VirtualSize: 55201792, PeakVirtualSize: 55201792 - Pagefile Usage - PagefileUsage: 3186688, PeakPagefileUsage: 3186688 - Working Set Size - WorkingSetSize: 6172672, PeakWorkingSetSize: 6242304, PageFaultCount: 1826 * Dump of thread ID 11476 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 15312500.000000, User Time: 60625000.000000, Wait Time: 786778.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0272C12C - Registers - eax=00000065 ebx=004b63b9 ecx=0019da68 edx=0272c12c esi=0019d820 edi=0019da98 eip=0048ee46 esp=0019d7b4 ebp=0019da44 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010202 - Callstack - ChildEBP RetAddr Args to Child 0019da44 0048161c 0019da68 004b63b8 00000000 0019da98 wah2_8.24_windows_intelx86!+0x0 0019da88 0044fa52 0272c12c 004b63b8 004b6484 00000421 wah2_8.24_windows_intelx86!+0x0 0019daa8 00496e90 0000000b 00000000 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 0019dac0 00485ca1 c0000005 0019daf4 00490c54 00000000 wah2_8.24_windows_intelx86!+0x0 0019ff80 76c48744 00388000 76c48720 e754f5e3 0019ffdc wah2_8.24_windows_intelx86!+0x0 0019ff94 76ee582d 00388000 e7603de0 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0019ffdc 76ee57fd ffffffff 76f0638e 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 0019ffec 00000000 00485cce 00388000 00000000 78746341 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 12304 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 785626.000000 - Registers - eax=00000000 ebx=007d4280 ecx=00000000 edx=00000000 esi=007d4748 edi=007d4908 eip=76ef396c esp=007cfd7c ebp=007cff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 007cff80 76c48744 007d4280 76c48720 e731f5e3 007cffdc ntdll!ZwWaitForWorkViaWorkerFactory+0x0 007cff94 76ee582d 007d4280 e7053de0 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 007cffdc 76ee57fd ffffffff 76f0638e 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 007cffec 00000000 76eba470 007d4280 00000000 f85de12d ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 1240 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 785626.000000 - Registers - eax=00000000 ebx=007d4280 ecx=00000000 edx=00000000 esi=007d52c0 edi=007d5480 eip=76ef396c esp=009cfd7c ebp=009cff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 009cff80 76c48744 007d4280 76c48720 e7d1f5e3 009cffdc ntdll!ZwWaitForWorkViaWorkerFactory+0x0 009cff94 76ee582d 007d4280 e7e53de0 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 009cffdc 76ee57fd ffffffff 76f0638e 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 009cffec 00000000 76eba470 007d4280 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 8492 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 785626.000000 - Registers - eax=00000000 ebx=007d4280 ecx=00000000 edx=00000000 esi=007d5778 edi=007d5938 eip=76ef396c esp=00b0fd7c ebp=00b0ff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 00b0ff80 76c48744 007d4280 76c48720 e7fdf5e3 00b0ffdc ntdll!ZwWaitForWorkViaWorkerFactory+0x0 00b0ff94 76ee582d 007d4280 e7c93de0 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 00b0ffdc 76ee57fd ffffffff 76f0638e 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 00b0ffec 00000000 76eba470 007d4280 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Dump of thread ID 8752 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 786773.000000 - Registers - eax=00000000 ebx=0265fd1c ecx=00000000 edx=00000000 esi=00000000 edi=00000001 eip=76ef205c esp=0265fcdc ebp=0265fd40 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 0265fd40 748d358f 00000064 00000000 0265ff80 00478b44 ntdll!NtDelayExecution+0x0 0265fd50 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 0265ff80 76c48744 00000000 76c48720 e528f5e3 0265ffdc wah2_8.24_windows_intelx86!+0x0 0265ff94 76ee582d 00000000 e51c3de0 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0265ffdc 76ee57fd ffffffff 76f0638e 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 0265ffec 00000000 00478b20 00000000 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Oct 2017 01:18:45	1425602	20769764	wah2_pnw25_r9x1_199912_24_664_011268968_0	57,899	247,168	4.2690
02 Oct 2017 15:39:21	1425602	20769764	wah2_pnw25_r9x1_199912_24_664_011268968_0	46,379	197,975	4.2686
01 Oct 2017 22:49:18	1425602	20769764	wah2_pnw25_r9x1_199912_24_664_011268968_0	34,859	149,994	4.3029
01 Oct 2017 17:56:53	1425602	20769764	wah2_pnw25_r9x1_199912_24_664_011268968_0	23,339	101,640	4.3549
01 Oct 2017 17:56:53	1425602	20769764	wah2_pnw25_r9x1_199912_24_664_011268968_0	11,819	53,283	4.5082