Task 20162096

Name	wah2_eas50_n4o7_201412_10_505_010859496_0
Workunit	10859496
Created	26 Jan 2017, 17:16:18 UTC
Sent	31 Jan 2017, 23:41:14 UTC
Report deadline	14 Jan 2018, 5:01:14 UTC
Received	25 Mar 2017, 3:34:42 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID	1384440
Run time	1 days 1 hours 12 min 58 sec
CPU time	22 hours 50 min 58 sec
Validate state	Invalid
Credit	1,539.60
Device peak FLOPS	3.04 GFLOPS
Application version	Weather At Home 2 (wah2) v8.24 windows_intelx86
Peak working set size	252.87 MB
Peak swap size	215.30 MB
Peak disk usage	38.20 MB
Stderr	<core_client_version>7.6.33</core_client_version> <![CDATA[ <message> finish file present too long </message> <stderr_txt> 15:43:04 (4908): start_timer_thread(): CreateThread() failed, errno 0 15:43:06 (12220): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:23:39 (1992): start_timer_thread(): CreateThread() failed, errno 0 20:23:41 (6076): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:40:09 (5972): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:11:36 (3308): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:57:44 (1080): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:08:09 (5560): start_timer_thread(): CreateThread() failed, errno 0 23:08:10 (7800): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:17:49 (3312): start_timer_thread(): CreateThread() failed, errno 0 18:44:22 (1556): start_timer_thread(): CreateThread() failed, errno 0 18:44:24 (4828): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:58:35 (4328): start_timer_thread(): CreateThread() failed, errno 0 20:58:36 (7080): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:51:01 (3264): start_timer_thread(): CreateThread() failed, errno 0 21:51:03 (7060): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:50:19 (7064): start_timer_thread(): CreateThread() failed, errno 0 16:50:21 (7156): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:18:28 (4780): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:27:50 (2544): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4156, selfPID=4156, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4156, selfPID=4228, iMonCtr=1 20:26:06 (4112): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:07:36 (6632): start_timer_thread(): CreateThread() failed, errno 0 18:07:37 (5356): start_timer_thread(): CreateThread() failed, errno 0 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5356, selfPID=5356, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5356, selfPID=8080, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_ain::Monitor... 18:32:23 (8080): called boinc_finish(0) CPDN Monitor - Abort request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0111212C Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 7.7.0 Dump Timestamp : 03/24/17 18:37:52 Install Directory : Data Directory : E:\_Apps\Science\Boinc\Data Project Symstore : LoadLibraryA( E:\_Apps\Science\Boinc\Data\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( E:\_Apps\Science\Boinc\Data\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( E:\_Apps\Science\Boinc\Data\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( E:\_Apps\Science\Boinc\Data\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: E:\_Apps\Science\Boinc\Data\projects\climateprediction.net;E:\_Apps\Science\Boinc\Data\projects\climateprediction.net ModLoad: 0000000000400000 0000000000152000 E:\_Apps\Science\Boinc\Data\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 0000000077240000 000000000017b000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.10586.672) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10586.0 ModLoad: 00000000761b0000 00000000000e0000 C:\WINDOWS\SYSTEM32\KERNEL32.DLL (6.2.10586.589) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10586.0 ModLoad: 00000000770c0000 000000000017e000 C:\WINDOWS\SYSTEM32\KERNELBASE.dll (6.2.10586.672) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10586.0 ModLoad: 0000000070b20000 0000000000067000 E:\_Utils\Security\Norton\Norton 360\NortonData\22.5.2.15\Definitions\BASHDefs\20170317.001\UMEngx86.dll (11.1.1.6) (-exported- Symbols Loaded) Linked PDB Filename : C:\bld_area\BehaviorBlocking\BB11.1\Src\11.1.1\Bin\Win32\Release\UMEngx86.pdb File Version : 11.1.1.6 Company Name : Symantec Corporation Product Name : BASH Product Version : 11.1.1.6 ModLoad: 0000000073f90000 0000000000147000 C:\WINDOWS\SYSTEM32\USER32.dll (6.2.10586.713) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10586.0 ModLoad: 00000000755d0000 000000000014f000 C:\WINDOWS\SYSTEM32\GDI32.dll (6.2.10586.753) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 10.0.10586.753 (th2_release_sec.161220-1754) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10586.753 ModLoad: 0000000076020000 000000000007b000 C:\WINDOWS\SYSTEM32\ADVAPI32.dll (6.2.10586.63) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10586.0 ModLoad: 0000000075950000 00000000000be000 C:\WINDOWS\SYSTEM32\msvcrt.dll (7.0.10586.0) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.10586.0 ModLoad: 0000000075f30000 0000000000044000 C:\WINDOWS\SYSTEM32\sechost.dll (6.2.10586.0) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10586.0 ModLoad: 0000000075720000 00000000000ad000 C:\WINDOWS\SYSTEM32\RPCRT4.dll (6.2.10586.306) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10586.0 ModLoad: 0000000073f70000 000000000001e000 C:\WINDOWS\SYSTEM32\SspiCli.dll (6.2.10586.589) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 10.0.10586.589 (th2_release.160906-1759) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10586.589 ModLoad: 0000000073f60000 000000000000a000 C:\WINDOWS\SYSTEM32\CRYPTBASE.dll (6.2.10586.0) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10586.0 ModLoad: 0000000076900000 0000000000058000 C:\WINDOWS\SYSTEM32\bcryptPrimitives.dll (6.2.10586.589) (-exported- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 10.0.10586.589 (th2_release.160906-1759) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10586.589 ModLoad: 0000000077040000 000000000002b000 C:\WINDOWS\SYSTEM32\IMM32.DLL (6.2.10586.0) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10586.0 ModLoad: 0000000071a50000 000000000013f000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.10586.0) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10586.0 ModLoad: 0000000073f50000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.10586.0) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10586.0 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 2096, Write: 0, Other 13620 - I/O Transfers Counters - Read: 0, Write: 3642, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 46224, QuotaPeakPagedPoolUsage: 53128 QuotaNonPagedPoolUsage: 9360, QuotaPeakNonPagedPoolUsage: 9784 - Virtual Memory Usage - VirtualSize: 32100352, PeakVirtualSize: 32100352 - Pagefile Usage - PagefileUsage: 2646016, PeakPagefileUsage: 2879488 - Working Set Size - WorkingSetSize: 5799936, PeakWorkingSetSize: 5963776, PageFaultCount: 1897 * Dump of thread ID 6100 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 6406250.000000, User Time: 12031250.000000, Wait Time: 8981.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0111212C - Registers - eax=00000065 ebx=004b63b9 ecx=0019dc88 edx=0111212c esi=0019da40 edi=0019dcb8 eip=0048ee46 esp=0019d9d4 ebp=0019dc64 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010202 - Callstack - ChildEBP RetAddr Args to Child 0019dc64 0048161c 0019dc88 004b63b8 00000000 0019dcb8 wah2_8.24_windows_intelx86!+0x0 0019dca8 0044fa52 0111212c 004b63b8 004b6484 00000421 wah2_8.24_windows_intelx86!+0x0 0019dcc8 00496e90 0000000b 00000000 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 0019dce0 00485ca1 c0000005 0019dd14 00490c54 00000000 wah2_8.24_windows_intelx86!+0x0 0019ff80 761c38f4 002a6000 761c38d0 da49144a 0019ffdc wah2_8.24_windows_intelx86!+0x0 0019ff94 772a5de3 002a6000 db5bf3ad 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0019ffdc 772a5dae ffffffff 772cb7c3 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 0019ffec 00000000 00485cce 002a6000 00000000 78746341 ntdll!RtlUnicodeStringToInteger+0x0 * Dump of thread ID 6128 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 6196.000000 - Registers - eax=00000000 ebx=008d4710 ecx=00000000 edx=00000000 esi=008d4550 edi=008d3fb8 eip=772b876c esp=0080fdc8 ebp=0080ff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 0080ff80 761c38f4 008d3fb8 761c38d0 dad0144a 0080ffdc ntdll!NtWaitForWorkViaWorkerFactory+0x0 0080ff94 772a5de3 008d3fb8 dbc2f3ad 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0080ffdc 772a5dae ffffffff 772cb7c3 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 0080ffec 00000000 7726c6d0 008d3fb8 00000000 03000000 ntdll!RtlUnicodeStringToInteger+0x0 * Dump of thread ID 6136 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 6196.000000 - Registers - eax=00000000 ebx=008d7e58 ecx=00000000 edx=00000000 esi=008d7c98 edi=008d3fb8 eip=772b876c esp=00acfdc8 ebp=00acff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 00acff80 761c38f4 008d3fb8 761c38d0 dafc144a 00acffdc ntdll!NtWaitForWorkViaWorkerFactory+0x0 00acff94 772a5de3 008d3fb8 dbeef3ad 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 00acffdc 772a5dae ffffffff 772cb7c3 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 00acffec 00000000 7726c6d0 008d3fb8 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 * Dump of thread ID 6140 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 8981.000000 - Registers - eax=00000000 ebx=00030000 ecx=00000000 edx=00000000 esi=00030064 edi=00030064 eip=001d039a esp=00bcff50 ebp=00bcff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000216 - Callstack - ChildEBP RetAddr Args to Child 00bcff80 761c38f4 00030000 761c38d0 daec144a 00bcffdc !+0x0 SymFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '001d039a' 00bcff94 772a5de3 00030000 dbfef3ad 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 SymFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '761c38f4' 00bcffdc 772a5dae ffffffff 772cb7c3 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 SymFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '772a5de3' 00bcffec 00000000 00030064 00030000 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 SymFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '772a5dae' * Dump of thread ID 5180 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 8975.000000 - Registers - eax=00000000 ebx=0134fd1c ecx=00000000 edx=00000000 esi=00000000 edi=00000001 eip=772b6f1c esp=0134fcdc ebp=0134fd40 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 0134fd40 7717a6ff 00000064 00000000 0134ff80 00478b44 ntdll!ZwDelayExecution+0x0 0134fd50 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 0134ff80 761c38f4 00000000 761c38d0 db64144a 0134ffdc wah2_8.24_windows_intelx86!+0x0 0134ff94 772a5de3 00000000 da76f3ad 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0134ffdc 772a5dae ffffffff 772cb7c3 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 0134ffec 00000000 00478b20 00000000 00000000 1afec165 ntdll!RtlUnicodeStringToInteger+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Mar 2017 03:36:43	1384440	20162096	wah2_eas50_n4o7_201412_10_505_010859496_0	23,339	72,315	3.0985
02 Feb 2017 06:46:50	1384440	20162096	wah2_eas50_n4o7_201412_10_505_010859496_0	11,819	36,193	3.0623