Task 21492732

Name	wah2_eas50_e0hn_201704_18_787_011730991_0
Workunit	11730991
Created	28 Feb 2019, 6:27:41 UTC
Sent	28 Feb 2019, 10:58:49 UTC
Report deadline	10 Feb 2020, 16:18:49 UTC
Received	8 Mar 2019, 9:48:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID	1391258
Run time	5 days 21 hours 19 min 14 sec
CPU time	7 sec
Validate state	Invalid
Credit	12,178.71
Device peak FLOPS	4.46 GFLOPS
Application version	Weather At Home 2 (wah2) v8.24 windows_intelx86
Peak working set size	249.70 MB
Peak swap size	214.33 MB
Peak disk usage	97.36 MB
Stderr	<core_client_version>7.14.2</core_client_version> <![CDATA[ <message> finish file present too long</message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received: Segment violation Signal 11 received: Software termination signal from kill Signal 11 received: Abnormal termination triggered by abort call Signal 11 received, exiting... 23:53:20 (42820): called boinc_finish(193) Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x75D04878 Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 7.7.0 Dump Timestamp : 03/07/19 23:53:21 Install Directory : Data Directory : T:\BOINC Project Symstore : LoadLibraryA( T:\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( T:\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( T:\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( T:\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: T:\BOINC\projects\climateprediction.net\wah2_eas50_e0hn_201704_18_787_011730991;T:\BOINC\projects\climateprediction.net ModLoad: 0000000001060000 00000000008f0000 T:\BOINC\projects\climateprediction.net\wah2rm3m2t_um_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : F:\cpdn\cpdn\cpdnboinc\monitor\win_build\WAH2 Release\wah2rm3m2t.pdb ModLoad: 0000000077160000 000000000016f000 C:\Windows\SYSTEM32\ntdll.dll (6.3.9600.18233) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.3.9600.18217 (winblue_ltsb.160124-0053) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.18217 ModLoad: 00000000755c0000 0000000000140000 C:\Windows\SYSTEM32\KERNEL32.DLL (6.3.9600.17415) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.3.9600.18217 (winblue_ltsb.160124-0053) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.18217 ModLoad: 0000000075cf0000 00000000000d7000 C:\Windows\SYSTEM32\KERNELBASE.dll (6.3.9600.18340) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 6.3.9600.18217 (winblue_ltsb.160124-0053) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.18217 ModLoad: 0000000075700000 0000000000153000 C:\Windows\SYSTEM32\USER32.dll (6.3.9600.18439) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 0000000075540000 000000000007c000 C:\Windows\SYSTEM32\ADVAPI32.dll (6.3.9600.18155) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 0000000075240000 0000000000014000 C:\Windows\SYSTEM32\imagehlp.dll (6.3.9600.17415) (-exported- Symbols Loaded) Linked PDB Filename : imagehlp.pdb File Version : 6.3.9600.17415 (winblue_r4.141028-1500) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.17415 ModLoad: 0000000074a20000 000000000010f000 C:\Windows\SYSTEM32\GDI32.dll (6.3.9600.18344) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.3.9600.18344 (winblue_ltsb.160518-1031) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.18344 ModLoad: 0000000074950000 00000000000c3000 C:\Windows\SYSTEM32\msvcrt.dll (7.0.9600.17415) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.9600.17415 (winblue_r4.141028-1500) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.9600.17415 ModLoad: 0000000074f30000 0000000000041000 C:\Windows\SYSTEM32\sechost.dll (6.3.9600.17734) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 0000000075060000 00000000000ba000 C:\Windows\SYSTEM32\RPCRT4.dll (6.3.9600.18292) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 0000000075260000 000000000001e000 C:\Windows\SYSTEM32\SspiCli.dll (6.3.9600.18454) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 6.3.9600.18454 (winblue_ltsb.160820-0600) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.18454 ModLoad: 0000000074940000 000000000000a000 C:\Windows\SYSTEM32\CRYPTBASE.dll (6.3.9600.17415) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 6.3.9600.17415 (winblue_r4.141028-1500) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.17415 ModLoad: 00000000748e0000 0000000000054000 C:\Windows\SYSTEM32\bcryptPrimitives.dll (6.3.9600.18344) (-exported- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 6.3.9600.18344 (winblue_ltsb.160518-1031) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.18344 ModLoad: 0000000075120000 0000000000027000 C:\Windows\system32\IMM32.DLL (6.3.9600.17415) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 6.3.9600.17415 (winblue_r4.141028-1500) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.17415 ModLoad: 0000000075bd0000 0000000000112000 C:\Windows\SYSTEM32\MSCTF.dll (6.3.9600.18514) (-exported- Symbols Loaded) Linked PDB Filename : msctf.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 00000000746e0000 0000000000141000 C:\Windows\SYSTEM32\dbghelp.dll (6.3.9600.17787) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 6.3.9600.17787 (winblue_r10.150331-1500) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.17787 ModLoad: 0000000074210000 0000000000008000 C:\Windows\SYSTEM32\version.dll (6.3.9600.17415) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 6.3.9600.17415 (winblue_r4.141028-1500) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.17415 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 6, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 66, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 243672, QuotaPeakPagedPoolUsage: 243760 QuotaNonPagedPoolUsage: 7408, QuotaPeakNonPagedPoolUsage: 7408 - Virtual Memory Usage - VirtualSize: 1034674176, PeakVirtualSize: 1034674176 - Pagefile Usage - PagefileUsage: 23900160, PeakPagefileUsage: 39833600 - Working Set Size - WorkingSetSize: 4501504, PeakWorkingSetSize: 4501504, PageFaultCount: 1196 * Dump of thread ID 118788 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 10920267.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x75D04878 - Registers - eax=1306f400 ebx=7f0aa000 ecx=00000003 edx=00000000 esi=013f38a0 edi=014dd6ac eip=75d04878 esp=1306f400 ebp=1306f458 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000216 - Callstack - ChildEBP RetAddr Args to Child 1306f458 01399707 e06d7363 00000001 00000003 1306f484 KERNELBASE!RaiseException+0x0 1306f490 013962d1 1306f4a0 01410274 013f38a0 01408584 wah2rm3m2t_um_8.24_windows_inte!+0x0 1306f4b0 01066521 00fd9f80 01000000 010690b9 14470000 wah2rm3m2t_um_8.24_windows_inte!+0x0 1306f8e0 013986ea 01060000 00000000 00712e52 0000000a wah2rm3m2t_um_8.24_windows_inte!+0x0 1306f970 755d7c04 7f0aa000 755d7be0 ac08357e 1306f9cc wah2rm3m2t_um_8.24_windows_inte!+0x0 1306f984 771bab8f 7f0aa000 ae42490f 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 1306f9cc 771bab5a ffffffff 7719fff0 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 1306f9dc 00000000 0139873d 7f0aa000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 * Dump of thread ID 119248 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 10920266.000000 - Registers - eax=0131a6b0 ebx=3b89fac8 ecx=00000000 edx=00000000 esi=00000000 edi=3b89fac8 eip=7719c57c esp=3b89fa88 ebp=3b89faec cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206 - Callstack - ChildEBP RetAddr Args to Child 3b89faec 75cf104f 00000064 00000000 3b89fd2c 0131a6d4 ntdll!ZwDelayExecution+0x0 3b89fafc 0131a6d4 00000064 0131a6b0 0131a6b0 00000000 KERNELBASE!Sleep+0x0 3b89fd2c 755d7c04 00000000 755d7be0 848731ba 3b89fd88 wah2rm3m2t_um_8.24_windows_inte!+0x0 3b89fd40 771bab8f 00000000 86cd4d4b 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 3b89fd88 771bab5a ffffffff 7719fff0 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 3b89fd98 00000000 0131a6b0 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=117808, selfPID=114304, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_ain::Monitor... 23:53:24 (114304): called boinc_finish(0) CPDN Monitor - Abort request from BOINC... 01:11:45 (3832): called boinc_finish(10) </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Mar 2019 20:50:18	1391258	21492732	wah2_eas50_e0hn_201704_18_787_011730991_0	184,619	444,807	2.4093
07 Mar 2019 05:39:21	1391258	21492732	wah2_eas50_e0hn_201704_18_787_011730991_0	173,099	418,820	2.4195
06 Mar 2019 19:16:21	1391258	21492732	wah2_eas50_e0hn_201704_18_787_011730991_0	161,579	392,736	2.4306
06 Mar 2019 11:25:26	1391258	21492732	wah2_eas50_e0hn_201704_18_787_011730991_0	150,059	365,554	2.4361
06 Mar 2019 00:27:51	1391258	21492732	wah2_eas50_e0hn_201704_18_787_011730991_0	138,539	337,112	2.4333
05 Mar 2019 15:53:23	1391258	21492732	wah2_eas50_e0hn_201704_18_787_011730991_0	127,019	308,706	2.4304
04 Mar 2019 20:07:01	1391258	21492732	wah2_eas50_e0hn_201704_18_787_011730991_0	115,499	281,592	2.4380
04 Mar 2019 03:08:00	1391258	21492732	wah2_eas50_e0hn_201704_18_787_011730991_0	103,979	255,420	2.4565
03 Mar 2019 16:36:28	1391258	21492732	wah2_eas50_e0hn_201704_18_787_011730991_0	92,459	228,480	2.4711
03 Mar 2019 05:48:10	1391258	21492732	wah2_eas50_e0hn_201704_18_787_011730991_0	80,939	200,540	2.4777
02 Mar 2019 19:47:00	1391258	21492732	wah2_eas50_e0hn_201704_18_787_011730991_0	69,419	171,914	2.4765
02 Mar 2019 11:47:36	1391258	21492732	wah2_eas50_e0hn_201704_18_787_011730991_0	57,899	143,341	2.4757
02 Mar 2019 02:48:04	1391258	21492732	wah2_eas50_e0hn_201704_18_787_011730991_0	46,379	114,659	2.4722
01 Mar 2019 17:54:01	1391258	21492732	wah2_eas50_e0hn_201704_18_787_011730991_0	34,859	86,282	2.4752
01 Mar 2019 08:33:43	1391258	21492732	wah2_eas50_e0hn_201704_18_787_011730991_0	23,339	57,076	2.4455
28 Feb 2019 23:29:43	1391258	21492732	wah2_eas50_e0hn_201704_18_787_011730991_0	11,819	28,293	2.3939