climateprediction.net home page
Task 21372119

Task 21372119

Name wah2_sam25_l02y_200012_85_763_011652658_2
Workunit 11652658
Created 7 Nov 2018, 17:26:51 UTC
Sent 7 Nov 2018, 17:34:32 UTC
Report deadline 20 Oct 2019, 22:54:32 UTC
Received 29 Nov 2018, 8:20:14 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1460616
Run time 9 days 8 hours 10 min 2 sec
CPU time 9 days 7 hours 52 min 46 sec
Validate state Invalid
Credit 9,138.96
Device peak FLOPS 3.16 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 417.10 MB
Peak swap size 382.84 MB
Peak disk usage 6.71 MB
Stderr
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_sam25_l02y_200012_85_763_011652658/dataout\l02yga.pdk0dec
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_sam25_l02y_200012_85_763_011652658/dataout\l02yga.pdk1feb
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_sam25_l02y_200012_85_763_011652658/dataout\l02yga.pdk1mar
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_sam25_l02y_200012_85_763_011652658/dataout\l02yga.pdk1apr
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_sam25_l02y_200012_85_763_011652658/dataout\l02yga.pdk1may
CPDN Monitor - Quit request from BOINC...
GCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16
GCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16

GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16

GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7032, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_sam25_l02y_200012_85_763_011652658/dataout\l02yga.pdk1jun
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_sam25_l02y_200012_85_763_011652658/dataout\l02yga.pdk1jul
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_sam25_l02y_200012_85_763_011652658/dataout\l02yga.pdk1aug
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_sam25_l02y_200012_85_763_011652658/dataout\l02yga.pdk1sep
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_sam25_l02y_200012_85_763_011652658/dataout\l02yga.pdk1oct
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_sam25_l02y_200012_85_763_011652658/dataout\l02yga.pdk1nov
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x75E7C54F

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 11/29/18 08:19:58
Install Directory : 
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\wah2_sam25_l02y_200012_85_763_011652658;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 0000000000a10000 0000000000f87000 C:\ProgramData\BOINC\projects\climateprediction.net\wah2am3m2_um_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : F:\cpdn\cpdn\cpdnboinc\monitor\win_build\WAH2 Release\wah2am3m2.pdb

ModLoad: 0000000077640000 0000000000180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.24291) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 6.1.7601.24291 (win7sp1_ldr_escrow.181110-1429)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24291

ModLoad: 0000000075be0000 0000000000110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.24291) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 6.1.7601.24291 (win7sp1_ldr_escrow.181110-1429)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24291

ModLoad: 0000000075e70000 0000000000047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.24291) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 6.1.7601.24291 (win7sp1_ldr_escrow.181110-1429)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24291

ModLoad: 0000000075ed0000 0000000000100000 C:\Windows\syswow64\USER32.dll (6.1.7601.23594) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Operativsystemet Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7601.17514

ModLoad: 0000000075cf0000 0000000000090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.24260) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 6.1.7601.24260 (win7sp1_ldr.180908-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24260

ModLoad: 0000000075fd0000 000000000000a000 C:\Windows\syswow64\LPK.dll (6.1.7601.24231) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : wlpk.pdb
    File Version          : 6.1.7601.24231 (win7sp1_ldr.180810-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24231

ModLoad: 00000000750b0000 000000000009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.23894) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : usp10.pdb
    File Version          : 1.0626.7601.23894 (win7sp1_ldr.170816-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft(R) Uniscribe Unicode script processor
    Product Version       : 1.0626.7601.23894

ModLoad: 0000000076c70000 00000000000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.7601.17744 (win7sp1_gdr.111215-1535)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.7601.17744

ModLoad: 0000000074ff0000 00000000000a1000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.24291) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 6.1.7601.24291 (win7sp1_ldr_escrow.181110-1429)
    Company Name          : Microsoft Corporation
    Product Name          : Operativsystemet Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7601.24291

ModLoad: 0000000075a60000 0000000000019000 C:\Windows\SysWOW64\sechost.dll (6.1.7601.18869) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075d80000 00000000000f0000 C:\Windows\syswow64\RPCRT4.dll (6.1.7601.24291) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Operativsystemet Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 0000000074d60000 0000000000060000 C:\Windows\syswow64\SspiCli.dll (6.1.7601.24291) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 6.1.7601.24291 (win7sp1_ldr_escrow.181110-1429)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24291

ModLoad: 0000000074d50000 000000000000c000 C:\Windows\syswow64\CRYPTBASE.dll (6.1.7601.24291) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 6.1.7601.24291 (win7sp1_ldr_escrow.181110-1429)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24291

ModLoad: 00000000753f0000 000000000002b000 C:\Windows\syswow64\imagehlp.dll (6.1.7601.18288) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : imagehlp.pdb
    File Version          : 6.1.7601.18288 (win7sp1_gdr.131018-1533)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18288

ModLoad: 0000000076d30000 0000000000060000 C:\Windows\system32\IMM32.DLL (6.1.7601.17514) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000077190000 00000000000cd000 C:\Windows\syswow64\MSCTF.dll (6.1.7601.23915) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : msctf.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Operativsystemet Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 000000006fdf0000 00000000000eb000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000072790000 0000000000009000 C:\Windows\system32\version.dll (6.1.7600.16385) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 6, Write: 0, Other 186

- I/O Transfers Counters -
Read: 0, Write: 102, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 262552, QuotaPeakPagedPoolUsage: 262552
QuotaNonPagedPoolUsage: 7080, QuotaPeakNonPagedPoolUsage: 7200

- Virtual Memory Usage -
VirtualSize: 1014620160, PeakVirtualSize: 1014620160

- Pagefile Usage -
PagefileUsage: 16109568, PeakPagefileUsage: 20766720

- Working Set Size -
WorkingSetSize: 5193728, PeakWorkingSetSize: 5193728, PageFaultCount: 1300

*** Dump of thread ID 7808 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 156001.000000, User Time: 0.000000, Wait Time: 36553088.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x75E7C54F

- Registers -
eax=1322f830 ebx=00000000 ecx=00000003 edx=00000000 esi=00dc6230 edi=0112c294
eip=75e7c54f esp=1322f830 ebp=1322f880
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000216

- Callstack -
ChildEBP RetAddr  Args to Child
1322f880 00d69af7 e06d7363 00000001 00000003 1322f8ac KERNELBASE!+0x0 
1322f8b8 00d666e1 1322f8c8 00de2b34 00dc6230 00ddaec4 wah2am3m2_um_8.24_windows_intel!+0x0 
1322f8d8 00a197ea 00500000 002633b1 0026340d 00263435 wah2am3m2_um_8.24_windows_intel!+0x0 
1322fcf4 00d689ff 00a10000 00000000 0026340d 0000000a wah2am3m2_um_8.24_windows_intel!+0x0 
1322fd84 75bf343d 7efde000 1322fdd0 77679802 7efde000 wah2am3m2_um_8.24_windows_intel!+0x0 
1322fd90 77679802 7efde000 45abd6ac 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
1322fdd0 776797d5 00d68a52 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
1322fde8 00000000 00d68a52 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 8360 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 36553088.000000

- Registers -
eax=00cec9b0 ebx=00000000 ecx=00000000 edx=00000000 esi=3c3ef9b8 edi=00000000
eip=7765fdc1 esp=3c3ef974 ebp=3c3ef9dc
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
3c3ef9dc 75e8460c 00000064 00000000 3c3efc1c 00cec9d4 ntdll!NtDelayExecution+0x0 
3c3ef9ec 00cec9d4 00000064 00000000 00000000 00000000 KERNELBASE!+0x0 
3c3efc1c 75bf343d 00000000 3c3efc68 77679802 00000000 wah2am3m2_um_8.24_windows_intel!+0x0 
3c3efc28 77679802 00000000 6ab7d714 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
3c3efc68 776797d5 00cec9b0 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
3c3efc80 00000000 00cec9b0 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x75E7C54F

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 11/29/18 08:19:58
Install Directory : 
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\wah2_sam25_l02y_200012_85_763_011652658;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 0000000000c10000 00000000008f0000 C:\ProgramData\BOINC\projects\climateprediction.net\wah2rm3m2t_um_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : F:\cpdn\cpdn\cpdnboinc\monitor\win_build\WAH2 Release\wah2rm3m2t.pdb

ModLoad: 0000000077640000 0000000000180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.24291) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Operativsystemet Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075be0000 0000000000110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.24291) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : Operativsystemet Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7601.18015

ModLoad: 0000000075e70000 0000000000047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.24291) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : Operativsystemet Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7601.18015

ModLoad: 0000000075ed0000 0000000000100000 C:\Windows\syswow64\USER32.dll (6.1.7601.23594) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Operativsystemet Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7601.17514

ModLoad: 0000000075cf0000 0000000000090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.24260) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 6.1.7601.24260 (win7sp1_ldr.180908-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24260

ModLoad: 0000000075fd0000 000000000000a000 C:\Windows\syswow64\LPK.dll (6.1.7601.24231) (-exported- Symbols Loaded)
    Linked PDB Filename   : wlpk.pdb
    File Version          : 6.1.7601.24231 (win7sp1_ldr.180810-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24231

ModLoad: 00000000750b0000 000000000009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.23894) (-exported- Symbols Loaded)
    Linked PDB Filename   : usp10.pdb
    File Version          : 1.0626.7601.23894 (win7sp1_ldr.170816-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft(R) Uniscribe Unicode script processor
    Product Version       : 1.0626.7601.23894

ModLoad: 0000000076c70000 00000000000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.7601.17744 (win7sp1_gdr.111215-1535)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.7601.17744

ModLoad: 0000000074ff0000 00000000000a1000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.24291) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 6.1.7601.24291 (win7sp1_ldr_escrow.181110-1429)
    Company Name          : Microsoft Corporation
    Product Name          : Operativsystemet Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7601.24291

ModLoad: 0000000075a60000 0000000000019000 C:\Windows\SysWOW64\sechost.dll (6.1.7601.18869) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075d80000 00000000000f0000 C:\Windows\syswow64\RPCRT4.dll (6.1.7601.24291) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Operativsystemet Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 0000000074d60000 0000000000060000 C:\Windows\syswow64\SspiCli.dll (6.1.7601.24291) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 6.1.7601.24291 (win7sp1_ldr_escrow.181110-1429)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24291

ModLoad: 0000000074d50000 000000000000c000 C:\Windows\syswow64\CRYPTBASE.dll (6.1.7601.24291) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 6.1.7601.24291 (win7sp1_ldr_escrow.181110-1429)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24291

ModLoad: 00000000753f0000 000000000002b000 C:\Windows\syswow64\imagehlp.dll (6.1.7601.18288) (-exported- Symbols Loaded)
    Linked PDB Filename   : imagehlp.pdb
    File Version          : 6.1.7601.18288 (win7sp1_gdr.131018-1533)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18288

ModLoad: 0000000076d30000 0000000000060000 C:\Windows\system32\IMM32.DLL (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000077190000 00000000000cd000 C:\Windows\syswow64\MSCTF.dll (6.1.7601.23915) (-exported- Symbols Loaded)
    Linked PDB Filename   : msctf.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Operativsystemet Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 000000006fdf0000 00000000000eb000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000072790000 0000000000009000 C:\Windows\system32\version.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 6, Write: 0, Other 186

- I/O Transfers Counters -
Read: 0, Write: 99, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 249056, QuotaPeakPagedPoolUsage: 249056
QuotaNonPagedPoolUsage: 7080, QuotaPeakNonPagedPoolUsage: 7200

- Virtual Memory Usage -
VirtualSize: 1007710208, PeakVirtualSize: 1007710208

- Pagefile Usage -
PagefileUsage: 9342976, PeakPagefileUsage: 25554944

- Working Set Size -
WorkingSetSize: 5189632, PeakWorkingSetSize: 5189632, PageFaultCount: 1299

*** Dump of thread ID 8692 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 156001.000000, Wait Time: 36553104.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x75E7C54F

- Registers -
eax=12c8f3c0 ebx=7efde000 ecx=00000003 edx=00000000 esi=00fa38a0 edi=0108d6ac
eip=75e7c54f esp=12c8f3c0 ebp=12c8f410
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000216

- Callstack -
ChildEBP RetAddr  Args to Child
12c8f410 00f49707 e06d7363 00000001 00000003 12c8f43c KERNELBASE!RaiseException+0x0 
12c8f448 00f462d1 12c8f458 00fc0274 00fa38a0 00fb8584 wah2rm3m2t_um_8.24_windows_inte!+0x0 
12c8f468 00c16512 01000000 00c190b9 14090000 14093b56 wah2rm3m2t_um_8.24_windows_inte!+0x0 
12c8f894 00f486ea 00c10000 00000000 00593276 0000000a wah2rm3m2t_um_8.24_windows_inte!+0x0 
12c8f924 75bf343d 7efde000 12c8f970 77679802 7efde000 wah2rm3m2t_um_8.24_windows_inte!+0x0 
12c8f930 77679802 7efde000 4441d536 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
12c8f970 776797d5 00f4873d 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
12c8f988 00000000 00f4873d 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 6176 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 36553104.000000

- Registers -
eax=00eca6b0 ebx=00000000 ecx=00000000 edx=00000000 esi=3badfa48 edi=00000000
eip=7765fdc1 esp=3badfa04 ebp=3badfa6c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
3badfa6c 75e8460c 00000064 00000000 3badfcac 00eca6d4 ntdll!NtDelayExecution+0x0 
3badfa7c 00eca6d4 00000064 00000000 00000000 00000000 KERNELBASE!Sleep+0x0 
3badfcac 75bf343d 00000000 3badfcf8 77679802 00000000 wah2rm3m2t_um_8.24_windows_inte!+0x0 
3badfcb8 77679802 00000000 6d24d0be 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
3badfcf8 776797d5 00eca6b0 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
3badfd10 00000000 00eca6b0 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5196, selfPID=7228, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
08:20:01 (7228): called boinc_finish(0)

</stderr_txt><message>
upload failure: <file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_13.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_14.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_15.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_16.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_17.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_18.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_19.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_20.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_21.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_22.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_23.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_24.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_25.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_26.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_27.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_28.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_29.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_30.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_31.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_32.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_33.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_34.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_35.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_36.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_37.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_38.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_39.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_40.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_41.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_42.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_43.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_44.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_45.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_46.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_47.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_48.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_49.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_50.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_51.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_52.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_53.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_54.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_55.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_56.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_57.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_58.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_59.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_60.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_61.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_62.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_63.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_64.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_65.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_66.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_67.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_68.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_69.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_70.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_71.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_72.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_73.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_74.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_75.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_76.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_77.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_78.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_79.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_80.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_81.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_82.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_83.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_84.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_85.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sam25_l02y_200012_85_763_011652658_2_r1257783500_restart.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
27 Nov 2018 09:31:04 1460616 21372119 wah2_sam25_l02y_200012_85_763_011652658_2 138,539 757,281 5.4662
24 Nov 2018 20:43:13 1460616 21372119 wah2_sam25_l02y_200012_85_763_011652658_2 127,019 692,314 5.4505
22 Nov 2018 06:45:46 1460616 21372119 wah2_sam25_l02y_200012_85_763_011652658_2 115,499 625,862 5.4188
20 Nov 2018 06:30:24 1460616 21372119 wah2_sam25_l02y_200012_85_763_011652658_2 103,979 560,367 5.3892
17 Nov 2018 16:45:17 1460616 21372119 wah2_sam25_l02y_200012_85_763_011652658_2 92,459 498,337 5.3898
15 Nov 2018 11:26:51 1460616 21372119 wah2_sam25_l02y_200012_85_763_011652658_2 80,939 439,799 5.4337
13 Nov 2018 20:52:47 1460616 21372119 wah2_sam25_l02y_200012_85_763_011652658_2 69,419 377,321 5.4354
12 Nov 2018 12:10:02 1460616 21372119 wah2_sam25_l02y_200012_85_763_011652658_2 57,899 315,496 5.4491
11 Nov 2018 11:20:32 1460616 21372119 wah2_sam25_l02y_200012_85_763_011652658_2 46,379 251,260 5.4175
10 Nov 2018 17:01:27 1460616 21372119 wah2_sam25_l02y_200012_85_763_011652658_2 34,859 187,121 5.3679
09 Nov 2018 23:51:48 1460616 21372119 wah2_sam25_l02y_200012_85_763_011652658_2 23,339 124,018 5.3138
09 Nov 2018 05:42:31 1460616 21372119 wah2_sam25_l02y_200012_85_763_011652658_2 11,819 58,841 4.9785


©2024 climateprediction.net