climateprediction.net home page
Task 18765988

Task 18765988

Name hadcm3s_arl0_1988_2_010065694_0
Workunit 10045284
Created 10 Aug 2015, 19:54:14 UTC
Sent 10 Aug 2015, 19:55:25 UTC
Report deadline 10 Nov 2015, 3:22:36 UTC
Received 16 Aug 2015, 0:54:15 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID 486496
Run time 2 days 5 hours 41 min 31 sec
CPU time 2 days 0 hours 23 min 17 sec
Validate state Invalid
Credit 311.04
Device peak FLOPS 1.41 GFLOPS
Application version UK Met Office HadCM3 short v7.24
windows_intelx86
Stderr
<core_client_version>7.0.64</core_client_version>
<![CDATA[
<message>
too many boinc_temporary_exit()s
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
09:35:37 (6900): BOINC client no longer exists - exiting
09:35:40 (6900): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
10:01:10 (7628): No heartbeat from client for 30 sec - exiting
10:01:10 (7628): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812FD3

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.2.4


Dump Timestamp    : 08/13/15 12:45:44
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\Documents and Settings\All Users\Application Data\BOINC
Project Symstore  : 
Loaded Library    : C:\Program Files\BOINC\\dbghelp.dll
Loaded Library    : C:\Program Files\BOINC\\symsrv.dll
Loaded Library    : C:\Program Files\BOINC\\srcsrv.dll
LoadLibraryA( C:\Program Files\BOINC\\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3s_arl0_1988_2_010065694;C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000c36000 C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3s_um_7.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000007c900000 00000000000b2000 C:\WINDOWS\system32\ntdll.dll (5.1.2600.6055) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 5.1.2600.6055 (xpsp_sp3_gdr.101209-1647)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 5.1.2600.6055

ModLoad: 000000007c800000 00000000000f6000 C:\WINDOWS\system32\kernel32.dll (5.1.2600.6532) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 5.1.2600.6532 (xpsp_sp3_qfe.140312-0419)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 5.1.2600.6532

ModLoad: 000000007e410000 0000000000091000 C:\WINDOWS\system32\USER32.dll (5.1.2600.5512) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 5.1.2600.5512 (xpsp.080413-2105)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 5.1.2600.5512

ModLoad: 0000000077f10000 0000000000049000 C:\WINDOWS\system32\GDI32.dll (5.1.2600.6460) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 5.1.2600.6460 (xpsp_sp3_qfe.131009-0419)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 5.1.2600.6460

ModLoad: 0000000077dd0000 000000000009b000 C:\WINDOWS\system32\ADVAPI32.dll (5.1.2600.5755) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 5.1.2600.5755 (xpsp_sp3_gdr.090206-1234)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 5.1.2600.5755

ModLoad: 0000000077e70000 0000000000093000 C:\WINDOWS\system32\RPCRT4.dll (5.1.2600.6477) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 5.1.2600.6477 (xpsp_sp3_qfe.131106-0418)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 5.1.2600.6477

ModLoad: 0000000077fe0000 0000000000011000 C:\WINDOWS\system32\Secur32.dll (5.1.2600.5834) (-exported- Symbols Loaded)
    Linked PDB Filename   : secur32.pdb
    File Version          : 5.1.2600.5834 (xpsp_sp3_gdr.090624-1305)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 5.1.2600.5834

ModLoad: 0000000076c90000 0000000000029000 C:\WINDOWS\system32\imagehlp.dll (5.1.2600.6479) (-exported- Symbols Loaded)
    Linked PDB Filename   : imagehlp.pdb
    File Version          : 5.1.2600.6479 (xpsp_sp3_qfe.131113-0419)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 5.1.2600.6479

ModLoad: 0000000077c10000 0000000000058000 C:\WINDOWS\system32\msvcrt.dll (7.0.2600.5512) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.2600.5512 (xpsp.080413-2111)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.2600.5512

ModLoad: 0000000076390000 000000000001d000 C:\WINDOWS\system32\IMM32.DLL (5.1.2600.5512) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 5.1.2600.5512 (xpsp.080413-2105)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 5.1.2600.5512

ModLoad: 0000000011fe0000 0000000000115000 C:\Program Files\BOINC\dbghelp.dll (6.8.4.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 6.8.0004.0 (debuggers(dbg).070515-1751)
    Company Name          : Microsoft Corporation
    Product Name          : Debugging Tools for Windows(R)
    Product Version       : 6.8.0004.0

ModLoad: 0000000012200000 0000000000048000 C:\Program Files\BOINC\symsrv.dll (6.8.4.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : symsrv.pdb
    File Version          : 6.8.0004.0 (debuggers(dbg).070515-1751)
    Company Name          : Microsoft Corporation
    Product Name          : Debugging Tools for Windows(R)
    Product Version       : 6.8.0004.0

ModLoad: 0000000012250000 000000000003b000 C:\Program Files\BOINC\srcsrv.dll (6.8.4.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : srcsrv.pdb
    File Version          : 6.8.0004.0 (debuggers(dbg).070515-1751)
    Company Name          : Microsoft Corporation
    Product Name          : Debugging Tools for Windows(R)
    Product Version       : 6.8.0004.0

ModLoad: 0000000077c00000 0000000000008000 C:\WINDOWS\system32\version.dll (5.1.2600.5512) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 5.1.2600.5512 (xpsp.080413-2105)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 5.1.2600.5512



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 4, Write: 0, Other 186

- I/O Transfers Counters -
Read: 0, Write: 273, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 30392, QuotaPeakPagedPoolUsage: 30392
QuotaNonPagedPoolUsage: 1944, QuotaPeakNonPagedPoolUsage: 2864

- Virtual Memory Usage -
VirtualSize: 852910080, PeakVirtualSize: 852910080

- Pagefile Usage -
PagefileUsage: 16068608, PeakPagefileUsage: 32673792

- Working Set Size -
WorkingSetSize: 2121728, PeakWorkingSetSize: 2121728, PageFaultCount: 560

*** Dump of thread ID 2604 (state: Ready): ***

- Information -
Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 625000.000000, User Time: 0.000000, Wait Time: 17870604.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812FD3

- Registers -
eax=1143fa58 ebx=7ffdf000 ecx=00000000 edx=009e8ef8 esi=1143fae0 edi=009e849c
eip=7c812fd3 esp=1143fa54 ebp=1143faa8
cs=001b  ss=0023  ds=0023  es=0023  fs=003b  gs=0000             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
1143faa8 007b2d27 e06d7363 00000001 00000003 1143fad4 kernel32!RaiseException+0x0 
1143fae0 007afae1 1143faf0 0083a2cc 0080e158 00832824 hadcm3s_um_7.24_windows_intelx8!+0x0 
1143fb00 0040642d 01000000 00500000 00407892 11650000 hadcm3s_um_7.24_windows_intelx8!+0x0 
1143ff30 007b1c2a 00400000 00000000 00052391 0000000a hadcm3s_um_7.24_windows_intelx8!+0x0 
1143ffc0 7c816037 00153a8c 00000000 7ffdf000 e06d7363 hadcm3s_um_7.24_windows_intelx8!+0x0 
1143fff0 00000000 007b1c7d 00000000 00000000 00000000 kernel32!RegisterWaitForInputIdle+0x0 

*** Dump of thread ID 6492 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 17870598.000000

- Registers -
eax=00000074 ebx=00000000 ecx=00000000 edx=4234f874 esi=00000000 edi=4234fd4c
eip=7c90e514 esp=4234fd1c ebp=4234fd74
cs=001b  ss=0023  ds=0023  es=0023  fs=003b  gs=0000             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
4234fd74 7c802455 00000064 00000000 4234ffb4 007352f4 ntdll!KiFastSystemCallRet+0x0 
4234fd84 007352f4 00000064 00736380 003d6b00 00000000 kernel32!Sleep+0x0 
4234ffb4 7c80b729 00000000 00736380 003d6b00 00000000 hadcm3s_um_7.24_windows_intelx8!+0x0 
4234ffec 00000000 007352d0 00000000 00000000 00000000 kernel32!GetModuleFileNameA+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6344, iMonCtr=1
Model crash detected, will try to restart...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812FD3

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.2.4


Dump Timestamp    : 08/13/15 12:46:32
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\Documents and Settings\All Users\Application Data\BOINC
Project Symstore  : 
Loaded Library    : C:\Program Files\BOINC\\dbghelp.dll
Loaded Library    : C:\Program Files\BOINC\\symsrv.dll
Loaded Library    : C:\Program Files\BOINC\\srcsrv.dll
LoadLibraryA( C:\Program Files\BOINC\\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3s_arl0_1988_2_010065694;C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000c36000 C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3s_um_7.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000007c900000 00000000000b2000 C:\WINDOWS\system32\ntdll.dll (5.1.2600.6055) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 5.1.2600.6055 (xpsp_sp3_gdr.101209-1647)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 5.1.2600.6055

ModLoad: 000000007c800000 00000000000f6000 C:\WINDOWS\system32\kernel32.dll (5.1.2600.6532) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 5.1.2600.6532 (xpsp_sp3_qfe.140312-0419)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 5.1.2600.6532

ModLoad: 000000007e410000 0000000000091000 C:\WINDOWS\system32\USER32.dll (5.1.2600.5512) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 5.1.2600.5512 (xpsp.080413-2105)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 5.1.2600.5512

ModLoad: 0000000077f10000 0000000000049000 C:\WINDOWS\system32\GDI32.dll (5.1.2600.6460) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 5.1.2600.6460 (xpsp_sp3_qfe.131009-0419)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 5.1.2600.6460

ModLoad: 0000000077dd0000 000000000009b000 C:\WINDOWS\system32\ADVAPI32.dll (5.1.2600.5755) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 5.1.2600.5755 (xpsp_sp3_gdr.090206-1234)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 5.1.2600.5755

ModLoad: 0000000077e70000 0000000000093000 C:\WINDOWS\system32\RPCRT4.dll (5.1.2600.6477) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 5.1.2600.6477 (xpsp_sp3_qfe.131106-0418)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 5.1.2600.6477

ModLoad: 0000000077fe0000 0000000000011000 C:\WINDOWS\system32\Secur32.dll (5.1.2600.5834) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : secur32.pdb
    File Version          : 5.1.2600.5834 (xpsp_sp3_gdr.090624-1305)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 5.1.2600.5834

ModLoad: 0000000076c90000 0000000000029000 C:\WINDOWS\system32\imagehlp.dll (5.1.2600.6479) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : imagehlp.pdb
    File Version          : 5.1.2600.6479 (xpsp_sp3_qfe.131113-0419)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 5.1.2600.6479

ModLoad: 0000000077c10000 0000000000058000 C:\WINDOWS\system32\msvcrt.dll (7.0.2600.5512) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.2600.5512 (xpsp.080413-2111)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.2600.5512

ModLoad: 0000000076390000 000000000001d000 C:\WINDOWS\system32\IMM32.DLL (5.1.2600.5512) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 5.1.2600.5512 (xpsp.080413-2105)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 5.1.2600.5512

ModLoad: 0000000012ff0000 0000000000115000 C:\Program Files\BOINC\dbghelp.dll (6.8.4.0) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 6.8.0004.0 (debuggers(dbg).070515-1751)
    Company Name          : Microsoft Corporation
    Product Name          : Debugging Tools for Windows(R)
    Product Version       : 6.8.0004.0

ModLoad: 0000000013210000 0000000000048000 C:\Program Files\BOINC\symsrv.dll (6.8.4.0) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : symsrv.pdb
    File Version          : 6.8.0004.0 (debuggers(dbg).070515-1751)
    Company Name          : Microsoft Corporation
    Product Name          : Debugging Tools for Windows(R)
    Product Version       : 6.8.0004.0

ModLoad: 0000000013260000 000000000003b000 C:\Program Files\BOINC\srcsrv.dll (6.8.4.0) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : srcsrv.pdb
    File Version          : 6.8.0004.0 (debuggers(dbg).070515-1751)
    Company Name          : Microsoft Corporation
    Product Name          : Debugging Tools for Windows(R)
    Product Version       : 6.8.0004.0

ModLoad: 0000000077c00000 0000000000008000 C:\WINDOWS\system32\version.dll (5.1.2600.5512) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 5.1.2600.5512 (xpsp.080413-2105)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 5.1.2600.5512



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 4, Write: 0, Other 186

- I/O Transfers Counters -
Read: 0, Write: 273, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 30392, QuotaPeakPagedPoolUsage: 30392
QuotaNonPagedPoolUsage: 1992, QuotaPeakNonPagedPoolUsage: 2864

- Virtual Memory Usage -
VirtualSize: 869691392, PeakVirtualSize: 869691392

- Pagefile Usage -
PagefileUsage: 32870400, PeakPagefileUsage: 106151936

- Working Set Size -
WorkingSetSize: 2134016, PeakWorkingSetSize: 2134016, PageFaultCount: 563

*** Dump of thread ID 7684 (state: Ready): ***

- Information -
Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 468750.000000, User Time: 0.000000, Wait Time: 17873698.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812FD3

- Registers -
eax=1143fa54 ebx=7ffd7000 ecx=00000000 edx=009e8ef8 esi=1143fadc edi=009e849c
eip=7c812fd3 esp=1143fa50 ebp=1143faa4
cs=001b  ss=0023  ds=0023  es=0023  fs=003b  gs=0000             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
1143faa4 007b2d27 e06d7363 00000001 00000003 1143fad0 kernel32!+0x0 
1143fadc 007afae1 1143faec 0083a2cc 0080e158 00832824 hadcm3s_um_7.24_windows_intelx8!+0x0 
1143fafc 0040643c 04600000 01000000 00500000 00407892 hadcm3s_um_7.24_windows_intelx8!+0x0 
1143ff30 007b1c2a 00400000 00000000 00052391 0000000a hadcm3s_um_7.24_windows_intelx8!+0x0 
1143ffc0 7c816037 00153a8c 00000000 7ffd7000 e06d7363 hadcm3s_um_7.24_windows_intelx8!+0x0 
1143fff0 00000000 007b1c7d 00000000 00000000 00000000 kernel32!+0x0 

*** Dump of thread ID 5952 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 17873698.000000

- Registers -
eax=0015752a ebx=00000000 ecx=00000000 edx=4234fd9c esi=00000000 edi=4234fd4c
eip=7c90e514 esp=4234fd1c ebp=4234fd74
cs=001b  ss=0023  ds=0023  es=0023  fs=003b  gs=0000             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
4234fd74 7c802455 00000064 00000000 4234ffb4 007352f4 ntdll!+0x0 
4234fd84 007352f4 00000064 00736380 003d6b00 00000000 kernel32!+0x0 
4234ffb4 7c80b729 00000000 00736380 003d6b00 00000000 hadcm3s_um_7.24_windows_intelx8!+0x0 
4234ffec 00000000 007352d0 00000000 00000000 00000000 kernel32!+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6344, iMonCtr=1
Model crash detected, will try to restart...
12:51:14 (6892): Can't acquire lockfile (32) - waiting 35s
12:51:49 (6892): Can't acquire lockfile (32) - exiting
12:51:49 (6892): Error: The process cannot access the file because it is being used by another process.

 (0x20)
13:22:49 (6712): Can't acquire lockfile (32) - waiting 35s
13:23:24 (6712): Can't acquire lockfile (32) - exiting
13:23:24 (6712): Error: The process cannot access the file because it is being used by another process.

 (0x20)
13:40:51 (4400): Can't acquire lockfile (32) - waiting 35s
13:41:26 (4400): Can't acquire lockfile (32) - exiting
13:41:26 (4400): Error: The process cannot access the file because it is being used by another process.

 (0x20)
00:44:05 (4544): Can't acquire lockfile (32) - waiting 35s
00:44:40 (4544): Can't acquire lockfile (32) - exiting
00:44:40 (4544): Error: The process cannot access the file because it is being used by another process.

 (0x20)
00:54:49 (7980): Can't acquire lockfile (32) - waiting 35s
00:55:24 (7980): Can't acquire lockfile (32) - exiting
00:55:24 (7980): Error: The process cannot access the file because it is being used by another process.

 (0x20)
01:05:29 (6324): Can't acquire lockfile (32) - waiting 35s
01:06:04 (6324): Can't acquire lockfile (32) - exiting
01:06:04 (6324): Error: The process cannot access the file because it is being used by another process.

 (0x20)
01:16:16 (2152): Can't acquire lockfile (32) - waiting 35s
01:16:51 (2152): Can't acquire lockfile (32) - exiting
01:16:51 (2152): Error: The process cannot access the file because it is being used by another process.

 (0x20)
01:27:05 (6680): Can't acquire lockfile (32) - waiting 35s
01:27:40 (6680): Can't acquire lockfile (32) - exiting
01:27:40 (6680): Error: The process cannot access the file because it is being used by another process.

 (0x20)
01:37:43 (6796): Can't acquire lockfile (32) - waiting 35s
01:38:18 (6796): Can't acquire lockfile (32) - exiting
01:38:18 (6796): Error: The process cannot access the file because it is being used by another process.

 (0x20)
01:48:21 (5864): Can't acquire lockfile (32) - waiting 35s
01:48:56 (5864): Can't acquire lockfile (32) - exiting
01:48:56 (5864): Error: The process cannot access the file because it is being used by another process.

 (0x20)
01:58:59 (4556): Can't acquire lockfile (32) - waiting 35s
01:59:34 (4556): Can't acquire lockfile (32) - exiting
01:59:34 (4556): Error: The process cannot access the file because it is being used by another process.

 (0x20)
02:09:38 (7204): Can't acquire lockfile (32) - waiting 35s
02:10:13 (7204): Can't acquire lockfile (32) - exiting
02:10:13 (7204): Error: The process cannot access the file because it is being used by another process.

 (0x20)
02:20:43 (6268): Can't acquire lockfile (32) - waiting 35s
02:21:18 (6268): Can't acquire lockfile (32) - exiting
02:21:18 (6268): Error: The process cannot access the file because it is being used by another process.

 (0x20)
02:31:32 (8040): Can't acquire lockfile (32) - waiting 35s
02:32:07 (8040): Can't acquire lockfile (32) - exiting
02:32:07 (8040): Error: The process cannot access the file because it is being used by another process.

 (0x20)
02:42:10 (4320): Can't acquire lockfile (32) - waiting 35s
02:42:45 (4320): Can't acquire lockfile (32) - exiting
02:42:45 (4320): Error: The process cannot access the file because it is being used by another process.

 (0x20)
02:53:40 (4780): Can't acquire lockfile (32) - waiting 35s
02:54:15 (4780): Can't acquire lockfile (32) - exiting
02:54:15 (4780): Error: The process cannot access the file because it is being used by another process.

 (0x20)
03:04:37 (6452): Can't acquire lockfile (32) - waiting 35s
03:05:12 (6452): Can't acquire lockfile (32) - exiting
03:05:12 (6452): Error: The process cannot access the file because it is being used by another process.

 (0x20)
03:15:16 (2524): Can't acquire lockfile (32) - waiting 35s
03:15:51 (2524): Can't acquire lockfile (32) - exiting
03:15:51 (2524): Error: The process cannot access the file because it is being used by another process.

 (0x20)
03:25:54 (5740): Can't acquire lockfile (32) - waiting 35s
03:26:29 (5740): Can't acquire lockfile (32) - exiting
03:26:29 (5740): Error: The process cannot access the file because it is being used by another process.

 (0x20)
03:36:51 (1992): Can't acquire lockfile (32) - waiting 35s
03:37:26 (1992): Can't acquire lockfile (32) - exiting
03:37:26 (1992): Error: The process cannot access the file because it is being used by another process.

 (0x20)
03:47:29 (608): Can't acquire lockfile (32) - waiting 35s
03:48:04 (608): Can't acquire lockfile (32) - exiting
03:48:04 (608): Error: The process cannot access the file because it is being used by another process.

 (0x20)
03:58:14 (1500): Can't acquire lockfile (32) - waiting 35s
03:58:49 (1500): Can't acquire lockfile (32) - exiting
03:58:49 (1500): Error: The process cannot access the file because it is being used by another process.

 (0x20)
04:08:52 (4516): Can't acquire lockfile (32) - waiting 35s
04:09:27 (4516): Can't acquire lockfile (32) - exiting
04:09:27 (4516): Error: The process cannot access the file because it is being used by another process.

 (0x20)
04:20:27 (8012): Can't acquire lockfile (32) - waiting 35s
04:21:02 (8012): Can't acquire lockfile (32) - exiting
04:21:02 (8012): Error: The process cannot access the file because it is being used by another process.

 (0x20)
04:31:14 (5156): Can't acquire lockfile (32) - waiting 35s
04:31:49 (5156): Can't acquire lockfile (32) - exiting
04:31:49 (5156): Error: The process cannot access the file because it is being used by another process.

 (0x20)
04:41:52 (8064): Can't acquire lockfile (32) - waiting 35s
04:42:27 (8064): Can't acquire lockfile (32) - exiting
04:42:27 (8064): Error: The process cannot access the file because it is being used by another process.

 (0x20)
04:52:56 (4764): Can't acquire lockfile (32) - waiting 35s
04:53:31 (4764): Can't acquire lockfile (32) - exiting
04:53:31 (4764): Error: The process cannot access the file because it is being used by another process.

 (0x20)
05:04:28 (7696): Can't acquire lockfile (32) - waiting 35s
05:05:03 (7696): Can't acquire lockfile (32) - exiting
05:05:03 (7696): Error: The process cannot access the file because it is being used by another process.

 (0x20)
05:15:27 (4492): Can't acquire lockfile (32) - waiting 35s
05:16:02 (4492): Can't acquire lockfile (32) - exiting
05:16:02 (4492): Error: The process cannot access the file because it is being used by another process.

 (0x20)
05:26:05 (7752): Can't acquire lockfile (32) - waiting 35s
05:26:40 (7752): Can't acquire lockfile (32) - exiting
05:26:40 (7752): Error: The process cannot access the file because it is being used by another process.

 (0x20)
05:36:44 (7696): Can't acquire lockfile (32) - waiting 35s
05:37:19 (7696): Can't acquire lockfile (32) - exiting
05:37:19 (7696): Error: The process cannot access the file because it is being used by another process.

 (0x20)
05:47:50 (5752): Can't acquire lockfile (32) - waiting 35s
05:48:25 (5752): Can't acquire lockfile (32) - exiting
05:48:25 (5752): Error: The process cannot access the file because it is being used by another process.

 (0x20)
05:58:29 (7092): Can't acquire lockfile (32) - waiting 35s
05:59:04 (7092): Can't acquire lockfile (32) - exiting
05:59:04 (7092): Error: The process cannot access the file because it is being used by another process.

 (0x20)
06:10:00 (5456): Can't acquire lockfile (32) - waiting 35s
06:10:35 (5456): Can't acquire lockfile (32) - exiting
06:10:35 (5456): Error: The process cannot access the file because it is being used by another process.

 (0x20)
06:21:31 (7036): Can't acquire lockfile (32) - waiting 35s
06:22:06 (7036): Can't acquire lockfile (32) - exiting
06:22:06 (7036): Error: The process cannot access the file because it is being used by another process.

 (0x20)
06:32:29 (4876): Can't acquire lockfile (32) - waiting 35s
06:33:04 (4876): Can't acquire lockfile (32) - exiting
06:33:04 (4876): Error: The process cannot access the file because it is being used by another process.

 (0x20)
06:43:50 (548): Can't acquire lockfile (32) - waiting 35s
06:44:25 (548): Can't acquire lockfile (32) - exiting
06:44:25 (548): Error: The process cannot access the file because it is being used by another process.

 (0x20)
06:54:29 (6236): Can't acquire lockfile (32) - waiting 35s
06:55:04 (6236): Can't acquire lockfile (32) - exiting
06:55:04 (6236): Error: The process cannot access the file because it is being used by another process.

 (0x20)
07:05:09 (6620): Can't acquire lockfile (32) - waiting 35s
07:05:44 (6620): Can't acquire lockfile (32) - exiting
07:05:44 (6620): Error: The process cannot access the file because it is being used by another process.

 (0x20)
07:15:48 (4892): Can't acquire lockfile (32) - waiting 35s
07:16:23 (4892): Can't acquire lockfile (32) - exiting
07:16:23 (4892): Error: The process cannot access the file because it is being used by another process.

 (0x20)
07:26:28 (6028): Can't acquire lockfile (32) - waiting 35s
07:27:03 (6028): Can't acquire lockfile (32) - exiting
07:27:03 (6028): Error: The process cannot access the file because it is being used by another process.

 (0x20)
07:37:06 (7308): Can't acquire lockfile (32) - waiting 35s
07:37:41 (7308): Can't acquire lockfile (32) - exiting
07:37:41 (7308): Error: The process cannot access the file because it is being used by another process.

 (0x20)
07:57:25 (5428): Can't acquire lockfile (32) - waiting 35s
07:58:00 (5428): Can't acquire lockfile (32) - exiting
07:58:00 (5428): Error: The process cannot access the file because it is being used by another process.

 (0x20)
08:21:28 (6868): Can't acquire lockfile (32) - waiting 35s
08:22:03 (6868): Can't acquire lockfile (32) - exiting
08:22:03 (6868): Error: The process cannot access the file because it is being used by another process.

 (0x20)
08:32:12 (7056): Can't acquire lockfile (32) - waiting 35s
08:32:47 (7056): Can't acquire lockfile (32) - exiting
08:32:47 (7056): Error: The process cannot access the file because it is being used by another process.

 (0x20)
08:42:51 (4416): Can't acquire lockfile (32) - waiting 35s
08:43:26 (4416): Can't acquire lockfile (32) - exiting
08:43:26 (4416): Error: The process cannot access the file because it is being used by another process.

 (0x20)
08:54:09 (5900): Can't acquire lockfile (32) - waiting 35s
08:54:44 (5900): Can't acquire lockfile (32) - exiting
08:54:44 (5900): Error: The process cannot access the file because it is being used by another process.

 (0x20)
09:04:48 (6112): Can't acquire lockfile (32) - waiting 35s
09:05:23 (6112): Can't acquire lockfile (32) - exiting
09:05:23 (6112): Error: The process cannot access the file because it is being used by another process.

 (0x20)
09:15:26 (7284): Can't acquire lockfile (32) - waiting 35s
09:16:01 (7284): Can't acquire lockfile (32) - exiting
09:16:01 (7284): Error: The process cannot access the file because it is being used by another process.

 (0x20)
09:26:05 (4872): Can't acquire lockfile (32) - waiting 35s
09:26:40 (4872): Can't acquire lockfile (32) - exiting
09:26:40 (4872): Error: The process cannot access the file because it is being used by another process.

 (0x20)
09:36:44 (7436): Can't acquire lockfile (32) - waiting 35s
09:37:19 (7436): Can't acquire lockfile (32) - exiting
09:37:19 (7436): Error: The process cannot access the file because it is being used by another process.

 (0x20)
09:47:47 (6744): Can't acquire lockfile (32) - waiting 35s
09:48:22 (6744): Can't acquire lockfile (32) - exiting
09:48:23 (6744): Error: The process cannot access the file because it is being used by another process.

 (0x20)
09:58:33 (7796): Can't acquire lockfile (32) - waiting 35s
09:59:08 (7796): Can't acquire lockfile (32) - exiting
09:59:08 (7796): Error: The process cannot access the file because it is being used by another process.

 (0x20)
10:09:13 (6224): Can't acquire lockfile (32) - waiting 35s
10:09:48 (6224): Can't acquire lockfile (32) - exiting
10:09:48 (6224): Error: The process cannot access the file because it is being used by another process.

 (0x20)
10:25:15 (5024): Can't acquire lockfile (32) - waiting 35s
10:25:50 (5024): Can't acquire lockfile (32) - exiting
10:25:50 (5024): Error: The process cannot access the file because it is being used by another process.

 (0x20)
11:53:21 (5272): Can't acquire lockfile (32) - waiting 35s
11:53:56 (5272): Can't acquire lockfile (32) - exiting
11:53:56 (5272): Error: The process cannot access the file because it is being used by another process.

 (0x20)
12:13:12 (2412): Can't acquire lockfile (32) - waiting 35s
12:13:47 (2412): Can't acquire lockfile (32) - exiting
12:13:47 (2412): Error: The process cannot access the file because it is being used by another process.

 (0x20)
12:23:50 (6864): Can't acquire lockfile (32) - waiting 35s
12:24:25 (6864): Can't acquire lockfile (32) - exiting
12:24:25 (6864): Error: The process cannot access the file because it is being used by another process.

 (0x20)
12:34:29 (5948): Can't acquire lockfile (32) - waiting 35s
12:35:04 (5948): Can't acquire lockfile (32) - exiting
12:35:04 (5948): Error: The process cannot access the file because it is being used by another process.

 (0x20)
12:45:08 (7308): Can't acquire lockfile (32) - waiting 35s
12:45:43 (7308): Can't acquire lockfile (32) - exiting
12:45:43 (7308): Error: The process cannot access the file because it is being used by another process.

 (0x20)
12:55:48 (8048): Can't acquire lockfile (32) - waiting 35s
12:56:23 (8048): Can't acquire lockfile (32) - exiting
12:56:23 (8048): Error: The process cannot access the file because it is being used by another process.

 (0x20)
13:06:46 (7548): Can't acquire lockfile (32) - waiting 35s
13:07:21 (7548): Can't acquire lockfile (32) - exiting
13:07:21 (7548): Error: The process cannot access the file because it is being used by another process.

 (0x20)
13:18:18 (6332): Can't acquire lockfile (32) - waiting 35s
13:18:53 (6332): Can't acquire lockfile (32) - exiting
13:18:53 (6332): Error: The process cannot access the file because it is being used by another process.

 (0x20)
13:29:00 (6448): Can't acquire lockfile (32) - waiting 35s
13:29:35 (6448): Can't acquire lockfile (32) - exiting
13:29:35 (6448): Error: The process cannot access the file because it is being used by another process.

 (0x20)
13:58:34 (7320): Can't acquire lockfile (32) - waiting 35s
13:59:09 (7320): Can't acquire lockfile (32) - exiting
13:59:09 (7320): Error: The process cannot access the file because it is being used by another process.

 (0x20)
14:10:37 (7588): Can't acquire lockfile (32) - waiting 35s
14:11:12 (7588): Can't acquire lockfile (32) - exiting
14:11:12 (7588): Error: The process cannot access the file because it is being used by another process.

 (0x20)
14:27:15 (6408): Can't acquire lockfile (32) - waiting 35s
14:27:50 (6408): Can't acquire lockfile (32) - exiting
14:27:50 (6408): Error: The process cannot access the file because it is being used by another process.

 (0x20)
14:37:55 (6644): Can't acquire lockfile (32) - waiting 35s
14:38:30 (6644): Can't acquire lockfile (32) - exiting
14:38:30 (6644): Error: The process cannot access the file because it is being used by another process.

 (0x20)
14:48:49 (5944): Can't acquire lockfile (32) - waiting 35s
14:49:24 (5944): Can't acquire lockfile (32) - exiting
14:49:24 (5944): Error: The process cannot access the file because it is being used by another process.

 (0x20)
14:59:27 (7932): Can't acquire lockfile (32) - waiting 35s
15:00:02 (7932): Can't acquire lockfile (32) - exiting
15:00:02 (7932): Error: The process cannot access the file because it is being used by another process.

 (0x20)
15:10:07 (5260): Can't acquire lockfile (32) - waiting 35s
15:10:42 (5260): Can't acquire lockfile (32) - exiting
15:10:42 (5260): Error: The process cannot access the file because it is being used by another process.

 (0x20)
15:20:45 (8080): Can't acquire lockfile (32) - waiting 35s
15:21:20 (8080): Can't acquire lockfile (32) - exiting
15:21:20 (8080): Error: The process cannot access the file because it is being used by another process.

 (0x20)
15:31:25 (7352): Can't acquire lockfile (32) - waiting 35s
15:32:00 (7352): Can't acquire lockfile (32) - exiting
15:32:00 (7352): Error: The process cannot access the file because it is being used by another process.

 (0x20)
15:42:49 (6424): Can't acquire lockfile (32) - waiting 35s
15:43:24 (6424): Can't acquire lockfile (32) - exiting
15:43:24 (6424): Error: The process cannot access the file because it is being used by another process.

 (0x20)
15:53:28 (4956): Can't acquire lockfile (32) - waiting 35s
15:54:03 (4956): Can't acquire lockfile (32) - exiting
15:54:03 (4956): Error: The process cannot access the file because it is being used by another process.

 (0x20)
16:05:04 (8092): Can't acquire lockfile (32) - waiting 35s
16:05:39 (8092): Can't acquire lockfile (32) - exiting
16:05:39 (8092): Error: The process cannot access the file because it is being used by another process.

 (0x20)
16:15:46 (5184): Can't acquire lockfile (32) - waiting 35s
16:16:21 (5184): Can't acquire lockfile (32) - exiting
16:16:21 (5184): Error: The process cannot access the file because it is being used by another process.

 (0x20)
16:26:24 (7088): Can't acquire lockfile (32) - waiting 35s
16:26:59 (7088): Can't acquire lockfile (32) - exiting
16:26:59 (7088): Error: The process cannot access the file because it is being used by another process.

 (0x20)
16:37:02 (7616): Can't acquire lockfile (32) - waiting 35s
16:37:37 (7616): Can't acquire lockfile (32) - exiting
16:37:37 (7616): Error: The process cannot access the file because it is being used by another process.

 (0x20)
16:47:41 (7576): Can't acquire lockfile (32) - waiting 35s
16:48:16 (7576): Can't acquire lockfile (32) - exiting
16:48:16 (7576): Error: The process cannot access the file because it is being used by another process.

 (0x20)
16:58:20 (5688): Can't acquire lockfile (32) - waiting 35s
16:58:55 (5688): Can't acquire lockfile (32) - exiting
16:58:55 (5688): Error: The process cannot access the file because it is being used by another process.

 (0x20)
17:08:59 (4116): Can't acquire lockfile (32) - waiting 35s
17:09:34 (4116): Can't acquire lockfile (32) - exiting
17:09:34 (4116): Error: The process cannot access the file because it is being used by another process.

 (0x20)
17:19:50 (7480): Can't acquire lockfile (32) - waiting 35s
17:20:25 (7480): Can't acquire lockfile (32) - exiting
17:20:25 (7480): Error: The process cannot access the file because it is being used by another process.

 (0x20)
17:30:27 (4180): Can't acquire lockfile (32) - waiting 35s
17:31:02 (4180): Can't acquire lockfile (32) - exiting
17:31:02 (4180): Error: The process cannot access the file because it is being used by another process.

 (0x20)
17:41:06 (6696): Can't acquire lockfile (32) - waiting 35s
17:41:41 (6696): Can't acquire lockfile (32) - exiting
17:41:41 (6696): Error: The process cannot access the file because it is being used by another process.

 (0x20)
17:52:12 (4408): Can't acquire lockfile (32) - waiting 35s
17:52:47 (4408): Can't acquire lockfile (32) - exiting
17:52:47 (4408): Error: The process cannot access the file because it is being used by another process.

 (0x20)
18:02:51 (7204): Can't acquire lockfile (32) - waiting 35s
18:03:26 (7204): Can't acquire lockfile (32) - exiting
18:03:26 (7204): Error: The process cannot access the file because it is being used by another process.

 (0x20)
18:14:17 (7296): Can't acquire lockfile (32) - waiting 35s
18:14:52 (7296): Can't acquire lockfile (32) - exiting
18:14:52 (7296): Error: The process cannot access the file because it is being used by another process.

 (0x20)
18:27:18 (3012): Can't acquire lockfile (32) - waiting 35s
18:27:53 (3012): Can't acquire lockfile (32) - exiting
18:27:53 (3012): Error: The process cannot access the file because it is being used by another process.

 (0x20)
18:38:48 (5116): Can't acquire lockfile (32) - waiting 35s
18:39:23 (5116): Can't acquire lockfile (32) - exiting
18:39:23 (5116): Error: The process cannot access the file because it is being used by another process.

 (0x20)
18:49:52 (8120): Can't acquire lockfile (32) - waiting 35s
18:50:27 (8120): Can't acquire lockfile (32) - exiting
18:50:27 (8120): Error: The process cannot access the file because it is being used by another process.

 (0x20)
19:00:34 (1264): Can't acquire lockfile (32) - waiting 35s
19:01:10 (1264): Can't acquire lockfile (32) - exiting
19:01:10 (1264): Error: The process cannot access the file because it is being used by another process.

 (0x20)
19:11:13 (4956): Can't acquire lockfile (32) - waiting 35s
19:11:48 (4956): Can't acquire lockfile (32) - exiting
19:11:48 (4956): Error: The process cannot access the file because it is being used by another process.

 (0x20)
19:21:52 (4588): Can't acquire lockfile (32) - waiting 35s
19:22:27 (4588): Can't acquire lockfile (32) - exiting
19:22:27 (4588): Error: The process cannot access the file because it is being used by another process.

 (0x20)
19:32:30 (8156): Can't acquire lockfile (32) - waiting 35s
19:33:05 (8156): Can't acquire lockfile (32) - exiting
19:33:05 (8156): Error: The process cannot access the file because it is being used by another process.

 (0x20)
19:43:09 (7456): Can't acquire lockfile (32) - waiting 35s
19:43:44 (7456): Can't acquire lockfile (32) - exiting
19:43:44 (7456): Error: The process cannot access the file because it is being used by another process.

 (0x20)
19:53:56 (6492): Can't acquire lockfile (32) - waiting 35s
19:54:31 (6492): Can't acquire lockfile (32) - exiting
19:54:31 (6492): Error: The process cannot access the file because it is being used by another process.

 (0x20)
20:04:36 (8036): Can't acquire lockfile (32) - waiting 35s
20:05:11 (8036): Can't acquire lockfile (32) - exiting
20:05:11 (8036): Error: The process cannot access the file because it is being used by another process.

 (0x20)
20:16:04 (6680): Can't acquire lockfile (32) - waiting 35s
20:16:40 (6680): Can't acquire lockfile (32) - exiting
20:16:40 (6680): Error: The process cannot access the file because it is being used by another process.

 (0x20)
20:26:43 (6732): Can't acquire lockfile (32) - waiting 35s
20:27:18 (6732): Can't acquire lockfile (32) - exiting
20:27:18 (6732): Error: The process cannot access the file because it is being used by another process.

 (0x20)
20:38:15 (5352): Can't acquire lockfile (32) - waiting 35s
20:38:50 (5352): Can't acquire lockfile (32) - exiting
20:38:50 (5352): Error: The process cannot access the file because it is being used by another process.

 (0x20)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
13 Aug 2015 11:25:10 486496 18765988 hadcm3s_arl0_1988_2_010065694_0 25,920 165,955 6.4026


©2024 climateprediction.net