climateprediction.net home page
Task 15865528

Task 15865528

Name hadcm3n_o7ck_2020_40_008396595_0
Workunit 8547454
Created 26 Jun 2013, 2:51:29 UTC
Sent 29 Jun 2013, 20:28:09 UTC
Report deadline 29 Sep 2013, 3:55:20 UTC
Received 23 Jul 2013, 13:33:42 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1259513
Run time 14 days 19 hours 27 min 2 sec
CPU time 14 days 3 hours 40 min 37 sec
Validate state Valid
Credit 12,441.60
Device peak FLOPS 3.06 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.0.28</core_client_version>
<![CDATA[
<stderr_txt>


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x006C6D27

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 07/03/13 09:25:13
Install Directory : 
Data Directory    : D:\Documents and Settings\All Users\Application Data\BOINC
Project Symstore  : 
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3n_o7ck_2020_40_008396595;D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net


SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 42244, Write: 0, Other 96894

- I/O Transfers Counters -
Read: 0, Write: 2900, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 124432, QuotaPeakPagedPoolUsage: 124432
QuotaNonPagedPoolUsage: 5568, QuotaPeakNonPagedPoolUsage: 5632

- Virtual Memory Usage -
VirtualSize: 1051308032, PeakVirtualSize: 1051308032

- Pagefile Usage -
PagefileUsage: 231608320, PeakPagefileUsage: 231608320

- Working Set Size -
WorkingSetSize: 226693120, PeakWorkingSetSize: 226693120, PageFaultCount: 57478

*** Dump of thread ID 2800 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 48437500.000000, User Time: 31204063232.000000, Wait Time: 684762.000000

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x006C6D27

- Registers -
eax=00000007 ebx=0f270908 ecx=00000000 edx=10473da4 esi=0f52baa0 edi=0f253c20
eip=006c6d27 esp=0f104900 ebp=0f2708f8
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
0f2708f8 0064a92b 0f251ae0 00000488 0f2e2dcc 0064a92b !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '006c6d27'
0f2e2db8 00455431 0f52b618 00000122 0f525b78 0f4e2690 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0064a92b'
0f4b915c 0044f0de 1132f8dc 1132f8e0 1132f8e4 1132f8e8 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00455431'
0f6d5e78 0065501d c04a7f31 c04d9892 100cddf8 0065501d !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0044f0de'
100cdde8 005df71b 470bdf8a 470bceee 10332864 005df71b !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0065501d'
10332858 005da7e1 10332d44 3de20020 005da7e1 1132f8dc !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005df71b'
10332d84 005dc121 1132f8dc 1132f8e0 1132f8e4 1132f8e8 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005da7e1'
10333188 007061a7 1031e8d0 10317b50 1132f7d8 007061a7 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005dc121'
1132f7c8 006f3667 1132f8d8 1132f8fc 1132fab8 006f3667 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '007061a7'
1132faa8 004083f3 04600000 01000000 00000001 004083f3 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '006f3667'
1132fb10 00408130 1132fb24 001224ef 1132fb24 00122451 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '004083f3'
1132ffc0 7d4e7c9a 00000000 00000000 7efde000 80000004 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00408130'
1132fff0 00000000 007bde7f 00000000 00000000 00000000 !BaseProcessInitPostImport+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e7c9a'

*** Dump of thread ID 132 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 684762.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=3404ff74
eip=7d61ccc6 esp=3404ff38 ebp=3404ff9c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
3404ff9c 7d4d14ef 00000064 00000000 3404ffb8 00749924 !NtDelayExecution+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d61ccc6'
3404ffac 00749924 00000064 3404ffec 7d4dfb97 00000000 !Sleep+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4d14ef'
3404ffb8 7d4dfb97 00000000 00000000 00000000 00000000 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00749924'
3404ffec 00000000 00749910 00000000 00000000 34560000 !FlsSetValue+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4dfb97'


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2792, iMonCtr=1
Model crash detected, will try to restart...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x006C6D27

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 07/03/13 10:23:23
Install Directory : 
Data Directory    : D:\Documents and Settings\All Users\Application Data\BOINC
Project Symstore  : 
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3n_o7ck_2020_40_008396595;D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net


SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 46321, Write: 0, Other 104238

- I/O Transfers Counters -
Read: 0, Write: 3096, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 124432, QuotaPeakPagedPoolUsage: 124432
QuotaNonPagedPoolUsage: 5568, QuotaPeakNonPagedPoolUsage: 5632

- Virtual Memory Usage -
VirtualSize: 1051308032, PeakVirtualSize: 1051308032

- Pagefile Usage -
PagefileUsage: 231612416, PeakPagefileUsage: 231616512

- Working Set Size -
WorkingSetSize: 226693120, PeakWorkingSetSize: 226693120, PageFaultCount: 57666

*** Dump of thread ID 1544 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 52656248.000000, User Time: 34353281024.000000, Wait Time: 908080.000000

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x006C6D27

- Registers -
eax=00000007 ebx=0f270908 ecx=00000000 edx=10473da4 esi=0f52baa0 edi=0f253c20
eip=006c6d27 esp=0f104900 ebp=0f2708f8
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
0f2708f8 0064a92b 0f251ae0 00000488 0f2e2dcc 0064a92b !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '006c6d27'
0f2e2db8 00455431 0f52b618 00000122 0f525b78 0f4e2690 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0064a92b'
0f4b915c 0044f0de 1132f8dc 1132f8e0 1132f8e4 1132f8e8 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00455431'
0f6d5e78 0065501d 40f1e282 40f1015a 100cddf8 0065501d !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0044f0de'
100cdde8 005df71b 00000002 00000002 10332864 005df71b !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0065501d'
10332858 005da7e1 10332d44 3de20020 005da7e1 1132f8dc !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005df71b'
10332d84 005dc121 1132f8dc 1132f8e0 1132f8e4 1132f8e8 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005da7e1'
10333188 007061a7 1031e8d0 10317b50 1132f7d8 007061a7 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005dc121'
1132f7c8 006f3667 1132f8d8 1132f8fc 1132fab8 006f3667 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '007061a7'
1132faa8 004083f3 04600000 01000000 00000001 004083f3 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '006f3667'
1132fb10 00408130 1132fb24 001224ef 1132fb24 00122451 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '004083f3'
1132ffc0 7d4e7c9a 00000000 00000000 7efde000 80000004 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00408130'
1132fff0 00000000 007bde7f 00000000 00000000 00000000 !BaseProcessInitPostImport+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e7c9a'

*** Dump of thread ID 608 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 908076.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=3404ff74
eip=7d61ccc6 esp=3404ff38 ebp=3404ff9c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
3404ff9c 7d4d14ef 00000064 00000000 3404ffb8 00749924 !NtDelayExecution+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d61ccc6'
3404ffac 00749924 00000064 3404ffec 7d4dfb97 00000000 !Sleep+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4d14ef'
3404ffb8 7d4dfb97 00000000 00000000 00000000 00000000 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00749924'
3404ffec 00000000 00749910 00000000 00000000 34560000 !FlsSetValue+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4dfb97'


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2792, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x005E5147

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 07/05/13 07:16:44
Install Directory : 
Data Directory    : D:\Documents and Settings\All Users\Application Data\BOINC
Project Symstore  : 
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3n_o7ck_2020_40_008396595;D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net


SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 111685, Write: 0, Other 243915

- I/O Transfers Counters -
Read: 0, Write: 7806, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 124432, QuotaPeakPagedPoolUsage: 124432
QuotaNonPagedPoolUsage: 5648, QuotaPeakNonPagedPoolUsage: 5712

- Virtual Memory Usage -
VirtualSize: 1051312128, PeakVirtualSize: 1051312128

- Pagefile Usage -
PagefileUsage: 231895040, PeakPagefileUsage: 231895040

- Working Set Size -
WorkingSetSize: 226930688, PeakWorkingSetSize: 226930688, PageFaultCount: 59574

*** Dump of thread ID 2980 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 119687504.000000, User Time: 83580469248.000000, Wait Time: 548867.000000

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x005E5147

- Registers -
eax=1047300c ebx=0f104498 ecx=00000000 edx=10472b84 esi=00000080 edi=0f4f3060
eip=005e5147 esp=0f104300 ebp=0f104488
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
0f104488 006c9119 00000002 00000003 0f270908 006c9119 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005e5147'
0f2708f8 0064a92b 0f251ae0 00000488 0f2e2dcc 0064a92b !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '006c9119'
0f2e2db8 00455431 0f52b618 00000122 0f525b78 0f4e2690 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0064a92b'
0f4b915c 0044f0de 1132f8dc 1132f8e0 1132f8e4 1132f8e8 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00455431'
0f6d5e78 0065501d 40f7853d 40f8172d 100cddf8 0065501d !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0044f0de'
100cdde8 005df71b 00000002 00000002 10332864 005df71b !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0065501d'
10332858 005da7e1 10332d44 3de20020 005da7e1 1132f8dc !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005df71b'
10332d84 005dc121 1132f8dc 1132f8e0 1132f8e4 1132f8e8 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005da7e1'
10333188 007061a7 1031e8d0 10317b50 1132f7d8 007061a7 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005dc121'
1132f7c8 006f3667 1132f8d8 1132f8fc 1132fab8 006f3667 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '007061a7'
1132faa8 004083f3 04600000 01000000 00000001 004083f3 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '006f3667'
1132fb10 00408130 1132fb24 001224ef 1132fb24 00122451 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '004083f3'
1132ffc0 7d4e7c9a 00000000 00000000 7efde000 80000004 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00408130'
1132fff0 00000000 007bde7f 00000000 00000000 00000000 !BaseProcessInitPostImport+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e7c9a'

*** Dump of thread ID 2948 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 548867.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=3404ff74
eip=7d61ccc6 esp=3404ff38 ebp=3404ff9c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
3404ff9c 7d4d14ef 00000064 00000000 3404ffb8 00749924 !NtDelayExecution+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d61ccc6'
3404ffac 00749924 00000064 3404ffec 7d4dfb97 00000000 !Sleep+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4d14ef'
3404ffb8 7d4dfb97 00000000 00000000 00000000 00000000 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00749924'
3404ffec 00000000 00749910 00000000 00000000 34560000 !FlsSetValue+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4dfb97'


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2724, iMonCtr=1
Model crash detected, will try to restart...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x005E5147

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 07/05/13 08:33:22
Install Directory : 
Data Directory    : D:\Documents and Settings\All Users\Application Data\BOINC
Project Symstore  : 
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3n_o7ck_2020_40_008396595;D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net


SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 61946, Write: 0, Other 137431

- I/O Transfers Counters -
Read: 0, Write: 4326, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 124432, QuotaPeakPagedPoolUsage: 124432
QuotaNonPagedPoolUsage: 5568, QuotaPeakNonPagedPoolUsage: 5632

- Virtual Memory Usage -
VirtualSize: 1051308032, PeakVirtualSize: 1051308032

- Pagefile Usage -
PagefileUsage: 231620608, PeakPagefileUsage: 231620608

- Working Set Size -
WorkingSetSize: 226660352, PeakWorkingSetSize: 226660352, PageFaultCount: 58494

*** Dump of thread ID 1220 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 68593752.000000, User Time: 45595156480.000000, Wait Time: 843167.000000

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x005E5147

- Registers -
eax=1047300c ebx=0f104498 ecx=00000000 edx=10472b84 esi=00000080 edi=0f4f3060
eip=005e5147 esp=0f104300 ebp=0f104488
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
0f104488 006c9119 00000004 00000005 0f270908 006c9119 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005e5147'
0f2708f8 0064a92b 0f251ae0 00000488 0f2e2dcc 0064a92b !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '006c9119'
0f2e2db8 00455431 0f52b618 00000122 0f525b78 0f4e2690 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0064a92b'
0f4b915c 0044f0de 1132f8dc 1132f8e0 1132f8e4 1132f8e8 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00455431'
0f6d5e78 0065501d 40f4be28 40f65089 100cddf8 0065501d !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0044f0de'
100cdde8 005df71b 00000002 00000002 10332864 005df71b !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0065501d'
10332858 005da7e1 10332d44 3de20020 005da7e1 1132f8dc !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005df71b'
10332d84 005dc121 1132f8dc 1132f8e0 1132f8e4 1132f8e8 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005da7e1'
10333188 007061a7 1031e8d0 10317b50 1132f7d8 007061a7 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005dc121'
1132f7c8 006f3667 1132f8d8 1132f8fc 1132fab8 006f3667 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '007061a7'
1132faa8 004083f3 04600000 01000000 00000001 004083f3 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '006f3667'
1132fb10 00408130 1132fb24 001224ef 1132fb24 00122451 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '004083f3'
1132ffc0 7d4e7c9a 00000000 00000000 7efde000 80000004 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00408130'
1132fff0 00000000 007bde7f 00000000 00000000 00000000 !BaseProcessInitPostImport+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e7c9a'

*** Dump of thread ID 1904 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 843163.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=3404ff74
eip=7d61ccc6 esp=3404ff38 ebp=3404ff9c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
3404ff9c 7d4d14ef 00000064 00000000 3404ffb8 00749924 !NtDelayExecution+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d61ccc6'
3404ffac 00749924 00000064 3404ffec 7d4dfb97 00000000 !Sleep+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4d14ef'
3404ffb8 7d4dfb97 00000000 00000000 00000000 00000000 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00749924'
3404ffec 00000000 00749910 00000000 00000000 34560000 !FlsSetValue+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4dfb97'


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2724, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Signal 4 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2076, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Signal 11 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2532, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 11 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1688, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1688, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1688, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1688, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1688, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1688, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1688, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1688, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Signal 11 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1276, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
23 Jul 2013 22:10:32 1259513 15865528 hadcm3n_o7ck_2020_40_008396595_0 1,036,800 1,222,344 1.1790
23 Jul 2013 22:01:40 1259513 15865528 hadcm3n_o7ck_2020_40_008396595_0 1,010,880 1,190,222 1.1774
23 Jul 2013 21:52:33 1259513 15865528 hadcm3n_o7ck_2020_40_008396595_0 984,960 1,157,910 1.1756
23 Jul 2013 21:40:08 1259513 15865528 hadcm3n_o7ck_2020_40_008396595_0 959,040 1,125,906 1.1740
23 Jul 2013 21:29:49 1259513 15865528 hadcm3n_o7ck_2020_40_008396595_0 933,120 1,093,960 1.1724
23 Jul 2013 21:17:21 1259513 15865528 hadcm3n_o7ck_2020_40_008396595_0 907,200 1,062,191 1.1708
23 Jul 2013 20:54:01 1259513 15865528 hadcm3n_o7ck_2020_40_008396595_0 881,280 1,030,201 1.1690
23 Jul 2013 20:41:55 1259513 15865528 hadcm3n_o7ck_2020_40_008396595_0 855,360 998,863 1.1678
23 Jul 2013 20:29:52 1259513 15865528 hadcm3n_o7ck_2020_40_008396595_0 829,440 967,622 1.1666
23 Jul 2013 20:16:28 1259513 15865528 hadcm3n_o7ck_2020_40_008396595_0 803,520 937,216 1.1664
23 Jul 2013 20:09:07 1259513 15865528 hadcm3n_o7ck_2020_40_008396595_0 777,600 907,113 1.1666
23 Jul 2013 20:09:07 1259513 15865528 hadcm3n_o7ck_2020_40_008396595_0 751,680 876,938 1.1666
23 Jul 2013 20:09:07 1259513 15865528 hadcm3n_o7ck_2020_40_008396595_0 725,760 847,419 1.1676
23 Jul 2013 20:09:07 1259513 15865528 hadcm3n_o7ck_2020_40_008396595_0 699,840 817,248 1.1678
23 Jul 2013 20:09:07 1259513 15865528 hadcm3n_o7ck_2020_40_008396595_0 673,920 787,065 1.1679
23 Jul 2013 20:09:07 1259513 15865528 hadcm3n_o7ck_2020_40_008396595_0 648,000 756,922 1.1681
23 Jul 2013 20:09:07 1259513 15865528 hadcm3n_o7ck_2020_40_008396595_0 622,080 725,532 1.1663
23 Jul 2013 20:09:07 1259513 15865528 hadcm3n_o7ck_2020_40_008396595_0 596,160 694,236 1.1645
23 Jul 2013 20:09:07 1259513 15865528 hadcm3n_o7ck_2020_40_008396595_0 570,240 662,873 1.1624
23 Jul 2013 20:09:07 1259513 15865528 hadcm3n_o7ck_2020_40_008396595_0 544,320 631,583 1.1603


©2024 climateprediction.net