climateprediction.net home page
Task 15834131

Task 15834131

Name hadcm3n_ze32_1920_40_008316576_2
Workunit 8467711
Created 7 Jun 2013, 11:09:23 UTC
Sent 7 Jun 2013, 11:46:21 UTC
Report deadline 6 Sep 2013, 19:13:32 UTC
Received 9 Jul 2013, 3:09:08 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1259513
Run time 15 days 6 hours 49 min 55 sec
CPU time 14 days 15 hours 12 min 5 sec
Validate state Valid
Credit 12,441.60
Device peak FLOPS 3.07 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr 
<core_client_version>7.0.28</core_client_version>
<![CDATA[
<stderr_txt>
end request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Signal 11 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1212, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1212, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1212, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1212, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 11 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=864, iMonCtr=1
Model crash detected, will try to restart...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x004D4F07

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 07/02/13 09:37:39
Install Directory : 
Data Directory    : D:\Documents and Settings\All Users\Application Data\BOINC
Project Symstore  : 
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3n_ze32_1920_40_008316576;D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net


SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 2045, Write: 0, Other 9240

- I/O Transfers Counters -
Read: 0, Write: 436, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 124432, QuotaPeakPagedPoolUsage: 124432
QuotaNonPagedPoolUsage: 5552, QuotaPeakNonPagedPoolUsage: 5552

- Virtual Memory Usage -
VirtualSize: 1051308032, PeakVirtualSize: 1051308032

- Pagefile Usage -
PagefileUsage: 231559168, PeakPagefileUsage: 231559168

- Working Set Size -
WorkingSetSize: 223408128, PeakWorkingSetSize: 223408128, PageFaultCount: 54451

*** Dump of thread ID 1164 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 1562500.000000, User Time: 154843744.000000, Wait Time: 810956.000000

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x004D4F07

- Registers -
eax=0000004f ebx=0f3f5bcc ecx=0f409c00 edx=0f409e90 esi=0f3f53b0 edi=0f4096e0
eip=004d4f07 esp=0f3f4e30 ebp=0f3f5bb8
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
0f3f5bb8 004bd16e 00000000 00000000 00000006 0f4169a4 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '004d4f07'
0f416998 004b18a5 0f4c5f00 0f981f58 004b18a5 00f096e0 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '004bd16e'
0f981f48 00506174 376a6bea 376a9d0e 10090f1c 00506174 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '004b18a5'
0f982074 004b4fbc 00f096e0 00888ec0 00f09590 00f095a4 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00506174'
10090f08 00439679 10060fd0 1008a0d0 10083350 1032c194 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '004b4fbc'
1032c188 00447f59 1032c2dc 103332fc 00447f59 00f096e0 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00439679'
103332e8 0070640f 3df87738 3df88738 3df889c0 1132f7d8 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00447f59'
1132f7c8 006f3667 1132f8d8 1132f8fc 1132fab8 006f3667 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0070640f'
1132faa8 004083f3 04600000 01000000 00000001 004083f3 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '006f3667'
1132fb10 00408130 1132fb24 001224ef 1132fb24 00122451 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '004083f3'
1132ffc0 7d4e7c9a 00000000 00000000 7efde000 80000004 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00408130'
1132fff0 00000000 007bde7f 00000000 00000000 00000000 !BaseProcessInitPostImport+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e7c9a'

*** Dump of thread ID 1244 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 810950.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=3404ff74
eip=7d61ccc6 esp=3404ff38 ebp=3404ff9c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
3404ff9c 7d4d14ef 00000064 00000000 3404ffb8 00749924 !NtDelayExecution+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d61ccc6'
3404ffac 00749924 00000064 3404ffec 7d4dfb97 00000000 !Sleep+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4d14ef'
3404ffb8 7d4dfb97 00000000 00000000 00000000 00000000 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00749924'
3404ffec 00000000 00749910 00000000 00000000 34560000 !FlsSetValue+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4dfb97'


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=864, iMonCtr=1
Model crash detected, will try to restart...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x004D4F07

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 07/02/13 09:38:05
Install Directory : 
Data Directory    : D:\Documents and Settings\All Users\Application Data\BOINC
Project Symstore  : 
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3n_ze32_1920_40_008316576;D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net


SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 2045, Write: 0, Other 9248

- I/O Transfers Counters -
Read: 0, Write: 266, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 124432, QuotaPeakPagedPoolUsage: 124432
QuotaNonPagedPoolUsage: 5552, QuotaPeakNonPagedPoolUsage: 5552

- Virtual Memory Usage -
VirtualSize: 1051308032, PeakVirtualSize: 1051308032

- Pagefile Usage -
PagefileUsage: 231559168, PeakPagefileUsage: 231559168

- Working Set Size -
WorkingSetSize: 223408128, PeakWorkingSetSize: 223408128, PageFaultCount: 54451

*** Dump of thread ID 1304 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 1875000.000000, User Time: 225624992.000000, Wait Time: 812593.000000

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x004D4F07

- Registers -
eax=00000019 ebx=0f3f4e6c ecx=0f409ac0 edx=0f409d70 esi=0f3f4750 edi=0f409560
eip=004d4f07 esp=0f3f4320 ebp=0f3f4e58
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
0f3f4e58 004bd16e 3b36faab 3b2bcf25 00000006 0f4169a4 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '004d4f07'
0f416998 004b18a5 0f4c5f00 0f981f58 004b18a5 00f096e0 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '004bd16e'
0f981f48 00506174 376a3233 376a665a 10090f1c 00506174 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '004b18a5'
0f982074 004b4fbc 00f096e0 00888ec0 00f09590 00f095a4 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00506174'
10090f08 00439679 10060fd0 1008a0d0 10083350 1032c194 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '004b4fbc'
1032c188 00447f59 1032c2dc 103332fc 00447f59 00f096e0 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00439679'
103332e8 0070640f 3df87738 3df88738 3df889c0 1132f7d8 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00447f59'
1132f7c8 006f3667 1132f8d8 1132f8fc 1132fab8 006f3667 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0070640f'
1132faa8 004083f3 04600000 01000000 00000001 004083f3 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '006f3667'
1132fb10 00408130 1132fb24 001224ef 1132fb24 00122451 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '004083f3'
1132ffc0 7d4e7c9a 00000000 00000000 7efde000 80000004 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00408130'
1132fff0 00000000 007bde7f 00000000 00000000 00000000 !BaseProcessInitPostImport+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e7c9a'

*** Dump of thread ID 2068 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 812591.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=3404ff74
eip=7d61ccc6 esp=3404ff38 ebp=3404ff9c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
3404ff9c 7d4d14ef 00000064 00000000 3404ffb8 00749924 !NtDelayExecution+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d61ccc6'
3404ffac 00749924 00000064 3404ffec 7d4dfb97 00000000 !Sleep+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4d14ef'
3404ffb8 7d4dfb97 00000000 00000000 00000000 00000000 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00749924'
3404ffec 00000000 00749910 00000000 00000000 34560000 !FlsSetValue+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4dfb97'


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=864, iMonCtr=1
Model crash detected, will try to restart...
09:38:07 (864): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x006C6D27

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 07/03/13 07:16:10
Install Directory : 
Data Directory    : D:\Documents and Settings\All Users\Application Data\BOINC
Project Symstore  : 
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3n_ze32_1920_40_008316576;D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net


SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 34513, Write: 0, Other 79138

- I/O Transfers Counters -
Read: 0, Write: 2436, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 124432, QuotaPeakPagedPoolUsage: 124432
QuotaNonPagedPoolUsage: 5568, QuotaPeakNonPagedPoolUsage: 5632

- Virtual Memory Usage -
VirtualSize: 1051308032, PeakVirtualSize: 1051308032

- Pagefile Usage -
PagefileUsage: 231608320, PeakPagefileUsage: 231608320

- Working Set Size -
WorkingSetSize: 226652160, PeakWorkingSetSize: 226652160, PageFaultCount: 56981

*** Dump of thread ID 3000 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 40625000.000000, User Time: 25091563520.000000, Wait Time: 189171.000000

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x006C6D27

- Registers -
eax=00000007 ebx=0f270908 ecx=00000000 edx=10473da4 esi=0f52baa0 edi=0f253c20
eip=006c6d27 esp=0f104900 ebp=0f2708f8
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
0f2708f8 0064a92b 0f251ae0 00000488 0f2e2dcc 0064a92b !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '006c6d27'
0f2e2db8 00455431 0f52b618 00000122 0f525b78 0f4e2690 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0064a92b'
0f4b915c 0044f0de 1132f8dc 1132f8e0 1132f8e4 1132f8e8 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00455431'
0f6d5e78 0065501d 3f7b1dfe 3f886cca 100cddf8 0065501d !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0044f0de'
100cdde8 005df71b 470c6e50 470c6fd3 10332864 005df71b !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0065501d'
10332858 005da7e1 10332d44 3de20020 005da7e1 1132f8dc !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005df71b'
10332d84 005dc121 1132f8dc 1132f8e0 1132f8e4 1132f8e8 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005da7e1'
10333188 007061a7 1031e8d0 10317b50 1132f7d8 007061a7 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005dc121'
1132f7c8 006f3667 1132f8d8 1132f8fc 1132fab8 006f3667 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '007061a7'
1132faa8 004083f3 04600000 01000000 00000001 004083f3 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '006f3667'
1132fb10 00408130 1132fb24 001224ef 1132fb24 00122451 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '004083f3'
1132ffc0 7d4e7c9a 00000000 00000000 7efde000 80000004 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00408130'
1132fff0 00000000 007bde7f 00000000 00000000 00000000 !BaseProcessInitPostImport+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e7c9a'

*** Dump of thread ID 3012 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 189169.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=3404ff74
eip=7d61ccc6 esp=3404ff38 ebp=3404ff9c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
3404ff9c 7d4d14ef 00000064 00000000 3404ffb8 00749924 !NtDelayExecution+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d61ccc6'
3404ffac 00749924 00000064 3404ffec 7d4dfb97 00000000 !Sleep+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4d14ef'
3404ffb8 7d4dfb97 00000000 00000000 00000000 00000000 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00749924'
3404ffec 00000000 00749910 00000000 00000000 34560000 !FlsSetValue+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4dfb97'


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=684, iMonCtr=1
Model crash detected, will try to restart...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x006C6D27

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 07/03/13 07:56:55
Install Directory : 
Data Directory    : D:\Documents and Settings\All Users\Application Data\BOINC
Project Symstore  : 
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3n_ze32_1920_40_008316576;D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net


SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 33198, Write: 0, Other 76756

- I/O Transfers Counters -
Read: 0, Write: 2771, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 124432, QuotaPeakPagedPoolUsage: 124432
QuotaNonPagedPoolUsage: 5568, QuotaPeakNonPagedPoolUsage: 5632

- Virtual Memory Usage -
VirtualSize: 1051308032, PeakVirtualSize: 1051308032

- Pagefile Usage -
PagefileUsage: 231612416, PeakPagefileUsage: 231612416

- Working Set Size -
WorkingSetSize: 226680832, PeakWorkingSetSize: 226680832, PageFaultCount: 56929

*** Dump of thread ID 3520 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 38281248.000000, User Time: 24052187136.000000, Wait Time: 345675.000000

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x006C6D27

- Registers -
eax=00000007 ebx=0f270908 ecx=00000000 edx=10473da4 esi=0f52baa0 edi=0f253c20
eip=006c6d27 esp=0f104900 ebp=0f2708f8
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
0f2708f8 0064a92b 0f251ae0 00000488 0f2e2dcc 0064a92b !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '006c6d27'
0f2e2db8 00455431 0f52b618 00000122 0f525b78 0f4e2690 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0064a92b'
0f4b915c 0044f0de 1132f8dc 1132f8e0 1132f8e4 1132f8e8 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00455431'
0f6d5e78 0065501d 40c23f80 40c18ca2 100cddf8 0065501d !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0044f0de'
100cdde8 005df71b 00000002 00000002 10332864 005df71b !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0065501d'
10332858 005da7e1 10332d44 3de20020 005da7e1 1132f8dc !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005df71b'
10332d84 005dc121 1132f8dc 1132f8e0 1132f8e4 1132f8e8 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005da7e1'
10333188 007061a7 1031e8d0 10317b50 1132f7d8 007061a7 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005dc121'
1132f7c8 006f3667 1132f8d8 1132f8fc 1132fab8 006f3667 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '007061a7'
1132faa8 004083f3 04600000 01000000 00000001 004083f3 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '006f3667'
1132fb10 00408130 1132fb24 001224ef 1132fb24 00122451 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '004083f3'
1132ffc0 7d4e7c9a 00000000 00000000 7efde000 80000004 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00408130'
1132fff0 00000000 007bde7f 00000000 00000000 00000000 !BaseProcessInitPostImport+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e7c9a'

*** Dump of thread ID 3528 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 345675.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=3404ff74
eip=7d61ccc6 esp=3404ff38 ebp=3404ff9c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
3404ff9c 7d4d14ef 00000064 00000000 3404ffb8 00749924 !NtDelayExecution+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d61ccc6'
3404ffac 00749924 00000064 3404ffec 7d4dfb97 00000000 !Sleep+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4d14ef'
3404ffb8 7d4dfb97 00000000 00000000 00000000 00000000 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00749924'
3404ffec 00000000 00749910 00000000 00000000 34560000 !FlsSetValue+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4dfb97'


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=684, iMonCtr=1
Model crash detected, will try to restart...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x006C6D27

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 07/03/13 09:10:01
Install Directory : 
Data Directory    : D:\Documents and Settings\All Users\Application Data\BOINC
Project Symstore  : 
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3n_ze32_1920_40_008316576;D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net


SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 58274, Write: 0, Other 130070

- I/O Transfers Counters -
Read: 0, Write: 4298, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 124432, QuotaPeakPagedPoolUsage: 124432
QuotaNonPagedPoolUsage: 5568, QuotaPeakNonPagedPoolUsage: 5632

- Virtual Memory Usage -
VirtualSize: 1051308032, PeakVirtualSize: 1051308032

- Pagefile Usage -
PagefileUsage: 231612416, PeakPagefileUsage: 231612416

- Working Set Size -
WorkingSetSize: 226676736, PeakWorkingSetSize: 226676736, PageFaultCount: 58288

*** Dump of thread ID 3848 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 67812496.000000, User Time: 43247185920.000000, Wait Time: 626368.000000

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x006C6D27

- Registers -
eax=00000007 ebx=0f270908 ecx=00000000 edx=10473da4 esi=0f52baa0 edi=0f253c20
eip=006c6d27 esp=0f104900 ebp=0f2708f8
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
0f2708f8 0064a92b 0f251ae0 00000488 0f2e2dcc 0064a92b !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '006c6d27'
0f2e2db8 00455431 0f52b618 00000122 0f525b78 0f4e2690 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0064a92b'
0f4b915c 0044f0de 1132f8dc 1132f8e0 1132f8e4 1132f8e8 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00455431'
0f6d5e78 0065501d 40c14de8 40bfbeb3 100cddf8 0065501d !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0044f0de'
100cdde8 005df71b 00000002 00000002 10332864 005df71b !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0065501d'
10332858 005da7e1 10332d44 3de20020 005da7e1 1132f8dc !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005df71b'
10332d84 005dc121 1132f8dc 1132f8e0 1132f8e4 1132f8e8 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005da7e1'
10333188 007061a7 1031e8d0 10317b50 1132f7d8 007061a7 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005dc121'
1132f7c8 006f3667 1132f8d8 1132f8fc 1132fab8 006f3667 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '007061a7'
1132faa8 004083f3 04600000 01000000 00000001 004083f3 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '006f3667'
1132fb10 00408130 1132fb24 001224ef 1132fb24 00122451 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '004083f3'
1132ffc0 7d4e7c9a 00000000 00000000 7efde000 80000004 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00408130'
1132fff0 00000000 007bde7f 00000000 00000000 00000000 !BaseProcessInitPostImport+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e7c9a'

*** Dump of thread ID 3856 (state: Ready): ***

- Information -
Status: Base Priority: Unknown, Priority: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 626293.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=3404ff74
eip=7d61ccc6 esp=3404ff38 ebp=3404ff9c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
3404ff9c 7d4d14ef 00000064 00000000 3404ffb8 00749924 !NtDelayExecution+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d61ccc6'
3404ffac 00749924 00000064 3404ffec 7d4dfb97 00000000 !Sleep+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4d14ef'
3404ffb8 7d4dfb97 00000000 00000000 00000000 00000000 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00749924'
3404ffec 00000000 00749910 00000000 00000000 34560000 !FlsSetValue+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4dfb97'


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=684, iMonCtr=1
Model crash detected, will try to restart...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x006C6D27

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 07/03/13 09:23:58
Install Directory : 
Data Directory    : D:\Documents and Settings\All Users\Application Data\BOINC
Project Symstore  : 
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3n_ze32_1920_40_008316576;D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net


SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 11866, Write: 0, Other 30820

- I/O Transfers Counters -
Read: 0, Write: 998, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 124432, QuotaPeakPagedPoolUsage: 124432
QuotaNonPagedPoolUsage: 5568, QuotaPeakNonPagedPoolUsage: 5632

- Virtual Memory Usage -
VirtualSize: 1051308032, PeakVirtualSize: 1051308032

- Pagefile Usage -
PagefileUsage: 231604224, PeakPagefileUsage: 231604224

- Working Set Size -
WorkingSetSize: 226652160, PeakWorkingSetSize: 226652160, PageFaultCount: 55759

*** Dump of thread ID 2148 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 13750000.000000, User Time: 8219062272.000000, Wait Time: 679960.000000

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x006C6D27

- Registers -
eax=00000007 ebx=0f270908 ecx=00000000 edx=10473da4 esi=0f52baa0 edi=0f253c20
eip=006c6d27 esp=0f104900 ebp=0f2708f8
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
0f2708f8 0064a92b 0f251ae0 00000488 0f2e2dcc 0064a92b !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '006c6d27'
0f2e2db8 00455431 0f52b618 00000122 0f525b78 0f4e2690 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0064a92b'
0f4b915c 0044f0de 1132f8dc 1132f8e0 1132f8e4 1132f8e8 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00455431'
0f6d5e78 0065501d 40c248bf 40c16588 100cddf8 0065501d !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0044f0de'
100cdde8 005df71b 00000002 00000002 10332864 005df71b !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0065501d'
10332858 005da7e1 10332d44 3de20020 005da7e1 1132f8dc !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005df71b'
10332d84 005dc121 1132f8dc 1132f8e0 1132f8e4 1132f8e8 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005da7e1'
10333188 007061a7 00822310 103331ac 1132f7d8 007061a7 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005dc121'
1132f7c8 006f3667 1132f8d8 1132f8fc 1132fab8 006f3667 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '007061a7'
1132faa8 004083f3 04600000 01000000 00000001 004083f3 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '006f3667'
1132fb10 00408130 1132fb24 001224ef 1132fb24 00122451 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '004083f3'
1132ffc0 7d4e7c9a 00000000 00000000 7efde000 80000004 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00408130'
1132fff0 00000000 007bde7f 00000000 00000000 00000000 !BaseProcessInitPostImport+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e7c9a'

*** Dump of thread ID 3212 (state: Ready): ***

- Information -
Status: Base Priority: Unknown, Priority: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 679825.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=3404ff74
eip=7d61ccc6 esp=3404ff38 ebp=3404ff9c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
3404ff9c 7d4d14ef 00000064 00000000 3404ffb8 00749924 !NtDelayExecution+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d61ccc6'
3404ffac 00749924 00000064 3404ffec 7d4dfb97 00000000 !Sleep+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4d14ef'
3404ffb8 7d4dfb97 00000000 00000000 00000000 00000000 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00749924'
3404ffec 00000000 00749910 00000000 00000000 34560000 !FlsSetValue+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4dfb97'


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=684, iMonCtr=1
Model crash detected, will try to restart...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x006C6D27

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 07/03/13 09:25:13
Install Directory : 
Data Directory    : D:\Documents and Settings\All Users\Application Data\BOINC
Project Symstore  : 
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3n_ze32_1920_40_008316576;D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net


SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 2290, Write: 0, Other 10527

- I/O Transfers Counters -
Read: 0, Write: 288, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 124432, QuotaPeakPagedPoolUsage: 124432
QuotaNonPagedPoolUsage: 5568, QuotaPeakNonPagedPoolUsage: 5632

- Virtual Memory Usage -
VirtualSize: 1051308032, PeakVirtualSize: 1051308032

- Pagefile Usage -
PagefileUsage: 231579648, PeakPagefileUsage: 231579648

- Working Set Size -
WorkingSetSize: 226598912, PeakWorkingSetSize: 226598912, PageFaultCount: 55228

*** Dump of thread ID 1352 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 2656250.000000, User Time: 717812480.000000, Wait Time: 684762.000000

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x006C6D27

- Registers -
eax=00000007 ebx=0f270908 ecx=00000000 edx=10473da4 esi=0f52baa0 edi=0f253c20
eip=006c6d27 esp=0f104900 ebp=0f2708f8
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
0f2708f8 0064a92b 0f251ae0 00000488 0f2e2dcc 0064a92b !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '006c6d27'
0f2e2db8 00455431 0f52b618 00000122 0f525b78 0f4e2690 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0064a92b'
0f4b915c 0044f0de 1132f8dc 1132f8e0 1132f8e4 1132f8e8 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00455431'
0f6d5e78 0065501d 40c209cb 40c12b78 100cddf8 0065501d !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0044f0de'
100cdde8 005df71b 00000002 00000002 10332864 005df71b !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0065501d'
10332858 005da7e1 10332d44 3de20020 005da7e1 1132f8dc !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005df71b'
10332d84 005dc121 1132f8dc 1132f8e0 1132f8e4 1132f8e8 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005da7e1'
10333188 007061a7 1031e8d0 10317b50 1132f7d8 007061a7 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005dc121'
1132f7c8 006f3667 1132f8d8 1132f8fc 1132fab8 006f3667 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '007061a7'
1132faa8 004083f3 04600000 01000000 00000001 004083f3 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '006f3667'
1132fb10 00408130 1132fb24 001224ef 1132fb24 00122451 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '004083f3'
1132ffc0 7d4e7c9a 00000000 00000000 7efde000 80000004 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00408130'
1132fff0 00000000 007bde7f 00000000 00000000 00000000 !BaseProcessInitPostImport+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e7c9a'

*** Dump of thread ID 2240 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 684762.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=3404ff74
eip=7d61ccc6 esp=3404ff38 ebp=3404ff9c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
3404ff9c 7d4d14ef 00000064 00000000 3404ffb8 00749924 !NtDelayExecution+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d61ccc6'
3404ffac 00749924 00000064 3404ffec 7d4dfb97 00000000 !Sleep+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4d14ef'
3404ffb8 7d4dfb97 00000000 00000000 00000000 00000000 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00749924'
3404ffec 00000000 00749910 00000000 00000000 34560000 !FlsSetValue+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4dfb97'


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=684, iMonCtr=1
Model crash detected, will try to restart...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x006C6D27

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 07/03/13 10:23:23
Install Directory : 
Data Directory    : D:\Documents and Settings\All Users\Application Data\BOINC
Project Symstore  : 
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Documents and Settings\All Users\Application Data\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3n_ze32_1920_40_008316576;D:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net


SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 46438, Write: 0, Other 104513

- I/O Transfers Counters -
Read: 0, Write: 3438, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 124432, QuotaPeakPagedPoolUsage: 124432
QuotaNonPagedPoolUsage: 5568, QuotaPeakNonPagedPoolUsage: 5632

- Virtual Memory Usage -
VirtualSize: 1051308032, PeakVirtualSize: 1051308032

- Pagefile Usage -
PagefileUsage: 231612416, PeakPagefileUsage: 231612416

- Working Set Size -
WorkingSetSize: 226672640, PeakWorkingSetSize: 226672640, PageFaultCount: 57652

*** Dump of thread ID 2752 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 52968752.000000, User Time: 34341093376.000000, Wait Time: 908080.000000

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x006C6D27

- Registers -
eax=00000007 ebx=0f270908 ecx=00000000 edx=10473da4 esi=0f52baa0 edi=0f253c20
eip=006c6d27 esp=0f104900 ebp=0f2708f8
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
0f2708f8 0064a92b 0f251ae0 00000488 0f2e2dcc 0064a92b !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '006c6d27'
0f2e2db8 00455431 0f52b618 00000122 0f525b78 0f4e2690 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0064a92b'
0f4b915c 0044f0de 1132f8dc 1132f8e0 1132f8e4 1132f8e8 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00455431'
0f6d5e78 0065501d 416d68de 4165a363 100cddf8 0065501d !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0044f0de'
100cdde8 005df71b 470c07fe 470c3044 10332864 005df71b !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '0065501d'
10332858 005da7e1 10332d44 3de20020 005da7e1 1132f8dc !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005df71b'
10332d84 005dc121 1132f8dc 1132f8e0 1132f8e4 1132f8e8 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005da7e1'
10333188 007061a7 1031e8d0 10317b50 1132f7d8 007061a7 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '005dc121'
1132f7c8 006f3667 1132f8d8 1132f8fc 1132fab8 006f3667 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '007061a7'
1132faa8 004083f3 04600000 01000000 00000001 004083f3 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '006f3667'
1132fb10 00408130 1132fb24 001224ef 1132fb24 00122451 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '004083f3'
1132ffc0 7d4e7c9a 00000000 00000000 7efde000 80000004 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00408130'
1132fff0 00000000 007bde7f 00000000 00000000 00000000 !BaseProcessInitPostImport+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e7c9a'

*** Dump of thread ID 1596 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 312500.000000, User Time: 0.000000, Wait Time: 908080.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=3404ff74
eip=7d61ccc6 esp=3404ff38 ebp=3404ff9c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
3404ff9c 7d4d14ef 00000064 00000000 3404ffb8 00749924 !NtDelayExecution+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d61ccc6'
3404ffac 00749924 00000064 3404ffec 7d4dfb97 00000000 !Sleep+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4d14ef'
3404ffb8 7d4dfb97 00000000 00000000 00000000 00000000 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00749924'
3404ffec 00000000 00749910 00000000 00000000 34560000 !FlsSetValue+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4dfb97'


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=684, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Signal 11 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2656, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 Jul 2013 02:10:15 1259513 15834131 hadcm3n_ze32_1920_40_008316576_2 1,036,800 1,263,841 1.2190
08 Jul 2013 14:48:54 1259513 15834131 hadcm3n_ze32_1920_40_008316576_2 1,010,880 1,231,000 1.2178
08 Jul 2013 05:16:31 1259513 15834131 hadcm3n_ze32_1920_40_008316576_2 984,960 1,198,149 1.2164
07 Jul 2013 12:21:44 1259513 15834131 hadcm3n_ze32_1920_40_008316576_2 959,040 1,165,702 1.2155
07 Jul 2013 03:01:59 1259513 15834131 hadcm3n_ze32_1920_40_008316576_2 933,120 1,132,908 1.2141
06 Jul 2013 11:06:54 1259513 15834131 hadcm3n_ze32_1920_40_008316576_2 907,200 1,099,984 1.2125
06 Jul 2013 05:12:58 1259513 15834131 hadcm3n_ze32_1920_40_008316576_2 881,280 1,067,416 1.2112
06 Jul 2013 04:42:50 1259513 15834131 hadcm3n_ze32_1920_40_008316576_2 855,360 1,036,768 1.2121
04 Jul 2013 14:26:49 1259513 15834131 hadcm3n_ze32_1920_40_008316576_2 829,440 1,004,249 1.2108
03 Jul 2013 14:38:20 1259513 15834131 hadcm3n_ze32_1920_40_008316576_2 803,520 982,185 1.2224
03 Jul 2013 05:54:38 1259513 15834131 hadcm3n_ze32_1920_40_008316576_2 777,600 951,999 1.2243
02 Jul 2013 12:04:27 1259513 15834131 hadcm3n_ze32_1920_40_008316576_2 751,680 919,487 1.2232
02 Jul 2013 11:28:00 1259513 15834131 hadcm3n_ze32_1920_40_008316576_2 725,760 887,047 1.2222
02 Jul 2013 11:05:32 1259513 15834131 hadcm3n_ze32_1920_40_008316576_2 699,840 854,076 1.2204
02 Jul 2013 10:46:56 1259513 15834131 hadcm3n_ze32_1920_40_008316576_2 673,920 821,220 1.2186
02 Jul 2013 10:30:19 1259513 15834131 hadcm3n_ze32_1920_40_008316576_2 648,000 788,393 1.2167
02 Jul 2013 10:07:45 1259513 15834131 hadcm3n_ze32_1920_40_008316576_2 622,080 781,362 1.2560
02 Jul 2013 09:56:43 1259513 15834131 hadcm3n_ze32_1920_40_008316576_2 596,160 748,220 1.2551
02 Jul 2013 09:46:34 1259513 15834131 hadcm3n_ze32_1920_40_008316576_2 570,240 715,568 1.2549
28 Jun 2013 09:33:53 1259513 15834131 hadcm3n_ze32_1920_40_008316576_2 544,320 683,090 1.2549


©2024 climateprediction.net