climateprediction.net home page
Task 16217972

Task 16217972

Name hadcm3n_7at4_1980_40_008425291_1
Workunit 8576147
Created 13 Jan 2014, 23:19:45 UTC
Sent 13 Jan 2014, 23:20:18 UTC
Report deadline 15 Apr 2014, 6:47:29 UTC
Received 15 Jan 2014, 5:41:11 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1274862
Run time 1 days 4 hours 18 min 56 sec
CPU time 1 days 3 hours 17 min 36 sec
Validate state Invalid
Credit 933.12
Device peak FLOPS 3.12 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.2.33</core_client_version>
<![CDATA[
<message>
The device does not recognize the command.
 (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
03:25:33 (6904): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
22:09:21 (5656): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                             Signal 11 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2368, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2368, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2368, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2368, iMonCtr=1
Model crash detected, will try to restart...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77762EEC

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 01/14/14 22:51:48
Install Directory : 
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_7at4_1980_40_008425291;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 00400000 00b28000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_um_6.07_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 77a70000 00168000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.3.9600.16408) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 6.3.9600.16384 (winblue_rtm.130821-1623)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.3.9600.16384

ModLoad: 75910000 00140000 C:\WINDOWS\SYSTEM32\KERNEL32.DLL (6.3.9600.16441) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 6.3.9600.16384 (winblue_rtm.130821-1623)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.3.9600.16384

ModLoad: 77750000 000cf000 C:\WINDOWS\SYSTEM32\KERNELBASE.dll (6.3.9600.16408) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 6.3.9600.16384 (winblue_rtm.130821-1623)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.3.9600.16384

ModLoad: 6c1c0000 0007d000 C:\Program Files\Bitdefender\Bitdefender 2013\Active Virus Control\Avc3_00220_035\avcuf32.dll (3.10.8557.4456) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\SVNROOT\AVC3\7820_adobe_reader\bin\Win32\Release\avcuf32.pdb
    File Version          : 3.10.8557.4456
    Company Name          : BitDefender S.R.L. Bucharest, ROMANIA
    Product Name          : BitDefender&#174; AntiVirus
    Product Version       : 13

ModLoad: 76e30000 0014f000 C:\WINDOWS\SYSTEM32\USER32.dll (6.3.9600.16441) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 6.3.9600.16384 (winblue_rtm.130821-1623)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.3.9600.16384

ModLoad: 77820000 00108000 C:\WINDOWS\SYSTEM32\GDI32.dll (6.3.9600.16421) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 6.3.9600.16421 (winblue_gdr.131004-2100)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.3.9600.16421

ModLoad: 776d0000 00077000 C:\WINDOWS\SYSTEM32\ADVAPI32.dll (6.3.9600.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 6.3.9600.16384 (winblue_rtm.130821-1623)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.3.9600.16384

ModLoad: 6bfc0000 000d4000 C:\WINDOWS\SYSTEM32\OPENGL32.dll (6.3.9600.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : opengl32.pdb
    File Version          : 6.3.9600.16384 (winblue_rtm.130821-1623)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.3.9600.16384

ModLoad: 6b7a0000 00024000 C:\WINDOWS\SYSTEM32\GLU32.dll (6.3.9600.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : glu32.pdb
    File Version          : 6.3.9600.16384 (winblue_rtm.130821-1623)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.3.9600.16384

ModLoad: 77980000 00012000 C:\WINDOWS\SYSTEM32\imagehlp.dll (6.3.9600.16438) (-exported- Symbols Loaded)
    Linked PDB Filename   : imagehlp.pdb
    File Version          : 6.3.9600.16438 (winblue_gdr.131018-1626)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.3.9600.16438

ModLoad: 77190000 000be000 C:\WINDOWS\SYSTEM32\msvcrt.dll (7.0.9600.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.9600.16384 (winblue_rtm.130821-1623)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.9600.16384

ModLoad: 76dd0000 0003e000 C:\WINDOWS\SYSTEM32\sechost.dll (6.3.9600.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 6.3.9600.16384 (winblue_rtm.130821-1623)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.3.9600.16384

ModLoad: 770d0000 000b1000 C:\WINDOWS\SYSTEM32\RPCRT4.dll (6.3.9600.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 6.3.9600.16384 (winblue_rtm.130821-1623)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.3.9600.16384

ModLoad: 6b6b0000 000e7000 C:\WINDOWS\SYSTEM32\DDRAW.dll (6.3.9600.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : ddraw.pdb
    File Version          : 6.3.9600.16384 (winblue_rtm.130821-1623)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.3.9600.16384

ModLoad: 754a0000 0001d000 C:\WINDOWS\SYSTEM32\SspiCli.dll (6.3.9600.16408) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 6.3.9600.16408 (winblue_gdr.130920-1803)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.3.9600.16408

ModLoad: 6b6a0000 00007000 C:\WINDOWS\SYSTEM32\DCIMAN32.dll (6.3.9600.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : dciman32.pdb
    File Version          : 6.3.9600.16384 (winblue_rtm.130821-1623)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.3.9600.16384

ModLoad: 75490000 00009000 C:\WINDOWS\SYSTEM32\CRYPTBASE.dll (6.3.9600.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 6.3.9600.16384 (winblue_rtm.130821-1623)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.3.9600.16384

ModLoad: 75430000 00051000 C:\WINDOWS\SYSTEM32\bcryptPrimitives.dll (6.3.9600.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 6.3.9600.16384 (winblue_rtm.130821-1623)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.3.9600.16384

ModLoad: 77440000 00025000 C:\WINDOWS\system32\IMM32.DLL (6.3.9600.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 6.3.9600.16384 (winblue_rtm.130821-1623)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.3.9600.16384

ModLoad: 75a50000 000f7000 C:\WINDOWS\SYSTEM32\MSCTF.dll (6.3.9600.16418) (-exported- Symbols Loaded)
    Linked PDB Filename   : msctf.pdb
    File Version          : 6.3.9600.16384 (winblue_rtm.130821-1623)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.3.9600.16384

ModLoad: 66e90000 00148000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.3.9600.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 6.3.9600.16384 (winblue_rtm.130821-1623)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.3.9600.16384

ModLoad: 74e40000 00008000 C:\WINDOWS\SYSTEM32\version.dll (6.3.9600.16384) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 6.3.9600.16384 (winblue_rtm.130821-1623)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.3.9600.16384



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 0, Write: 0, Other 0

- I/O Transfers Counters -
Read: 0, Write: 0, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0
QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0

- Virtual Memory Usage -
VirtualSize: 0, PeakVirtualSize: 0

- Pagefile Usage -
PagefileUsage: 0, PeakPagefileUsage: 0

- Working Set Size -
WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0

*** Dump of thread ID 4088 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77762EEC

- Registers -
eax=1132f9b8 ebx=00000001 ecx=00000003 edx=00000000 esi=009fca88 edi=fffffffe
eip=77762eec esp=1132f9b8 ebp=1132fa14
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000216

- Callstack -
ChildEBP RetAddr  Args to Child
1132fa14 007bfa90 e06d7363 00000001 00000003 1132fa40 KERNELBASE!RaiseException+0x0 
1132fa4c 007bbbcb 1132fa5c 00860978 0082f1b4 0085d354 hadcm3n_um_6.07_windows_intelx8!+0x0 
1132fa68 00406e8c 04600000 01000000 00500000 004083ee hadcm3n_um_6.07_windows_intelx8!+0x0 
1132fadc 00408130 1132faf0 002232e9 1132faf0 00223271 hadcm3n_um_6.07_windows_intelx8!+0x0 
1132ff8c 7592495d 7ffde000 1132ffdc 77ab98ee 7ffde000 hadcm3n_um_6.07_windows_intelx8!+0x0 
1132ff98 77ab98ee 7ffde000 bfbb8bc2 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1132ffdc 77ab98c4 ffffffff 77aae0ed 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
1132ffec 00000000 007bde7f 7ffde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 8396 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Registers -
eax=c0000004 ebx=3394fd60 ecx=00000000 edx=00000000 esi=00000000 edi=3394fd60
eip=77aabf3c esp=3394fd20 ebp=3394fd84
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000212

- Callstack -
ChildEBP RetAddr  Args to Child
3394fd84 6c20d997 00000064 00000000 3394fdd8 6d1c2088 ntdll!ZwDelayExecution+0x0 
3394fdb0 6c1c9404 6d1c20b8 3394fe3c 00000002 00000000 avcuf32!AvcGetJumpCode+0x0 
3394fe6c 777511f6 00000001 00000202 6d1c2088 777511f6 avcuf32!AvcGetJumpCode+0x0 
3394fe7c 777511f6 00000064 00000000 3394feb4 6c20d997 KERNELBASE!Sleep+0x0 
3394fe8c 6c20d997 00000064 6c20d93f 6d1c2238 3394ff40 KERNELBASE!Sleep+0x0 
3394feb4 6c1c9404 6d1c2268 3394ff40 00000001 00000000 avcuf32!AvcGetJumpCode+0x0 
3394ff70 00749924 00000001 00000202 6d1c2238 00749924 avcuf32!AvcGetJumpCode+0x0 
3394ff80 00749924 00000064 3394ff98 7592495d 00000000 hadcm3n_um_6.07_windows_intelx8!+0x0 
3394ff8c 7592495d 00000000 3394ffdc 77ab98ee 00000000 hadcm3n_um_6.07_windows_intelx8!+0x0 
3394ff98 77ab98ee 00000000 9d1d8bc2 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
3394ffdc 77ab98c4 ffffffff 77aae0ed 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
3394ffec 00000000 00749910 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2368, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
15 Jan 2014 00:46:57 1274862 16217972 hadcm3n_7at4_1980_40_008425291_1 77,760 86,294 1.1097
14 Jan 2014 16:03:36 1274862 16217972 hadcm3n_7at4_1980_40_008425291_1 51,840 57,651 1.1121
14 Jan 2014 08:32:56 1274862 16217972 hadcm3n_7at4_1980_40_008425291_1 25,920 28,861 1.1135


©2024 climateprediction.net