Task 15792984

Name	hadcm3n_4ilr_1940_40_008308522_2
Workunit	8459657
Created	22 May 2013, 4:03:17 UTC
Sent	22 May 2013, 4:03:54 UTC
Report deadline	21 Aug 2013, 11:31:05 UTC
Received	30 May 2013, 22:22:11 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-529697949 (0xE06D7363) Unknown error code
Computer ID	1283606
Run time	8 days 15 hours 55 min 42 sec
CPU time	8 days 12 hours 44 min 2 sec
Validate state	Invalid
Credit	2,488.32
Device peak FLOPS	1.54 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code -529697949 (0xe06d7363) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x76964B32 Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 6.13.0 Dump Timestamp : 05/30/13 18:06:44 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_4ilr_1940_40_008308522;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 00400000 00111000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_6.07_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 770c0000 00157000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.9200.16578) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 74bf0000 00130000 C:\WINDOWS\SYSTEM32\KERNEL32.DLL (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 76950000 000a6000 C:\WINDOWS\SYSTEM32\KERNELBASE.dll (6.2.9200.16451) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 74d20000 00116000 C:\WINDOWS\SYSTEM32\USER32.dll (6.2.9200.16420) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 76f50000 000ae000 C:\WINDOWS\SYSTEM32\ADVAPI32.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 75470000 000fd000 C:\WINDOWS\SYSTEM32\GDI32.dll (6.2.9200.16433) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.2.9200.16433 (win8_gdr.121010-1704) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16433 ModLoad: 753b0000 000b1000 C:\WINDOWS\SYSTEM32\msvcrt.dll (7.0.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.9200.16384 ModLoad: 74700000 00034000 C:\WINDOWS\SYSTEM32\sechost.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 74eb0000 000ac000 C:\WINDOWS\SYSTEM32\RPCRT4.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 746e0000 0001c000 C:\WINDOWS\SYSTEM32\SspiCli.dll (6.2.9200.16420) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 6.2.9200.16420 (win8_gdr.120919-1813) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16420 ModLoad: 746d0000 00009000 C:\WINDOWS\SYSTEM32\CRYPTBASE.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 74670000 00051000 C:\WINDOWS\SYSTEM32\bcryptPrimitives.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 751b0000 00020000 C:\WINDOWS\system32\IMM32.DLL (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 750d0000 000dd000 C:\WINDOWS\SYSTEM32\MSCTF.dll (6.2.9200.16496) (-exported- Symbols Loaded) Linked PDB Filename : msctf.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 73e10000 00026000 C:\WINDOWS\SYSTEM32\ntmarta.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : ntmarta.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 6e9b0000 000a4000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_se_6.07_windows_intelx86.dll (-exported- Symbols Loaded) Linked PDB Filename : d:\cpdn\cpdnboinc\hadcm3\test\projects\reqs.comlab.ox.ac.uk_cpdn\hadcm3n_se_6.07_windows_intelx86.pdb ModLoad: 73ec0000 00129000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 74060000 00008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 0, Write: 0, Other 0 - I/O Transfers Counters - Read: 0, Write: 0, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0 QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0 - Virtual Memory Usage - VirtualSize: 0, PeakVirtualSize: 0 - Pagefile Usage - PagefileUsage: 0, PeakPagefileUsage: 0 - Working Set Size - WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0 * Dump of thread ID 2096 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x76964B32 - Registers - eax=0018f218 ebx=02c20048 ecx=00000003 edx=00000000 esi=6ea4a484 edi=013afa00 eip=76964b32 esp=0018f218 ebp=0018f274 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000216 - Callstack - ChildEBP RetAddr Args to Child 0018f274 6ea0e730 e06d7363 00000001 00000003 0018f2a0 KERNELBASE!RaiseException+0x0 0018f2ac 6ea0bcdc 0018f2bc 6ea41fe0 6ea313f4 6ea3b230 hadcm3n_se_6.07_windows_intelx8!umtonc+0x0 0018f2c8 6e9bfa97 04ebe800 00000010 00310b90 00000000 hadcm3n_se_6.07_windows_intelx8!umtonc+0x0 0018f2e0 6e9b36b8 f241221d 004bb848 004bb710 0018f6e0 hadcm3n_se_6.07_windows_intelx8!+0x0 00000000 00000000 00000000 00000000 00000000 00000000 hadcm3n_se_6.07_windows_intelx8!+0x0 * Dump of thread ID 4728 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=00000000 ebx=0209ff44 ecx=00000000 edx=00000000 esi=0209ff44 edi=00000000 eip=770edf34 esp=0209ff04 ebp=0209ff68 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 0209ff68 7695119c 00000064 00000000 0209ff84 00413da4 ntdll!ZwDelayExecution+0x0 0209ff78 00413da4 00000064 0209ff90 74c18543 00000000 KERNELBASE!Sleep+0x0 0209ff84 74c18543 00000000 0209ffd4 7711bf39 00000000 hadcm3n_6.07_windows_intelx86!+0x0 0209ff90 7711bf39 00000000 488b519d 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0209ffd4 7711bf0c 00413d90 00000000 ffffffff 77191df7 ntdll!RtlInitializeExceptionChain+0x0 0209ffec 00000000 00413d90 00000000 00000000 515a1ab7 ntdll!RtlInitializeExceptionChain+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 May 2013 23:12:51	1283606	15792984	hadcm3n_4ilr_1940_40_008308522_2	207,360	655,222	3.1598
29 May 2013 00:09:53	1283606	15792984	hadcm3n_4ilr_1940_40_008308522_2	181,440	573,136	3.1588
27 May 2013 23:20:01	1283606	15792984	hadcm3n_4ilr_1940_40_008308522_2	155,520	490,735	3.1554
27 May 2013 00:00:54	1283606	15792984	hadcm3n_4ilr_1940_40_008308522_2	129,600	408,826	3.1545
26 May 2013 00:52:51	1283606	15792984	hadcm3n_4ilr_1940_40_008308522_2	103,680	327,051	3.1544
25 May 2013 01:34:35	1283606	15792984	hadcm3n_4ilr_1940_40_008308522_2	77,760	245,202	3.1533
24 May 2013 02:20:44	1283606	15792984	hadcm3n_4ilr_1940_40_008308522_2	51,840	163,218	3.1485
23 May 2013 03:11:07	1283606	15792984	hadcm3n_4ilr_1940_40_008308522_2	25,920	81,882	3.1590