Task 14432366

Name	hadam3p_pnw_b64k_1979_1_007894243_0
Workunit	8049355
Created	17 Apr 2012, 14:28:57 UTC
Sent	17 May 2012, 21:45:23 UTC
Report deadline	30 Apr 2013, 3:05:23 UTC
Received	24 May 2012, 7:20:29 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1146891
Run time	4 days 3 hours 15 min 23 sec
CPU time	4 days 0 hours 58 min 54 sec
Validate state	Invalid
Credit	2,254.93
Device peak FLOPS	2.02 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=98800, selfPID=100624, iMonCPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=24512, selfPID=24512, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=49572, selfPID=49572, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7690B9BC Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 6.13.0 Dump Timestamp : 05/23/12 14:08:29 Install Directory : C:\Program Files (x86)\BOINC\ Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\Program Files (x86)\BOINC\\dbghelp.dll ): GetLastError = 193 Loaded Library : dbghelp.dll LoadLibraryA( C:\Program Files (x86)\BOINC\\symsrv.dll ): GetLastError = 193 LoadLibraryA( symsrv.dll ): GetLastError = 193 LoadLibraryA( C:\Program Files (x86)\BOINC\\srcsrv.dll ): GetLastError = 193 LoadLibraryA( srcsrv.dll ): GetLastError = 193 LoadLibraryA( C:\Program Files (x86)\BOINC\\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_pnw_b64k_1979_1_007894243;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 002d0000 008d3000 C:\ProgramData\BOINC\projects\climateprediction.net\hadrm3p_pnw_um_6.09_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : d:\cpdn\cpdnboinc\cpdnprecis\test\projects\reqs.comlab.ox.ac.uk_cpdn\hadrm3p_pnw_um_6.09_windows_intelx86.pdb ModLoad: 77330000 00180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.17725) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 6.1.7600.16385 ModLoad: 75eb0000 00110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.17651) (-nosymbols- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 6.1.7600.16385 ModLoad: 76900000 00046000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.17651) (-nosymbols- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 6.1.7600.16385 ModLoad: 74f90000 00100000 C:\Windows\syswow64\USER32.dll (6.1.7601.17514) (-nosymbols- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 6.1.7601.17514 ModLoad: 76830000 00090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.17514) (-nosymbols- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.17514 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 0, Write: 0, Other 0 - I/O Transfers Counters - Read: 0, Write: 0, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0 QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0 - Virtual Memory Usage - VirtualSize: 0, PeakVirtualSize: 0 - Pagefile Usage - PagefileUsage: 0, PeakPagefileUsage: 0 - Working Set Size - WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0 * Dump of thread ID 25872 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7690B9BC - Registers - eax=10fff94c ebx=7efde000 ecx=00000003 edx=00000000 esi=00754e48 edi=00000000 eip=7690b9bc esp=10fff94c ebp=10fff99c cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 10fff99c 005f1793 e06d7363 00000001 00000003 10fff9c8 KERNELBASE!+0x0 10fff9d4 005ee9b5 10fff9e4 0068ceb0 0065e0dc 00689214 hadrm3p_pnw_um_6.09_windows_int!+0x0 10fff9f0 002d8322 01000000 002d985b 00000000 71ebeee9 hadrm3p_pnw_um_6.09_windows_int!+0x0 10fffa54 005f0893 00000002 002b1ad0 002b1b68 71ebee45 hadrm3p_pnw_um_6.09_windows_int!+0x0 10fffa9c 75ec339a 7efde000 10fffae8 77369ef2 7efde000 hadrm3p_pnw_um_6.09_windows_int!+0x0 10fffaa8 77369ef2 7efde000 736e59fd 00000000 00000000 kernel32!+0x0 10fffae8 77369ec5 005f08ea 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 10fffb00 00000000 005f08ea 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 * Dump of thread ID 64244 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=0057b2e0 ebx=00000000 ecx=00000000 edx=00000000 esi=335efbc4 edi=00000000 eip=7734fd71 esp=335efb80 ebp=335efbe8 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246 - Callstack - ChildEBP RetAddr Args to Child 335efbe8 76913a8b 00000064 00000000 335efc04 0057b2f4 ntdll!ZwDelayExecution+0x0 335efbf8 0057b2f4 00000064 335efc10 75ec339a 00000000 KERNELBASE!+0x0 335efc04 75ec339a 00000000 335efc50 77369ef2 00000000 hadrm3p_pnw_um_6.09_windows_int!+0x0 335efc10 77369ef2 00000000 50cf5f45 00000000 00000000 kernel32!+0x0 335efc50 77369ec5 0057b2e0 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 335efc68 00000000 0057b2e0 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=70276, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_b64k_1979_1_007894243_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_b64k_1979_1_007894243_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_b64k_1979_1_007894243_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 May 2012 14:54:36	1146891	14432366	hadam3p_pnw_b64k_1979_1_007894243_0	103,776	342,071	3.2962
22 May 2012 22:49:09	1146891	14432366	hadam3p_pnw_b64k_1979_1_007894243_0	92,256	304,237	3.2977
22 May 2012 11:32:38	1146891	14432366	hadam3p_pnw_b64k_1979_1_007894243_0	80,736	266,950	3.3065
21 May 2012 20:05:01	1146891	14432366	hadam3p_pnw_b64k_1979_1_007894243_0	69,216	229,709	3.3187
21 May 2012 06:35:25	1146891	14432366	hadam3p_pnw_b64k_1979_1_007894243_0	57,696	191,548	3.3200
20 May 2012 18:09:39	1146891	14432366	hadam3p_pnw_b64k_1979_1_007894243_0	46,176	153,912	3.3332
20 May 2012 01:47:01	1146891	14432366	hadam3p_pnw_b64k_1979_1_007894243_0	34,656	116,636	3.3655
19 May 2012 01:56:29	1146891	14432366	hadam3p_pnw_b64k_1979_1_007894243_0	23,136	78,517	3.3937
18 May 2012 12:39:20	1146891	14432366	hadam3p_pnw_b64k_1979_1_007894243_0	11,616	40,445	3.4818