Task 12860586

Name	hadam3p_eu_2jsw_1985_1_007242026_0
Workunit	7440266
Created	4 May 2011, 19:45:20 UTC
Sent	11 May 2011, 0:14:11 UTC
Report deadline	22 Apr 2012, 5:34:11 UTC
Received	21 May 2011, 21:32:05 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	231457
Run time	4 days 17 hours 40 min 17 sec
CPU time	4 days 8 hours 50 min 39 sec
Validate state	Invalid
Credit	796.57
Device peak FLOPS	1.36 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C91CFF4 write attempt to address 0x0000018C Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 6.13.0 Dump Timestamp : 05/17/11 20:59:48 Install Directory : C:\Archivos de programa\BOINC\ Data Directory : C:\Documents and Settings\All Users\Datos de programa\BOINC Project Symstore : LoadLibraryA( C:\Archivos de programa\BOINC\\dbghelp.dll ): GetLastError = 998 LoadLibraryA( dbghelp.dll ): GetLastError = 998 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 4946, Write: 0, Other 210 - I/O Transfers Counters - Read: 0, Write: 932, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 45456, QuotaPeakPagedPoolUsage: 49752 QuotaNonPagedPoolUsage: 10272, QuotaPeakNonPagedPoolUsage: 10592 - Virtual Memory Usage - VirtualSize: 51281920, PeakVirtualSize: 55664640 - Pagefile Usage - PagefileUsage: 2924544, PeakPagefileUsage: 2924544 - Working Set Size - WorkingSetSize: 30035968, PeakWorkingSetSize: 30035968, PageFaultCount: 8234 * Dump of thread ID 3208 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 8281250.000000, User Time: 23906250.000000, Wait Time: 739998.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C91CFF4 write attempt to address 0x0000018C * Dump of thread ID 2492 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 600239.000000 * Dump of thread ID 2664 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 156250.000000, Wait Time: 739997.000000 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=396, selfPID=396, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=396, selfPID=3480, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C91CFF4 write attempt to address 0x000011A4 Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.13.0 Dump Timestamp : 05/17/11 21:08:54 Install Directory : C:\Archivos de programa\BOINC\ Data Directory : C:\Documents and Settings\All Users\Datos de programa\BOINC Project Symstore : LoadLibraryA( C:\Archivos de programa\BOINC\\dbghelp.dll ): GetLastError = 998 LoadLibraryA( dbghelp.dll ): GetLastError = 998 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 4948, Write: 0, Other 208 - I/O Transfers Counters - Read: 0, Write: 782, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 45320, QuotaPeakPagedPoolUsage: 49616 QuotaNonPagedPoolUsage: 10256, QuotaPeakNonPagedPoolUsage: 10600 - Virtual Memory Usage - VirtualSize: 51142656, PeakVirtualSize: 55525376 - Pagefile Usage - PagefileUsage: 2936832, PeakPagefileUsage: 2936832 - Working Set Size - WorkingSetSize: 30011392, PeakWorkingSetSize: 30011392, PageFaultCount: 8233 * Dump of thread ID 3816 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 6093750.000000, User Time: 27343750.000000, Wait Time: 774891.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C91CFF4 write attempt to address 0x000011A4 * Dump of thread ID 4412 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 750970.000000 * Dump of thread ID 4424 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 312500.000000, Wait Time: 774888.000000 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Signal 11 received, exiting... Called boinc_finish Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C91CFF4 write attempt to address 0x00405100 Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.13.0 Dump Timestamp : 05/17/11 21:09:27 Install Directory : C:\Archivos de programa\BOINC\ Data Directory : C:\Documents and Settings\All Users\Datos de programa\BOINC Project Symstore : LoadLibraryA( C:\Archivos de programa\BOINC\\dbghelp.dll ): GetLastError = 998 LoadLibraryA( dbghelp.dll ): GetLastError = 998 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 1125, Write: 0, Other 272 - I/O Transfers Counters - Read: 0, Write: 380, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 58536, QuotaPeakPagedPoolUsage: 58536 QuotaNonPagedPoolUsage: 10368, QuotaPeakNonPagedPoolUsage: 10720 - Virtual Memory Usage - VirtualSize: 1152438272, PeakVirtualSize: 1185841152 - Pagefile Usage - PagefileUsage: 9732096, PeakPagefileUsage: 42999808 - Working Set Size - WorkingSetSize: 5566464, PeakWorkingSetSize: 5566464, PageFaultCount: 1688 * Dump of thread ID 5212 (state: Ready): * - Information - Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 2968750.000000, User Time: 1406250.000000, Wait Time: 777020.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C91CFF4 write attempt to address 0x00405100 * Dump of thread ID 6044 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 754488.000000 * Dump of thread ID 6068 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 777019.000000 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4516, selfPID=4516, iMonCtr=1 Signal 11 received, exiting... Called boinc_finish Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x50662E62 read attempt to address 0x11AB0300 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C91CFF4 write attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C91CFF4 write attempt to address 0x00000910 Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.13.0 Dump Timestamp : 05/20/11 18:12:16 Install Directory : C:\Archivos de programa\BOINC\ Data Directory : C:\Documents and Settings\All Users\Datos de programa\BOINC Project Symstore : LoadLibraryA( C:\Archivos de programa\BOINC\\dbghelp.dll ): GetLastError = 998 LoadLibraryA( dbghelp.dll ): GetLastError = 998 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 29923, Write: 0, Other 15539 - I/O Transfers Counters - Read: 0, Write: 8763, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 45456, QuotaPeakPagedPoolUsage: 49752 QuotaNonPagedPoolUsage: 10360, QuotaPeakNonPagedPoolUsage: 11552 - Virtual Memory Usage - VirtualSize: 51351552, PeakVirtualSize: 66957312 - Pagefile Usage - PagefileUsage: 3108864, PeakPagefileUsage: 17752064 - Working Set Size - WorkingSetSize: 30580736, PeakWorkingSetSize: 45662208, PageFaultCount: 22477 * Dump of thread ID 2492 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 24218750.000000, User Time: 199531248.000000, Wait Time: 15571139.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C91CFF4 write attempt to address 0x00000910 * Dump of thread ID 2524 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 312500.000000, User Time: 937500.000000, Wait Time: 15570734.000000 * Dump of thread ID 3480 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 1718750.000000, User Time: 2031250.000000, Wait Time: 15571140.000000 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2320, selfPID=2160, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2320, selfPID=2320, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 01:03:32 (5064): No heartbeat from core client for 30 sec - exiting 01:03:33 (5064): No heartbeat from core client for 30 sec - exiting 01:03:34 (5064): No heartbeat from core client for 30 sec - exiting 01:03:36 (5064): No heartbeat from core client for 30 sec - exiting 01:03:37 (5064): No heartbeat from core client for 30 sec - exiting 01:03:38 (5064): No heartbeat from core client for 30 sec - exiting 01:03:39 (5064): No heartbeat from core client for 30 sec - exiting 01:03:40 (5064): No heartbeat from core client for 30 sec - exiting 01:03:41 (5064): No heartbeat from core client for 30 sec - exiting 01:03:42 (5064): No heartbeat from core client for 30 sec - exiting 01:03:44 (5064): No heartbeat from core client for 30 sec - exiting 01:03:45 (5064): No heartbeat from core client for 30 sec - exiting 01:03:46 (5064): No heartbeat from core client for 30 sec - exiting 01:03:47 (5064): No heartbeat from core client for 30 sec - exiting 01:03:48 (5064): No heartbeat from core client for 30 sec - exiting 01:03:49 (5064): No heartbeat from core client for 30 sec - exiting 01:03:50 (5064): No heartbeat from core client for 30 sec - exiting 01:03:51 (5064): No heartbeat from core client for 30 sec - exiting 01:03:52 (5064): No heartbeat from core client for 30 sec - exiting 01:03:53 (5064): No heartbeat from core client for 30 sec - exiting 01:03:55 (5064): No heartbeat from core client for 30 sec - exiting 01:03:56 (5064): No heartbeat from core client for 30 sec - exiting 01:03:57 (5064): No heartbeat from core client for 30 sec - exiting 01:03:58 (5064): No heartbeat from core client for 30 sec - exiting 01:03:59 (5064): No heartbeat from core client for 30 sec - exiting 01:04:00 (5064): No heartbeat from core client for 30 sec - exiting 01:04:01 (5064): No heartbeat from core client for 30 sec - exiting 01:04:02 (5064): No heartbeat from core client for 30 sec - exiting 01:04:04 (5064): No heartbeat from core client for 30 sec - exiting 01:04:05 (5064): No heartbeat from core client for 30 sec - exiting 01:04:06 (5064): No heartbeat from core client for 30 sec - exiting 01:04:07 (5064): No heartbeat from core client for 30 sec - exiting 01:04:08 (5064): No heartbeat from core client for 30 sec - exiting 01:04:10 (5064): No heartbeat from core client for 30 sec - exiting 01:04:11 (5064): No heartbeat from core client for 30 sec - exiting 01:04:12 (5064): No heartbeat from core client for 30 sec - exiting 01:04:13 (5064): No heartbeat from core client for 30 sec - exiting 01:04:14 (5064): No heartbeat from core client for 30 sec - exiting 01:04:15 (5064): No heartbeat from core client for 30 sec - exiting 01:04:16 (5064): No heartbeat from core client for 30 sec - exiting 01:04:18 (5064): No heartbeat from core client for 30 sec - exiting 01:04:19 (5064): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C91CFF4 write attempt to address 0x00000A80 Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.13.0 Dump Timestamp : 05/21/11 07:10:31 Install Directory : C:\Archivos de programa\BOINC\ Data Directory : C:\Documents and Settings\All Users\Datos de programa\BOINC Project Symstore : LoadLibraryA( C:\Archivos de programa\BOINC\\dbghelp.dll ): GetLastError = 998 LoadLibraryA( dbghelp.dll ): GetLastError = 998 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 17432, Write: 0, Other 7842 - I/O Transfers Counters - Read: 0, Write: 4708, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 45456, QuotaPeakPagedPoolUsage: 49752 QuotaNonPagedPoolUsage: 10280, QuotaPeakNonPagedPoolUsage: 11096 - Virtual Memory Usage - VirtualSize: 51281920, PeakVirtualSize: 66887680 - Pagefile Usage - PagefileUsage: 2969600, PeakPagefileUsage: 17612800 - Working Set Size - WorkingSetSize: 30445568, PeakWorkingSetSize: 45191168, PageFaultCount: 15624 * Dump of thread ID 952 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 13437500.000000, User Time: 104218752.000000, Wait Time: 1384670.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C91CFF4 write attempt to address 0x00000A80 * Dump of thread ID 2312 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1383843.000000 * Dump of thread ID 2136 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 625000.000000, Wait Time: 1384669.000000 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2688, selfPID=2688, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2688, selfPID=4060, iMonCtr=1 Signal 11 received, exiting... Called boinc_finish ERROR: Invalid parameter detected in function (null). File: (null) Line: 0 ERROR: Expression: (null) CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1196, selfPID=3212, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_eu_2jsw_1985_1_007242026_0_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2jsw_1985_1_007242026_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2jsw_1985_1_007242026_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2jsw_1985_1_007242026_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2jsw_1985_1_007242026_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2jsw_1985_1_007242026_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2jsw_1985_1_007242026_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2jsw_1985_1_007242026_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 May 2011 04:12:41	231457	12860586	hadam3p_eu_2jsw_1985_1_007242026_0	46,176	363,499	7.8720
19 May 2011 22:55:07	231457	12860586	hadam3p_eu_2jsw_1985_1_007242026_0	34,656	272,522	7.8636
18 May 2011 20:32:28	231457	12860586	hadam3p_eu_2jsw_1985_1_007242026_0	23,136	181,973	7.8654
17 May 2011 12:27:02	231457	12860586	hadam3p_eu_2jsw_1985_1_007242026_0	11,616	91,794	7.9024