Task 11876776

Name	famous_v54s_1999_200_006692418_5
Workunit	6895671
Created	8 Sep 2010, 20:36:46 UTC
Sent	11 Sep 2010, 9:19:53 UTC
Report deadline	11 Dec 2010, 16:47:04 UTC
Received	9 Oct 2010, 22:02:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	986925
Run time	6 days 10 hours 3 min 48 sec
CPU time	6 days 5 hours 43 min 21 sec
Validate state	Invalid
Credit	1,852.98
Device peak FLOPS	1.55 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77E4BEE7 Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 6.11.1 Dump Timestamp : 10/08/10 18:48:34 Install Directory : C:\Program Files\BOINC\ Data Directory : C:\Documents and Settings\All Users\Application Data\BOINC Project Symstore : LoadLibraryA( C:\Program Files\BOINC\\dbghelp.dll ): GetLastError = 1114 LoadLibraryA( dbghelp.dll ): GetLastError = 1114 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 4, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 31, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 37532, QuotaPeakPagedPoolUsage: 37532 QuotaNonPagedPoolUsage: 1832, QuotaPeakNonPagedPoolUsage: 1832 - Virtual Memory Usage - VirtualSize: 853819392, PeakVirtualSize: 853819392 - Pagefile Usage - PagefileUsage: 18182144, PeakPagefileUsage: 23244800 - Working Set Size - WorkingSetSize: 2170880, PeakWorkingSetSize: 2170880, PageFaultCount: 530 * Dump of thread ID 5480 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 73015512.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77E4BEE7 * Dump of thread ID 5568 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 73015512.000000 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=604, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77E4BEE7 Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.11.1 Dump Timestamp : 10/08/10 18:48:36 Install Directory : C:\Program Files\BOINC\ Data Directory : C:\Documents and Settings\All Users\Application Data\BOINC Project Symstore : LoadLibraryA( C:\Program Files\BOINC\\dbghelp.dll ): GetLastError = 1114 LoadLibraryA( dbghelp.dll ): GetLastError = 1114 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 4, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 31, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 37532, QuotaPeakPagedPoolUsage: 37532 QuotaNonPagedPoolUsage: 1832, QuotaPeakNonPagedPoolUsage: 1832 - Virtual Memory Usage - VirtualSize: 853819392, PeakVirtualSize: 853819392 - Pagefile Usage - PagefileUsage: 18182144, PeakPagefileUsage: 23244800 - Working Set Size - WorkingSetSize: 2166784, PeakWorkingSetSize: 2166784, PageFaultCount: 529 * Dump of thread ID 4460 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 73015680.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77E4BEE7 * Dump of thread ID 4568 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 73015680.000000 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=604, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77E4BEE7 Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.11.1 Dump Timestamp : 10/08/10 18:48:39 Install Directory : C:\Program Files\BOINC\ Data Directory : C:\Documents and Settings\All Users\Application Data\BOINC Project Symstore : LoadLibraryA( C:\Program Files\BOINC\\dbghelp.dll ): GetLastError = 1114 LoadLibraryA( dbghelp.dll ): GetLastError = 1114 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 4, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 31, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 37532, QuotaPeakPagedPoolUsage: 37532 QuotaNonPagedPoolUsage: 1832, QuotaPeakNonPagedPoolUsage: 1832 - Virtual Memory Usage - VirtualSize: 853819392, PeakVirtualSize: 853819392 - Pagefile Usage - PagefileUsage: 18182144, PeakPagefileUsage: 23244800 - Working Set Size - WorkingSetSize: 2166784, PeakWorkingSetSize: 2166784, PageFaultCount: 529 * Dump of thread ID 1168 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 73015840.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77E4BEE7 * Dump of thread ID 1200 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 73015840.000000 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=604, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77E4BEE7 Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.11.1 Dump Timestamp : 10/08/10 18:48:41 Install Directory : C:\Program Files\BOINC\ Data Directory : C:\Documents and Settings\All Users\Application Data\BOINC Project Symstore : LoadLibraryA( C:\Program Files\BOINC\\dbghelp.dll ): GetLastError = 1114 LoadLibraryA( dbghelp.dll ): GetLastError = 1114 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 4, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 31, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 37532, QuotaPeakPagedPoolUsage: 37532 QuotaNonPagedPoolUsage: 1832, QuotaPeakNonPagedPoolUsage: 1832 - Virtual Memory Usage - VirtualSize: 853819392, PeakVirtualSize: 853819392 - Pagefile Usage - PagefileUsage: 18186240, PeakPagefileUsage: 23244800 - Working Set Size - WorkingSetSize: 2166784, PeakWorkingSetSize: 2166784, PageFaultCount: 529 * Dump of thread ID 5856 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 73016000.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77E4BEE7 * Dump of thread ID 5316 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 73016000.000000 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=604, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77E4BEE7 Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.11.1 Dump Timestamp : 10/08/10 18:48:44 Install Directory : C:\Program Files\BOINC\ Data Directory : C:\Documents and Settings\All Users\Application Data\BOINC Project Symstore : LoadLibraryA( C:\Program Files\BOINC\\dbghelp.dll ): GetLastError = 1114 LoadLibraryA( dbghelp.dll ): GetLastError = 1114 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 4, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 31, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 37532, QuotaPeakPagedPoolUsage: 37532 QuotaNonPagedPoolUsage: 1832, QuotaPeakNonPagedPoolUsage: 1832 - Virtual Memory Usage - VirtualSize: 853819392, PeakVirtualSize: 853819392 - Pagefile Usage - PagefileUsage: 18186240, PeakPagefileUsage: 23244800 - Working Set Size - WorkingSetSize: 2166784, PeakWorkingSetSize: 2166784, PageFaultCount: 529 * Dump of thread ID 4128 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 73016168.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77E4BEE7 * Dump of thread ID 5112 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 73016168.000000 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=604, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77E4BEE7 Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.11.1 Dump Timestamp : 10/08/10 18:48:47 Install Directory : C:\Program Files\BOINC\ Data Directory : C:\Documents and Settings\All Users\Application Data\BOINC Project Symstore : LoadLibraryA( C:\Program Files\BOINC\\dbghelp.dll ): GetLastError = 1114 LoadLibraryA( dbghelp.dll ): GetLastError = 1114 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 4, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 31, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 37532, QuotaPeakPagedPoolUsage: 37532 QuotaNonPagedPoolUsage: 1832, QuotaPeakNonPagedPoolUsage: 1832 - Virtual Memory Usage - VirtualSize: 853819392, PeakVirtualSize: 853819392 - Pagefile Usage - PagefileUsage: 18186240, PeakPagefileUsage: 23244800 - Working Set Size - WorkingSetSize: 2166784, PeakWorkingSetSize: 2166784, PageFaultCount: 529 * Dump of thread ID 5608 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 73016328.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77E4BEE7 * Dump of thread ID 5324 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 73016328.000000 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=604, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( 18:48:49 (604): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Oct 2010 22:21:13	986925	11876776	famous_v54s_1999_200_006692418_5	561,626	532,940	0.9489
02 Oct 2010 20:22:05	986925	11876776	famous_v54s_1999_200_006692418_5	552,266	525,659	0.9518
02 Oct 2010 18:15:34	986925	11876776	famous_v54s_1999_200_006692418_5	542,906	518,329	0.9547
02 Oct 2010 16:15:56	986925	11876776	famous_v54s_1999_200_006692418_5	533,546	510,979	0.9577
02 Oct 2010 14:05:59	986925	11876776	famous_v54s_1999_200_006692418_5	524,186	503,350	0.9603
02 Oct 2010 11:59:35	986925	11876776	famous_v54s_1999_200_006692418_5	514,826	495,668	0.9628
02 Oct 2010 09:52:00	986925	11876776	famous_v54s_1999_200_006692418_5	505,466	487,999	0.9654
02 Oct 2010 07:40:50	986925	11876776	famous_v54s_1999_200_006692418_5	496,106	480,325	0.9682
02 Oct 2010 05:34:29	986925	11876776	famous_v54s_1999_200_006692418_5	486,746	472,672	0.9711
02 Oct 2010 03:27:08	986925	11876776	famous_v54s_1999_200_006692418_5	477,386	465,000	0.9741
02 Oct 2010 03:13:37	986925	11876776	famous_v54s_1999_200_006692418_5	468,026	457,120	0.9767
01 Oct 2010 22:44:36	986925	11876776	famous_v54s_1999_200_006692418_5	458,666	448,962	0.9788
01 Oct 2010 18:31:36	986925	11876776	famous_v54s_1999_200_006692418_5	449,306	440,157	0.9796
01 Oct 2010 16:00:49	986925	11876776	famous_v54s_1999_200_006692418_5	439,946	430,985	0.9796
01 Oct 2010 13:25:55	986925	11876776	famous_v54s_1999_200_006692418_5	430,586	421,848	0.9797
01 Oct 2010 10:52:00	986925	11876776	famous_v54s_1999_200_006692418_5	421,226	412,703	0.9798
01 Oct 2010 08:16:02	986925	11876776	famous_v54s_1999_200_006692418_5	411,866	403,563	0.9798
01 Oct 2010 05:44:24	986925	11876776	famous_v54s_1999_200_006692418_5	402,506	394,422	0.9799
01 Oct 2010 03:18:12	986925	11876776	famous_v54s_1999_200_006692418_5	393,146	385,279	0.9800
01 Oct 2010 03:18:12	986925	11876776	famous_v54s_1999_200_006692418_5	383,786	375,937	0.9795