Task 11475268

Name	famous_u9al_1999_200_006644888_3
Workunit	6848260
Created	10 Jun 2010, 12:45:51 UTC
Sent	6 Aug 2010, 12:35:08 UTC
Report deadline	5 Nov 2010, 20:02:19 UTC
Received	23 Aug 2010, 15:30:00 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1016158
Run time	4 days 2 hours 15 min 29 sec
CPU time	3 days 23 hours 49 min 25 sec
Validate state	Invalid
Credit	3,891.17
Device peak FLOPS	3.50 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.36</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812AFB Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 6.11.1 Dump Timestamp : 08/23/10 11:28:05 Install Directory : C:\Program Files\BOINC\ Data Directory : C:\Documents and Settings\All Users\Application Data\BOINC Project Symstore : Loaded Library : C:\Program Files\BOINC\\dbghelp.dll LoadLibraryA( C:\Program Files\BOINC\\symsrv.dll ): GetLastError = 1455 LoadLibraryA( symsrv.dll ): GetLastError = 1455 Loaded Library : C:\Program Files\BOINC\\srcsrv.dll LoadLibraryA( C:\Program Files\BOINC\\version.dll ): GetLastError = 126 Loaded Library : version.dll SymInitialize(): GetLastError = 8 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 5, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 260, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 65148, QuotaPeakPagedPoolUsage: 65156 QuotaNonPagedPoolUsage: 2160, QuotaPeakNonPagedPoolUsage: 2440 - Virtual Memory Usage - VirtualSize: 873361408, PeakVirtualSize: 873361408 - Pagefile Usage - PagefileUsage: 41242624, PeakPagefileUsage: 53649408 - Working Set Size - WorkingSetSize: 2363392, PeakWorkingSetSize: 2363392, PageFaultCount: 572 * Dump of thread ID 4852 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 16621609.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812AFB * Dump of thread ID 5032 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 16621605.000000 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5364, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812AFB Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.11.1 Dump Timestamp : 08/23/10 11:28:06 Install Directory : C:\Program Files\BOINC\ Data Directory : C:\Documents and Settings\All Users\Application Data\BOINC Project Symstore : Loaded Library : C:\Program Files\BOINC\\dbghelp.dll LoadLibraryA( C:\Program Files\BOINC\\symsrv.dll ): GetLastError = 1455 LoadLibraryA( symsrv.dll ): GetLastError = 1455 LoadLibraryA( C:\Program Files\BOINC\\srcsrv.dll ): GetLastError = 1455 LoadLibraryA( srcsrv.dll ): GetLastError = 1455 LoadLibraryA( C:\Program Files\BOINC\\version.dll ): GetLastError = 126 Loaded Library : version.dll SymInitialize(): GetLastError = 8 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 5, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 47, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 65148, QuotaPeakPagedPoolUsage: 65148 QuotaNonPagedPoolUsage: 2160, QuotaPeakNonPagedPoolUsage: 2440 - Virtual Memory Usage - VirtualSize: 873361408, PeakVirtualSize: 873361408 - Pagefile Usage - PagefileUsage: 41242624, PeakPagefileUsage: 53649408 - Working Set Size - WorkingSetSize: 2363392, PeakWorkingSetSize: 2363392, PageFaultCount: 572 * Dump of thread ID 3660 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 16621719.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812AFB * Dump of thread ID 3692 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 16621718.000000 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5364, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812AFB Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.11.1 Dump Timestamp : 08/23/10 11:28:09 Install Directory : C:\Program Files\BOINC\ Data Directory : C:\Documents and Settings\All Users\Application Data\BOINC Project Symstore : LoadLibraryA( C:\Program Files\BOINC\\dbghelp.dll ): GetLastError = 1114 LoadLibraryA( dbghelp.dll ): GetLastError = 1114 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 5, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 47, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 65148, QuotaPeakPagedPoolUsage: 65156 QuotaNonPagedPoolUsage: 2160, QuotaPeakNonPagedPoolUsage: 2440 - Virtual Memory Usage - VirtualSize: 873361408, PeakVirtualSize: 873361408 - Pagefile Usage - PagefileUsage: 41242624, PeakPagefileUsage: 53649408 - Working Set Size - WorkingSetSize: 2363392, PeakWorkingSetSize: 2363392, PageFaultCount: 572 * Dump of thread ID 708 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 16621854.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812AFB * Dump of thread ID 1540 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 16621854.000000 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5364, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812AFB Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.11.1 Dump Timestamp : 08/23/10 11:28:11 Install Directory : C:\Program Files\BOINC\ Data Directory : C:\Documents and Settings\All Users\Application Data\BOINC Project Symstore : LoadLibraryA( C:\Program Files\BOINC\\dbghelp.dll ): GetLastError = 1114 LoadLibraryA( dbghelp.dll ): GetLastError = 1114 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 5, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 47, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 65148, QuotaPeakPagedPoolUsage: 65148 QuotaNonPagedPoolUsage: 2160, QuotaPeakNonPagedPoolUsage: 2440 - Virtual Memory Usage - VirtualSize: 873361408, PeakVirtualSize: 873361408 - Pagefile Usage - PagefileUsage: 41242624, PeakPagefileUsage: 53649408 - Working Set Size - WorkingSetSize: 2363392, PeakWorkingSetSize: 2363392, PageFaultCount: 572 * Dump of thread ID 5804 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 312500.000000, User Time: 0.000000, Wait Time: 16621988.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812AFB * Dump of thread ID 4680 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 16621987.000000 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5364, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812AFB Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.11.1 Dump Timestamp : 08/23/10 11:28:13 Install Directory : C:\Program Files\BOINC\ Data Directory : C:\Documents and Settings\All Users\Application Data\BOINC Project Symstore : LoadLibraryA( C:\Program Files\BOINC\\dbghelp.dll ): GetLastError = 1114 LoadLibraryA( dbghelp.dll ): GetLastError = 1114 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 5, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 47, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 65148, QuotaPeakPagedPoolUsage: 65156 QuotaNonPagedPoolUsage: 2160, QuotaPeakNonPagedPoolUsage: 2440 - Virtual Memory Usage - VirtualSize: 873361408, PeakVirtualSize: 873361408 - Pagefile Usage - PagefileUsage: 41242624, PeakPagefileUsage: 53649408 - Working Set Size - WorkingSetSize: 2363392, PeakWorkingSetSize: 2363392, PageFaultCount: 572 * Dump of thread ID 4696 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 16622121.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812AFB * Dump of thread ID 3088 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 16622121.000000 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5364, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812AFB Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.11.1 Dump Timestamp : 08/23/10 11:28:15 Install Directory : C:\Program Files\BOINC\ Data Directory : C:\Documents and Settings\All Users\Application Data\BOINC Project Symstore : LoadLibraryA( C:\Program Files\BOINC\\dbghelp.dll ): GetLastError = 1455 LoadLibraryA( dbghelp.dll ): GetLastError = 1455 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 5, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 47, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 65148, QuotaPeakPagedPoolUsage: 65148 QuotaNonPagedPoolUsage: 2160, QuotaPeakNonPagedPoolUsage: 2440 - Virtual Memory Usage - VirtualSize: 873361408, PeakVirtualSize: 873361408 - Pagefile Usage - PagefileUsage: 41242624, PeakPagefileUsage: 53649408 - Working Set Size - WorkingSetSize: 2363392, PeakWorkingSetSize: 2363392, PageFaultCount: 572 * Dump of thread ID 4192 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 16622254.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812AFB * Dump of thread ID 1996 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 16622253.000000 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5364, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( 11:28:23 (5364): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Aug 2010 13:21:20	1016158	11475268	famous_u9al_1999_200_006644888_3	1,179,386	342,731	0.2906
23 Aug 2010 12:33:45	1016158	11475268	famous_u9al_1999_200_006644888_3	1,170,026	339,975	0.2906
23 Aug 2010 11:46:02	1016158	11475268	famous_u9al_1999_200_006644888_3	1,160,666	337,217	0.2905
23 Aug 2010 10:57:10	1016158	11475268	famous_u9al_1999_200_006644888_3	1,151,306	334,487	0.2905
23 Aug 2010 10:09:23	1016158	11475268	famous_u9al_1999_200_006644888_3	1,141,946	331,800	0.2906
23 Aug 2010 09:26:57	1016158	11475268	famous_u9al_1999_200_006644888_3	1,132,586	329,092	0.2906
23 Aug 2010 07:38:56	1016158	11475268	famous_u9al_1999_200_006644888_3	1,123,226	326,352	0.2905
23 Aug 2010 06:51:26	1016158	11475268	famous_u9al_1999_200_006644888_3	1,113,866	323,627	0.2905
23 Aug 2010 06:03:52	1016158	11475268	famous_u9al_1999_200_006644888_3	1,104,506	320,903	0.2905
23 Aug 2010 04:18:48	1016158	11475268	famous_u9al_1999_200_006644888_3	1,095,146	318,147	0.2905
23 Aug 2010 02:33:19	1016158	11475268	famous_u9al_1999_200_006644888_3	1,085,786	315,464	0.2905
23 Aug 2010 01:48:52	1016158	11475268	famous_u9al_1999_200_006644888_3	1,076,426	312,776	0.2906
23 Aug 2010 01:25:46	1016158	11475268	famous_u9al_1999_200_006644888_3	1,067,066	310,056	0.2906
23 Aug 2010 00:23:25	1016158	11475268	famous_u9al_1999_200_006644888_3	1,057,706	307,363	0.2906
22 Aug 2010 21:35:36	1016158	11475268	famous_u9al_1999_200_006644888_3	1,048,346	304,602	0.2906
22 Aug 2010 20:47:43	1016158	11475268	famous_u9al_1999_200_006644888_3	1,038,986	301,905	0.2906
22 Aug 2010 20:03:10	1016158	11475268	famous_u9al_1999_200_006644888_3	1,029,626	299,220	0.2906
22 Aug 2010 19:06:30	1016158	11475268	famous_u9al_1999_200_006644888_3	1,020,266	296,391	0.2905
22 Aug 2010 17:14:07	1016158	11475268	famous_u9al_1999_200_006644888_3	1,010,906	293,653	0.2905
22 Aug 2010 16:14:47	1016158	11475268	famous_u9al_1999_200_006644888_3	1,001,546	290,885	0.2904