Task 11069908

Name	hadsm3dhet2_jt6o_006600818_0
Workunit	6804191
Created	15 Mar 2010, 12:08:25 UTC
Sent	16 Jun 2010, 12:00:33 UTC
Report deadline	29 May 2011, 17:20:33 UTC
Received	16 Aug 2010, 14:50:10 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1055633
Run time	6 days 6 hours 1 min 3 sec
CPU time	5 days 17 hours 48 min 12 sec
Validate state	Invalid
Credit	2,084.11
Device peak FLOPS	1.67 GFLOPS
Application version	UK Met Office HadSM3 Slab Model v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> El dispositivo no reconoce el comando. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... error: cannot delete old hadsm3dhet2_jt6o_006600818/jobs/climate.spin error: cannot delete old hadsm3dhet2_jt6o_006600818/jobs/climate.cont error: cannot delete old hadsm3dhet2_jt6o_006600818/jobs/climate.doub error: cannot delete old hadsm3dhet2_jt6o_006600818/jobs/ncatts.cpdc CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... error: cannot delete old hadsm3dhet2_jt6o_006600818/jobs/climate.spin error: cannot delete old hadsm3dhet2_jt6o_006600818/jobs/climate.cont error: cannot delete old hadsm3dhet2_jt6o_006600818/jobs/climate.doub error: cannot delete old hadsm3dhet2_jt6o_006600818/jobs/ncatts.cpdc CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5152, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812A5B Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 6.3.8 Dump Timestamp : 08/16/10 16:48:30 Install Directory : C:\Archivos de programa\BOINC\ Data Directory : C:\Documents and Settings\All Users\Datos de programa\BOINC Project Symstore : LoadLibraryA( C:\Archivos de programa\BOINC\\dbghelp.dll ): GetLastError = 1114 LoadLibraryA( dbghelp.dll ): GetLastError = 1114 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 715, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 86, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 53212, QuotaPeakPagedPoolUsage: 53212 QuotaNonPagedPoolUsage: 2288, QuotaPeakNonPagedPoolUsage: 2288 - Virtual Memory Usage - VirtualSize: 219361280, PeakVirtualSize: 219361280 - Pagefile Usage - PagefileUsage: 7262208, PeakPagefileUsage: 9195520 - Working Set Size - WorkingSetSize: 2560000, PeakWorkingSetSize: 2560000, PageFaultCount: 677 * Dump of thread ID 4568 (state: Ready): * - Information - Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 781250.000000, User Time: 468750.000000, Wait Time: 811956.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812A5B * Dump of thread ID 4160 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 811955.000000 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5152, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812A5B Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.3.8 Dump Timestamp : 08/16/10 16:48:36 Install Directory : C:\Archivos de programa\BOINC\ Data Directory : C:\Documents and Settings\All Users\Datos de programa\BOINC Project Symstore : LoadLibraryA( C:\Archivos de programa\BOINC\\dbghelp.dll ): GetLastError = 1114 LoadLibraryA( dbghelp.dll ): GetLastError = 1114 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 715, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 86, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 53212, QuotaPeakPagedPoolUsage: 53212 QuotaNonPagedPoolUsage: 2288, QuotaPeakNonPagedPoolUsage: 2288 - Virtual Memory Usage - VirtualSize: 219361280, PeakVirtualSize: 219361280 - Pagefile Usage - PagefileUsage: 7262208, PeakPagefileUsage: 9195520 - Working Set Size - WorkingSetSize: 2555904, PeakWorkingSetSize: 2555904, PageFaultCount: 676 * Dump of thread ID 5444 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 468750.000000, User Time: 312500.000000, Wait Time: 812400.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812A5B * Dump of thread ID 2476 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 812399.000000 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5152, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812A5B Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.3.8 Dump Timestamp : 08/16/10 16:48:42 Install Directory : C:\Archivos de programa\BOINC\ Data Directory : C:\Documents and Settings\All Users\Datos de programa\BOINC Project Symstore : LoadLibraryA( C:\Archivos de programa\BOINC\\dbghelp.dll ): GetLastError = 1114 LoadLibraryA( dbghelp.dll ): GetLastError = 1114 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 715, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 86, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 53212, QuotaPeakPagedPoolUsage: 53212 QuotaNonPagedPoolUsage: 2288, QuotaPeakNonPagedPoolUsage: 2288 - Virtual Memory Usage - VirtualSize: 219361280, PeakVirtualSize: 219361280 - Pagefile Usage - PagefileUsage: 7262208, PeakPagefileUsage: 9195520 - Working Set Size - WorkingSetSize: 2555904, PeakWorkingSetSize: 2555904, PageFaultCount: 676 * Dump of thread ID 4924 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 312500.000000, User Time: 468750.000000, Wait Time: 812742.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812A5B * Dump of thread ID 1480 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 812740.000000 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5152, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812A5B Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.3.8 Dump Timestamp : 08/16/10 16:48:45 Install Directory : C:\Archivos de programa\BOINC\ Data Directory : C:\Documents and Settings\All Users\Datos de programa\BOINC Project Symstore : LoadLibraryA( C:\Archivos de programa\BOINC\\dbghelp.dll ): GetLastError = 1114 LoadLibraryA( dbghelp.dll ): GetLastError = 1114 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 715, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 84, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 53212, QuotaPeakPagedPoolUsage: 53212 QuotaNonPagedPoolUsage: 2288, QuotaPeakNonPagedPoolUsage: 2288 - Virtual Memory Usage - VirtualSize: 219361280, PeakVirtualSize: 219361280 - Pagefile Usage - PagefileUsage: 7262208, PeakPagefileUsage: 9195520 - Working Set Size - WorkingSetSize: 2551808, PeakWorkingSetSize: 2551808, PageFaultCount: 675 * Dump of thread ID 808 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 312500.000000, User Time: 625000.000000, Wait Time: 812917.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812A5B * Dump of thread ID 5348 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 812916.000000 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5152, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812A5B Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.3.8 Dump Timestamp : 08/16/10 16:48:49 Install Directory : C:\Archivos de programa\BOINC\ Data Directory : C:\Documents and Settings\All Users\Datos de programa\BOINC Project Symstore : LoadLibraryA( C:\Archivos de programa\BOINC\\dbghelp.dll ): GetLastError = 1455 LoadLibraryA( dbghelp.dll ): GetLastError = 1455 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 715, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 84, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 53212, QuotaPeakPagedPoolUsage: 53212 QuotaNonPagedPoolUsage: 2288, QuotaPeakNonPagedPoolUsage: 2288 - Virtual Memory Usage - VirtualSize: 219361280, PeakVirtualSize: 219361280 - Pagefile Usage - PagefileUsage: 7262208, PeakPagefileUsage: 9195520 - Working Set Size - WorkingSetSize: 2555904, PeakWorkingSetSize: 2555904, PageFaultCount: 676 * Dump of thread ID 4672 (state: Ready): * - Information - Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 625000.000000, User Time: 312500.000000, Wait Time: 813185.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812A5B * Dump of thread ID 5656 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 813182.000000 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5152, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Aug 2010 00:10:17	1055633	11069908	hadsm3dhet2_jt6o_006600818_0	226,842	488,115	2.1518
12 Aug 2010 16:53:03	1055633	11069908	hadsm3dhet2_jt6o_006600818_0	216,040	464,908	2.1520
10 Aug 2010 21:47:37	1055633	11069908	hadsm3dhet2_jt6o_006600818_0	205,238	440,421	2.1459
09 Aug 2010 20:17:30	1055633	11069908	hadsm3dhet2_jt6o_006600818_0	194,436	420,020	2.1602
05 Aug 2010 21:25:25	1055633	11069908	hadsm3dhet2_jt6o_006600818_0	183,634	397,891	2.1668
05 Aug 2010 15:05:55	1055633	11069908	hadsm3dhet2_jt6o_006600818_0	172,832	375,679	2.1737
31 Jul 2010 18:01:02	1055633	11069908	hadsm3dhet2_jt6o_006600818_0	162,030	353,493	2.1817
28 Jul 2010 12:45:35	1055633	11069908	hadsm3dhet2_jt6o_006600818_0	151,228	330,723	2.1869
26 Jul 2010 13:51:43	1055633	11069908	hadsm3dhet2_jt6o_006600818_0	140,426	307,303	2.1884
25 Jul 2010 20:15:42	1055633	11069908	hadsm3dhet2_jt6o_006600818_0	129,624	284,470	2.1946
01 Jul 2010 21:06:09	1055633	11069908	hadsm3dhet2_jt6o_006600818_0	118,822	261,111	2.1975
01 Jul 2010 10:53:39	1055633	11069908	hadsm3dhet2_jt6o_006600818_0	108,020	237,697	2.2005
26 Jun 2010 13:31:11	1055633	11069908	hadsm3dhet2_jt6o_006600818_0	97,218	213,599	2.1971
25 Jun 2010 20:54:58	1055633	11069908	hadsm3dhet2_jt6o_006600818_0	86,416	188,971	2.1868
25 Jun 2010 13:08:58	1055633	11069908	hadsm3dhet2_jt6o_006600818_0	75,614	164,325	2.1732
24 Jun 2010 17:39:31	1055633	11069908	hadsm3dhet2_jt6o_006600818_0	64,812	139,582	2.1536
23 Jun 2010 21:42:08	1055633	11069908	hadsm3dhet2_jt6o_006600818_0	54,010	116,215	2.1517
21 Jun 2010 21:29:38	1055633	11069908	hadsm3dhet2_jt6o_006600818_0	43,208	93,607	2.1664
21 Jun 2010 14:38:37	1055633	11069908	hadsm3dhet2_jt6o_006600818_0	32,406	71,064	2.1929
18 Jun 2010 20:32:56	1055633	11069908	hadsm3dhet2_jt6o_006600818_0	21,604	47,520	2.1996