Task 10986754

Name	hadsm3dhet2_jmro_006592502_7
Workunit	6795875
Created	15 Mar 2010, 11:57:29 UTC
Sent	15 Oct 2010, 5:07:45 UTC
Report deadline	27 Sep 2011, 10:27:45 UTC
Received	31 Dec 2010, 19:31:03 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	793376
Run time	21 days 7 hours 4 min 27 sec
CPU time	16 days 9 hours 44 min 50 sec
Validate state	Invalid
Credit	6,351.58
Device peak FLOPS	1.61 GFLOPS
Application version	UK Met Office HadSM3 Slab Model v6.07 windows_intelx86
Stderr	<core_client_version>6.10.43</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5100, iMonCtr=1 Model crash detected, will try to restart... No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. MainError: 01:35:02 PM No files match the supplied pattern. No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11468, iMonCtr=1 Model crash detected, will try to restart... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8012, iMonCtr=1 Model crash detected, will try to restart... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. MainError: 12:19:17 AM No files match the supplied pattern. No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4340, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4340, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4340, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4340, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4340, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4340, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Dec 2010 03:53:29	793376	10986754	hadsm3dhet2_jmro_006592502_7	172,832	1,408,507	2.0374
28 Dec 2010 18:28:11	793376	10986754	hadsm3dhet2_jmro_006592502_7	162,030	1,385,593	2.0361
27 Dec 2010 18:14:29	793376	10986754	hadsm3dhet2_jmro_006592502_7	151,228	1,362,525	2.0345
26 Dec 2010 11:21:03	793376	10986754	hadsm3dhet2_jmro_006592502_7	140,426	1,340,925	2.0350
25 Dec 2010 12:16:03	793376	10986754	hadsm3dhet2_jmro_006592502_7	129,624	1,318,632	2.0345
23 Dec 2010 18:35:06	793376	10986754	hadsm3dhet2_jmro_006592502_7	118,822	1,295,892	2.0334
22 Dec 2010 11:20:43	793376	10986754	hadsm3dhet2_jmro_006592502_7	108,020	1,273,763	2.0331
21 Dec 2010 11:24:34	793376	10986754	hadsm3dhet2_jmro_006592502_7	97,218	1,251,386	2.0324
19 Dec 2010 12:50:04	793376	10986754	hadsm3dhet2_jmro_006592502_7	86,416	1,228,059	2.0301
18 Dec 2010 10:15:02	793376	10986754	hadsm3dhet2_jmro_006592502_7	75,614	1,205,137	2.0285
17 Dec 2010 10:44:42	793376	10986754	hadsm3dhet2_jmro_006592502_7	64,812	1,182,715	2.0276
16 Dec 2010 09:07:43	793376	10986754	hadsm3dhet2_jmro_006592502_7	54,010	1,160,561	2.0272
14 Dec 2010 21:18:22	793376	10986754	hadsm3dhet2_jmro_006592502_7	43,208	1,138,430	2.0267
13 Dec 2010 23:55:30	793376	10986754	hadsm3dhet2_jmro_006592502_7	32,406	1,115,997	2.0258
13 Dec 2010 09:49:29	793376	10986754	hadsm3dhet2_jmro_006592502_7	21,604	1,094,399	2.0263
12 Dec 2010 09:19:51	793376	10986754	hadsm3dhet2_jmro_006592502_7	10,802	1,072,096	2.0255
10 Dec 2010 12:24:09	793376	10986754	hadsm3dhet2_jmro_006592502_7	259,248	1,049,134	2.0234
09 Dec 2010 09:12:00	793376	10986754	hadsm3dhet2_jmro_006592502_7	248,446	1,027,140	2.0231
08 Dec 2010 12:25:34	793376	10986754	hadsm3dhet2_jmro_006592502_7	237,644	1,005,342	2.0233
07 Dec 2010 13:33:04	793376	10986754	hadsm3dhet2_jmro_006592502_7	226,842	983,562	2.0234