Task 12425920

Name	famous_xozo_999_200_007094219_0
Workunit	7297519
Created	18 Dec 2010, 17:00:22 UTC
Sent	22 Dec 2010, 16:21:50 UTC
Report deadline	23 Mar 2011, 23:49:01 UTC
Received	14 Jan 2011, 18:21:56 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1046143
Run time
CPU time	6 days 15 hours 3 min 38 sec
Validate state	Invalid
Credit	3,644.12
Device peak FLOPS	2.32 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>5.10.45</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 20:16:30 (3664): No heartbeat from core client for 30 sec - exiting 20:16:31 (3664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:13:37 (756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5144, selfPID=5144, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:13:13 (4224): handle_file_upload_status: can't open boinc_ufs_cpdnout3.zip 23:26:53 (4224): No heartbeat from core client for 30 sec - exiting 23:26:54 (4224): No heartbeat from core client for 30 sec - exiting 23:26:55 (4224): No heartbeat from core client for 30 sec - exiting 23:26:56 (4224): No heartbeat from core client for 30 sec - exiting 23:26:57 (4224): No heartbeat from core client for 30 sec - exiting 23:26:58 (4224): No heartbeat from core client for 30 sec - exiting 23:26:59 (4224): No heartbeat from core client for 30 sec - exiting 23:27:00 (4224): No heartbeat from core client for 30 sec - exiting 23:27:01 (4224): No heartbeat from core client for 30 sec - exiting 23:27:02 (4224): No heartbeat from core client for 30 sec - exiting 23:27:03 (4224): No heartbeat from core client for 30 sec - exiting 23:27:04 (4224): No heartbeat from core client for 30 sec - exiting 23:27:05 (4224): No heartbeat from core client for 30 sec - exiting 23:27:06 (4224): No heartbeat from core client for 30 sec - exiting 23:27:07 (4224): No heartbeat from core client for 30 sec - exiting 23:27:08 (4224): No heartbeat from core client for 30 sec - exiting 23:27:09 (4224): No heartbeat from core client for 30 sec - exiting 23:27:10 (4224): No heartbeat from core client for 30 sec - exiting 23:27:11 (4224): No heartbeat from core client for 30 sec - exiting 23:27:12 (4224): No heartbeat from core client for 30 sec - exiting 23:27:13 (4224): No heartbeat from core client for 30 sec - exiting 23:27:14 (4224): No heartbeat from core client for 30 sec - exiting 23:27:15 (4224): No heartbeat from core client for 30 sec - exiting 23:27:16 (4224): No heartbeat from core client for 30 sec - exiting 23:27:17 (4224): No heartbeat from core client for 30 sec - exiting 23:27:18 (4224): No heartbeat from core client for 30 sec - exiting 23:27:19 (4224): No heartbeat from core client for 30 sec - exiting 23:27:20 (4224): No heartbeat from core client for 30 sec - exiting 23:27:21 (4224): No heartbeat from core client for 30 sec - exiting 23:27:22 (4224): No heartbeat from core client for 30 sec - exiting 23:27:23 (4224): No heartbeat from core client for 30 sec - exiting 23:27:24 (4224): No heartbeat from core client for 30 sec - exiting 23:27:25 (4224): No heartbeat from core client for 30 sec - exiting 23:27:26 (4224): No heartbeat from core client for 30 sec - exiting 23:27:27 (4224): No heartbeat from core client for 30 sec - exiting 23:27:28 (4224): No heartbeat from core client for 30 sec - exiting 23:27:29 (4224): No heartbeat from core client for 30 sec - exiting 23:27:30 (4224): No heartbeat from core client for 30 sec - exiting 23:27:31 (4224): No heartbeat from core client for 30 sec - exiting 23:27:32 (4224): No heartbeat from core client for 30 sec - exiting 23:27:33 (4224): No heartbeat from core client for 30 sec - exiting 23:27:34 (4224): No heartbeat from core client for 30 sec - exiting 23:27:35 (4224): No heartbeat from core client for 30 sec - exiting 23:27:36 (4224): No heartbeat from core client for 30 sec - exiting 23:27:37 (4224): No heartbeat from core client for 30 sec - exiting 23:27:38 (4224): No heartbeat from core client for 30 sec - exiting 23:27:39 (4224): No heartbeat from core client for 30 sec - exiting 23:27:40 (4224): No heartbeat from core client for 30 sec - exiting 23:27:41 (4224): No heartbeat from core client for 30 sec - exiting 23:27:42 (4224): No heartbeat from core client for 30 sec - exiting 23:27:43 (4224): No heartbeat from core client for 30 sec - exiting 23:27:44 (4224): No heartbeat from core client for 30 sec - exiting 23:27:45 (4224): No heartbeat from core client for 30 sec - exiting 23:27:46 (4224): No heartbeat from core client for 30 sec - exiting 23:27:47 (4224): No heartbeat from core client for 30 sec - exiting 23:27:48 (4224): No heartbeat from core client for 30 sec - exiting 23:27:49 (4224): No heartbeat from core client for 30 sec - exiting 23:27:50 (4224): No heartbeat from core client for 30 sec - exiting 23:27:51 (4224): No heartbeat from core client for 30 sec - exiting 23:27:52 (4224): No heartbeat from core client for 30 sec - exiting 23:27:53 (4224): No heartbeat from core client for 30 sec - exiting 23:27:54 (4224): No heartbeat from core client for 30 sec - exiting 23:27:55 (4224): No heartbeat from core client for 30 sec - exiting 23:27:56 (4224): No heartbeat from core client for 30 sec - exiting 23:27:57 (4224): No heartbeat from core client for 30 sec - exiting 23:27:58 (4224): No heartbeat from core client for 30 sec - exiting 23:27:59 (4224): No heartbeat from core client for 30 sec - exiting 23:28:00 (4224): No heartbeat from core client for 30 sec - exiting 23:28:01 (4224): No heartbeat from core client for 30 sec - exiting 23:28:02 (4224): No heartbeat from core client for 30 sec - exiting 23:28:03 (4224): No heartbeat from core client for 30 sec - exiting 23:28:04 (4224): No heartbeat from core client for 30 sec - exiting 23:28:05 (4224): No heartbeat from core client for 30 sec - exiting 23:28:06 (4224): No heartbeat from core client for 30 sec - exiting 23:28:07 (4224): No heartbeat from core client for 30 sec - exiting 23:28:08 (4224): No heartbeat from core client for 30 sec - exiting 23:28:09 (4224): No heartbeat from core client for 30 sec - exiting 23:28:10 (4224): No heartbeat from core client for 30 sec - exiting 23:28:11 (4224): No heartbeat from core client for 30 sec - exiting 23:28:12 (4224): No heartbeat from core client for 30 sec - exiting 23:28:13 (4224): No heartbeat from core client for 30 sec - exiting 23:28:14 (4224): No heartbeat from core client for 30 sec - exiting 23:28:15 (4224): No heartbeat from core client for 30 sec - exiting 23:28:16 (4224): No heartbeat from core client for 30 sec - exiting 23:28:17 (4224): No heartbeat from core client for 30 sec - exiting 23:28:18 (4224): No heartbeat from core client for 30 sec - exiting 23:28:19 (4224): No heartbeat from core client for 30 sec - exiting 23:28:20 (4224): No heartbeat from core client for 30 sec - exiting 23:28:21 (4224): No heartbeat from core client for 30 sec - exiting 23:28:22 (4224): No heartbeat from core client for 30 sec - exiting 23:28:23 (4224): No heartbeat from core client for 30 sec - exiting 23:28:24 (4224): No heartbeat from core client for 30 sec - exiting 23:28:25 (4224): No heartbeat from core client for 30 sec - exiting 23:28:26 (4224): No heartbeat from core client for 30 sec - exiting 23:28:27 (4224): No heartbeat from core client for 30 sec - exiting 23:28:28 (4224): No heartbeat from core client for 30 sec - exiting 23:28:29 (4224): No heartbeat from core client for 30 sec - exiting 23:28:30 (4224): No heartbeat from core client for 30 sec - exiting 23:28:32 (4224): No heartbeat from core client for 30 sec - exiting 23:28:33 (4224): No heartbeat from core client for 30 sec - exiting 23:28:34 (4224): No heartbeat from core client for 30 sec - exiting 23:28:35 (4224): No heartbeat from core client for 30 sec - exiting 23:28:36 (4224): No heartbeat from core client for 30 sec - exiting 23:28:37 (4224): No heartbeat from core client for 30 sec - exiting 23:28:38 (4224): No heartbeat from core client for 30 sec - exiting 23:28:39 (4224): No heartbeat from core client for 30 sec - exiting 23:28:40 (4224): No heartbeat from core client for 30 sec - exiting 23:28:41 (4224): No heartbeat from core client for 30 sec - exiting 23:28:42 (4224): No heartbeat from core client for 30 sec - exiting 23:28:43 (4224): No heartbeat from core client for 30 sec - exiting 23:28:44 (4224): No heartbeat from core client for 30 sec - exiting 23:28:45 (4224): No heartbeat from core client for 30 sec - exiting 23:28:46 (4224): No heartbeat from core client for 30 sec - exiting 23:28:47 (4224): No heartbeat from core client for 30 sec - exiting 23:28:48 (4224): No heartbeat from core client for 30 sec - exiting 23:28:49 (4224): No heartbeat from core client for 30 sec - exiting 23:28:50 (4224): No heartbeat from core client for 30 sec - exiting 23:28:51 (4224): No heartbeat from core client for 30 sec - exiting 23:28:52 (4224): No heartbeat from core client for 30 sec - exiting 23:28:53 (4224): No heartbeat from core client for 30 sec - exiting 23:28:54 (4224): No heartbeat from core client for 30 sec - exiting 23:28:55 (4224): No heartbeat from core client for 30 sec - exiting 23:28:56 (4224): No heartbeat from core client for 30 sec - exiting 23:28:57 (4224): No heartbeat from core client for 30 sec - exiting 23:28:58 (4224): No heartbeat from core client for 30 sec - exiting 23:28:59 (4224): No heartbeat from core client for 30 sec - exiting 23:29:00 (4224): No heartbeat from core client for 30 sec - exiting 23:29:01 (4224): No heartbeat from core client for 30 sec - exiting 23:29:02 (4224): No heartbeat from core client for 30 sec - exiting 23:29:03 (4224): No heartbeat from core client for 30 sec - exiting 23:29:04 (4224): No heartbeat from core client for 30 sec - exiting 23:29:05 (4224): No heartbeat from core client for 30 sec - exiting 23:29:06 (4224): No heartbeat from core client for 30 sec - exiting 23:29:07 (4224): No heartbeat from core client for 30 sec - exiting 23:29:08 (4224): No heartbeat from core client for 30 sec - exiting 23:29:09 (4224): No heartbeat from core client for 30 sec - exiting 23:29:10 (4224): No heartbeat from core client for 30 sec - exiting 23:29:11 (4224): No heartbeat from core client for 30 sec - exiting 23:29:12 (4224): No heartbeat from core client for 30 sec - exiting 23:29:13 (4224): No heartbeat from core client for 30 sec - exiting 23:29:14 (4224): No heartbeat from core client for 30 sec - exiting 23:29:15 (4224): No heartbeat from core client for 30 sec - exiting 23:29:16 (4224): No heartbeat from core client for 30 sec - exiting 23:29:17 (4224): No heartbeat from core client for 30 sec - exiting 23:29:18 (4224): No heartbeat from core client for 30 sec - exiting 23:29:19 (4224): No heartbeat from core client for 30 sec - exiting 23:29:20 (4224): No heartbeat from core client for 30 sec - exiting 23:29:21 (4224): No heartbeat from core client for 30 sec - exiting 23:29:22 (4224): No heartbeat from core client for 30 sec - exiting 23:29:23 (4224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:35:50 (5472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:59:00 (2368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 06:59:47 (2356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:59:00 (2376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3524, selfPID=3524, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:02:48 (2176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:22:14 (3808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:50:04 (5504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:50:17 (4380): No heartbeat from core client for 30 sec - exiting 13:50:18 (4380): No heartbeat from core client for 30 sec - exiting 13:50:19 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... 06:28:39 (2316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLCFILES tmp/pipe_dummy Model crashed: READHIST: End of file in READ from history file for namelist NLCFILES tmp/pipe_dummy Model crashed: READHIST: End of file in READ from history file for namelist NLCFILES tmp/pipe_dummy Model crashed: READHIST: End of file in READ from history file for namelist NLCFILES tmp/pipe_dummy Model crashed: READHIST: End of file in READ from history file for namelist NLCFILES tmp/pipe_dummy Model crashed: READHIST: End of file in READ from history file for namelist NLCFILES tmp/pipe_dummy Sorry, too many model crashes! :-( 17:54:45 (4028): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Jan 2011 15:00:13	1046143	12425920	famous_xozo_999_200_007094219_0	1,104,506	570,165	0.5162
14 Jan 2011 13:39:12	1046143	12425920	famous_xozo_999_200_007094219_0	1,095,146	564,335	0.5153
14 Jan 2011 13:39:12	1046143	12425920	famous_xozo_999_200_007094219_0	1,085,786	559,566	0.5154
14 Jan 2011 13:39:12	1046143	12425920	famous_xozo_999_200_007094219_0	1,076,426	554,780	0.5154
14 Jan 2011 13:39:12	1046143	12425920	famous_xozo_999_200_007094219_0	1,067,066	550,361	0.5158
13 Jan 2011 21:38:03	1046143	12425920	famous_xozo_999_200_007094219_0	1,057,706	545,703	0.5159
13 Jan 2011 19:07:24	1046143	12425920	famous_xozo_999_200_007094219_0	1,048,346	541,095	0.5161
13 Jan 2011 15:40:50	1046143	12425920	famous_xozo_999_200_007094219_0	1,038,986	535,720	0.5156
13 Jan 2011 13:01:34	1046143	12425920	famous_xozo_999_200_007094219_0	1,029,626	530,999	0.5157
12 Jan 2011 19:01:00	1046143	12425920	famous_xozo_999_200_007094219_0	1,020,266	526,200	0.5157
12 Jan 2011 15:52:20	1046143	12425920	famous_xozo_999_200_007094219_0	1,010,906	522,624	0.5170
12 Jan 2011 12:46:56	1046143	12425920	famous_xozo_999_200_007094219_0	1,001,546	516,144	0.5153
12 Jan 2011 12:45:09	1046143	12425920	famous_xozo_999_200_007094219_0	992,186	511,328	0.5154
12 Jan 2011 12:45:09	1046143	12425920	famous_xozo_999_200_007094219_0	982,826	506,520	0.5154
11 Jan 2011 21:46:24	1046143	12425920	famous_xozo_999_200_007094219_0	973,466	501,764	0.5154
11 Jan 2011 16:35:13	1046143	12425920	famous_xozo_999_200_007094219_0	964,106	497,007	0.5155
11 Jan 2011 13:52:42	1046143	12425920	famous_xozo_999_200_007094219_0	954,746	492,242	0.5156
11 Jan 2011 11:26:59	1046143	12425920	famous_xozo_999_200_007094219_0	945,386	487,457	0.5156
10 Jan 2011 23:24:31	1046143	12425920	famous_xozo_999_200_007094219_0	936,026	482,665	0.5157
10 Jan 2011 22:01:52	1046143	12425920	famous_xozo_999_200_007094219_0	926,666	477,885	0.5157