Task 11620518

Name	famous_u5t2_1599_200_006640369_5
Workunit	6843741
Created	28 Jul 2010, 18:17:43 UTC
Sent	28 Jul 2010, 20:14:53 UTC
Report deadline	28 Oct 2010, 3:42:04 UTC
Received	5 Sep 2010, 23:44:13 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1089330
Run time	7 days 8 hours 45 min 38 sec
CPU time	7 days 3 hours 45 min 15 sec
Validate state	Invalid
Credit	2,563.26
Device peak FLOPS	1.31 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4028, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:05:28 (764): No heartbeat from core client for 30 sec - exiting 14:05:29 (764): No heartbeat from core client for 30 sec - exiting 14:05:30 (764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2644, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3952, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2932, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1528, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3788, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3428, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2564, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( 19:43:05 (3356): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Sep 2010 22:20:39	1089330	11620518	famous_u5t2_1599_200_006640369_5	776,906	613,248	0.7893
05 Sep 2010 15:39:49	1089330	11620518	famous_u5t2_1599_200_006640369_5	767,546	606,062	0.7896
05 Sep 2010 13:30:19	1089330	11620518	famous_u5t2_1599_200_006640369_5	758,186	598,770	0.7897
04 Sep 2010 16:32:06	1089330	11620518	famous_u5t2_1599_200_006640369_5	748,826	591,341	0.7897
04 Sep 2010 14:27:25	1089330	11620518	famous_u5t2_1599_200_006640369_5	739,466	583,746	0.7894
04 Sep 2010 01:51:53	1089330	11620518	famous_u5t2_1599_200_006640369_5	730,106	576,031	0.7890
04 Sep 2010 01:08:21	1089330	11620518	famous_u5t2_1599_200_006640369_5	720,746	568,335	0.7885
04 Sep 2010 01:08:21	1089330	11620518	famous_u5t2_1599_200_006640369_5	711,386	560,987	0.7886
04 Sep 2010 01:08:21	1089330	11620518	famous_u5t2_1599_200_006640369_5	702,026	553,406	0.7883
04 Sep 2010 01:08:21	1089330	11620518	famous_u5t2_1599_200_006640369_5	692,666	545,957	0.7882
04 Sep 2010 01:08:21	1089330	11620518	famous_u5t2_1599_200_006640369_5	683,306	538,670	0.7883
01 Sep 2010 10:21:12	1089330	11620518	famous_u5t2_1599_200_006640369_5	673,946	531,314	0.7884
01 Sep 2010 10:08:45	1089330	11620518	famous_u5t2_1599_200_006640369_5	664,586	524,110	0.7886
31 Aug 2010 01:42:59	1089330	11620518	famous_u5t2_1599_200_006640369_5	655,226	516,780	0.7887
30 Aug 2010 09:04:15	1089330	11620518	famous_u5t2_1599_200_006640369_5	645,866	509,491	0.7888
30 Aug 2010 02:00:34	1089330	11620518	famous_u5t2_1599_200_006640369_5	636,506	502,189	0.7890
29 Aug 2010 22:29:15	1089330	11620518	famous_u5t2_1599_200_006640369_5	627,146	494,937	0.7892
29 Aug 2010 20:27:35	1089330	11620518	famous_u5t2_1599_200_006640369_5	617,786	487,710	0.7894
29 Aug 2010 18:25:37	1089330	11620518	famous_u5t2_1599_200_006640369_5	608,426	480,491	0.7897
29 Aug 2010 15:41:40	1089330	11620518	famous_u5t2_1599_200_006640369_5	599,066	473,112	0.7897