Task 11910430

Name	famous_v28x_1999_200_006688679_6
Workunit	6891932
Created	17 Sep 2010, 21:15:16 UTC
Sent	17 Sep 2010, 23:04:14 UTC
Report deadline	18 Dec 2010, 6:31:25 UTC
Received	26 Oct 2010, 15:21:45 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1032008
Run time	17 days 6 hours 14 min 29 sec
CPU time	15 days 23 hours 0 min 30 sec
Validate state	Invalid
Credit	4,076.46
Device peak FLOPS	0.98 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4844, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4616, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4616, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4496, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4496, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4636, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 15:23:25 (4636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:23:26 (4636): No heartbeat from core client for 30 sec - exiting BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4672, iMonCtr=1 Model crash detected, will try to restart... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 08:45:24 (4392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4532, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4552, iMonCtr=1 Model crash detected, will try to restart... 16:56:48 (5712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:56:49 (5712): No heartbeat from core client for 30 sec - exiting 16:56:50 (5712): No heartbeat from core client for 30 sec - exiting 16:56:51 (5712): No heartbeat from core client for 30 sec - exiting 16:56:52 (5712): No heartbeat from core client for 30 sec - exiting 16:56:53 (5712): No heartbeat from core client for 30 sec - exiting C10:43:20 (4472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( 16:20:18 (4540): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Oct 2010 14:55:29	1032008	11910430	famous_v28x_1999_200_006688679_6	1,235,546	1,377,512	1.1149
25 Oct 2010 19:17:52	1032008	11910430	famous_v28x_1999_200_006688679_6	1,226,186	1,367,253	1.1150
24 Oct 2010 22:58:24	1032008	11910430	famous_v28x_1999_200_006688679_6	1,216,826	1,356,568	1.1148
24 Oct 2010 19:55:36	1032008	11910430	famous_v28x_1999_200_006688679_6	1,207,466	1,345,925	1.1147
24 Oct 2010 16:49:06	1032008	11910430	famous_v28x_1999_200_006688679_6	1,198,106	1,335,275	1.1145
24 Oct 2010 13:40:54	1032008	11910430	famous_v28x_1999_200_006688679_6	1,188,746	1,324,631	1.1143
24 Oct 2010 10:37:24	1032008	11910430	famous_v28x_1999_200_006688679_6	1,179,386	1,314,014	1.1142
23 Oct 2010 21:40:29	1032008	11910430	famous_v28x_1999_200_006688679_6	1,170,026	1,303,264	1.1139
23 Oct 2010 17:58:05	1032008	11910430	famous_v28x_1999_200_006688679_6	1,160,666	1,292,481	1.1136
23 Oct 2010 14:42:45	1032008	11910430	famous_v28x_1999_200_006688679_6	1,151,306	1,281,754	1.1133
23 Oct 2010 11:38:59	1032008	11910430	famous_v28x_1999_200_006688679_6	1,141,946	1,271,102	1.1131
22 Oct 2010 22:09:33	1032008	11910430	famous_v28x_1999_200_006688679_6	1,132,586	1,260,144	1.1126
22 Oct 2010 18:55:17	1032008	11910430	famous_v28x_1999_200_006688679_6	1,123,226	1,249,037	1.1120
22 Oct 2010 15:38:26	1032008	11910430	famous_v28x_1999_200_006688679_6	1,113,866	1,238,022	1.1115
22 Oct 2010 12:24:24	1032008	11910430	famous_v28x_1999_200_006688679_6	1,104,506	1,226,996	1.1109
21 Oct 2010 23:25:25	1032008	11910430	famous_v28x_1999_200_006688679_6	1,095,146	1,216,229	1.1106
21 Oct 2010 20:07:57	1032008	11910430	famous_v28x_1999_200_006688679_6	1,085,786	1,205,534	1.1103
21 Oct 2010 16:54:55	1032008	11910430	famous_v28x_1999_200_006688679_6	1,076,426	1,194,845	1.1100
21 Oct 2010 13:46:22	1032008	11910430	famous_v28x_1999_200_006688679_6	1,067,066	1,184,245	1.1098
21 Oct 2010 10:42:19	1032008	11910430	famous_v28x_1999_200_006688679_6	1,057,706	1,173,609	1.1096