Task 11619301

Name	famous_u5tu_1799_200_006640397_5
Workunit	6843769
Created	27 Jul 2010, 21:21:44 UTC
Sent	27 Jul 2010, 21:43:44 UTC
Report deadline	27 Oct 2010, 5:10:55 UTC
Received	16 Aug 2010, 1:06:23 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1089510
Run time	11 days 14 hours 59 min 8 sec
CPU time	9 days 8 hours 49 min 53 sec
Validate state	Invalid
Credit	1,451.52
Device peak FLOPS	0.72 GFLOPS
Application version	UK Met Office FAMOUS v6.11 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.17</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (1826): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (1826): No heartbeat from core client for 30 sec - exiting (1826): No heartbeat from core client for 30 sec - exiting (2012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (2012): No heartbeat from core client for 30 sec - exiting (2012): No heartbeat from core client for 30 sec - exiting (2012): No heartbeat from core client for 30 sec - exiting (2012): No heartbeat from core client for 30 sec - exiting (2012): No heartbeat from core client for 30 sec - exiting (2012): No heartbeat from core client for 30 sec - exiting (2012): No heartbeat from core client for 30 sec - exiting (2012): No heartbeat from core client for 30 sec - exiting (2219): No heartbeat from core client for 30 sec - exiting (2219): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (2219): No heartbeat from core client for 30 sec - exiting (2219): No heartbeat from core client for 30 sec - exiting (2375): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (2375): No heartbeat from core client for 30 sec - exiting (3019): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (3019): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3091, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3091, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3091, iMonCtr=1 (1431): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (1431): No heartbeat from core client for 30 sec - exiting (1431): No heartbeat from core client for 30 sec - exiting (1431): No heartbeat from core client for 30 sec - exiting (2018): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (2018): No heartbeat from core client for 30 sec - exiting (2018): No heartbeat from core client for 30 sec - exiting (2018): No heartbeat from core client for 30 sec - exiting (2018): No heartbeat from core client for 30 sec - exiting (2116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (2116): No heartbeat from core client for 30 sec - exiting (2116): No heartbeat from core client for 30 sec - exiting (2116): No heartbeat from core client for 30 sec - exiting (2116): No heartbeat from core client for 30 sec - exiting (2116): No heartbeat from core client for 30 sec - exiting (2116): No heartbeat from core client for 30 sec - exiting (2116): No heartbeat from core client for 30 sec - exiting (2116): No heartbeat from core client for 30 sec - exiting (2116): No heartbeat from core client for 30 sec - exiting (2188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (2188): No heartbeat from core client for 30 sec - exiting (2188): No heartbeat from core client for 30 sec - exiting (2188): No heartbeat from core client for 30 sec - exiting (2188): No heartbeat from core client for 30 sec - exiting (2332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (1790): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (1927): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (1927): No heartbeat from core client for 30 sec - exiting (2559): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (2559): No heartbeat from core client for 30 sec - exiting (1719): No heartbeat from core client for 30 sec - exiting (1719): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (1817): No heartbeat from core client for 30 sec - exiting (1817): No heartbeat from core client for 30 sec - exiting (1817): No heartbeat from core client for 30 sec - exiting (1817): No heartbeat from core client for 30 sec - exiting (1817): No heartbeat from core client for 30 sec - exiting (1817): No heartbeat from core client for 30 sec - exiting (1817): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (1905): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (1997): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (2070): No heartbeat from core client for 30 sec - exiting (2070): No heartbeat from core client for 30 sec - exiting (2070): No heartbeat from core client for 30 sec - exiting (2070): No heartbeat from core client for 30 sec - exiting (1444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (2279): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (2279): No heartbeat from core client for 30 sec - exiting (2279): No heartbeat from core client for 30 sec - exiting (2279): No heartbeat from core client for 30 sec - exiting (2351): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (1383): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (1912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (2147): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (2147): No heartbeat from core client for 30 sec - exiting (2147): No heartbeat from core client for 30 sec - exiting (2147): No heartbeat from core client for 30 sec - exiting (2260): No heartbeat from core client for 30 sec - exiting (2260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (2387): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (2387): No heartbeat from core client for 30 sec - exiting (2387): No heartbeat from core client for 30 sec - exiting (2387): No heartbeat from core client for 30 sec - exiting (2387): No heartbeat from core client for 30 sec - exiting (2387): No heartbeat from core client for 30 sec - exiting (1819): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (1819): No heartbeat from core client for 30 sec - exiting (1819): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2093, iMonCtr=1 Model crash detected, will try to restart... (1460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (1460): No heartbeat from core client for 30 sec - exiting (2227): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (2508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (2508): No heartbeat from core client for 30 sec - exiting (7116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7116): No heartbeat from core client for 30 sec - exiting (7116): No heartbeat from core client for 30 sec - exiting Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy Sorry, too many model crashes! :-( (8319): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Aug 2010 21:42:07	1089510	11619301	famous_u5tu_1799_200_006640397_5	439,946	799,674	1.8177
11 Aug 2010 19:45:46	1089510	11619301	famous_u5tu_1799_200_006640397_5	430,586	782,122	1.8164
11 Aug 2010 08:01:16	1089510	11619301	famous_u5tu_1799_200_006640397_5	421,226	765,777	1.8180
11 Aug 2010 02:54:05	1089510	11619301	famous_u5tu_1799_200_006640397_5	411,866	749,368	1.8194
10 Aug 2010 21:37:20	1089510	11619301	famous_u5tu_1799_200_006640397_5	402,506	732,701	1.8203
10 Aug 2010 16:17:52	1089510	11619301	famous_u5tu_1799_200_006640397_5	393,146	715,211	1.8192
10 Aug 2010 09:35:25	1089510	11619301	famous_u5tu_1799_200_006640397_5	383,786	698,776	1.8207
10 Aug 2010 05:19:29	1089510	11619301	famous_u5tu_1799_200_006640397_5	374,426	681,628	1.8205
09 Aug 2010 22:14:16	1089510	11619301	famous_u5tu_1799_200_006640397_5	365,066	664,178	1.8193
09 Aug 2010 12:37:24	1089510	11619301	famous_u5tu_1799_200_006640397_5	355,706	646,108	1.8164
09 Aug 2010 06:22:44	1089510	11619301	famous_u5tu_1799_200_006640397_5	346,346	628,606	1.8150
09 Aug 2010 00:05:42	1089510	11619301	famous_u5tu_1799_200_006640397_5	336,986	610,847	1.8127
08 Aug 2010 12:46:13	1089510	11619301	famous_u5tu_1799_200_006640397_5	327,626	592,622	1.8088
07 Aug 2010 14:35:02	1089510	11619301	famous_u5tu_1799_200_006640397_5	318,266	574,700	1.8057
07 Aug 2010 08:37:10	1089510	11619301	famous_u5tu_1799_200_006640397_5	308,906	557,008	1.8032
07 Aug 2010 01:57:39	1089510	11619301	famous_u5tu_1799_200_006640397_5	299,546	539,091	1.7997
06 Aug 2010 10:10:37	1089510	11619301	famous_u5tu_1799_200_006640397_5	290,186	521,438	1.7969
05 Aug 2010 10:53:14	1089510	11619301	famous_u5tu_1799_200_006640397_5	280,826	503,721	1.7937
04 Aug 2010 21:44:54	1089510	11619301	famous_u5tu_1799_200_006640397_5	271,466	486,988	1.7939
04 Aug 2010 12:42:38	1089510	11619301	famous_u5tu_1799_200_006640397_5	262,106	470,469	1.7950