Task 12550229

Name	famous_wbhp_1899_200_007060124_2
Workunit	7263440
Created	1 Feb 2011, 13:10:39 UTC
Sent	1 Feb 2011, 13:10:54 UTC
Report deadline	3 May 2011, 20:38:05 UTC
Received	15 Feb 2011, 12:54:51 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1112324
Run time	12 days 18 hours 48 min 15 sec
CPU time	12 days 1 hours 53 min 6 sec
Validate state	Invalid
Credit	6,145.53
Device peak FLOPS	2.70 GFLOPS
Application version	UK Met Office FAMOUS v6.11 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.45</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Signal 15 received, exiting... (3257): called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0x6ba400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/libc.so.6(__libc_start_main+0xe6)[0x4d950e16] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... Signal 15 received, exiting... SIGSEGV: segmentation violation (1618): called boinc_finish Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0x384400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/libc.so.6(__libc_start_main+0xe6)[0x4d950e16] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... (1582): called boinc_finish Signal 15 received, exiting... (1653): called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0xf7f400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/libc.so.6(__libc_start_main+0xe6)[0x4d950e16] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... Signal 15 received, exiting... (1605): called boinc_finish Signal 15 received, exiting... SIGSEGV: segmentation violation (1602): called boinc_finish Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0x64d400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/libc.so.6(__libc_start_main+0xe6)[0x4d950e16] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... Signal 15 received, exiting... (1607): called boinc_finish Signal 15 received, exiting... (1625): called boinc_finish Signal 15 received, exiting... (1584): called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0x1db400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/libc.so.6(__libc_start_main+0xe6)[0x478e36] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... (2326): called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0xeca400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/libc.so.6(__libc_start_main+0xe6)[0x579e36] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... Signal 15 received, exiting... (2227): called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... (9658): called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0xf7e400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/libc.so.6(__libc_start_main+0xe6)[0x259e36] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... Signal 15 received, exiting... (1635): called boinc_finish Signal 15 received, exiting... (1623): called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0x687400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/libc.so.6(__libc_start_main+0xe6)[0x4a96ee36] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... Signal 15 received, exiting... SIGSEGV: segmentation violation (1593): called boinc_finish Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0x3de400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/libc.so.6(__libc_start_main+0xe6)[0x4a96ee36] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... Signal 15 received, exiting... (1572): called boinc_finish Signal 15 received, exiting... (1584): called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0x22b400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/libc.so.6(__libc_start_main+0xe6)[0x4a96ee36] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... Signal 15 received, exiting... (1622): called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0x564400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/libc.so.6(__libc_start_main+0xe6)[0x4a96ee36] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... Signal 15 received, exiting... (1539): called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0x5f6400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/libc.so.6(__libc_start_main+0xe6)[0x4a96ee36] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... Signal 15 received, exiting... (1634): called boinc_finish Signal 15 received, exiting... (1592): called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0x439400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/libc.so.6(__libc_start_main+0xe6)[0x4a96ee36] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... Signal 15 received, exiting... (1560): called boinc_finish Signal 15 received, exiting... (1564): called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0xf2a400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/libc.so.6(__libc_start_main+0xe6)[0x4a96ee36] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... Signal 15 received, exiting... (1585): called boinc_finish Signal 15 received, exiting... (1534): called boinc_finish Signal 15 received, exiting... (1572): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( (1592): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Feb 2011 13:01:47	1112324	12550229	famous_wbhp_1899_200_007060124_2	1,862,666	1,038,759	0.5577
15 Feb 2011 13:01:47	1112324	12550229	famous_wbhp_1899_200_007060124_2	1,853,306	1,033,555	0.5577
15 Feb 2011 13:01:47	1112324	12550229	famous_wbhp_1899_200_007060124_2	1,843,946	1,028,346	0.5577
15 Feb 2011 13:01:47	1112324	12550229	famous_wbhp_1899_200_007060124_2	1,834,586	1,023,120	0.5577
14 Feb 2011 23:42:12	1112324	12550229	famous_wbhp_1899_200_007060124_2	1,825,226	1,017,917	0.5577
14 Feb 2011 21:41:33	1112324	12550229	famous_wbhp_1899_200_007060124_2	1,815,866	1,012,690	0.5577
14 Feb 2011 21:07:04	1112324	12550229	famous_wbhp_1899_200_007060124_2	1,806,506	1,007,487	0.5577
14 Feb 2011 19:17:41	1112324	12550229	famous_wbhp_1899_200_007060124_2	1,797,146	1,002,284	0.5577
14 Feb 2011 17:07:03	1112324	12550229	famous_wbhp_1899_200_007060124_2	1,787,786	997,103	0.5577
14 Feb 2011 15:38:45	1112324	12550229	famous_wbhp_1899_200_007060124_2	1,778,426	991,922	0.5578
14 Feb 2011 14:11:46	1112324	12550229	famous_wbhp_1899_200_007060124_2	1,769,066	986,730	0.5578
14 Feb 2011 12:41:34	1112324	12550229	famous_wbhp_1899_200_007060124_2	1,759,706	981,518	0.5578
14 Feb 2011 11:16:45	1112324	12550229	famous_wbhp_1899_200_007060124_2	1,750,346	976,324	0.5578
14 Feb 2011 09:47:27	1112324	12550229	famous_wbhp_1899_200_007060124_2	1,740,986	971,142	0.5578
14 Feb 2011 08:22:08	1112324	12550229	famous_wbhp_1899_200_007060124_2	1,731,626	965,945	0.5578
14 Feb 2011 06:51:35	1112324	12550229	famous_wbhp_1899_200_007060124_2	1,722,266	960,748	0.5578
14 Feb 2011 05:18:26	1112324	12550229	famous_wbhp_1899_200_007060124_2	1,712,906	955,529	0.5578
14 Feb 2011 03:46:27	1112324	12550229	famous_wbhp_1899_200_007060124_2	1,703,546	950,308	0.5578
14 Feb 2011 02:14:28	1112324	12550229	famous_wbhp_1899_200_007060124_2	1,694,186	945,096	0.5578
14 Feb 2011 00:47:08	1112324	12550229	famous_wbhp_1899_200_007060124_2	1,684,826	939,883	0.5579