Task 11849685

Name	famous_votj_1399_200_006717933_0
Workunit	6921186
Created	26 Aug 2010, 18:15:15 UTC
Sent	14 Sep 2010, 6:50:10 UTC
Report deadline	14 Dec 2010, 14:17:21 UTC
Received	11 Oct 2010, 23:20:26 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1023145
Run time	7 days 17 hours 2 min 5 sec
CPU time	7 days 13 hours 23 min 43 sec
Validate state	Invalid
Credit	4,972.03
Device peak FLOPS	3.36 GFLOPS
Application version	UK Met Office FAMOUS v6.11 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Signal 15 received, exiting... (3144): called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0xffffe400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/libc.so.6(__libc_start_main+0xfe)[0xf7456c0e] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... (4479): called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Signal 15 received, exiting... (18061): called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0xffffe400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/libc.so.6(__libc_start_main+0xfe)[0xf741ec0e] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... (8219): called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0xffffe400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/libc.so.6(__libc_start_main+0xfe)[0xf7477c0e] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... (7772): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... (4613): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Signal 15 received, exiting... (10224): called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0xffffe400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/libc.so.6(__libc_start_main+0xfe)[0xf74dac0e] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Signal 15 received, exiting... (9078): called boinc_finish (9078): called boinc_finish Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Signal 15 received, exiting... (4550): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... SIGSEGV: segmentation violation Stack trace (10 frames): /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xffffe400] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x822f25f] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x80584b4] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x806c39c] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x830cfc3] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/libc.so.6(__libc_start_main+0xfe)[0xf7542c0e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4474, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (10 frames): /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xffffe400] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x822f25f] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x80584b4] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x806c39c] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x830cfc3] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/libc.so.6(__libc_start_main+0xfe)[0xf763bc0e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4474, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (10 frames): /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xffffe400] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x822f25f] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x80584b4] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x806c39c] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x830cfc3] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/libc.so.6(__libc_start_main+0xfe)[0xf75eac0e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4474, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (10 frames): /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xffffe400] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x822f25f] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x80584b4] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x806c39c] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x830cfc3] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/libc.so.6(__libc_start_main+0xfe)[0xf7573c0e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4474, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (10 frames): /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xffffe400] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x822f25f] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x80584b4] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x806c39c] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x830cfc3] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/libc.so.6(__libc_start_main+0xfe)[0xf754bc0e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4474, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (10 frames): /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xffffe400] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x822f25f] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x80584b4] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x806c39c] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x830cfc3] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /home/andrew/BOINC/hosts/Q6600/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib/libc.so.6(__libc_start_main+0xfe)[0xf75fec0e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4474, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( (4474): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Oct 2010 21:08:56	1023145	11849685	famous_votj_1399_200_006717933_0	1,506,986	650,768	0.4318
11 Oct 2010 19:37:17	1023145	11849685	famous_votj_1399_200_006717933_0	1,497,626	645,402	0.4310
11 Oct 2010 17:10:35	1023145	11849685	famous_votj_1399_200_006717933_0	1,488,266	640,055	0.4301
11 Oct 2010 15:02:55	1023145	11849685	famous_votj_1399_200_006717933_0	1,478,906	634,690	0.4292
11 Oct 2010 13:09:43	1023145	11849685	famous_votj_1399_200_006717933_0	1,469,546	629,322	0.4282
11 Oct 2010 11:02:28	1023145	11849685	famous_votj_1399_200_006717933_0	1,460,186	623,894	0.4273
11 Oct 2010 09:16:09	1023145	11849685	famous_votj_1399_200_006717933_0	1,450,826	618,501	0.4263
11 Oct 2010 08:04:58	1023145	11849685	famous_votj_1399_200_006717933_0	1,441,466	613,147	0.4254
11 Oct 2010 06:20:01	1023145	11849685	famous_votj_1399_200_006717933_0	1,432,106	607,771	0.4244
11 Oct 2010 06:20:01	1023145	11849685	famous_votj_1399_200_006717933_0	1,422,746	602,399	0.4234
11 Oct 2010 06:20:01	1023145	11849685	famous_votj_1399_200_006717933_0	1,413,386	597,030	0.4224
10 Oct 2010 22:30:48	1023145	11849685	famous_votj_1399_200_006717933_0	1,404,026	591,665	0.4214
10 Oct 2010 20:16:24	1023145	11849685	famous_votj_1399_200_006717933_0	1,394,666	586,322	0.4204
10 Oct 2010 18:43:22	1023145	11849685	famous_votj_1399_200_006717933_0	1,385,306	582,399	0.4204
10 Oct 2010 17:05:39	1023145	11849685	famous_votj_1399_200_006717933_0	1,375,946	578,444	0.4204
10 Oct 2010 15:53:09	1023145	11849685	famous_votj_1399_200_006717933_0	1,366,586	574,410	0.4203
10 Oct 2010 14:14:24	1023145	11849685	famous_votj_1399_200_006717933_0	1,357,226	570,447	0.4203
10 Oct 2010 12:40:59	1023145	11849685	famous_votj_1399_200_006717933_0	1,347,866	566,523	0.4203
10 Oct 2010 11:00:28	1023145	11849685	famous_votj_1399_200_006717933_0	1,338,506	562,571	0.4203
10 Oct 2010 09:27:13	1023145	11849685	famous_votj_1399_200_006717933_0	1,329,146	558,600	0.4203