Task 10896576

Name	hadam3p_nbp3_1976_2_006163649_2
Workunit	6429706
Created	7 Mar 2010, 17:54:15 UTC
Sent	17 Jun 2010, 19:41:34 UTC
Report deadline	31 May 2011, 1:01:34 UTC
Received	6 Jul 2010, 22:40:12 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	883406
Run time	2 days 8 hours 47 min 36 sec
CPU time	2 days 8 hours 32 min 16 sec
Validate state	Invalid
Credit	1,247.40
Device peak FLOPS	1.92 GFLOPS
Application version	UK Met Office HADAM3P v6.14 i686-pc-linux-gnu
Stderr	<core_client_version>6.6.40</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0e22ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=30844, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0e06ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=31994, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0d54ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5641, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0d98ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6947, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0dadace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15661, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0dd2ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=24311, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0e20ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16742, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0de5ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2977, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0dbdace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=27610, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0de7ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32518, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0dedace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=616, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0de3ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6799, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0d5bace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8243, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0da1ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=17706, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0d8face] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19919, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0deaace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19919, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0e2dace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19919, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0d72ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19919, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0e1cace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19919, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0da8ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19919, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( (19919): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Jul 2010 04:15:12	883406	10896576	hadam3p_nbp3_1976_2_006163649_2	43,200	201,232	4.6581
04 Jul 2010 22:16:48	883406	10896576	hadam3p_nbp3_1976_2_006163649_2	40,320	188,104	4.6653
03 Jul 2010 15:29:22	883406	10896576	hadam3p_nbp3_1976_2_006163649_2	37,440	175,286	4.6818
02 Jul 2010 07:56:19	883406	10896576	hadam3p_nbp3_1976_2_006163649_2	34,560	161,287	4.6669
01 Jul 2010 01:58:07	883406	10896576	hadam3p_nbp3_1976_2_006163649_2	31,680	147,904	4.6687
29 Jun 2010 19:29:36	883406	10896576	hadam3p_nbp3_1976_2_006163649_2	28,800	134,386	4.6662
28 Jun 2010 14:53:44	883406	10896576	hadam3p_nbp3_1976_2_006163649_2	25,920	120,962	4.6667
27 Jun 2010 08:23:17	883406	10896576	hadam3p_nbp3_1976_2_006163649_2	23,040	107,569	4.6688
26 Jun 2010 01:04:55	883406	10896576	hadam3p_nbp3_1976_2_006163649_2	20,160	94,170	4.6711
24 Jun 2010 19:01:53	883406	10896576	hadam3p_nbp3_1976_2_006163649_2	17,280	80,456	4.6560
24 Jun 2010 00:39:11	883406	10896576	hadam3p_nbp3_1976_2_006163649_2	14,400	67,133	4.6620
22 Jun 2010 18:37:36	883406	10896576	hadam3p_nbp3_1976_2_006163649_2	11,520	53,717	4.6629
21 Jun 2010 14:21:03	883406	10896576	hadam3p_nbp3_1976_2_006163649_2	8,640	40,536	4.6917
20 Jun 2010 07:37:49	883406	10896576	hadam3p_nbp3_1976_2_006163649_2	5,760	26,998	4.6872
18 Jun 2010 23:42:31	883406	10896576	hadam3p_nbp3_1976_2_006163649_2	2,880	13,125	4.5573