Task 10902816

Name	hadam3p_netm_1968_2_006167700_3
Workunit	6433757
Created	7 Mar 2010, 17:54:48 UTC
Sent	8 Jun 2010, 12:26:47 UTC
Report deadline	21 May 2011, 17:46:47 UTC
Received	17 Jun 2010, 19:41:33 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	883406
Run time	21 hours 5 min 59 sec
CPU time	20 hours 59 min 2 sec
Validate state	Invalid
Credit	415.80
Device peak FLOPS	1.94 GFLOPS
Application version	UK Met Office HADAM3P v6.14 i686-pc-linux-gnu
Stderr	<core_client_version>6.6.40</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0e41ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4812, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0dd5ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5336, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0dc7ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10806, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0d63ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=29795, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0d5bace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2916, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0d72ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2916, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0e09ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2916, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0dcaace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2916, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0e31ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2916, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0dc8ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2916, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( (2916): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Jun 2010 21:39:21	883406	10902816	hadam3p_netm_1968_2_006167700_3	14,400	66,604	4.6253
15 Jun 2010 16:34:27	883406	10902816	hadam3p_netm_1968_2_006167700_3	11,520	53,163	4.6148
14 Jun 2010 10:42:04	883406	10902816	hadam3p_netm_1968_2_006167700_3	8,640	39,960	4.6250
13 Jun 2010 06:10:35	883406	10902816	hadam3p_netm_1968_2_006167700_3	5,760	27,005	4.6884
11 Jun 2010 23:58:31	883406	10902816	hadam3p_netm_1968_2_006167700_3	2,880	13,428	4.6625