Task 10789299

Name	hadam3p_npf0_2003_2_006571414_2
Workunit	6774790
Created	23 Jan 2010, 0:05:13 UTC
Sent	2 Feb 2010, 17:43:14 UTC
Report deadline	15 Jan 2011, 23:03:14 UTC
Received	11 Jun 2010, 19:05:39 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	883406
Run time	2 days 0 hours 20 min 52 sec
CPU time	2 days 0 hours 5 min 11 sec
Validate state	Invalid
Credit	1,081.08
Device peak FLOPS	0.00 GFLOPS
Application version	---
Stderr	<core_client_version>6.6.40</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0dfface] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=21459, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0d86ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=21459, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 1 received, exiting... (12467): called boinc_finish SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0dcdace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13535, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0dc6ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2812, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0d65ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4762, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0d79ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4762, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0d68ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4762, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0e16ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4762, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0d55ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4762, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836f3c8] [0xffffe400] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813ce07] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8142e00] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8138967] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x814459b] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x813aac1] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8078cd7] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x82e99b3] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8309513] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x8303462] /home/hme/BOINC/projects/climateprediction.net/hadam3p_um_6.14_i686-pc-linux-gnu[0x830afb5] /lib/libc.so.6(__libc_start_main+0xfe)[0xf0db7ace] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4762, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( (4762): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Jun 2010 15:30:41	883406	10789299	hadam3p_npf0_2003_2_006571414_2	37,440	172,654	4.6115
09 Jun 2010 18:14:48	883406	10789299	hadam3p_npf0_2003_2_006571414_2	34,560	159,491	4.6149
08 Jun 2010 13:59:11	883406	10789299	hadam3p_npf0_2003_2_006571414_2	31,680	146,258	4.6167
07 Jun 2010 08:09:49	883406	10789299	hadam3p_npf0_2003_2_006571414_2	28,800	132,605	4.6043
06 Jun 2010 03:05:34	883406	10789299	hadam3p_npf0_2003_2_006571414_2	25,920	119,274	4.6016
04 Jun 2010 20:38:01	883406	10789299	hadam3p_npf0_2003_2_006571414_2	23,040	106,056	4.6031
03 Jun 2010 14:51:42	883406	10789299	hadam3p_npf0_2003_2_006571414_2	20,160	92,733	4.5999
02 Jun 2010 08:30:15	883406	10789299	hadam3p_npf0_2003_2_006571414_2	17,280	79,325	4.5906
01 Jun 2010 01:29:24	883406	10789299	hadam3p_npf0_2003_2_006571414_2	14,400	66,088	4.5894
30 May 2010 20:55:30	883406	10789299	hadam3p_npf0_2003_2_006571414_2	11,520	52,743	4.5784
29 May 2010 14:40:21	883406	10789299	hadam3p_npf0_2003_2_006571414_2	8,640	39,527	4.5749
28 May 2010 19:11:53	883406	10789299	hadam3p_npf0_2003_2_006571414_2	5,760	26,440	4.5903
27 May 2010 21:19:44	883406	10789299	hadam3p_npf0_2003_2_006571414_2	2,880	13,148	4.5653