Task 11285099

Name	hadsm3dhet2_k9sd_006622335_0
Workunit	6825708
Created	15 Mar 2010, 12:36:18 UTC
Sent	11 Apr 2010, 2:52:56 UTC
Report deadline	24 Mar 2011, 8:12:56 UTC
Received	1 May 2010, 2:51:30 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1063130
Run time
CPU time	1 days 17 hours 37 min 48 sec
Validate state	Invalid
Credit	793.95
Device peak FLOPS	0.00 GFLOPS
Application version	---
Stderr	<core_client_version>6.10.17</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: 7R CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2037, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2037, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2037, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2037, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2037, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2037, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (11 frames): /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b] [0x55573400] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81325e6] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81b83f7] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80972b5] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c22cf] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f] /opt/lib32/lib/libc.so.6(__libc_start_main+0xe6)[0x555ebb96] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2086, iMonCtr=1 Model crash detected, will try to restart... SIGILL: illegal instruction Stack trace (16 frames): /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b] [0x55573400] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x858fd65] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x862cb4c] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x83e7879] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x850d2fd] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8249fa7] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x85f336b] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x84b44e6] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80b273e] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86f5990] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f] /opt/lib32/lib/libc.so.6(__libc_start_main+0xe6)[0x555ebb96] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2086, iMonCtr=1 Model crash detected, will try to restart... Model crashed: 7R forrtl: severe (24): end-of-file during read, unit 22, file /var/lib/boinc/projects/climateprediction.net/hadsm3dhet2_k9sd_006622335/datain/ancil/ctldata/STASHmaster/STASHmaster_S Image PC Routine Line Source hadsm3_um_6.08_i6 087C31CC Unknown Unknown Unknown hadsm3_um_6.08_i6 087C0D75 Unknown Unknown Unknown hadsm3_um_6.08_i6 087A2FD3 Unknown Unknown Unknown hadsm3_um_6.08_i6 0877238E Unknown Unknown Unknown hadsm3_um_6.08_i6 08781C29 Unknown Unknown Unknown hadsm3_um_6.08_i6 08271DE6 Unknown Unknown Unknown hadsm3_um_6.08_i6 086EFBDC Unknown Unknown Unknown hadsm3_um_6.08_i6 086C0886 Unknown Unknown Unknown hadsm3_um_6.08_i6 086FEB0F Unknown Unknown Unknown Unknown 555EBB96 Unknown Unknown Unknown hadsm3_um_6.08_i6 0804BB31 Unknown Unknown Unknown CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2086, iMonCtr=1 Model crash detected, will try to restart... Model crashed: 7R Model crashed: 7R SIGSEGV: segmentation violation Stack trace (10 frames): /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b] [0x55573400] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x82e56de] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x82e77f4] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86d3b2e] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86eff99] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f] /opt/lib32/lib/libc.so.6(__libc_start_main+0xe6)[0x555ebb96] /var/lib/boinc/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2086, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Apr 2010 02:07:01	1063130	11285099	hadsm3dhet2_k9sd_006622335_0	86,416	143,282	1.6580
20 Apr 2010 02:35:22	1063130	11285099	hadsm3dhet2_k9sd_006622335_0	75,614	64,379	0.8514
19 Apr 2010 05:34:53	1063130	11285099	hadsm3dhet2_k9sd_006622335_0	64,812	55,228	0.8521
18 Apr 2010 22:23:29	1063130	11285099	hadsm3dhet2_k9sd_006622335_0	54,010	45,640	0.8450
18 Apr 2010 17:22:20	1063130	11285099	hadsm3dhet2_k9sd_006622335_0	43,208	36,032	0.8339
16 Apr 2010 11:55:24	1063130	11285099	hadsm3dhet2_k9sd_006622335_0	32,406	27,217	0.8399
15 Apr 2010 20:07:07	1063130	11285099	hadsm3dhet2_k9sd_006622335_0	21,604	18,005	0.8334
15 Apr 2010 11:09:27	1063130	11285099	hadsm3dhet2_k9sd_006622335_0	10,802	8,818	0.8163