Task 12502402

Name	famous_v583_999_200_006733184_1
Workunit	6936525
Created	18 Jan 2011, 4:52:49 UTC
Sent	21 Jan 2011, 15:11:04 UTC
Report deadline	22 Apr 2011, 22:38:15 UTC
Received	29 Jan 2011, 15:38:03 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1119057
Run time	5 days 1 hours 58 min 11 sec
CPU time	4 days 21 hours 44 min
Validate state	Invalid
Credit	1,945.63
Device peak FLOPS	1.98 GFLOPS
Application version	UK Met Office FAMOUS v6.11 i686-pc-linux-gnu
Stderr	<core_client_version>6.12.11</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (12 frames): /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf7742400] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x810af74] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8225a3c] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x82429c1] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x817177f] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x817613b] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8325c74] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf7596ce6] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2312, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (12 frames): /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf76ff400] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x810af74] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8225a3c] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x82429c1] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x817177f] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x817613b] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8325c74] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf7553ce6] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2312, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (12 frames): /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf77c8400] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x810af74] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8225a3c] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x82429c1] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x817177f] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x817613b] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8325c74] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf761cce6] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2312, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (12 frames): /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf7716400] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x810af74] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8225a3c] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x82429c1] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x817177f] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x817613b] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8325c74] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf756ace6] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2312, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (12 frames): /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf779f400] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x810af74] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8225a3c] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x82429c1] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x817177f] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x817613b] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8325c74] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf75f3ce6] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2312, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (12 frames): /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400] [0xf7742400] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x810af74] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8225a3c] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x82429c1] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x817177f] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x817613b] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8325c74] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf7596ce6] /home/dod/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2312, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( (2312): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Jan 2011 12:27:26	1119057	12502402	famous_v583_999_200_006733184_1	589,706	420,850	0.7137
29 Jan 2011 12:27:26	1119057	12502402	famous_v583_999_200_006733184_1	580,346	414,285	0.7139
29 Jan 2011 12:27:26	1119057	12502402	famous_v583_999_200_006733184_1	570,986	407,770	0.7142
29 Jan 2011 12:27:26	1119057	12502402	famous_v583_999_200_006733184_1	561,626	401,306	0.7145
29 Jan 2011 12:27:26	1119057	12502402	famous_v583_999_200_006733184_1	552,266	394,771	0.7148
29 Jan 2011 12:27:26	1119057	12502402	famous_v583_999_200_006733184_1	542,906	388,186	0.7150
28 Jan 2011 16:32:20	1119057	12502402	famous_v583_999_200_006733184_1	533,546	381,514	0.7151
28 Jan 2011 16:32:20	1119057	12502402	famous_v583_999_200_006733184_1	524,186	374,833	0.7151
28 Jan 2011 16:32:21	1119057	12502402	famous_v583_999_200_006733184_1	514,826	368,151	0.7151
28 Jan 2011 16:32:20	1119057	12502402	famous_v583_999_200_006733184_1	505,466	361,474	0.7151
28 Jan 2011 16:32:21	1119057	12502402	famous_v583_999_200_006733184_1	496,106	354,805	0.7152
28 Jan 2011 16:32:21	1119057	12502402	famous_v583_999_200_006733184_1	486,746	348,129	0.7152
28 Jan 2011 16:32:21	1119057	12502402	famous_v583_999_200_006733184_1	477,386	341,468	0.7153
28 Jan 2011 16:32:21	1119057	12502402	famous_v583_999_200_006733184_1	468,026	334,782	0.7153
28 Jan 2011 16:32:21	1119057	12502402	famous_v583_999_200_006733184_1	458,666	328,093	0.7153
28 Jan 2011 16:32:21	1119057	12502402	famous_v583_999_200_006733184_1	449,306	321,414	0.7154
28 Jan 2011 16:32:20	1119057	12502402	famous_v583_999_200_006733184_1	439,946	314,735	0.7154
28 Jan 2011 16:32:21	1119057	12502402	famous_v583_999_200_006733184_1	430,586	308,045	0.7154
28 Jan 2011 16:32:20	1119057	12502402	famous_v583_999_200_006733184_1	421,226	301,375	0.7155
28 Jan 2011 16:32:20	1119057	12502402	famous_v583_999_200_006733184_1	411,866	294,710	0.7155