Task 18008233

Name	hadam3pm2_pe0l_1991_10_009528462_2
Workunit	9610205
Created	5 Mar 2015, 6:58:29 UTC
Sent	5 Mar 2015, 7:37:46 UTC
Report deadline	15 Feb 2016, 12:57:46 UTC
Received	22 Mar 2015, 1:19:24 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1303626
Run time	12 days 5 hours 53 min 49 sec
CPU time	5 days 16 hours 14 min 22 sec
Validate state	Invalid
Credit	8,900.08
Device peak FLOPS	2.39 GFLOPS
Application version	UK Met Office HadAM3P (global only) with MOSES II landsurface scheme v7.03 i686-pc-linux-gnu
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> SIGSEGV: segmentation violation Stack trace (13 frames): /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x83bccdf] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf0fd8e50] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8165b39] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816b8f8] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8162a76] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816d014] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8161751] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8085677] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8094c0a] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x831e514] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x83205f9] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x834c82d] /lib/libc.so.6(__libc_start_main+0xf3)[0xf0ddc993] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=27038, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x83bccdf] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf0fcce50] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8165b39] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816b8f8] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8162a76] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816d014] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8161751] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8085677] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8094c0a] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x831e514] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x83205f9] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x834c82d] /lib/libc.so.6(__libc_start_main+0xf3)[0xf0dd0993] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=27038, iMonCtr=1 Model crash detected, will try to restart... Signal 15 received, exiting... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x83bccdf] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf0f62e50] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8165b39] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816b8f8] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8162a76] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816d014] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8161751] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8085677] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8094c0a] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x831e514] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x83205f9] /home/martin/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x834c82d] /lib/libc.so.6(__libc_start_main+0xf3)[0xf0d66993] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6810, iMonCtr=1 Model crash detected, will try to restart... oa.pc\|5dec.nc oa.pc\|6jan.nc oa.pc\|6feb.nc oa.pc\|6mar.nc oa.pc\|6apr.nc oa.pc\|6may.nc oa.pc\|6jun.nc oa.pc\|6jul.nc oa.pc\|6aug.nc oa.pc\|6sep.nc oa.pc\|6oct.nc oa.pc\|6nov.nc oa.pe\|5dec.nc oa.pe\|6jan.nc oa.pe\|6feb.nc oa.pe\|6mar.nc oa.pe\|6apr.nc oa.pe\|6may.nc oa.pe\|6jun.nc oa.pe\|6jul.nc oa.pe\|6aug.nc oa.pe\|6sep.nc oa.pe\|6oct.nc oa.pe\|6nov.nc SIGSEGV: segmentation violation Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... oa.pc\|8dec.nc oa.pc\|9jan.nc oa.pc\|9feb.nc oa.pc\|9mar.nc oa.pc\|9apr.nc oa.pc\|9may.nc oa.pc\|9jun.nc oa.pc\|9jul.nc oa.pc\|9aug.nc oa.pc\|9sep.nc oa.pc\|9oct.nc oa.pc\|9nov.nc oa.pe\|8dec.nc oa.pe\|9jan.nc oa.pe\|9feb.nc oa.pe\|9mar.nc oa.pe\|9apr.nc oa.pe\|9may.nc oa.pe\|9jun.nc oa.pe\|9jul.nc oa.pe\|9aug.nc oa.pe\|9sep.nc oa.pe\|9oct.nc oa.pe\|9nov.nc oa.pc\|9dec.nc oa.pc\|0jan.nc oa.pc\|0feb.nc oa.pc\|0mar.nc oa.pc\|0apr.nc oa.pc\|0may.nc oa.pc\|0jun.nc oa.pc\|0jul.nc oa.pc\|0aug.nc oa.pc\|0sep.nc oa.pc\|0oct.nc oa.pc\|0nov.nc oa.pe\|9dec.nc oa.pe\|0jan.nc oa.pe\|0feb.nc oa.pe\|0mar.nc oa.pe\|0apr.nc oa.pe\|0may.nc oa.pe\|0jun.nc oa.pe\|0jul.nc oa.pe\|0aug.nc oa.pe\|0sep.nc oa.pe\|0oct.nc oa.pe\|0nov.nc Model crashed: æM Model crashed: § Model crashed: § Model crashed: § Model crashed: § Model crashed: § Sorry, too many model crashes! :-( 01:18:54 (2715): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Mar 2015 19:38:26	1303626	18008233	hadam3pm2_pe0l_1991_10_009528462_2	308,228	768,770	2.4942
21 Mar 2015 17:22:56	1303626	18008233	hadam3pm2_pe0l_1991_10_009528462_2	305,348	760,767	2.4915
21 Mar 2015 15:12:29	1303626	18008233	hadam3pm2_pe0l_1991_10_009528462_2	302,468	752,766	2.4887
21 Mar 2015 12:56:59	1303626	18008233	hadam3pm2_pe0l_1991_10_009528462_2	299,588	744,770	2.4860
21 Mar 2015 10:41:29	1303626	18008233	hadam3pm2_pe0l_1991_10_009528462_2	296,708	736,732	2.4830
21 Mar 2015 08:20:55	1303626	18008233	hadam3pm2_pe0l_1991_10_009528462_2	293,828	728,430	2.4791
21 Mar 2015 06:00:14	1303626	18008233	hadam3pm2_pe0l_1991_10_009528462_2	290,948	720,061	2.4749
21 Mar 2015 03:38:44	1303626	18008233	hadam3pm2_pe0l_1991_10_009528462_2	288,068	711,671	2.4705
21 Mar 2015 01:14:15	1303626	18008233	hadam3pm2_pe0l_1991_10_009528462_2	285,188	703,318	2.4662
20 Mar 2015 22:53:09	1303626	18008233	hadam3pm2_pe0l_1991_10_009528462_2	282,308	695,022	2.4619
20 Mar 2015 20:32:28	1303626	18008233	hadam3pm2_pe0l_1991_10_009528462_2	279,428	686,758	2.4577
20 Mar 2015 15:55:34	1303626	18008233	hadam3pm2_pe0l_1991_10_009528462_2	273,668	670,386	2.4496
20 Mar 2015 13:38:31	1303626	18008233	hadam3pm2_pe0l_1991_10_009528462_2	270,788	662,163	2.4453
20 Mar 2015 11:17:23	1303626	18008233	hadam3pm2_pe0l_1991_10_009528462_2	267,908	653,826	2.4405
20 Mar 2015 08:56:44	1303626	18008233	hadam3pm2_pe0l_1991_10_009528462_2	265,028	645,496	2.4356
20 Mar 2015 06:35:39	1303626	18008233	hadam3pm2_pe0l_1991_10_009528462_2	262,148	637,198	2.4307
20 Mar 2015 04:33:36	1303626	18008233	hadam3pm2_pe0l_1991_10_009528462_2	259,268	628,893	2.4256
20 Mar 2015 01:50:54	1303626	18008233	hadam3pm2_pe0l_1991_10_009528462_2	256,388	620,559	2.4204
19 Mar 2015 23:29:35	1303626	18008233	hadam3pm2_pe0l_1991_10_009528462_2	253,508	612,239	2.4151
19 Mar 2015 21:09:00	1303626	18008233	hadam3pm2_pe0l_1991_10_009528462_2	250,628	603,971	2.4098