Task 20272249

Name	wah2_sas50_mwco_201512_13_531_010945289_0
Workunit	10945289
Created	16 Feb 2017, 22:21:17 UTC
Sent	18 Feb 2017, 23:55:36 UTC
Report deadline	1 Feb 2018, 5:15:36 UTC
Received	12 Apr 2017, 0:00:15 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1421716
Run time	15 days 13 hours 20 min 15 sec
CPU time	15 days 4 hours 26 min 56 sec
Validate state	Invalid
Credit	9,138.96
Device peak FLOPS	1.99 GFLOPS
Application version	Weather At Home 2 (wah2) (region independent) v8.12 i686-pc-linux-gnu
Peak working set size	238.86 MB
Peak swap size	272.31 MB
Peak disk usage	160.98 MB
Stderr	<core_client_version>7.6.31</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (19 frames): ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] [0xb77b4c14] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xb740318a] /lib/i386-linux-gnu/libc.so.6(+0xa21bb)[0xb74771bb] /lib/i386-linux-gnu/libc.so.6(+0xa252a)[0xb747752a] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1e)[0xb7475bbe] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391] [0xb77b4c14] [0xb77b4c31] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x4a)[0xb748525a] /lib/i386-linux-gnu/libc.so.6(usleep+0x35)[0xb74b5105] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf7)[0xb73ed637] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... 14:11:14 (2026): called boinc_finish(193) Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (19 frames): ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] [0xb7751c14] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xb73a018a] /lib/i386-linux-gnu/libc.so.6(+0xa21bb)[0xb74141bb] /lib/i386-linux-gnu/libc.so.6(+0xa252a)[0xb741452a] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1e)[0xb7412bbe] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391] [0xb7751c14] [0xb7751c31] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x4a)[0xb742225a] /lib/i386-linux-gnu/libc.so.6(usleep+0x35)[0xb7452105] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf7)[0xb738a637] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1] Exiting... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (20 frames): ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] [0xb7793c14] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xb73e218a] /lib/i386-linux-gnu/libc.so.6(+0xa21bb)[0xb74561bb] /lib/i386-linux-gnu/libc.so.6(+0xa252a)[0xb745652a] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1e)[0xb7454bbe] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391] [0xb7793c14] [0xb7793c31] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x4a)[0xb746425a] /lib/i386-linux-gnu/libc.so.6(usleep+0x35)[0xb7494105] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8050953] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051103] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf7)[0xb73cc637] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1] Exiting... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (19 frames): ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] [0xb773ac14] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xb738918a] /lib/i386-linux-gnu/libc.so.6(+0xa21bb)[0xb73fd1bb] /lib/i386-linux-gnu/libc.so.6(+0xa252a)[0xb73fd52a] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1e)[0xb73fbbbe] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391] [0xb773ac14] [0xb773ac31] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x4a)[0xb740b25a] /lib/i386-linux-gnu/libc.so.6(usleep+0x35)[0xb743b105] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf7)[0xb7373637] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: READDM1A: Dump does not match STASH list - see output tmp/xadae.pipe_dummy Leaving CPDN_Main::Monitor... SIGSEGV: segmentation violation Stack trace (14 frames): ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] [0xb7753c14] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xb73a218a] /lib/i386-linux-gnu/libc.so.6(+0xa21bb)[0xb74161bb] /lib/i386-linux-gnu/libc.so.6(+0xa252a)[0xb741652a] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1e)[0xb7414bbe] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8050463] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x805242c] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf7)[0xb738c637] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Apr 2017 04:47:34	1421716	20272249	wah2_sas50_mwco_201512_13_531_010945289_0	138,539	1,311,209	9.4645
02 Apr 2017 22:44:43	1421716	20272249	wah2_sas50_mwco_201512_13_531_010945289_0	127,019	1,210,276	9.5283
31 Mar 2017 05:55:43	1421716	20272249	wah2_sas50_mwco_201512_13_531_010945289_0	115,499	1,106,510	9.5803
26 Mar 2017 05:59:24	1421716	20272249	wah2_sas50_mwco_201512_13_531_010945289_0	103,979	1,007,971	9.6940
21 Mar 2017 06:16:00	1421716	20272249	wah2_sas50_mwco_201512_13_531_010945289_0	92,459	904,976	9.7879
12 Mar 2017 01:20:07	1421716	20272249	wah2_sas50_mwco_201512_13_531_010945289_0	80,939	801,856	9.9069
09 Mar 2017 03:26:11	1421716	20272249	wah2_sas50_mwco_201512_13_531_010945289_0	69,419	707,753	10.1954
05 Mar 2017 08:43:03	1421716	20272249	wah2_sas50_mwco_201512_13_531_010945289_0	57,899	579,815	10.0142
03 Mar 2017 01:25:47	1421716	20272249	wah2_sas50_mwco_201512_13_531_010945289_0	46,379	450,049	9.7037
26 Feb 2017 17:15:57	1421716	20272249	wah2_sas50_mwco_201512_13_531_010945289_0	34,859	334,989	9.6098
25 Feb 2017 12:34:05	1421716	20272249	wah2_sas50_mwco_201512_13_531_010945289_0	23,339	236,198	10.1203
22 Feb 2017 02:45:13	1421716	20272249	wah2_sas50_mwco_201512_13_531_010945289_0	11,819	131,350	11.1135