Task 19353926

Name	wah2_eu25_f95j_195812_13_366_010360657_0
Workunit	10360657
Created	15 Mar 2016, 20:19:37 UTC
Sent	15 Mar 2016, 20:37:16 UTC
Report deadline	26 Feb 2017, 1:57:16 UTC
Received	27 Mar 2016, 23:30:31 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1325379
Run time	1 days 15 hours 53 min 28 sec
CPU time	1 days 14 hours 36 min 18 sec
Validate state	Invalid
Credit	2,299.53
Device peak FLOPS	3.82 GFLOPS
Application version	Weather At Home 2 (wah2) (region independent) v8.12 i686-pc-linux-gnu
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> Signal 15 received, exiting... 07:01:01 (5667): called boinc_finish(193) Signal 15 received, exiting... 07:01:01 (5668): called boinc_finish(193) Signal 1 received, exiting... 07:01:01 (5667): called boinc_finish(193) Signal 15 received, exiting... Signal 15 received, exiting... 07:01:03 (2689): called boinc_finish(193) Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (20 frames): ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77b9bc0] /lib/libc.so.6(getenv+0x9a)[0xf73e62ca] /lib/libc.so.6(+0xaaaeb)[0xf7460aeb] /lib/libc.so.6(localtime_r+0x1e)[0xf745ea2e] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77b9bc0] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77b9bc0] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf77b9be9] /lib/libc.so.6(nanosleep+0x46)[0xf746ee66] /lib/libc.so.6(usleep+0x35)[0xf74a4515] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674] /lib/libc.so.6(__libc_start_main+0xf5)[0xf73ce545] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1] Exiting... Signal 15 received, exiting... Signal 15 received, exiting... Signal 1 received, exiting... 07:01:01 (2699): called boinc_finish(193) Signal 15 received, exiting... SIGSEGV: segmentation violation SIGSEGV: segmentation violation Stack trace (18 frames): Stack trace (../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] 7linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77dabc0] frames): /lib/libc.so.6(getenv+0x9a)[0xf74072ca] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77dabc0] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x805111d] /lib/libc.so.6(+0xaaaeb)[0xf7481aeb] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4] /lib/libc.so.6(localtime_r+0x1e)[0xf747fa2e] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96] /lib/libc.so.6(__libc_start_main+0xf5)[0xf73ef545] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391] Exiting... linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77dabc0] CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... 20:20:12 (5685): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5686, selfPID=5681, iMonCtr=1 Model crash detected, will try to restart... Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (18 frames): ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77b3bc0] /lib/libc.so.6(getenv+0x9a)[0xf73e02ca] /lib/libc.so.6(+0xaaaeb)[0xf745aaeb] /lib/libc.so.6(localtime_r+0x1e)[0xf7458a2e] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77b3bc0] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77b3bc0] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf77b3be9] /lib/libc.so.6(nanosleep+0x46)[0xf7468e66] /lib/libc.so.6(usleep+0x35)[0xf749e515] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c63c4] /lib/libpthread.so.0(+0x6452)[0xf776f452] /lib/libc.so.6(clone+0x5e)[0xf74a825e] Exiting... Signal 15 received, exiting... Signal 15 received, exiting... 07:01:02 (2468): called boinc_finish(193) Signal 15 received, exiting... SIGSEGV: segmentation violation SIGSEGV: segmentation violation Stack trace (18 frames): ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] Stack trace (linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77bbbc0] 7 frames): /lib/libc.so.6(getenv+0x9a)[0xf73e82ca] /lib/libc.so.6(+0xaaaeb)[0xf7462aeb] /lib/libc.so.6(localtime_r+0x1e)[0xf7460a2e] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77bbbc0] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x805111d] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77bbbc0] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c] /lib/libc.so.6(__libc_start_main+0xf5)[0xf73d0545] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77bbbc0] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf77bbbe9] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Signal 15 received, exiting... 07:01:04 (2750): called boinc_finish(193) 07:01:04 (2749): called boinc_finish(193) Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2749, selfPID=2750, iMonCtr=1 Signal 1 received, exiting... SIGSEGV: segmentation violation Stack trace (23 frames): ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776abc0] /lib/libc.so.6(getenv+0x9a)[0xf73972ca] /lib/libc.so.6(+0xaaaeb)[0xf7411aeb] /lib/libc.so.6(localtime_r+0x1e)[0xf740fa2e] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776abc0] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf776abe9] /lib/libpthread.so.0(waitpid+0x4b)[0xf772fa0b] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8050017] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d8c0] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776abc0] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf776abe9] /lib/libc.so.6(nanosleep+0x46)[0xf741fe66] /lib/libc.so.6(usleep+0x35)[0xf7455515] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674] /lib/libc.so.6(__libc_start_main+0xf5)[0xf737f545] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1] Exiting... Signal 15 received, exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7234, selfPID=7220, iMonCtr=1 Model crash detected, will try to restart... Signal 15 received, exiting... SIGSEGV: segmentation violation SIGSEGV: segmentation violation Stack trace (Stack trace (718 frames): frames): ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77babc0] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77babc0] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x805111d] /lib/libc.so.6(getenv+0x9a)[0xf73e72ca] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4] /lib/libc.so.6(+0xaaaeb)[0xf7461aeb] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674] /lib/libc.so.6(localtime_r+0x1e)[0xf745fa2e] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77babc0] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77babc0] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf77babe9] /lib/libc.so.6(nanosleep+0x46)[0xf746fe66] /lib/libc.so.6(usleep+0x35)[0xf74a5515] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c63c4] /lib/libpthread.so.0(+0x6452)[0xf7776452] /lib/libc.so.6(clone+0x5e)[0xf74af25e] Exiting... Signal 15 received, exiting... Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (20 frames): ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77bcbc0] /lib/libc.so.6(getenv+0x9a)[0xf73e92ca] /lib/libc.so.6(+0xaaaeb)[0xf7463aeb] /lib/libc.so.6(localtime_r+0x1e)[0xf7461a2e] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77bcbc0] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77bcbc0] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf77bcbe9] /lib/libc.so.6(nanosleep+0x46)[0xf7471e66] /lib/libc.so.6(usleep+0x35)[0xf74a7515] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674] /lib/libc.so.6(__libc_start_main+0xf5)[0xf73d1545] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1] Exiting... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (20 frames): ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76f6bc0] /lib/libc.so.6(getenv+0x9a)[0xf73232ca] /lib/libc.so.6(+0xaaaeb)[0xf739daeb] /lib/libc.so.6(localtime_r+0x1e)[0xf739ba2e] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76f6bc0] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76f6bc0] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf76f6be9] /lib/libc.so.6(nanosleep+0x46)[0xf73abe66] /lib/libc.so.6(usleep+0x35)[0xf73e1515] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674] /lib/libc.so.6(__libc_start_main+0xf5)[0xf730b545] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1] Exiting... Signal 1 received, exiting... SIGSEGV: segmentation violation Stack trace (23 frames): ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776dbc0] /lib/libc.so.6(getenv+0x9a)[0xf739a2ca] /lib/libc.so.6(+0xaaaeb)[0xf7414aeb] /lib/libc.so.6(localtime_r+0x1e)[0xf7412a2e] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776dbc0] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf776dbe9] /lib/libpthread.so.0(waitpid+0x4b)[0xf7732a0b] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8050017] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d8c0] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776dbc0] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf776dbe9] /lib/libc.so.6(nanosleep+0x46)[0xf7422e66] /lib/libc.so.6(usleep+0x35)[0xf7458515] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674] /lib/libc.so.6(__libc_start_main+0xf5)[0xf7382545] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1] Exiting... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (20 frames): ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76eabc0] /lib/libc.so.6(getenv+0x9a)[0xf73172ca] /lib/libc.so.6(+0xaaaeb)[0xf7391aeb] /lib/libc.so.6(localtime_r+0x1e)[0xf738fa2e] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76eabc0] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76eabc0] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf76eabe9] /lib/libc.so.6(nanosleep+0x46)[0xf739fe66] /lib/libc.so.6(usleep+0x35)[0xf73d5515] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674] /lib/libc.so.6(__libc_start_main+0xf5)[0xf72ff545] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1] Exiting... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Signal 15 received, exiting... 16:35:01 (20278): called boinc_finish(193) 16:35:01 (20277): called boinc_finish(193) Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... 07:01:03 (2775): called boinc_finish(193) Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (20 frames): ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776abc0] /lib/libc.so.6(getenv+0x9a)[0xf73972ca] /lib/libc.so.6(+0xaaaeb)[0xf7411aeb] /lib/libc.so.6(localtime_r+0x1e)[0xf740fa2e] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776abc0] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776abc0] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf776abe9] /lib/libc.so.6(nanosleep+0x46)[0xf741fe66] /lib/libc.so.6(usleep+0x35)[0xf7455515] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674] /lib/libc.so.6(__libc_start_main+0xf5)[0xf737f545] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1] Exiting... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Signal 15 received, exiting... SIGSEGV: segmentation violation SIGSEGV: segmentation violation Stack trace (18 frames): ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77a5bc0] Stack trace (7 frames): /lib/libc.so.6(getenv+0x9a)[0xf73d22ca] /lib/libc.so.6(+0xaaaeb)[0xf744caeb] /lib/libc.so.6(localtime_r+0x1e)[0xf744aa2e] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77a5bc0] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x805111d] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c] /lib/libc.so.6(__libc_start_main+0xf5)[0xf73ba545] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1] Exiting... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... 08:30:43 (7219): called boinc_finish(193) Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (18 frames): ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7748bc0] /lib/libc.so.6(getenv+0x9a)[0xf73752ca] /lib/libc.so.6(+0xaaaeb)[0xf73efaeb] /lib/libc.so.6(localtime_r+0x1e)[0xf73eda2e] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7748bc0] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7748bc0] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7748be9] /lib/libc.so.6(nanosleep+0x46)[0xf73fde66] /lib/libc.so.6(usleep+0x35)[0xf7433515] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c63c4] /lib/libpthread.so.0(+0x6452)[0xf7704452] /lib/libc.so.6(clone+0x5e)[0xf743d25e] Exiting... Signal 15 received, exiting... Signal 15 received, exiting... SIGSEGV: segmentation violation SIGSEGV: segmentation violation Stack trace (Stack trace (718 frames): frames): ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7773bc0] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7773bc0] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x805111d] /lib/libc.so.6(getenv+0x9a)[0xf73a02ca] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4] /lib/libc.so.6(+0xaaaeb)[0xf741aaeb] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674] /lib/libc.so.6(localtime_r+0x1e)[0xf7418a2e] /lib/libc.so.6(__libc_start_main+0xf5)[0xf7388545] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c] Exiting... ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7773bc0] CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Signal 15 received, exiting... 07:01:03 (2976): called boinc_finish(193) Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (20 frames): ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77adbc0] /lib/libc.so.6(getenv+0x9a)[0xf73da2ca] /lib/libc.so.6(+0xaaaeb)[0xf7454aeb] /lib/libc.so.6(localtime_r+0x1e)[0xf7452a2e] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77adbc0] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77adbc0] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf77adbe9] /lib/libc.so.6(nanosleep+0x46)[0xf7462e66] /lib/libc.so.6(usleep+0x35)[0xf7498515] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674] /lib/libc.so.6(__libc_start_main+0xf5)[0xf73c2545] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1] Exiting... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17858, selfPID=17842, iMonCtr=1 Model crash detected, will try to restart... Signal 15 received, exiting... SIGSEGV: segmentation violation Leaving CPDN_Main::Monitor... Stack trace (18 frames): ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e2bc0] /lib/libc.so.6(getenv+0x9a)[0xf730f2ca] /lib/libc.so.6(+0xaaaeb)[0xf7389aeb] /lib/libc.so.6(localtime_r+0x1e)[0xf7387a2e] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e2bc0] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e2bc0] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf76e2be9] /lib/libc.so.6(nanosleep+0x46)[0xf7397e66] /lib/libc.so.6(usleep+0x35)[0xf73cd515] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50] ../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c63c4] /lib/libpthread.so.0(+0x6452)[0xf769e452] /lib/libc.so.6(clone+0x5e)[0xf73d725e] Exiting... forrtl: severe (24): end-of-file during read, unit 9, file /home/rick/projects/climateprediction.net/wah2_eu25_f95j_195812_13_366_010360657/tmp/xadae.namelists Image PC Routine Line Source wah2am3m2_um_8.12 08446FED Unknown Unknown Unknown wah2am3m2_um_8.12 08445DE5 Unknown Unknown Unknown wah2am3m2_um_8.12 084178FF Unknown Unknown Unknown wah2am3m2_um_8.12 083D465D Unknown Unknown Unknown wah2am3m2_um_8.12 083D3FA7 Unknown Unknown Unknown wah2am3m2_um_8.12 083F1F14 Unknown Unknown Unknown wah2am3m2_um_8.12 08255ED7 Unknown Unknown Unknown wah2am3m2_um_8.12 08314FD2 Unknown Unknown Unknown wah2am3m2_um_8.12 08316727 Unknown Unknown Unknown wah2am3m2_um_8.12 08341332 Unknown Unknown Unknown libc.so.6 2A768545 Unknown Unknown Unknown forrtl: severe (24): end-of-file during read, unit 9, file /home/rick/projects/climateprediction.net/wah2_eu25_f95j_195812_13_366_010360657/tmp/xacxf.namelists Image PC Routine Line Source wah2rm3m2t_um_8.1 083F37DD Unknown Unknown Unknown wah2rm3m2t_um_8.1 083F25D5 Unknown Unknown Unknown wah2rm3m2t_um_8.1 083C302F Unknown Unknown Unknown wah2rm3m2t_um_8.1 0837F19D Unknown Unknown Unknown wah2rm3m2t_um_8.1 0837EAE7 Unknown Unknown Unknown wah2rm3m2t_um_8.1 0839D644 Unknown Unknown Unknown wah2rm3m2t_um_8.1 08208B5B Unknown Unknown Unknown wah2rm3m2t_um_8.1 082A6BB2 Unknown Unknown Unknown wah2rm3m2t_um_8.1 082EA63F Unknown Unknown Unknown wah2rm3m2t_um_8.1 082ECD6C Unknown Unknown Unknown libc.so.6 2A778545 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2542, selfPID=2173, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 06:04:22 (2173): called boinc_finish(0) </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>wah2_eu25_f95j_195812_13_366_010360657_0_4.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eu25_f95j_195812_13_366_010360657_0_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eu25_f95j_195812_13_366_010360657_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eu25_f95j_195812_13_366_010360657_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eu25_f95j_195812_13_366_010360657_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eu25_f95j_195812_13_366_010360657_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eu25_f95j_195812_13_366_010360657_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eu25_f95j_195812_13_366_010360657_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eu25_f95j_195812_13_366_010360657_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eu25_f95j_195812_13_366_010360657_0_13.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eu25_f95j_195812_13_366_010360657_0_14.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Mar 2016 03:38:18	1325379	19353926	wah2_eu25_f95j_195812_13_366_010360657_0	34,859	128,613	3.6895
24 Mar 2016 06:07:06	1325379	19353926	wah2_eu25_f95j_195812_13_366_010360657_0	23,339	86,507	3.7065
19 Mar 2016 20:28:30	1325379	19353926	wah2_eu25_f95j_195812_13_366_010360657_0	11,819	44,295	3.7478