climateprediction.net home page
Task 19683148

Task 19683148

Name wah2_pnw25_z78s_199712_24_406_010587281_0
Workunit 10587281
Created 18 May 2016, 4:00:31 UTC
Sent 20 May 2016, 8:03:54 UTC
Report deadline 2 May 2017, 13:23:54 UTC
Received 17 Jun 2016, 20:03:50 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1325379
Run time 3 days 13 hours 28 min 56 sec
CPU time 3 days 11 hours 13 min 45 sec
Validate state Invalid
Credit 12,938.64
Device peak FLOPS 3.74 GFLOPS
Application version Weather At Home 2 (wah2) (region independent) v8.12
i686-pc-linux-gnu
Stderr
<core_client_version>7.6.22</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Signal 15 received, exiting...
18:09:40 (6457): called boinc_finish(193)
Signal 15 received, exiting...
18:09:40 (6456): called boinc_finish(193)
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (23 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76fabc0]
/lib/libc.so.6(getenv+0x9a)[0xf732630a]
/lib/libc.so.6(+0xaa74b)[0xf73a074b]
/lib/libc.so.6(localtime_r+0x1e)[0xf739e68e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76fabc0]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf76fabe9]
/lib/libpthread.so.0(waitpid+0x4b)[0xf76bfa0b]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8050017]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d8c0]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76fabc0]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf76fabe9]
/lib/libc.so.6(nanosleep+0x46)[0xf73aed06]
/lib/libc.so.6(usleep+0x35)[0xf73e41a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf730e545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
Stack trace (linux-gate.so.1(__kernel_sigreturn+0x0)[0xf773bbc0]
7 frames):
/lib/libc.so.6(getenv+0x9a)[0xf736730a]
/lib/libc.so.6(+0xaa74b)[0xf73e174b]
/lib/libc.so.6(localtime_r+0x1e)[0xf73df68e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf773bbc0]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x805111d]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf773bbc0]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf773bbc0]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf734f545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
Signal 1 received, exiting...
07:01:02 (2760): called boinc_finish(193)
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (23 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7790bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73bc30a]
/lib/libc.so.6(+0xaa74b)[0xf743674b]
/lib/libc.so.6(localtime_r+0x1e)[0xf743468e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7790bc0]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7790be9]
/lib/libpthread.so.0(waitpid+0x4b)[0xf7755a0b]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8050017]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d8c0]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7790bc0]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7790be9]
/lib/libc.so.6(nanosleep+0x46)[0xf7444d06]
/lib/libc.so.6(usleep+0x35)[0xf747a1a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73a4545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Signal 15 received, exiting...
19:10:24 (2595): called boinc_finish(193)
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (20 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf779abc0]
/lib/libc.so.6(getenv+0x9a)[0xf73c630a]
/lib/libc.so.6(+0xaa74b)[0xf744074b]
/lib/libc.so.6(localtime_r+0x1e)[0xf743e68e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf779abc0]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf779abc0]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf779abe9]
/lib/libc.so.6(nanosleep+0x46)[0xf744ed06]
/lib/libc.so.6(usleep+0x35)[0xf74841a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73ae545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7752bc0]
/lib/libc.so.6(getenv+0x9a)[0xf737e30a]
/lib/libc.so.6(+0xaa74b)[0xf73f874b]
/lib/libc.so.6(localtime_r+0x1e)[0xf73f668e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7752bc0]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7752bc0]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7752be9]
/lib/libc.so.6(nanosleep+0x46)[0xf7406d06]
/lib/libc.so.6(usleep+0x35)[0xf743c1a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c63c4]
/lib/libpthread.so.0(+0x6452)[0xf770e452]
/lib/libc.so.6(clone+0x5e)[0xf7445eee]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7737bc0]
/lib/libc.so.6(getenv+0x9a)[0xf736330a]
/lib/libc.so.6(+0xaa74b)[0xf73dd74b]
/lib/libc.so.6(localtime_r+0x1e)[0xf73db68e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7737bc0]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7737bc0]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7737be9]
/lib/libc.so.6(nanosleep+0x46)[0xf73ebd06]
/lib/libc.so.6(usleep+0x35)[0xf74211a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c63c4]
/lib/libpthread.so.0(+0x6452)[0xf76f3452]
/lib/libc.so.6(clone+0x5e)[0xf742aeee]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
07:01:03 (2784): called boinc_finish(193)
07:01:03 (2783): called boinc_finish(193)
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (20 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77a8bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73d430a]
/lib/libc.so.6(+0xaa74b)[0xf744e74b]
/lib/libc.so.6(localtime_r+0x1e)[0xf744c68e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77a8bc0]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77a8bc0]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf77a8be9]
/lib/libc.so.6(nanosleep+0x46)[0xf745cd06]
/lib/libc.so.6(usleep+0x35)[0xf74921a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73bc545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (7 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d1bc0]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x805111d]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73e5545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Signal 15 received, exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2777, selfPID=2330, iMonCtr=1
Model crash detected, will try to restart...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77dabc0]
/lib/libc.so.6(getenv+0x9a)[0xf740630a]
/lib/libc.so.6(+0xaa74b)[0xf748074b]
/lib/libc.so.6(localtime_r+0x1e)[0xf747e68e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77dabc0]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77dabc0]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf77dabe9]
/lib/libc.so.6(nanosleep+0x46)[0xf748ed06]
/lib/libc.so.6(usleep+0x35)[0xf74c41a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c63c4]
/lib/libpthread.so.0(+0x6452)[0xf7796452]
/lib/libc.so.6(clone+0x5e)[0xf74cdeee]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Signal 15 received, exiting...
07:01:08 (2794): called boinc_finish(193)
07:01:08 (2793): called boinc_finish(193)
Signal 15 received, exiting...
07:01:04 (2490): called boinc_finish(193)
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7765bc0]
/lib/libc.so.6(getenv+0x9a)[0xf739130a]
/lib/libc.so.6(+0xaa74b)[0xf740b74b]
/lib/libc.so.6(localtime_r+0x1e)[0xf740968e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7765bc0]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5130]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7765bc0]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7765bc0]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7765be9]
/lib/libc.so.6(nanosleep+0x46)[0xf7419d06]
/lib/libc.so.6(usleep+0x35)[0xf744f1a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7379545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (23 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77bcbc0]
/lib/libc.so.6(getenv+0x9a)[0xf73e830a]
/lib/libc.so.6(+0xaa74b)[0xf746274b]
/lib/libc.so.6(localtime_r+0x1e)[0xf746068e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77bcbc0]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf77bcbe9]
/lib/libpthread.so.0(waitpid+0x4b)[0xf7781a0b]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8050017]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d8c0]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77bcbc0]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf77bcbe9]
/lib/libc.so.6(nanosleep+0x46)[0xf7470d06]
/lib/libc.so.6(usleep+0x35)[0xf74a61a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73d0545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
07:01:01 (2708): called boinc_finish(193)
Signal 15 received, exiting...
07:01:01 (2709): called boinc_finish(193)
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (7 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf779bbc0]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x805111d]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73af545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
SIGSEGV: segmentation violation
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (20 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf771dbc0]
/lib/libc.so.6(getenv+0x9a)[0xf734930a]
/lib/libc.so.6(+0xaa74b)[0xf73c374b]
/lib/libc.so.6(localtime_r+0x1e)[0xf73c168e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf771dbc0]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf771dbc0]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf771dbe9]
/lib/libc.so.6(nanosleep+0x46)[0xf73d1d06]
/lib/libc.so.6(usleep+0x35)[0xf74071a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7331545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
13:00:31 (2552): called boinc_finish(193)
Signal 15 received, exiting...
13:00:31 (2553): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7730bc0]
/lib/libc.so.6(getenv+0x9a)[0xf735c30a]
/lib/libc.so.6(+0xaa74b)[0xf73d674b]
/lib/libc.so.6(localtime_r+0x1e)[0xf73d468e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7730bc0]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7730bc0]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7730be9]
/lib/libc.so.6(nanosleep+0x46)[0xf73e4d06]
/lib/libc.so.6(usleep+0x35)[0xf741a1a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c63c4]
/lib/libpthread.so.0(+0x6452)[0xf76ec452]
/lib/libc.so.6(clone+0x5e)[0xf7423eee]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Signal 1 received, exiting...
09:04:59 (2345): called boinc_finish(193)
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77b5bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73e130a]
/lib/libc.so.6(+0xaa74b)[0xf745b74b]
/lib/libc.so.6(localtime_r+0x1e)[0xf745968e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77b5bc0]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77b5bc0]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf77b5be9]
/lib/libc.so.6(nanosleep+0x46)[0xf7469d06]
/lib/libc.so.6(usleep+0x35)[0xf749f1a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c63c4]
/lib/libpthread.so.0(+0x6452)[0xf7771452]
/lib/libc.so.6(clone+0x5e)[0xf74a8eee]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (Stack trace (187 frames): frames):

../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7766bc0]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7766bc0]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x805111d]
/lib/libc.so.6(getenv+0x9a)[0xf739230a]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
/lib/libc.so.6(+0xaa74b)[0xf740c74b]
/lib/libc.so.6(localtime_r+0x1e)[0xf740a68e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7766bc0]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7766bc0]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7766be9]
/lib/libc.so.6(nanosleep+0x46)[0xf741ad06]
/lib/libc.so.6(usleep+0x35)[0xf74501a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c63c4]
/lib/libpthread.so.0(+0x6452)[0xf7722452]
/lib/libc.so.6(clone+0x5e)[0xf7459eee]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
09:51:42 (2628): called boinc_finish(193)
Signal 15 received, exiting...
09:51:42 (2629): called boinc_finish(193)
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2628, selfPID=2629, iMonCtr=1
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (20 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776cbc0]
/lib/libc.so.6(getenv+0x9a)[0xf739830a]
/lib/libc.so.6(+0xaa74b)[0xf741274b]
/lib/libc.so.6(localtime_r+0x1e)[0xf741068e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776cbc0]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776cbc0]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf776cbe9]
/lib/libc.so.6(nanosleep+0x46)[0xf7420d06]
/lib/libc.so.6(usleep+0x35)[0xf74561a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7380545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
07:01:01 (2710): called boinc_finish(193)
Signal 15 received, exiting...
07:01:01 (2711): called boinc_finish(193)
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf774fbc0]
/lib/libc.so.6(getenv+0x9a)[0xf737b30a]
/lib/libc.so.6(+0xaa74b)[0xf73f574b]
/lib/libc.so.6(localtime_r+0x1e)[0xf73f368e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf774fbc0]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf774fbc0]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf774fbe9]
/lib/libc.so.6(nanosleep+0x46)[0xf7403d06]
/lib/libc.so.6(usleep+0x35)[0xf74391a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c63c4]
/lib/libpthread.so.0(+0x6452)[0xf770b452]
/lib/libc.so.6(clone+0x5e)[0xf7442eee]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Signal 15 received, exiting...
10:09:00 (2351): called boinc_finish(193)
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (7 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf774ad20]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x805111d]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf735d545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (20 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7719d20]
/lib/libc.so.6(getenv+0x9a)[0xf734430a]
/lib/libc.so.6(+0xaa74b)[0xf73be74b]
/lib/libc.so.6(localtime_r+0x1e)[0xf73bc68e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7719d20]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7719d20]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7719d49]
/lib/libc.so.6(nanosleep+0x46)[0xf73ccd06]
/lib/libc.so.6(usleep+0x35)[0xf74021a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf732c545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
07:31:01 (2793): called boinc_finish(193)
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7719d20]
/lib/libc.so.6(getenv+0x9a)[0xf734430a]
/lib/libc.so.6(+0xaa74b)[0xf73be74b]
/lib/libc.so.6(localtime_r+0x1e)[0xf73bc68e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7719d20]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7719d20]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7719d49]
/lib/libc.so.6(nanosleep+0x46)[0xf73ccd06]
/lib/libc.so.6(usleep+0x35)[0xf74021a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c63c4]
/lib/libpthread.so.0(+0x6452)[0xf76d4452]
/lib/libc.so.6(clone+0x5e)[0xf740beee]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Signal 15 received, exiting...
21:50:28 (2653): called boinc_finish(193)
21:50:28 (2652): called boinc_finish(193)
Signal 15 received, exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2757, selfPID=2252, iMonCtr=1
Model crash detected, will try to restart...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (18 frames):
Stack trace (../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
7linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7757d20]
 frames):
/lib/libc.so.6(getenv+0x9a)[0xf738230a]
/lib/libc.so.6(+0xaa74b)[0xf73fc74b]
/lib/libc.so.6(localtime_r+0x1e)[0xf73fa68e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7757d20]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7757d20]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7757d20]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7757d49]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x805111d]
/lib/libc.so.6(nanosleep+0x46)[0xf740ad06]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
/lib/libc.so.6(usleep+0x35)[0xf74401a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf736a545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c63c4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
/lib/libpthread.so.0(+0x6452)[0xf7712452]
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (20 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7717d20]
/lib/libc.so.6(getenv+0x9a)[0xf734230a]
/lib/libc.so.6(+0xaa74b)[0xf73bc74b]
/lib/libc.so.6(localtime_r+0x1e)[0xf73ba68e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7717d20]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7717d20]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7717d49]
/lib/libc.so.6(nanosleep+0x46)[0xf73cad06]
/lib/libc.so.6(usleep+0x35)[0xf74001a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf732a545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
10:40:39 (2638): called boinc_finish(193)
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (20 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776dd20]
/lib/libc.so.6(getenv+0x9a)[0xf739830a]
/lib/libc.so.6(+0xaa74b)[0xf741274b]
/lib/libc.so.6(localtime_r+0x1e)[0xf741068e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776dd20]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776dd20]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf776dd49]
/lib/libc.so.6(nanosleep+0x46)[0xf7420d06]
/lib/libc.so.6(usleep+0x35)[0xf74561a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7380545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (23 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d7d20]
/lib/libc.so.6(getenv+0x9a)[0xf740230a]
/lib/libc.so.6(+0xaa74b)[0xf747c74b]
/lib/libc.so.6(localtime_r+0x1e)[0xf747a68e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d7d20]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf77d7d49]
/lib/libpthread.so.0(waitpid+0x4b)[0xf779ba0b]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8050017]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d8c0]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d7d20]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf77d7d49]
/lib/libc.so.6(nanosleep+0x46)[0xf748ad06]
/lib/libc.so.6(usleep+0x35)[0xf74c01a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73ea545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Signal 15 received, exiting...
Signal 1 received, exiting...
07:46:07 (2772): called boinc_finish(193)
Signal 15 received, exiting...
07:46:07 (2771): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (23 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d0d20]
/lib/libc.so.6(getenv+0x9a)[0xf73fb30a]
/lib/libc.so.6(+0xaa74b)[0xf747574b]
/lib/libc.so.6(localtime_r+0x1e)[0xf747368e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d0d20]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf77d0d49]
/lib/libpthread.so.0(waitpid+0x4b)[0xf7794a0b]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8050017]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d8c0]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d0d20]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf77d0d49]
/lib/libc.so.6(nanosleep+0x46)[0xf7483d06]
/lib/libc.so.6(usleep+0x35)[0xf74b91a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73e3545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
16:22:20 (2649): called boinc_finish(193)
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (20 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf779cd20]
/lib/libc.so.6(getenv+0x9a)[0xf73c730a]
/lib/libc.so.6(+0xaa74b)[0xf744174b]
/lib/libc.so.6(localtime_r+0x1e)[0xf743f68e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf779cd20]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf779cd20]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf779cd49]
/lib/libc.so.6(nanosleep+0x46)[0xf744fd06]
/lib/libc.so.6(usleep+0x35)[0xf74851a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73af545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
07:46:11 (2748): called boinc_finish(193)
07:46:11 (2749): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2652, selfPID=2211, iMonCtr=1
Model crash detected, will try to restart...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7752d20]
/lib/libc.so.6(getenv+0x9a)[0xf737d30a]
/lib/libc.so.6(+0xaa74b)[0xf73f774b]
/lib/libc.so.6(localtime_r+0x1e)[0xf73f568e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7752d20]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7752d20]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7752d49]
/lib/libc.so.6(nanosleep+0x46)[0xf7405d06]
/lib/libc.so.6(usleep+0x35)[0xf743b1a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c63c4]
/lib/libpthread.so.0(+0x6462)[0xf770d462]
/lib/libc.so.6(clone+0x5e)[0xf7444eee]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2290, selfPID=2191, iMonCtr=1
Model crash detected, will try to restart...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf772ed20]
/lib/libc.so.6(getenv+0x9a)[0xf735930a]
/lib/libc.so.6(+0xaa74b)[0xf73d374b]
/lib/libc.so.6(localtime_r+0x1e)[0xf73d168e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf772ed20]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf772ed20]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf772ed49]
/lib/libc.so.6(nanosleep+0x46)[0xf73e1d06]
/lib/libc.so.6(usleep+0x35)[0xf74171a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c63c4]
/lib/libpthread.so.0(+0x6462)[0xf76e9462]
/lib/libc.so.6(clone+0x5e)[0xf7420eee]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
14:57:04 (2621): called boinc_finish(193)
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf771bd20]
/lib/libc.so.6(getenv+0x9a)[0xf734630a]
/lib/libc.so.6(+0xaa74b)[0xf73c074b]
/lib/libc.so.6(localtime_r+0x1e)[0xf73be68e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf771bd20]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf771bd20]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf771bd49]
/lib/libc.so.6(nanosleep+0x46)[0xf73ced06]
/lib/libc.so.6(usleep+0x35)[0xf74041a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c63c4]
/lib/libpthread.so.0(+0x6462)[0xf76d6462]
/lib/libc.so.6(clone+0x5e)[0xf740deee]

Exiting...
Signal 15 received, exiting...
Signal 1 received, exiting...
Signal 15 received, exiting...
07:46:08 (2764): called boinc_finish(193)
07:46:08 (2763): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
18:58:22 (2667): called boinc_finish(193)
Signal 1 received, exiting...
18:58:22 (2667): called boinc_finish(193)
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (20 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7753d20]
/lib/libc.so.6(getenv+0x9a)[0xf737e30a]
/lib/libc.so.6(+0xaa74b)[0xf73f874b]
/lib/libc.so.6(localtime_r+0x1e)[0xf73f668e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7753d20]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7753d20]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7753d49]
/lib/libc.so.6(nanosleep+0x46)[0xf7406d06]
/lib/libc.so.6(usleep+0x35)[0xf743c1a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7366545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (23 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7722d20]
/lib/libc.so.6(getenv+0x9a)[0xf734d30a]
/lib/libc.so.6(+0xaa74b)[0xf73c774b]
/lib/libc.so.6(localtime_r+0x1e)[0xf73c568e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7722d20]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7722d49]
/lib/libpthread.so.0(waitpid+0x4b)[0xf76e6a1b]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8050017]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d8c0]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7722d20]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7722d49]
/lib/libc.so.6(nanosleep+0x46)[0xf73d5d06]
/lib/libc.so.6(usleep+0x35)[0xf740b1a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7335545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf775fd20]
/lib/libc.so.6(getenv+0x9a)[0xf738a30a]
/lib/libc.so.6(+0xaa74b)[0xf740474b]
/lib/libc.so.6(localtime_r+0x1e)[0xf740268e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf775fd20]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5130]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf775fd20]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf775fd20]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf775fd49]
/lib/libc.so.6(nanosleep+0x46)[0xf7412d06]
/lib/libc.so.6(usleep+0x35)[0xf74481a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7372545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Signal 15 received, exiting...
07:46:06 (2689): called boinc_finish(193)
07:46:03 (2690): called boinc_finish(193)
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (20 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7781d20]
/lib/libc.so.6(getenv+0x9a)[0xf73ac30a]
/lib/libc.so.6(+0xaa74b)[0xf742674b]
/lib/libc.so.6(localtime_r+0x1e)[0xf742468e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7781d20]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7781d20]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7781d49]
/lib/libc.so.6(nanosleep+0x46)[0xf7434d06]
/lib/libc.so.6(usleep+0x35)[0xf746a1a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7394545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
19:18:39 (2687): called boinc_finish(193)
Signal 15 received, exiting...
19:18:39 (2688): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (20 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7722d20]
/lib/libc.so.6(getenv+0x9a)[0xf734d30a]
/lib/libc.so.6(+0xaa74b)[0xf73c774b]
/lib/libc.so.6(localtime_r+0x1e)[0xf73c568e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7722d20]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7722d20]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7722d49]
/lib/libc.so.6(nanosleep+0x46)[0xf73d5d06]
/lib/libc.so.6(usleep+0x35)[0xf740b1a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7335545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Signal 15 received, exiting...
19:40:41 (2372): called boinc_finish(193)
Signal 1 received, exiting...
19:40:41 (2371): called boinc_finish(193)
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (20 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7781d20]
/lib/libc.so.6(getenv+0x9a)[0xf73ac30a]
/lib/libc.so.6(+0xaa74b)[0xf742674b]
/lib/libc.so.6(localtime_r+0x1e)[0xf742468e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7781d20]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x804d88c]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7781d20]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7781d49]
/lib/libc.so.6(nanosleep+0x46)[0xf7434d06]
/lib/libc.so.6(usleep+0x35)[0xf746a1a5]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80dda50]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8051114]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7394545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Signal 15 received, exiting...
18:28:59 (2391): called boinc_finish(193)
18:28:59 (2390): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
07:46:02 (2701): called boinc_finish(193)
Signal 15 received, exiting...
07:46:02 (2702): called boinc_finish(193)
Signal 1 received, exiting...
07:46:02 (2701): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
10:28:57 (2410): called boinc_finish(193)
Signal 15 received, exiting...
10:28:57 (2411): called boinc_finish(193)
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (Stack trace (718 frames): frames):

../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7788d20]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7788d20]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x805111d]
/lib/libc.so.6(getenv+0x9a)[0xf73b330a]
/lib/libc.so.6(+0xaa74b)[0xf742d74b]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80523d4]
/lib/libc.so.6(localtime_r+0x1e)[0xf742b68e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf739b545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]

Exiting...
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7788d20]
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...

SETPOS: Seek Failed: Invalid argument
SETPOS: Unit 61 to Word Address -198 Failed with Error Code -1

Model crashed: SETPOS: Unit 61 to Word Address -198 Failed with Error Code -1
Leaving CPDN_Main::Monitor...
SIGSEGV: segmentation violation
Stack trace (13 frames):
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c9f4f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776cd20]
/lib/libc.so.6(getenv+0x9a)[0xf739730a]
/lib/libc.so.6(+0xaa74b)[0xf741174b]
/lib/libc.so.6(localtime_r+0x1e)[0xf740f68e]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c4d96]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c528c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x80c5391]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8050463]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x805242c]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu[0x8052674]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf737f545]
../../projects/climateprediction.net/wah2_8.12_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d4d1]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
17 Jun 2016 10:43:17 1325379 19683148 wah2_pnw25_z78s_199712_24_406_010587281_0 196,139 289,871 1.4779
16 Jun 2016 21:29:20 1325379 19683148 wah2_pnw25_z78s_199712_24_406_010587281_0 184,619 272,719 1.4772
16 Jun 2016 04:42:14 1325379 19683148 wah2_pnw25_z78s_199712_24_406_010587281_0 173,099 255,671 1.4770
15 Jun 2016 23:39:04 1325379 19683148 wah2_pnw25_z78s_199712_24_406_010587281_0 161,579 238,621 1.4768
15 Jun 2016 06:35:39 1325379 19683148 wah2_pnw25_z78s_199712_24_406_010587281_0 150,059 221,575 1.4766
14 Jun 2016 06:34:05 1325379 19683148 wah2_pnw25_z78s_199712_24_406_010587281_0 138,539 204,562 1.4766
13 Jun 2016 20:42:39 1325379 19683148 wah2_pnw25_z78s_199712_24_406_010587281_0 127,019 187,397 1.4753
10 Jun 2016 20:54:15 1325379 19683148 wah2_pnw25_z78s_199712_24_406_010587281_0 115,499 170,435 1.4756
08 Jun 2016 20:22:20 1325379 19683148 wah2_pnw25_z78s_199712_24_406_010587281_0 103,979 153,615 1.4774
06 Jun 2016 20:33:02 1325379 19683148 wah2_pnw25_z78s_199712_24_406_010587281_0 92,459 136,863 1.4803
04 Jun 2016 11:33:46 1325379 19683148 wah2_pnw25_z78s_199712_24_406_010587281_0 80,939 120,108 1.4839
04 Jun 2016 06:08:50 1325379 19683148 wah2_pnw25_z78s_199712_24_406_010587281_0 69,419 103,176 1.4863
04 Jun 2016 01:25:27 1325379 19683148 wah2_pnw25_z78s_199712_24_406_010587281_0 57,899 86,148 1.4879
01 Jun 2016 23:54:29 1325379 19683148 wah2_pnw25_z78s_199712_24_406_010587281_0 46,379 69,037 1.4885
31 May 2016 02:29:59 1325379 19683148 wah2_pnw25_z78s_199712_24_406_010587281_0 34,859 51,754 1.4847
28 May 2016 20:36:31 1325379 19683148 wah2_pnw25_z78s_199712_24_406_010587281_0 23,339 34,642 1.4843
25 May 2016 20:05:09 1325379 19683148 wah2_pnw25_z78s_199712_24_406_010587281_0 11,819 17,508 1.4813


©2024 climateprediction.net