climateprediction.net home page
Task 19092820

Task 19092820

Name hadam3prm3pm2t_eu_nfrw_2002_1_009603521_1
Workunit 9677855
Created 20 Nov 2015, 18:58:32 UTC
Sent 20 Nov 2015, 20:19:37 UTC
Report deadline 2 Nov 2016, 1:39:37 UTC
Received 1 Mar 2016, 20:25:27 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1325379
Run time 8 days 3 hours 47 min 8 sec
CPU time 7 days 18 hours 24 min 54 sec
Validate state Workunit error - check skipped
Credit 9,559.58
Device peak FLOPS 3.79 GFLOPS
Application version UK Met Office HadAM3P and HadRM3P model with MOSES II and TRIFFID Europe v7.01
i686-pc-linux-gnu
Stderr 
<core_client_version>7.2.42</core_client_version>
<![CDATA[
<stderr_txt>
+0x46)[0xf7490e66]
/lib/libc.so.6(usleep+0x35)[0xf74c6515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/libpthread.so.0(+0x6452)[0xf7797452]
/lib/libc.so.6(clone+0x5e)[0xf74d025e]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77c7bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73f52ca]
/lib/libc.so.6(+0xaaaeb)[0xf746faeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf746da2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77c7bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77c7bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77c7bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf747de66]
/lib/libc.so.6(usleep+0x35)[0xf74b3515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73dd545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7795bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73c32ca]
/lib/libc.so.6(+0xaaaeb)[0xf743daeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf743ba2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7795bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7795bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf775ba0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7795bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7795bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf744be66]
/lib/libc.so.6(usleep+0x35)[0xf7481515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73ab545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
09:41:48 (3870): called boinc_finish
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7717bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73452ca]
/lib/libc.so.6(+0xaaaeb)[0xf73bfaeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf73bda2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7717bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7717bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7717bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf73cde66]
/lib/libc.so.6(usleep+0x35)[0xf7403515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf732d545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77ccbc0]
/lib/libc.so.6(getenv+0x9a)[0xf73fa2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7474aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7472a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77ccbc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77ccbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77ccbf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7482e66]
/lib/libc.so.6(usleep+0x35)[0xf74b8515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73e2545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
07:01:02 (2752): called boinc_finish
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7771bc0]
/lib/libc.so.6(getenv+0x9a)[0xf739f2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7419aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7417a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7771bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7771bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7771bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7427e66]
/lib/libc.so.6(usleep+0x35)[0xf745d515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7387545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76f7bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73252ca]
/lib/libc.so.6(+0xaaaeb)[0xf739faeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf739da2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76f7bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf76f7bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf76bda0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76f7bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf76f7bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf73ade66]
/lib/libc.so.6(usleep+0x35)[0xf73e3515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf730d545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7723bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73512ca]
/lib/libc.so.6(+0xaaaeb)[0xf73cbaeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf73c9a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7723bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7723bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf76e9a0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804feba]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7723bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7723bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf73d9e66]
/lib/libc.so.6(usleep+0x35)[0xf740f515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7339545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
CPDN Monitor - Quit request from BOINC...
Signal 15 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d9bc0]
/lib/libc.so.6(getenv+0x9a)[0xf74072ca]
/lib/libc.so.6(+0xaaaeb)[0xf7481aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf747fa2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d9bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77d9bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf779fa0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d9bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77d9bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf748fe66]
/lib/libc.so.6(usleep+0x35)[0xf74c5515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73ef545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Signal 15 received, exiting...
Signal 1 received, exiting...
07:01:02 (2589): called boinc_finish
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7796bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73c42ca]
/lib/libc.so.6(+0xaaaeb)[0xf743eaeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf743ca2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7796bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7796bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf775ca0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7796bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7796bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf744ce66]
/lib/libc.so.6(usleep+0x35)[0xf7482515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73ac545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77c3bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73f12ca]
/lib/libc.so.6(+0xaaaeb)[0xf746baeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7469a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77c3bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77c3bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77c3bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7479e66]
/lib/libc.so.6(usleep+0x35)[0xf74af515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73d9545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf772bbc0]
/lib/libc.so.6(getenv+0x9a)[0xf73592ca]
/lib/libc.so.6(+0xaaaeb)[0xf73d3aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf73d1a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf772bbc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c46a0]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf772bbc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf772bbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf772bbf0]
/lib/libc.so.6(nanosleep+0x46)[0xf73e1e66]
/lib/libc.so.6(usleep+0x35)[0xf7417515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7341545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf779ebc0]
/lib/libc.so.6(getenv+0x9a)[0xf73cc2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7446aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7444a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf779ebc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf779ebc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf779ebf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7454e66]
/lib/libc.so.6(usleep+0x35)[0xf748a515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73b4545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf771ebc0]
/lib/libc.so.6(getenv+0x9a)[0xf734c2ca]
/lib/libc.so.6(+0xaaaeb)[0xf73c6aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf73c4a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf771ebc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf771ebc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf771ebf0]
/lib/libc.so.6(nanosleep+0x46)[0xf73d4e66]
/lib/libc.so.6(usleep+0x35)[0xf740a515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7334545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77c4bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73f22ca]
/lib/libc.so.6(+0xaaaeb)[0xf746caeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf746aa2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77c4bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77c4bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77c4bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf747ae66]
/lib/libc.so.6(usleep+0x35)[0xf74b0515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/libpthread.so.0(+0x6452)[0xf7781452]
/lib/libc.so.6(clone+0x5e)[0xf74ba25e]

Exiting...
CPDN Monitor - Quit request from BOINC...
Signal 15 received, exiting...
Signal 15 received, exiting...
07:01:02 (3057): called boinc_finish
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76dcbc0]
/lib/libc.so.6(getenv+0x9a)[0xf730a2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7384aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7382a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76dcbc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c46a0]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76dcbc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76dcbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf76dcbf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7392e66]
/lib/libc.so.6(usleep+0x35)[0xf73c8515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf72f2545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7761bc0]
/lib/libc.so.6(getenv+0x9a)[0xf738f2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7409aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7407a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7761bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c46a0]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7761bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7761bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7761bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7417e66]
/lib/libc.so.6(usleep+0x35)[0xf744d515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7377545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7760bc0]
/lib/libc.so.6(getenv+0x9a)[0xf738e2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7408aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7406a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7760bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7760bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf7726a0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7760bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7760bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7416e66]
/lib/libc.so.6(usleep+0x35)[0xf744c515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7376545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
12:55:47 (2096): called boinc_finish
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf773ebc0]
/lib/libc.so.6(getenv+0x9a)[0xf736c2ca]
/lib/libc.so.6(+0xaaaeb)[0xf73e6aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf73e4a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf773ebc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf773ebc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf773ebf0]
/lib/libc.so.6(nanosleep+0x46)[0xf73f4e66]
/lib/libc.so.6(usleep+0x35)[0xf742a515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7354545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2354, selfPID=1892, iMonCtr=1
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776dbc0]
Stack trace (9 frames):
/lib/libc.so.6(getenv+0x9a)[0xf739b2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7415aeb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
/lib/libc.so.6(localtime_r+0x1e)[0xf7413a2e]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776dbc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x3b0)[0x804d524]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80508af]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776dbc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776dbc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf776dbf0]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7383545]
/lib/libc.so.6(nanosleep+0x46)[0xf7423e66]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
CPDN Monitor - Quit request from BOINC...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7781bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73af2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7429aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7427a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7781bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7781bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7781bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7437e66]
/lib/libc.so.6(usleep+0x35)[0xf746d515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7397545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
07:01:03 (2666): called boinc_finish
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7741bc0]
/lib/libc.so.6(getenv+0x9a)[0xf736f2ca]
/lib/libc.so.6(+0xaaaeb)[0xf73e9aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf73e7a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7741bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c46a0]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7741bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7741bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7741bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf73f7e66]
/lib/libc.so.6(usleep+0x35)[0xf742d515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7357545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2551, selfPID=2129, iMonCtr=1
Model crash detected, will try to restart...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77bebc0]
/lib/libc.so.6(getenv+0x9a)[0xf73ec2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7466aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7464a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77bebc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77bebc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77bebf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7474e66]
/lib/libc.so.6(usleep+0x35)[0xf74aa515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/libpthread.so.0(+0x6452)[0xf777b452]
/lib/libc.so.6(clone+0x5e)[0xf74b425e]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
14:46:59 (2520): called boinc_finish
14:46:59 (2519): called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77c3bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73f12ca]
/lib/libc.so.6(+0xaaaeb)[0xf746baeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7469a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77c3bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c46a0]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77c3bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77c3bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77c3bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7479e66]
/lib/libc.so.6(usleep+0x35)[0xf74af515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73d9545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7764bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73922ca]
/lib/libc.so.6(+0xaaaeb)[0xf740caeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf740aa2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7764bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7764bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf772aa0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804feba]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7764bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7764bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf741ae66]
/lib/libc.so.6(usleep+0x35)[0xf7450515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf737a545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7702bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73302ca]
/lib/libc.so.6(+0xaaaeb)[0xf73aaaeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf73a8a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7702bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7702bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf76c8a0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7702bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7702bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf73b8e66]
/lib/libc.so.6(usleep+0x35)[0xf73ee515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7318545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
07:01:04 (2593): called boinc_finish
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76f1bc0]
/lib/libc.so.6(getenv+0x9a)[0xf731f2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7399aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7397a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76f1bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76f1bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf76f1bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf73a7e66]
/lib/libc.so.6(usleep+0x35)[0xf73dd515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/libpthread.so.0(+0x6452)[0xf76ae452]
/lib/libc.so.6(clone+0x5e)[0xf73e725e]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d5bc0]
/lib/libc.so.6(getenv+0x9a)[0xf74032ca]
/lib/libc.so.6(+0xaaaeb)[0xf747daeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf747ba2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d5bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d5bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77d5bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf748be66]
/lib/libc.so.6(usleep+0x35)[0xf74c1515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73eb545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77c1bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73ef2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7469aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7467a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77c1bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77c1bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77c1bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7477e66]
/lib/libc.so.6(usleep+0x35)[0xf74ad515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73d7545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
CPDN Monitor - Quit request from BOINC...
Signal 15 received, exiting...
11:40:33 (9094): called boinc_finish
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e8bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73152ca]
/lib/libc.so.6(+0xaaaeb)[0xf738faeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf738da2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e8bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e8bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf76e8bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf739de66]
/lib/libc.so.6(usleep+0x35)[0xf73d3515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf72fd545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776dbc0]
/lib/libc.so.6(getenv+0x9a)[0xf739a2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7414aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7412a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776dbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf776dbf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf7732a0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776dbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf776dbf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7422e66]
/lib/libc.so.6(usleep+0x35)[0xf7458515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7382545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7756bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73832ca]
/lib/libc.so.6(+0xaaaeb)[0xf73fdaeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf73fba2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7756bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7756bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf771ba0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7756bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7756bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf740be66]
/lib/libc.so.6(usleep+0x35)[0xf7441515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf736b545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7768bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73952ca]
/lib/libc.so.6(+0xaaaeb)[0xf740faeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf740da2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7768bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7768bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7768bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf741de66]
/lib/libc.so.6(usleep+0x35)[0xf7453515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf737d545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7770bc0]
/lib/libc.so.6(getenv+0x9a)[0xf739d2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7417aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7415a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7770bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7770bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7770bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7425e66]
/lib/libc.so.6(usleep+0x35)[0xf745b515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/libpthread.so.0(+0x6452)[0xf772c452]
/lib/libc.so.6(clone+0x5e)[0xf746525e]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Signal 15 received, exiting...
Signal 1 received, exiting...
09:12:51 (2635): called boinc_finish
09:12:51 (2634): called boinc_finish
CPDN Monitor - Quit request from BOINC...
Signal 15 received, exiting...
Signal 15 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7713bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73402ca]
/lib/libc.so.6(+0xaaaeb)[0xf73baaeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf73b8a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7713bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c46a0]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7713bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7713bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf73c8e66]
/lib/libc.so.6(usleep+0x35)[0xf73fe515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7328545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
07:01:02 (2551): called boinc_finish
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (7 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7762bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f7d]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7377545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
CPDN Monitor - Quit request from BOINC...
Signal 15 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf775bbc0]
/lib/libc.so.6(getenv+0x9a)[0xf73882ca]
/lib/libc.so.6(+0xaaaeb)[0xf7402aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7400a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf775bbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf775bbf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf7720a0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf775bbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf775bbf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7410e66]
/lib/libc.so.6(usleep+0x35)[0xf7446515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7370545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7718bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73452ca]
/lib/libc.so.6(+0xaaaeb)[0xf73bfaeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf73bda2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7718bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7718bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7718bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf73cde66]
/lib/libc.so.6(usleep+0x35)[0xf7403515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/libpthread.so.0(+0x6452)[0xf76d4452]
/lib/libc.so.6(clone+0x5e)[0xf740d25e]

Exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf775dbc0]
/lib/libc.so.6(getenv+0x9a)[0xf738a2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7404aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7402a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf775dbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf775dbf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf7722a0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf775dbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf775dbf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7412e66]
/lib/libc.so.6(usleep+0x35)[0xf7448515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7372545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (24 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776bbc0]
/lib/libc.so.6(getenv+0x9a)[0xf73982ca]
/lib/libc.so.6(+0xaaaeb)[0xf7412aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7410a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776bbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf776bbf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf7730a0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804feba]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776bbc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c46a0]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776bbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf776bbf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7420e66]
/lib/libc.so.6(usleep+0x35)[0xf7456515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7380545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf774cbc0]
/lib/libc.so.6(getenv+0x9a)[0xf73792ca]
/lib/libc.so.6(+0xaaaeb)[0xf73f3aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf73f1a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf774cbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf774cbf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf7711a0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf774cbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf774cbf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7401e66]
/lib/libc.so.6(usleep+0x35)[0xf7437515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7361545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
CPDN Monitor - Quit request from BOINC...
Signal 15 received, exiting...
14:59:13 (20371): called boinc_finish
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76fdbc0]
/lib/libc.so.6(getenv+0x9a)[0xf732a2ca]
/lib/libc.so.6(+0xaaaeb)[0xf73a4aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf73a2a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76fdbc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76fdbc0]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf76fdbe9]
/lib/libc.so.6(nanosleep+0x46)[0xf73b2e66]
/lib/libc.so.6(usleep+0x35)[0xf73e8515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/libpthread.so.0(+0x6452)[0xf76b9452]
/lib/libc.so.6(clone+0x5e)[0xf73f225e]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7722bc0]
/lib/libc.so.6(getenv+0x9a)[0xf734f2ca]
/lib/libc.so.6(+0xaaaeb)[0xf73c9aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf73c7a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7722bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7722bc0]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7722be9]
/lib/libc.so.6(nanosleep+0x46)[0xf73d7e66]
/lib/libc.so.6(usleep+0x35)[0xf740d515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7337545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
CPDN Monitor - Quit request from BOINC...
Signal 15 received, exiting...
13:17:08 (22031): called boinc_finish
Signal 15 received, exiting...
13:17:08 (22030): called boinc_finish
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=22030, selfPID=22030, iMonCtr=1
Leaving CPDN_Main::Monitor...
16:24:43 (2061): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
01 Mar 2016 03:18:32 1325379 19092820 hadam3prm3pm2t_eu_nfrw_2002_1_009603521_1 138,539 672,301 4.8528
23 Feb 2016 22:36:27 1325379 19092820 hadam3prm3pm2t_eu_nfrw_2002_1_009603521_1 127,019 619,485 4.8771
18 Feb 2016 04:09:13 1325379 19092820 hadam3prm3pm2t_eu_nfrw_2002_1_009603521_1 115,499 565,529 4.8964
07 Feb 2016 21:03:02 1325379 19092820 hadam3prm3pm2t_eu_nfrw_2002_1_009603521_1 103,979 513,024 4.9339
27 Jan 2016 21:03:19 1325379 19092820 hadam3prm3pm2t_eu_nfrw_2002_1_009603521_1 92,459 458,480 4.9587
15 Jan 2016 20:28:10 1325379 19092820 hadam3prm3pm2t_eu_nfrw_2002_1_009603521_1 80,939 405,504 5.0100
11 Jan 2016 03:25:38 1325379 19092820 hadam3prm3pm2t_eu_nfrw_2002_1_009603521_1 69,419 349,409 5.0333
07 Jan 2016 01:56:18 1325379 19092820 hadam3prm3pm2t_eu_nfrw_2002_1_009603521_1 57,899 291,695 5.0380
30 Dec 2015 20:33:36 1325379 19092820 hadam3prm3pm2t_eu_nfrw_2002_1_009603521_1 46,379 233,812 5.0413
16 Dec 2015 07:28:26 1325379 19092820 hadam3prm3pm2t_eu_nfrw_2002_1_009603521_1 34,859 174,258 4.9989
07 Dec 2015 05:52:42 1325379 19092820 hadam3prm3pm2t_eu_nfrw_2002_1_009603521_1 23,339 116,303 4.9832
29 Nov 2015 11:08:48 1325379 19092820 hadam3prm3pm2t_eu_nfrw_2002_1_009603521_1 11,819 58,374 4.9390


©2024 cpdn.org