climateprediction.net home page
Task 19092846

Task 19092846

Name hadam3prm3pm2t_eu_iq4e_2002_1_009823121_1
Workunit 9879047
Created 20 Nov 2015, 19:58:02 UTC
Sent 20 Nov 2015, 20:19:37 UTC
Report deadline 2 Nov 2016, 1:39:37 UTC
Received 29 Feb 2016, 21:53:02 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1325379
Run time 8 days 4 hours 23 min 29 sec
CPU time 7 days 18 hours 0 min 2 sec
Validate state Workunit error - check skipped
Credit 9,559.58
Device peak FLOPS 3.79 GFLOPS
Application version UK Met Office HadAM3P and HadRM3P model with MOSES II and TRIFFID Europe v7.01
i686-pc-linux-gnu
Stderr 
<core_client_version>7.2.42</core_client_version>
<![CDATA[
<stderr_txt>
aeb)[0xf7388aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7386a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e0bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e0bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf76e0bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7396e66]
/lib/libc.so.6(usleep+0x35)[0xf73cc515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf72f6545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf771cbc0]
/lib/libc.so.6(getenv+0x9a)[0xf734a2ca]
/lib/libc.so.6(+0xaaaeb)[0xf73c4aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf73c2a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf771cbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf771cbf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf76e2a0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf771cbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf771cbf0]
/lib/libc.so.6(nanosleep+0x46)[0xf73d2e66]
/lib/libc.so.6(usleep+0x35)[0xf7408515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7332545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
09:41:49 (2164): called boinc_finish
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (17 frames):
Stack trace (../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
7linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e2bc0]
 frames):
/lib/libc.so.6(getenv+0x9a)[0xf73102ca]
/lib/libc.so.6(+0xaaaeb)[0xf738aaeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7388a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e2bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e2bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf76e2bf0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
/lib/libc.so.6(nanosleep+0x46)[0xf7398e66]
/lib/libc.so.6(usleep+0x35)[0xf73ce515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e2bc0]
/lib/libpthread.so.0(+0x6452)[0xf769f452]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f7d]
/lib/libc.so.6(clone+0x5e)[0xf73d825e]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
19:17:05 (2500): called boinc_finish
19:17:05 (2499): called boinc_finish
Signal 15 received, exiting...
07:01:02 (2763): called boinc_finish
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7786bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73b42ca]
/lib/libc.so.6(+0xaaaeb)[0xf742eaeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf742ca2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7786bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7786bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7786bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf743ce66]
/lib/libc.so.6(usleep+0x35)[0xf7472515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/libpthread.so.0(+0x6452)[0xf7743452]
/lib/libc.so.6(clone+0x5e)[0xf747c25e]

Exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7788bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73b62ca]
/lib/libc.so.6(+0xaaaeb)[0xf7430aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf742ea2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7788bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7788bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf774ea0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7788bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7788bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf743ee66]
/lib/libc.so.6(usleep+0x35)[0xf7474515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf739e545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77b0bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73de2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7458aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7456a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77b0bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77b0bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf7776a0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804feba]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77b0bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77b0bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7466e66]
/lib/libc.so.6(usleep+0x35)[0xf749c515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73c6545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7792bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73c02ca]
/lib/libc.so.6(+0xaaaeb)[0xf743aaeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7438a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7792bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7792bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf7758a0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7792bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7792bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7448e66]
/lib/libc.so.6(usleep+0x35)[0xf747e515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73a8545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776cbc0]
/lib/libc.so.6(getenv+0x9a)[0xf739a2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7414aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7412a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776cbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf776cbf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf7732a0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776cbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf776cbf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7422e66]
/lib/libc.so.6(usleep+0x35)[0xf7458515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7382545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Signal 1 received, exiting...
07:01:02 (2591): called boinc_finish
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77b7bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73e52ca]
/lib/libc.so.6(+0xaaaeb)[0xf745faeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf745da2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77b7bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77b7bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf777da0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77b7bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77b7bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf746de66]
/lib/libc.so.6(usleep+0x35)[0xf74a3515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73cd545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7763bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73912ca]
/lib/libc.so.6(+0xaaaeb)[0xf740baeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7409a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7763bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7763bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf7729a0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7763bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7763bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7419e66]
/lib/libc.so.6(usleep+0x35)[0xf744f515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7379545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2486, selfPID=2010, iMonCtr=1
Model crash detected, will try to restart...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d3bc0]
/lib/libc.so.6(getenv+0x9a)[0xf74012ca]
/lib/libc.so.6(+0xaaaeb)[0xf747baeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7479a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d3bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d3bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77d3bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7489e66]
/lib/libc.so.6(usleep+0x35)[0xf74bf515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/libpthread.so.0(+0x6452)[0xf7790452]
/lib/libc.so.6(clone+0x5e)[0xf74c925e]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf778cbc0]
/lib/libc.so.6(getenv+0x9a)[0xf73ba2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7434aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7432a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf778cbc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf778cbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf778cbf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7442e66]
/lib/libc.so.6(usleep+0x35)[0xf7478515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73a2545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77adbc0]
/lib/libc.so.6(getenv+0x9a)[0xf73db2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7455aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7453a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77adbc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77adbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77adbf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7463e66]
/lib/libc.so.6(usleep+0x35)[0xf7499515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73c3545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2632, selfPID=2155, iMonCtr=1
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (Stack trace (179 frames): frames):

../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e6bc0]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e6bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73142ca]
/lib/libc.so.6(+0xaaaeb)[0xf738eaeb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x3b0)[0x804d524]
/lib/libc.so.6(localtime_r+0x1e)[0xf738ca2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80508af]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e6bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf72fc545]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e6bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf76e6bf0]

Exiting...
Signal 15 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7771bc0]
/lib/libc.so.6(getenv+0x9a)[0xf739f2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7419aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7417a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7771bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7771bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf7737a0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7771bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7771bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7427e66]
/lib/libc.so.6(usleep+0x35)[0xf745d515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7387545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2238, selfPID=2013, iMonCtr=1
Model crash detected, will try to restart...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (Stack trace (717 frames): frames):

../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7718bc0]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7718bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f7d]
/lib/libc.so.6(getenv+0x9a)[0xf73462ca]
/lib/libc.so.6(+0xaaaeb)[0xf73c0aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf73bea2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7718bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7718bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7718bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf73cee66]
/lib/libc.so.6(usleep+0x35)[0xf7404515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/libpthread.so.0(+0x6452)[0xf76d5452]
/lib/libc.so.6(clone+0x5e)[0xf740e25e]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7737bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73652ca]
/lib/libc.so.6(+0xaaaeb)[0xf73dfaeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf73dda2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7737bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7737bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7737bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf73ede66]
/lib/libc.so.6(usleep+0x35)[0xf7423515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf734d545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7747bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73752ca]
/lib/libc.so.6(+0xaaaeb)[0xf73efaeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf73eda2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7747bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7747bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf770da0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7747bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7747bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf73fde66]
/lib/libc.so.6(usleep+0x35)[0xf7433515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf735d545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77a6bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73d42ca]
/lib/libc.so.6(+0xaaaeb)[0xf744eaeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf744ca2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77a6bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77a6bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77a6bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf745ce66]
/lib/libc.so.6(usleep+0x35)[0xf7492515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73bc545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2373, selfPID=1891, iMonCtr=1
SIGSEGV: segmentation violation
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (9 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76edbc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x3b0)[0x804d524]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80508af]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7303545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
19:32:43 (2484): called boinc_finish
19:32:43 (2483): called boinc_finish
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2483, selfPID=2483, iMonCtr=1
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (17 frames):
Stack trace (../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
7linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77b8bc0]
 frames):
/lib/libc.so.6(getenv+0x9a)[0xf73e62ca]
/lib/libc.so.6(+0xaaaeb)[0xf7460aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf745ea2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77b8bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f7d]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77b8bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77b8bc0]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73ce545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received,Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77a5bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73d32ca]
/lib/libc.so.6(+0xaaaeb)[0xf744daeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf744ba2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77a5bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77a5bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77a5bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf745be66]
/lib/libc.so.6(usleep+0x35)[0xf7491515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73bb545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7784bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73b22ca]
/lib/libc.so.6(+0xaaaeb)[0xf742caeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf742aa2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7784bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7784bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7784bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf743ae66]
/lib/libc.so.6(usleep+0x35)[0xf7470515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf739a545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e5bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73132ca]
/lib/libc.so.6(+0xaaaeb)[0xf738daeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf738ba2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e5bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf76e5bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf76aba0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e5bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf76e5bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf739be66]
/lib/libc.so.6(usleep+0x35)[0xf73d1515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf72fb545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7799bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73c72ca]
/lib/libc.so.6(+0xaaaeb)[0xf7441aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf743fa2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7799bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7799bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf775fa0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7799bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7799bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf744fe66]
/lib/libc.so.6(usleep+0x35)[0xf7485515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73af545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf775ebc0]
/lib/libc.so.6(getenv+0x9a)[0xf738c2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7406aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7404a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf775ebc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf775ebf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf7724a0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf775ebc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf775ebf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7414e66]
/lib/libc.so.6(usleep+0x35)[0xf744a515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7374545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
07:01:04 (2587): called boinc_finish
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76fcbc0]
/lib/libc.so.6(getenv+0x9a)[0xf732a2ca]
Stack trace (7 frames):
/lib/libc.so.6(+0xaaaeb)[0xf73a4aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf73a2a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76fcbc0]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76fcbc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f7d]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76fcbc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf76fcbf0]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7312545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e6bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73142ca]
/lib/libc.so.6(+0xaaaeb)[0xf738eaeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf738ca2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e6bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e6bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf76e6bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf739ce66]
/lib/libc.so.6(usleep+0x35)[0xf73d2515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf72fc545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77cbbc0]
/lib/libc.so.6(getenv+0x9a)[0xf73f92ca]
/lib/libc.so.6(+0xaaaeb)[0xf7473aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7471a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77cbbc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77cbbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77cbbf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7481e66]
/lib/libc.so.6(usleep+0x35)[0xf74b7515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73e1545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7770bc0]
/lib/libc.so.6(getenv+0x9a)[0xf739e2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7418aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7416a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7770bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7770bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf7736a0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7770bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7770bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7426e66]
/lib/libc.so.6(usleep+0x35)[0xf745c515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7386545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7730bc0]
/lib/libc.so.6(getenv+0x9a)[0xf735d2ca]
/lib/libc.so.6(+0xaaaeb)[0xf73d7aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf73d5a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7730bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7730bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf76f5a0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7730bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7730bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf73e5e66]
/lib/libc.so.6(usleep+0x35)[0xf741b515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7345545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7787bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73b42ca]
/lib/libc.so.6(+0xaaaeb)[0xf742eaeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf742ca2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7787bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7787bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf774ca0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7787bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7787bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf743ce66]
/lib/libc.so.6(usleep+0x35)[0xf7472515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf739c545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77acbc0]
/lib/libc.so.6(getenv+0x9a)[0xf73d92ca]
/lib/libc.so.6(+0xaaaeb)[0xf7453aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7451a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77acbc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c46a0]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77acbc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77acbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77acbf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7461e66]
/lib/libc.so.6(usleep+0x35)[0xf7497515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73c1545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
17:34:01 (2185): called boinc_finish
17:34:01 (2186): called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2621, selfPID=2112, iMonCtr=1
Model crash detected, will try to restart...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776bbc0]
/lib/libc.so.6(getenv+0x9a)[0xf73982ca]
/lib/libc.so.6(+0xaaaeb)[0xf7412aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7410a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776bbc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776bbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf776bbf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7420e66]
/lib/libc.so.6(usleep+0x35)[0xf7456515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/libpthread.so.0(+0x6452)[0xf7727452]
/lib/libc.so.6(clone+0x5e)[0xf746025e]

Exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7792bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73bf2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7439aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7437a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7792bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7792bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7792bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7447e66]
/lib/libc.so.6(usleep+0x35)[0xf747d515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73a7545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 1 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (15 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf777abc0]
/lib/libc.so.6(getenv+0x9a)[0xf73a72ca]
/lib/libc.so.6(+0xaaaeb)[0xf7421aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf741fa2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf777abc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf777abf0]
/lib/libc.so.6(nanosleep+0x46)[0xf742fe66]
/lib/libc.so.6(usleep+0x35)[0xf7465515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/libpthread.so.0(+0x6452)[0xf7736452]
/lib/libc.so.6(clone+0x5e)[0xf746f25e]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
07:01:02 (2549): called boinc_finish
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7795bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73c22ca]
/lib/libc.so.6(+0xaaaeb)[0xf743caeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf743aa2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7795bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7795bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7795bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf744ae66]
/lib/libc.so.6(usleep+0x35)[0xf7480515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/libpthread.so.0(+0x6452)[0xf7751452]
/lib/libc.so.6(clone+0x5e)[0xf748a25e]

Exiting...
Signal 15 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76dcbc0]
/lib/libc.so.6(getenv+0x9a)[0xf73092ca]
/lib/libc.so.6(+0xaaaeb)[0xf7383aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7381a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76dcbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf76dcbf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf76a1a0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76dcbc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf76dcbf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7391e66]
/lib/libc.so.6(usleep+0x35)[0xf73c7515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf72f1545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7706bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73332ca]
/lib/libc.so.6(+0xaaaeb)[0xf73adaeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf73aba2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7706bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7706bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf76cba0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7706bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7706bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf73bbe66]
/lib/libc.so.6(usleep+0x35)[0xf73f1515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf731b545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 15 received, exiting...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77a0bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73cd2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7447aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7445a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77a0bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77a0bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77a0bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7455e66]
/lib/libc.so.6(usleep+0x35)[0xf748b515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73b5545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (24 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d0bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73fd2ca]
/lib/libc.so.6(+0xaaaeb)[0xf7477aeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf7475a2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d0bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77d0bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf7795a0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d0bc0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c46a0]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d0bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77d0bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf7485e66]
/lib/libc.so.6(usleep+0x35)[0xf74bb515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf73e5545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e7bc0]
/lib/libc.so.6(getenv+0x9a)[0xf73142ca]
/lib/libc.so.6(+0xaaaeb)[0xf738eaeb]
/lib/libc.so.6(localtime_r+0x1e)[0xf738ca2e]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e7bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf76e7bf0]
/lib/libpthread.so.0(waitpid+0x4b)[0xf76aca0b]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804fe77]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d720]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e7bc0]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf76e7bf0]
/lib/libc.so.6(nanosleep+0x46)[0xf739ce66]
/lib/libc.so.6(usleep+0x35)[0xf73d2515]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf72fc545]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
CPDN Monitor - Quit request from BOINC...
Leaving CPDN_Main::Monitor...
13:50:36 (14514): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
29 Feb 2016 03:46:15 1325379 19092846 hadam3prm3pm2t_eu_iq4e_2002_1_009823121_1 138,539 674,467 4.8684
23 Feb 2016 05:51:19 1325379 19092846 hadam3prm3pm2t_eu_iq4e_2002_1_009823121_1 127,019 620,755 4.8871
16 Feb 2016 08:10:54 1325379 19092846 hadam3prm3pm2t_eu_iq4e_2002_1_009823121_1 115,499 567,120 4.9102
04 Feb 2016 07:29:26 1325379 19092846 hadam3prm3pm2t_eu_iq4e_2002_1_009823121_1 103,979 514,062 4.9439
23 Jan 2016 10:16:41 1325379 19092846 hadam3prm3pm2t_eu_iq4e_2002_1_009823121_1 92,459 459,446 4.9692
14 Jan 2016 20:04:22 1325379 19092846 hadam3prm3pm2t_eu_iq4e_2002_1_009823121_1 80,939 404,512 4.9977
11 Jan 2016 00:38:17 1325379 19092846 hadam3prm3pm2t_eu_iq4e_2002_1_009823121_1 69,419 347,955 5.0124
05 Jan 2016 07:21:51 1325379 19092846 hadam3prm3pm2t_eu_iq4e_2002_1_009823121_1 57,899 290,142 5.0112
29 Dec 2015 05:13:31 1325379 19092846 hadam3prm3pm2t_eu_iq4e_2002_1_009823121_1 46,379 231,896 5.0000
16 Dec 2015 04:46:48 1325379 19092846 hadam3prm3pm2t_eu_iq4e_2002_1_009823121_1 34,859 173,995 4.9914
04 Dec 2015 04:35:52 1325379 19092846 hadam3prm3pm2t_eu_iq4e_2002_1_009823121_1 23,339 115,822 4.9626
28 Nov 2015 10:05:14 1325379 19092846 hadam3prm3pm2t_eu_iq4e_2002_1_009823121_1 11,819 57,448 4.8606


©2024 cpdn.org