climateprediction.net home page
Task 18553740

Task 18553740

Name hadam3prm3pm2t_eu_qst5_2002_1_009641464_1
Workunit 9715798
Created 19 Jun 2015, 4:22:53 UTC
Sent 17 Sep 2015, 19:06:02 UTC
Report deadline 30 Aug 2016, 0:26:02 UTC
Received 28 Oct 2015, 12:43:49 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1338003
Run time 16 days 17 hours 18 min 27 sec
CPU time 14 days 15 hours 40 min 2 sec
Validate state Workunit error - check skipped
Credit 9,559.58
Device peak FLOPS 2.30 GFLOPS
Application version UK Met Office HadAM3P and HadRM3P model with MOSES II and TRIFFID Europe v7.01
i686-pc-linux-gnu
Stderr
<core_client_version>7.2.42</core_client_version>
<![CDATA[
<stderr_txt>
Signal 1 received, exiting...
22:55:36 (15889): called boinc_finish
Signal 1 received, exiting...
22:55:36 (15890): called boinc_finish
Signal 1 received, exiting...
22:55:36 (15886): called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 1 received, exiting...
00:18:35 (6939): called boinc_finish
Signal 1 received, exiting...
00:18:35 (6939): called boinc_finish
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (16 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d5bd0]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf74667d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf74dc94e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf74dcc9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf74db3ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d5bd0]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf77d5bf5]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf74ea6f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf75185bd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/i386-linux-gnu/i686/cmov/libpthread.so.0(+0x6efb)[0xf7764efb]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(clone+0x5e)[0xf751f64e]

Exiting...
Signal 1 received, exiting...
11:15:24 (3823): called boinc_finish
Signal 1 received, exiting...
Signal 1 received, exiting...
11:15:24 (3823): called boinc_finish
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7762bd0]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf73f47d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf746a94e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf746ac9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf74693ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7762bd0]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf7762bf5]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf74786f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf74a65bd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf73dda63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 2 received, exiting...
Signal 2 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d9bd0]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf748a7d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf750094e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf7500c9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf74ff3ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77d9bd0]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf77d9bf5]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf750e6f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf753c5bd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf7473a63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
11:27:24 (11422): called boinc_finish
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf777fbd0]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf73a27d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf741894e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf7418c9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf74173ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf777fbd0]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf777fbf5]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf74266f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf74545dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf738ba63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
Signal 1 received, exiting...
03:49:43 (13666): called boinc_finish
Signal 1 received, exiting...
03:49:43 (13666): called boinc_finish
Signal 1 received, exiting...
Signal 1 received, exiting...
11:51:31 (17069): called boinc_finish
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7723bd0]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf736c7d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf73e294e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf73e2c9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf73e13ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7723bd0]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf7723bf5]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf73f06f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf741e5dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf7355a63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
01:45:56 (17949): called boinc_finish
Signal 1 received, exiting...
01:45:56 (17949): called boinc_finish
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7753bd0]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf739c7d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf741294e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf7412c9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf74113ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7753bd0]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf7753bf5]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf74206f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf744e5dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf7385a63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
Signal 1 received, exiting...
01:53:34 (5770): called boinc_finish
Signal 1 received, exiting...
01:53:34 (5770): called boinc_finish
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77e4bd0]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf74087d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf747e94e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf747ec9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf747d3ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77e4bd0]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf77e4bf5]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf748c6f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf74ba5dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf73f1a63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
CPDN Monitor - Quit request from BOINC...
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7711bd0]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf73397d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf73af94e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf73afc9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf73ae3ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7711bd0]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf7711bf5]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf73bd6f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf73eb5dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf7322a63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Signal 1 received, exiting...
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7760bd0]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf73a97d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf741f94e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf741fc9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf741e3ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7760bd0]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf7760bf5]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf742d6f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf745b5dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf7392a63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
Signal 1 received, exiting...
01:22:20 (3014): called boinc_finish
Signal 1 received, exiting...
Signal 1 received, exiting...
13:17:21 (3155): called boinc_finish
Signal 1 received, exiting...
13:17:21 (3155): called boinc_finish
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76f3bd0]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf733c7d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf73b294e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf73b2c9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf73b13ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76f3bd0]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf76f3bf5]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf73c06f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf73ee5dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf7325a63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Signal 1 received, exiting...
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7733bd0]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf73547d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf73ca94e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf73cac9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf73c93ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7733bd0]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf7733bf5]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf73d86f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf74065dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf733da63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 2 received, exiting...
Signal 2 received, exiting...
01:41:44 (3121): called boinc_finish
01:41:44 (3120): called boinc_finish
Signal 1 received, exiting...
00:35:58 (7662): called boinc_finish
Signal 1 received, exiting...
00:35:58 (7662): called boinc_finish
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7748bd0]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf73697d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf73df94e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf73dfc9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf73de3ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7748bd0]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf7748bf5]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf73ed6f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf741b5dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf7352a63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 2 received, exiting...
02:08:40 (5206): called boinc_finish
Signal 2 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7771bd0]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf73937d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf740994e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf7409c9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf74083ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7771bd0]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf7771bf5]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf74176f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf74455dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf737ca63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 2 received, exiting...
Signal 2 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776abd0]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf738b7d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf740194e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf7401c9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf74003ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776abd0]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf776abf5]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf740f6f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf743d5dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf7374a63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 2 received, exiting...
02:42:13 (8615): called boinc_finish
Signal 2 received, exiting...
02:42:13 (8614): called boinc_finish
Signal 1 received, exiting...
00:29:09 (3749): called boinc_finish
Signal 1 received, exiting...
Signal 1 received, exiting...
00:29:09 (3749): called boinc_finish
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7714bd0]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf73377d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf73ad94e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf73adc9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf73ac3ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7714bd0]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf7714bf5]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf73bb6f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf73e95dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf7320a63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
00:06:12 (6117): called boinc_finish
Signal 1 received, exiting...
00:06:12 (6117): called boinc_finish
Signal 1 received, exiting...
00:06:12 (6078): called boinc_finish
Signal 1 received, exiting...
Signal 1 received, exiting...
Signal 1 received, exiting...
23:44:59 (3049): called boinc_finish
23:44:59 (3049): called boinc_finish
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77cebd0]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf73f17d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf746794e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf7467c9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf74663ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77cebd0]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf77cebf5]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf74756f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf74a35dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf73daa63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
Signal 1 received, exiting...
22:51:06 (3012): called boinc_finish
Signal 1 received, exiting...
22:51:06 (2766): called boinc_finish
Signal 1 received, exiting...
09:38:25 (3502): called boinc_finish
SIGSEGV: segmentation violation
Stack trace (7 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77fdb40]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6bf]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x805134d]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf7408a63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
00:18:00 (5385): called boinc_finish
Signal 1 received, exiting...
00:18:00 (5384): called boinc_finish
Signal 1 received, exiting...
00:18:00 (5385): called boinc_finish
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7706b40]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf734f7d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf73c594e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf73c5c9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf73c43ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7706b40]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf7706b65]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf73d36f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf74015dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf7338a63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (16 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7701b40]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf734a7d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf73c094e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf73c0c9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf73bf3ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7701b40]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf7701b65]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf73ce6f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf73fc5dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/i386-linux-gnu/i686/cmov/libpthread.so.0(+0x6efb)[0xf76b0efb]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(clone+0x5e)[0xf740366e]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7779b40]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf739a7d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf741094e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf7410c9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf740f3ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7779b40]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf7779b65]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf741e6f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf744c5dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf7383a63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Signal 1 received, exiting...
Stack trace (16 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77a7b40]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf73c77d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf743d94e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf743dc9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf743c3ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77a7b40]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf77a7b65]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf744b6f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf74795dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/i386-linux-gnu/i686/cmov/libpthread.so.0(+0x6efb)[0xf772defb]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(clone+0x5e)[0xf748066e]

Exiting...
CPDN Monitor - Quit request from BOINC...
Signal 1 received, exiting...
23:08:57 (3790): called boinc_finish
Signal 1 received, exiting...
23:08:57 (3790): called boinc_finish
Signal 1 received, exiting...
23:08:57 (3789): called boinc_finish
Signal 1 received, exiting...
23:08:57 (3644): called boinc_finish
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776fb40]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf73907d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf740694e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf7406c9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf74053ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776fb40]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf776fb65]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf74146f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf74425dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf7379a63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
Signal 1 received, exiting...
23:33:52 (3405): called boinc_finish
Signal 1 received, exiting...
Signal 1 received, exiting...
23:33:52 (3365): called boinc_finish
23:33:52 (3365): called boinc_finish
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776bb40]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf738e7d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf740494e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf7404c9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf74033ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf776bb40]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf776bb65]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf74126f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf74405dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf7377a63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 2 received, exiting...
20:41:28 (19846): called boinc_finish
Signal 2 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7762b40]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf73867d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf73fc94e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf73fcc9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf73fb3ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7762b40]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf7762b65]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf740a6f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf74385dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf736fa63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 2 received, exiting...
Signal 2 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77fdb40]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf741f7d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf749594e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf7495c9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf74943ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77fdb40]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf77fdb65]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf74a36f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf74d15dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf7408a63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
23:01:42 (21952): called boinc_finish
Signal 1 received, exiting...
23:01:43 (21953): called boinc_finish
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7704b40]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf73277d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf739d94e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf739dc9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf739c3ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7704b40]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf7704b65]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf73ab6f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf73d95dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf7310a63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
Signal 1 received, exiting...
00:33:10 (3780): called boinc_finish
Signal 1 received, exiting...
00:33:10 (3725): called boinc_finish
Signal 15 received, exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4009, selfPID=3927, iMonCtr=1
Model crash detected, will try to restart...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76dbb40]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf73247d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf739a94e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf739ac9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf73993ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76dbb40]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x804d6ec]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76dbb40]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf76dbb65]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf73a86f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf73d65dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/i386-linux-gnu/i686/cmov/libpthread.so.0(+0x6efb)[0xf768aefb]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(clone+0x5e)[0xf73dd66e]

Exiting...
Signal 2 received, exiting...
Signal 2 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7780b40]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf73c97d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf743f94e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf743fc9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf743e3ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7780b40]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf7780b65]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf744d6f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf747b5dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf73b2a63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
19:04:12 (4049): called boinc_finish
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77bbb40]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf74047d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf747a94e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf747ac9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf74793ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77bbb40]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf77bbb65]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf74886f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf74b65dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf73eda63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 2 received, exiting...
Signal 2 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76f8b40]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x72)[0xf73417d2]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa694e)[0xf73b794e]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0xa6c9f)[0xf73b7c9f]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2b)[0xf73b63ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76f8b40]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf76f8b65]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(nanosleep+0x46)[0xf73c56f6]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(usleep+0x3d)[0xf73f35dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3)[0xf732aa63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Leaving CPDN_Main::Monitor...
12:20:39 (3810): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
26 Oct 2015 18:36:53 1338003 18553740 hadam3prm3pm2t_eu_qst5_2002_1_009641464_1 138,539 1,268,484 9.1562
26 Oct 2015 18:36:53 1338003 18553740 hadam3prm3pm2t_eu_qst5_2002_1_009641464_1 127,019 1,167,992 9.1954
11 Oct 2015 13:24:09 1338003 18553740 hadam3prm3pm2t_eu_qst5_2002_1_009641464_1 115,499 1,065,325 9.2237
09 Oct 2015 12:35:26 1338003 18553740 hadam3prm3pm2t_eu_qst5_2002_1_009641464_1 103,979 962,163 9.2534
07 Oct 2015 10:09:52 1338003 18553740 hadam3prm3pm2t_eu_qst5_2002_1_009641464_1 92,459 859,537 9.2964
05 Oct 2015 08:17:13 1338003 18553740 hadam3prm3pm2t_eu_qst5_2002_1_009641464_1 80,939 756,258 9.3436
02 Oct 2015 19:04:53 1338003 18553740 hadam3prm3pm2t_eu_qst5_2002_1_009641464_1 69,419 650,554 9.3714
30 Sep 2015 14:34:19 1338003 18553740 hadam3prm3pm2t_eu_qst5_2002_1_009641464_1 57,899 543,999 9.3957
27 Sep 2015 23:05:02 1338003 18553740 hadam3prm3pm2t_eu_qst5_2002_1_009641464_1 46,379 436,861 9.4194
25 Sep 2015 19:49:10 1338003 18553740 hadam3prm3pm2t_eu_qst5_2002_1_009641464_1 34,859 329,432 9.4504
23 Sep 2015 13:00:22 1338003 18553740 hadam3prm3pm2t_eu_qst5_2002_1_009641464_1 23,339 219,784 9.4170
20 Sep 2015 23:44:26 1338003 18553740 hadam3prm3pm2t_eu_qst5_2002_1_009641464_1 11,819 110,326 9.3346


©2024 climateprediction.net