climateprediction.net home page
Task 21981137

Task 21981137

Name hadam4h_h170_201211_5_889_012045035_1
Workunit 12045035
Created 17 Dec 2020, 19:11:54 UTC
Sent 24 Dec 2020, 22:39:44 UTC
Report deadline 7 Dec 2021, 3:59:44 UTC
Received 15 May 2021, 15:32:08 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1551303
Run time 30 days 0 hours 1 min 19 sec
CPU time 29 days 18 hours 42 min 25 sec
Validate state Valid
Credit 33,854.34
Device peak FLOPS 4.58 GFLOPS
Application version UK Met Office HadAM4 at N216 resolution v8.52
i686-pc-linux-gnu
Peak working set size 1,376.14 MB
Peak swap size 1,398.83 MB
Peak disk usage 163.19 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
22:12:26 (2353): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
22:12:27 (2353): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ee3b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79e2552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a66d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a670ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a6503b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ee3b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ee3b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a71693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a71892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a78314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7aac475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79c9ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f28b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a27552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7aabd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7aac0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7aaa03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f28b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f28b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ab6693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ab6892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7abd314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7af1475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a0eee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f12b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a10552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a94d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a950ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a9303b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f12b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f12b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a9f693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a9f892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7aa6314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ada475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79f7ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f74b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a72552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7af6d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7af70ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7af503b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f74b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f74b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b01693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b01892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b08314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b3c475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a59ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa2b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7aa0552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b24d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b250ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b2303b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa2b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fa2b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b2f693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b2f892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b36314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b6a475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a87ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f5cb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a5a552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7aded2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7adf0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7add03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f5cb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f5cb49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ae9693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ae9892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7af0314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b24475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a41ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7efab60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79f8552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a7cd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a7d0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a7b03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7efab60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7efab49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a87693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a87892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a8e314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ac2475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79dfee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f70b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a6e552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7af2d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7af30ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7af103b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f70b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f70b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7afd693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7afd892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b04314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b38475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a55ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fbab60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7ab8552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b3cd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b3d0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b3b03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fbab60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fbab49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b47693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b47892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b4e314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b82475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a9fee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f64b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a62552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7ae6d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ae70ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ae503b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f64b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f64b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7af1693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7af1892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7af8314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b2c475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a49ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f31b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a2f552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7ab3d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ab40ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ab203b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f31b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f31b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7abe693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7abe892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ac5314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7af9475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a16ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f18b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a16552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a9ad2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a9b0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a9903b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f18b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f18b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7aa5693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7aa5892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7aac314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ae0475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79fdee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f74b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a72552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7af6d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7af70ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7af503b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f74b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f74b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b01693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b01892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b08314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b3c475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a59ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f2ab60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a28552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7aacd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7aad0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7aab03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f2ab60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f2ab49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ab7693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ab7892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7abe314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7af2475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a0fee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ed1b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79cf552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a53d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a540ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a5203b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ed1b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ed1b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a5e693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a5e892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a65314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a99475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79b6ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f4db60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a4b552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7acfd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ad00ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ace03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f4db60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f4db49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ada693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ada892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ae1314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b15475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a32ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f5db60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a5b552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7adfd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ae00ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ade03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f5db60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f5db49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7aea693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7aea892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7af1314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b25475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a42ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
22:23:53 (1475): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
22:23:54 (1475): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f4ab60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a48552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7accd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7acd0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7acb03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f4ab60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f4ab49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ad7693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ad7892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ade314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b12475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a2fee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f1cb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a1a552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a9ed2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a9f0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a9d03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f1cb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f1cb49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7aa9693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7aa9892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ab0314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ae4475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a01ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fd0b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7ace552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b52d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b530ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b5103b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fd0b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fd0b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b5d693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b5d892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b64314]
/lib/i386-linux-gnu/libc.so.6(sleep+0x75)[0xf7b64225]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e7831]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7ab5ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ef1b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79ef552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a73d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a740ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a7203b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ef1b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ef1b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a7e693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a7e892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a85314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ab9475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79d6ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f4eb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a4c552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7ad0d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ad10ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7acf03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f4eb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f4eb49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7adb693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7adb892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ae2314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b16475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a33ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
23:12:59 (2539): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7effb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79fd552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a81d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a820ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a8003b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7effb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7effb49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a8c693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a8c892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a93314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ac7475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79e4ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7eedb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79eb552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a6fd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a700ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a6e03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7eedb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7eedb49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a7a693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a7a892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a81314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ab5475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79d2ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2809, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2809, iMonCtr=1
Model crash detected, will try to restart...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f3db60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a3b552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7abfd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ac00ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7abe03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f3db60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f3db49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7aca693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7aca892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ad1314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b05475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a22ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
16:44:16 (114861): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
16:44:16 (114861): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ef8b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79f6552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a7ad2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a7b0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a7903b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ef8b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ef8b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a85693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a85892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a8c314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ac0475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79ddee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
CPDN Monitor - Quit request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f53b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a51552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7ad5d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ad60ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ad403b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f53b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f53b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ae0693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ae0892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ae7314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b1b475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a38ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
22:15:42 (14681): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f6bb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a69552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7aedd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7aee0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7aec03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f6bb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f6bb49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7af8693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7af8892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7aff314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b33475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a50ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
15:31:26 (3643): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
15 May 2021 13:44:06 1507541 21981137 hadam4h_h170_201211_5_889_012045035_1 43,403 2,569,998 59.2125
25 Apr 2021 15:50:02 1507541 21981137 hadam4h_h170_201211_5_889_012045035_1 34,763 1,996,825 57.4411
02 Apr 2021 10:45:19 1507541 21981137 hadam4h_h170_201211_5_889_012045035_1 26,123 1,506,742 57.6788
19 Mar 2021 19:46:47 1507541 21981137 hadam4h_h170_201211_5_889_012045035_1 17,483 1,031,125 58.9787
01 Mar 2021 19:05:23 1507541 21981137 hadam4h_h170_201211_5_889_012045035_1 8,843 593,426 67.1069


©2024 climateprediction.net