climateprediction.net home page
Task 21990099

Task 21990099

Name hadam4h_h1b7_200611_5_889_012045186_1
Workunit 12045186
Created 30 Dec 2020, 6:42:59 UTC
Sent 30 Dec 2020, 12:42:25 UTC
Report deadline 12 Dec 2021, 18:02:25 UTC
Received 24 Apr 2021, 18:53:22 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1551272
Run time 24 days 23 hours 17 min 5 sec
CPU time 24 days 15 hours 22 min 37 sec
Validate state Valid
Credit 33,854.34
Device peak FLOPS 5.90 GFLOPS
Application version UK Met Office HadAM4 at N216 resolution v8.52
i686-pc-linux-gnu
Peak working set size 1,376.94 MB
Peak swap size 1,398.82 MB
Peak disk usage 163.10 MB
Stderr 
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
00:14:24 (15693): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
00:14:24 (15693): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ef3b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79e8552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a6cd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a6d0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a6b03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ef3b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ef3b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a77693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a77892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a7e314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ab2475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79cfee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f92b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a87552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b0bd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b0c0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b0a03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f92b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f92b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b16693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b16892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b1d314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b51475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a6eee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f56b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a4b552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7acfd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ad00ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ace03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f56b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f56b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ada693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ada892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ae1314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b15475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a32ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fcbb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7ac0552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b44d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b450ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b4303b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fcbb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fcbb49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b4f693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b4f892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b56314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b8a475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7aa7ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f30b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a25552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7aa9d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7aaa0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7aa803b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f30b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f30b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ab4693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ab4892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7abb314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7aef475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a0cee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fbbb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7ab0552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b34d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b350ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b3303b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fbbb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fbbb49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b3f693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b3f892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b46314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b7a475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a97ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f30b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a25552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7aa9d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7aaa0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7aa803b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f30b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f30b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ab4693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ab4892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7abb314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7aef475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a0cee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ee5b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79da552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a5ed2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a5f0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a5d03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ee5b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ee5b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a69693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a69892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a70314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7aa4475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79c1ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f0cb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a00552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a84d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a850ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a8303b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f0cb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f0cb49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a8f693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a8f892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a96314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7aca475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79e7ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
16:22:41 (11715): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f54b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a48552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7accd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7acd0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7acb03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f54b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f54b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ad7693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ad7892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ade314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b12475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a2fee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ed3b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79c7552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a4bd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a4c0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a4a03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ed3b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ed3b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a56693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a56892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a5d314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a91475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79aeee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f98b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a8c552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b10d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b110ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b0f03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f98b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f98b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b1b693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b1b892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b22314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b56475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a73ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f39b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a2d552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7ab1d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ab20ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ab003b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f39b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f39b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7abc693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7abc892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ac3314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7af7475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a14ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fb9b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7aad552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b31d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b320ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b3003b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fb9b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fb9b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b3c693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b3c892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b43314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b77475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a94ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7eecb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79e0552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a64d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a650ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a6303b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7eecb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7eecb49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a6f693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a6f892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a76314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7aaa475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79c7ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
23:03:05 (4270): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fc0b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7ab4552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b38d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b390ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b3703b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fc0b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fc0b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b43693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b43892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b4a314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b7e475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a9bee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f97b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a8b552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b0fd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b100ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b0e03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f97b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f97b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b1a693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b1a892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b21314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b55475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a72ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f9bb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a8f552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b13d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b140ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b1203b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f9bb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f9bb49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b1e693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b1e892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b25314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b59475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a76ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ee1b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79d5552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a59d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a5a0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a5803b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ee1b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ee1b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a64693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a64892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a6b314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a9f475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79bcee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
20:54:09 (18867): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
20:54:10 (18867): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f2eb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a22552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7aa6d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7aa70ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7aa503b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f2eb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f2eb49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ab1693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ab1892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ab8314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7aec475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a09ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fb5b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7aa9552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b2dd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b2e0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b2c03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fb5b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fb5b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b38693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b38892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b3f314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b73475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a90ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f70b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a64552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7ae8d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ae90ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ae703b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f70b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f70b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7af3693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7af3892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7afa314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b2e475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a4bee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
CPDN Monitor - Quit request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
18:11:50 (4651): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7eecb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79e0552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a64d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a650ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a6303b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7eecb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7eecb49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a6f693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a6f892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a76314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7aaa475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79c7ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f99b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a8d552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b11d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b120ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b1003b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f99b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f99b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b1c693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b1c892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b23314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b57475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a74ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
15:32:40 (6143): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
15:32:41 (6143): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f27b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a1b552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a9fd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7aa00ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a9e03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f27b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f27b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7aaa693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7aaa892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ab1314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ae5475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a02ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f53b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a47552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7acbd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7acc0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7aca03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f53b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f53b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ad6693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ad6892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7add314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b11475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a2eee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f2fb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a23552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7aa7d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7aa80ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7aa603b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f2fb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f2fb49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ab2693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ab2892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ab9314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7aed475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a0aee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ef1b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79e5552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a69d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a6a0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a6803b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ef1b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ef1b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a74693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a74892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a7b314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7aaf475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79ccee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
18:53:10 (5381): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
24 Apr 2021 15:53:20 1507732 21990099 hadam4h_h1b7_200611_5_889_012045186_1 43,403 2,121,718 48.8841
09 Apr 2021 14:26:03 1507732 21990099 hadam4h_h1b7_200611_5_889_012045186_1 34,763 1,749,086 50.3146
31 Mar 2021 17:21:48 1507732 21990099 hadam4h_h1b7_200611_5_889_012045186_1 26,123 1,392,343 53.2995
22 Mar 2021 16:21:01 1507732 21990099 hadam4h_h1b7_200611_5_889_012045186_1 17,483 1,063,325 60.8205
06 Mar 2021 07:46:39 1507732 21990099 hadam4h_h1b7_200611_5_889_012045186_1 8,843 704,471 79.6643


©2024 climateprediction.net