climateprediction.net home page
Task 21997491

Task 21997491

Name hadam4h_a20f_209911_5_891_012051694_0
Workunit 12051694
Created 18 Jan 2021, 15:24:11 UTC
Sent 10 Feb 2021, 15:20:17 UTC
Report deadline 23 Jan 2022, 20:40:17 UTC
Received 23 Jul 2021, 3:29:53 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1551272
Run time 23 days 0 hours 3 min
CPU time 22 days 18 hours 12 min 42 sec
Validate state Valid
Credit 33,854.34
Device peak FLOPS 5.95 GFLOPS
Application version UK Met Office HadAM4 at N216 resolution v8.52
i686-pc-linux-gnu
Peak working set size 1,377.39 MB
Peak swap size 1,398.81 MB
Peak disk usage 162.95 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f5db60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a51552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7ad5d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ad60ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ad403b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f5db60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f5db49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ae0693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ae0892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ae7314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b1b475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a38ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ef4b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79e8552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a6cd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a6d0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a6b03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ef4b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ef4b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a77693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a77892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a7e314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ab2475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79cfee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f9cb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a90552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b14d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b150ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b1303b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f9cb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f9cb49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b1f693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b1f892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b26314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b5a475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a77ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f33b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a27552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7aabd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7aac0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7aaa03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f33b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f33b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ab6693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ab6892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7abd314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7af1475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a0eee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ed2b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79c6552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a4ad2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a4b0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a4903b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ed2b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ed2b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a55693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a55892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a5c314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a90475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79adee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f61b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a55552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7ad9d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ada0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ad803b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f61b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f61b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ae4693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ae4892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7aeb314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b1f475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a3cee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f45b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a39552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7abdd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7abe0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7abc03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f45b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f45b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ac8693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ac8892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7acf314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b03475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a20ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
00:36:16 (5249): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7faab60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a9e552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b22d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b230ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b2103b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7faab60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7faab49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b2d693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b2d892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b34314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b68475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a85ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
18:34:01 (187612): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f7bb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a6f552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7af3d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7af40ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7af203b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f7bb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f7bb49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7afe693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7afe892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b05314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b39475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a56ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f3fb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a33552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7ab7d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ab80ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ab603b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f3fb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f3fb49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ac2693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ac2892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ac9314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7afd475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d2114]
/lib/i386-linux-gnu/libpthread.so.0(+0x8635)[0xf7efb635]
/lib/i386-linux-gnu/libc.so.6(clone+0x6a)[0xf7b048fa]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f2bb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a1f552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7aa3d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7aa40ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7aa203b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f2bb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f2bb49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7aae693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7aae892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ab5314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ae9475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a06ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa9b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a9d552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b21d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b220ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b2003b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa9b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fa9b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b2c693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b2c892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b33314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b67475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a84ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
14:15:14 (23071): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f64b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a58552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7adcd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7add0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7adb03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f64b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f64b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ae7693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ae7892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7aee314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b22475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a3fee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa7b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a9b552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b1fd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b200ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b1e03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa7b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fa7b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b2a693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b2a892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b31314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b65475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a82ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
12:05:09 (4823): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ed1b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79c5552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a49d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a4a0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a4803b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ed1b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ed1b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a54693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a54892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a5b314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a8f475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79acee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ef7b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79eb552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a6fd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a700ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a6e03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ef7b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ef7b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a7a693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a7a892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a81314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ab5475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79d2ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ef4b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79e9552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a6dd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a6e0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a6c03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ef4b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ef4b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a78693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a78892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a7f314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ab3475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79d0ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fafb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7aa4552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b28d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b290ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b2703b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fafb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fafb49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b33693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b33892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b3a314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b6e475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a8bee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
23:59:31 (6445): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ee4b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79d9552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a5dd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a5e0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a5c03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ee4b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ee4b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a68693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a68892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a6f314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7aa3475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79c0ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
10:44:50 (4801): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
10:44:50 (4801): called boinc_finish(193)
Signal 3 received, exiting...
00:20:28 (4162): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f09b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79fd552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a81d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a820ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a8003b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f09b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f09b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a8c693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a8c892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a93314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ac7475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79e4ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 3 received, exiting...
00:20:31 (5490): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa6b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a99552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b1dd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b1e0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b1c03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa6b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fa6b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b28693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b28892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b2f314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b63475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a80ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
03:47:05 (15617): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
00:38:15 (5076): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ed9b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79cc552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a50d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a510ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a4f03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ed9b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ed9b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a5b693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a5b892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a62314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a96475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79b3ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f26b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a19552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a9dd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a9e0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a9c03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f26b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f26b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7aa8693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7aa8892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7aaf314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ae3475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a00ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f85b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a78552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7afcd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7afd0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7afb03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f85b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f85b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b07693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b07892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b0e314]
/lib/i386-linux-gnu/libc.so.6(sleep+0x75)[0xf7b0e225]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e7831]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a5fee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f26b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a18552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a9cd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a9d0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a9b03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f26b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f26b49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7aa7693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7aa7892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7aae314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ae2475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79ffee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f6cb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a5e552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7ae2d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ae30ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ae103b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f6cb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f6cb49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7aed693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7aed892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7af4314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b28475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a45ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
01:37:57 (5348): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f4eb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a40552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7ac4d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ac50ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ac303b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f4eb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f4eb49]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7acf693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7acf892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ad6314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b0a475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a27ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
03:29:35 (4292): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
23 Jul 2021 01:42:51 1507732 21997491 hadam4h_a20f_209911_5_891_012051694_0 43,403 1,963,037 45.2281
11 Jul 2021 15:57:18 1507732 21997491 hadam4h_a20f_209911_5_891_012051694_0 34,763 1,628,758 46.8532
06 Jul 2021 17:25:53 1507732 21997491 hadam4h_a20f_209911_5_891_012051694_0 26,123 1,292,910 49.4932
16 Jun 2021 13:25:36 1507732 21997491 hadam4h_a20f_209911_5_891_012051694_0 17,483 930,043 53.1970
01 Jun 2021 02:22:27 1507732 21997491 hadam4h_a20f_209911_5_891_012051694_0 8,843 515,211 58.2620


©2024 climateprediction.net