climateprediction.net home page
Task 21755343

Task 21755343

Name hadam4_a0ih_209810_12_839_011901721_1
Workunit 11901721
Created 1 Oct 2019, 12:42:05 UTC
Sent 1 Oct 2019, 18:28:41 UTC
Report deadline 12 Sep 2020, 23:48:41 UTC
Received 13 Nov 2019, 16:51:38 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1471015
Run time 5 days 23 hours 32 min 34 sec
CPU time 5 days 23 hours 32 min 34 sec
Validate state Valid
Credit 19,196.51
Device peak FLOPS 4.25 GFLOPS
Application version UK Met Office HadAM4 at N144 resolution v8.09
i686-pc-linux-gnu
Peak working set size 632.94 MB
Peak swap size 654.91 MB
Peak disk usage 5.83 MB
Stderr 
<core_client_version>7.9.3</core_client_version>
<![CDATA[
<stderr_txt>
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
21:43:18 (5309): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f68090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7ac6a69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b46468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b46835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b44db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f68090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f68079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b561cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b88be1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7aafe81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
CPDN Monitor - Quit request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
22:37:12 (4618): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f69090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7ac7a69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b47468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b47835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b45db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f69090]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0580]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f69090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f69079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b571cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b89be1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7ab0e81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
20:17:02 (2276): called boinc_finish(193)

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
18:28:02 (2286): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f4e090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7aaca69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b2c468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b2c835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b2adb2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f4e090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f4e079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b3c1cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b6ebe1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a95e81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
13:08:44 (2271): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f30090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7a8ea69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b0e468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b0e835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b0cdb2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f30090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f30079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b1e1cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b50be1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a77e81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
22:45:41 (2161): called boinc_finish(193)
CPDN Monitor - Quit request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fb7090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7b14a69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b94468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b94835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b92db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fb7090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fb7079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7ba41cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7bd6be1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7afde81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7eff090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7a5ca69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7adc468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7adc835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7adadb2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7eff090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7eff079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7aec1cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b1ebe1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a45e81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
21:32:55 (2284): called boinc_finish(193)
CPDN Monitor - Quit request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
01:23:10 (14234): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f24090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7a81a69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b01468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b01835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7affdb2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f24090]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0580]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f24090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f24079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b111cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b43be1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a6ae81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
12:03:37 (4491): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f8e090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7aeba69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b6b468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b6b835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b69db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f8e090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f8e079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b7b1cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7badbe1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7ad4e81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
23:55:04 (8811): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f24090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7a81a69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b01468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b01835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7affdb2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f24090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f24079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b111cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b43be1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a6ae81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1
CPDN Monitor - Quit request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f44090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7aa1a69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b21468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b21835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b1fdb2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f44090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f44079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b311cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b63be1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a8ae81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f55090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7ab2a69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b32468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b32835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b30db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f55090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f55079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b421cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b74be1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a9be81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
CPDN Monitor - Quit request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f7b090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7ad8a69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b58468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b58835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b56db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f7b090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f7b079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b681cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b9abe1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7ac1e81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa9090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7b06a69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b86468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b86835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b84db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa9090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fa9079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b961cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7bc8be1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7aefe81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
CPDN Monitor - Quit request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f5e090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7abba69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b3b468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b3b835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b39db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f5e090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f5e079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b4b1cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b7dbe1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7aa4e81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
23:19:09 (11971): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f3c090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7a99a69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b19468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b19835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b17db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f3c090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f3c079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b291cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b5bbe1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a82e81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f51090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7aaea69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b2e468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b2e835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b2cdb2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f51090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f51079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b3e1cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b70be1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a97e81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2192, iMonCtr=1
Model crash detected, will try to restart...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
21:10:37 (6891): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7eed090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7a4aa69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7aca468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7aca835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7ac8db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7eed090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7eed079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7ada1cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b0cbe1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a33e81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f3b090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7a98a69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b18468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b18835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b16db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f3b090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f3b079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b281cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b5abe1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a81e81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
21:09:07 (2283): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
19:08:14 (2268): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f47090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7aa4a69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b24468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b24835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b22db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f47090]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0580]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f47090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f47079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b341cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b66be1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a8de81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fba090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7b17a69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b97468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b97835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b95db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fba090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fba079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7ba71cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7bd9be1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7b00e81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fc7090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7b24a69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7ba4468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7ba4835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7ba2db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fc7090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fc7079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7bb41cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7be6be1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7b0de81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
21:58:37 (14109): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f6e090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7acba69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b4b468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b4b835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b49db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f6e090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f6e079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b5b1cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b8dbe1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7ab4e81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fce090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7b2ba69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7bab468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7bab835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7ba9db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fce090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fce079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7bbb1cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7bedbe1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7b14e81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
21:47:00 (2570): called boinc_finish(193)
CPDN Monitor - Quit request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
22:34:05 (20609): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa9090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7b06a69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b86468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b86835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b84db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa9090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fa9079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b961cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7bc8be1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7aefe81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
CPDN Monitor - Quit request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f18090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7a75a69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7af5468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7af5835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7af3db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f18090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f18079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b051cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b37be1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a5ee81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
23:33:50 (2512): called boinc_finish(193)
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ef7090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7a54a69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7ad4468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7ad4835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7ad2db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ef7090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ef7079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7ae41cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b16be1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a3de81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
CPDN Monitor - Quit request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f89090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7ae6a69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b66468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b66835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b64db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f89090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f89079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b761cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7ba8be1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7acfe81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
CPDN Monitor - Quit request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fb0090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7b0da69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b8d468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b8d835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b8bdb2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fb0090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fb0079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b9d1cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7bcfbe1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7af6e81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
CPDN Monitor - Quit request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ee0090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7a3da69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7abd468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7abd835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7abbdb2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ee0090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ee0079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7acd1cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7affbe1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a26e81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
17:09:42 (2540): called boinc_finish(193)
CPDN Monitor - Quit request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f79090]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7ad6a69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b56468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b56835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b54db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f79090]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f79079]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b661cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b98be1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7abfe81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:43:10 (2410): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
13 Nov 2019 16:54:17 1471015 21755343 hadam4_a0ih_209810_12_839_011901721_1 51,941 516,355 9.9412
11 Nov 2019 07:47:41 1471015 21755343 hadam4_a0ih_209810_12_839_011901721_1 47,621 473,729 9.9479
09 Nov 2019 08:05:47 1471015 21755343 hadam4_a0ih_209810_12_839_011901721_1 43,301 430,138 9.9337
03 Nov 2019 15:36:46 1471015 21755343 hadam4_a0ih_209810_12_839_011901721_1 38,981 387,735 9.9468
02 Nov 2019 12:23:59 1471015 21755343 hadam4_a0ih_209810_12_839_011901721_1 34,661 344,823 9.9484
30 Oct 2019 10:55:30 1471015 21755343 hadam4_a0ih_209810_12_839_011901721_1 30,341 302,547 9.9716
22 Oct 2019 17:09:59 1471015 21755343 hadam4_a0ih_209810_12_839_011901721_1 26,021 259,742 9.9820
19 Oct 2019 14:27:06 1471015 21755343 hadam4_a0ih_209810_12_839_011901721_1 21,701 215,801 9.9443
13 Oct 2019 20:43:11 1471015 21755343 hadam4_a0ih_209810_12_839_011901721_1 17,381 172,543 9.9271
10 Oct 2019 19:01:38 1471015 21755343 hadam4_a0ih_209810_12_839_011901721_1 13,061 129,589 9.9218
06 Oct 2019 20:21:23 1471015 21755343 hadam4_a0ih_209810_12_839_011901721_1 8,741 87,104 9.9650
04 Oct 2019 18:18:16 1471015 21755343 hadam4_a0ih_209810_12_839_011901721_1 4,421 43,753 9.8966


©2024 cpdn.org