climateprediction.net home page
Task 22169730

Task 22169730

Name hadam4h_10cl_209308_4_924_012124029_1
Workunit 12124029
Created 1 Dec 2021, 13:41:52 UTC
Sent 20 Dec 2021, 1:41:20 UTC
Report deadline 2 Dec 2022, 7:01:20 UTC
Received 11 Jan 2022, 14:44:03 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1459164
Run time 16 days 2 hours 49 min 25 sec
CPU time 16 days 2 hours 3 min 49 sec
Validate state Valid
Credit 27,115.14
Device peak FLOPS 4.04 GFLOPS
Application version UK Met Office HadAM4 at N216 resolution v8.52
i686-pc-linux-gnu
Peak working set size 1,380.74 MB
Peak swap size 1,397.83 MB
Peak disk usage 164.74 MB
Stderr
<core_client_version>7.6.31</core_client_version>
<![CDATA[
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
17:50:12 (14736): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf772a400]
/lib32/libc.so.6(getenv+0x9a)[0xf738ff8a]
/lib32/libc.so.6(+0xa13db)[0xf74033db]
/lib32/libc.so.6(+0xa174a)[0xf740374a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf7401dde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf772a400]
[0xf772a430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf741125a]
/lib32/libc.so.6(usleep+0x35)[0xf7440825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf737a647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
05:05:44 (19909): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf77a9400]
/lib32/libc.so.6(getenv+0x9a)[0xf740ef8a]
/lib32/libc.so.6(+0xa13db)[0xf74823db]
/lib32/libc.so.6(+0xa174a)[0xf748274a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf7480dde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf77a9400]
[0xf77a9430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf749025a]
/lib32/libc.so.6(usleep+0x35)[0xf74bf825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf73f9647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf772c400]
/lib32/libc.so.6(getenv+0x9a)[0xf7391f8a]
/lib32/libc.so.6(+0xa13db)[0xf74053db]
/lib32/libc.so.6(+0xa174a)[0xf740574a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf7403dde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf772c400]
[0xf772c430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf741325a]
/lib32/libc.so.6(usleep+0x35)[0xf7442825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf737c647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf7783400]
/lib32/libc.so.6(getenv+0x9a)[0xf73e8f8a]
/lib32/libc.so.6(+0xa13db)[0xf745c3db]
/lib32/libc.so.6(+0xa174a)[0xf745c74a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf745adde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf7783400]
[0xf7783430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf746a25a]
/lib32/libc.so.6(usleep+0x35)[0xf7499825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf73d3647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf7706400]
/lib32/libc.so.6(getenv+0x9a)[0xf736bf8a]
/lib32/libc.so.6(+0xa13db)[0xf73df3db]
/lib32/libc.so.6(+0xa174a)[0xf73df74a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf73dddde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf7706400]
[0xf7706430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf73ed25a]
/lib32/libc.so.6(usleep+0x35)[0xf741c825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf7356647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf778f400]
/lib32/libc.so.6(getenv+0x9a)[0xf73f4f8a]
/lib32/libc.so.6(+0xa13db)[0xf74683db]
/lib32/libc.so.6(+0xa174a)[0xf746874a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf7466dde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf778f400]
[0xf778f430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf747625a]
/lib32/libc.so.6(usleep+0x35)[0xf74a5825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf73df647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf7710400]
/lib32/libc.so.6(getenv+0x9a)[0xf7375f8a]
/lib32/libc.so.6(+0xa13db)[0xf73e93db]
/lib32/libc.so.6(+0xa174a)[0xf73e974a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf73e7dde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf7710400]
[0xf7710430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf73f725a]
/lib32/libc.so.6(usleep+0x35)[0xf7426825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf7360647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
10:00:37 (31235): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf77c2400]
/lib32/libc.so.6(getenv+0x9a)[0xf7427f8a]
/lib32/libc.so.6(+0xa13db)[0xf749b3db]
/lib32/libc.so.6(+0xa174a)[0xf749b74a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf7499dde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf77c2400]
[0xf77c2430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf74a925a]
/lib32/libc.so.6(usleep+0x35)[0xf74d8825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf7412647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
12:38:08 (400): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
12:38:09 (400): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf76f7400]
/lib32/libc.so.6(getenv+0x9a)[0xf735cf8a]
/lib32/libc.so.6(+0xa13db)[0xf73d03db]
/lib32/libc.so.6(+0xa174a)[0xf73d074a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf73cedde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf76f7400]
[0xf76f7430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf73de25a]
/lib32/libc.so.6(usleep+0x35)[0xf740d825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf7347647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
13:18:41 (465): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf76e2400]
/lib32/libc.so.6(getenv+0x9a)[0xf7347f8a]
/lib32/libc.so.6(+0xa13db)[0xf73bb3db]
/lib32/libc.so.6(+0xa174a)[0xf73bb74a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf73b9dde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf76e2400]
[0xf76e2430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf73c925a]
/lib32/libc.so.6(usleep+0x35)[0xf73f8825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf7332647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf76ec400]
/lib32/libc.so.6(getenv+0x9a)[0xf7351f8a]
/lib32/libc.so.6(+0xa13db)[0xf73c53db]
/lib32/libc.so.6(+0xa174a)[0xf73c574a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf73c3dde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf76ec400]
[0xf76ec430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf73d325a]
/lib32/libc.so.6(usleep+0x35)[0xf7402825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf733c647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf7747400]
/lib32/libc.so.6(getenv+0x9a)[0xf73acf8a]
/lib32/libc.so.6(+0xa13db)[0xf74203db]
/lib32/libc.so.6(+0xa174a)[0xf742074a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf741edde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf7747400]
[0xf7747430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf742e25a]
/lib32/libc.so.6(usleep+0x35)[0xf745d825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf7397647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
19:21:05 (357): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
06:50:36 (324): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf7747400]
/lib32/libc.so.6(getenv+0x9a)[0xf73acf8a]
/lib32/libc.so.6(+0xa13db)[0xf74203db]
/lib32/libc.so.6(+0xa174a)[0xf742074a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf741edde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf7747400]
[0xf7747430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf742e25a]
/lib32/libc.so.6(usleep+0x35)[0xf745d825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf7397647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
17:50:52 (2725): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
19:50:54 (10010): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf7777400]
/lib32/libc.so.6(getenv+0x9a)[0xf73dcf8a]
/lib32/libc.so.6(+0xa13db)[0xf74503db]
/lib32/libc.so.6(+0xa174a)[0xf745074a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf744edde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf7777400]
[0xf7777430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf745e25a]
/lib32/libc.so.6(usleep+0x35)[0xf748d825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf73c7647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf76f9400]
/lib32/libc.so.6(getenv+0x9a)[0xf735ef8a]
/lib32/libc.so.6(+0xa13db)[0xf73d23db]
/lib32/libc.so.6(+0xa174a)[0xf73d274a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf73d0dde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf76f9400]
[0xf76f9430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf73e025a]
/lib32/libc.so.6(usleep+0x35)[0xf740f825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf7349647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf7772400]
/lib32/libc.so.6(getenv+0x9a)[0xf73d7f8a]
/lib32/libc.so.6(+0xa13db)[0xf744b3db]
/lib32/libc.so.6(+0xa174a)[0xf744b74a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf7449dde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf7772400]
[0xf7772430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf745925a]
/lib32/libc.so.6(usleep+0x35)[0xf7488825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf73c2647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf77a3400]
/lib32/libc.so.6(getenv+0x9a)[0xf7408f8a]
/lib32/libc.so.6(+0xa13db)[0xf747c3db]
/lib32/libc.so.6(+0xa174a)[0xf747c74a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf747adde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf77a3400]
[0xf77a3430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf748a25a]
/lib32/libc.so.6(usleep+0x35)[0xf74b9825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf73f3647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf77c3400]
/lib32/libc.so.6(getenv+0x9a)[0xf7428f8a]
/lib32/libc.so.6(+0xa13db)[0xf749c3db]
/lib32/libc.so.6(+0xa174a)[0xf749c74a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf749adde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf77c3400]
[0xf77c3430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf74aa25a]
/lib32/libc.so.6(usleep+0x35)[0xf74d9825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf7413647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
10:20:25 (634): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf7773400]
/lib32/libc.so.6(getenv+0x9a)[0xf73d8f8a]
/lib32/libc.so.6(+0xa13db)[0xf744c3db]
/lib32/libc.so.6(+0xa174a)[0xf744c74a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf744adde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf7773400]
[0xf7773430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf745a25a]
/lib32/libc.so.6(usleep+0x35)[0xf7489825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf73c3647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf7704400]
/lib32/libc.so.6(getenv+0x9a)[0xf7369f8a]
/lib32/libc.so.6(+0xa13db)[0xf73dd3db]
/lib32/libc.so.6(+0xa174a)[0xf73dd74a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf73dbdde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf7704400]
[0xf7704430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf73eb25a]
/lib32/libc.so.6(usleep+0x35)[0xf741a825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf7354647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf7708400]
/lib32/libc.so.6(getenv+0x9a)[0xf736df8a]
/lib32/libc.so.6(+0xa13db)[0xf73e13db]
/lib32/libc.so.6(+0xa174a)[0xf73e174a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf73dfdde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf7708400]
[0xf7708430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf73ef25a]
/lib32/libc.so.6(usleep+0x35)[0xf741e825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf7358647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
17:05:41 (1190): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf77a3400]
/lib32/libc.so.6(getenv+0x9a)[0xf7408f8a]
/lib32/libc.so.6(+0xa13db)[0xf747c3db]
/lib32/libc.so.6(+0xa174a)[0xf747c74a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf747adde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf77a3400]
[0xf77a3430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf748a25a]
/lib32/libc.so.6(usleep+0x35)[0xf74b9825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf73f3647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
17:20:31 (1587): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf7783400]
/lib32/libc.so.6(getenv+0x9a)[0xf73e8f8a]
/lib32/libc.so.6(+0xa13db)[0xf745c3db]
/lib32/libc.so.6(+0xa174a)[0xf745c74a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf745adde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf7783400]
[0xf7783430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf746a25a]
/lib32/libc.so.6(usleep+0x35)[0xf7499825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf73d3647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf778f400]
/lib32/libc.so.6(getenv+0x9a)[0xf73f4f8a]
/lib32/libc.so.6(+0xa13db)[0xf74683db]
/lib32/libc.so.6(+0xa174a)[0xf746874a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf7466dde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf778f400]
[0xf778f430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf747625a]
/lib32/libc.so.6(usleep+0x35)[0xf74a5825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf73df647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
18:05:59 (7595): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
[0xf7789400]
/lib32/libc.so.6(getenv+0x9a)[0xf73eef8a]
/lib32/libc.so.6(+0xa13db)[0xf74623db]
/lib32/libc.so.6(+0xa174a)[0xf746274a]
/lib32/libc.so.6(localtime_r+0x1e)[0xf7460dde]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
[0xf7789400]
[0xf7789430]
/lib32/libc.so.6(nanosleep+0x4a)[0xf747025a]
/lib32/libc.so.6(usleep+0x35)[0xf749f825]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf7)[0xf73d9647]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
08:42:31 (8314): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
11 Jan 2022 14:47:29 1459164 22169730 hadam4h_10cl_209308_4_924_012124029_1 34,763 1,386,608 39.8875
06 Jan 2022 14:56:40 1459164 22169730 hadam4h_10cl_209308_4_924_012124029_1 26,123 1,031,479 39.4855
28 Dec 2021 18:28:10 1459164 22169730 hadam4h_10cl_209308_4_924_012124029_1 17,483 688,502 39.3812
24 Dec 2021 15:02:58 1459164 22169730 hadam4h_10cl_209308_4_924_012124029_1 8,843 353,097 39.9295


©2024 climateprediction.net