climateprediction.net home page
Task 18909013

Task 18909013

Name hadam3prm3pm2t_eu_psrf_2002_1_009640902_2
Workunit 9715236
Created 16 Sep 2015, 17:13:50 UTC
Sent 16 Sep 2015, 18:13:12 UTC
Report deadline 28 Aug 2016, 23:33:12 UTC
Received 11 Dec 2015, 12:35:09 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1155005
Run time 6 days 6 hours 7 min 21 sec
CPU time 6 days 4 hours 14 min 56 sec
Validate state Invalid
Credit 3,995.19
Device peak FLOPS 3.25 GFLOPS
Application version UK Met Office HadAM3P and HadRM3P model with MOSES II and TRIFFID Europe v7.01
i686-pc-linux-gnu
Stderr 
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
20:50:02 (20921): called boinc_finish
Signal 1 received, exiting...
20:50:02 (20921): called boinc_finish
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf74b7011]
/lib/libc.so.6(+0x8e1f0)[0xf75151f0]
/lib/libc.so.6(+0x8e562)[0xf7515562]
/lib/libc.so.6(localtime_r+0x2b)[0xf7513bbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf752373c]
/lib/libc.so.6(usleep+0x3d)[0xf75564dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf74a0003]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
20:49:39 (9635): called boinc_finish
Signal 1 received, exiting...
20:49:39 (9636): called boinc_finish
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf7508011]
/lib/libc.so.6(+0x8e1f0)[0xf75661f0]
/lib/libc.so.6(+0x8e562)[0xf7566562]
/lib/libc.so.6(localtime_r+0x2b)[0xf7564bbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf757473c]
/lib/libc.so.6(usleep+0x3d)[0xf75a74dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80507b3]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf74f1003]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf7447011]
/lib/libc.so.6(+0x8e1f0)[0xf74a51f0]
/lib/libc.so.6(+0x8e562)[0xf74a5562]
/lib/libc.so.6(localtime_r+0x2b)[0xf74a3bbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf74b373c]
/lib/libc.so.6(usleep+0x3d)[0xf74e64dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf7430003]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf744e011]
/lib/libc.so.6(+0x8e1f0)[0xf74ac1f0]
/lib/libc.so.6(+0x8e562)[0xf74ac562]
/lib/libc.so.6(localtime_r+0x2b)[0xf74aabbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf74ba73c]
/lib/libc.so.6(usleep+0x3d)[0xf74ed4dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf7437003]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Signal 1 received, exiting...
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf74be011]
/lib/libc.so.6(+0x8e1f0)[0xf751c1f0]
/lib/libc.so.6(+0x8e562)[0xf751c562]
/lib/libc.so.6(localtime_r+0x2b)[0xf751abbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf752a73c]
/lib/libc.so.6(usleep+0x3d)[0xf755d4dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf74a7003]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
20:02:33 (7579): called boinc_finish
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf747d011]
/lib/libc.so.6(+0x8e1f0)[0xf74db1f0]
/lib/libc.so.6(+0x8e562)[0xf74db562]
/lib/libc.so.6(localtime_r+0x2b)[0xf74d9bbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf74e973c]
/lib/libc.so.6(usleep+0x3d)[0xf751c4dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80507b3]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf7466003]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf750b011]
/lib/libc.so.6(+0x8e1f0)[0xf75691f0]
/lib/libc.so.6(+0x8e562)[0xf7569562]
/lib/libc.so.6(localtime_r+0x2b)[0xf7567bbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf757773c]
/lib/libc.so.6(usleep+0x3d)[0xf75aa4dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf74f4003]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
21:33:19 (2719): called boinc_finish
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Signal 1 received, exiting...
Stack trace (15 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf74ec011]
/lib/libc.so.6(+0x8e1f0)[0xf754a1f0]
/lib/libc.so.6(+0x8e562)[0xf754a562]
/lib/libc.so.6(localtime_r+0x2b)[0xf7548bbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf755873c]
/lib/libc.so.6(usleep+0x3d)[0xf758b4dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/libpthread.so.0(+0x6a7d)[0xf776ca7d]
/lib/libc.so.6(clone+0x5e)[0xf7591abe]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
22:03:30 (2644): called boinc_finish
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (15 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf7529011]
/lib/libc.so.6(+0x8e1f0)[0xf75871f0]
/lib/libc.so.6(+0x8e562)[0xf7587562]
/lib/libc.so.6(localtime_r+0x2b)[0xf7585bbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf759573c]
/lib/libc.so.6(usleep+0x3d)[0xf75c84dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/libpthread.so.0(+0x6a7d)[0xf77a9a7d]
/lib/libc.so.6(clone+0x5e)[0xf75ceabe]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
20:55:44 (5271): called boinc_finish
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf74e7011]
/lib/libc.so.6(+0x8e1f0)[0xf75451f0]
/lib/libc.so.6(+0x8e562)[0xf7545562]
/lib/libc.so.6(localtime_r+0x2b)[0xf7543bbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf755373c]
/lib/libc.so.6(usleep+0x3d)[0xf75864dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf74d0003]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
21:00:12 (2744): called boinc_finish
Signal 1 received, exiting...
21:00:12 (2744): called boinc_finish
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf743a011]
/lib/libc.so.6(+0x8e1f0)[0xf74981f0]
/lib/libc.so.6(+0x8e562)[0xf7498562]
/lib/libc.so.6(localtime_r+0x2b)[0xf7496bbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf74a673c]
/lib/libc.so.6(usleep+0x3d)[0xf74d94dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf7423003]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
00:04:19 (8548): called boinc_finish
Signal 1 received, exiting...
00:04:19 (8548): called boinc_finish
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf74e9011]
/lib/libc.so.6(+0x8e1f0)[0xf75471f0]
/lib/libc.so.6(+0x8e562)[0xf7547562]
/lib/libc.so.6(localtime_r+0x2b)[0xf7545bbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf755573c]
/lib/libc.so.6(usleep+0x3d)[0xf75884dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf74d2003]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
22:08:23 (5430): called boinc_finish
Signal 1 received, exiting...
22:08:23 (5425): called boinc_finish
Signal 1 received, exiting...
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf74b1011]
/lib/libc.so.6(+0x8e1f0)[0xf750f1f0]
/lib/libc.so.6(+0x8e562)[0xf750f562]
/lib/libc.so.6(localtime_r+0x2b)[0xf750dbbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf751d73c]
/lib/libc.so.6(usleep+0x3d)[0xf75504dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf749a003]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
20:30:58 (2698): called boinc_finish
Signal 1 received, exiting...
20:30:58 (2698): called boinc_finish
Signal 1 received, exiting...
SIGSEGV: segmentation violation
20:30:58 (2699): called boinc_finish
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf7430011]
/lib/libc.so.6(+0x8e1f0)[0xf748e1f0]
/lib/libc.so.6(+0x8e562)[0xf748e562]
/lib/libc.so.6(localtime_r+0x2b)[0xf748cbbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf749c73c]
/lib/libc.so.6(usleep+0x3d)[0xf74cf4dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf7419003]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
21:12:16 (4709): called boinc_finish
Signal 1 received, exiting...
21:12:16 (4709): called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
19:22:49 (3479): called boinc_finish
Signal 1 received, exiting...
19:22:49 (3480): called boinc_finish
Signal 1 received, exiting...
Signal 1 received, exiting...
19:22:49 (3477): called boinc_finish
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Signal 1 received, exiting...
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf7469011]
/lib/libc.so.6(+0x8e1f0)[0xf74c71f0]
/lib/libc.so.6(+0x8e562)[0xf74c7562]
/lib/libc.so.6(localtime_r+0x2b)[0xf74c5bbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf74d573c]
/lib/libc.so.6(usleep+0x3d)[0xf75084dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf7452003]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (18 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf74dd011]
/lib/libc.so.6(+0x8e1f0)[0xf753b1f0]
/lib/libc.so.6(+0x8e562)[0xf753b562]
/lib/libc.so.6(localtime_r+0x2b)[0xf7539bbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf754973c]
/lib/libc.so.6(usleep+0x3d)[0xf757c4dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80507b3]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf74c6003]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf74f6011]
/lib/libc.so.6(+0x8e1f0)[0xf75541f0]
/lib/libc.so.6(+0x8e562)[0xf7554562]
/lib/libc.so.6(localtime_r+0x2b)[0xf7552bbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf756273c]
/lib/libc.so.6(usleep+0x3d)[0xf75954dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf74df003]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
15:38:46 (2651): called boinc_finish
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf747d011]
/lib/libc.so.6(+0x8e1f0)[0xf74db1f0]
/lib/libc.so.6(+0x8e562)[0xf74db562]
/lib/libc.so.6(localtime_r+0x2b)[0xf74d9bbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf74e973c]
/lib/libc.so.6(usleep+0x3d)[0xf751c4dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf7466003]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf7505011]
/lib/libc.so.6(+0x8e1f0)[0xf75631f0]
/lib/libc.so.6(+0x8e562)[0xf7563562]
/lib/libc.so.6(localtime_r+0x2b)[0xf7561bbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf757173c]
/lib/libc.so.6(usleep+0x3d)[0xf75a44dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf74ee003]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
20:05:00 (4908): called boinc_finish
Signal 1 received, exiting...
20:05:00 (4903): called boinc_finish
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf7465011]
/lib/libc.so.6(+0x8e1f0)[0xf74c31f0]
/lib/libc.so.6(+0x8e562)[0xf74c3562]
/lib/libc.so.6(localtime_r+0x2b)[0xf74c1bbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf74d173c]
/lib/libc.so.6(usleep+0x3d)[0xf75044dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf744e003]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
07:20:44 (2844): called boinc_finish
Signal 1 received, exiting...
07:20:44 (2845): called boinc_finish
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf7517011]
/lib/libc.so.6(+0x8e1f0)[0xf75751f0]
/lib/libc.so.6(+0x8e562)[0xf7575562]
/lib/libc.so.6(localtime_r+0x2b)[0xf7573bbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf758373c]
/lib/libc.so.6(usleep+0x3d)[0xf75b64dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf7500003]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
23:29:57 (2742): called boinc_finish
Signal 1 received, exiting...
23:29:57 (2742): called boinc_finish
Signal 1 received, exiting...
23:29:57 (2542): called boinc_finish
Signal 1 received, exiting...
23:29:57 (2542): called boinc_finish
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf752a011]
/lib/libc.so.6(+0x8e1f0)[0xf75881f0]
/lib/libc.so.6(+0x8e562)[0xf7588562]
/lib/libc.so.6(localtime_r+0x2b)[0xf7586bbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf759673c]
/lib/libc.so.6(usleep+0x3d)[0xf75c94dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf7513003]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
21:11:38 (2737): called boinc_finish
Signal 1 received, exiting...
21:11:38 (2737): called boinc_finish
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf7482011]
/lib/libc.so.6(+0x8e1f0)[0xf74e01f0]
/lib/libc.so.6(+0x8e562)[0xf74e0562]
/lib/libc.so.6(localtime_r+0x2b)[0xf74debbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf74ee73c]
/lib/libc.so.6(usleep+0x3d)[0xf75214dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf746b003]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 1 received, exiting...
Signal 1 received, exiting...
Signal 1 received, exiting...
SIGSEGV: segmentation violation
Stack trace (17 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xffffe400]
/lib/libc.so.6(getenv+0x91)[0xf7440011]
/lib/libc.so.6(+0x8e1f0)[0xf749e1f0]
/lib/libc.so.6(+0x8e562)[0xf749e562]
/lib/libc.so.6(localtime_r+0x2b)[0xf749cbbb]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xffffe400]
/lib/libc.so.6(nanosleep+0x3c)[0xf74ac73c]
/lib/libc.so.6(usleep+0x3d)[0xf74df4dd]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/libc.so.6(__libc_start_main+0xf3)[0xf7429003]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Signal 3 received, exiting...
14:06:48 (2510): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
04 Dec 2015 15:31:13 1155005 18909013 hadam3prm3pm2t_eu_psrf_2002_1_009640902_2 57,899 445,926 7.7018
26 Nov 2015 13:52:53 1155005 18909013 hadam3prm3pm2t_eu_psrf_2002_1_009640902_2 46,379 359,500 7.7514
15 Nov 2015 15:11:16 1155005 18909013 hadam3prm3pm2t_eu_psrf_2002_1_009640902_2 34,859 270,799 7.7684
11 Nov 2015 15:55:54 1155005 18909013 hadam3prm3pm2t_eu_psrf_2002_1_009640902_2 23,339 182,556 7.8219
07 Nov 2015 09:21:17 1155005 18909013 hadam3prm3pm2t_eu_psrf_2002_1_009640902_2 11,819 94,641 8.0075


©2024 climateprediction.net