climateprediction.net home page
Task 21932108

Task 21932108

Name hadam4h_a0ft_209211_4_868_012015618_3
Workunit 12015618
Created 4 May 2020, 18:35:22 UTC
Sent 7 May 2020, 22:08:21 UTC
Report deadline 20 Apr 2021, 3:28:21 UTC
Received 1 Jul 2020, 9:46:52 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1400281
Run time 18 days 8 hours 1 min 59 sec
CPU time 15 days 23 hours 52 min 16 sec
Validate state Invalid
Credit 20,375.94
Device peak FLOPS 5.08 GFLOPS
Application version UK Met Office HadAM4 at N216 resolution v8.52
i686-pc-linux-gnu
Peak working set size 1,373.09 MB
Peak swap size 1,394.47 MB
Peak disk usage 107.33 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)</message>
<stderr_txt>
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
09:11:31 (710592): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
09:11:32 (710592): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fb3b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a98552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b1cd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b1d0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b1b03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fb3b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fb3b49]
/lib/i386-linux-gnu/libc.so.6(+0xc65ed)[0xf7b275ed]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b276d2]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b2e154]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b622b5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a7fee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
06:13:41 (3211): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
06:13:41 (3211): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
08:22:49 (1542197): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
08:47:42 (3353): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (23 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f16b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79fb552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a7fd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a800ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a7e03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f16b60]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0580]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f16b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f16b49]
/lib/i386-linux-gnu/libc.so.6(+0xc65ed)[0xf7a8a5ed]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a8a6d2]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a91154]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ac52b5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79e2ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
21:02:50 (56644): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f7eb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a63552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7ae7d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ae80ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ae603b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f7eb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f7eb49]
/lib/i386-linux-gnu/libc.so.6(+0xc65ed)[0xf7af25ed]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7af26d2]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7af9154]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b2d2b5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a4aee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
01:21:22 (3189): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f0bb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79f0552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a74d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a750ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a7303b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f0bb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f0bb49]
/lib/i386-linux-gnu/libc.so.6(+0xc65ed)[0xf7a7f5ed]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a7f6d2]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a86154]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7aba2b5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79d7ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f0eb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79f3552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a77d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a780ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a7603b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f0eb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f0eb49]
/lib/i386-linux-gnu/libc.so.6(+0xc65ed)[0xf7a825ed]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a826d2]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a89154]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7abd2b5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79daee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
20:45:05 (74485): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f7bb60]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a60552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7ae4d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ae50ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ae303b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f7bb60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f7bb49]
/lib/i386-linux-gnu/libc.so.6(+0xc65ed)[0xf7aef5ed]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7aef6d2]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7af6154]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b2a2b5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a47ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...

Model crashed: READDUMP: BAD BUFFIN OF DATA                                                                                                                                                                                                                                    tmp/xnnuj.pipe_dummy                                                            

Model crashed: READDUMP: BAD BUFFIN OF DATA                                                                                                                                                                                                                                    tmp/xnnuj.pipe_dummy                                                            

Model crashed: READDUMP: BAD BUFFIN OF DATA                                                                                                                                                                                                                                    tmp/xnnuj.pipe_dummy                                                            

Model crashed: READDUMP: BAD BUFFIN OF DATA                                                                                                                                                                                                                                    tmp/xnnuj.pipe_dummy                                                            

Model crashed: READDUMP: BAD BUFFIN OF DATA                                                                                                                                                                                                                                    tmp/xnnuj.pipe_dummy                                                            

Model crashed: READDUMP: BAD BUFFIN OF DATA                                                                                                                                                                                                                                    tmp/xnnuj.pipe_dummy                                                            
Sorry, too many model crashes! :-(
20:46:47 (1965): called boinc_finish(22)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
16 Jun 2020 03:35:44 1400281 21932108 hadam4h_a0ft_209211_4_868_012015618_3 26,123 1,110,445 42.5083
06 Jun 2020 20:25:52 1400281 21932108 hadam4h_a0ft_209211_4_868_012015618_3 17,483 736,856 42.1470
25 May 2020 00:02:31 1400281 21932108 hadam4h_a0ft_209211_4_868_012015618_3 8,843 415,908 47.0325


©2024 climateprediction.net