climateprediction.net home page
Task 21757288

Task 21757288

Name hadam4_a003_209010_12_838_011900309_1
Workunit 11900309
Created 3 Oct 2019, 9:45:06 UTC
Sent 3 Oct 2019, 9:57:23 UTC
Report deadline 14 Sep 2020, 15:17:23 UTC
Received 11 Dec 2019, 18:11:56 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1493132
Run time 7 days 5 hours 40 min 52 sec
CPU time 7 days 4 hours 58 min 53 sec
Validate state Invalid
Credit 11,213.52
Device peak FLOPS 4.98 GFLOPS
Application version UK Met Office HadAM4 at N144 resolution v8.09
i686-pc-linux-gnu
Peak working set size 632.72 MB
Peak swap size 655.14 MB
Peak disk usage 5.79 MB
Stderr 
<core_client_version>7.16.3</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
11:06:40 (59907): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (20 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f22b40]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7a86a69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b06468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b06835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b04db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f22b40]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f22b29]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b161cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b48be1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a6fe81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (20 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa2b40]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7b06a69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b86468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b86835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b84db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa2b40]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fa2b29]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b961cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7bc8be1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7aefe81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
17:42:47 (28349): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (20 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f16b40]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7a7aa69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7afa468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7afa835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7af8db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f16b40]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f16b29]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b0a1cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b3cbe1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a63e81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
17:33:33 (54783): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (20 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fb0b60]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7b14a69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b94468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b94835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b92db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fb0b60]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fb0b49]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7ba41cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7bd6be1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7afde81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...

Model crashed: ATM_DYN : NEGATIVE THETA DETECTED.                                                                                                                                                                                                                              tmp/xnnuj.pipe_dummy                                                            

Model crashed: ATM_DYN : NEGATIVE THETA DETECTED.                                                                                                                                                                                                                              tmp/xnnuj.pipe_dummy                                                            

Model crashed: ATM_DYN : NEGATIVE THETA DETECTED.                                                                                                                                                                                                                              tmp/xnnuj.pipe_dummy                                                            
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: ATM_DYN : NEGATIVE THETA DETECTED.                                                                                                                                                                                                                              tmp/xnnuj.pipe_dummy                                                            

Model crashed: ATM_DYN : NEGATIVE THETA DETECTED.                                                                                                                                                                                                                              tmp/xnnuj.pipe_dummy                                                            

Model crashed: ATM_DYN : NEGATIVE THETA DETECTED.                                                                                                                                                                                                                              tmp/xnnuj.pipe_dummy                                                            
Sorry, too many model crashes! :-(
12:41:49 (96845): called boinc_finish(22)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
23 Nov 2019 23:47:44 1493132 21757288 hadam4_a003_209010_12_838_011900309_1 30,341 452,349 14.9088
01 Nov 2019 17:31:09 1493132 21757288 hadam4_a003_209010_12_838_011900309_1 26,021 376,937 14.4859
01 Nov 2019 05:19:37 1493132 21757288 hadam4_a003_209010_12_838_011900309_1 21,701 330,613 15.2349
31 Oct 2019 15:24:24 1493132 21757288 hadam4_a003_209010_12_838_011900309_1 17,381 281,892 16.2184
18 Oct 2019 13:42:48 1493132 21757288 hadam4_a003_209010_12_838_011900309_1 13,061 225,822 17.2898
16 Oct 2019 20:57:33 1493132 21757288 hadam4_a003_209010_12_838_011900309_1 8,741 146,872 16.8027
16 Oct 2019 03:16:43 1493132 21757288 hadam4_a003_209010_12_838_011900309_1 4,421 85,965 19.4447


©2024 climateprediction.net