climateprediction.net home page
Task 21755603

Task 21755603

Name hadam4_a04j_209210_12_838_011900469_1
Workunit 11900469
Created 2 Oct 2019, 9:33:40 UTC
Sent 2 Oct 2019, 10:17:53 UTC
Report deadline 13 Sep 2020, 15:37:53 UTC
Received 22 Oct 2019, 21:57:15 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1493139
Run time 9 days 5 hours 0 min 30 sec
CPU time 9 days 3 hours 54 min 31 sec
Validate state Invalid
Credit 16,003.31
Device peak FLOPS 5.21 GFLOPS
Application version UK Met Office HadAM4 at N144 resolution v8.09
i686-pc-linux-gnu
Peak working set size 632.77 MB
Peak swap size 655.14 MB
Peak disk usage 5.79 MB
Stderr
<core_client_version>7.16.3</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
23:53:50 (31203): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
20:48:37 (1491): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
23:03:22 (29526): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (20 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f87b40]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7aeba69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b6b468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b6b835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b69db2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f87b40]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f87b29]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b7b1cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7badbe1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7ad4e81]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
11:31:35 (17533): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
17:49:45 (1568): called boinc_finish(193)

Model crashed: ATM_DYN : NEGATIVE THETA DETECTED.                                                                                                                                                                                                                              tmp/xnnuj.pipe_dummy                                                            

Model crashed: ATM_DYN : NEGATIVE THETA DETECTED.                                                                                                                                                                                                                              tmp/xnnuj.pipe_dummy                                                            

Model crashed: ATM_DYN : NEGATIVE THETA DETECTED.                                                                                                                                                                                                                              tmp/xnnuj.pipe_dummy                                                            

Model crashed: ATM_DYN : NEGATIVE THETA DETECTED.                                                                                                                                                                                                                              tmp/xnnuj.pipe_dummy                                                            

Model crashed: ATM_DYN : NEGATIVE THETA DETECTED.                                                                                                                                                                                                                              tmp/xnnuj.pipe_dummy                                                            

Model crashed: ATM_DYN : NEGATIVE THETA DETECTED.                                                                                                                                                                                                                              tmp/xnnuj.pipe_dummy                                                            
Sorry, too many model crashes! :-(
07:00:25 (10096): called boinc_finish(22)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
21 Oct 2019 09:37:33 1493139 21755603 hadam4_a04j_209210_12_838_011900469_1 43,301 730,550 16.8714
19 Oct 2019 20:45:34 1493139 21755603 hadam4_a04j_209210_12_838_011900469_1 38,981 655,984 16.8283
18 Oct 2019 16:12:39 1493139 21755603 hadam4_a04j_209210_12_838_011900469_1 34,661 569,983 16.4445
17 Oct 2019 14:25:58 1493139 21755603 hadam4_a04j_209210_12_838_011900469_1 30,341 483,197 15.9255
16 Oct 2019 08:51:13 1493139 21755603 hadam4_a04j_209210_12_838_011900469_1 26,021 414,811 15.9414
07 Oct 2019 20:09:59 1493139 21755603 hadam4_a04j_209210_12_838_011900469_1 21,701 339,973 15.6662
06 Oct 2019 12:52:59 1493139 21755603 hadam4_a04j_209210_12_838_011900469_1 17,381 275,303 15.8393
05 Oct 2019 06:09:00 1493139 21755603 hadam4_a04j_209210_12_838_011900469_1 13,061 211,254 16.1744
04 Oct 2019 06:33:59 1493139 21755603 hadam4_a04j_209210_12_838_011900469_1 8,741 143,205 16.3831
03 Oct 2019 06:32:35 1493139 21755603 hadam4_a04j_209210_12_838_011900469_1 4,421 72,467 16.3915


©2024 climateprediction.net