Task 21996591

Name	hadam4h_a1bp_209611_5_891_012050804_0
Workunit	12050804
Created	18 Jan 2021, 14:29:39 UTC
Sent	29 Jan 2021, 3:10:50 UTC
Report deadline	11 Jan 2022, 8:30:50 UTC
Received	24 Mar 2021, 12:10:27 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1511316
Run time	33 days 5 hours 34 min 39 sec
CPU time	33 days 5 hours 34 min 39 sec
Validate state	Invalid
Credit	13,636.74
Device peak FLOPS	1.77 GFLOPS
Application version	UK Met Office HadAM4 at N216 resolution v8.52 i686-pc-linux-gnu
Peak working set size	1,355.84 MB
Peak swap size	1,378.35 MB
Peak disk usage	161.97 MB
Stderr	<core_client_version>7.14.2</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234)</message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:34:46 (17239): BOINC client no longer exists - exiting 02:34:46 (17239): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... SIGBUS: bus error Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x83d8117] linux-gate.so.1(__kernel_sigreturn+0x0)[0x40040d40] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x80a4746] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x806aa85] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x807f7e5] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81ddb4f] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81e121b] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x836e63f] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0x4019fb41] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3286, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... SIGBUS: bus error Stack trace (10 frames): /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x83d8117] linux-gate.so.1(__kernel_sigreturn+0x0)[0x40086d40] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x8225060] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x80a1365] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x806aa85] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x807f7e5] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81ddb4f] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81e121b] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x836e63f] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0x401e5b41] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5298, iMonCtr=1 Model crash detected, will try to restart... SIGBUS: bus error Stack trace (12 frames): /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x83d8117] linux-gate.so.1(__kernel_sigreturn+0x0)[0x400d8d40] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x8139366] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x8085b75] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81f2308] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x808b160] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x806bc09] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x807f7e5] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81ddb4f] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81e121b] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x836e63f] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0x40237b41] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5298, iMonCtr=1 Model crash detected, will try to restart... SIGBUS: bus error Stack trace (15 frames): /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x83d8117] linux-gate.so.1(__kernel_sigreturn+0x0)[0x400d7d40] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x82cfda9] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81d08eb] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x82b0f9a] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81900ea] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x80e1a38] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81c8cb7] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x8179795] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x806c756] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x807f7e5] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81ddb4f] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81e121b] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x836e63f] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0x40236b41] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5298, iMonCtr=1 Model crash detected, will try to restart... SIGBUS: bus error Stack trace (11 frames): /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x83d8117] linux-gate.so.1(__kernel_sigreturn+0x0)[0x40090d40] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x8321efe] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x827091e] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x82534e3] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x805f17b] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x80787e2] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81ddb4f] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81e121b] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x836e63f] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0x401efb41] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5298, iMonCtr=1 Model crash detected, will try to restart... SIGBUS: bus error Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x83d8117] linux-gate.so.1(__kernel_sigreturn+0x0)[0x400acd40] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81c63e8] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x80644aa] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x80787e2] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81ddb4f] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81e121b] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x836e63f] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0x4020bb41] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5298, iMonCtr=1 Model crash detected, will try to restart... SIGBUS: bus error Stack trace (11 frames): /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x83d8117] linux-gate.so.1(__kernel_sigreturn+0x0)[0x4009cd40] /lib/i386-linux-gnu/libc.so.6(+0x141078)[0x40322078] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x80b73f6] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x80a9421] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x806f21f] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x807f7e5] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81ddb4f] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81e121b] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x836e63f] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0x401fbb41] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5298, iMonCtr=1 Model crash detected, will try to restart... SIGBUS: bus error Stack trace (10 frames): /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x83d8117] linux-gate.so.1(__kernel_sigreturn+0x0)[0x40033d40] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x80bb842] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x80a9421] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x806f21f] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x807f7e5] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81ddb4f] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81e121b] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x836e63f] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0x40192b41] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5298, iMonCtr=1 Model crash detected, will try to restart... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 20:26:19 (821): called boinc_finish(193) CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Sorry, too many model crashes! :-( 06:09:39 (30704): called boinc_finish(22) </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Mar 2021 22:46:05	1511316	21996591	hadam4h_a1bp_209611_5_891_012050804_0	17,483	2,246,309	128.4853