Task 22061711

Name	hadam4h_a0j6_200811_4_852_011937575_1
Workunit	11937575
Created	25 Apr 2021, 10:03:10 UTC
Sent	6 May 2021, 11:21:44 UTC
Report deadline	18 Apr 2022, 16:41:44 UTC
Received	10 Jun 2021, 8:23:13 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1503867
Run time	3 days 22 hours 22 min 41 sec
CPU time	3 days 21 hours 59 min 3 sec
Validate state	Invalid
Credit	20,375.94
Device peak FLOPS	8.28 GFLOPS
Application version	UK Met Office HadAM4 at N216 resolution v8.52 i686-pc-linux-gnu
Peak working set size	1,364.46 MB
Peak swap size	1,386.06 MB
Peak disk usage	150.89 MB
Stderr	<core_client_version>7.16.6</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234)</message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 17:19:41 (25433): called boinc_finish(193) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (21 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f9bb60] /lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a91552] /lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b15d2d] /lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b160ee] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b1403b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f9bb60] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f9bb49] /lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b20693] /lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b20892] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b27314] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b5b475] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a78ee5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (21 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f8ab60] /lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a80552] /lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b04d2d] /lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b050ee] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b0303b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f8ab60] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f8ab49] /lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b0f693] /lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b0f892] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b16314] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b4a475] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a67ee5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 16:28:05 (3926): called boinc_finish(193) Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 16:28:06 (3926): called boinc_finish(193) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (21 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f66b60] /lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a5c552] /lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7ae0d2d] /lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ae10ee] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7adf03b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f66b60] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f66b49] /lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7aeb693] /lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7aeb892] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7af2314] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b26475] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a43ee5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (21 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f79b60] /lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a6f552] /lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7af3d2d] /lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7af40ee] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7af203b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f79b60] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f79b49] /lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7afe693] /lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7afe892] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b05314] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b39475] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a56ee5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 16:30:03 (14971): called boinc_finish(193) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (22 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f5ab60] /lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a50552] /lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7ad4d2d] /lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ad50ee] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ad303b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f5ab60] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f5ab49] /lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7adf693] /lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7adf892] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ae6314] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b1a475] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a37ee5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 08:53:14 (8580): called boinc_finish(193) Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (22 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f32b60] /lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a28552] /lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7aacd2d] /lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7aad0ee] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7aab03b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f32b60] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f32b49] /lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ab7693] /lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ab7892] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7abe314] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7af2475] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a0fee5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 09:21:18 (27532): called boinc_finish(193) Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 09:21:19 (27532): called boinc_finish(193) Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Sorry, too many model crashes! :-( 09:22:40 (1799): called boinc_finish(22) </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Jun 2021 14:06:52	1503867	22061711	hadam4h_a0j6_200811_4_852_011937575_1	26,123	320,819	12.2811
31 May 2021 08:08:16	1503867	22061711	hadam4h_a0j6_200811_4_852_011937575_1	17,483	218,394	12.4918
17 May 2021 13:59:42	1503867	22061711	hadam4h_a0j6_200811_4_852_011937575_1	8,843	110,029	12.4425