Task 22037176

Name	hadam4h_e0yq_207111_5_898_012070046_2
Workunit	12070046
Created	23 Mar 2021, 10:49:36 UTC
Sent	23 Mar 2021, 13:24:48 UTC
Report deadline	5 Mar 2022, 18:44:48 UTC
Received	13 Jun 2021, 18:44:03 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1456271
Run time	19 days 9 hours 55 min 17 sec
CPU time	19 days 7 hours 54 min 49 sec
Validate state	Invalid
Credit	27,115.14
Device peak FLOPS	3.27 GFLOPS
Application version	UK Met Office HadAM4 at N216 resolution v8.52 i686-pc-linux-gnu
Peak working set size	1,383.84 MB
Peak swap size	1,397.94 MB
Peak disk usage	206.48 MB
Stderr	<core_client_version>7.6.31</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (19 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] [0xf7748bc0] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf738b18a] /lib/i386-linux-gnu/libc.so.6(+0xa232b)[0xf73ff32b] /lib/i386-linux-gnu/libc.so.6(+0xa269a)[0xf73ff69a] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1e)[0xf73fdd2e] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] [0xf7748bc0] [0xf7748be9] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x4a)[0xf740d3ca] /lib/i386-linux-gnu/libc.so.6(usleep+0x35)[0xf743d2c5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf7)[0xf7375637] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/xnnuj.pipe_dummy forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /var/lib/boinc-client/projects/climateprediction.net/hadam4h_e0yq_207111_5_898_012070046/dataout/xnnuj.out Image PC Routine Line Source hadam4_um_8.52_i6 083F6605 Unknown Unknown Unknown hadam4_um_8.52_i6 0843ABB0 Unknown Unknown Unknown hadam4_um_8.52_i6 08438E0F Unknown Unknown Unknown hadam4_um_8.52_i6 081ABA99 Unknown Unknown Unknown hadam4_um_8.52_i6 0811E285 Unknown Unknown Unknown hadam4_um_8.52_i6 0811FF0C Unknown Unknown Unknown hadam4_um_8.52_i6 081D82A7 Unknown Unknown Unknown hadam4_um_8.52_i6 081E121B Unknown Unknown Unknown hadam4_um_8.52_i6 0836E63F Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=27428, iMonCtr=1 Model crash detected, will try to restart... forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /var/lib/boinc-client/projects/climateprediction.net/hadam4h_e0yq_207111_5_898_012070046/dataout/xnnuj.out Image PC Routine Line Source hadam4_um_8.52_i6 083F6605 Unknown Unknown Unknown hadam4_um_8.52_i6 084419A3 Unknown Unknown Unknown hadam4_um_8.52_i6 081092DF Unknown Unknown Unknown hadam4_um_8.52_i6 0810C08E Unknown Unknown Unknown hadam4_um_8.52_i6 0812254F Unknown Unknown Unknown hadam4_um_8.52_i6 081D82A7 Unknown Unknown Unknown hadam4_um_8.52_iSuspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (20 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] [0xf77cabc0] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf740d18a] /lib/i386-linux-gnu/libc.so.6(+0xa232b)[0xf748132b] /lib/i386-linux-gnu/libc.so.6(+0xa269a)[0xf748169a] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1e)[0xf747fd2e] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] [0xf77cabc0] [0xf77cabe9] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x4a)[0xf748f3ca] /lib/i386-linux-gnu/libc.so.6(usleep+0x35)[0xf74bf2c5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf7)[0xf73f7637] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 3 received, exiting... SIGSEGV: segmentation violation 21:45:01 (1780): called boinc_finish(193) Stack trace (7 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] [0xf770dbc0] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804d0b6] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8050d88] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf7)[0xf733a637] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Apr 2021 15:16:02	1456271	22037176	hadam4h_e0yq_207111_5_898_012070046_2	34,763	1,628,916	46.8578
25 Apr 2021 04:44:07	1456271	22037176	hadam4h_e0yq_207111_5_898_012070046_2	26,123	1,296,954	49.6480
19 Apr 2021 16:08:21	1456271	22037176	hadam4h_e0yq_207111_5_898_012070046_2	17,483	931,498	53.2802
07 Apr 2021 06:15:44	1456271	22037176	hadam4h_e0yq_207111_5_898_012070046_2	8,843	612,256	69.2362