Task 21757282

Name	hadcm3s_hw14_190012_240_837_011895458_1
Workunit	11895458
Created	3 Oct 2019, 9:45:06 UTC
Sent	3 Oct 2019, 9:48:16 UTC
Report deadline	14 Sep 2020, 15:08:16 UTC
Received	19 Oct 2019, 1:37:03 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1491365
Run time	10 hours 39 min 40 sec
CPU time	9 hours 52 min 34 sec
Validate state	Invalid
Credit	0.00
Device peak FLOPS	2.87 GFLOPS
Application version	UK Met Office HadCM3 short v8.36 i686-pc-linux-gnu
Peak working set size	165.95 MB
Peak swap size	214.31 MB
Peak disk usage	4.50 MB
Stderr	<core_client_version>7.9.3</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234)</message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... forrtl: No space left on device forrtl: severe (38): error during write, unit -1, file /proc/14687/fd/1 Image 0, RUN_RESUBMIT_TARGET = 0, 9, 12, 30, FT_LASTFIELD = 410, 130, 261, 0, 1111, 0, 20, 1531, 72, 810 / &NLCHISTO RUN_HIST_TYPE = 'Interim ', RUN_TYPE = 'Reconfig', RUN_COMPCODE = ' ', RUN_LAST_MEAN = ' ', RUN_MEANS_TO_DO = ' ', RUN_OCEAN_FIRST = 'Y', RUN_JOB_NAME = 'xabne000', RUN_ID = 'hw14k', RUN_RESUBMIT = 'N', RUN_RESUBMIT_Q = 'night ', RUN_RESUBMIT_TIME = ' ', RUN_RESUBMIT_CPU = '17000 ', RUN_RESUBMIT_MEMORY = ' ', RUN_RESUBMIT_PRTY = ' ', RUN_RESUBMIT_JOBNAME = ' ', FT_ACTIVE = 41'N', 2'Y', 'N', 'Y', 'N', 3'Y', 81'N' / &NLIHISTG H_STEPIM = 13536, 6768, 20, H_GROUPIM = 48, 24, 20, MEAN_OFFSETIM = 4-32768, OFFSET_DUMPSIM = 4-32768, MEAN_NUMBERIM = 40, RUN_MEANCTL_INDICIM = 161 / &NLCHISTG END_DUMPIM = 'hw14ka.daa19d0', 'hw14ko.daa19d0', 2' ', RESTARTIM = 4' ', SAFEDMPIM = 4' ', NEWSAFEIM = 4' ', LASTATMIM = 4' ', CURRATMIM = 4' ', LASTDMPIM = 4' ' / &NLCFILES HKFILE = ' ', PPXREF = ' ', CONFIG = ' ', STASHCTL = ' ', NAMELIST = ' ', OUTPUT = ' ', OUTPUT2 = ' ', MCTL = ' ', ICTL = ' ', PHIST = ' ', IHIST = ' SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x84ff4f7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa3090] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fa3079] /lib32/libc.so.6(gsignal+0xc2)[0xf7cd3452] /lib32/libc.so.6(abort+0x121)[0xf7cd4871] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x842eda2] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x848b8f1] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x8496bad] /lib32/libc.so.6(__libc_start_main+0xf1)[0xf7cbee81] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9467, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x84ff4f7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ef4090] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ef4079] /lib32/libc.so.6(gsignal+0xc2)[0xf7c24452] /lib32/libc.so.6(abort+0x121)[0xf7c25871] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x842eda2] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x848b8f1] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x8496bad] /lib32/libc.so.6(__libc_start_main+0xf1)[0xf7c0fe81] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9467, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x84ff4f7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f27090] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f27079] /lib32/libc.so.6(gsignal+0xc2)[0xf7c57452] /lib32/libc.so.6(abort+0x121)[0xf7c58871] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x842eda2] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x848b8f1] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x8496bad] /lib32/libc.so.6(__libc_start_main+0xf1)[0xf7c42e81] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9467, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x84ff4f7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f9d090] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f9d079] /lib32/libc.so.6(gsignal+0xc2)[0xf7ccd452] /lib32/libc.so.6(abort+0x121)[0xf7cce871] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x842eda2] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x848b8f1] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x8496bad] /lib32/libc.so.6(__libc_start_main+0xf1)[0xf7cb8e81] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9467, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x84ff4f7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fc7090] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fc7079] /lib32/libc.so.6(gsignal+0xc2)[0xf7cf7452] /lib32/libc.so.6(abort+0x121)[0xf7cf8871] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x842eda2] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x848b8f1] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x8496bad] /lib32/libc.so.6(__libc_start_main+0xf1)[0xf7ce2e81] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9467, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x84ff4f7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f48090] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f48079] /lib32/libc.so.6(gsignal+0xc2)[0xf7c78452] /lib32/libc.so.6(abort+0x121)[0xf7c79871] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x842eda2] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x848b8f1] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x8496bad] /lib32/libc.so.6(__libc_start_main+0xf1)[0xf7c63e81] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9467, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( 11:26:14 (9467): called boinc_finish(22) </stderr_txt> ]]>