<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
process exited with code 148 (0x94, -108)</message>
<stderr_txt>
OFILE_LIMIT=-10.000
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.025] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.025] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.025] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.025] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.025] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.025] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.025] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.025] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.026] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.026] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.026] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.026] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.026] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.026] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.026] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.026] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.026] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.026] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.026] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.026] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.026] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.026] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.026] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.026] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:9843:9843] [20221228:102411:1672194251:0.027] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1981050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0150
(argv4) batchid: 950
(argv5) wuid: 12166794
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/1
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_08a6088337946996739f075f4d8f6412 to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0150_1981050100_123_950_12166794.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0150_1981050100_123_950_12166794.zip
ic_ancil_file: ic_ancil_12166794
ifsdata_file: ifsdata_12166794
climate_data_file: clim_data_12166794
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_95ec41f2d46284ee310630af900f543d to: /var/lib/boinc-client/slots/1/ic_ancil_12166794.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/1/ic_ancil_12166794.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_c1a082612e90e84aa8fb60471849ab61 to: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12166794.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12166794.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/1/159l_2/clim_data_12166794.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/1/159l_2/clim_data_12166794.zip
Checking for progress XML file: /var/lib/boinc-client/slots/1/progress_file_12166794.xml
Opened progress file ok : /var/lib/boinc-client/slots/1/progress_file_12166794.xml
-- Model is restarting --
Adjusting last_iter, 0, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/1/progress_file_12166794.xml
last_cpu_time: 325
upload_file_number: 0
last_iter: -1
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0150_1981050100_123_950_12166794_1_r313015234
The child process has been launched with process id: 10160
Executing the command: /var/lib/boinc-client/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.162] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.162] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.162] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.162] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.162] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.162] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.162] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.162] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.162] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.162] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.162] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.162] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.162] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.163] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.163] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.163] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.163] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.163] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.163] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.163] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.163] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.163] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.163] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.163] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.163] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.163] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.163] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.163] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.163] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:10160:10160] [20221228:103455:1672194895:0.163] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1981050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0150
(argv4) batchid: 950
(argv5) wuid: 12166794
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/1
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_08a6088337946996739f075f4d8f6412 to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0150_1981050100_123_950_12166794.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0150_1981050100_123_950_12166794.zip
ic_ancil_file: ic_ancil_12166794
ifsdata_file: ifsdata_12166794
climate_data_file: clim_data_12166794
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_95ec41f2d46284ee310630af900f543d to: /var/lib/boinc-client/slots/1/ic_ancil_12166794.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/1/ic_ancil_12166794.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_c1a082612e90e84aa8fb60471849ab61 to: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12166794.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12166794.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/1/159l_2/clim_data_12166794.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/1/159l_2/clim_data_12166794.zip
Checking for progress XML file: /var/lib/boinc-client/slots/1/progress_file_12166794.xml
Opened progress file ok : /var/lib/boinc-client/slots/1/progress_file_12166794.xml
-- Model is restarting --
Adjusting last_iter, 0, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/1/progress_file_12166794.xml
last_cpu_time: 339
upload_file_number: 0
last_iter: -1
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0150_1981050100_123_950_12166794_1_r313015234
The child process has been launched with process id: 24693
Executing the command: /var/lib/boinc-client/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:24693:24693] [20221228:173529:1672220129:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1981050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0150
(argv4) batchid: 950
(argv5) wuid: 12166794
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/1
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_08a6088337946996739f075f4d8f6412 to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0150_1981050100_123_950_12166794.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0150_1981050100_123_950_12166794.zip
ic_ancil_file: ic_ancil_12166794
ifsdata_file: ifsdata_12166794
climate_data_file: clim_data_12166794
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_95ec41f2d46284ee310630af900f543d to: /var/lib/boinc-client/slots/1/ic_ancil_12166794.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/1/ic_ancil_12166794.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_c1a082612e90e84aa8fb60471849ab61 to: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12166794.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12166794.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/1/159l_2/clim_data_12166794.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/1/159l_2/clim_data_12166794.zip
Checking for progress XML file: /var/lib/boinc-client/slots/1/progress_file_12166794.xml
Opened progress file ok : /var/lib/boinc-client/slots/1/progress_file_12166794.xml
-- Model is restarting --
Adjusting last_iter, 0, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/1/progress_file_12166794.xml
last_cpu_time: 378
upload_file_number: 0
last_iter: -1
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0150_1981050100_123_950_12166794_1_r313015234
The child process has been launched with process id: 24994
Executing the command: /var/lib/boinc-client/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:24994:24994] [20221228:174552:1672220752:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:48:00 STEP 0 H= 0:00 +CPU= 49.794
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000000
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000000
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000000
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:51:42 STEP 1 H= 1:00 +CPU= 36.160
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:55:02 STEP 2 H= 2:00 +CPU= 31.284
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:59:06 STEP 3 H= 3:00 +CPU= 47.357
18:02:22 STEP 4 H= 4:00 +CPU= 32.511
18:06:18 STEP 5 H= 5:00 +CPU= 31.872
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:09:57 STEP 6 H= 6:00 +CPU= 46.401
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:12:57 STEP 7 H= 7:00 +CPU= 31.049
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:16:10 STEP 8 H= 8:00 +CPU= 31.879
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:19:18 STEP 9 H= 9:00 +CPU= 45.219
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:22:14 STEP 10 H= 10:00 +CPU= 32.265
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:23:22 STEP 11 H= 11:00 +CPU= 28.331
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:26:21 STEP 12 H= 12:00 +CPU= 49.093
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000012
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000012
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000012
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:28:28 STEP 13 H= 13:00 +CPU= 27.592
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:30:00 STEP 14 H= 14:00 +CPU= 27.923
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:30:58 STEP 15 H= 15:00 +CPU= 37.967
18:31:34 STEP 16 H= 16:00 +CPU= 27.348
18:33:50 STEP 17 H= 17:00 +CPU= 27.898
18:34:32 STEP 18 H= 18:00 +CPU= 32.953
18:34:58 STEP 19 H= 19:00 +CPU= 21.189
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:42:23 STEP 20 H= 20:00 +CPU= 33.556
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:59:17 STEP 21 H= 21:00 +CPU= 62.985
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
19:14:05 STEP 22 H= 22:00 +CPU= 42.970
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
19:28:47 STEP 23 H= 23:00 +CPU= 38.613
19:51:22 STEP 24 H= 24:00 +CPU= 71.531
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000024
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000024
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMGGhq0f+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMSHhq0f+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMUAhq0f+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMGGhq0f+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMSHhq0f+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMUAhq0f+000012
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0150_1981050100_123_950_12166794_1_r313015234_0.zip
Uploading the intermediate file: upload_file_0.zip
20:05:48 STEP 25 H= 25:00 +CPU= 41.536
20:16:37 STEP 26 H= 26:00 +CPU= 33.726
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:19:04 STEP 27 H= 27:00 +CPU= 41.334
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:20:08 STEP 28 H= 28:00 +CPU= 28.158
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:21:20 STEP 29 H= 29:00 +CPU= 27.163
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:23:18 STEP 30 H= 30:00 +CPU= 43.506
20:23:49 STEP 31 H= 31:00 +CPU= 25.922
20:24:43 STEP 32 H= 32:00 +CPU= 26.375
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:26:17 STEP 33 H= 33:00 +CPU= 40.690
20:27:23 STEP 34 H= 34:00 +CPU= 26.521
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:28:18 STEP 35 H= 35:00 +CPU= 26.082
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:29:48 STEP 36 H= 36:00 +CPU= 43.204
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000036
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000036
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000036
20:31:03 STEP 37 H= 37:00 +CPU= 26.705
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:32:16 STEP 38 H= 38:00 +CPU= 26.997
20:34:00 STEP 39 H= 39:00 +CPU= 41.205
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:35:13 STEP 40 H= 40:00 +CPU= 25.531
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:36:09 STEP 41 H= 41:00 +CPU= 24.367
20:37:02 STEP 42 H= 42:00 +CPU= 41.312
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:38:05 STEP 43 H= 43:00 +CPU= 25.577
20:39:02 STEP 44 H= 44:00 +CPU= 25.431
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:40:42 STEP 45 H= 45:00 +CPU= 39.797
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:41:50 STEP 46 H= 46:00 +CPU= 26.430
20:42:41 STEP 47 H= 47:00 +CPU= 26.556
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:45:09 STEP 48 H= 48:00 +CPU= 49.202
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000048
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000048
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMGGhq0f+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMSHhq0f+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMUAhq0f+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMGGhq0f+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMSHhq0f+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMUAhq0f+000036
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0150_1981050100_123_950_12166794_1_r313015234_1.zip
Uploading the intermediate file: upload_file_1.zip
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:45:50 STEP 49 H= 49:00 +CPU= 25.117
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:46:49 STEP 50 H= 50:00 +CPU= 25.202
20:48:46 STEP 51 H= 51:00 +CPU= 39.145
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:49:46 STEP 52 H= 52:00 +CPU= 25.954
20:50:12 STEP 53 H= 53:00 +CPU= 23.003
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:52:07 STEP 54 H= 54:00 +CPU= 45.517
20:53:05 STEP 55 H= 55:00 +CPU= 25.425
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:53:54 STEP 56 H= 56:00 +CPU= 25.230
20:55:55 STEP 57 H= 57:00 +CPU= 41.206
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:56:59 STEP 58 H= 58:00 +CPU= 26.480
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:58:06 STEP 59 H= 59:00 +CPU= 25.710
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:59:31 STEP 60 H= 60:00 +CPU= 43.867
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000060
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000060
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000060
21:00:39 STEP 61 H= 61:00 +CPU= 24.728
21:01:43 STEP 62 H= 62:00 +CPU= 26.418
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:03:12 STEP 63 H= 63:00 +CPU= 40.998
21:04:01 STEP 64 H= 64:00 +CPU= 25.747
21:04:52 STEP 65 H= 65:00 +CPU= 25.403
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:06:36 STEP 66 H= 66:00 +CPU= 41.491
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:07:37 STEP 67 H= 67:00 +CPU= 24.968
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:08:53 STEP 68 H= 68:00 +CPU= 24.983
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:10:15 STEP 69 H= 69:00 +CPU= 38.560
21:10:42 STEP 70 H= 70:00 +CPU= 22.464
21:11:49 STEP 71 H= 71:00 +CPU= 27.109
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:13:51 STEP 72 H= 72:00 +CPU= 45.698
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000072
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000072
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMGGhq0f+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMSHhq0f+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMUAhq0f+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMGGhq0f+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMSHhq0f+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMUAhq0f+000060
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0150_1981050100_123_950_12166794_1_r313015234_2.zip
Uploading the intermediate file: upload_file_2.zip
21:15:24 STEP 73 H= 73:00 +CPU= 27.533
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1981050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0150
(argv4) batchid: 950
(argv5) wuid: 12166794
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/1
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_08a6088337946996739f075f4d8f6412 to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0150_1981050100_123_950_12166794.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0150_1981050100_123_950_12166794.zip
ic_ancil_file: ic_ancil_12166794
ifsdata_file: ifsdata_12166794
climate_data_file: clim_data_12166794
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_95ec41f2d46284ee310630af900f543d to: /var/lib/boinc-client/slots/1/ic_ancil_12166794.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/1/ic_ancil_12166794.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_c1a082612e90e84aa8fb60471849ab61 to: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12166794.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12166794.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/1/159l_2/clim_data_12166794.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/1/159l_2/clim_data_12166794.zip
Checking for progress XML file: /var/lib/boinc-client/slots/1/progress_file_12166794.xml
Opened progress file ok : /var/lib/boinc-client/slots/1/progress_file_12166794.xml
-- Model is restarting --
Adjusting last_iter, 74, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/1/progress_file_12166794.xml
last_cpu_time: 2901
upload_file_number: 3
last_iter: 71
last_upload: 259200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0150_1981050100_123_950_12166794_1_r313015234
The child process has been launched with process id: 20563
Executing the command: /var/lib/boinc-client/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:X450J:1:1:20563:20563] [20221229:173901:1672306741:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
17:41:46 STEP 72 H= 72:00 +CPU= 46.603
17:45:14 STEP 73 H= 73:00 +CPU= 27.284
17:47:45 STEP 74 H= 74:00 +CPU= 26.922
17:51:22 STEP 75 H= 75:00 +CPU= 42.487
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:54:12 STEP 76 H= 76:00 +CPU= 29.302
17:56:38 STEP 77 H= 77:00 +CPU= 27.718
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:58:26 STEP 78 H= 78:00 +CPU= 39.213
17:59:26 STEP 79 H= 79:00 +CPU= 24.445
18:00:38 STEP 80 H= 80:00 +CPU= 24.613
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:02:42 STEP 81 H= 81:00 +CPU= 37.930
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:04:00 STEP 82 H= 82:00 +CPU= 24.998
18:04:35 STEP 83 H= 83:00 +CPU= 21.707
18:06:12 STEP 84 H= 84:00 +CPU= 44.339
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000084
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000084
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000084
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:07:02 STEP 85 H= 85:00 +CPU= 23.522
18:07:26 STEP 86 H= 86:00 +CPU= 21.201
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:10:05 STEP 87 H= 87:00 +CPU= 38.817
18:11:38 STEP 88 H= 88:00 +CPU= 25.281
18:12:04 STEP 89 H= 89:00 +CPU= 20.573
18:12:46 STEP 90 H= 90:00 +CPU= 34.543
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:14:15 STEP 91 H= 91:00 +CPU= 25.288
18:14:47 STEP 92 H= 92:00 +CPU= 22.093
18:16:10 STEP 93 H= 93:00 +CPU= 37.162
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:16:48 STEP 94 H= 94:00 +CPU= 20.818
18:18:21 STEP 95 H= 95:00 +CPU= 25.658
18:21:39 STEP 96 H= 96:00 +CPU= 45.486
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+000096
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+000096
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+000096
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMGGhq0f+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMSHhq0f+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMUAhq0f+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMGGhq0f+000084
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMSHhq0f+000084
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794/ICMUAhq0f+000084
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0150_1981050100_123_950_12166794_1_r313015234_3.zip
Uploading the intermediate file: upload_file_3.zip
18:22:11 STEP 97 H= 97:00 +CPU= 20.659
18:23:40 STEP 98 H= 98:00 +CPU= 24.968
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:43:48 STEP 99 H= 99:00 +CPU= 54.905
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
19:00:32 STEP 100 H= 100:00 +CPU= 38.319
19:15:47 STEP 101 H= 101:00 +CPU= 35.566
19:41:34 STEP 102 H= 102:00 +CPU= 62.079
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1981050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0150
(argv4) batchid: 950
(argv5) wuid: 12166794
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/1
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_08a6088337946996739f075f4d8f6412 to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0150_1981050100_123_950_12166794.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0150_1981050100_123_950_12166794.zip
ic_ancil_file: ic_ancil_12166794
ifsdata_file: ifsdata_12166794
climate_data_file: clim_data_12166794
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_95ec41f2d46284ee310630af900f543d to: /var/lib/boinc-client/slots/1/ic_ancil_12166794.zip
double free or corruption (top)
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1981050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0150
(argv4) batchid: 950
(argv5) wuid: 12166794
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/1
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166794
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_08a6088337946996739f075f4d8f6412 to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0150_1981050100_123_950_12166794.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0150_1981050100_123_950_12166794.zip
ic_ancil_file: ic_ancil_12166794
ifsdata_file: ifsdata_12166794
climate_data_file: clim_data_12166794
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: to: /var/lib/boinc-client/slots/1/ic_ancil_12166794.zip
..Copying the IC ancils to the working directory failed
</stderr_txt>
]]>
