<core_client_version>7.20.2</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
_app_1.05_x86_64-pc-linux-gnu.zip to: /media/public/BOINC/slots/13/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /media/public/BOINC/slots/13/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_8efb97eaf3d998a3c710949d98ef1c8c to: /media/public/BOINC/slots/13/oifs_43r3_ps_0340_1995050100_123_964_12180984.zip
Unzipping the namelist zip file: /media/public/BOINC/slots/13/oifs_43r3_ps_0340_1995050100_123_964_12180984.zip
ic_ancil_file: ic_ancil_12180984
ifsdata_file: ifsdata_12180984
climate_data_file: clim_data_12180984
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_b06a60329d87cc22aeef4675ca3d2f47 to: /media/public/BOINC/slots/13/ic_ancil_12180984.zip
Unzipping the IC ancils zip file: /media/public/BOINC/slots/13/ic_ancil_12180984.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_228f991c7292bc7f1f0e182c59110846 to: /media/public/BOINC/slots/13/ifsdata/ifsdata_12180984.zip
Unzipping the ifsdata_zip file: /media/public/BOINC/slots/13/ifsdata/ifsdata_12180984.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /media/public/BOINC/slots/13/159l_2/clim_data_12180984.zip
Unzipping the climate data zip file: /media/public/BOINC/slots/13/159l_2/clim_data_12180984.zip
Checking for progress XML file: /media/public/BOINC/slots/13/progress_file_12180984.xml
Opened progress file ok : /media/public/BOINC/slots/13/progress_file_12180984.xml
-- Model is restarting --
Adjusting last_iter, 0, to previous model restart step.
Creating progress file: /media/public/BOINC/slots/13/progress_file_12180984.xml
last_cpu_time: 16
upload_file_number: 0
last_iter: -1
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0340_1995050100_123_964_12180984_0_r709651202
The child process has been launched with process id: 69681
Executing the command: /media/public/BOINC/slots/13/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:sobek:1:1:69681:69681] [20230131:014809:1675129689:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1995050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0340
(argv4) batchid: 964
(argv5) wuid: 12180984
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /media/public/BOINC/slots/13
Project directory is: /media/public/BOINC/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984
..mkdir for temp folder for results failed
Copying: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /media/public/BOINC/slots/13/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /media/public/BOINC/slots/13/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_8efb97eaf3d998a3c710949d98ef1c8c to: /media/public/BOINC/slots/13/oifs_43r3_ps_0340_1995050100_123_964_12180984.zip
Unzipping the namelist zip file: /media/public/BOINC/slots/13/oifs_43r3_ps_0340_1995050100_123_964_12180984.zip
ic_ancil_file: ic_ancil_12180984
ifsdata_file: ifsdata_12180984
climate_data_file: clim_data_12180984
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_b06a60329d87cc22aeef4675ca3d2f47 to: /media/public/BOINC/slots/13/ic_ancil_12180984.zip
Unzipping the IC ancils zip file: /media/public/BOINC/slots/13/ic_ancil_12180984.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_228f991c7292bc7f1f0e182c59110846 to: /media/public/BOINC/slots/13/ifsdata/ifsdata_12180984.zip
Unzipping the ifsdata_zip file: /media/public/BOINC/slots/13/ifsdata/ifsdata_12180984.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /media/public/BOINC/slots/13/159l_2/clim_data_12180984.zip
Unzipping the climate data zip file: /media/public/BOINC/slots/13/159l_2/clim_data_12180984.zip
Checking for progress XML file: /media/public/BOINC/slots/13/progress_file_12180984.xml
Opened progress file ok : /media/public/BOINC/slots/13/progress_file_12180984.xml
-- Model is restarting --
Adjusting last_iter, 0, to previous model restart step.
Creating progress file: /media/public/BOINC/slots/13/progress_file_12180984.xml
last_cpu_time: 24
upload_file_number: 0
last_iter: -1
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0340_1995050100_123_964_12180984_0_r709651202
The child process has been launched with process id: 69728
Executing the command: /media/public/BOINC/slots/13/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:sobek:1:1:69728:69728] [20230131:015017:1675129817:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1995050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0340
(argv4) batchid: 964
(argv5) wuid: 12180984
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /media/public/BOINC/slots/13
Project directory is: /media/public/BOINC/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984
..mkdir for temp folder for results failed
Copying: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /media/public/BOINC/slots/13/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /media/public/BOINC/slots/13/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_8efb97eaf3d998a3c710949d98ef1c8c to: /media/public/BOINC/slots/13/oifs_43r3_ps_0340_1995050100_123_964_12180984.zip
Unzipping the namelist zip file: /media/public/BOINC/slots/13/oifs_43r3_ps_0340_1995050100_123_964_12180984.zip
ic_ancil_file: ic_ancil_12180984
ifsdata_file: ifsdata_12180984
climate_data_file: clim_data_12180984
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_b06a60329d87cc22aeef4675ca3d2f47 to: /media/public/BOINC/slots/13/ic_ancil_12180984.zip
Unzipping the IC ancils zip file: /media/public/BOINC/slots/13/ic_ancil_12180984.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_228f991c7292bc7f1f0e182c59110846 to: /media/public/BOINC/slots/13/ifsdata/ifsdata_12180984.zip
Unzipping the ifsdata_zip file: /media/public/BOINC/slots/13/ifsdata/ifsdata_12180984.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /media/public/BOINC/slots/13/159l_2/clim_data_12180984.zip
Unzipping the climate data zip file: /media/public/BOINC/slots/13/159l_2/clim_data_12180984.zip
Checking for progress XML file: /media/public/BOINC/slots/13/progress_file_12180984.xml
Opened progress file ok : /media/public/BOINC/slots/13/progress_file_12180984.xml
-- Model is restarting --
Adjusting last_iter, 0, to previous model restart step.
Creating progress file: /media/public/BOINC/slots/13/progress_file_12180984.xml
last_cpu_time: 32
upload_file_number: 0
last_iter: -1
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0340_1995050100_123_964_12180984_0_r709651202
The child process has been launched with process id: 69768
Executing the command: /media/public/BOINC/slots/13/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:sobek:1:1:69768:69768] [20230131:015308:1675129988:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
01:53:41 STEP 0 H= 0:00 +CPU= 30.355
Moving to projects directory: /media/public/BOINC/slots/13/ICMGGhq0f+000000
Moving to projects directory: /media/public/BOINC/slots/13/ICMSHhq0f+000000
01:54:16 STEP 1 H= 1:00 +CPU= 21.029
01:54:36 STEP 2 H= 2:00 +CPU= 19.128
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1995050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0340
(argv4) batchid: 964
(argv5) wuid: 12180984
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /media/public/BOINC/slots/13
Project directory is: /media/public/BOINC/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984
..mkdir for temp folder for results failed
Copying: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /media/public/BOINC/slots/13/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /media/public/BOINC/slots/13/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_8efb97eaf3d998a3c710949d98ef1c8c to: /media/public/BOINC/slots/13/oifs_43r3_ps_0340_1995050100_123_964_12180984.zip
Unzipping the namelist zip file: /media/public/BOINC/slots/13/oifs_43r3_ps_0340_1995050100_123_964_12180984.zip
ic_ancil_file: ic_ancil_12180984
ifsdata_file: ifsdata_12180984
climate_data_file: clim_data_12180984
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_b06a60329d87cc22aeef4675ca3d2f47 to: /media/public/BOINC/slots/13/ic_ancil_12180984.zip
Unzipping the IC ancils zip file: /media/public/BOINC/slots/13/ic_ancil_12180984.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_228f991c7292bc7f1f0e182c59110846 to: /media/public/BOINC/slots/13/ifsdata/ifsdata_12180984.zip
Unzipping the ifsdata_zip file: /media/public/BOINC/slots/13/ifsdata/ifsdata_12180984.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /media/public/BOINC/slots/13/159l_2/clim_data_12180984.zip
Unzipping the climate data zip file: /media/public/BOINC/slots/13/159l_2/clim_data_12180984.zip
Checking for progress XML file: /media/public/BOINC/slots/13/progress_file_12180984.xml
Opened progress file ok : /media/public/BOINC/slots/13/progress_file_12180984.xml
-- Model is restarting --
Adjusting last_iter, 0, to previous model restart step.
Creating progress file: /media/public/BOINC/slots/13/progress_file_12180984.xml
last_cpu_time: 59
upload_file_number: 0
last_iter: -1
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0340_1995050100_123_964_12180984_0_r709651202
The child process has been launched with process id: 27007
Executing the command: /media/public/BOINC/slots/13/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:fedora:1:1:27007:27007] [20230131:202345:1675196625:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
20:24:31 STEP 0 H= 0:00 +CPU= 40.851
Moving to projects directory: /media/public/BOINC/slots/13/ICMGGhq0f+000000
Moving to projects directory: /media/public/BOINC/slots/13/ICMSHhq0f+000000
20:25:18 STEP 1 H= 1:00 +CPU= 29.773
Moving to projects directory: /media/public/BOINC/slots/13/ICMUAhq0f+000000
20:25:50 STEP 2 H= 2:00 +CPU= 26.028
20:26:32 STEP 3 H= 3:00 +CPU= 38.848
20:26:59 STEP 4 H= 4:00 +CPU= 25.677
20:27:25 STEP 5 H= 5:00 +CPU= 25.299
20:28:07 STEP 6 H= 6:00 +CPU= 39.749
20:28:33 STEP 7 H= 7:00 +CPU= 24.993
20:28:59 STEP 8 H= 8:00 +CPU= 25.520
20:29:38 STEP 9 H= 9:00 +CPU= 38.074
20:30:04 STEP 10 H= 10:00 +CPU= 25.500
20:30:29 STEP 11 H= 11:00 +CPU= 24.435
20:31:14 STEP 12 H= 12:00 +CPU= 42.642
Moving to projects directory: /media/public/BOINC/slots/13/ICMGGhq0f+000012
Moving to projects directory: /media/public/BOINC/slots/13/ICMSHhq0f+000012
Moving to projects directory: /media/public/BOINC/slots/13/ICMUAhq0f+000012
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1995050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0340
(argv4) batchid: 964
(argv5) wuid: 12180984
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /media/public/BOINC/slots/13
Project directory is: /media/public/BOINC/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984
..mkdir for temp folder for results failed
Copying: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /media/public/BOINC/slots/13/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /media/public/BOINC/slots/13/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_8efb97eaf3d998a3c710949d98ef1c8c to: /media/public/BOINC/slots/13/oifs_43r3_ps_0340_1995050100_123_964_12180984.zip
Unzipping the namelist zip file: /media/public/BOINC/slots/13/oifs_43r3_ps_0340_1995050100_123_964_12180984.zip
ic_ancil_file: ic_ancil_12180984
ifsdata_file: ifsdata_12180984
climate_data_file: clim_data_12180984
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_b06a60329d87cc22aeef4675ca3d2f47 to: /media/public/BOINC/slots/13/ic_ancil_12180984.zip
Unzipping the IC ancils zip file: /media/public/BOINC/slots/13/ic_ancil_12180984.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_228f991c7292bc7f1f0e182c59110846 to: /media/public/BOINC/slots/13/ifsdata/ifsdata_12180984.zip
Unzipping the ifsdata_zip file: /media/public/BOINC/slots/13/ifsdata/ifsdata_12180984.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /media/public/BOINC/slots/13/159l_2/clim_data_12180984.zip
Unzipping the climate data zip file: /media/public/BOINC/slots/13/159l_2/clim_data_12180984.zip
Checking for progress XML file: /media/public/BOINC/slots/13/progress_file_12180984.xml
Opened progress file ok : /media/public/BOINC/slots/13/progress_file_12180984.xml
-- Model is restarting --
Adjusting last_iter, 13, to previous model restart step.
Creating progress file: /media/public/BOINC/slots/13/progress_file_12180984.xml
last_cpu_time: 474
upload_file_number: 0
last_iter: -1
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0340_1995050100_123_964_12180984_0_r709651202
The child process has been launched with process id: 3820
Executing the command: /media/public/BOINC/slots/13/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:fedora:1:1:3820:3820] [20230131:203351:1675197231:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
20:34:37 STEP 0 H= 0:00 +CPU= 40.864
Moving to projects directory: /media/public/BOINC/slots/13/ICMGGhq0f+000000
Moving to projects directory: /media/public/BOINC/slots/13/ICMSHhq0f+000000
Moving to projects directory: /media/public/BOINC/slots/13/ICMUAhq0f+000000
20:35:08 STEP 1 H= 1:00 +CPU= 29.387
20:35:36 STEP 2 H= 2:00 +CPU= 26.222
20:36:15 STEP 3 H= 3:00 +CPU= 38.013
20:36:41 STEP 4 H= 4:00 +CPU= 25.571
20:37:08 STEP 5 H= 5:00 +CPU= 25.472
20:37:48 STEP 6 H= 6:00 +CPU= 38.683
20:38:14 STEP 7 H= 7:00 +CPU= 24.854
20:38:40 STEP 8 H= 8:00 +CPU= 25.329
20:39:18 STEP 9 H= 9:00 +CPU= 37.425
20:39:45 STEP 10 H= 10:00 +CPU= 25.498
20:40:10 STEP 11 H= 11:00 +CPU= 24.716
20:40:53 STEP 12 H= 12:00 +CPU= 41.451
Moving to projects directory: /media/public/BOINC/slots/13/ICMGGhq0f+000012
Moving to projects directory: /media/public/BOINC/slots/13/ICMSHhq0f+000012
Moving to projects directory: /media/public/BOINC/slots/13/ICMUAhq0f+000012
20:41:19 STEP 13 H= 13:00 +CPU= 25.123
20:41:46 STEP 14 H= 14:00 +CPU= 25.862
20:42:26 STEP 15 H= 15:00 +CPU= 38.823
20:42:56 STEP 16 H= 16:00 +CPU= 26.413
20:43:21 STEP 17 H= 17:00 +CPU= 24.445
20:44:01 STEP 18 H= 18:00 +CPU= 39.220
20:44:27 STEP 19 H= 19:00 +CPU= 25.050
20:44:54 STEP 20 H= 20:00 +CPU= 26.220
20:45:34 STEP 21 H= 21:00 +CPU= 38.355
20:46:00 STEP 22 H= 22:00 +CPU= 25.614
20:46:27 STEP 23 H= 23:00 +CPU= 25.658
20:47:19 STEP 24 H= 24:00 +CPU= 44.962
Moving to projects directory: /media/public/BOINC/slots/13/ICMGGhq0f+000024
Moving to projects directory: /media/public/BOINC/slots/13/ICMSHhq0f+000024
Moving to projects directory: /media/public/BOINC/slots/13/ICMUAhq0f+000024
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMGGhq0f+000000
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMSHhq0f+000000
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMUAhq0f+000000
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMGGhq0f+000012
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMSHhq0f+000012
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMUAhq0f+000012
Zipping up the intermediate file: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_0340_1995050100_123_964_12180984_0_r709651202_0.zip
Uploading the intermediate file: upload_file_0.zip
20:47:45 STEP 25 H= 25:00 +CPU= 25.003
20:48:11 STEP 26 H= 26:00 +CPU= 25.683
20:48:50 STEP 27 H= 27:00 +CPU= 37.931
20:49:17 STEP 28 H= 28:00 +CPU= 26.129
20:49:43 STEP 29 H= 29:00 +CPU= 25.150
20:50:25 STEP 30 H= 30:00 +CPU= 39.206
20:50:51 STEP 31 H= 31:00 +CPU= 25.216
20:51:18 STEP 32 H= 32:00 +CPU= 25.983
20:51:56 STEP 33 H= 33:00 +CPU= 37.674
20:52:23 STEP 34 H= 34:00 +CPU= 26.062
20:52:49 STEP 35 H= 35:00 +CPU= 25.281
20:53:33 STEP 36 H= 36:00 +CPU= 42.705
Moving to projects directory: /media/public/BOINC/slots/13/ICMGGhq0f+000036
Moving to projects directory: /media/public/BOINC/slots/13/ICMSHhq0f+000036
Moving to projects directory: /media/public/BOINC/slots/13/ICMUAhq0f+000036
20:53:58 STEP 37 H= 37:00 +CPU= 25.125
20:54:25 STEP 38 H= 38:00 +CPU= 25.426
20:55:04 STEP 39 H= 39:00 +CPU= 38.223
20:55:30 STEP 40 H= 40:00 +CPU= 25.927
20:55:56 STEP 41 H= 41:00 +CPU= 25.654
20:56:36 STEP 42 H= 42:00 +CPU= 38.770
20:57:01 STEP 43 H= 43:00 +CPU= 25.288
20:57:28 STEP 44 H= 44:00 +CPU= 25.814
20:58:07 STEP 45 H= 45:00 +CPU= 38.730
20:58:33 STEP 46 H= 46:00 +CPU= 25.260
20:59:00 STEP 47 H= 47:00 +CPU= 26.479
20:59:48 STEP 48 H= 48:00 +CPU= 45.363
Moving to projects directory: /media/public/BOINC/slots/13/ICMGGhq0f+000048
Moving to projects directory: /media/public/BOINC/slots/13/ICMSHhq0f+000048
Moving to projects directory: /media/public/BOINC/slots/13/ICMUAhq0f+000048
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMGGhq0f+000024
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMSHhq0f+000024
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMUAhq0f+000024
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMGGhq0f+000036
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMSHhq0f+000036
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMUAhq0f+000036
Zipping up the intermediate file: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_0340_1995050100_123_964_12180984_0_r709651202_1.zip
Uploading the intermediate file: upload_file_1.zip
21:00:14 STEP 49 H= 49:00 +CPU= 25.178
21:00:41 STEP 50 H= 50:00 +CPU= 26.081
21:01:21 STEP 51 H= 51:00 +CPU= 38.631
21:01:48 STEP 52 H= 52:00 +CPU= 25.963
21:02:15 STEP 53 H= 53:00 +CPU= 26.280
21:02:56 STEP 54 H= 54:00 +CPU= 39.188
21:03:22 STEP 55 H= 55:00 +CPU= 24.825
21:03:49 STEP 56 H= 56:00 +CPU= 26.005
21:04:29 STEP 57 H= 57:00 +CPU= 38.726
21:04:58 STEP 58 H= 58:00 +CPU= 26.410
21:05:25 STEP 59 H= 59:00 +CPU= 25.458
21:06:11 STEP 60 H= 60:00 +CPU= 43.599
Moving to projects directory: /media/public/BOINC/slots/13/ICMGGhq0f+000060
Moving to projects directory: /media/public/BOINC/slots/13/ICMSHhq0f+000060
Moving to projects directory: /media/public/BOINC/slots/13/ICMUAhq0f+000060
21:06:39 STEP 61 H= 61:00 +CPU= 26.014
21:07:10 STEP 62 H= 62:00 +CPU= 27.225
21:07:51 STEP 63 H= 63:00 +CPU= 39.532
21:08:17 STEP 64 H= 64:00 +CPU= 25.901
21:08:45 STEP 65 H= 65:00 +CPU= 25.765
21:09:31 STEP 66 H= 66:00 +CPU= 40.560
21:10:01 STEP 67 H= 67:00 +CPU= 26.034
21:10:33 STEP 68 H= 68:00 +CPU= 27.227
21:11:20 STEP 69 H= 69:00 +CPU= 39.984
21:11:54 STEP 70 H= 70:00 +CPU= 28.272
21:12:30 STEP 71 H= 71:00 +CPU= 28.520
21:13:28 STEP 72 H= 72:00 +CPU= 48.627
Moving to projects directory: /media/public/BOINC/slots/13/ICMGGhq0f+000072
Moving to projects directory: /media/public/BOINC/slots/13/ICMSHhq0f+000072
Moving to projects directory: /media/public/BOINC/slots/13/ICMUAhq0f+000072
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMGGhq0f+000048
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMSHhq0f+000048
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMUAhq0f+000048
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMGGhq0f+000060
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMSHhq0f+000060
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMUAhq0f+000060
Zipping up the intermediate file: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_0340_1995050100_123_964_12180984_0_r709651202_2.zip
Uploading the intermediate file: upload_file_2.zip
21:13:59 STEP 73 H= 73:00 +CPU= 26.851
21:14:31 STEP 74 H= 74:00 +CPU= 27.852
21:15:15 STEP 75 H= 75:00 +CPU= 40.545
21:15:43 STEP 76 H= 76:00 +CPU= 26.027
21:16:09 STEP 77 H= 77:00 +CPU= 25.655
21:16:50 STEP 78 H= 78:00 +CPU= 39.330
21:17:17 STEP 79 H= 79:00 +CPU= 25.605
21:17:44 STEP 80 H= 80:00 +CPU= 26.491
21:18:28 STEP 81 H= 81:00 +CPU= 39.906
21:18:57 STEP 82 H= 82:00 +CPU= 26.679
21:19:28 STEP 83 H= 83:00 +CPU= 26.834
21:20:25 STEP 84 H= 84:00 +CPU= 45.962
Moving to projects directory: /media/public/BOINC/slots/13/ICMGGhq0f+000084
Moving to projects directory: /media/public/BOINC/slots/13/ICMSHhq0f+000084
Moving to projects directory: /media/public/BOINC/slots/13/ICMUAhq0f+000084
21:20:52 STEP 85 H= 85:00 +CPU= 25.837
21:21:21 STEP 86 H= 86:00 +CPU= 26.766
21:22:03 STEP 87 H= 87:00 +CPU= 40.006
21:22:31 STEP 88 H= 88:00 +CPU= 27.017
21:22:58 STEP 89 H= 89:00 +CPU= 25.562
21:23:41 STEP 90 H= 90:00 +CPU= 40.691
21:24:08 STEP 91 H= 91:00 +CPU= 25.893
21:24:37 STEP 92 H= 92:00 +CPU= 26.713
21:25:21 STEP 93 H= 93:00 +CPU= 40.325
21:25:51 STEP 94 H= 94:00 +CPU= 27.171
21:26:23 STEP 95 H= 95:00 +CPU= 28.207
21:27:27 STEP 96 H= 96:00 +CPU= 51.451
Moving to projects directory: /media/public/BOINC/slots/13/ICMGGhq0f+000096
Moving to projects directory: /media/public/BOINC/slots/13/ICMSHhq0f+000096
Moving to projects directory: /media/public/BOINC/slots/13/ICMUAhq0f+000096
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMGGhq0f+000072
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMSHhq0f+000072
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMUAhq0f+000072
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMGGhq0f+000084
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMSHhq0f+000084
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMUAhq0f+000084
Zipping up the intermediate file: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_0340_1995050100_123_964_12180984_0_r709651202_3.zip
Uploading the intermediate file: upload_file_3.zip
21:28:02 STEP 97 H= 97:00 +CPU= 29.427
21:28:40 STEP 98 H= 98:00 +CPU= 30.939
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:30:12 STEP 99 H= 99:00 +CPU= 46.264
21:31:03 STEP 100 H= 100:00 +CPU= 32.991
21:31:50 STEP 101 H= 101:00 +CPU= 32.355
21:32:48 STEP 102 H= 102:00 +CPU= 46.496
21:33:23 STEP 103 H= 103:00 +CPU= 29.709
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:35:32 STEP 104 H= 104:00 +CPU= 35.265
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:36:50 STEP 105 H= 105:00 +CPU= 48.339
21:37:34 STEP 106 H= 106:00 +CPU= 32.922
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:38:40 STEP 107 H= 107:00 +CPU= 32.396
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:41:06 STEP 108 H= 108:00 +CPU= 51.067
Moving to projects directory: /media/public/BOINC/slots/13/ICMGGhq0f+000108
Moving to projects directory: /media/public/BOINC/slots/13/ICMSHhq0f+000108
Moving to projects directory: /media/public/BOINC/slots/13/ICMUAhq0f+000108
21:41:41 STEP 109 H= 109:00 +CPU= 29.763
21:42:18 STEP 110 H= 110:00 +CPU= 30.817
21:43:09 STEP 111 H= 111:00 +CPU= 44.462
21:43:43 STEP 112 H= 112:00 +CPU= 29.826
21:44:16 STEP 113 H= 113:00 +CPU= 29.018
21:45:09 STEP 114 H= 114:00 +CPU= 45.643
21:45:43 STEP 115 H= 115:00 +CPU= 29.391
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:48:01 STEP 116 H= 116:00 +CPU= 35.052
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:50:16 STEP 117 H= 117:00 +CPU= 50.970
21:50:55 STEP 118 H= 118:00 +CPU= 31.943
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:51:50 STEP 119 H= 119:00 +CPU= 32.476
21:53:03 STEP 120 H= 120:00 +CPU= 55.259
Moving to projects directory: /media/public/BOINC/slots/13/ICMGGhq0f+000120
Moving to projects directory: /media/public/BOINC/slots/13/ICMSHhq0f+000120
Moving to projects directory: /media/public/BOINC/slots/13/ICMUAhq0f+000120
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMGGhq0f+000096
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMSHhq0f+000096
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMUAhq0f+000096
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMGGhq0f+000108
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMSHhq0f+000108
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMUAhq0f+000108
Zipping up the intermediate file: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_0340_1995050100_123_964_12180984_0_r709651202_4.zip
Uploading the intermediate file: upload_file_4.zip
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:54:08 STEP 121 H= 121:00 +CPU= 29.466
21:54:46 STEP 122 H= 122:00 +CPU= 30.970
21:55:43 STEP 123 H= 123:00 +CPU= 46.109
21:56:19 STEP 124 H= 124:00 +CPU= 31.067
21:56:52 STEP 125 H= 125:00 +CPU= 29.643
21:57:46 STEP 126 H= 126:00 +CPU= 45.676
21:58:22 STEP 127 H= 127:00 +CPU= 29.838
21:58:59 STEP 128 H= 128:00 +CPU= 30.552
21:59:51 STEP 129 H= 129:00 +CPU= 44.672
22:00:28 STEP 130 H= 130:00 +CPU= 30.651
22:01:03 STEP 131 H= 131:00 +CPU= 29.736
22:02:01 STEP 132 H= 132:00 +CPU= 49.607
Moving to projects directory: /media/public/BOINC/slots/13/ICMGGhq0f+000132
Moving to projects directory: /media/public/BOINC/slots/13/ICMSHhq0f+000132
Moving to projects directory: /media/public/BOINC/slots/13/ICMUAhq0f+000132
22:02:35 STEP 133 H= 133:00 +CPU= 29.554
22:03:11 STEP 134 H= 134:00 +CPU= 30.806
22:04:04 STEP 135 H= 135:00 +CPU= 45.056
22:04:41 STEP 136 H= 136:00 +CPU= 30.493
22:05:16 STEP 137 H= 137:00 +CPU= 29.842
22:06:09 STEP 138 H= 138:00 +CPU= 45.805
22:06:43 STEP 139 H= 139:00 +CPU= 29.090
22:07:18 STEP 140 H= 140:00 +CPU= 30.235
22:08:11 STEP 141 H= 141:00 +CPU= 45.008
22:08:46 STEP 142 H= 142:00 +CPU= 30.318
22:09:22 STEP 143 H= 143:00 +CPU= 30.265
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:10:43 STEP 144 H= 144:00 +CPU= 51.469
Moving to projects directory: /media/public/BOINC/slots/13/ICMGGhq0f+000144
Moving to projects directory: /media/public/BOINC/slots/13/ICMSHhq0f+000144
Moving to projects directory: /media/public/BOINC/slots/13/ICMUAhq0f+000144
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMGGhq0f+000120
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMSHhq0f+000120
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMUAhq0f+000120
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMGGhq0f+000132
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMSHhq0f+000132
Adding to the zip: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_12180984/ICMUAhq0f+000132
Zipping up the intermediate file: /media/public/BOINC/projects/climateprediction.net/oifs_43r3_ps_0340_1995050100_123_964_12180984_0_r709651202_5.zip
Uploading the intermediate file: upload_file_5.zip
22:11:19 STEP 145 H= 145:00 +CPU= 27.308
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
The child process terminated with status: 0
..Failed, model did not complete successfully
</stderr_txt>
]]>
