<core_client_version>7.24.1</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
Unknown Unknown
oifs_43r3_model.e 0000000000AB8B1D verint_ 168 verint.F90
oifs_43r3_model.e 0000000000D310D5 gpgrgeo_ 259 gpgrgeo.F90
oifs_43r3_model.e 0000000000D0FCDB cpg_gp_ 832 cpg_gp.F90
oifs_43r3_model.e 0000000000C2432E cpg_ 627 cpg.F90
oifs_43r3_model.e 0000000000C22238 cpg_drv_ 351 cpg_drv.F90
oifs_43r3_model.e 0000000000BCC914 gp_model_ 419 gp_model.F90
oifs_43r3_model.e 00000000012C5002 gp_model_heap_ 74 gp_model_heap.F90
oifs_43r3_model.e 0000000000BACBAE scan2m_ 535 scan2m.F90
oifs_43r3_model.e 0000000000688153 stepo_ 327 stepo.F90
oifs_43r3_model.e 00000000004CD1DC cnt4_ 1133 cnt4.F90
oifs_43r3_model.e 00000000004B5D85 cnt3_ 267 cnt3.F90
oifs_43r3_model.e 00000000004B4F52 cnt2_ 88 cnt2.F90
oifs_43r3_model.e 000000000049D638 cnt1_ 92 cnt1.F90
oifs_43r3_model.e 0000000000406FBD cnt0_ 146 cnt0.F90
oifs_43r3_model.e 0000000000401E7F MAIN__ 96 master.F90
oifs_43r3_model.e 0000000000401E12 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DCC34A Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DCDBE7 Unknown Unknown Unknown
oifs_43r3_model.e 0000000000401CD5 Unknown Unknown Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a3m2
(argv4) batchid: 1018
(argv5) wuid: 12293009
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/3
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/3/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/3/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_76db5cc3cc5f3e1e8c282a485c433ab7 to: /var/lib/boinc-client/slots/3/oifs_43r3_bl_a3m2_2016092300_20_1018_12293009.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/3/oifs_43r3_bl_a3m2_2016092300_20_1018_12293009.zip
ic_ancil_file: ic_ancil_12293009
ifsdata_file: ifsdata_12293009
climate_data_file: clim_data_12293009
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/3/ic_ancil_12293009.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/3/ic_ancil_12293009.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_cb0fd0b4e71ae90ef18a98c8f86d81f7 to: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12293009.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12293009.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/3/159l_2/clim_data_12293009.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/3/159l_2/clim_data_12293009.zip
Checking for progress XML file: /var/lib/boinc-client/slots/3/progress_file_12293009.xml
Opened progress file ok : /var/lib/boinc-client/slots/3/progress_file_12293009.xml
-- Model is restarting --
Adjusting last_iter, 866, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/3/progress_file_12293009.xml
last_cpu_time: 15394
upload_file_number: 9
last_iter: 865
last_upload: 777600
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a3m2_2016092300_20_1018_12293009_2_r396485625
The child process has been launched with process id: 2743
Executing the command: /var/lib/boinc-client/slots/3/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:2743:2743] [20240816:182132:1723825292:0.001] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
18:21:58 STEP 864 H= 216:00 +CPU= 16.735
18:22:33 STEP 865 H= 216:15 +CPU= 16.204
18:23:11 STEP 866 H= 216:30 +CPU= 16.064
18:23:38 STEP 867 H= 216:45 +CPU= 16.012
18:24:09 STEP 868 H= 217:00 +CPU= 16.550
18:24:57 STEP 869 H= 217:15 +CPU= 16.117
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:26:22 STEP 870 H= 217:30 +CPU= 16.225
18:26:45 STEP 871 H= 217:45 +CPU= 15.927
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:28:15 STEP 872 H= 218:00 +CPU= 16.640
18:29:47 STEP 873 H= 218:15 +CPU= 16.379
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:30:52 STEP 874 H= 218:30 +CPU= 16.005
18:31:45 STEP 875 H= 218:45 +CPU= 15.973
18:33:50 STEP 876 H= 219:00 +CPU= 20.812
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000876
18:35:29 STEP 877 H= 219:15 +CPU= 16.524
18:37:05 STEP 878 H= 219:30 +CPU= 16.430
18:38:41 STEP 879 H= 219:45 +CPU= 16.489
18:39:59 STEP 880 H= 220:00 +CPU= 16.776
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:41:14 STEP 881 H= 220:15 +CPU= 16.184
18:42:53 STEP 882 H= 220:30 +CPU= 16.484
18:44:30 STEP 883 H= 220:45 +CPU= 16.530
18:46:11 STEP 884 H= 221:00 +CPU= 16.938
18:47:49 STEP 885 H= 221:15 +CPU= 16.498
18:49:28 STEP 886 H= 221:30 +CPU= 16.518
18:51:05 STEP 887 H= 221:45 +CPU= 16.539
18:53:08 STEP 888 H= 222:00 +CPU= 20.825
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000888
18:54:43 STEP 889 H= 222:15 +CPU= 16.454
18:56:22 STEP 890 H= 222:30 +CPU= 16.508
18:57:58 STEP 891 H= 222:45 +CPU= 16.487
18:59:38 STEP 892 H= 223:00 +CPU= 17.002
19:01:10 STEP 893 H= 223:15 +CPU= 16.448
19:02:46 STEP 894 H= 223:30 +CPU= 16.545
19:04:22 STEP 895 H= 223:45 +CPU= 16.529
19:06:03 STEP 896 H= 224:00 +CPU= 17.017
19:07:37 STEP 897 H= 224:15 +CPU= 16.435
19:09:16 STEP 898 H= 224:30 +CPU= 16.562
19:10:55 STEP 899 H= 224:45 +CPU= 16.541
19:12:57 STEP 900 H= 225:00 +CPU= 20.891
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000900
19:14:35 STEP 901 H= 225:15 +CPU= 16.501
19:16:12 STEP 902 H= 225:30 +CPU= 16.573
19:17:50 STEP 903 H= 225:45 +CPU= 16.592
19:19:28 STEP 904 H= 226:00 +CPU= 16.976
19:21:06 STEP 905 H= 226:15 +CPU= 16.595
19:22:37 STEP 906 H= 226:30 +CPU= 16.579
19:24:17 STEP 907 H= 226:45 +CPU= 16.688
19:25:56 STEP 908 H= 227:00 +CPU= 17.062
19:27:35 STEP 909 H= 227:15 +CPU= 16.641
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
19:28:15 STEP 910 H= 227:30 +CPU= 16.131
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
19:29:49 STEP 911 H= 227:45 +CPU= 16.456
19:32:09 STEP 912 H= 228:00 +CPU= 23.642
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000912
19:33:49 STEP 913 H= 228:15 +CPU= 16.612
19:35:27 STEP 914 H= 228:30 +CPU= 16.600
19:37:07 STEP 915 H= 228:45 +CPU= 16.595
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
19:38:11 STEP 916 H= 229:00 +CPU= 16.651
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
19:39:49 STEP 917 H= 229:15 +CPU= 16.338
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
19:41:30 STEP 918 H= 229:30 +CPU= 16.401
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
19:42:31 STEP 919 H= 229:45 +CPU= 16.147
19:43:39 STEP 920 H= 230:00 +CPU= 16.794
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
19:45:32 STEP 921 H= 230:15 +CPU= 16.530
19:47:07 STEP 922 H= 230:30 +CPU= 16.530
19:48:46 STEP 923 H= 230:45 +CPU= 16.620
19:50:51 STEP 924 H= 231:00 +CPU= 20.922
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000924
19:52:24 STEP 925 H= 231:15 +CPU= 16.520
19:54:04 STEP 926 H= 231:30 +CPU= 16.597
19:55:41 STEP 927 H= 231:45 +CPU= 16.675
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a3m2
(argv4) batchid: 1018
(argv5) wuid: 12293009
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/3
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/3/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/3/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_76db5cc3cc5f3e1e8c282a485c433ab7 to: /var/lib/boinc-client/slots/3/oifs_43r3_bl_a3m2_2016092300_20_1018_12293009.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/3/oifs_43r3_bl_a3m2_2016092300_20_1018_12293009.zip
ic_ancil_file: ic_ancil_12293009
ifsdata_file: ifsdata_12293009
climate_data_file: clim_data_12293009
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/3/ic_ancil_12293009.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/3/ic_ancil_12293009.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_cb0fd0b4e71ae90ef18a98c8f86d81f7 to: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12293009.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12293009.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/3/159l_2/clim_data_12293009.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/3/159l_2/clim_data_12293009.zip
Checking for progress XML file: /var/lib/boinc-client/slots/3/progress_file_12293009.xml
Opened progress file ok : /var/lib/boinc-client/slots/3/progress_file_12293009.xml
-- Model is restarting --
Adjusting last_iter, 928, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/3/progress_file_12293009.xml
last_cpu_time: 16486
upload_file_number: 9
last_iter: 913
last_upload: 777600
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a3m2_2016092300_20_1018_12293009_2_r396485625
Executing the command: /var/lib/boinc-client/slots/3/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:195759:1723831079:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
The child process has been launched with process id: 6367
19:59:56 STEP 912 H= 228:00 +CPU= 17.411
20:01:33 STEP 913 H= 228:15 +CPU= 16.453
20:03:11 STEP 914 H= 228:30 +CPU= 16.473
20:04:46 STEP 915 H= 228:45 +CPU= 16.459
20:06:27 STEP 916 H= 229:00 +CPU= 16.913
20:08:03 STEP 917 H= 229:15 +CPU= 16.455
20:09:41 STEP 918 H= 229:30 +CPU= 16.462
20:11:19 STEP 919 H= 229:45 +CPU= 16.435
20:12:58 STEP 920 H= 230:00 +CPU= 16.890
20:14:31 STEP 921 H= 230:15 +CPU= 16.469
20:16:09 STEP 922 H= 230:30 +CPU= 16.457
20:17:46 STEP 923 H= 230:45 +CPU= 16.481
20:19:49 STEP 924 H= 231:00 +CPU= 20.998
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000924
20:21:25 STEP 925 H= 231:15 +CPU= 16.565
20:23:01 STEP 926 H= 231:30 +CPU= 16.526
20:24:39 STEP 927 H= 231:45 +CPU= 16.572
20:26:20 STEP 928 H= 232:00 +CPU= 17.026
20:27:55 STEP 929 H= 232:15 +CPU= 16.558
20:29:30 STEP 930 H= 232:30 +CPU= 16.550
20:31:06 STEP 931 H= 232:45 +CPU= 16.574
20:32:42 STEP 932 H= 233:00 +CPU= 16.973
20:34:22 STEP 933 H= 233:15 +CPU= 16.596
20:35:59 STEP 934 H= 233:30 +CPU= 16.644
20:37:32 STEP 935 H= 233:45 +CPU= 16.490
20:39:36 STEP 936 H= 234:00 +CPU= 21.046
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000936
20:41:11 STEP 937 H= 234:15 +CPU= 16.652
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:42:47 STEP 938 H= 234:30 +CPU= 16.177
20:44:26 STEP 939 H= 234:45 +CPU= 16.663
20:46:06 STEP 940 H= 235:00 +CPU= 17.087
20:47:43 STEP 941 H= 235:15 +CPU= 16.628
20:49:22 STEP 942 H= 235:30 +CPU= 16.692
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:50:40 STEP 943 H= 235:45 +CPU= 16.376
20:51:59 STEP 944 H= 236:00 +CPU= 16.931
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:53:51 STEP 945 H= 236:15 +CPU= 16.639
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:54:52 STEP 946 H= 236:30 +CPU= 16.241
20:55:55 STEP 947 H= 236:45 +CPU= 16.305
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:58:06 STEP 948 H= 237:00 +CPU= 20.878
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000948
20:59:42 STEP 949 H= 237:15 +CPU= 16.568
21:01:20 STEP 950 H= 237:30 +CPU= 16.655
21:02:57 STEP 951 H= 237:45 +CPU= 16.618
21:04:37 STEP 952 H= 238:00 +CPU= 17.092
21:06:16 STEP 953 H= 238:15 +CPU= 16.650
21:07:55 STEP 954 H= 238:30 +CPU= 16.638
21:09:10 STEP 955 H= 238:45 +CPU= 16.502
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:10:05 STEP 956 H= 239:00 +CPU= 16.659
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:11:48 STEP 957 H= 239:15 +CPU= 16.465
21:13:25 STEP 958 H= 239:30 +CPU= 16.604
21:15:05 STEP 959 H= 239:45 +CPU= 16.618
21:17:24 STEP 960 H= 240:00 +CPU= 23.759
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293009/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3m2_2016092300_20_1018_12293009_2_r396485625_9.zip
Uploading the intermediate file: upload_file_9.zip
21:19:01 STEP 961 H= 240:15 +CPU= 16.657
21:20:37 STEP 962 H= 240:30 +CPU= 16.680
21:22:15 STEP 963 H= 240:45 +CPU= 16.648
21:23:56 STEP 964 H= 241:00 +CPU= 17.132
21:25:34 STEP 965 H= 241:15 +CPU= 16.740
21:27:08 STEP 966 H= 241:30 +CPU= 16.660
21:28:43 STEP 967 H= 241:45 +CPU= 16.621
21:30:25 STEP 968 H= 242:00 +CPU= 17.105
21:31:59 STEP 969 H= 242:15 +CPU= 16.661
21:33:36 STEP 970 H= 242:30 +CPU= 16.638
21:35:16 STEP 971 H= 242:45 +CPU= 16.639
21:37:20 STEP 972 H= 243:00 +CPU= 21.005
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000972
21:38:54 STEP 973 H= 243:15 +CPU= 16.598
21:40:34 STEP 974 H= 243:30 +CPU= 16.685
21:42:14 STEP 975 H= 243:45 +CPU= 16.672
21:43:57 STEP 976 H= 244:00 +CPU= 17.108
21:45:35 STEP 977 H= 244:15 +CPU= 16.627
21:47:14 STEP 978 H= 244:30 +CPU= 16.609
21:48:53 STEP 979 H= 244:45 +CPU= 16.684
21:50:34 STEP 980 H= 245:00 +CPU= 17.132
21:52:09 STEP 981 H= 245:15 +CPU= 16.664
21:53:36 STEP 982 H= 245:30 +CPU= 16.609
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:54:46 STEP 983 H= 245:45 +CPU= 16.290
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:56:52 STEP 984 H= 246:00 +CPU= 20.889
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000984
21:58:32 STEP 985 H= 246:15 +CPU= 16.716
22:00:11 STEP 986 H= 246:30 +CPU= 16.689
22:01:49 STEP 987 H= 246:45 +CPU= 16.696
22:03:29 STEP 988 H= 247:00 +CPU= 17.088
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:04:52 STEP 989 H= 247:15 +CPU= 16.355
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:06:46 STEP 990 H= 247:30 +CPU= 16.657
22:08:23 STEP 991 H= 247:45 +CPU= 16.675
22:09:49 STEP 992 H= 248:00 +CPU= 17.122
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:10:36 STEP 993 H= 248:15 +CPU= 16.119
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:12:28 STEP 994 H= 248:30 +CPU= 16.604
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:13:57 STEP 995 H= 248:45 +CPU= 16.484
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
22:16:21 STEP 996 H= 249:00 +CPU= 21.092
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000996
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221725:1723839445:8366.605] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1538] Received signal#8 (SIGFPE) :: 3958MB (heap), 4796MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221725:1723839445:8366.605] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221725:1723839445:8366.605] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x820890 (old at (nil))
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221725:1723839445:8366.605] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1617] Signal#8 was caused by floating-point overflow [memaddr=0x1cc6692], nsigs = 1
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221725:1723839445:8366.605] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#8, nsigs = 1
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221725:1723839445:8366.605] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3843] 3958 MB (maxheap), 4796 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221725:1723839445:8366.605] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : MASTER
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221725:1723839445:8366.605] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221725:1723839445:8366.605] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT1
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221725:1723839445:8366.605] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT2
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221725:1723839445:8366.605] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT3
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221725:1723839445:8366.605] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT4
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221725:1723839445:8366.605] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : STEPO
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221725:1723839445:8366.605] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : SCAN2M
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221725:1723839445:8366.605] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : GP_MODEL_HEAP
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221725:1723839445:8366.605] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : GP_MODEL
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221725:1723839445:8366.605] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : EC_PHYS_DRV
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221725:1723839445:8366.605] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : >OMP-PHYSICS (1001)
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221725:1723839445:8366.605] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : EC_PHYS
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221725:1723839445:8366.605] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CALLPAR
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221725:1723839445:8366.605] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : TURBULENCE_LAYER
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221725:1723839445:8366.605] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : VDFOUTER
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221725:1723839445:8366.605] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : VDFMAIN
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/3/oifs_43r3_model.exe' : sigcontextptr=0x7ffde3835390
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 24) with addr2line-cmd
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/3/oifs_43r3_model.exe' 0x83a8f3 0x83aef9 0x1dd5490 0x1cc6692 0x121fd8b 0x1207e29 0x11fdcb2 0xfac003 0xf5fa6b 0xf4dbc4 0xbd7131 0x12c5002 0xbacbae 0x688153 0x4cd1dc 0x4b5d85 0x4b4f52 0x49d638 0x406fbd 0x401e7f 0x401e12 0x1dcc34a 0x1dcdbe7 0x401cd5
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x83a8f3] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x83aef9] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x1dd5490] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1cc6692] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x121fd8b] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x1207e29] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x11fdcb2] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0xfac003] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0xf5fa6b] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0xf4dbc4] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xbd7131] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x12c5002] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0xbacbae] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x688153] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x4cd1dc] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x4b5d85] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x4b4f52] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x49d638] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x406fbd] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x401e7f] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x401e12] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x1dcc34a] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1dcdbe7] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x401cd5] : ??() at ??:0
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221726:1723839446:8367.610] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
Process 1 thread 1 calling linux_trbk from intel_trbk()
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/3/oifs_43r3_model.exe' : sigcontextptr=0x7ffde38352a0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 25) with addr2line-cmd
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/3/oifs_43r3_model.exe' 0x83a8f3 0x83aef9 0x822540 0x1dd5490 0x1cc6692 0x121fd8b 0x1207e29 0x11fdcb2 0xfac003 0xf5fa6b 0xf4dbc4 0xbd7131 0x12c5002 0xbacbae 0x688153 0x4cd1dc 0x4b5d85 0x4b4f52 0x49d638 0x406fbd 0x401e7f 0x401e12 0x1dcc34a 0x1dcdbe7 0x401cd5
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x83a8f3] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x83aef9] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x822540] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1dd5490] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x1cc6692] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x121fd8b] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x1207e29] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x11fdcb2] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0xfac003] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0xf5fa6b] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xf4dbc4] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0xbd7131] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x12c5002] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0xbacbae] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x688153] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x4cd1dc] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x4b5d85] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x4b4f52] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x49d638] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x406fbd] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x401e7f] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x401e12] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1dcc34a] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x1dcdbe7] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [24]: [0x401cd5] : ??() at ??:0
[LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221727:1723839447:8367.727] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#8, nsigs = 1
[EC_DRHOOK:daniel-AB350-Gaming-3:1:1:6367:6367] [20240816:221727:1723839447:8367.727] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1cf8da0 for signal#8, nsigs = 1
forrtl: error (72): floating overflow
Image PC Routine Line Source
oifs_43r3_model.e 0000000001CF935B Unknown Unknown Unknown
oifs_43r3_model.e 00000000008214C1 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DD5490 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001CC6692 Unknown Unknown Unknown
oifs_43r3_model.e 000000000121FD8B vdfmain_ 874 vdfmain.F90
oifs_43r3_model.e 0000000001207E29 vdfouter_ 739 vdfouter.F90
oifs_43r3_model.e 00000000011FDCB2 turbulence_layer_ 158 turbulence_layer.F90
oifs_43r3_model.e 0000000000FAC003 callpar_ 869 callpar.F90
oifs_43r3_model.e 0000000000F5FA6B ec_phys_ 670 ec_phys.F90
oifs_43r3_model.e 0000000000F4DBC4 ec_phys_drv_ 599 ec_phys_drv.F90
oifs_43r3_model.e 0000000000BD7131 gp_model_ 613 gp_model.F90
oifs_43r3_model.e 00000000012C5002 gp_model_heap_ 74 gp_model_heap.F90
oifs_43r3_model.e 0000000000BACBAE scan2m_ 535 scan2m.F90
oifs_43r3_model.e 0000000000688153 stepo_ 327 stepo.F90
oifs_43r3_model.e 00000000004CD1DC cnt4_ 1133 cnt4.F90
oifs_43r3_model.e 00000000004B5D85 cnt3_ 267 cnt3.F90
oifs_43r3_model.e 00000000004B4F52 cnt2_ 88 cnt2.F90
oifs_43r3_model.e 000000000049D638 cnt1_ 92 cnt1.F90
oifs_43r3_model.e 0000000000406FBD cnt0_ 146 cnt0.F90
oifs_43r3_model.e 0000000000401E7F MAIN__ 96 master.F90
oifs_43r3_model.e 0000000000401E12 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DCC34A Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DCDBE7 Unknown Unknown Unknown
oifs_43r3_model.e 0000000000401CD5 Unknown Unknown Unknown
..The child process has been killed with signal: 6
>>> Printing last 70 lines from file: NODE.001_01
UPDT RAESHDU = 2000.0
SUECAEC: GLOBAL AVERAGE VOLCANIC SULPHATE FOR (KINDAT,KMINUT) 20160923
630 9.999999999999998E-005
GPNORM HUMIDITY AVERAGE MINIMUM MAXIMUM
AVE 0.460059124076500E-02 0.999999999695112E-08 0.482685905199678E-01
GPNORM LIQUID WATER AVERAGE MINIMUM MAXIMUM
AVE 0.285989367496781E-05 0.000000000000000E+00 0.134569812090351E-01
GPNORM ICE WATER AVERAGE MINIMUM MAXIMUM
AVE 0.219849677881708E-04 0.000000000000000E+00 0.172621870626956E-01
GPNORM SNOW AVERAGE MINIMUM MAXIMUM
AVE 0.652526737611545E-04 0.000000000000000E+00 0.236927055915471E-01
GPNORM RAIN AVERAGE MINIMUM MAXIMUM
AVE 0.570559414234905E-05 0.000000000000000E+00 0.924708970605419E-02
GPNORM CLOUD FRACTION AVERAGE MINIMUM MAXIMUM
AVE 0.206165969220232E+00 0.000000000000000E+00 0.100000000000000E+01
GPNORM CLW AVERAGE MINIMUM MAXIMUM
AVE 0.281348000926505E-05 0.000000000000000E+00 0.126361167512891E-01
GPNORM CIW AVERAGE MINIMUM MAXIMUM
AVE 0.212581917618569E-04 0.000000000000000E+00 0.176302499061375E-01
GPNORM CC AVERAGE MINIMUM MAXIMUM
AVE 0.205640666962592E+00 0.000000000000000E+00 0.100000000000000E+01
GPNORM RFL AVERAGE MINIMUM MAXIMUM
AVE 0.202849498223240E-04 0.000000000000000E+00 0.279783905031631E-01
GPNORM SFL AVERAGE MINIMUM MAXIMUM
AVE 0.169988333556360E-04 0.000000000000000E+00 0.692172757591149E-02
GPNORM CRFL AVERAGE MINIMUM MAXIMUM
AVE 0.416394731107986E-05 0.000000000000000E+00 0.120873605373477E-01
GPNORM CSFL AVERAGE MINIMUM MAXIMUM
AVE 0.172767388679383E-05 0.000000000000000E+00 0.803078353538104E-02
GPNORM PFRC AVERAGE MINIMUM MAXIMUM
AVE 0.137534119748318E+00 0.000000000000000E+00 0.100000000000000E+01
NSTEP = 996 STEPO A00000000
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
NSTEP = 996 SCAN2M_HPOS P
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
ICMGGh7zg+000996 MODE=w
IO-STREAM CLOSED - ICMGGh7zg+000996
MPI-TASK: 1 - 319312132 BYTES IN 6 RECORDS TRANSFERRED IN 0.0003 SECONDS******** Mbytes/s, TOTAL TIME= 0.0060( 5.0%)
NSTEP = 996 STEPO 0AA000000
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
./ICMSHh7zg+000996 MODE=w
IO-STREAM CLOSED - ./ICMSHh7zg+000996
MPI-TASK: 1 - 707399250 BYTES IN 202 RECORDS TRANSFERRED IN 0.0970 SECONDS 7292.8 Mbytes/s, TOTAL TIME= 1.0188( 9.5%)
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
./ICMUAh7zg+000996 MODE=w
IO-STREAM CLOSED - ./ICMUAh7zg+000996
MPI-TASK: 1 - 5108994112 BYTES IN 125 RECORDS TRANSFERRED IN 0.0360 SECONDS141916.5 Mbytes/s, TOTAL TIME= 0.8392( 4.3%)
STEPO_FPOS WAS : B00000F00E
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
./ICMUAh7zg+000996 MODE=a
IO-STREAM CLOSED - ./ICMUAh7zg+000996
MPI-TASK: 1 - 10 BYTES IN 2 RECORDS TRANSFERRED IN 0.0002 SECONDS 0.0 Mbytes/s, TOTAL TIME= 0.0184( 1.1%)
STEPO_FPOS WAS : V00000000Y
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
./ICMUAh7zg+000996 MODE=a
IO-STREAM CLOSED - ./ICMUAh7zg+000996
MPI-TASK: 1 - 310732403 BYTES IN 4 RECORDS TRANSFERRED IN 0.0003 SECONDS******** Mbytes/s, TOTAL TIME= 0.0342( 0.9%)
STEPO_FPOS WAS : T00000000M
NSTEP = 996 STEPO 0AAA00AAA
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
NSTEP = 996 SCAN2M_HPOS P
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
ICMGGh7zg+000996 MODE=a
IO-STREAM CLOSED - ICMGGh7zg+000996
MPI-TASK: 1 - 319312132 BYTES IN 7 RECORDS TRANSFERRED IN 0.0155 SECONDS 20600.8 Mbytes/s, TOTAL TIME= 0.0506(30.6%)
22:16:21 STEP 996 H= 249:00 +CPU= 21.092
NSTEP = 997 STEPO 0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat
22:13:57 A00000000 STEPO 996 16.558 16.558 89.725 23:50 135:58 0.32516048145123E-04 2GB 0MB
22:13:57 0AA000000 STEPO 996 0.016 0.016 0.016 23:50 135:58 0.32516048145123E-04 2GB 0MB
22:13:58 FULLPOS-B DYNFPOS 996 0.879 0.879 0.904 23:51 135:59 0.32516048145123E-04 2GB 0MB
22:14:33 FULLPOS-V DYNFPOS 996 2.042 2.042 34.286 23:53 136:33 0.32516048145123E-04 2GB 0MB
22:14:35 FULLPOS-T DYNFPOS 996 0.414 0.414 2.492 23:53 136:36 0.32516048145123E-04 2GB 0MB
22:14:37 0AAA00AAA STEPO 996 0.403 0.403 2.432 23:54 136:38 0.32516048145123E-04 2GB 0MB
22:16:21 0AAA00AAA STEPO 997 17.263 17.263 103.827 24:11 138:22 0.32516048145123E-04 2GB 0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf
CSTEP = " 960",
CTIME = "00100000 ",
NSTEPLPP = 201, 202, 49, 228226, 228227, 2*0, 948, 2*0,
IPRGPNSRES = 1,
IPRGPEWRES = 1,
IPRTRWRES = 1,
IPRTRVRES = 1,
GMASS0 = 0.000000000000000E+000,
GMASSI = 0.000000000000000E+000
/
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc-client/slots/3/progress_file_12293009.xml
<running_values>
<last_cpu_time>17946.930000</last_cpu_time>
<upload_file_number>10</upload_file_number>
<last_iter>997</last_iter>
<last_upload>864000</last_upload>
<model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully
</stderr_txt>
]]>
