climateprediction.net home page
Task 22447552

Task 22447552

Name oifs_43r3_bl_a4bs_2016092300_20_1018_12293935_0
Workunit 12293935
Created 13 Jun 2024, 4:07:59 UTC
Sent 14 Jun 2024, 3:08:54 UTC
Report deadline 13 Aug 2024, 3:08:54 UTC
Received 14 Jun 2024, 4:10:26 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1551322
Run time 58 min 27 sec
CPU time 56 min 32 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 4.89 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,024.75 MB
Peak swap size 5,981.07 MB
Peak disk usage 1,268.97 MB
Stderr
<core_client_version>7.16.5</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a4bs
(argv4) batchid: 1018
(argv5) wuid: 12293935
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /media/antonio/BOINC/BOINC/slots/24
Project directory is: /media/antonio/BOINC/BOINC/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935
Copying: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /media/antonio/BOINC/BOINC/slots/24/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /media/antonio/BOINC/BOINC/slots/24/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_f41cfa5f5cc0832d276cf44c7335e1cf to: /media/antonio/BOINC/BOINC/slots/24/oifs_43r3_bl_a4bs_2016092300_20_1018_12293935.zip
Unzipping the namelist zip file: /media/antonio/BOINC/BOINC/slots/24/oifs_43r3_bl_a4bs_2016092300_20_1018_12293935.zip
ic_ancil_file: ic_ancil_12293935
ifsdata_file: ifsdata_12293935
climate_data_file: clim_data_12293935
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /media/antonio/BOINC/BOINC/slots/24/ic_ancil_12293935.zip
Unzipping the IC ancils zip file: /media/antonio/BOINC/BOINC/slots/24/ic_ancil_12293935.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_edf8e8f3177d4eac7b44b9eaa3211d9a to: /media/antonio/BOINC/BOINC/slots/24/ifsdata/ifsdata_12293935.zip
Unzipping the ifsdata_zip file: /media/antonio/BOINC/BOINC/slots/24/ifsdata/ifsdata_12293935.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /media/antonio/BOINC/BOINC/slots/24/159l_2/clim_data_12293935.zip
Unzipping the climate data zip file: /media/antonio/BOINC/BOINC/slots/24/159l_2/clim_data_12293935.zip
Checking for progress XML file: /media/antonio/BOINC/BOINC/slots/24/progress_file_12293935.xml
Creating progress file: /media/antonio/BOINC/BOINC/slots/24/progress_file_12293935.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a4bs_2016092300_20_1018_12293935_0_r249777998
The child process has been launched with process id: 269041
Executing the command: /media/antonio/BOINC/BOINC/slots/24/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:051030:1718334630:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  05:11:12 STEP    0 H=   0:00 +CPU= 35.618
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMGGh7zg+000000
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMSHh7zg+000000
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMUAh7zg+000000
  05:11:40 STEP    1 H=   0:15 +CPU= 26.973
  05:12:08 STEP    2 H=   0:30 +CPU= 28.820
  05:12:37 STEP    3 H=   0:45 +CPU= 28.179
  05:13:07 STEP    4 H=   1:00 +CPU= 29.432
  05:13:34 STEP    5 H=   1:15 +CPU= 27.555
  05:14:07 STEP    6 H=   1:30 +CPU= 32.759
  05:14:41 STEP    7 H=   1:45 +CPU= 33.256
  05:15:13 STEP    8 H=   2:00 +CPU= 31.981
  05:15:45 STEP    9 H=   2:15 +CPU= 31.760
  05:16:18 STEP   10 H=   2:30 +CPU= 32.879
  05:16:52 STEP   11 H=   2:45 +CPU= 33.372
  05:17:34 STEP   12 H=   3:00 +CPU= 41.667
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMGGh7zg+000012
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMSHh7zg+000012
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMUAh7zg+000012
  05:18:06 STEP   13 H=   3:15 +CPU= 31.310
  05:18:38 STEP   14 H=   3:30 +CPU= 32.066
  05:19:12 STEP   15 H=   3:45 +CPU= 33.218
  05:19:45 STEP   16 H=   4:00 +CPU= 32.809
  05:20:18 STEP   17 H=   4:15 +CPU= 33.176
  05:20:51 STEP   18 H=   4:30 +CPU= 33.119
  05:21:24 STEP   19 H=   4:45 +CPU= 32.796
  05:21:58 STEP   20 H=   5:00 +CPU= 32.789
  05:22:32 STEP   21 H=   5:15 +CPU= 33.674
  05:23:06 STEP   22 H=   5:30 +CPU= 34.527
  05:23:41 STEP   23 H=   5:45 +CPU= 33.883
  05:24:22 STEP   24 H=   6:00 +CPU= 41.103
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMGGh7zg+000024
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMSHh7zg+000024
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMUAh7zg+000024
  05:24:56 STEP   25 H=   6:15 +CPU= 33.362
  05:25:28 STEP   26 H=   6:30 +CPU= 32.205
  05:26:03 STEP   27 H=   6:45 +CPU= 34.114
  05:26:36 STEP   28 H=   7:00 +CPU= 32.899
  05:27:05 STEP   29 H=   7:15 +CPU= 29.360
  05:27:38 STEP   30 H=   7:30 +CPU= 31.976
  05:28:09 STEP   31 H=   7:45 +CPU= 31.377
  05:28:44 STEP   32 H=   8:00 +CPU= 34.660
  05:29:18 STEP   33 H=   8:15 +CPU= 33.634
  05:29:51 STEP   34 H=   8:30 +CPU= 33.073
  05:30:26 STEP   35 H=   8:45 +CPU= 34.832
  05:31:09 STEP   36 H=   9:00 +CPU= 42.437
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMGGh7zg+000036
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMSHh7zg+000036
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMUAh7zg+000036
  05:31:44 STEP   37 H=   9:15 +CPU= 33.996
  05:32:18 STEP   38 H=   9:30 +CPU= 34.711
  05:32:54 STEP   39 H=   9:45 +CPU= 35.475
  05:33:31 STEP   40 H=  10:00 +CPU= 36.356
  05:34:06 STEP   41 H=  10:15 +CPU= 35.007
  05:34:43 STEP   42 H=  10:30 +CPU= 36.315
  05:35:17 STEP   43 H=  10:45 +CPU= 33.752
  05:35:51 STEP   44 H=  11:00 +CPU= 33.107
  05:36:23 STEP   45 H=  11:15 +CPU= 32.273
  05:36:57 STEP   46 H=  11:30 +CPU= 33.771
  05:37:29 STEP   47 H=  11:45 +CPU= 31.345
  05:38:13 STEP   48 H=  12:00 +CPU= 43.650
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMGGh7zg+000048
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMSHh7zg+000048
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMUAh7zg+000048
  05:38:45 STEP   49 H=  12:15 +CPU= 32.079
  05:39:17 STEP   50 H=  12:30 +CPU= 32.013
  05:39:50 STEP   51 H=  12:45 +CPU= 32.611
  05:40:26 STEP   52 H=  13:00 +CPU= 35.776
  05:41:01 STEP   53 H=  13:15 +CPU= 34.156
  05:41:35 STEP   54 H=  13:30 +CPU= 34.137
  05:42:10 STEP   55 H=  13:45 +CPU= 34.136
  05:42:44 STEP   56 H=  14:00 +CPU= 33.882
  05:43:19 STEP   57 H=  14:15 +CPU= 34.536
  05:43:54 STEP   58 H=  14:30 +CPU= 34.049
  05:44:24 STEP   59 H=  14:45 +CPU= 30.646
  05:45:06 STEP   60 H=  15:00 +CPU= 40.886
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMGGh7zg+000060
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMSHh7zg+000060
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMUAh7zg+000060
  05:45:39 STEP   61 H=  15:15 +CPU= 32.852
  05:46:12 STEP   62 H=  15:30 +CPU= 32.558
  05:46:45 STEP   63 H=  15:45 +CPU= 33.569
  05:47:22 STEP   64 H=  16:00 +CPU= 35.811
  05:47:56 STEP   65 H=  16:15 +CPU= 33.766
  05:48:29 STEP   66 H=  16:30 +CPU= 33.350
  05:49:03 STEP   67 H=  16:45 +CPU= 33.196
  05:49:38 STEP   68 H=  17:00 +CPU= 34.154
  05:50:13 STEP   69 H=  17:15 +CPU= 35.098
  05:50:46 STEP   70 H=  17:30 +CPU= 33.269
  05:51:22 STEP   71 H=  17:45 +CPU= 34.961
  05:52:04 STEP   72 H=  18:00 +CPU= 41.987
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMGGh7zg+000072
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMSHh7zg+000072
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMUAh7zg+000072
  05:52:39 STEP   73 H=  18:15 +CPU= 34.533
  05:53:15 STEP   74 H=  18:30 +CPU= 35.066
  05:53:49 STEP   75 H=  18:45 +CPU= 34.353
  05:54:24 STEP   76 H=  19:00 +CPU= 34.282
  05:54:56 STEP   77 H=  19:15 +CPU= 32.448
  05:55:30 STEP   78 H=  19:30 +CPU= 32.839
  05:56:01 STEP   79 H=  19:45 +CPU= 31.525
  05:56:35 STEP   80 H=  20:00 +CPU= 33.644
  05:57:06 STEP   81 H=  20:15 +CPU= 30.379
  05:57:38 STEP   82 H=  20:30 +CPU= 32.380
  05:58:12 STEP   83 H=  20:45 +CPU= 33.470
  05:58:55 STEP   84 H=  21:00 +CPU= 43.053
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMGGh7zg+000084
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMSHh7zg+000084
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMUAh7zg+000084
  05:59:31 STEP   85 H=  21:15 +CPU= 34.881
  06:00:05 STEP   86 H=  21:30 +CPU= 34.083
  06:00:37 STEP   87 H=  21:45 +CPU= 32.499
  06:01:13 STEP   88 H=  22:00 +CPU= 35.130
  06:01:48 STEP   89 H=  22:15 +CPU= 34.891
  06:02:22 STEP   90 H=  22:30 +CPU= 33.485
  06:02:56 STEP   91 H=  22:45 +CPU= 33.750
  06:03:31 STEP   92 H=  23:00 +CPU= 34.839
  06:04:08 STEP   93 H=  23:15 +CPU= 36.510
  06:04:43 STEP   94 H=  23:30 +CPU= 34.938
  06:05:17 STEP   95 H=  23:45 +CPU= 33.739
  06:06:04 STEP   96 H=  24:00 +CPU= 46.199
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMGGh7zg+000096
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMSHh7zg+000096
Moving to projects directory: /media/antonio/BOINC/BOINC/slots/24/ICMUAh7zg+000096
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMGGh7zg+000000
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMSHh7zg+000000
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMUAh7zg+000000
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMGGh7zg+000012
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMSHh7zg+000012
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMUAh7zg+000012
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMGGh7zg+000024
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMSHh7zg+000024
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMUAh7zg+000024
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMGGh7zg+000036
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMSHh7zg+000036
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMUAh7zg+000036
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMGGh7zg+000048
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMSHh7zg+000048
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMUAh7zg+000048
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMGGh7zg+000060
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMSHh7zg+000060
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMUAh7zg+000060
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMGGh7zg+000072
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMSHh7zg+000072
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMUAh7zg+000072
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMGGh7zg+000084
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMSHh7zg+000084
Adding to the zip: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_12293935/ICMUAh7zg+000084
Zipping up the intermediate file: /media/antonio/BOINC/BOINC/projects/climateprediction.net/oifs_43r3_bl_a4bs_2016092300_20_1018_12293935_0_r249777998_0.zip
Uploading the intermediate file: upload_file_0.zip
  06:06:35 STEP   97 H=  24:15 +CPU= 31.553
  06:07:09 STEP   98 H=  24:30 +CPU= 33.854
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060730:1718338050:3420.541] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1538] Received signal#8 (SIGFPE) :: 4412MB (heap), 5025MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060730:1718338050:3420.541] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060730:1718338050:3420.541] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x820890 (old at (nil))
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060730:1718338050:3420.541] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1617] Signal#8 was caused by floating-point overflow [memaddr=0x1cc6692], nsigs = 1
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060730:1718338050:3420.541] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#8, nsigs = 1
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060730:1718338050:3420.541] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3843] 4412 MB (maxheap), 5025 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060730:1718338050:3420.541] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060730:1718338050:3420.541] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060730:1718338050:3420.541] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060730:1718338050:3420.541] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060730:1718338050:3420.541] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060730:1718338050:3420.541] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060730:1718338050:3420.541] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060730:1718338050:3420.541] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060730:1718338050:3420.541] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060730:1718338050:3420.541] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060730:1718338050:3420.541] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :            EC_PHYS_DRV 
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060730:1718338050:3420.541] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :             >OMP-PHYSICS              (1001) 
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060730:1718338050:3420.541] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :              EC_PHYS 
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060730:1718338050:3420.541] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :               CALLPAR 
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060730:1718338050:3420.541] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                TURBULENCE_LAYER 
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060730:1718338050:3420.541] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                 VDFOUTER 
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060730:1718338050:3420.541] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                  VDFMAIN 
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/media/antonio/BOINC/BOINC/slots/24/oifs_43r3_model.exe' : sigcontextptr=0x7ffcca494510
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 24) with addr2line-cmd
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/media/antonio/BOINC/BOINC/slots/24/oifs_43r3_model.exe' 0x83a8f3 0x83aef9 0x1dd5490 0x1cc6692 0x121fd8b 0x1207e29 0x11fdcb2 0xfac003 0xf5fa6b 0xf4dbc4 0xbd7131 0x12c5002 0xbacbae 0x688153 0x4cd1dc 0x4b5d85 0x4b4f52 0x49d638 0x406fbd 0x401e7f 0x401e12 0x1dcc34a 0x1dcdbe7 0x401cd5
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x83a8f3] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x83aef9] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x1dd5490] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1cc6692] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x121fd8b] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x1207e29] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x11fdcb2] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0xfac003] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0xf5fa6b] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0xf4dbc4] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xbd7131] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x12c5002] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0xbacbae] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x688153] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x4cd1dc] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x4b5d85] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x4b4f52] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x49d638] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x406fbd] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x401e7f] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x401e12] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x1dcc34a] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1dcdbe7] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x401cd5] : ??() at ??:0
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.547] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
 Process            1  thread            1  calling linux_trbk from intel_trbk()
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/media/antonio/BOINC/BOINC/slots/24/oifs_43r3_model.exe' : sigcontextptr=0x7ffcca494420
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 25) with addr2line-cmd
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/media/antonio/BOINC/BOINC/slots/24/oifs_43r3_model.exe' 0x83a8f3 0x83aef9 0x822540 0x1dd5490 0x1cc6692 0x121fd8b 0x1207e29 0x11fdcb2 0xfac003 0xf5fa6b 0xf4dbc4 0xbd7131 0x12c5002 0xbacbae 0x688153 0x4cd1dc 0x4b5d85 0x4b4f52 0x49d638 0x406fbd 0x401e7f 0x401e12 0x1dcc34a 0x1dcdbe7 0x401cd5
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x83a8f3] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x83aef9] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x822540] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1dd5490] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x1cc6692] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x121fd8b] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x1207e29] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x11fdcb2] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0xfac003] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0xf5fa6b] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xf4dbc4] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0xbd7131] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x12c5002] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0xbacbae] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x688153] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x4cd1dc] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x4b5d85] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x4b4f52] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x49d638] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x406fbd] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x401e7f] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x401e12] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1dcc34a] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x1dcdbe7] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [24]: [0x401cd5] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.606] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#8, nsigs = 1
[EC_DRHOOK:generosidad:1:1:269041:269041] [20240614:060731:1718338051:3421.606] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1cf8da0 for signal#8, nsigs = 1
forrtl: error (72): floating overflow
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CF935B  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000008214C1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DD5490  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001CC6692  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000121FD8B  vdfmain_                  874  vdfmain.F90
oifs_43r3_model.e  0000000001207E29  vdfouter_                 739  vdfouter.F90
oifs_43r3_model.e  00000000011FDCB2  turbulence_layer_         158  turbulence_layer.F90
oifs_43r3_model.e  0000000000FAC003  callpar_                  869  callpar.F90
oifs_43r3_model.e  0000000000F5FA6B  ec_phys_                  670  ec_phys.F90
oifs_43r3_model.e  0000000000F4DBC4  ec_phys_drv_              599  ec_phys_drv.F90
oifs_43r3_model.e  0000000000BD7131  gp_model_                 613  gp_model.F90
oifs_43r3_model.e  00000000012C5002  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BACBAE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  0000000000688153  stepo_                    327  stepo.F90
oifs_43r3_model.e  00000000004CD1DC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000004B5D85  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  00000000004B4F52  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  000000000049D638  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  0000000000406FBD  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  0000000000401E7F  MAIN__                     96  master.F90
oifs_43r3_model.e  0000000000401E12  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCC34A  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCDBE7  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000401CD5  Unknown               Unknown  Unknown
..The child process has been killed with signal: 6
>>> Printing last 70 lines from file: NODE.001_01

 GPNORM RAIN                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.252290184845398E-04 0.000000000000000E+00 0.818139997621825E-02
 GPNORM  CLOUD FRACTION      AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.268650992665133E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM CLW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.673117077616012E-05 0.000000000000000E+00 0.112502865046057E-01
 GPNORM CIW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.301257404714340E-04 0.000000000000000E+00 0.137372966341554E-01
 GPNORM CC                   AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.268514809765168E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM RFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.904345415165665E-04 0.000000000000000E+00 0.292763579800013E-01
 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.534045768477032E-04 0.000000000000000E+00 0.684511752638424E-02
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.152859311365853E-04 0.000000000000000E+00 0.183741721247696E-01
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.463416421515431E-05 0.000000000000000E+00 0.108275858425677E-01
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.215840481537103E+00 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =    96 STEPO   F00000000
 CREATE RESTART FILE ./srf00010000.0001                                                                                                                                                                                                                                              
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./srf00010000.0001 MODE=w
 IO-STREAM CLOSED - ./srf00010000.0001
 MPI-TASK:   1 - ************ BYTES IN     46 RECORDS TRANSFERRED IN    2.6746 SECONDS******** Mbytes/s, TOTAL TIME=    3.3928(78.8%)
 CREATE RESTART CONTROL FILE ./rcf                                                                                                                   
 WRRESF: DELETED PREVIOUS RESTART FILE OK: ./srf00001200.0001
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =    96 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000096 MODE=w
 IO-STREAM CLOSED - ICMGGh7zg+000096
 MPI-TASK:   1 -    312591364 BYTES IN      6 RECORDS TRANSFERRED IN    0.0004 SECONDS781478.4 Mbytes/s, TOTAL TIME=    0.0103( 3.9%)
 NSTEP =    96 STEPO   0AA000000
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMSHh7zg+000096 MODE=w
 IO-STREAM CLOSED - ./ICMSHh7zg+000096
 MPI-TASK:   1 -    707399250 BYTES IN    202 RECORDS TRANSFERRED IN    0.0131 SECONDS 53999.9 Mbytes/s, TOTAL TIME=    0.3803( 3.4%)
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000096 MODE=w
 IO-STREAM CLOSED - ./ICMUAh7zg+000096
 MPI-TASK:   1 -   5001461824 BYTES IN    125 RECORDS TRANSFERRED IN    0.0080 SECONDS625182.7 Mbytes/s, TOTAL TIME=    0.2722( 2.9%)
 STEPO_FPOS WAS : B00000F00E
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000096 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000096
 MPI-TASK:   1 -           10 BYTES IN      2 RECORDS TRANSFERRED IN    0.0002 SECONDS     0.0 Mbytes/s, TOTAL TIME=    0.0055( 3.6%)
 STEPO_FPOS WAS : V00000000Y
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000096 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000096
 MPI-TASK:   1 -    304011635 BYTES IN      4 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0059( 5.1%)
 STEPO_FPOS WAS : T00000000M
 NSTEP =    96 STEPO   0AAA00AAA
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =    96 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000096 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+000096
 MPI-TASK:   1 -    312591364 BYTES IN      7 RECORDS TRANSFERRED IN    0.0007 SECONDS446559.1 Mbytes/s, TOTAL TIME=    0.0142( 4.9%)
 06:06:04 STEP   96 H=  24:00 +CPU= 46.199
 NSTEP =    97 STEPO   0AAA00AAA
 06:06:35 STEP   97 H=  24:15 +CPU= 31.553
 NSTEP =    98 STEPO   0AAA00AAA
 06:07:09 STEP   98 H=  24:30 +CPU= 33.854
 NSTEP =    99 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 06:05:23 FULLPOS-B DYNFPOS     96     1.497    1.497    1.507     54:25     54:53 0.62071912905417E-04       2GB       0MB
 06:05:27 FULLPOS-V DYNFPOS     96     4.222    4.222    4.238     54:29     54:57 0.62071912905417E-04       2GB       0MB
 06:05:28 FULLPOS-T DYNFPOS     96     0.747    0.747    0.748     54:30     54:58 0.62071912905417E-04       2GB       0MB
 06:05:28 0AAA00AAA STEPO       96     0.719    0.719    0.720     54:30     54:58 0.62071912905417E-04       2GB       0MB
 06:06:04 0AAA00AAA STEPO       97    34.871   34.871   35.073     55:05     55:33 0.62071912905417E-04       2GB       0MB
 06:06:35 0AAA00AAA STEPO       98    31.553   31.553   31.715     55:37     56:05 0.62071912905417E-04       2GB       0MB
 06:07:09 0AAA00AAA STEPO       99    33.854   33.854   34.067     56:11     56:39 0.62071912905417E-04       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "      96",
 CTIME   = "00010000      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 2*0,          84, 2*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =  0.000000000000000E+000,
 GMASSI  =  0.000000000000000E+000
 /
------------------------------------------------
>>> Printing last 8 lines from file: /media/antonio/BOINC/BOINC/slots/24/progress_file_12293935.xml

<running_values>
  <last_cpu_time>3391.670000</last_cpu_time>
  <upload_file_number>1</upload_file_number>
  <last_iter>99</last_iter>
  <last_upload>86400</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 climateprediction.net