<core_client_version>7.20.5</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1992050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0234
(argv4) batchid: 961
(argv5) wuid: 12177878
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/21
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/21/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/21/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_79fdddffd35fc8f42539eafea212a505 to: /var/lib/boinc/slots/21/oifs_43r3_ps_0234_1992050100_123_961_12177878.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/21/oifs_43r3_ps_0234_1992050100_123_961_12177878.zip
ic_ancil_file: ic_ancil_12177878
ifsdata_file: ifsdata_12177878
climate_data_file: clim_data_12177878
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_21b23644f6d71b49bb47e9cd936d5918 to: /var/lib/boinc/slots/21/ic_ancil_12177878.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/21/ic_ancil_12177878.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_e8b65ffcbd1c4ddd5fc2bb997592f34f to: /var/lib/boinc/slots/21/ifsdata/ifsdata_12177878.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/21/ifsdata/ifsdata_12177878.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/21/159l_2/clim_data_12177878.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/21/159l_2/clim_data_12177878.zip
Checking for progress XML file: /var/lib/boinc/slots/21/progress_file_12177878.xml
Creating progress file: /var/lib/boinc/slots/21/progress_file_12177878.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0234_1992050100_123_961_12177878_1_r1837049404
The child process has been launched with process id: 14502
Executing the command: /var/lib/boinc/slots/21/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:14502:14502] [20221222:171631:1671704191:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
17:17:01 STEP 0 H= 0:00 +CPU= 28.043
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc/slots/21/ICMGGhq0f+000000
Moving to projects directory: /var/lib/boinc/slots/21/ICMSHhq0f+000000
Moving to projects directory: /var/lib/boinc/slots/21/ICMUAhq0f+000000
17:17:22 STEP 1 H= 1:00 +CPU= 19.274
17:17:39 STEP 2 H= 2:00 +CPU= 16.505
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:18:08 STEP 3 H= 3:00 +CPU= 27.545
17:18:25 STEP 4 H= 4:00 +CPU= 16.668
17:18:40 STEP 5 H= 5:00 +CPU= 15.288
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:19:10 STEP 6 H= 6:00 +CPU= 27.436
17:19:26 STEP 7 H= 7:00 +CPU= 15.375
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:19:44 STEP 8 H= 8:00 +CPU= 16.497
17:20:10 STEP 9 H= 9:00 +CPU= 25.406
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:20:29 STEP 10 H= 10:00 +CPU= 16.700
17:20:43 STEP 11 H= 11:00 +CPU= 14.846
17:21:13 STEP 12 H= 12:00 +CPU= 29.096
Moving to projects directory: /var/lib/boinc/slots/21/ICMGGhq0f+000012
Moving to projects directory: /var/lib/boinc/slots/21/ICMSHhq0f+000012
Moving to projects directory: /var/lib/boinc/slots/21/ICMUAhq0f+000012
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:21:30 STEP 13 H= 13:00 +CPU= 15.071
17:21:46 STEP 14 H= 14:00 +CPU= 15.759
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:22:17 STEP 15 H= 15:00 +CPU= 28.568
17:22:33 STEP 16 H= 16:00 +CPU= 16.761
17:22:50 STEP 17 H= 17:00 +CPU= 16.112
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:23:20 STEP 18 H= 18:00 +CPU= 27.551
17:23:36 STEP 19 H= 19:00 +CPU= 16.399
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:23:54 STEP 20 H= 20:00 +CPU= 15.938
17:24:20 STEP 21 H= 21:00 +CPU= 25.888
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:24:40 STEP 22 H= 22:00 +CPU= 17.909
17:24:58 STEP 23 H= 23:00 +CPU= 16.984
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:25:31 STEP 24 H= 24:00 +CPU= 30.296
Moving to projects directory: /var/lib/boinc/slots/21/ICMGGhq0f+000024
Moving to projects directory: /var/lib/boinc/slots/21/ICMSHhq0f+000024
Moving to projects directory: /var/lib/boinc/slots/21/ICMUAhq0f+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMGGhq0f+000000
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMSHhq0f+000000
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMUAhq0f+000000
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMGGhq0f+000012
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMSHhq0f+000012
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMUAhq0f+000012
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0234_1992050100_123_961_12177878_1_r1837049404_0.zip
Uploading the intermediate file: upload_file_0.zip
17:25:45 STEP 25 H= 25:00 +CPU= 14.618
17:26:02 STEP 26 H= 26:00 +CPU= 16.468
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:26:31 STEP 27 H= 27:00 +CPU= 27.219
17:26:49 STEP 28 H= 28:00 +CPU= 17.305
17:27:05 STEP 29 H= 29:00 +CPU= 15.858
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:27:35 STEP 30 H= 30:00 +CPU= 27.795
17:27:53 STEP 31 H= 31:00 +CPU= 18.575
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:28:13 STEP 32 H= 32:00 +CPU= 17.138
17:28:39 STEP 33 H= 33:00 +CPU= 26.314
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:28:59 STEP 34 H= 34:00 +CPU= 17.388
17:29:15 STEP 35 H= 35:00 +CPU= 15.630
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:29:49 STEP 36 H= 36:00 +CPU= 32.022
Moving to projects directory: /var/lib/boinc/slots/21/ICMGGhq0f+000036
Moving to projects directory: /var/lib/boinc/slots/21/ICMSHhq0f+000036
Moving to projects directory: /var/lib/boinc/slots/21/ICMUAhq0f+000036
17:30:06 STEP 37 H= 37:00 +CPU= 17.349
17:30:23 STEP 38 H= 38:00 +CPU= 16.721
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:30:52 STEP 39 H= 39:00 +CPU= 26.634
17:31:09 STEP 40 H= 40:00 +CPU= 16.426
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:31:28 STEP 41 H= 41:00 +CPU= 16.999
17:31:56 STEP 42 H= 42:00 +CPU= 27.952
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:32:14 STEP 43 H= 43:00 +CPU= 16.029
17:32:31 STEP 44 H= 44:00 +CPU= 16.853
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:33:01 STEP 45 H= 45:00 +CPU= 27.849
17:33:17 STEP 46 H= 46:00 +CPU= 16.043
17:33:34 STEP 47 H= 47:00 +CPU= 16.620
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:34:07 STEP 48 H= 48:00 +CPU= 31.463
Moving to projects directory: /var/lib/boinc/slots/21/ICMGGhq0f+000048
Moving to projects directory: /var/lib/boinc/slots/21/ICMSHhq0f+000048
Moving to projects directory: /var/lib/boinc/slots/21/ICMUAhq0f+000048
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMGGhq0f+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMSHhq0f+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMUAhq0f+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMGGhq0f+000036
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMSHhq0f+000036
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMUAhq0f+000036
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0234_1992050100_123_961_12177878_1_r1837049404_1.zip
Uploading the intermediate file: upload_file_1.zip
17:34:22 STEP 49 H= 49:00 +CPU= 14.319
17:34:38 STEP 50 H= 50:00 +CPU= 15.727
17:35:05 STEP 51 H= 51:00 +CPU= 27.677
17:35:23 STEP 52 H= 52:00 +CPU= 17.378
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:35:42 STEP 53 H= 53:00 +CPU= 17.077
17:36:09 STEP 54 H= 54:00 +CPU= 27.240
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:36:29 STEP 55 H= 55:00 +CPU= 17.361
17:36:45 STEP 56 H= 56:00 +CPU= 15.864
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:37:15 STEP 57 H= 57:00 +CPU= 28.500
17:37:33 STEP 58 H= 58:00 +CPU= 17.555
17:37:50 STEP 59 H= 59:00 +CPU= 17.041
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:38:22 STEP 60 H= 60:00 +CPU= 30.249
Moving to projects directory: /var/lib/boinc/slots/21/ICMGGhq0f+000060
Moving to projects directory: /var/lib/boinc/slots/21/ICMSHhq0f+000060
Moving to projects directory: /var/lib/boinc/slots/21/ICMUAhq0f+000060
17:38:38 STEP 61 H= 61:00 +CPU= 16.011
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:38:58 STEP 62 H= 62:00 +CPU= 17.620
17:39:25 STEP 63 H= 63:00 +CPU= 27.427
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:39:44 STEP 64 H= 64:00 +CPU= 16.988
17:40:01 STEP 65 H= 65:00 +CPU= 16.554
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:40:32 STEP 66 H= 66:00 +CPU= 28.204
17:40:48 STEP 67 H= 67:00 +CPU= 16.377
17:41:05 STEP 68 H= 68:00 +CPU= 16.911
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:41:36 STEP 69 H= 69:00 +CPU= 28.576
17:41:53 STEP 70 H= 70:00 +CPU= 17.221
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:42:14 STEP 71 H= 71:00 +CPU= 18.684
17:42:46 STEP 72 H= 72:00 +CPU= 31.317
Moving to projects directory: /var/lib/boinc/slots/21/ICMGGhq0f+000072
Moving to projects directory: /var/lib/boinc/slots/21/ICMSHhq0f+000072
Moving to projects directory: /var/lib/boinc/slots/21/ICMUAhq0f+000072
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMGGhq0f+000048
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMSHhq0f+000048
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMUAhq0f+000048
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMGGhq0f+000060
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMSHhq0f+000060
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMUAhq0f+000060
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0234_1992050100_123_961_12177878_1_r1837049404_2.zip
Uploading the intermediate file: upload_file_2.zip
17:43:03 STEP 73 H= 73:00 +CPU= 17.153
17:43:21 STEP 74 H= 74:00 +CPU= 17.696
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:43:50 STEP 75 H= 75:00 +CPU= 27.264
17:44:08 STEP 76 H= 76:00 +CPU= 17.500
17:44:25 STEP 77 H= 77:00 +CPU= 17.245
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:44:55 STEP 78 H= 78:00 +CPU= 27.453
17:45:12 STEP 79 H= 79:00 +CPU= 16.651
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:45:33 STEP 80 H= 80:00 +CPU= 19.348
17:46:01 STEP 81 H= 81:00 +CPU= 27.133
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:46:20 STEP 82 H= 82:00 +CPU= 17.900
17:46:38 STEP 83 H= 83:00 +CPU= 17.993
17:47:10 STEP 84 H= 84:00 +CPU= 31.523
Moving to projects directory: /var/lib/boinc/slots/21/ICMGGhq0f+000084
Moving to projects directory: /var/lib/boinc/slots/21/ICMSHhq0f+000084
Moving to projects directory: /var/lib/boinc/slots/21/ICMUAhq0f+000084
17:47:27 STEP 85 H= 85:00 +CPU= 17.236
17:47:45 STEP 86 H= 86:00 +CPU= 17.642
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:48:17 STEP 87 H= 87:00 +CPU= 29.468
17:48:34 STEP 88 H= 88:00 +CPU= 17.180
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:48:52 STEP 89 H= 89:00 +CPU= 15.859
17:49:20 STEP 90 H= 90:00 +CPU= 27.952
17:49:36 STEP 91 H= 91:00 +CPU= 16.830
17:49:55 STEP 92 H= 92:00 +CPU= 18.353
17:50:23 STEP 93 H= 93:00 +CPU= 27.932
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:50:42 STEP 94 H= 94:00 +CPU= 17.532
17:51:00 STEP 95 H= 95:00 +CPU= 17.487
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:51:37 STEP 96 H= 96:00 +CPU= 35.078
Moving to projects directory: /var/lib/boinc/slots/21/ICMGGhq0f+000096
Moving to projects directory: /var/lib/boinc/slots/21/ICMSHhq0f+000096
Moving to projects directory: /var/lib/boinc/slots/21/ICMUAhq0f+000096
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMGGhq0f+000072
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMSHhq0f+000072
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMUAhq0f+000072
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMGGhq0f+000084
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMSHhq0f+000084
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMUAhq0f+000084
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0234_1992050100_123_961_12177878_1_r1837049404_3.zip
Uploading the intermediate file: upload_file_3.zip
17:51:55 STEP 97 H= 97:00 +CPU= 17.786
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:52:14 STEP 98 H= 98:00 +CPU= 17.501
17:52:42 STEP 99 H= 99:00 +CPU= 27.400
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:53:02 STEP 100 H= 100:00 +CPU= 17.771
17:53:18 STEP 101 H= 101:00 +CPU= 16.864
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:53:48 STEP 102 H= 102:00 +CPU= 27.585
17:54:05 STEP 103 H= 103:00 +CPU= 16.840
17:54:22 STEP 104 H= 104:00 +CPU= 17.024
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:54:52 STEP 105 H= 105:00 +CPU= 28.205
17:55:09 STEP 106 H= 106:00 +CPU= 17.075
17:55:25 STEP 107 H= 107:00 +CPU= 15.883
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:55:59 STEP 108 H= 108:00 +CPU= 31.211
Moving to projects directory: /var/lib/boinc/slots/21/ICMGGhq0f+000108
Moving to projects directory: /var/lib/boinc/slots/21/ICMSHhq0f+000108
Moving to projects directory: /var/lib/boinc/slots/21/ICMUAhq0f+000108
17:56:15 STEP 109 H= 109:00 +CPU= 16.350
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:56:34 STEP 110 H= 110:00 +CPU= 16.788
17:57:05 STEP 111 H= 111:00 +CPU= 30.815
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:57:25 STEP 112 H= 112:00 +CPU= 18.385
17:57:42 STEP 113 H= 113:00 +CPU= 17.020
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:58:14 STEP 114 H= 114:00 +CPU= 30.201
17:58:32 STEP 115 H= 115:00 +CPU= 17.431
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:58:52 STEP 116 H= 116:00 +CPU= 17.794
17:59:21 STEP 117 H= 117:00 +CPU= 29.007
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:59:41 STEP 118 H= 118:00 +CPU= 18.546
18:00:00 STEP 119 H= 119:00 +CPU= 18.853
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:00:35 STEP 120 H= 120:00 +CPU= 32.508
Moving to projects directory: /var/lib/boinc/slots/21/ICMGGhq0f+000120
Moving to projects directory: /var/lib/boinc/slots/21/ICMSHhq0f+000120
Moving to projects directory: /var/lib/boinc/slots/21/ICMUAhq0f+000120
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMGGhq0f+000096
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMSHhq0f+000096
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMUAhq0f+000096
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMGGhq0f+000108
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMSHhq0f+000108
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878/ICMUAhq0f+000108
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0234_1992050100_123_961_12177878_1_r1837049404_4.zip
Uploading the intermediate file: upload_file_4.zip
18:00:52 STEP 121 H= 121:00 +CPU= 16.311
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:01:24 STEP 122 H= 122:00 +CPU= 20.000
18:01:54 STEP 123 H= 123:00 +CPU= 28.889
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:07:34 STEP 124 H= 124:00 +CPU= 23.090
18:07:57 STEP 125 H= 125:00 +CPU= 19.092
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:08:26 STEP 126 H= 126:00 +CPU= 27.138
18:08:41 STEP 127 H= 127:00 +CPU= 15.668
18:09:02 STEP 128 H= 128:00 +CPU= 20.239
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:13:02 STEP 129 H= 129:00 +CPU= 32.778
18:13:20 STEP 130 H= 130:00 +CPU= 17.128
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:13:39 STEP 131 H= 131:00 +CPU= 17.221
18:14:12 STEP 132 H= 132:00 +CPU= 33.332
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc/slots/21/ICMGGhq0f+000132
Moving to projects directory: /var/lib/boinc/slots/21/ICMSHhq0f+000132
Moving to projects directory: /var/lib/boinc/slots/21/ICMUAhq0f+000132
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1992050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0234
(argv4) batchid: 961
(argv5) wuid: 12177878
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/21
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/21/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/21/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
18:46:17 STEP 133 H= 133:00 +CPU= 24.236
Copying the namelist files from: ../../projects/climateprediction.net/jf_79fdddffd35fc8f42539eafea212a505 to: /var/lib/boinc/slots/21/oifs_43r3_ps_0234_1992050100_123_961_12177878.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/21/oifs_43r3_ps_0234_1992050100_123_961_12177878.zip
ic_ancil_file: ic_ancil_12177878
ifsdata_file: ifsdata_12177878
climate_data_file: clim_data_12177878
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_21b23644f6d71b49bb47e9cd936d5918 to: /var/lib/boinc/slots/21/ic_ancil_12177878.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/21/ic_ancil_12177878.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_e8b65ffcbd1c4ddd5fc2bb997592f34f to: /var/lib/boinc/slots/21/ifsdata/ifsdata_12177878.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/21/ifsdata/ifsdata_12177878.zip
18:46:38 STEP 134 H= 134:00 +CPU= 20.496
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/21/159l_2/clim_data_12177878.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/21/159l_2/clim_data_12177878.zip
Checking for progress XML file: /var/lib/boinc/slots/21/progress_file_12177878.xml
Opened progress file ok : /var/lib/boinc/slots/21/progress_file_12177878.xml
-- Model is restarting --
Adjusting last_iter, 133, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/21/progress_file_12177878.xml
last_cpu_time: 2807
upload_file_number: 5
last_iter: 119
last_upload: 432000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0234_1992050100_123_961_12177878_1_r1837049404
The child process has been launched with process id: 14900
Executing the command: /var/lib/boinc/slots/21/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.032] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.033] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.033] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.033] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.033] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.033] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:14900:14900] [20221222:184654:1671709614:0.033] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:47:08 STEP 135 H= 135:00 +CPU= 28.456
Invalid characters in stoi string: STEPO
Unable to update iter, resetting to last_iter.
ifs_line =
Invalid characters in stoi string: STEPO
Unable to update iter, resetting to last_iter.
ifs_line =
Invalid characters in stoi string: STEPO
Unable to update iter, resetting to last_iter.
ifs_line =
Suspend request received from the BOINC client, suspending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1992050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0234
(argv4) batchid: 961
(argv5) wuid: 12177878
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/21
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/21/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1992050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0234
(argv4) batchid: 961
(argv5) wuid: 12177878
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/21
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/21/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/21/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1992050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0234
(argv4) batchid: 961
(argv5) wuid: 12177878
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/21
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/21/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/21/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
14:23:35 STEP 136 H= 136:00 +CPU=*******
14:24:03 STEP 137 H= 137:00 +CPU= 25.262
Copying the namelist files from: ../../projects/climateprediction.net/jf_79fdddffd35fc8f42539eafea212a505 to: /var/lib/boinc/slots/21/oifs_43r3_ps_0234_1992050100_123_961_12177878.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/21/oifs_43r3_ps_0234_1992050100_123_961_12177878.zip
ic_ancil_file: ic_ancil_12177878
ifsdata_file: ifsdata_12177878
climate_data_file: clim_data_12177878
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_21b23644f6d71b49bb47e9cd936d5918 to: /var/lib/boinc/slots/21/ic_ancil_12177878.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/21/ic_ancil_12177878.zip
14:24:44 STEP 138 H= 138:00 +CPU= 35.424
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_e8b65ffcbd1c4ddd5fc2bb997592f34f to: /var/lib/boinc/slots/21/ifsdata/ifsdata_12177878.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/21/ifsdata/ifsdata_12177878.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/21/159l_2/clim_data_12177878.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/21/159l_2/clim_data_12177878.zip
Checking for progress XML file: /var/lib/boinc/slots/21/progress_file_12177878.xml
Opened progress file ok : /var/lib/boinc/slots/21/progress_file_12177878.xml
-- Model is restarting --
Adjusting last_iter, -999, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/21/progress_file_12177878.xml
last_cpu_time: 5224
upload_file_number: 5
last_iter: -985
last_upload: 432000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0234_1992050100_123_961_12177878_1_r1837049404
Executing the command: /var/lib/boinc/slots/21/oifs_43r3_model.exe
The child process has been launched with process id: 20489
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1992050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0234
(argv4) batchid: 961
(argv5) wuid: 12177878
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/21
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/21/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/21/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:000431:1671987871:391.537] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:000724:1671988044:531.656] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:000848:1671988128:998.440] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:001746:1671988666:1207.471] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:002020:1671988820:1378.601] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:002403:1671989043:1614.448] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:002658:1671989218:1729.530] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:002913:1671989353:1868.636] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:003125:1671989485:2049.273] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:003444:1671989684:2189.440] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:003625:1671989785:2287.660] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:003858:1671989938:2559.322] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:004235:1671990155:2651.433] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:004838:1671990518:3032.426] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:005026:1671990626:3137.007] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:005142:1671990702:3211.270] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:005403:1671990843:3388.702] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:030046:1671998446:12341.948] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:033540:1672000540:13241.909] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:034029:1672000829:13336.837] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:034141:1672000901:13401.885] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:034255:1672000975:13478.205] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:034420:1672001060:13575.156] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:034550:1672001150:13663.268] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:034721:1672001241:13734.837] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:034758:1672001278:13782.994] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:034937:1672001377:13887.557] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:035136:1672001496:14027.506] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:035717:1672001837:14391.196] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:20489:20489] [20221226:040316:1672002196:14817.953] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
04:05:43 STEP 139 H= 139:00 +CPU=*******
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1992050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0234
(argv4) batchid: 961
(argv5) wuid: 12177878
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/21
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12177878
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/21/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/21/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_79fdddffd35fc8f42539eafea212a505 to: /var/lib/boinc/slots/21/oifs_43r3_ps_0234_1992050100_123_961_12177878.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/21/oifs_43r3_ps_0234_1992050100_123_961_12177878.zip
ic_ancil_file: ic_ancil_12177878
ifsdata_file: ifsdata_12177878
climate_data_file: clim_data_12177878
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_21b23644f6d71b49bb47e9cd936d5918 to: /var/lib/boinc/slots/21/ic_ancil_12177878.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/21/ic_ancil_12177878.zip
05:15:13 STEP 120 H= 120:00 +CPU=204.422
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_e8b65ffcbd1c4ddd5fc2bb997592f34f to: /var/lib/boinc/slots/21/ifsdata/ifsdata_12177878.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/21/ifsdata/ifsdata_12177878.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/21/159l_2/clim_data_12177878.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/21/159l_2/clim_data_12177878.zip
Checking for progress XML file: /var/lib/boinc/slots/21/progress_file_12177878.xml
Creating progress file: /var/lib/boinc/slots/21/progress_file_12177878.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0234_1992050100_123_961_12177878_1_r1837049404
The child process has been launched with process id: 21946
Executing the command: /var/lib/boinc/slots/21/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053611:1672007771:0.019] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053611:1672007771:0.019] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053611:1672007771:0.019] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053611:1672007771:0.019] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053611:1672007771:0.019] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.045] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.046] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.046] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.046] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.046] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.046] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.046] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.046] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.046] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.046] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.046] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.046] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.046] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.046] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.046] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.046] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.046] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.046] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.046] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.055] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.055] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.055] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.055] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.055] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:21946:21946] [20221226:053612:1672007772:0.055] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
SIGSEGV: segmentation violation
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1992050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0234
(argv4) batchid: 961
(argv5) wuid: 12177878
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/21
Project directory is: /var/lib/boinc/projects/climateprediction.net/
Stack trace (8 frames):
[0x453b63]
[0x53c3f0]
[0x452c07]
[0x41cf1c]
[0x41f305]
[0x41f85e]
[0x538cf9]
[0x5fb433]
Exiting...
</stderr_txt>
]]>
