<core_client_version>7.22.1</core_client_version>
<![CDATA[
<stderr_txt>
e child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:02:20 STEP 1836 H= 459:00 +CPU= 16.256
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /home/karl_neu/slots/12/ICMGGh7zg+001836
Moving to projects directory: /home/karl_neu/slots/12/ICMSHh7zg+001836
Moving to projects directory: /home/karl_neu/slots/12/ICMUAh7zg+001836
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:02:52 STEP 1837 H= 459:15 +CPU= 13.047
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:03:42 STEP 1838 H= 459:30 +CPU= 11.959
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:04:14 STEP 1839 H= 459:45 +CPU= 12.391
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:04:45 STEP 1840 H= 460:00 +CPU= 12.582
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:05:15 STEP 1841 H= 460:15 +CPU= 12.031
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:05:47 STEP 1842 H= 460:30 +CPU= 12.520
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:06:18 STEP 1843 H= 460:45 +CPU= 12.337
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.591] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 3958MB (heap), 4796MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.591] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.591] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x820890 (old at (nil))
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.591] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x3e800000000], nsigs = 1
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.591] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.591] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3843] 3958 MB (maxheap), 4796 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.591] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : MASTER
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.591] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT0
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.591] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT1
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.591] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT2
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.591] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT3
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.591] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT4
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.591] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : STEPO
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.591] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : SCAN2M
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.591] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : GP_MODEL_HEAP
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.591] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : GP_MODEL
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.591] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : EC_PHYS_DRV
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.592] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : >OMP-PHYSICS (1001)
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.592] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : EC_PHYS
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.592] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CALLPAR
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.592] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : TURBULENCE_LAYER
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.592] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : VDFOUTER
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.592] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : VDFMAIN
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.592] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : SURFEXCDRIVER
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.592] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : SURFEXCDRIVER_CTL_MOD:SURFEXCDRIVER_CTL
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030642:1718500002:61858.592] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : SRFCOTWO_MOD:SRFCOTWO
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030643:1718500003:61859.592] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240616:030643:1718500003:61859.592] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1cf8da0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image PC Routine Line Source
oifs_43r3_model.e 0000000001CF935B Unknown Unknown Unknown
oifs_43r3_model.e 00000000008214C1 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DD5490 Unknown Unknown Unknown
oifs_43r3_model.e 00000000018299E1 srfcotwo_mod_mp_s 315 srfcotwo_mod.F90
oifs_43r3_model.e 0000000001807945 surfexcdriver_ctl 680 surfexcdriver_ctl_mod.F90
oifs_43r3_model.e 00000000016397FE surfexcdriver_ 847 surfexcdriver.F90
oifs_43r3_model.e 000000000121ECE4 vdfmain_ 738 vdfmain.F90
oifs_43r3_model.e 0000000001207E29 vdfouter_ 739 vdfouter.F90
oifs_43r3_model.e 00000000011FDCB2 turbulence_layer_ 158 turbulence_layer.F90
oifs_43r3_model.e 0000000000FAC003 callpar_ 869 callpar.F90
oifs_43r3_model.e 0000000000F5FA6B ec_phys_ 670 ec_phys.F90
oifs_43r3_model.e 0000000000F4DBC4 ec_phys_drv_ 599 ec_phys_drv.F90
oifs_43r3_model.e 0000000000BD7131 gp_model_ 613 gp_model.F90
oifs_43r3_model.e 00000000012C5002 gp_model_heap_ 74 gp_model_heap.F90
oifs_43r3_model.e 0000000000BACBAE scan2m_ 535 scan2m.F90
oifs_43r3_model.e 0000000000688153 stepo_ 327 stepo.F90
oifs_43r3_model.e 00000000004CD1DC cnt4_ 1133 cnt4.F90
oifs_43r3_model.e 00000000004B5D85 cnt3_ 267 cnt3.F90
oifs_43r3_model.e 00000000004B4F52 cnt2_ 88 cnt2.F90
oifs_43r3_model.e 000000000049D638 cnt1_ 92 cnt1.F90
oifs_43r3_model.e 0000000000406FBD cnt0_ 146 cnt0.F90
oifs_43r3_model.e 0000000000401E7F MAIN__ 96 master.F90
oifs_43r3_model.e 0000000000401E12 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DCC34A Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DCDBE7 Unknown Unknown Unknown
oifs_43r3_model.e 0000000000401CD5 Unknown Unknown Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a0d5
(argv4) batchid: 1018
(argv5) wuid: 12288800
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /home/karl_neu/slots/12
Project directory is: /home/karl_neu/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800
..mkdir for temp folder for results failed
Copying: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /home/karl_neu/slots/12/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /home/karl_neu/slots/12/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_24763ddda0a7be2260508b7e5fee55fd to: /home/karl_neu/slots/12/oifs_43r3_bl_a0d5_2016092300_20_1018_12288800.zip
Unzipping the namelist zip file: /home/karl_neu/slots/12/oifs_43r3_bl_a0d5_2016092300_20_1018_12288800.zip
ic_ancil_file: ic_ancil_12288800
ifsdata_file: ifsdata_12288800
climate_data_file: clim_data_12288800
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /home/karl_neu/slots/12/ic_ancil_12288800.zip
Unzipping the IC ancils zip file: /home/karl_neu/slots/12/ic_ancil_12288800.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_e9ae64b058c935dac9590a70b4865533 to: /home/karl_neu/slots/12/ifsdata/ifsdata_12288800.zip
Unzipping the ifsdata_zip file: /home/karl_neu/slots/12/ifsdata/ifsdata_12288800.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /home/karl_neu/slots/12/159l_2/clim_data_12288800.zip
Unzipping the climate data zip file: /home/karl_neu/slots/12/159l_2/clim_data_12288800.zip
Checking for progress XML file: /home/karl_neu/slots/12/progress_file_12288800.xml
Opened progress file ok : /home/karl_neu/slots/12/progress_file_12288800.xml
-- Model is restarting --
Adjusting last_iter, 1844, to previous model restart step.
Creating progress file: /home/karl_neu/slots/12/progress_file_12288800.xml
last_cpu_time: 28209
upload_file_number: 15
last_iter: 1825
last_upload: 1598400
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a0d5_2016092300_20_1018_12288800_1_r1207509095
The child process has been launched with process id: 77
Executing the command: /home/karl_neu/slots/12/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:karl-Micro-Star:1:1:77:77] [20240616:143339:1718541219:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:34:26 STEP 1824 H= 456:00 +CPU= 11.502
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:34:53 STEP 1825 H= 456:15 +CPU= 11.106
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:35:23 STEP 1826 H= 456:30 +CPU= 11.334
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:35:49 STEP 1827 H= 456:45 +CPU= 10.855
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:36:19 STEP 1828 H= 457:00 +CPU= 11.848
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:36:49 STEP 1829 H= 457:15 +CPU= 11.572
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:37:09 STEP 1830 H= 457:30 +CPU= 11.754
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:37:25 STEP 1831 H= 457:45 +CPU= 12.575
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:37:40 STEP 1832 H= 458:00 +CPU= 13.009
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:37:57 STEP 1833 H= 458:15 +CPU= 12.627
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:38:11 STEP 1834 H= 458:30 +CPU= 12.623
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:38:28 STEP 1835 H= 458:45 +CPU= 12.563
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:38:48 STEP 1836 H= 459:00 +CPU= 16.320
Moving to projects directory: /home/karl_neu/slots/12/ICMGGh7zg+001836
Moving to projects directory: /home/karl_neu/slots/12/ICMSHh7zg+001836
Moving to projects directory: /home/karl_neu/slots/12/ICMUAh7zg+001836
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:39:05 STEP 1837 H= 459:15 +CPU= 12.738
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:39:20 STEP 1838 H= 459:30 +CPU= 12.664
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:39:36 STEP 1839 H= 459:45 +CPU= 12.580
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:39:51 STEP 1840 H= 460:00 +CPU= 13.051
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:40:08 STEP 1841 H= 460:15 +CPU= 12.444
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:40:22 STEP 1842 H= 460:30 +CPU= 12.463
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:40:39 STEP 1843 H= 460:45 +CPU= 12.564
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:40:56 STEP 1844 H= 461:00 +CPU= 12.926
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:41:11 STEP 1845 H= 461:15 +CPU= 12.643
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:41:27 STEP 1846 H= 461:30 +CPU= 12.472
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:41:42 STEP 1847 H= 461:45 +CPU= 12.588
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:42:02 STEP 1848 H= 462:00 +CPU= 16.157
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /home/karl_neu/slots/12/ICMGGh7zg+001848
Moving to projects directory: /home/karl_neu/slots/12/ICMSHh7zg+001848
Moving to projects directory: /home/karl_neu/slots/12/ICMUAh7zg+001848
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:42:18 STEP 1849 H= 462:15 +CPU= 12.498
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:42:33 STEP 1850 H= 462:30 +CPU= 12.478
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:42:49 STEP 1851 H= 462:45 +CPU= 12.631
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:43:06 STEP 1852 H= 463:00 +CPU= 13.004
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:43:21 STEP 1853 H= 463:15 +CPU= 12.684
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:43:38 STEP 1854 H= 463:30 +CPU= 12.453
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:43:52 STEP 1855 H= 463:45 +CPU= 12.495
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:44:10 STEP 1856 H= 464:00 +CPU= 13.393
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:44:26 STEP 1857 H= 464:15 +CPU= 12.700
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:44:41 STEP 1858 H= 464:30 +CPU= 12.850
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:44:58 STEP 1859 H= 464:45 +CPU= 12.482
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:45:18 STEP 1860 H= 465:00 +CPU= 16.102
Moving to projects directory: /home/karl_neu/slots/12/ICMGGh7zg+001860
Moving to projects directory: /home/karl_neu/slots/12/ICMSHh7zg+001860
Moving to projects directory: /home/karl_neu/slots/12/ICMUAh7zg+001860
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:45:32 STEP 1861 H= 465:15 +CPU= 12.456
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:45:49 STEP 1862 H= 465:30 +CPU= 12.473
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:46:03 STEP 1863 H= 465:45 +CPU= 12.561
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:46:20 STEP 1864 H= 466:00 +CPU= 13.081
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:46:37 STEP 1865 H= 466:15 +CPU= 12.480
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:46:51 STEP 1866 H= 466:30 +CPU= 12.670
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:47:08 STEP 1867 H= 466:45 +CPU= 12.259
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:47:23 STEP 1868 H= 467:00 +CPU= 12.799
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:47:39 STEP 1869 H= 467:15 +CPU= 12.445
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:47:53 STEP 1870 H= 467:30 +CPU= 12.386
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:48:10 STEP 1871 H= 467:45 +CPU= 12.707
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:48:35 STEP 1872 H= 468:00 +CPU= 18.549
Moving to projects directory: /home/karl_neu/slots/12/ICMGGh7zg+001872
Moving to projects directory: /home/karl_neu/slots/12/ICMSHh7zg+001872
Moving to projects directory: /home/karl_neu/slots/12/ICMUAh7zg+001872
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMGGh7zg+001776
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMSHh7zg+001776
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMUAh7zg+001776
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMGGh7zg+001788
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMSHh7zg+001788
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMUAh7zg+001788
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMGGh7zg+001800
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMSHh7zg+001800
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMUAh7zg+001800
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMGGh7zg+001812
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMSHh7zg+001812
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMUAh7zg+001812
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMGGh7zg+001824
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMSHh7zg+001824
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMUAh7zg+001824
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMGGh7zg+001836
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMSHh7zg+001836
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMUAh7zg+001836
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMGGh7zg+001848
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMSHh7zg+001848
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMUAh7zg+001848
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMGGh7zg+001860
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMSHh7zg+001860
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMUAh7zg+001860
Zipping up the intermediate file: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_a0d5_2016092300_20_1018_12288800_1_r1207509095_15.zip
Uploading the intermediate file: upload_file_15.zip
14:48:47 STEP 1873 H= 468:15 +CPU= 12.791
14:49:00 STEP 1874 H= 468:30 +CPU= 12.477
14:49:13 STEP 1875 H= 468:45 +CPU= 12.725
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:49:30 STEP 1876 H= 469:00 +CPU= 12.882
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:49:46 STEP 1877 H= 469:15 +CPU= 12.672
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:50:01 STEP 1878 H= 469:30 +CPU= 12.774
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:50:17 STEP 1879 H= 469:45 +CPU= 12.502
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:50:32 STEP 1880 H= 470:00 +CPU= 12.938
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:50:49 STEP 1881 H= 470:15 +CPU= 12.342
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:51:03 STEP 1882 H= 470:30 +CPU= 12.450
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:51:20 STEP 1883 H= 470:45 +CPU= 12.614
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:51:40 STEP 1884 H= 471:00 +CPU= 16.215
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /home/karl_neu/slots/12/ICMGGh7zg+001884
Moving to projects directory: /home/karl_neu/slots/12/ICMSHh7zg+001884
Moving to projects directory: /home/karl_neu/slots/12/ICMUAh7zg+001884
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:51:57 STEP 1885 H= 471:15 +CPU= 12.949
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:52:12 STEP 1886 H= 471:30 +CPU= 12.893
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:52:29 STEP 1887 H= 471:45 +CPU= 12.901
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:52:46 STEP 1888 H= 472:00 +CPU= 13.304
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:53:01 STEP 1889 H= 472:15 +CPU= 12.860
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:53:18 STEP 1890 H= 472:30 +CPU= 12.865
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:53:35 STEP 1891 H= 472:45 +CPU= 12.936
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:53:50 STEP 1892 H= 473:00 +CPU= 13.380
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:54:07 STEP 1893 H= 473:15 +CPU= 12.915
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:54:22 STEP 1894 H= 473:30 +CPU= 12.872
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:54:39 STEP 1895 H= 473:45 +CPU= 12.794
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:54:59 STEP 1896 H= 474:00 +CPU= 16.548
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /home/karl_neu/slots/12/ICMGGh7zg+001896
Moving to projects directory: /home/karl_neu/slots/12/ICMSHh7zg+001896
Moving to projects directory: /home/karl_neu/slots/12/ICMUAh7zg+001896
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:55:16 STEP 1897 H= 474:15 +CPU= 12.891
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:55:31 STEP 1898 H= 474:30 +CPU= 12.842
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:55:48 STEP 1899 H= 474:45 +CPU= 12.792
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:56:05 STEP 1900 H= 475:00 +CPU= 13.101
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:56:20 STEP 1901 H= 475:15 +CPU= 12.815
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:56:37 STEP 1902 H= 475:30 +CPU= 12.761
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:56:51 STEP 1903 H= 475:45 +CPU= 12.813
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:57:09 STEP 1904 H= 476:00 +CPU= 13.207
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:57:26 STEP 1905 H= 476:15 +CPU= 12.828
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:57:40 STEP 1906 H= 476:30 +CPU= 12.807
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:57:57 STEP 1907 H= 476:45 +CPU= 12.769
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:58:18 STEP 1908 H= 477:00 +CPU= 16.389
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /home/karl_neu/slots/12/ICMGGh7zg+001908
Moving to projects directory: /home/karl_neu/slots/12/ICMSHh7zg+001908
Moving to projects directory: /home/karl_neu/slots/12/ICMUAh7zg+001908
14:58:32 STEP 1909 H= 477:15 +CPU= 12.782
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:58:49 STEP 1910 H= 477:30 +CPU= 12.784
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:59:06 STEP 1911 H= 477:45 +CPU= 12.770
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:59:21 STEP 1912 H= 478:00 +CPU= 13.123
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:59:38 STEP 1913 H= 478:15 +CPU= 12.763
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:59:52 STEP 1914 H= 478:30 +CPU= 12.701
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:00:07 STEP 1915 H= 478:45 +CPU= 12.876
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:00:25 STEP 1916 H= 479:00 +CPU= 13.859
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:00:41 STEP 1917 H= 479:15 +CPU= 14.044
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:00:59 STEP 1918 H= 479:30 +CPU= 13.807
15:01:12 STEP 1919 H= 479:45 +CPU= 13.073
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:01:36 STEP 1920 H= 480:00 +CPU= 18.068
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01
DDH------------------------------------------------------------------------
I I
I TIME = 480.000H DDH * Diagnostic Var., AREA GLOBAL I
I I
I-------------------------------------------------------------------------I
I VARIABLE I Initial value I Current value I
I-------------------------------------------------------------------------I
I OMEGA (P/S) I -0.4034842951E-21 I 0.5262937019E-06 I
ICloud fractionI 0.0000000000E+00 I 0.5992455184E-02 I
I Relat. Hum. I 0.4214950262E+00 I 0.4363875401E+00 I
I PASS 01 I 0.0000000000E+00 I 0.9597020812E+02 I
DDH------------------------------------------------------------------------
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
NSTEP = 1920 SCAN2M_HPOS P
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
ICMGGh7zg+001920 MODE=a
IO-STREAM CLOSED - ICMGGh7zg+001920
MPI-TASK: 1 - 908242276 BYTES IN 7 RECORDS TRANSFERRED IN 0.0002 SECONDS******** Mbytes/s, TOTAL TIME= 0.0054( 3.7%)
15:01:36 STEP 1920 H= 480:00 +CPU= 18.068
END CNT3
NSTEP = 1920 CNT0 000000000 12.709 12.709 16.726 0.760 0 0 0 0 0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ 46/ 1069125708 WRITTEN 2860/************
-TASK-OPENED-OPEN-RECS IN -KBYTE IN -RECS OUT-KBYTE OUT-WALL -WALL IN-WALL
OU-TOT IN -TOT OUT
1 53 0 46 1044068 2860 ************ 18.4 15.7 2.7 16.2 7.5
===-=== START OF TIMING STATISTICS ===-===
STATS FOR ALL TASKS
NUM ROUTINE CALLS MEAN(ms) MAX(ms) FRAC(%) UNBAL(%)
0 CNT0 - COMPLETE EXECUTION 1 1676984.9 1676984.9 100.00 0.00
1 CNT4 - FORWARD INTEGRATION 1 1657818.7 1657818.7 98.86 0.00
8 SCAN2M - GRID-POINT DYNAMICS 105 2919.1 2919.1 18.28 0.00
9 SPCM - SPECTRAL COMP. 96 508.5 508.5 2.91 0.00
10 SCAN2M - PHYSICS 97 7776.5 7776.5 44.98 0.00
11 IOPACK - OUTPUT P.P. RESULTS 8 787.1 787.1 0.38 0.00
12 SPNORM - SPECTRAL NORM COMP. 5 29.9 29.9 0.01 0.00
17 GRIDFPOS IN CNT4 8 15.4 15.4 0.01 0.00
27 RESTART FILES - WRITING 2 3148.5 3148.5 0.38 0.00
28 RESTART FILES - READING 1 18768.9 18768.9 1.12 0.00
29 SU4FPOS IN CNT4 8 0.1 0.1 0.00 0.00
30 DYNFPOS IN CNT4 8 3564.4 3564.4 1.70 0.00
31 POSDDH IN STEPO 1 1.0 1.0 0.00 0.00
37 CPGLAG - SL COMPUTATIONS 97 3685.5 3685.5 21.32 0.00
39 SU0YOMB 1 251.9 251.9 0.02 0.00
51 SCAN2M - SL COMM. PART 1 97 12.3 12.3 0.07 0.00
54 SPCM - M TO S/S TO M TRANSP. 96 92.3 92.3 0.53 0.00
55 SPCIMPF - S TO M/M TO S TRANSP. 96 34.6 34.6 0.20 0.00
56 SPNORM - SPECTRAL NORM COMM. 5 0.1 0.1 0.00 0.00
102 LTINV_CTL - INVERSE LEGENDRE TRANSFORM 212 216.5 216.5 2.74 0.00
103 LTDIR_CTL - DIRECT LEGENDRE TRANSFORM 200 134.8 134.8 1.61 0.00
106 FTDIR_CTL - DIRECT FOURIER TRANSFORM 200 62.4 62.4 0.74 0.00
107 FTINV_CTL - INVERSE FOURIER TRANSFORM 212 92.2 92.2 1.17 0.00
140 SULEG - COMP. OF LEGENDRE POL. 1 23.2 23.2 0.00 0.00
152 LTINV_CTL - M TO L TRANSPOSITION 212 65.1 65.1 0.82 0.00
153 LTDIR_CTL - L TO M TRANSPOSITION 200 23.8 23.8 0.28 0.00
157 FTINV_CTL - L TO G TRANSPOSITION 212 54.2 54.2 0.68 0.00
158 FTDIR_CTL - G TO L TRANSPOSITION 200 20.1 20.1 0.24 0.00
400 GSTATS 12215 0.0 0.0 0.00 0.00
401 GSTATS HOOK 11311 0.0 0.0 0.00 0.00
TOTAL MEASURED IMBALANCE = 0.0 SECONDS, 0.0 PERCENT
TOTAL WALLCLOCK TIME 1677.0 CPU TIME 1265.8 VECTOR TIME 1265.8
===-=== END OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY 1042.3
*** END CNT0 ***
------------------------------------------------
Moving to projects directory: /home/karl_neu/slots/12/ICMGGh7zg+001920
Moving to projects directory: /home/karl_neu/slots/12/ICMSHh7zg+001920
Moving to projects directory: /home/karl_neu/slots/12/ICMUAh7zg+001920
Adding to the zip: /home/karl_neu/slots/12/NODE.001_01
Adding to the zip: /home/karl_neu/slots/12/ifs.stat
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMGGh7zg+001872
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMSHh7zg+001872
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMUAh7zg+001872
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMGGh7zg+001884
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMSHh7zg+001884
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMUAh7zg+001884
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMGGh7zg+001896
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMSHh7zg+001896
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMUAh7zg+001896
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMGGh7zg+001908
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMSHh7zg+001908
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMUAh7zg+001908
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMGGh7zg+001920
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMSHh7zg+001920
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12288800/ICMUAh7zg+001920
Zipping up the final file: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_a0d5_2016092300_20_1018_12288800_1_r1207509095_16.zip
Uploading the final file: upload_file_16.zip
Uploading trickle at timestep: 1727100
15:05:00 (64): called boinc_finish(0)
</stderr_txt>
<message>
upload failure: <file_xfer_error>
<file_name>oifs_43r3_bl_a0d5_2016092300_20_1018_12288800_1_r1207509095_17.zip</file_name>
<error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
<file_name>oifs_43r3_bl_a0d5_2016092300_20_1018_12288800_1_r1207509095_18.zip</file_name>
<error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
<file_name>oifs_43r3_bl_a0d5_2016092300_20_1018_12288800_1_r1207509095_19.zip</file_name>
<error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
