Name | oifs_43r3_bl_a1cm_2016092300_20_1017_12283577_0 |
Workunit | 12283577 |
Created | 7 Jun 2024, 13:22:50 UTC |
Sent | 7 Jun 2024, 13:26:54 UTC |
Report deadline | 6 Aug 2024, 13:26:54 UTC |
Received | 9 Jun 2024, 13:34:32 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 0 (0x00000000) |
Computer ID | 1506017 |
Run time | 22 hours 59 min 29 sec |
CPU time | 15 hours 3 min 56 sec |
Validate state | Invalid |
Credit | 1,976.32 |
Device peak FLOPS | 7.35 GFLOPS |
Application version | OpenIFS 43r3 Baroclinic Lifecycle v1.13 x86_64-pc-linux-gnu |
Peak working set size | 5,513.07 MB |
Peak swap size | 5,980.80 MB |
Peak disk usage | 1,432.90 MB |
Stderr | <core_client_version>7.20.5</core_client_version> <![CDATA[ <stderr_txt> quest received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:48:46 STEP 1350 H= 337:30 +CPU= 36.853 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:50:03 STEP 1351 H= 337:45 +CPU= 38.610 05:50:58 STEP 1352 H= 338:00 +CPU= 40.149 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:52:16 STEP 1353 H= 338:15 +CPU= 37.668 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:53:45 STEP 1354 H= 338:30 +CPU= 37.008 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:54:58 STEP 1355 H= 338:45 +CPU= 37.009 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:56:38 STEP 1356 H= 339:00 +CPU= 45.549 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001356 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001356 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001356 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:57:58 STEP 1357 H= 339:15 +CPU= 34.647 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:59:32 STEP 1358 H= 339:30 +CPU= 34.402 Suspend request received from the BOINC client, suspending the child process [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060008:1717905608:60065.030] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 3958MB (heap), 5275MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1 [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060008:1717905608:60065.032] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1 [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060008:1717905608:60065.032] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x820890 (old at (nil)) [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060008:1717905608:60065.034] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1 [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060008:1717905608:60065.034] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1 [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060008:1717905608:60065.034] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3843] 3958 MB (maxheap), 5275 MB (maxrss), 0 MB (maxstack) [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060008:1717905608:60065.035] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : MASTER [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060008:1717905608:60065.035] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT0 [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060008:1717905608:60065.035] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT1 [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060008:1717905608:60065.035] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT2 [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060008:1717905608:60065.035] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT3 [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060008:1717905608:60065.035] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT4 [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060008:1717905608:60065.035] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : STEPO [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060008:1717905608:60065.035] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : SCAN2M [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060008:1717905608:60065.035] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : GP_MODEL_HEAP [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060008:1717905608:60065.035] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : GP_MODEL [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060008:1717905608:60065.035] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : EC_PHYS_DRV [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060008:1717905608:60065.035] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : >OMP-PHYSICS (1001) [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060008:1717905608:60065.035] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : EC_PHYS [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060008:1717905608:60065.035] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CALLPAR [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060008:1717905608:60065.035] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CLOUD_LAYER [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060008:1717905608:60065.035] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CLOUDSC [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060009:1717905609:60066.035] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1 [EC_DRHOOK:jesus:1:1:3757:3757] [20240609:060009:1717905609:60066.035] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1cf8da0 for signal#15, nsigs = 1 forrtl: error (78): process killed (SIGTERM) Image PC Routine Line Source oifs_43r3_model.e 0000000001CF935B Unknown Unknown Unknown oifs_43r3_model.e 00000000008214C1 Unknown Unknown Unknown oifs_43r3_model.e 0000000001DD5490 Unknown Unknown Unknown oifs_43r3_model.e 000000000117AF43 cloudsc_ 2994 cloudsc.F90 oifs_43r3_model.e 000000000115C847 cloud_layer_ 131 cloud_layer.F90 oifs_43r3_model.e 0000000000FBB064 callpar_ 1223 callpar.F90 oifs_43r3_model.e 0000000000F5FA6B ec_phys_ 670 ec_phys.F90 oifs_43r3_model.e 0000000000F4DBC4 ec_phys_drv_ 599 ec_phys_drv.F90 oifs_43r3_model.e 0000000000BD7131 gp_model_ 613 gp_model.F90 oifs_43r3_model.e 00000000012C5002 gp_model_heap_ 74 gp_model_heap.F90 oifs_43r3_model.e 0000000000BACBAE scan2m_ 535 scan2m.F90 oifs_43r3_model.e 0000000000688153 stepo_ 327 stepo.F90 oifs_43r3_model.e 00000000004CD1DC cnt4_ 1133 cnt4.F90 oifs_43r3_model.e 00000000004B5D85 cnt3_ 267 cnt3.F90 oifs_43r3_model.e 00000000004B4F52 cnt2_ 88 cnt2.F90 oifs_43r3_model.e 000000000049D638 cnt1_ 92 cnt1.F90 oifs_43r3_model.e 0000000000406FBD cnt0_ 146 cnt0.F90 oifs_43r3_model.e 0000000000401E7F MAIN__ 96 master.F90 oifs_43r3_model.e 0000000000401E12 Unknown Unknown Unknown oifs_43r3_model.e 0000000001DCC34A Unknown Unknown Unknown oifs_43r3_model.e 0000000001DCDBE7 Unknown Unknown Unknown oifs_43r3_model.e 0000000000401CD5 Unknown Unknown Unknown (argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu (argv1) start_date: 2016092300 (argv2) exptid: h7zg (argv3) unique_member_id: a1cm (argv4) batchid: 1017 (argv5) wuid: 12283577 (argv6) fclen: 20 (argv7) app_name: oifs_43r3_bl (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/9 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_bl version: 1.13 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/9/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/9/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_ab83a0b3b277d668fcecd5469de5b4a3 to: /var/lib/boinc-client/slots/9/oifs_43r3_bl_a1cm_2016092300_20_1017_12283577.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/9/oifs_43r3_bl_a1cm_2016092300_20_1017_12283577.zip ic_ancil_file: ic_ancil_12283577 ifsdata_file: ifsdata_12283577 climate_data_file: clim_data_12283577 horiz_resolution: 159 vert_resolution: 91 grid_type: l_2 upload_interval: 96 utstep: 900 nfrres: restart dump frequency (steps) 48 Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/9/ic_ancil_12283577.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/9/ic_ancil_12283577.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_5ada559c60569f5dd601c23f32ef6596 to: /var/lib/boinc-client/slots/9/ifsdata/ifsdata_12283577.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/9/ifsdata/ifsdata_12283577.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/9/159l_2/clim_data_12283577.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/9/159l_2/clim_data_12283577.zip Checking for progress XML file: /var/lib/boinc-client/slots/9/progress_file_12283577.xml Opened progress file ok : /var/lib/boinc-client/slots/9/progress_file_12283577.xml -- Model is restarting -- Adjusting last_iter, 1359, to previous model restart step. Creating progress file: /var/lib/boinc-client/slots/9/progress_file_12283577.xml last_cpu_time: 50956 upload_file_number: 14 last_iter: 1345 last_upload: 1209600 model_completed: 0 total_length_of_simulation: 1728000 result_base_name: oifs_43r3_bl_a1cm_2016092300_20_1017_12283577_0_r1662125137 The child process has been launched with process id: 3468 Executing the command: /var/lib/boinc-client/slots/9/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440 [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil)) [EC_DRHOOK:jesus:1:1:3468:3468] [20240609:120159:1717927319:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> 12:02:59 STEP 1344 H= 336:00 +CPU= 36.739 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:07:09 STEP 1345 H= 336:15 +CPU= 28.636 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:09:49 STEP 1346 H= 336:30 +CPU= 35.297 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:11:43 STEP 1347 H= 336:45 +CPU= 33.507 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:14:13 STEP 1348 H= 337:00 +CPU= 32.640 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:16:25 STEP 1349 H= 337:15 +CPU= 28.381 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:18:18 STEP 1350 H= 337:30 +CPU= 29.549 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:23:56 STEP 1351 H= 337:45 +CPU= 32.312 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:25:23 STEP 1352 H= 338:00 +CPU= 33.918 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:26:57 STEP 1353 H= 338:15 +CPU= 32.396 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:28:25 STEP 1354 H= 338:30 +CPU= 33.178 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:29:44 STEP 1355 H= 338:45 +CPU= 33.608 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:31:59 STEP 1356 H= 339:00 +CPU= 41.241 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001356 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001356 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001356 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:33:27 STEP 1357 H= 339:15 +CPU= 33.640 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:34:44 STEP 1358 H= 339:30 +CPU= 33.698 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:36:32 STEP 1359 H= 339:45 +CPU= 32.369 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:38:01 STEP 1360 H= 340:00 +CPU= 33.216 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:39:38 STEP 1361 H= 340:15 +CPU= 33.434 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:41:02 STEP 1362 H= 340:30 +CPU= 32.017 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:42:39 STEP 1363 H= 340:45 +CPU= 31.249 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:44:06 STEP 1364 H= 341:00 +CPU= 32.755 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:45:36 STEP 1365 H= 341:15 +CPU= 33.102 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:46:49 STEP 1366 H= 341:30 +CPU= 32.795 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:48:25 STEP 1367 H= 341:45 +CPU= 31.364 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:49:51 STEP 1368 H= 342:00 +CPU= 41.605 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001368 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001368 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001368 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:51:05 STEP 1369 H= 342:15 +CPU= 32.369 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:52:16 STEP 1370 H= 342:30 +CPU= 31.491 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:53:32 STEP 1371 H= 342:45 +CPU= 32.714 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:54:56 STEP 1372 H= 343:00 +CPU= 32.575 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:56:20 STEP 1373 H= 343:15 +CPU= 32.326 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:57:32 STEP 1374 H= 343:30 +CPU= 32.431 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 12:58:46 STEP 1375 H= 343:45 +CPU= 32.495 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:00:23 STEP 1376 H= 344:00 +CPU= 33.300 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:01:37 STEP 1377 H= 344:15 +CPU= 33.647 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:02:53 STEP 1378 H= 344:30 +CPU= 32.941 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:04:29 STEP 1379 H= 344:45 +CPU= 31.812 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:05:59 STEP 1380 H= 345:00 +CPU= 42.398 Suspend request received from the BOINC client, suspending the child process Resuming the child process Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001380 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001380 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001380 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:07:38 STEP 1381 H= 345:15 +CPU= 32.836 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:09:03 STEP 1382 H= 345:30 +CPU= 32.880 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:10:29 STEP 1383 H= 345:45 +CPU= 34.409 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:11:46 STEP 1384 H= 346:00 +CPU= 33.869 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:13:14 STEP 1385 H= 346:15 +CPU= 33.318 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:14:51 STEP 1386 H= 346:30 +CPU= 32.466 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:16:07 STEP 1387 H= 346:45 +CPU= 33.311 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:17:34 STEP 1388 H= 347:00 +CPU= 33.980 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:19:11 STEP 1389 H= 347:15 +CPU= 32.101 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:20:50 STEP 1390 H= 347:30 +CPU= 34.226 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:22:14 STEP 1391 H= 347:45 +CPU= 33.261 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:24:07 STEP 1392 H= 348:00 +CPU= 44.787 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001392 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001392 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001392 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:25:29 STEP 1393 H= 348:15 +CPU= 32.169 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:26:52 STEP 1394 H= 348:30 +CPU= 32.267 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:28:05 STEP 1395 H= 348:45 +CPU= 33.197 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:29:31 STEP 1396 H= 349:00 +CPU= 33.321 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:30:47 STEP 1397 H= 349:15 +CPU= 34.276 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:32:15 STEP 1398 H= 349:30 +CPU= 33.683 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:33:30 STEP 1399 H= 349:45 +CPU= 33.682 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:34:57 STEP 1400 H= 350:00 +CPU= 34.106 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:36:12 STEP 1401 H= 350:15 +CPU= 33.389 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:37:28 STEP 1402 H= 350:30 +CPU= 33.234 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:38:54 STEP 1403 H= 350:45 +CPU= 34.156 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:40:35 STEP 1404 H= 351:00 +CPU= 41.790 Suspend request received from the BOINC client, suspending the child process Resuming the child process Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001404 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001404 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001404 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:42:04 STEP 1405 H= 351:15 +CPU= 33.656 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:43:20 STEP 1406 H= 351:30 +CPU= 32.484 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:44:46 STEP 1407 H= 351:45 +CPU= 33.601 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:46:01 STEP 1408 H= 352:00 +CPU= 33.261 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:47:38 STEP 1409 H= 352:15 +CPU= 34.346 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:49:06 STEP 1410 H= 352:30 +CPU= 33.157 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:50:34 STEP 1411 H= 352:45 +CPU= 34.085 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:52:00 STEP 1412 H= 353:00 +CPU= 34.187 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:53:16 STEP 1413 H= 353:15 +CPU= 33.443 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:54:41 STEP 1414 H= 353:30 +CPU= 33.573 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:56:10 STEP 1415 H= 353:45 +CPU= 33.951 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:57:44 STEP 1416 H= 354:00 +CPU= 44.298 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001416 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001416 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001416 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 13:59:24 STEP 1417 H= 354:15 +CPU= 34.411 Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:00:31 STEP 1418 H= 354:30 +CPU= 34.116 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:02:07 STEP 1419 H= 354:45 +CPU= 32.955 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:03:21 STEP 1420 H= 355:00 +CPU= 33.455 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:04:48 STEP 1421 H= 355:15 +CPU= 33.267 Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:05:53 STEP 1422 H= 355:30 +CPU= 33.133 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:07:20 STEP 1423 H= 355:45 +CPU= 32.649 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:08:50 STEP 1424 H= 356:00 +CPU= 33.358 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:10:16 STEP 1425 H= 356:15 +CPU= 31.964 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:11:29 STEP 1426 H= 356:30 +CPU= 33.419 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:12:55 STEP 1427 H= 356:45 +CPU= 32.598 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:14:34 STEP 1428 H= 357:00 +CPU= 40.858 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001428 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001428 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001428 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:15:48 STEP 1429 H= 357:15 +CPU= 32.949 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:17:13 STEP 1430 H= 357:30 +CPU= 34.264 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:18:27 STEP 1431 H= 357:45 +CPU= 32.804 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:19:52 STEP 1432 H= 358:00 +CPU= 34.053 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:21:16 STEP 1433 H= 358:15 +CPU= 32.607 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:22:39 STEP 1434 H= 358:30 +CPU= 32.193 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:24:06 STEP 1435 H= 358:45 +CPU= 32.877 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:25:35 STEP 1436 H= 359:00 +CPU= 33.275 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:27:00 STEP 1437 H= 359:15 +CPU= 33.796 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:28:26 STEP 1438 H= 359:30 +CPU= 31.971 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:29:50 STEP 1439 H= 359:45 +CPU= 32.180 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:31:56 STEP 1440 H= 360:00 +CPU= 39.663 ..The child process terminated with status: 0 >>> Printing last 70 lines from file: NODE.001_01 DDH------------------------------------------------------------------------ I I I TIME = 360.000H DDH * Diagnostic Var., AREA GLOBAL I I I I-------------------------------------------------------------------------I I VARIABLE I Initial value I Current value I I-------------------------------------------------------------------------I I OMEGA (P/S) I -0.5534270480E-21 I 0.1756362725E-05 I ICloud fractionI 0.0000000000E+00 I 0.3348264439E-01 I I Relat. Hum. I 0.4824360569E+00 I 0.5038839588E+00 I I PASS 01 I 0.0000000000E+00 I 0.4593599374E+03 I DDH------------------------------------------------------------------------ MAXGPFV : MAX. VALUE = 0.000000000000000E+000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 NSTEP = 1440 SCAN2M_HPOS P IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ICMGGh7zg+001440 MODE=a IO-STREAM CLOSED - ICMGGh7zg+001440 MPI-TASK: 1 - 298024740 BYTES IN 7 RECORDS TRANSFERRED IN 0.0068 SECONDS 43827.2 Mbytes/s, TOTAL TIME= 0.0421(16.2%) 14:31:56 STEP 1440 H= 360:00 +CPU= 39.663 END CNT3 NSTEP = 1440 CNT0 000000000 29.000 29.000 80.127 0.362 0 0 0 0 0 IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ 46/ 1069125708 WRITTEN 2860/************ -TASK-OPENED-OPEN-RECS IN -KBYTE IN -RECS OUT-KBYTE OUT-WALL -WALL IN-WALL OU-TOT IN -TOT OUT 1 53 0 46 1044068 2860 ************ 11.5 3.5 8.0 4.4 45.2 ===-=== START OF TIMING STATISTICS ===-=== STATS FOR ALL TASKS NUM ROUTINE CALLS MEAN(ms) MAX(ms) FRAC(%) UNBAL(%) 0 CNT0 - COMPLETE EXECUTION 1 8996509.3 8996509.3 100.00 0.00 1 CNT4 - FORWARD INTEGRATION 1 8990664.8 8990664.8 99.94 0.00 8 SCAN2M - GRID-POINT DYNAMICS 105 15974.3 15974.3 18.64 0.00 9 SPCM - SPECTRAL COMP. 96 3729.1 3729.1 3.98 0.00 10 SCAN2M - PHYSICS 97 42845.1 42845.1 46.20 0.00 11 IOPACK - OUTPUT P.P. RESULTS 8 4406.6 4406.6 0.39 0.00 12 SPNORM - SPECTRAL NORM COMP. 5 69.0 69.0 0.00 0.00 17 GRIDFPOS IN CNT4 8 69.6 69.6 0.01 0.00 27 RESTART FILES - WRITING 2 17621.8 17621.8 0.39 0.00 28 RESTART FILES - READING 1 5457.3 5457.3 0.06 0.00 29 SU4FPOS IN CNT4 8 6.0 6.0 0.00 0.00 30 DYNFPOS IN CNT4 8 13279.1 13279.1 1.18 0.00 31 POSDDH IN STEPO 1 20.6 20.6 0.00 0.00 37 CPGLAG - SL COMPUTATIONS 97 16520.7 16520.7 17.81 0.00 39 SU0YOMB 1 205.5 205.5 0.00 0.00 51 SCAN2M - SL COMM. PART 1 97 45.1 45.1 0.05 0.00 54 SPCM - M TO S/S TO M TRANSP. 96 1594.0 1594.0 1.70 0.00 55 SPCIMPF - S TO M/M TO S TRANSP. 96 257.8 257.8 0.28 0.00 56 SPNORM - SPECTRAL NORM COMM. 5 4.2 4.2 0.00 0.00 102 LTINV_CTL - INVERSE LEGENDRE TRANSFORM 212 1776.7 1776.7 4.19 0.00 103 LTDIR_CTL - DIRECT LEGENDRE TRANSFORM 200 828.8 828.8 1.84 0.00 106 FTDIR_CTL - DIRECT FOURIER TRANSFORM 200 416.9 416.9 0.93 0.00 107 FTINV_CTL - INVERSE FOURIER TRANSFORM 212 357.0 357.0 0.84 0.00 140 SULEG - COMP. OF LEGENDRE POL. 1 73.1 73.1 0.00 0.00 152 LTINV_CTL - M TO L TRANSPOSITION 212 243.1 243.1 0.57 0.00 153 LTDIR_CTL - L TO M TRANSPOSITION 200 46.7 46.7 0.10 0.00 157 FTINV_CTL - L TO G TRANSPOSITION 212 259.2 259.2 0.61 0.00 158 FTDIR_CTL - G TO L TRANSPOSITION 200 181.9 181.9 0.40 0.00 400 GSTATS 12215 0.0 0.0 0.00 0.00 401 GSTATS HOOK 11311 0.0 0.0 0.00 0.00 TOTAL MEASURED IMBALANCE = 0.0 SECONDS, 0.0 PERCENT TOTAL WALLCLOCK TIME 8996.5 CPU TIME 3280.7 VECTOR TIME 3280.7 ===-=== END OF TIMING STATISTICS ===-=== FORECAST DAYS PER DAY 144.1 *** END CNT0 *** ------------------------------------------------ Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001440 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001440 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001440 Adding to the zip: /var/lib/boinc-client/slots/9/NODE.001_01 Adding to the zip: /var/lib/boinc-client/slots/9/ifs.stat Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMGGh7zg+001416 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMSHh7zg+001416 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMUAh7zg+001344 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMGGh7zg+001440 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMSHh7zg+001428 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMUAh7zg+001404 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMGGh7zg+001404 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMSHh7zg+001368 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMSHh7zg+001392 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMUAh7zg+001416 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMGGh7zg+001356 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMUAh7zg+001428 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMUAh7zg+001380 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMGGh7zg+001392 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMSHh7zg+001440 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMSHh7zg+001356 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMSHh7zg+001380 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMGGh7zg+001368 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMUAh7zg+001356 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMUAh7zg+001392 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMUAh7zg+001440 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMUAh7zg+001368 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMGGh7zg+001380 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMSHh7zg+001344 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMGGh7zg+001428 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMSHh7zg+001404 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283577/ICMGGh7zg+001344 Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1cm_2016092300_20_1017_12283577_0_r1662125137_14.zip Uploading the final file: upload_file_14.zip Uploading trickle at timestep: 1295100 14:35:31 (2904): called boinc_finish(0) </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>oifs_43r3_bl_a1cm_2016092300_20_1017_12283577_0_r1662125137_15.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>oifs_43r3_bl_a1cm_2016092300_20_1017_12283577_0_r1662125137_16.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>oifs_43r3_bl_a1cm_2016092300_20_1017_12283577_0_r1662125137_17.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>oifs_43r3_bl_a1cm_2016092300_20_1017_12283577_0_r1662125137_18.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>oifs_43r3_bl_a1cm_2016092300_20_1017_12283577_0_r1662125137_19.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]] |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
09 Jun 2024 12:34:04 | 1506017 | 22435156 | oifs_43r3_bl_a1cm_2016092300_20_1017_12283577_0 | 1,295,100 | 54,236 | 0.0419 |
©2024 cpdn.org