climateprediction.net home page
Task 22505901

Task 22505901

Name oifs_43r3_bl_a3lb_2016092300_20_1018_12292982_1
Workunit 12292982
Created 12 Aug 2024, 13:48:53 UTC
Sent 12 Aug 2024, 13:49:57 UTC
Report deadline 11 Oct 2024, 13:49:57 UTC
Received 13 Aug 2024, 11:59:41 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1533065
Run time 19 hours 50 min 19 sec
CPU time 19 hours 11 min 25 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 5.28 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,010.08 MB
Peak swap size 5,981.12 MB
Peak disk usage 1,581.81 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
var/lib/boinc-client/slots/21/ICMGGh7zg+001512
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001512
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001512
  08:16:35 STEP 1513 H= 378:15 +CPU= 29.484
  08:17:06 STEP 1514 H= 378:30 +CPU= 29.055
  08:17:36 STEP 1515 H= 378:45 +CPU= 28.775
  08:18:06 STEP 1516 H= 379:00 +CPU= 29.257
  08:18:36 STEP 1517 H= 379:15 +CPU= 29.364
  08:19:06 STEP 1518 H= 379:30 +CPU= 29.021
  08:19:37 STEP 1519 H= 379:45 +CPU= 28.945
  08:20:07 STEP 1520 H= 380:00 +CPU= 29.612
  08:20:38 STEP 1521 H= 380:15 +CPU= 28.685
  08:21:07 STEP 1522 H= 380:30 +CPU= 29.138
  08:21:38 STEP 1523 H= 380:45 +CPU= 29.330
  08:22:16 STEP 1524 H= 381:00 +CPU= 36.450
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001524
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001524
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001524
  08:22:46 STEP 1525 H= 381:15 +CPU= 29.249
  08:23:18 STEP 1526 H= 381:30 +CPU= 28.704
  08:23:47 STEP 1527 H= 381:45 +CPU= 28.989
  08:24:19 STEP 1528 H= 382:00 +CPU= 30.171
  08:24:48 STEP 1529 H= 382:15 +CPU= 28.974
  08:25:18 STEP 1530 H= 382:30 +CPU= 29.142
  08:25:49 STEP 1531 H= 382:45 +CPU= 30.043
  08:26:21 STEP 1532 H= 383:00 +CPU= 30.755
  08:26:51 STEP 1533 H= 383:15 +CPU= 28.885
  08:27:22 STEP 1534 H= 383:30 +CPU= 29.607
  08:27:51 STEP 1535 H= 383:45 +CPU= 28.533
  08:28:32 STEP 1536 H= 384:00 +CPU= 39.918
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001536
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001536
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001524
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3lb_2016092300_20_1018_12292982_1_r1568795543_15.zip
Uploading the intermediate file: upload_file_15.zip
  08:29:03 STEP 1537 H= 384:15 +CPU= 29.237
  08:29:34 STEP 1538 H= 384:30 +CPU= 29.577
  08:30:05 STEP 1539 H= 384:45 +CPU= 29.493
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083021:1723530621:24786.005] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 3958MB (heap), 4797MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083021:1723530621:24786.087] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083021:1723530621:24786.087] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x820890 (old at (nil))
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083021:1723530621:24786.087] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083021:1723530621:24786.087] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083021:1723530621:24786.087] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3843] 3958 MB (maxheap), 4797 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083021:1723530621:24786.087] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083021:1723530621:24786.238] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083021:1723530621:24786.238] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083021:1723530621:24786.238] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083021:1723530621:24786.238] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083021:1723530621:24786.238] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083021:1723530621:24786.238] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083021:1723530621:24786.238] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083021:1723530621:24786.238] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083021:1723530621:24786.238] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083021:1723530621:24786.238] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :            EC_PHYS_DRV 
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083021:1723530621:24786.238] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :             >OMP-PHYSICS              (1001) 
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083021:1723530621:24786.238] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :              EC_PHYS 
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083021:1723530621:24786.238] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :               CALLPAR 
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083021:1723530621:24786.238] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                CLOUD_LAYER 
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083021:1723530621:24786.238] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                 CLOUDSC 
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083022:1723530622:24787.238] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:11758:11758] [20240813:083022:1723530622:24787.239] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1cf8da0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CF935B  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000008214C1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DD5490  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000116B390  cloudsc_                 1329  cloudsc.F90
oifs_43r3_model.e  000000000115C847  cloud_layer_              131  cloud_layer.F90
oifs_43r3_model.e  0000000000FBB064  callpar_                 1223  callpar.F90
oifs_43r3_model.e  0000000000F5FA6B  ec_phys_                  670  ec_phys.F90
oifs_43r3_model.e  0000000000F4DBC4  ec_phys_drv_              599  ec_phys_drv.F90
oifs_43r3_model.e  0000000000BD7131  gp_model_                 613  gp_model.F90
oifs_43r3_model.e  00000000012C5002  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BACBAE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  0000000000688153  stepo_                    327  stepo.F90
oifs_43r3_model.e  00000000004CD1DC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000004B5D85  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  00000000004B4F52  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  000000000049D638  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  0000000000406FBD  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  0000000000401E7F  MAIN__                     96  master.F90
oifs_43r3_model.e  0000000000401E12  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCC34A  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCDBE7  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000401CD5  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a3lb
(argv4) batchid: 1018
(argv5) wuid: 12292982
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/21
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/21/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/21/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_bb35bc3ab5800da80e0795c62c1259cc to: /var/lib/boinc-client/slots/21/oifs_43r3_bl_a3lb_2016092300_20_1018_12292982.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/21/oifs_43r3_bl_a3lb_2016092300_20_1018_12292982.zip
ic_ancil_file: ic_ancil_12292982
ifsdata_file: ifsdata_12292982
climate_data_file: clim_data_12292982
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/21/ic_ancil_12292982.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/21/ic_ancil_12292982.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_d199b46881ee012d2ec767822c7510f1 to: /var/lib/boinc-client/slots/21/ifsdata/ifsdata_12292982.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/21/ifsdata/ifsdata_12292982.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/21/159l_2/clim_data_12292982.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/21/159l_2/clim_data_12292982.zip
Checking for progress XML file: /var/lib/boinc-client/slots/21/progress_file_12292982.xml
Opened progress file ok : /var/lib/boinc-client/slots/21/progress_file_12292982.xml
-- Model is restarting --
Adjusting last_iter, 1540, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/21/progress_file_12292982.xml
last_cpu_time: 54186
upload_file_number: 16
last_iter: 1537
last_upload: 1382400
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a3lb_2016092300_20_1018_12292982_1_r1568795543
The child process has been launched with process id: 2505
Executing the command: /var/lib/boinc-client/slots/21/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:WRZTELEBIMWSKL01:1:1:2505:2505] [20240813:083648:1723531008:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  08:37:24 STEP 1536 H= 384:00 +CPU= 17.354
  08:37:40 STEP 1537 H= 384:15 +CPU= 16.589
  08:37:57 STEP 1538 H= 384:30 +CPU= 16.541
  08:38:14 STEP 1539 H= 384:45 +CPU= 16.574
  08:38:31 STEP 1540 H= 385:00 +CPU= 17.016
  08:38:47 STEP 1541 H= 385:15 +CPU= 16.717
  08:39:04 STEP 1542 H= 385:30 +CPU= 16.696
  08:39:21 STEP 1543 H= 385:45 +CPU= 16.658
  08:39:38 STEP 1544 H= 386:00 +CPU= 17.338
  08:39:55 STEP 1545 H= 386:15 +CPU= 16.850
  08:40:17 STEP 1546 H= 386:30 +CPU= 21.726
  08:40:41 STEP 1547 H= 386:45 +CPU= 23.662
  08:41:10 STEP 1548 H= 387:00 +CPU= 28.029
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001548
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001548
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001548
  08:41:34 STEP 1549 H= 387:15 +CPU= 23.780
  08:41:56 STEP 1550 H= 387:30 +CPU= 21.927
  08:42:20 STEP 1551 H= 387:45 +CPU= 24.204
  08:42:45 STEP 1552 H= 388:00 +CPU= 25.034
  08:43:11 STEP 1553 H= 388:15 +CPU= 25.367
  08:43:38 STEP 1554 H= 388:30 +CPU= 27.243
  08:44:04 STEP 1555 H= 388:45 +CPU= 25.668
  08:44:29 STEP 1556 H= 389:00 +CPU= 25.540
  08:44:55 STEP 1557 H= 389:15 +CPU= 25.190
  08:45:22 STEP 1558 H= 389:30 +CPU= 26.734
  08:45:56 STEP 1559 H= 389:45 +CPU= 34.409
  08:46:39 STEP 1560 H= 390:00 +CPU= 42.901
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001560
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001560
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001560
  08:47:13 STEP 1561 H= 390:15 +CPU= 33.947
  08:47:49 STEP 1562 H= 390:30 +CPU= 35.626
  08:48:25 STEP 1563 H= 390:45 +CPU= 36.006
  08:49:03 STEP 1564 H= 391:00 +CPU= 37.727
  08:49:41 STEP 1565 H= 391:15 +CPU= 38.841
  08:50:39 STEP 1566 H= 391:30 +CPU= 57.550
  08:51:35 STEP 1567 H= 391:45 +CPU= 55.562
  08:52:16 STEP 1568 H= 392:00 +CPU= 40.740
  08:52:56 STEP 1569 H= 392:15 +CPU= 40.300
  08:53:38 STEP 1570 H= 392:30 +CPU= 41.273
  08:54:16 STEP 1571 H= 392:45 +CPU= 38.941
  08:55:13 STEP 1572 H= 393:00 +CPU= 55.951
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001572
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001572
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001572
  08:55:59 STEP 1573 H= 393:15 +CPU= 46.608
  08:56:46 STEP 1574 H= 393:30 +CPU= 46.639
  08:57:30 STEP 1575 H= 393:45 +CPU= 43.543
  08:58:14 STEP 1576 H= 394:00 +CPU= 44.069
  08:58:54 STEP 1577 H= 394:15 +CPU= 40.560
  08:59:36 STEP 1578 H= 394:30 +CPU= 41.909
  09:00:14 STEP 1579 H= 394:45 +CPU= 37.497
  09:00:47 STEP 1580 H= 395:00 +CPU= 33.077
  09:01:25 STEP 1581 H= 395:15 +CPU= 38.173
  09:02:03 STEP 1582 H= 395:30 +CPU= 37.633
  09:02:37 STEP 1583 H= 395:45 +CPU= 33.735
  09:03:20 STEP 1584 H= 396:00 +CPU= 41.698
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001584
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001584
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001584
  09:03:52 STEP 1585 H= 396:15 +CPU= 32.173
  09:04:34 STEP 1586 H= 396:30 +CPU= 41.938
  09:05:16 STEP 1587 H= 396:45 +CPU= 41.723
  09:05:59 STEP 1588 H= 397:00 +CPU= 43.049
  09:06:46 STEP 1589 H= 397:15 +CPU= 47.142
  09:07:42 STEP 1590 H= 397:30 +CPU= 55.928
  09:08:24 STEP 1591 H= 397:45 +CPU= 41.646
  09:09:24 STEP 1592 H= 398:00 +CPU= 60.291
  09:10:31 STEP 1593 H= 398:15 +CPU= 66.671
  09:11:31 STEP 1594 H= 398:30 +CPU= 58.849
  09:12:20 STEP 1595 H= 398:45 +CPU= 49.535
  09:13:12 STEP 1596 H= 399:00 +CPU= 51.484
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001596
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001596
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001596
  09:13:52 STEP 1597 H= 399:15 +CPU= 40.112
  09:14:31 STEP 1598 H= 399:30 +CPU= 38.995
  09:15:08 STEP 1599 H= 399:45 +CPU= 36.643
  09:15:42 STEP 1600 H= 400:00 +CPU= 34.224
  09:16:16 STEP 1601 H= 400:15 +CPU= 34.366
  09:16:48 STEP 1602 H= 400:30 +CPU= 31.598
  09:17:21 STEP 1603 H= 400:45 +CPU= 33.363
  09:17:52 STEP 1604 H= 401:00 +CPU= 31.029
  09:18:23 STEP 1605 H= 401:15 +CPU= 31.127
  09:19:03 STEP 1606 H= 401:30 +CPU= 39.280
  09:19:49 STEP 1607 H= 401:45 +CPU= 45.707
  09:20:43 STEP 1608 H= 402:00 +CPU= 54.317
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001608
  09:21:29 STEP 1609 H= 402:15 +CPU= 45.871
  09:22:15 STEP 1610 H= 402:30 +CPU= 45.713
  09:22:56 STEP 1611 H= 402:45 +CPU= 41.689
  09:23:44 STEP 1612 H= 403:00 +CPU= 47.050
  09:24:27 STEP 1613 H= 403:15 +CPU= 42.875
  09:25:11 STEP 1614 H= 403:30 +CPU= 44.286
  09:25:55 STEP 1615 H= 403:45 +CPU= 43.723
  09:26:38 STEP 1616 H= 404:00 +CPU= 42.615
  09:27:20 STEP 1617 H= 404:15 +CPU= 35.604
  09:27:50 STEP 1618 H= 404:30 +CPU= 29.544
  09:28:24 STEP 1619 H= 404:45 +CPU= 30.368
  09:29:01 STEP 1620 H= 405:00 +CPU= 36.114
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001620
  09:29:32 STEP 1621 H= 405:15 +CPU= 29.876
  09:30:05 STEP 1622 H= 405:30 +CPU= 30.281
  09:30:39 STEP 1623 H= 405:45 +CPU= 30.913
  09:31:13 STEP 1624 H= 406:00 +CPU= 33.128
  09:31:53 STEP 1625 H= 406:15 +CPU= 38.796
  09:32:34 STEP 1626 H= 406:30 +CPU= 40.146
  09:33:13 STEP 1627 H= 406:45 +CPU= 38.073
  09:33:54 STEP 1628 H= 407:00 +CPU= 39.300
  09:34:35 STEP 1629 H= 407:15 +CPU= 39.695
  09:35:14 STEP 1630 H= 407:30 +CPU= 38.711
  09:35:54 STEP 1631 H= 407:45 +CPU= 39.252
  09:36:50 STEP 1632 H= 408:00 +CPU= 53.216
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001620
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3lb_2016092300_20_1018_12292982_1_r1568795543_16.zip
Uploading the intermediate file: upload_file_16.zip
  09:37:32 STEP 1633 H= 408:15 +CPU= 40.063
  09:38:11 STEP 1634 H= 408:30 +CPU= 37.692
  09:38:49 STEP 1635 H= 408:45 +CPU= 37.110
  09:39:21 STEP 1636 H= 409:00 +CPU= 31.469
  09:39:51 STEP 1637 H= 409:15 +CPU= 29.370
  09:40:22 STEP 1638 H= 409:30 +CPU= 29.570
  09:40:54 STEP 1639 H= 409:45 +CPU= 29.823
  09:41:26 STEP 1640 H= 410:00 +CPU= 31.193
  09:41:56 STEP 1641 H= 410:15 +CPU= 29.484
  09:42:29 STEP 1642 H= 410:30 +CPU= 30.998
  09:43:08 STEP 1643 H= 410:45 +CPU= 38.307
  09:43:56 STEP 1644 H= 411:00 +CPU= 47.056
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001644
  09:44:33 STEP 1645 H= 411:15 +CPU= 37.504
  09:45:11 STEP 1646 H= 411:30 +CPU= 37.763
  09:45:49 STEP 1647 H= 411:45 +CPU= 38.009
  09:46:29 STEP 1648 H= 412:00 +CPU= 38.186
  09:47:09 STEP 1649 H= 412:15 +CPU= 39.104
  09:47:48 STEP 1650 H= 412:30 +CPU= 38.702
  09:48:28 STEP 1651 H= 412:45 +CPU= 39.216
  09:49:11 STEP 1652 H= 413:00 +CPU= 41.491
  09:49:54 STEP 1653 H= 413:15 +CPU= 42.171
  09:50:31 STEP 1654 H= 413:30 +CPU= 36.001
  09:51:01 STEP 1655 H= 413:45 +CPU= 29.470
  09:51:39 STEP 1656 H= 414:00 +CPU= 36.944
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001656
  09:52:10 STEP 1657 H= 414:15 +CPU= 29.828
  09:52:41 STEP 1658 H= 414:30 +CPU= 30.431
  09:53:12 STEP 1659 H= 414:45 +CPU= 30.066
  09:53:42 STEP 1660 H= 415:00 +CPU= 29.641
  09:54:15 STEP 1661 H= 415:15 +CPU= 32.102
  09:54:53 STEP 1662 H= 415:30 +CPU= 36.719
  09:55:31 STEP 1663 H= 415:45 +CPU= 37.129
  09:56:10 STEP 1664 H= 416:00 +CPU= 38.613
  09:56:50 STEP 1665 H= 416:15 +CPU= 38.217
  09:57:30 STEP 1666 H= 416:30 +CPU= 38.956
  09:58:09 STEP 1667 H= 416:45 +CPU= 37.992
  09:58:57 STEP 1668 H= 417:00 +CPU= 46.415
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001668
  09:59:35 STEP 1669 H= 417:15 +CPU= 37.016
  10:00:16 STEP 1670 H= 417:30 +CPU= 38.941
  10:00:58 STEP 1671 H= 417:45 +CPU= 39.972
  10:01:42 STEP 1672 H= 418:00 +CPU= 43.743
  10:02:28 STEP 1673 H= 418:15 +CPU= 44.654
  10:03:14 STEP 1674 H= 418:30 +CPU= 44.887
  10:03:52 STEP 1675 H= 418:45 +CPU= 36.374
  10:04:30 STEP 1676 H= 419:00 +CPU= 37.765
  10:05:10 STEP 1677 H= 419:15 +CPU= 38.161
  10:05:48 STEP 1678 H= 419:30 +CPU= 36.535
  10:06:38 STEP 1679 H= 419:45 +CPU= 48.473
  10:08:05 STEP 1680 H= 420:00 +CPU= 83.602
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001680
  10:08:55 STEP 1681 H= 420:15 +CPU= 48.381
  10:09:48 STEP 1682 H= 420:30 +CPU= 50.713
  10:10:44 STEP 1683 H= 420:45 +CPU= 54.186
  10:11:36 STEP 1684 H= 421:00 +CPU= 50.842
  10:12:41 STEP 1685 H= 421:15 +CPU= 63.052
  10:13:57 STEP 1686 H= 421:30 +CPU= 72.948
  10:14:55 STEP 1687 H= 421:45 +CPU= 55.700
  10:15:47 STEP 1688 H= 422:00 +CPU= 50.594
  10:16:37 STEP 1689 H= 422:15 +CPU= 48.468
  10:17:27 STEP 1690 H= 422:30 +CPU= 48.090
  10:18:17 STEP 1691 H= 422:45 +CPU= 48.237
  10:19:22 STEP 1692 H= 423:00 +CPU= 62.699
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001692
  10:20:13 STEP 1693 H= 423:15 +CPU= 49.549
  10:21:01 STEP 1694 H= 423:30 +CPU= 45.823
  10:21:46 STEP 1695 H= 423:45 +CPU= 44.263
  10:22:29 STEP 1696 H= 424:00 +CPU= 42.114
  10:23:14 STEP 1697 H= 424:15 +CPU= 43.210
  10:23:55 STEP 1698 H= 424:30 +CPU= 39.874
  10:24:38 STEP 1699 H= 424:45 +CPU= 42.191
  10:25:26 STEP 1700 H= 425:00 +CPU= 45.727
  10:26:13 STEP 1701 H= 425:15 +CPU= 45.793
  10:26:58 STEP 1702 H= 425:30 +CPU= 42.640
  10:27:41 STEP 1703 H= 425:45 +CPU= 41.335
  10:28:40 STEP 1704 H= 426:00 +CPU= 57.874
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001704
  10:29:32 STEP 1705 H= 426:15 +CPU= 50.406
  10:30:25 STEP 1706 H= 426:30 +CPU= 50.587
  10:31:17 STEP 1707 H= 426:45 +CPU= 50.564
  10:32:10 STEP 1708 H= 427:00 +CPU= 51.578
  10:33:00 STEP 1709 H= 427:15 +CPU= 48.613
  10:33:50 STEP 1710 H= 427:30 +CPU= 47.411
  10:34:56 STEP 1711 H= 427:45 +CPU= 63.522
  10:36:03 STEP 1712 H= 428:00 +CPU= 64.393
  10:37:07 STEP 1713 H= 428:15 +CPU= 60.917
  10:38:01 STEP 1714 H= 428:30 +CPU= 52.934
  10:38:55 STEP 1715 H= 428:45 +CPU= 51.560
  10:40:00 STEP 1716 H= 429:00 +CPU= 63.649
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001716
  10:40:47 STEP 1717 H= 429:15 +CPU= 45.723
  10:41:36 STEP 1718 H= 429:30 +CPU= 46.899
  10:42:22 STEP 1719 H= 429:45 +CPU= 44.777
  10:43:08 STEP 1720 H= 430:00 +CPU= 44.644
  10:43:48 STEP 1721 H= 430:15 +CPU= 39.382
  10:44:29 STEP 1722 H= 430:30 +CPU= 39.639
  10:45:09 STEP 1723 H= 430:45 +CPU= 38.499
  10:45:45 STEP 1724 H= 431:00 +CPU= 35.691
  10:46:25 STEP 1725 H= 431:15 +CPU= 38.202
  10:47:00 STEP 1726 H= 431:30 +CPU= 34.610
  10:47:40 STEP 1727 H= 431:45 +CPU= 37.978
  10:48:40 STEP 1728 H= 432:00 +CPU= 58.274
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001716
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3lb_2016092300_20_1018_12292982_1_r1568795543_17.zip
Uploading the intermediate file: upload_file_17.zip
  10:49:24 STEP 1729 H= 432:15 +CPU= 40.929
  10:50:11 STEP 1730 H= 432:30 +CPU= 44.946
  10:50:58 STEP 1731 H= 432:45 +CPU= 45.195
  10:51:42 STEP 1732 H= 433:00 +CPU= 42.000
  10:52:28 STEP 1733 H= 433:15 +CPU= 42.905
  10:53:10 STEP 1734 H= 433:30 +CPU= 41.073
  10:53:50 STEP 1735 H= 433:45 +CPU= 39.402
  10:54:33 STEP 1736 H= 434:00 +CPU= 40.742
  10:55:15 STEP 1737 H= 434:15 +CPU= 40.471
  10:55:55 STEP 1738 H= 434:30 +CPU= 38.872
  10:56:37 STEP 1739 H= 434:45 +CPU= 40.794
  10:57:29 STEP 1740 H= 435:00 +CPU= 50.336
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001740
  10:58:02 STEP 1741 H= 435:15 +CPU= 32.053
  10:58:36 STEP 1742 H= 435:30 +CPU= 32.977
  10:59:08 STEP 1743 H= 435:45 +CPU= 31.748
  10:59:42 STEP 1744 H= 436:00 +CPU= 33.194
  11:00:15 STEP 1745 H= 436:15 +CPU= 31.981
  11:00:47 STEP 1746 H= 436:30 +CPU= 31.727
  11:01:21 STEP 1747 H= 436:45 +CPU= 33.075
  11:02:03 STEP 1748 H= 437:00 +CPU= 40.698
  11:02:45 STEP 1749 H= 437:15 +CPU= 41.049
  11:03:29 STEP 1750 H= 437:30 +CPU= 42.141
  11:04:10 STEP 1751 H= 437:45 +CPU= 40.074
  11:05:05 STEP 1752 H= 438:00 +CPU= 52.970
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001752
  11:05:44 STEP 1753 H= 438:15 +CPU= 37.868
  11:06:28 STEP 1754 H= 438:30 +CPU= 42.841
  11:07:11 STEP 1755 H= 438:45 +CPU= 41.895
  11:07:53 STEP 1756 H= 439:00 +CPU= 41.053
  11:08:34 STEP 1757 H= 439:15 +CPU= 40.195
  11:09:19 STEP 1758 H= 439:30 +CPU= 42.797
  11:10:03 STEP 1759 H= 439:45 +CPU= 42.225
  11:10:45 STEP 1760 H= 440:00 +CPU= 41.524
  11:11:28 STEP 1761 H= 440:15 +CPU= 41.642
  11:12:12 STEP 1762 H= 440:30 +CPU= 43.287
  11:12:54 STEP 1763 H= 440:45 +CPU= 39.305
  11:13:48 STEP 1764 H= 441:00 +CPU= 52.523
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001764
  11:14:37 STEP 1765 H= 441:15 +CPU= 47.401
  11:15:36 STEP 1766 H= 441:30 +CPU= 57.082
  11:16:32 STEP 1767 H= 441:45 +CPU= 54.110
  11:17:26 STEP 1768 H= 442:00 +CPU= 52.653
  11:18:16 STEP 1769 H= 442:15 +CPU= 47.998
  11:19:00 STEP 1770 H= 442:30 +CPU= 43.355
  11:19:46 STEP 1771 H= 442:45 +CPU= 43.707
  11:20:29 STEP 1772 H= 443:00 +CPU= 42.089
  11:21:30 STEP 1773 H= 443:15 +CPU= 58.615
  11:22:27 STEP 1774 H= 443:30 +CPU= 56.054
  11:23:18 STEP 1775 H= 443:45 +CPU= 48.766
  11:24:28 STEP 1776 H= 444:00 +CPU= 66.872
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001776
  11:25:14 STEP 1777 H= 444:15 +CPU= 44.586
  11:25:53 STEP 1778 H= 444:30 +CPU= 38.127
  11:26:33 STEP 1779 H= 444:45 +CPU= 38.951
  11:27:15 STEP 1780 H= 445:00 +CPU= 40.120
  11:27:57 STEP 1781 H= 445:15 +CPU= 41.167
  11:28:42 STEP 1782 H= 445:30 +CPU= 43.182
  11:29:24 STEP 1783 H= 445:45 +CPU= 40.407
  11:30:02 STEP 1784 H= 446:00 +CPU= 36.250
  11:30:38 STEP 1785 H= 446:15 +CPU= 35.404
  11:31:18 STEP 1786 H= 446:30 +CPU= 38.075
  11:32:05 STEP 1787 H= 446:45 +CPU= 45.571
  11:33:04 STEP 1788 H= 447:00 +CPU= 57.442
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001788
  11:34:00 STEP 1789 H= 447:15 +CPU= 53.869
  11:34:50 STEP 1790 H= 447:30 +CPU= 47.960
  11:35:34 STEP 1791 H= 447:45 +CPU= 42.658
  11:36:30 STEP 1792 H= 448:00 +CPU= 54.172
  11:37:24 STEP 1793 H= 448:15 +CPU= 52.864
  11:38:09 STEP 1794 H= 448:30 +CPU= 43.795
  11:38:53 STEP 1795 H= 448:45 +CPU= 43.375
  11:39:39 STEP 1796 H= 449:00 +CPU= 43.954
  11:40:25 STEP 1797 H= 449:15 +CPU= 43.882
  11:41:07 STEP 1798 H= 449:30 +CPU= 40.622
  11:41:47 STEP 1799 H= 449:45 +CPU= 39.044
  11:42:40 STEP 1800 H= 450:00 +CPU= 51.696
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001800
  11:43:27 STEP 1801 H= 450:15 +CPU= 45.777
  11:44:10 STEP 1802 H= 450:30 +CPU= 40.982
  11:44:47 STEP 1803 H= 450:45 +CPU= 36.709
  11:45:27 STEP 1804 H= 451:00 +CPU= 38.433
  11:46:04 STEP 1805 H= 451:15 +CPU= 36.563
  11:46:41 STEP 1806 H= 451:30 +CPU= 35.737
  11:47:19 STEP 1807 H= 451:45 +CPU= 37.083
  11:47:59 STEP 1808 H= 452:00 +CPU= 38.727
  11:48:36 STEP 1809 H= 452:15 +CPU= 36.302
  11:49:15 STEP 1810 H= 452:30 +CPU= 37.919
  11:49:53 STEP 1811 H= 452:45 +CPU= 36.792
  11:50:37 STEP 1812 H= 453:00 +CPU= 43.226
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001812
  11:51:17 STEP 1813 H= 453:15 +CPU= 37.906
  11:51:55 STEP 1814 H= 453:30 +CPU= 37.440
  11:52:32 STEP 1815 H= 453:45 +CPU= 35.935
  11:53:10 STEP 1816 H= 454:00 +CPU= 36.829
  11:53:47 STEP 1817 H= 454:15 +CPU= 36.481
  11:54:24 STEP 1818 H= 454:30 +CPU= 32.409
  11:54:59 STEP 1819 H= 454:45 +CPU= 32.234
  11:55:32 STEP 1820 H= 455:00 +CPU= 31.913
  11:56:04 STEP 1821 H= 455:15 +CPU= 31.498
  11:56:36 STEP 1822 H= 455:30 +CPU= 31.388
  11:57:08 STEP 1823 H= 455:45 +CPU= 31.527
  11:58:08 STEP 1824 H= 456:00 +CPU= 42.077
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001812
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3lb_2016092300_20_1018_12292982_1_r1568795543_18.zip
Uploading the intermediate file: upload_file_18.zip
  11:58:42 STEP 1825 H= 456:15 +CPU= 32.159
  11:59:15 STEP 1826 H= 456:30 +CPU= 32.709
  11:59:48 STEP 1827 H= 456:45 +CPU= 32.203
  12:00:21 STEP 1828 H= 457:00 +CPU= 32.448
  12:00:54 STEP 1829 H= 457:15 +CPU= 32.065
  12:01:28 STEP 1830 H= 457:30 +CPU= 31.917
  12:02:01 STEP 1831 H= 457:45 +CPU= 32.209
  12:02:34 STEP 1832 H= 458:00 +CPU= 32.307
  12:03:07 STEP 1833 H= 458:15 +CPU= 31.629
  12:03:40 STEP 1834 H= 458:30 +CPU= 31.756
  12:04:12 STEP 1835 H= 458:45 +CPU= 31.941
  12:04:53 STEP 1836 H= 459:00 +CPU= 39.122
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001836
  12:05:26 STEP 1837 H= 459:15 +CPU= 32.715
  12:06:00 STEP 1838 H= 459:30 +CPU= 32.328
  12:06:34 STEP 1839 H= 459:45 +CPU= 32.604
  12:07:06 STEP 1840 H= 460:00 +CPU= 31.614
  12:07:38 STEP 1841 H= 460:15 +CPU= 31.363
  12:08:11 STEP 1842 H= 460:30 +CPU= 31.939
  12:08:44 STEP 1843 H= 460:45 +CPU= 32.171
  12:09:18 STEP 1844 H= 461:00 +CPU= 33.092
  12:09:52 STEP 1845 H= 461:15 +CPU= 32.136
  12:10:24 STEP 1846 H= 461:30 +CPU= 32.312
  12:10:56 STEP 1847 H= 461:45 +CPU= 31.149
  12:11:37 STEP 1848 H= 462:00 +CPU= 40.015
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001848
  12:12:09 STEP 1849 H= 462:15 +CPU= 30.976
  12:12:41 STEP 1850 H= 462:30 +CPU= 31.145
  12:13:13 STEP 1851 H= 462:45 +CPU= 31.383
  12:13:47 STEP 1852 H= 463:00 +CPU= 32.615
  12:14:19 STEP 1853 H= 463:15 +CPU= 31.425
  12:14:50 STEP 1854 H= 463:30 +CPU= 31.159
  12:15:23 STEP 1855 H= 463:45 +CPU= 32.054
  12:15:56 STEP 1856 H= 464:00 +CPU= 32.416
  12:16:29 STEP 1857 H= 464:15 +CPU= 32.041
  12:17:02 STEP 1858 H= 464:30 +CPU= 32.105
  12:17:35 STEP 1859 H= 464:45 +CPU= 32.179
  12:18:15 STEP 1860 H= 465:00 +CPU= 39.609
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001860
  12:18:48 STEP 1861 H= 465:15 +CPU= 32.418
  12:19:20 STEP 1862 H= 465:30 +CPU= 31.163
  12:19:53 STEP 1863 H= 465:45 +CPU= 32.729
  12:20:27 STEP 1864 H= 466:00 +CPU= 33.041
  12:21:00 STEP 1865 H= 466:15 +CPU= 32.184
  12:21:32 STEP 1866 H= 466:30 +CPU= 31.877
  12:22:04 STEP 1867 H= 466:45 +CPU= 30.721
  12:22:37 STEP 1868 H= 467:00 +CPU= 31.798
  12:23:08 STEP 1869 H= 467:15 +CPU= 31.246
  12:23:42 STEP 1870 H= 467:30 +CPU= 32.612
  12:24:14 STEP 1871 H= 467:45 +CPU= 31.009
  12:25:03 STEP 1872 H= 468:00 +CPU= 42.199
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001872
  12:25:34 STEP 1873 H= 468:15 +CPU= 30.920
  12:26:07 STEP 1874 H= 468:30 +CPU= 32.385
  12:26:41 STEP 1875 H= 468:45 +CPU= 32.891
  12:27:15 STEP 1876 H= 469:00 +CPU= 32.673
  12:27:47 STEP 1877 H= 469:15 +CPU= 31.525
  12:28:21 STEP 1878 H= 469:30 +CPU= 32.492
  12:28:53 STEP 1879 H= 469:45 +CPU= 31.057
  12:29:26 STEP 1880 H= 470:00 +CPU= 31.749
  12:29:58 STEP 1881 H= 470:15 +CPU= 31.088
  12:30:30 STEP 1882 H= 470:30 +CPU= 31.418
  12:31:02 STEP 1883 H= 470:45 +CPU= 30.740
  12:31:42 STEP 1884 H= 471:00 +CPU= 39.483
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001884
  12:32:13 STEP 1885 H= 471:15 +CPU= 30.497
  12:32:46 STEP 1886 H= 471:30 +CPU= 32.099
  12:33:18 STEP 1887 H= 471:45 +CPU= 31.343
  12:33:50 STEP 1888 H= 472:00 +CPU= 31.022
  12:34:26 STEP 1889 H= 472:15 +CPU= 34.044
  12:35:01 STEP 1890 H= 472:30 +CPU= 34.354
  12:35:37 STEP 1891 H= 472:45 +CPU= 35.092
  12:36:14 STEP 1892 H= 473:00 +CPU= 35.379
  12:36:49 STEP 1893 H= 473:15 +CPU= 34.016
  12:37:26 STEP 1894 H= 473:30 +CPU= 35.734
  12:38:01 STEP 1895 H= 473:45 +CPU= 34.380
  12:38:45 STEP 1896 H= 474:00 +CPU= 43.061
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001896
  12:39:20 STEP 1897 H= 474:15 +CPU= 34.194
  12:39:52 STEP 1898 H= 474:30 +CPU= 31.247
  12:40:24 STEP 1899 H= 474:45 +CPU= 31.081
  12:40:57 STEP 1900 H= 475:00 +CPU= 32.022
  12:41:30 STEP 1901 H= 475:15 +CPU= 32.142
  12:42:03 STEP 1902 H= 475:30 +CPU= 31.509
  12:42:35 STEP 1903 H= 475:45 +CPU= 31.509
  12:43:08 STEP 1904 H= 476:00 +CPU= 32.006
  12:43:44 STEP 1905 H= 476:15 +CPU= 35.007
  12:44:20 STEP 1906 H= 476:30 +CPU= 34.849
  12:44:56 STEP 1907 H= 476:45 +CPU= 35.006
  12:45:41 STEP 1908 H= 477:00 +CPU= 43.536
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001908
  12:46:17 STEP 1909 H= 477:15 +CPU= 34.970
  12:46:53 STEP 1910 H= 477:30 +CPU= 35.833
  12:47:30 STEP 1911 H= 477:45 +CPU= 35.223
  12:48:08 STEP 1912 H= 478:00 +CPU= 36.754
  12:48:43 STEP 1913 H= 478:15 +CPU= 34.671
  12:49:15 STEP 1914 H= 478:30 +CPU= 30.841
  12:49:47 STEP 1915 H= 478:45 +CPU= 30.853
  12:50:19 STEP 1916 H= 479:00 +CPU= 31.015
  12:50:47 STEP 1917 H= 479:15 +CPU= 26.741
  12:51:14 STEP 1918 H= 479:30 +CPU= 26.785
  12:51:43 STEP 1919 H= 479:45 +CPU= 27.941
  12:52:18 STEP 1920 H= 480:00 +CPU= 34.094
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  480.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.8673255859E-21      I       0.2376133848E-05      I
ICloud fractionI      0.0000000000E+00      I       0.6249151410E-01      I
I  Relat. Hum. I      0.3646615651E+00      I       0.4437404917E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.1025324567E+04      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    313193268 BYTES IN      7 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0110( 1.8%)
 12:52:18 STEP 1920 H= 480:00 +CPU= 34.094
 END CNT3
 NSTEP =  1920 CNT0   000000000  25.565  25.565  26.324   0.971               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN        11440/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    203    0       46      1044068    11440 ************    46.2    17.5    28.7    17.9    62.9
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.88      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  417    5930.8    5930.8     16.13      0.00
   9 SPCM     - SPECTRAL COMP.                     384    1309.6    1309.6      3.28      0.00
  10 SCAN2M - PHYSICS                              385   19253.3   19253.3     48.35      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 32    1423.5    1423.5      0.30      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 17      90.8      90.8      0.01      0.00
  17 GRIDFPOS IN CNT4                               32      37.5      37.5      0.01      0.00
  27 RESTART FILES - WRITING                         8    5659.7    5659.7      0.30      0.00
  28 RESTART FILES - READING                         1   18400.4   18400.4      0.12      0.00
  29 SU4FPOS IN CNT4                                32       3.5       3.5      0.00      0.00
  30 DYNFPOS IN CNT4                                32    8480.5    8480.5      1.77      0.00
  31 POSDDH IN STEPO                                 2      87.6      87.6      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    385    8168.8    8168.8     20.51      0.00
  39 SU0YOMB                                         1     213.0     213.0      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    385      40.1      40.1      0.10      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              384     532.1     532.1      1.33      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              384     105.7     105.7      0.26      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 17      64.4      64.4      0.01      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      836     569.8     569.8      3.11      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       800     336.9     336.9      1.76      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        800     114.0     114.0      0.59      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       836     200.2     200.2      1.09      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      23.9      23.9      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            836      60.5      60.5      0.33      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            800      35.4      35.4      0.18      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            836     129.0     129.0      0.70      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            800      39.6      39.6      0.21      0.00
 400 GSTATS                                      45508       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 42288       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    15330.3 CPU TIME   14899.0 VECTOR TIME    14899.0


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      112.9
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMGGh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMSHh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/21/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/slots/21/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/21/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMGGh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMSHh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292982/ICMUAh7zg+001884
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3lb_2016092300_20_1018_12292982_1_r1568795543_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
12:55:51 (2271): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
13 Aug 2024 12:00:54 1533065 22505901 oifs_43r3_bl_a3lb_2016092300_20_1018_12292982_1 1,727,100 69,085 0.0400


©2024 cpdn.org