climateprediction.net home page
Task 22434866

Task 22434866

Name oifs_43r3_bl_a14m_2016092300_20_1017_12283289_0
Workunit 12283289
Created 7 Jun 2024, 12:57:45 UTC
Sent 7 Jun 2024, 13:04:44 UTC
Report deadline 6 Aug 2024, 13:04:44 UTC
Received 11 Jun 2024, 20:44:50 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1478188
Run time 13 hours 53 min 58 sec
CPU time 13 hours 53 min 58 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 4.22 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,014.20 MB
Peak swap size 5,980.80 MB
Peak disk usage 1,296.86 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
ifs43r3_2/src/ifsaux/support/drhook.c:3897] :            CALL_SL_HEAP 
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20933:20933] [20240610:214434:1718052274:48297.945] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :             CALL_SL 
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20933:20933] [20240610:214434:1718052274:48297.946] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :              >OMP-CALL_SL     2        (1005) 
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20933:20933] [20240610:214434:1718052274:48297.946] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :               LAPINEB 
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20933:20933] [20240610:214434:1718052274:48297.946] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                LARCINB 
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20933:20933] [20240610:214434:1718052274:48297.946] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                 LAITRE_GMV 
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20933:20933] [20240610:214434:1718052274:48297.946] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                  LAITRI 
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20933:20933] [20240610:214435:1718052275:48298.946] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20933:20933] [20240610:214435:1718052275:48298.946] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1cf8da0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CF935B  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000008214C1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DD5490  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000DCAC20  laitri_                   320  laitri.F90
oifs_43r3_model.e  0000000000DC6EE4  laitre_gmv_               143  laitre_gmv.F90
oifs_43r3_model.e  0000000000DCFA6C  larcinb_                  415  larcinb.F90
oifs_43r3_model.e  0000000000D8A8F8  lapineb_                  451  lapineb.F90
oifs_43r3_model.e  0000000000D57FC1  call_sl_                  363  call_sl.F90
oifs_43r3_model.e  0000000000D54BBC  call_sl_heap_              94  call_sl_heap.F90
oifs_43r3_model.e  0000000000BD4FD8  gp_model_                 533  gp_model.F90
oifs_43r3_model.e  00000000012C5002  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BACBAE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  0000000000688153  stepo_                    327  stepo.F90
oifs_43r3_model.e  00000000004CD1DC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000004B5D85  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  00000000004B4F52  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  000000000049D638  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  0000000000406FBD  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  0000000000401E7F  MAIN__                     96  master.F90
oifs_43r3_model.e  0000000000401E12  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCC34A  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCDBE7  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000401CD5  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a14m
(argv4) batchid: 1017
(argv5) wuid: 12283289
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /data/boinc/boinc-client/slots/5
Project directory is: /data/boinc/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289
..mkdir for temp folder for results failed
Copying: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /data/boinc/boinc-client/slots/5/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /data/boinc/boinc-client/slots/5/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_333ada2ae5358a30fe4eb8d1aa650df4 to: /data/boinc/boinc-client/slots/5/oifs_43r3_bl_a14m_2016092300_20_1017_12283289.zip
Unzipping the namelist zip file: /data/boinc/boinc-client/slots/5/oifs_43r3_bl_a14m_2016092300_20_1017_12283289.zip
ic_ancil_file: ic_ancil_12283289
ifsdata_file: ifsdata_12283289
climate_data_file: clim_data_12283289
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /data/boinc/boinc-client/slots/5/ic_ancil_12283289.zip
Unzipping the IC ancils zip file: /data/boinc/boinc-client/slots/5/ic_ancil_12283289.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_d5aa3711d921b98e505b95f97b8f4553 to: /data/boinc/boinc-client/slots/5/ifsdata/ifsdata_12283289.zip
Unzipping the ifsdata_zip file: /data/boinc/boinc-client/slots/5/ifsdata/ifsdata_12283289.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /data/boinc/boinc-client/slots/5/159l_2/clim_data_12283289.zip
Unzipping the climate data zip file: /data/boinc/boinc-client/slots/5/159l_2/clim_data_12283289.zip
Checking for progress XML file: /data/boinc/boinc-client/slots/5/progress_file_12283289.xml
Opened progress file ok : /data/boinc/boinc-client/slots/5/progress_file_12283289.xml
-- Model is restarting --
Adjusting last_iter, 1040, to previous model restart step.
Creating progress file: /data/boinc/boinc-client/slots/5/progress_file_12283289.xml
last_cpu_time: 35621
upload_file_number: 10
last_iter: 1009
last_upload: 864000
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a14m_2016092300_20_1017_12283289_0_r863704960
The child process has been launched with process id: 20253
Executing the command: /data/boinc/boinc-client/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.001] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.001] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.001] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:20253:20253] [20240611:074736:1718088456:0.001] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  07:48:18 STEP 1008 H= 252:00 +CPU= 32.340
  07:48:48 STEP 1009 H= 252:15 +CPU= 29.970
  07:49:18 STEP 1010 H= 252:30 +CPU= 29.741
  07:49:49 STEP 1011 H= 252:45 +CPU= 31.048
  07:50:20 STEP 1012 H= 253:00 +CPU= 31.509
  07:50:50 STEP 1013 H= 253:15 +CPU= 29.922
  07:51:20 STEP 1014 H= 253:30 +CPU= 29.902
  07:51:52 STEP 1015 H= 253:45 +CPU= 31.080
  07:52:22 STEP 1016 H= 254:00 +CPU= 30.715
  07:52:53 STEP 1017 H= 254:15 +CPU= 30.118
  07:53:24 STEP 1018 H= 254:30 +CPU= 30.995
  07:53:55 STEP 1019 H= 254:45 +CPU= 31.148
  07:54:34 STEP 1020 H= 255:00 +CPU= 38.818
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001020
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001020
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001020
  07:55:05 STEP 1021 H= 255:15 +CPU= 30.495
  07:55:37 STEP 1022 H= 255:30 +CPU= 32.594
  07:56:08 STEP 1023 H= 255:45 +CPU= 30.610
  07:56:41 STEP 1024 H= 256:00 +CPU= 32.366
  07:57:12 STEP 1025 H= 256:15 +CPU= 31.238
  07:57:44 STEP 1026 H= 256:30 +CPU= 31.742
  07:58:16 STEP 1027 H= 256:45 +CPU= 31.738
  07:58:48 STEP 1028 H= 257:00 +CPU= 31.518
  07:59:19 STEP 1029 H= 257:15 +CPU= 31.783
  07:59:51 STEP 1030 H= 257:30 +CPU= 31.578
  08:00:22 STEP 1031 H= 257:45 +CPU= 30.776
  08:01:01 STEP 1032 H= 258:00 +CPU= 38.968
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001032
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001032
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001032
  08:01:33 STEP 1033 H= 258:15 +CPU= 31.664
  08:02:04 STEP 1034 H= 258:30 +CPU= 30.929
  08:02:35 STEP 1035 H= 258:45 +CPU= 30.729
  08:03:06 STEP 1036 H= 259:00 +CPU= 31.221
  08:03:37 STEP 1037 H= 259:15 +CPU= 30.825
  08:04:09 STEP 1038 H= 259:30 +CPU= 31.586
  08:04:41 STEP 1039 H= 259:45 +CPU= 31.395
  08:05:12 STEP 1040 H= 260:00 +CPU= 30.575
  08:05:43 STEP 1041 H= 260:15 +CPU= 30.751
  08:06:13 STEP 1042 H= 260:30 +CPU= 30.658
  08:06:44 STEP 1043 H= 260:45 +CPU= 30.323
  08:07:22 STEP 1044 H= 261:00 +CPU= 37.376
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001044
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001044
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001044
  08:07:52 STEP 1045 H= 261:15 +CPU= 30.530
  08:08:25 STEP 1046 H= 261:30 +CPU= 32.116
  08:08:55 STEP 1047 H= 261:45 +CPU= 30.047
  08:09:27 STEP 1048 H= 262:00 +CPU= 32.123
  08:09:59 STEP 1049 H= 262:15 +CPU= 31.348
  08:10:30 STEP 1050 H= 262:30 +CPU= 31.072
  08:11:01 STEP 1051 H= 262:45 +CPU= 30.371
  08:11:33 STEP 1052 H= 263:00 +CPU= 32.238
  08:12:05 STEP 1053 H= 263:15 +CPU= 31.889
  08:12:37 STEP 1054 H= 263:30 +CPU= 31.292
  08:13:07 STEP 1055 H= 263:45 +CPU= 30.186
  08:13:49 STEP 1056 H= 264:00 +CPU= 41.859
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001056
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001056
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001056
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+000960
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+000960
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+000960
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+000972
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+000972
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+000972
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+000984
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+000984
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+000984
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+000996
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+000996
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+000996
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001008
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001008
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001008
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001020
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001020
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001020
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001032
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001032
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001032
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001044
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001044
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001044
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a14m_2016092300_20_1017_12283289_0_r863704960_10.zip
Uploading the intermediate file: upload_file_10.zip
  08:14:21 STEP 1057 H= 264:15 +CPU= 31.551
  08:14:54 STEP 1058 H= 264:30 +CPU= 32.610
  08:15:26 STEP 1059 H= 264:45 +CPU= 32.061
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:51:24 STEP 1060 H= 265:00 +CPU= 31.691
  08:51:58 STEP 1061 H= 265:15 +CPU= 32.857
  08:52:32 STEP 1062 H= 265:30 +CPU= 32.879
  08:53:06 STEP 1063 H= 265:45 +CPU= 33.089
  08:53:40 STEP 1064 H= 266:00 +CPU= 33.410
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:18:33 STEP 1065 H= 266:15 +CPU= 32.531
  09:19:08 STEP 1066 H= 266:30 +CPU= 33.237
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:50:49 STEP 1067 H= 266:45 +CPU= 33.511
  09:51:33 STEP 1068 H= 267:00 +CPU= 42.680
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001068
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001068
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001068
  09:52:09 STEP 1069 H= 267:15 +CPU= 34.238
  09:52:45 STEP 1070 H= 267:30 +CPU= 34.199
  09:53:21 STEP 1071 H= 267:45 +CPU= 34.159
  09:53:57 STEP 1072 H= 268:00 +CPU= 35.018
  09:54:33 STEP 1073 H= 268:15 +CPU= 34.447
  09:55:09 STEP 1074 H= 268:30 +CPU= 34.589
  09:55:46 STEP 1075 H= 268:45 +CPU= 34.716
  09:56:22 STEP 1076 H= 269:00 +CPU= 34.799
  09:56:58 STEP 1077 H= 269:15 +CPU= 34.140
  09:57:33 STEP 1078 H= 269:30 +CPU= 33.994
  09:58:08 STEP 1079 H= 269:45 +CPU= 33.819
  09:58:53 STEP 1080 H= 270:00 +CPU= 42.450
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001080
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001080
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001080
  09:59:28 STEP 1081 H= 270:15 +CPU= 33.950
  10:00:03 STEP 1082 H= 270:30 +CPU= 33.856
  10:00:38 STEP 1083 H= 270:45 +CPU= 33.608
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:36:43 STEP 1084 H= 271:00 +CPU= 34.105
  10:37:21 STEP 1085 H= 271:15 +CPU= 34.401
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:11:17 STEP 1086 H= 271:30 +CPU= 31.396
  11:11:50 STEP 1087 H= 271:45 +CPU= 32.379
  11:12:24 STEP 1088 H= 272:00 +CPU= 33.107
  11:12:57 STEP 1089 H= 272:15 +CPU= 32.232
  11:13:30 STEP 1090 H= 272:30 +CPU= 32.503
  11:14:03 STEP 1091 H= 272:45 +CPU= 31.947
  11:14:42 STEP 1092 H= 273:00 +CPU= 38.596
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001092
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001092
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001092
  11:15:15 STEP 1093 H= 273:15 +CPU= 31.843
  11:15:46 STEP 1094 H= 273:30 +CPU= 31.432
  11:16:19 STEP 1095 H= 273:45 +CPU= 31.996
  11:16:52 STEP 1096 H= 274:00 +CPU= 32.372
  11:17:25 STEP 1097 H= 274:15 +CPU= 31.832
  11:17:57 STEP 1098 H= 274:30 +CPU= 31.498
  11:18:29 STEP 1099 H= 274:45 +CPU= 31.559
  11:19:01 STEP 1100 H= 275:00 +CPU= 31.833
  11:19:33 STEP 1101 H= 275:15 +CPU= 31.597
  11:20:05 STEP 1102 H= 275:30 +CPU= 31.627
  11:20:38 STEP 1103 H= 275:45 +CPU= 31.890
  11:21:22 STEP 1104 H= 276:00 +CPU= 43.998
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001104
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001104
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001104
  11:21:54 STEP 1105 H= 276:15 +CPU= 31.127
  11:22:27 STEP 1106 H= 276:30 +CPU= 32.245
  11:23:00 STEP 1107 H= 276:45 +CPU= 32.263
  11:23:32 STEP 1108 H= 277:00 +CPU= 32.436
  11:24:04 STEP 1109 H= 277:15 +CPU= 31.595
  11:24:37 STEP 1110 H= 277:30 +CPU= 31.740
  11:25:09 STEP 1111 H= 277:45 +CPU= 32.148
  11:25:43 STEP 1112 H= 278:00 +CPU= 32.651
  11:26:14 STEP 1113 H= 278:15 +CPU= 31.502
  11:26:47 STEP 1114 H= 278:30 +CPU= 32.207
  11:27:20 STEP 1115 H= 278:45 +CPU= 31.857
  11:28:01 STEP 1116 H= 279:00 +CPU= 40.441
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001116
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001116
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001116
  11:28:34 STEP 1117 H= 279:15 +CPU= 32.770
  11:29:07 STEP 1118 H= 279:30 +CPU= 32.142
  11:29:40 STEP 1119 H= 279:45 +CPU= 32.195
  11:30:13 STEP 1120 H= 280:00 +CPU= 32.157
  11:30:45 STEP 1121 H= 280:15 +CPU= 31.965
  11:31:18 STEP 1122 H= 280:30 +CPU= 32.117
  11:31:50 STEP 1123 H= 280:45 +CPU= 32.020
  11:32:24 STEP 1124 H= 281:00 +CPU= 33.244
  11:32:56 STEP 1125 H= 281:15 +CPU= 31.365
  11:33:29 STEP 1126 H= 281:30 +CPU= 32.272
  11:34:02 STEP 1127 H= 281:45 +CPU= 31.584
  11:34:43 STEP 1128 H= 282:00 +CPU= 40.259
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001128
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001128
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001128
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:37:23 STEP 1129 H= 282:15 +CPU= 32.573
  11:38:02 STEP 1130 H= 282:30 +CPU= 33.155
  11:38:36 STEP 1131 H= 282:45 +CPU= 32.692
  11:39:10 STEP 1132 H= 283:00 +CPU= 33.248
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:43:01 STEP 1133 H= 283:15 +CPU= 32.839
  11:43:35 STEP 1134 H= 283:30 +CPU= 32.665
  11:44:08 STEP 1135 H= 283:45 +CPU= 32.644
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:03:34 STEP 1136 H= 284:00 +CPU= 33.670
  12:04:07 STEP 1137 H= 284:15 +CPU= 32.400
  12:04:40 STEP 1138 H= 284:30 +CPU= 32.410
  12:05:14 STEP 1139 H= 284:45 +CPU= 32.492
  12:05:56 STEP 1140 H= 285:00 +CPU= 41.187
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001140
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001140
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001140
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:05:48 STEP 1141 H= 285:15 +CPU= 32.461
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:14:13 STEP 1142 H= 285:30 +CPU= 32.815
  18:14:46 STEP 1143 H= 285:45 +CPU= 32.207
  18:15:20 STEP 1144 H= 286:00 +CPU= 33.099
  18:15:53 STEP 1145 H= 286:15 +CPU= 32.214
  18:16:25 STEP 1146 H= 286:30 +CPU= 31.771
  18:16:58 STEP 1147 H= 286:45 +CPU= 32.180
  18:17:31 STEP 1148 H= 287:00 +CPU= 32.078
  18:18:03 STEP 1149 H= 287:15 +CPU= 31.836
  18:18:36 STEP 1150 H= 287:30 +CPU= 32.327
  18:19:09 STEP 1151 H= 287:45 +CPU= 32.259
  18:20:00 STEP 1152 H= 288:00 +CPU= 44.742
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001152
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001152
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001152
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001056
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001056
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001056
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001068
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001068
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001068
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001080
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001080
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001080
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001092
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001092
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001092
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001104
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001104
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001104
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001116
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001116
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001116
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001128
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001128
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001128
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001140
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001140
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001140
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a14m_2016092300_20_1017_12283289_0_r863704960_11.zip
Uploading the intermediate file: upload_file_11.zip
  18:20:33 STEP 1153 H= 288:15 +CPU= 32.101
  18:21:05 STEP 1154 H= 288:30 +CPU= 31.735
  18:21:38 STEP 1155 H= 288:45 +CPU= 32.036
  18:22:11 STEP 1156 H= 289:00 +CPU= 32.447
  18:22:44 STEP 1157 H= 289:15 +CPU= 31.821
  18:23:17 STEP 1158 H= 289:30 +CPU= 31.938
  18:23:49 STEP 1159 H= 289:45 +CPU= 31.867
  18:24:22 STEP 1160 H= 290:00 +CPU= 32.163
  18:24:55 STEP 1161 H= 290:15 +CPU= 31.752
  18:25:27 STEP 1162 H= 290:30 +CPU= 31.755
  18:26:00 STEP 1163 H= 290:45 +CPU= 32.426
  18:26:41 STEP 1164 H= 291:00 +CPU= 39.693
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001164
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001164
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001164
  18:27:14 STEP 1165 H= 291:15 +CPU= 31.776
  18:27:46 STEP 1166 H= 291:30 +CPU= 31.683
  18:28:19 STEP 1167 H= 291:45 +CPU= 32.068
  18:28:53 STEP 1168 H= 292:00 +CPU= 32.789
  18:29:25 STEP 1169 H= 292:15 +CPU= 32.028
  18:29:58 STEP 1170 H= 292:30 +CPU= 32.049
  18:30:31 STEP 1171 H= 292:45 +CPU= 32.026
  18:31:05 STEP 1172 H= 293:00 +CPU= 32.873
  18:31:38 STEP 1173 H= 293:15 +CPU= 32.246
  18:32:10 STEP 1174 H= 293:30 +CPU= 31.523
  18:32:43 STEP 1175 H= 293:45 +CPU= 32.118
  18:33:25 STEP 1176 H= 294:00 +CPU= 40.852
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001176
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001176
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001176
  18:33:57 STEP 1177 H= 294:15 +CPU= 32.145
  18:34:30 STEP 1178 H= 294:30 +CPU= 32.514
  18:35:04 STEP 1179 H= 294:45 +CPU= 32.816
  18:35:38 STEP 1180 H= 295:00 +CPU= 33.725
  18:36:12 STEP 1181 H= 295:15 +CPU= 32.728
  18:36:45 STEP 1182 H= 295:30 +CPU= 32.624
  18:37:19 STEP 1183 H= 295:45 +CPU= 33.165
  18:37:53 STEP 1184 H= 296:00 +CPU= 33.383
  18:38:26 STEP 1185 H= 296:15 +CPU= 32.679
  18:39:00 STEP 1186 H= 296:30 +CPU= 32.981
  18:39:34 STEP 1187 H= 296:45 +CPU= 33.026
  18:40:16 STEP 1188 H= 297:00 +CPU= 40.938
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001188
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001188
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001188
  18:40:50 STEP 1189 H= 297:15 +CPU= 33.251
  18:41:23 STEP 1190 H= 297:30 +CPU= 32.868
  18:41:57 STEP 1191 H= 297:45 +CPU= 33.213
  18:42:31 STEP 1192 H= 298:00 +CPU= 33.755
  18:43:05 STEP 1193 H= 298:15 +CPU= 32.922
  18:43:39 STEP 1194 H= 298:30 +CPU= 32.867
  18:44:12 STEP 1195 H= 298:45 +CPU= 33.149
  18:44:47 STEP 1196 H= 299:00 +CPU= 33.579
  18:45:20 STEP 1197 H= 299:15 +CPU= 32.954
  18:45:54 STEP 1198 H= 299:30 +CPU= 33.357
  18:46:28 STEP 1199 H= 299:45 +CPU= 32.979
  18:47:20 STEP 1200 H= 300:00 +CPU= 45.645
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001200
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001200
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001200
  18:47:54 STEP 1201 H= 300:15 +CPU= 33.131
  18:48:27 STEP 1202 H= 300:30 +CPU= 32.476
  18:49:00 STEP 1203 H= 300:45 +CPU= 32.779
  18:49:35 STEP 1204 H= 301:00 +CPU= 33.940
  18:50:08 STEP 1205 H= 301:15 +CPU= 32.821
  18:50:42 STEP 1206 H= 301:30 +CPU= 32.786
  18:51:15 STEP 1207 H= 301:45 +CPU= 32.798
  18:51:50 STEP 1208 H= 302:00 +CPU= 33.266
  18:52:23 STEP 1209 H= 302:15 +CPU= 32.743
  18:52:57 STEP 1210 H= 302:30 +CPU= 32.828
  18:53:30 STEP 1211 H= 302:45 +CPU= 32.755
  18:54:12 STEP 1212 H= 303:00 +CPU= 41.215
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001212
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001212
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001212
  18:54:46 STEP 1213 H= 303:15 +CPU= 32.524
  18:55:20 STEP 1214 H= 303:30 +CPU= 32.941
  18:55:53 STEP 1215 H= 303:45 +CPU= 32.756
  18:56:28 STEP 1216 H= 304:00 +CPU= 33.661
  18:57:02 STEP 1217 H= 304:15 +CPU= 33.123
  18:57:36 STEP 1218 H= 304:30 +CPU= 33.126
  18:58:09 STEP 1219 H= 304:45 +CPU= 32.820
  18:58:45 STEP 1220 H= 305:00 +CPU= 34.079
  18:59:18 STEP 1221 H= 305:15 +CPU= 32.685
  18:59:52 STEP 1222 H= 305:30 +CPU= 32.917
  19:00:25 STEP 1223 H= 305:45 +CPU= 32.912
  19:01:09 STEP 1224 H= 306:00 +CPU= 41.233
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001224
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001224
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001224
  19:01:43 STEP 1225 H= 306:15 +CPU= 32.733
  19:02:16 STEP 1226 H= 306:30 +CPU= 32.747
  19:02:50 STEP 1227 H= 306:45 +CPU= 32.707
  19:03:24 STEP 1228 H= 307:00 +CPU= 33.592
  19:03:58 STEP 1229 H= 307:15 +CPU= 33.271
  19:04:32 STEP 1230 H= 307:30 +CPU= 33.359
  19:05:05 STEP 1231 H= 307:45 +CPU= 32.669
  19:05:39 STEP 1232 H= 308:00 +CPU= 34.019
  19:06:13 STEP 1233 H= 308:15 +CPU= 32.971
  19:06:46 STEP 1234 H= 308:30 +CPU= 32.660
  19:07:20 STEP 1235 H= 308:45 +CPU= 33.506
  19:08:02 STEP 1236 H= 309:00 +CPU= 40.705
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001236
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001236
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001236
  19:08:36 STEP 1237 H= 309:15 +CPU= 33.112
  19:09:09 STEP 1238 H= 309:30 +CPU= 32.793
  19:09:42 STEP 1239 H= 309:45 +CPU= 32.430
  19:10:16 STEP 1240 H= 310:00 +CPU= 33.440
  19:10:50 STEP 1241 H= 310:15 +CPU= 32.954
  19:11:23 STEP 1242 H= 310:30 +CPU= 32.402
  19:11:56 STEP 1243 H= 310:45 +CPU= 32.555
  19:12:30 STEP 1244 H= 311:00 +CPU= 33.257
  19:13:03 STEP 1245 H= 311:15 +CPU= 32.905
  19:13:37 STEP 1246 H= 311:30 +CPU= 33.289
  19:14:11 STEP 1247 H= 311:45 +CPU= 32.576
  19:14:59 STEP 1248 H= 312:00 +CPU= 45.552
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001248
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001248
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001152
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001152
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001152
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001164
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001164
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001164
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001176
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001176
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001176
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001188
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001188
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001188
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001200
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001200
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001200
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001212
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001212
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001212
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001224
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001224
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001224
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001236
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001236
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001236
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a14m_2016092300_20_1017_12283289_0_r863704960_12.zip
Uploading the intermediate file: upload_file_12.zip
  19:15:33 STEP 1249 H= 312:15 +CPU= 33.274
  19:16:06 STEP 1250 H= 312:30 +CPU= 32.429
  19:16:40 STEP 1251 H= 312:45 +CPU= 33.118
  19:17:14 STEP 1252 H= 313:00 +CPU= 33.058
  19:17:47 STEP 1253 H= 313:15 +CPU= 32.692
  19:18:20 STEP 1254 H= 313:30 +CPU= 32.818
  19:18:54 STEP 1255 H= 313:45 +CPU= 32.715
  19:19:28 STEP 1256 H= 314:00 +CPU= 33.369
  19:20:01 STEP 1257 H= 314:15 +CPU= 32.224
  19:20:34 STEP 1258 H= 314:30 +CPU= 32.571
  19:21:08 STEP 1259 H= 314:45 +CPU= 32.653
  19:21:50 STEP 1260 H= 315:00 +CPU= 41.371
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001260
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001260
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001260
  19:22:24 STEP 1261 H= 315:15 +CPU= 33.045
  19:22:57 STEP 1262 H= 315:30 +CPU= 32.881
  19:23:31 STEP 1263 H= 315:45 +CPU= 33.042
  19:24:07 STEP 1264 H= 316:00 +CPU= 33.732
  19:24:41 STEP 1265 H= 316:15 +CPU= 33.044
  19:25:14 STEP 1266 H= 316:30 +CPU= 32.730
  19:25:48 STEP 1267 H= 316:45 +CPU= 32.474
  19:26:22 STEP 1268 H= 317:00 +CPU= 33.630
  19:26:55 STEP 1269 H= 317:15 +CPU= 32.648
  19:27:30 STEP 1270 H= 317:30 +CPU= 33.200
  19:28:03 STEP 1271 H= 317:45 +CPU= 32.523
  19:28:45 STEP 1272 H= 318:00 +CPU= 41.333
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001272
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001272
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001272
  19:29:19 STEP 1273 H= 318:15 +CPU= 32.746
  19:29:52 STEP 1274 H= 318:30 +CPU= 32.650
  19:30:26 STEP 1275 H= 318:45 +CPU= 32.857
  19:31:00 STEP 1276 H= 319:00 +CPU= 33.818
  19:31:34 STEP 1277 H= 319:15 +CPU= 32.734
  19:32:07 STEP 1278 H= 319:30 +CPU= 32.389
  19:32:40 STEP 1279 H= 319:45 +CPU= 32.867
  19:33:15 STEP 1280 H= 320:00 +CPU= 33.653
  19:33:48 STEP 1281 H= 320:15 +CPU= 33.101
  19:34:22 STEP 1282 H= 320:30 +CPU= 33.319
  19:34:56 STEP 1283 H= 320:45 +CPU= 33.347
  19:35:38 STEP 1284 H= 321:00 +CPU= 40.861
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001284
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001284
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001284
  19:36:12 STEP 1285 H= 321:15 +CPU= 33.055
  19:36:45 STEP 1286 H= 321:30 +CPU= 33.009
  19:37:18 STEP 1287 H= 321:45 +CPU= 32.431
  19:37:52 STEP 1288 H= 322:00 +CPU= 33.368
  19:38:26 STEP 1289 H= 322:15 +CPU= 33.133
  19:39:00 STEP 1290 H= 322:30 +CPU= 33.314
  19:39:34 STEP 1291 H= 322:45 +CPU= 32.633
  19:40:08 STEP 1292 H= 323:00 +CPU= 33.793
  19:40:41 STEP 1293 H= 323:15 +CPU= 32.500
  19:41:15 STEP 1294 H= 323:30 +CPU= 32.800
  19:41:48 STEP 1295 H= 323:45 +CPU= 32.672
  19:42:34 STEP 1296 H= 324:00 +CPU= 45.328
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001296
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001296
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001296
  19:43:08 STEP 1297 H= 324:15 +CPU= 32.851
  19:43:41 STEP 1298 H= 324:30 +CPU= 32.672
  19:44:14 STEP 1299 H= 324:45 +CPU= 32.466
  19:44:49 STEP 1300 H= 325:00 +CPU= 33.679
  19:45:22 STEP 1301 H= 325:15 +CPU= 32.652
  19:45:55 STEP 1302 H= 325:30 +CPU= 32.585
  19:46:29 STEP 1303 H= 325:45 +CPU= 32.913
  19:47:02 STEP 1304 H= 326:00 +CPU= 32.739
  19:47:35 STEP 1305 H= 326:15 +CPU= 32.641
  19:48:09 STEP 1306 H= 326:30 +CPU= 32.894
  19:48:42 STEP 1307 H= 326:45 +CPU= 32.590
  19:49:24 STEP 1308 H= 327:00 +CPU= 40.663
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001308
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001308
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001308
  19:49:57 STEP 1309 H= 327:15 +CPU= 32.663
  19:50:30 STEP 1310 H= 327:30 +CPU= 32.373
  19:51:04 STEP 1311 H= 327:45 +CPU= 33.070
  19:51:38 STEP 1312 H= 328:00 +CPU= 32.791
  19:52:11 STEP 1313 H= 328:15 +CPU= 32.823
  19:52:45 STEP 1314 H= 328:30 +CPU= 32.951
  19:53:19 STEP 1315 H= 328:45 +CPU= 33.123
  19:53:53 STEP 1316 H= 329:00 +CPU= 32.945
  19:54:26 STEP 1317 H= 329:15 +CPU= 32.296
  19:55:00 STEP 1318 H= 329:30 +CPU= 32.673
  19:55:33 STEP 1319 H= 329:45 +CPU= 32.813
  19:56:16 STEP 1320 H= 330:00 +CPU= 41.064
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001320
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001320
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001320
  19:56:49 STEP 1321 H= 330:15 +CPU= 33.005
  19:57:23 STEP 1322 H= 330:30 +CPU= 32.864
  19:57:56 STEP 1323 H= 330:45 +CPU= 32.844
  19:58:31 STEP 1324 H= 331:00 +CPU= 33.728
  19:59:04 STEP 1325 H= 331:15 +CPU= 32.982
  19:59:38 STEP 1326 H= 331:30 +CPU= 32.612
  20:00:11 STEP 1327 H= 331:45 +CPU= 32.861
  20:00:45 STEP 1328 H= 332:00 +CPU= 33.551
  20:01:19 STEP 1329 H= 332:15 +CPU= 32.957
  20:01:52 STEP 1330 H= 332:30 +CPU= 32.481
  20:02:26 STEP 1331 H= 332:45 +CPU= 33.380
  20:03:08 STEP 1332 H= 333:00 +CPU= 40.715
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001332
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001332
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001332
  20:03:41 STEP 1333 H= 333:15 +CPU= 32.711
  20:04:14 STEP 1334 H= 333:30 +CPU= 32.513
  20:04:47 STEP 1335 H= 333:45 +CPU= 32.427
  20:05:21 STEP 1336 H= 334:00 +CPU= 32.855
  20:05:54 STEP 1337 H= 334:15 +CPU= 32.925
  20:06:27 STEP 1338 H= 334:30 +CPU= 32.587
  20:07:01 STEP 1339 H= 334:45 +CPU= 32.547
  20:07:35 STEP 1340 H= 335:00 +CPU= 33.378
  20:08:08 STEP 1341 H= 335:15 +CPU= 32.444
  20:08:42 STEP 1342 H= 335:30 +CPU= 33.145
  20:09:15 STEP 1343 H= 335:45 +CPU= 32.860
  20:10:02 STEP 1344 H= 336:00 +CPU= 44.913
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001344
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001344
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001344
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001260
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001260
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001260
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001272
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001272
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001272
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001284
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001284
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001284
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001296
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001296
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001296
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001308
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001308
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001308
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001320
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001320
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001320
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001332
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001332
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001332
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a14m_2016092300_20_1017_12283289_0_r863704960_13.zip
Uploading the intermediate file: upload_file_13.zip
  20:10:34 STEP 1345 H= 336:15 +CPU= 32.107
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:29:40 STEP 1346 H= 336:30 +CPU= 32.683
  20:30:14 STEP 1347 H= 336:45 +CPU= 32.938
  20:30:51 STEP 1348 H= 337:00 +CPU= 34.163
  20:31:26 STEP 1349 H= 337:15 +CPU= 33.380
  20:32:00 STEP 1350 H= 337:30 +CPU= 33.431
  20:32:34 STEP 1351 H= 337:45 +CPU= 33.055
  20:33:09 STEP 1352 H= 338:00 +CPU= 33.471
  20:33:42 STEP 1353 H= 338:15 +CPU= 32.816
  20:34:15 STEP 1354 H= 338:30 +CPU= 32.576
  20:34:49 STEP 1355 H= 338:45 +CPU= 32.847
  20:35:31 STEP 1356 H= 339:00 +CPU= 41.327
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001356
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001356
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001356
  20:36:04 STEP 1357 H= 339:15 +CPU= 32.462
  20:36:37 STEP 1358 H= 339:30 +CPU= 32.403
  20:37:10 STEP 1359 H= 339:45 +CPU= 32.418
  20:37:44 STEP 1360 H= 340:00 +CPU= 33.290
  20:38:18 STEP 1361 H= 340:15 +CPU= 32.982
  20:38:52 STEP 1362 H= 340:30 +CPU= 32.869
  20:39:25 STEP 1363 H= 340:45 +CPU= 32.895
  20:39:59 STEP 1364 H= 341:00 +CPU= 33.423
  20:40:33 STEP 1365 H= 341:15 +CPU= 32.820
  20:41:06 STEP 1366 H= 341:30 +CPU= 32.455
  20:41:39 STEP 1367 H= 341:45 +CPU= 33.029
  20:42:21 STEP 1368 H= 342:00 +CPU= 41.286
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001368
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001368
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001368
  20:42:55 STEP 1369 H= 342:15 +CPU= 33.237
  20:43:29 STEP 1370 H= 342:30 +CPU= 32.602
  20:44:02 STEP 1371 H= 342:45 +CPU= 32.999
  20:44:36 STEP 1372 H= 343:00 +CPU= 33.392
  20:45:10 STEP 1373 H= 343:15 +CPU= 32.547
  20:45:43 STEP 1374 H= 343:30 +CPU= 32.473
  20:46:16 STEP 1375 H= 343:45 +CPU= 32.686
  20:46:50 STEP 1376 H= 344:00 +CPU= 33.361
  20:47:23 STEP 1377 H= 344:15 +CPU= 32.430
  20:47:56 STEP 1378 H= 344:30 +CPU= 32.696
  20:48:29 STEP 1379 H= 344:45 +CPU= 32.208
  20:49:11 STEP 1380 H= 345:00 +CPU= 40.997
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001380
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001380
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001380
  20:49:45 STEP 1381 H= 345:15 +CPU= 32.744
  20:50:18 STEP 1382 H= 345:30 +CPU= 32.821
  20:50:52 STEP 1383 H= 345:45 +CPU= 32.782
  20:51:26 STEP 1384 H= 346:00 +CPU= 33.318
  20:51:58 STEP 1385 H= 346:15 +CPU= 32.002
  20:52:32 STEP 1386 H= 346:30 +CPU= 32.592
  20:53:05 STEP 1387 H= 346:45 +CPU= 32.502
  20:53:40 STEP 1388 H= 347:00 +CPU= 33.382
  20:54:13 STEP 1389 H= 347:15 +CPU= 32.892
  20:54:47 STEP 1390 H= 347:30 +CPU= 32.430
  20:55:20 STEP 1391 H= 347:45 +CPU= 32.722
  20:56:07 STEP 1392 H= 348:00 +CPU= 45.612
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001392
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001392
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001392
  20:56:39 STEP 1393 H= 348:15 +CPU= 31.717
  20:57:12 STEP 1394 H= 348:30 +CPU= 31.492
  20:57:44 STEP 1395 H= 348:45 +CPU= 31.711
  20:58:17 STEP 1396 H= 349:00 +CPU= 32.173
  20:58:50 STEP 1397 H= 349:15 +CPU= 31.503
  20:59:22 STEP 1398 H= 349:30 +CPU= 31.681
  20:59:55 STEP 1399 H= 349:45 +CPU= 31.765
  21:00:28 STEP 1400 H= 350:00 +CPU= 32.904
  21:01:02 STEP 1401 H= 350:15 +CPU= 32.813
  21:01:34 STEP 1402 H= 350:30 +CPU= 32.088
  21:02:08 STEP 1403 H= 350:45 +CPU= 32.820
  21:02:49 STEP 1404 H= 351:00 +CPU= 40.062
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001404
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001404
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001404
  21:03:22 STEP 1405 H= 351:15 +CPU= 32.206
  21:03:55 STEP 1406 H= 351:30 +CPU= 32.458
  21:04:28 STEP 1407 H= 351:45 +CPU= 32.453
  21:05:01 STEP 1408 H= 352:00 +CPU= 33.084
  21:05:35 STEP 1409 H= 352:15 +CPU= 32.844
  21:06:07 STEP 1410 H= 352:30 +CPU= 32.024
  21:06:40 STEP 1411 H= 352:45 +CPU= 32.510
  21:07:14 STEP 1412 H= 353:00 +CPU= 32.569
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:09:48 STEP 1413 H= 353:15 +CPU= 31.960
  21:10:21 STEP 1414 H= 353:30 +CPU= 32.238
  21:10:54 STEP 1415 H= 353:45 +CPU= 31.812
  21:11:35 STEP 1416 H= 354:00 +CPU= 40.644
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001416
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001416
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001416
  21:12:08 STEP 1417 H= 354:15 +CPU= 31.680
  21:12:41 STEP 1418 H= 354:30 +CPU= 32.719
  21:13:13 STEP 1419 H= 354:45 +CPU= 31.719
  21:13:46 STEP 1420 H= 355:00 +CPU= 32.408
  21:14:19 STEP 1421 H= 355:15 +CPU= 32.460
  21:14:52 STEP 1422 H= 355:30 +CPU= 32.555
  21:15:25 STEP 1423 H= 355:45 +CPU= 32.666
  21:15:58 STEP 1424 H= 356:00 +CPU= 32.957
  21:16:31 STEP 1425 H= 356:15 +CPU= 32.468
  21:17:04 STEP 1426 H= 356:30 +CPU= 32.263
  21:17:37 STEP 1427 H= 356:45 +CPU= 32.734
  21:18:19 STEP 1428 H= 357:00 +CPU= 40.742
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001428
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001428
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001428
  21:18:52 STEP 1429 H= 357:15 +CPU= 32.447
  21:19:24 STEP 1430 H= 357:30 +CPU= 32.240
  21:19:57 STEP 1431 H= 357:45 +CPU= 32.155
  21:20:30 STEP 1432 H= 358:00 +CPU= 32.778
  21:21:03 STEP 1433 H= 358:15 +CPU= 32.052
  21:21:35 STEP 1434 H= 358:30 +CPU= 31.858
  21:22:07 STEP 1435 H= 358:45 +CPU= 32.136
  21:22:41 STEP 1436 H= 359:00 +CPU= 33.234
  21:23:14 STEP 1437 H= 359:15 +CPU= 32.008
  21:23:47 STEP 1438 H= 359:30 +CPU= 32.691
  21:24:20 STEP 1439 H= 359:45 +CPU= 31.980
  21:25:02 STEP 1440 H= 360:00 +CPU= 41.771
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.4579105826E-21      I       0.5910865920E-06      I
ICloud fractionI      0.0000000000E+00      I       0.7191204591E-02      I
I  Relat. Hum. I      0.5063556821E+00      I       0.5164018213E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.1314491920E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    294728276 BYTES IN      7 RECORDS TRANSFERRED IN    0.0005 SECONDS589456.6 Mbytes/s, TOTAL TIME=    0.0090( 5.6%)
 21:25:02 STEP 1440 H= 360:00 +CPU= 41.771
 END CNT3
 NSTEP =  1440 CNT0   000000000  30.207  30.207  30.690   0.984               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN        12870/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    228    0       46      1044068    12870 ************    38.9     6.8    32.1     7.7    61.9
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.98      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  469   33712.9   33712.9     32.24      0.00
   9 SPCM     - SPECTRAL COMP.                     432   34124.2   34124.2     30.06      0.00
  10 SCAN2M - PHYSICS                              433   26763.1   26763.1     23.63      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 36    1422.1    1422.1      0.10      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 19      44.9      44.9      0.00      0.00
  17 GRIDFPOS IN CNT4                               36      32.1      32.1      0.00      0.00
  27 RESTART FILES - WRITING                         9    5685.9    5685.9      0.10      0.00
  28 RESTART FILES - READING                         1    8644.1    8644.1      0.02      0.00
  29 SU4FPOS IN CNT4                                36       0.5       0.5      0.00      0.00
  30 DYNFPOS IN CNT4                                36    7381.0    7381.0      0.54      0.00
  31 POSDDH IN STEPO                                 2       8.8       8.8      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    433   11233.7   11233.7      9.92      0.00
  39 SU0YOMB                                         1     511.1     511.1      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    433      23.0      23.0      0.02      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              432     323.7     323.7      0.29      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              432      74.1      74.1      0.07      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 19       1.2       1.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      940     573.4     573.4      1.10      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       900     323.0     323.0      0.59      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        900     120.0     120.0      0.22      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       940     159.0     159.0      0.30      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      45.5      45.5      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            940     392.9     392.9      0.75      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            900      39.2      39.2      0.07      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            940      70.4      70.4      0.13      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            900      20.3      20.3      0.04      0.00
 400 GSTATS                                      51056       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 47450       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    49046.3 CPU TIME   14417.0 VECTOR TIME    14417.0


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       26.4
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMGGh7zg+001440
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMSHh7zg+001440
Moving to projects directory: /data/boinc/boinc-client/slots/5/ICMUAh7zg+001440
Adding to the zip: /data/boinc/boinc-client/slots/5/NODE.001_01
Adding to the zip: /data/boinc/boinc-client/slots/5/ifs.stat
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001404
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001440
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001392
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001428
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001392
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001440
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001380
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001368
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001356
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001368
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001344
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001416
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001380
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001356
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001368
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001428
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001380
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001404
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001416
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001404
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001392
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001416
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001428
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001344
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMUAh7zg+001440
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMGGh7zg+001356
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283289/ICMSHh7zg+001344
Zipping up the final file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a14m_2016092300_20_1017_12283289_0_r863704960_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
21:28:36 (20250): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a14m_2016092300_20_1017_12283289_0_r863704960_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a14m_2016092300_20_1017_12283289_0_r863704960_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a14m_2016092300_20_1017_12283289_0_r863704960_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a14m_2016092300_20_1017_12283289_0_r863704960_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a14m_2016092300_20_1017_12283289_0_r863704960_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
11 Jun 2024 20:45:11 1478188 22434866 oifs_43r3_bl_a14m_2016092300_20_1017_12283289_0 1,295,100 50,038 0.0386


©2024 cpdn.org