climateprediction.net home page
Task 22436567

Task 22436567

Name oifs_43r3_bl_a2fh_2016092300_20_1017_12284976_0
Workunit 12284976
Created 7 Jun 2024, 15:23:56 UTC
Sent 7 Jun 2024, 16:47:33 UTC
Report deadline 6 Aug 2024, 16:47:33 UTC
Received 14 Jun 2024, 18:34:48 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1548201
Run time 3 hours 54 min 22 sec
CPU time 3 hours 54 min 22 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 8.89 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,438.23 MB
Peak swap size 5,980.80 MB
Peak disk usage 1,381.77 MB
Stderr
<core_client_version>7.24.1</core_client_version>
<![CDATA[
<stderr_txt>
2449f885225475e to: /var/lib/boinc/slots/5/oifs_43r3_bl_a2fh_2016092300_20_1017_12284976.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/5/oifs_43r3_bl_a2fh_2016092300_20_1017_12284976.zip
ic_ancil_file: ic_ancil_12284976
ifsdata_file: ifsdata_12284976
climate_data_file: clim_data_12284976
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc/slots/5/ic_ancil_12284976.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/5/ic_ancil_12284976.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_0ba2dcba04a23fabdf57e369a137a400 to: /var/lib/boinc/slots/5/ifsdata/ifsdata_12284976.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/5/ifsdata/ifsdata_12284976.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/5/159l_2/clim_data_12284976.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/5/159l_2/clim_data_12284976.zip
Checking for progress XML file: /var/lib/boinc/slots/5/progress_file_12284976.xml
Opened progress file ok : /var/lib/boinc/slots/5/progress_file_12284976.xml
-- Model is restarting --
Adjusting last_iter, 956, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/5/progress_file_12284976.xml
last_cpu_time: 8944
upload_file_number: 9
last_iter: 913
last_upload: 777600
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a2fh_2016092300_20_1017_12284976_0_r410186998
The child process has been launched with process id: 16299
Executing the command: /var/lib/boinc/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:MadCat3:1:1:16299:16299] [20240613:200225:1718301745:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:02:57 STEP  912 H= 228:00 +CPU=  9.199
  20:03:06 STEP  913 H= 228:15 +CPU=  8.847
  20:03:15 STEP  914 H= 228:30 +CPU=  8.938
  20:03:24 STEP  915 H= 228:45 +CPU=  8.976
  20:03:34 STEP  916 H= 229:00 +CPU=  9.423
  20:03:43 STEP  917 H= 229:15 +CPU=  8.978
  20:03:51 STEP  918 H= 229:30 +CPU=  8.866
  20:04:00 STEP  919 H= 229:45 +CPU=  8.864
  20:04:10 STEP  920 H= 230:00 +CPU=  9.274
  20:04:19 STEP  921 H= 230:15 +CPU=  8.899
  20:04:27 STEP  922 H= 230:30 +CPU=  8.799
  20:04:36 STEP  923 H= 230:45 +CPU=  8.884
  20:04:48 STEP  924 H= 231:00 +CPU= 11.880
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000924
  20:04:57 STEP  925 H= 231:15 +CPU=  8.957
  20:05:06 STEP  926 H= 231:30 +CPU=  8.871
  20:05:15 STEP  927 H= 231:45 +CPU=  8.848
  20:05:24 STEP  928 H= 232:00 +CPU=  9.262
  20:05:33 STEP  929 H= 232:15 +CPU=  8.919
  20:05:42 STEP  930 H= 232:30 +CPU=  8.779
  20:05:51 STEP  931 H= 232:45 +CPU=  8.927
  20:06:00 STEP  932 H= 233:00 +CPU=  9.147
  20:06:09 STEP  933 H= 233:15 +CPU=  8.827
  20:06:18 STEP  934 H= 233:30 +CPU=  8.893
  20:06:27 STEP  935 H= 233:45 +CPU=  8.816
  20:06:39 STEP  936 H= 234:00 +CPU= 11.810
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000936
  20:06:47 STEP  937 H= 234:15 +CPU=  8.814
  20:06:56 STEP  938 H= 234:30 +CPU=  8.966
  20:07:05 STEP  939 H= 234:45 +CPU=  8.901
  20:07:15 STEP  940 H= 235:00 +CPU=  9.228
  20:07:24 STEP  941 H= 235:15 +CPU=  8.996
  20:07:33 STEP  942 H= 235:30 +CPU=  8.971
  20:07:41 STEP  943 H= 235:45 +CPU=  8.902
  20:07:51 STEP  944 H= 236:00 +CPU=  9.310
  20:08:00 STEP  945 H= 236:15 +CPU=  9.087
  20:08:09 STEP  946 H= 236:30 +CPU=  8.833
  20:08:18 STEP  947 H= 236:45 +CPU=  8.958
  20:08:30 STEP  948 H= 237:00 +CPU= 11.840
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000948
  20:08:38 STEP  949 H= 237:15 +CPU=  8.856
  20:08:47 STEP  950 H= 237:30 +CPU=  8.848
  20:08:56 STEP  951 H= 237:45 +CPU=  8.850
  20:09:05 STEP  952 H= 238:00 +CPU=  9.202
  20:09:14 STEP  953 H= 238:15 +CPU=  8.948
  20:09:23 STEP  954 H= 238:30 +CPU=  8.790
  20:09:32 STEP  955 H= 238:45 +CPU=  8.900
  20:09:41 STEP  956 H= 239:00 +CPU=  9.198
  20:09:50 STEP  957 H= 239:15 +CPU=  9.021
  20:09:59 STEP  958 H= 239:30 +CPU=  8.893
  20:10:08 STEP  959 H= 239:45 +CPU=  9.002
  20:10:22 STEP  960 H= 240:00 +CPU= 13.225
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2fh_2016092300_20_1017_12284976_0_r410186998_9.zip
  20:10:31 STEP  961 H= 240:15 +CPU=  8.958
Uploading the intermediate file: upload_file_9.zip
  20:10:40 STEP  962 H= 240:30 +CPU=  8.960
  20:10:48 STEP  963 H= 240:45 +CPU=  8.835
  20:10:58 STEP  964 H= 241:00 +CPU=  9.236
  20:11:07 STEP  965 H= 241:15 +CPU=  8.941
  20:11:16 STEP  966 H= 241:30 +CPU=  8.911
  20:11:25 STEP  967 H= 241:45 +CPU=  8.877
  20:11:34 STEP  968 H= 242:00 +CPU=  9.240
  20:11:43 STEP  969 H= 242:15 +CPU=  8.904
  20:11:52 STEP  970 H= 242:30 +CPU=  9.008
  20:12:01 STEP  971 H= 242:45 +CPU=  8.890
  20:12:12 STEP  972 H= 243:00 +CPU= 11.713
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000972
  20:12:21 STEP  973 H= 243:15 +CPU=  8.966
  20:12:31 STEP  974 H= 243:30 +CPU=  9.096
  20:12:39 STEP  975 H= 243:45 +CPU=  8.939
  20:12:49 STEP  976 H= 244:00 +CPU=  9.403
  20:12:58 STEP  977 H= 244:15 +CPU=  8.905
  20:13:07 STEP  978 H= 244:30 +CPU=  8.955
  20:13:16 STEP  979 H= 244:45 +CPU=  8.897
  20:13:25 STEP  980 H= 245:00 +CPU=  9.158
  20:13:34 STEP  981 H= 245:15 +CPU=  8.871
  20:13:43 STEP  982 H= 245:30 +CPU=  8.915
  20:13:52 STEP  983 H= 245:45 +CPU=  9.080
  20:14:04 STEP  984 H= 246:00 +CPU= 12.117
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000984
  20:14:13 STEP  985 H= 246:15 +CPU=  8.982
  20:14:22 STEP  986 H= 246:30 +CPU=  9.001
  20:14:31 STEP  987 H= 246:45 +CPU=  8.904
  20:14:40 STEP  988 H= 247:00 +CPU=  9.467
  20:14:49 STEP  989 H= 247:15 +CPU=  8.980
  20:14:58 STEP  990 H= 247:30 +CPU=  8.987
  20:15:07 STEP  991 H= 247:45 +CPU=  8.958
  20:15:17 STEP  992 H= 248:00 +CPU=  9.372
  20:15:26 STEP  993 H= 248:15 +CPU=  9.180
  20:15:35 STEP  994 H= 248:30 +CPU=  8.921
  20:15:44 STEP  995 H= 248:45 +CPU=  9.032
  20:15:56 STEP  996 H= 249:00 +CPU= 11.952
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000996
  20:16:05 STEP  997 H= 249:15 +CPU=  9.005
  20:16:14 STEP  998 H= 249:30 +CPU=  9.074
  20:16:23 STEP  999 H= 249:45 +CPU=  9.042
  20:16:33 STEP 1000 H= 250:00 +CPU=  9.370
  20:16:42 STEP 1001 H= 250:15 +CPU=  9.087
  20:16:51 STEP 1002 H= 250:30 +CPU=  9.102
  20:17:00 STEP 1003 H= 250:45 +CPU=  9.077
  20:17:09 STEP 1004 H= 251:00 +CPU=  9.376
  20:17:18 STEP 1005 H= 251:15 +CPU=  8.939
  20:17:28 STEP 1006 H= 251:30 +CPU=  9.136
  20:17:37 STEP 1007 H= 251:45 +CPU=  8.925
  20:17:50 STEP 1008 H= 252:00 +CPU= 13.266
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001008
  20:17:59 STEP 1009 H= 252:15 +CPU=  9.072
  20:18:08 STEP 1010 H= 252:30 +CPU=  9.089
  20:18:17 STEP 1011 H= 252:45 +CPU=  9.026
  20:18:27 STEP 1012 H= 253:00 +CPU=  9.447
  20:18:36 STEP 1013 H= 253:15 +CPU=  9.044
  20:18:45 STEP 1014 H= 253:30 +CPU=  8.972
  20:18:54 STEP 1015 H= 253:45 +CPU=  9.013
  20:19:03 STEP 1016 H= 254:00 +CPU=  9.389
  20:19:12 STEP 1017 H= 254:15 +CPU=  9.013
  20:19:21 STEP 1018 H= 254:30 +CPU=  8.910
  20:19:30 STEP 1019 H= 254:45 +CPU=  8.967
  20:19:42 STEP 1020 H= 255:00 +CPU= 11.770
  20:19:51 STEP 1021 H= 255:15 +CPU=  8.977
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001020
  20:20:00 STEP 1022 H= 255:30 +CPU=  8.994
  20:20:09 STEP 1023 H= 255:45 +CPU=  9.032
  20:20:18 STEP 1024 H= 256:00 +CPU=  9.302
  20:20:28 STEP 1025 H= 256:15 +CPU=  9.296
  20:20:37 STEP 1026 H= 256:30 +CPU=  9.283
  20:20:46 STEP 1027 H= 256:45 +CPU=  9.162
  20:20:56 STEP 1028 H= 257:00 +CPU=  9.417
  20:21:05 STEP 1029 H= 257:15 +CPU=  8.959
  20:21:14 STEP 1030 H= 257:30 +CPU=  9.018
  20:21:23 STEP 1031 H= 257:45 +CPU=  8.936
  20:21:35 STEP 1032 H= 258:00 +CPU= 11.894
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001032
  20:21:44 STEP 1033 H= 258:15 +CPU=  9.070
  20:21:53 STEP 1034 H= 258:30 +CPU=  9.045
  20:22:02 STEP 1035 H= 258:45 +CPU=  9.021
  20:22:11 STEP 1036 H= 259:00 +CPU=  9.478
  20:22:20 STEP 1037 H= 259:15 +CPU=  9.077
  20:22:29 STEP 1038 H= 259:30 +CPU=  9.045
  20:22:38 STEP 1039 H= 259:45 +CPU=  9.014
  20:22:48 STEP 1040 H= 260:00 +CPU=  9.286
  20:22:57 STEP 1041 H= 260:15 +CPU=  8.990
  20:23:06 STEP 1042 H= 260:30 +CPU=  8.991
  20:23:15 STEP 1043 H= 260:45 +CPU=  8.884
  20:23:27 STEP 1044 H= 261:00 +CPU= 12.033
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001044
  20:23:36 STEP 1045 H= 261:15 +CPU=  8.969
  20:23:45 STEP 1046 H= 261:30 +CPU=  9.041
  20:23:54 STEP 1047 H= 261:45 +CPU=  9.099
  20:24:03 STEP 1048 H= 262:00 +CPU=  9.432
  20:24:12 STEP 1049 H= 262:15 +CPU=  8.994
  20:24:21 STEP 1050 H= 262:30 +CPU=  8.925
  20:24:30 STEP 1051 H= 262:45 +CPU=  8.962
  20:24:40 STEP 1052 H= 263:00 +CPU=  9.259
  20:24:49 STEP 1053 H= 263:15 +CPU=  9.074
  20:24:58 STEP 1054 H= 263:30 +CPU=  8.974
  20:25:07 STEP 1055 H= 263:45 +CPU=  9.097
  20:25:21 STEP 1056 H= 264:00 +CPU= 13.626
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2fh_2016092300_20_1017_12284976_0_r410186998_10.zip
Uploading the intermediate file: upload_file_10.zip
  20:25:30 STEP 1057 H= 264:15 +CPU=  9.204
  20:25:39 STEP 1058 H= 264:30 +CPU=  9.169
  20:25:48 STEP 1059 H= 264:45 +CPU=  9.104
  20:25:58 STEP 1060 H= 265:00 +CPU=  9.399
  20:26:07 STEP 1061 H= 265:15 +CPU=  8.887
  20:26:15 STEP 1062 H= 265:30 +CPU=  8.875
  20:26:24 STEP 1063 H= 265:45 +CPU=  8.824
  20:26:34 STEP 1064 H= 266:00 +CPU=  9.283
  20:26:42 STEP 1065 H= 266:15 +CPU=  8.800
  20:26:51 STEP 1066 H= 266:30 +CPU=  8.923
  20:27:01 STEP 1067 H= 266:45 +CPU=  9.055
  20:27:12 STEP 1068 H= 267:00 +CPU= 11.891
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001068
  20:27:21 STEP 1069 H= 267:15 +CPU=  8.951
  20:27:30 STEP 1070 H= 267:30 +CPU=  8.960
  20:27:39 STEP 1071 H= 267:45 +CPU=  8.859
  20:27:49 STEP 1072 H= 268:00 +CPU=  9.317
  20:27:58 STEP 1073 H= 268:15 +CPU=  8.902
  20:28:06 STEP 1074 H= 268:30 +CPU=  8.890
  20:28:15 STEP 1075 H= 268:45 +CPU=  8.918
  20:28:25 STEP 1076 H= 269:00 +CPU=  9.401
  20:28:34 STEP 1077 H= 269:15 +CPU=  9.059
  20:28:43 STEP 1078 H= 269:30 +CPU=  9.029
  20:28:52 STEP 1079 H= 269:45 +CPU=  8.933
  20:29:04 STEP 1080 H= 270:00 +CPU= 11.815
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001080
  20:29:13 STEP 1081 H= 270:15 +CPU=  8.852
  20:29:21 STEP 1082 H= 270:30 +CPU=  8.848
  20:29:30 STEP 1083 H= 270:45 +CPU=  8.826
  20:29:40 STEP 1084 H= 271:00 +CPU=  9.249
  20:29:49 STEP 1085 H= 271:15 +CPU=  8.944
  20:29:58 STEP 1086 H= 271:30 +CPU=  8.966
  20:30:07 STEP 1087 H= 271:45 +CPU=  9.051
  20:30:16 STEP 1088 H= 272:00 +CPU=  9.248
  20:30:25 STEP 1089 H= 272:15 +CPU=  8.950
  20:30:34 STEP 1090 H= 272:30 +CPU=  8.948
  20:30:43 STEP 1091 H= 272:45 +CPU=  8.971
  20:30:55 STEP 1092 H= 273:00 +CPU= 11.789
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001092
  20:31:04 STEP 1093 H= 273:15 +CPU=  8.992
  20:31:13 STEP 1094 H= 273:30 +CPU=  8.969
  20:31:22 STEP 1095 H= 273:45 +CPU=  9.024
  20:31:31 STEP 1096 H= 274:00 +CPU=  9.383
  20:31:40 STEP 1097 H= 274:15 +CPU=  9.089
  20:31:49 STEP 1098 H= 274:30 +CPU=  9.055
  20:31:58 STEP 1099 H= 274:45 +CPU=  9.081
  20:32:08 STEP 1100 H= 275:00 +CPU=  9.332
  20:32:17 STEP 1101 H= 275:15 +CPU=  9.056
  20:32:26 STEP 1102 H= 275:30 +CPU=  8.925
  20:32:35 STEP 1103 H= 275:45 +CPU=  8.967
  20:32:48 STEP 1104 H= 276:00 +CPU= 13.251
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001104
  20:32:57 STEP 1105 H= 276:15 +CPU=  8.879
  20:33:06 STEP 1106 H= 276:30 +CPU=  8.981
  20:33:15 STEP 1107 H= 276:45 +CPU=  8.964
  20:33:24 STEP 1108 H= 277:00 +CPU=  9.335
  20:33:33 STEP 1109 H= 277:15 +CPU=  8.982
  20:33:42 STEP 1110 H= 277:30 +CPU=  8.860
  20:33:51 STEP 1111 H= 277:45 +CPU=  8.954
  20:34:01 STEP 1112 H= 278:00 +CPU=  9.370
  20:34:10 STEP 1113 H= 278:15 +CPU=  8.937
  20:34:19 STEP 1114 H= 278:30 +CPU=  8.987
  20:34:28 STEP 1115 H= 278:45 +CPU=  8.886
  20:34:39 STEP 1116 H= 279:00 +CPU= 11.837
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001116
  20:34:48 STEP 1117 H= 279:15 +CPU=  8.930
  20:34:57 STEP 1118 H= 279:30 +CPU=  8.917
  20:35:06 STEP 1119 H= 279:45 +CPU=  8.989
  20:35:16 STEP 1120 H= 280:00 +CPU=  9.332
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:35:46 STEP 1121 H= 280:15 +CPU=  8.887
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:04:15 STEP 1122 H= 280:30 +CPU=  9.686
  00:04:25 STEP 1123 H= 280:45 +CPU=  9.569
  00:04:35 STEP 1124 H= 281:00 +CPU= 10.050
  00:04:45 STEP 1125 H= 281:15 +CPU=  9.598
  00:04:54 STEP 1126 H= 281:30 +CPU=  9.593
  00:05:03 STEP 1127 H= 281:45 +CPU=  9.137
  00:05:16 STEP 1128 H= 282:00 +CPU= 12.536
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001128
  00:05:25 STEP 1129 H= 282:15 +CPU=  9.417
  00:05:35 STEP 1130 H= 282:30 +CPU=  9.337
  00:05:45 STEP 1131 H= 282:45 +CPU=  9.749
  00:05:54 STEP 1132 H= 283:00 +CPU=  9.776
  00:06:04 STEP 1133 H= 283:15 +CPU=  9.450
  00:06:13 STEP 1134 H= 283:30 +CPU=  9.443
  00:06:23 STEP 1135 H= 283:45 +CPU=  9.444
  00:06:33 STEP 1136 H= 284:00 +CPU=  9.948
  00:06:42 STEP 1137 H= 284:15 +CPU=  9.536
  00:06:52 STEP 1138 H= 284:30 +CPU=  9.439
  00:07:02 STEP 1139 H= 284:45 +CPU=  9.538
  00:07:15 STEP 1140 H= 285:00 +CPU= 13.073
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001140
  00:07:24 STEP 1141 H= 285:15 +CPU=  9.343
  00:07:33 STEP 1142 H= 285:30 +CPU=  9.222
  00:07:43 STEP 1143 H= 285:45 +CPU=  9.335
  00:07:52 STEP 1144 H= 286:00 +CPU=  9.645
  00:08:02 STEP 1145 H= 286:15 +CPU=  9.365
  00:08:12 STEP 1146 H= 286:30 +CPU=  9.851
  00:08:21 STEP 1147 H= 286:45 +CPU=  9.356
  00:08:31 STEP 1148 H= 287:00 +CPU=  9.836
  00:08:40 STEP 1149 H= 287:15 +CPU=  9.449
  00:08:50 STEP 1150 H= 287:30 +CPU=  9.599
  00:09:00 STEP 1151 H= 287:45 +CPU=  9.591
  00:09:14 STEP 1152 H= 288:00 +CPU= 13.917
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2fh_2016092300_20_1017_12284976_0_r410186998_11.zip
Uploading the intermediate file: upload_file_11.zip
  00:09:23 STEP 1153 H= 288:15 +CPU=  9.560
  00:09:33 STEP 1154 H= 288:30 +CPU=  9.412
  00:09:42 STEP 1155 H= 288:45 +CPU=  9.644
  00:09:52 STEP 1156 H= 289:00 +CPU=  9.767
  00:10:02 STEP 1157 H= 289:15 +CPU=  9.391
  00:10:11 STEP 1158 H= 289:30 +CPU=  9.390
  00:10:20 STEP 1159 H= 289:45 +CPU=  9.392
  00:10:30 STEP 1160 H= 290:00 +CPU=  9.739
  00:10:39 STEP 1161 H= 290:15 +CPU=  9.125
  00:10:49 STEP 1162 H= 290:30 +CPU=  9.383
  00:10:58 STEP 1163 H= 290:45 +CPU=  9.337
  00:11:10 STEP 1164 H= 291:00 +CPU= 12.241
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001164
  00:11:20 STEP 1165 H= 291:15 +CPU=  9.216
  00:11:29 STEP 1166 H= 291:30 +CPU=  9.381
  00:11:38 STEP 1167 H= 291:45 +CPU=  9.367
  00:11:48 STEP 1168 H= 292:00 +CPU=  9.729
  00:11:58 STEP 1169 H= 292:15 +CPU=  9.480
  00:12:07 STEP 1170 H= 292:30 +CPU=  9.312
  00:12:17 STEP 1171 H= 292:45 +CPU=  9.642
  00:12:27 STEP 1172 H= 293:00 +CPU=  9.798
  00:12:36 STEP 1173 H= 293:15 +CPU=  9.179
  00:12:45 STEP 1174 H= 293:30 +CPU=  9.324
  00:12:55 STEP 1175 H= 293:45 +CPU=  9.409
  00:13:07 STEP 1176 H= 294:00 +CPU= 12.226
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001176
  00:13:16 STEP 1177 H= 294:15 +CPU=  9.315
  00:13:26 STEP 1178 H= 294:30 +CPU=  9.384
  00:13:35 STEP 1179 H= 294:45 +CPU=  9.242
  00:13:45 STEP 1180 H= 295:00 +CPU=  9.698
  00:13:54 STEP 1181 H= 295:15 +CPU=  9.263
  00:14:03 STEP 1182 H= 295:30 +CPU=  9.321
  00:14:13 STEP 1183 H= 295:45 +CPU=  9.488
  00:14:23 STEP 1184 H= 296:00 +CPU=  9.868
  00:14:32 STEP 1185 H= 296:15 +CPU=  9.542
  00:14:42 STEP 1186 H= 296:30 +CPU=  9.387
  00:14:51 STEP 1187 H= 296:45 +CPU=  9.387
  00:15:04 STEP 1188 H= 297:00 +CPU= 12.385
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001188
  00:15:13 STEP 1189 H= 297:15 +CPU=  9.324
  00:15:22 STEP 1190 H= 297:30 +CPU=  9.340
  00:15:32 STEP 1191 H= 297:45 +CPU=  9.324
  00:15:42 STEP 1192 H= 298:00 +CPU=  9.876
  00:15:51 STEP 1193 H= 298:15 +CPU=  9.583
  00:16:01 STEP 1194 H= 298:30 +CPU=  9.427
  00:16:10 STEP 1195 H= 298:45 +CPU=  9.252
  00:16:20 STEP 1196 H= 299:00 +CPU=  9.671
  00:16:29 STEP 1197 H= 299:15 +CPU=  9.380
  00:16:38 STEP 1198 H= 299:30 +CPU=  9.283
  00:16:48 STEP 1199 H= 299:45 +CPU=  9.199
  00:17:02 STEP 1200 H= 300:00 +CPU= 14.011
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001200
  00:17:11 STEP 1201 H= 300:15 +CPU=  9.367
  00:17:21 STEP 1202 H= 300:30 +CPU=  9.647
  00:17:30 STEP 1203 H= 300:45 +CPU=  9.312
  00:17:40 STEP 1204 H= 301:00 +CPU=  9.773
  00:17:50 STEP 1205 H= 301:15 +CPU=  9.572
  00:17:59 STEP 1206 H= 301:30 +CPU=  9.223
  00:18:08 STEP 1207 H= 301:45 +CPU=  9.211
  00:18:18 STEP 1208 H= 302:00 +CPU=  9.803
  00:18:27 STEP 1209 H= 302:15 +CPU=  9.278
  00:18:37 STEP 1210 H= 302:30 +CPU=  9.266
  00:18:46 STEP 1211 H= 302:45 +CPU=  9.396
  00:18:58 STEP 1212 H= 303:00 +CPU= 12.281
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001212
  00:19:08 STEP 1213 H= 303:15 +CPU=  9.279
  00:19:17 STEP 1214 H= 303:30 +CPU=  9.322
  00:19:26 STEP 1215 H= 303:45 +CPU=  9.171
  00:19:36 STEP 1216 H= 304:00 +CPU=  9.759
  00:19:46 STEP 1217 H= 304:15 +CPU=  9.451
  00:19:55 STEP 1218 H= 304:30 +CPU=  9.606
  00:20:04 STEP 1219 H= 304:45 +CPU=  9.305
  00:20:14 STEP 1220 H= 305:00 +CPU=  9.868
  00:20:24 STEP 1221 H= 305:15 +CPU=  9.667
  00:20:34 STEP 1222 H= 305:30 +CPU=  9.558
  00:20:43 STEP 1223 H= 305:45 +CPU=  9.593
  00:20:56 STEP 1224 H= 306:00 +CPU= 12.415
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001224
  00:21:05 STEP 1225 H= 306:15 +CPU=  9.301
  00:21:14 STEP 1226 H= 306:30 +CPU=  9.227
  00:21:24 STEP 1227 H= 306:45 +CPU=  9.458
  00:21:34 STEP 1228 H= 307:00 +CPU=  9.772
  00:21:43 STEP 1229 H= 307:15 +CPU=  9.357
  00:21:53 STEP 1230 H= 307:30 +CPU=  9.363
  00:22:02 STEP 1231 H= 307:45 +CPU=  9.442
  00:22:12 STEP 1232 H= 308:00 +CPU=  9.737
  00:22:21 STEP 1233 H= 308:15 +CPU=  9.236
  00:22:31 STEP 1234 H= 308:30 +CPU=  9.533
  00:22:40 STEP 1235 H= 308:45 +CPU=  9.310
  00:22:52 STEP 1236 H= 309:00 +CPU= 12.258
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001236
  00:23:02 STEP 1237 H= 309:15 +CPU=  9.308
  00:23:11 STEP 1238 H= 309:30 +CPU=  9.647
  00:23:21 STEP 1239 H= 309:45 +CPU=  9.418
  00:23:31 STEP 1240 H= 310:00 +CPU=  9.733
  00:23:40 STEP 1241 H= 310:15 +CPU=  9.301
  00:23:49 STEP 1242 H= 310:30 +CPU=  9.306
  00:23:59 STEP 1243 H= 310:45 +CPU=  9.673
  00:24:09 STEP 1244 H= 311:00 +CPU=  9.945
  00:24:18 STEP 1245 H= 311:15 +CPU=  9.181
  00:24:27 STEP 1246 H= 311:30 +CPU=  9.082
  00:24:36 STEP 1247 H= 311:45 +CPU=  9.056
  00:24:50 STEP 1248 H= 312:00 +CPU= 13.554
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2fh_2016092300_20_1017_12284976_0_r410186998_12.zip
Uploading the intermediate file: upload_file_12.zip
  00:24:59 STEP 1249 H= 312:15 +CPU=  9.275
  00:25:09 STEP 1250 H= 312:30 +CPU=  9.254
  00:25:18 STEP 1251 H= 312:45 +CPU=  9.254
  00:25:27 STEP 1252 H= 313:00 +CPU=  9.505
  00:25:37 STEP 1253 H= 313:15 +CPU=  9.804
  00:25:47 STEP 1254 H= 313:30 +CPU=  9.880
  00:25:57 STEP 1255 H= 313:45 +CPU=  9.901
  00:26:08 STEP 1256 H= 314:00 +CPU= 10.771
  00:26:18 STEP 1257 H= 314:15 +CPU=  9.751
  00:26:27 STEP 1258 H= 314:30 +CPU=  9.574
  00:26:37 STEP 1259 H= 314:45 +CPU=  9.443
  00:26:49 STEP 1260 H= 315:00 +CPU= 12.316
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001260
  00:26:59 STEP 1261 H= 315:15 +CPU=  9.400
  00:27:09 STEP 1262 H= 315:30 +CPU=  9.804
  00:27:18 STEP 1263 H= 315:45 +CPU=  9.450
  00:27:28 STEP 1264 H= 316:00 +CPU=  9.892
  00:27:37 STEP 1265 H= 316:15 +CPU=  9.357
  00:27:47 STEP 1266 H= 316:30 +CPU=  9.280
  00:27:56 STEP 1267 H= 316:45 +CPU=  9.302
  00:28:06 STEP 1268 H= 317:00 +CPU=  9.562
  00:28:15 STEP 1269 H= 317:15 +CPU=  9.107
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:35:44 STEP 1270 H= 317:30 +CPU=  9.346
  00:35:54 STEP 1271 H= 317:45 +CPU=  9.595
  00:36:07 STEP 1272 H= 318:00 +CPU= 12.450
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001272
  00:36:16 STEP 1273 H= 318:15 +CPU=  9.700
  00:36:26 STEP 1274 H= 318:30 +CPU=  9.604
  00:36:36 STEP 1275 H= 318:45 +CPU=  9.698
  00:36:46 STEP 1276 H= 319:00 +CPU=  9.942
  00:36:55 STEP 1277 H= 319:15 +CPU=  9.516
  00:37:05 STEP 1278 H= 319:30 +CPU=  9.592
  00:37:14 STEP 1279 H= 319:45 +CPU=  9.631
  00:37:24 STEP 1280 H= 320:00 +CPU=  9.862
  00:37:34 STEP 1281 H= 320:15 +CPU=  9.645
  00:37:44 STEP 1282 H= 320:30 +CPU=  9.779
  00:37:54 STEP 1283 H= 320:45 +CPU=  9.727
  00:38:06 STEP 1284 H= 321:00 +CPU= 12.842
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001284
  00:38:16 STEP 1285 H= 321:15 +CPU=  9.792
  00:38:26 STEP 1286 H= 321:30 +CPU=  9.533
  00:38:36 STEP 1287 H= 321:45 +CPU=  9.664
  00:38:46 STEP 1288 H= 322:00 +CPU=  9.909
  00:38:55 STEP 1289 H= 322:15 +CPU=  9.585
  00:39:05 STEP 1290 H= 322:30 +CPU=  9.590
  00:39:15 STEP 1291 H= 322:45 +CPU=  9.727
  00:39:25 STEP 1292 H= 323:00 +CPU= 10.094
  00:39:34 STEP 1293 H= 323:15 +CPU=  9.613
  00:39:44 STEP 1294 H= 323:30 +CPU=  9.689
  00:39:54 STEP 1295 H= 323:45 +CPU=  9.863
  00:40:08 STEP 1296 H= 324:00 +CPU= 14.175
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001296
  00:40:18 STEP 1297 H= 324:15 +CPU=  9.667
  00:40:27 STEP 1298 H= 324:30 +CPU=  9.299
  00:40:37 STEP 1299 H= 324:45 +CPU=  9.623
  00:40:47 STEP 1300 H= 325:00 +CPU=  9.799
  00:40:56 STEP 1301 H= 325:15 +CPU=  9.642
  00:41:06 STEP 1302 H= 325:30 +CPU=  9.521
  00:41:16 STEP 1303 H= 325:45 +CPU=  9.648
  00:41:26 STEP 1304 H= 326:00 +CPU=  9.885
  00:41:35 STEP 1305 H= 326:15 +CPU=  9.408
  00:41:45 STEP 1306 H= 326:30 +CPU=  9.499
  00:41:54 STEP 1307 H= 326:45 +CPU=  9.546
  00:42:07 STEP 1308 H= 327:00 +CPU= 12.494
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001308
  00:42:16 STEP 1309 H= 327:15 +CPU=  9.730
  00:42:26 STEP 1310 H= 327:30 +CPU=  9.659
  00:42:36 STEP 1311 H= 327:45 +CPU=  9.563
  00:42:46 STEP 1312 H= 328:00 +CPU= 10.103
  00:42:56 STEP 1313 H= 328:15 +CPU=  9.740
  00:43:05 STEP 1314 H= 328:30 +CPU=  9.626
  00:43:15 STEP 1315 H= 328:45 +CPU=  9.681
  00:43:25 STEP 1316 H= 329:00 +CPU= 10.216
  00:43:35 STEP 1317 H= 329:15 +CPU=  9.871
  00:43:45 STEP 1318 H= 329:30 +CPU=  9.611
  00:43:54 STEP 1319 H= 329:45 +CPU=  9.484
  00:44:07 STEP 1320 H= 330:00 +CPU= 12.469
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001320
  00:44:17 STEP 1321 H= 330:15 +CPU=  9.701
  00:44:26 STEP 1322 H= 330:30 +CPU=  9.611
  00:44:36 STEP 1323 H= 330:45 +CPU=  9.885
  00:44:47 STEP 1324 H= 331:00 +CPU= 10.272
  00:44:56 STEP 1325 H= 331:15 +CPU=  9.620
  00:45:06 STEP 1326 H= 331:30 +CPU=  9.693
  00:45:16 STEP 1327 H= 331:45 +CPU=  9.676
  00:45:25 STEP 1328 H= 332:00 +CPU=  9.854
  00:45:35 STEP 1329 H= 332:15 +CPU=  9.476
  00:45:45 STEP 1330 H= 332:30 +CPU=  9.626
  00:45:54 STEP 1331 H= 332:45 +CPU=  9.483
  00:46:07 STEP 1332 H= 333:00 +CPU= 12.673
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001332
  00:46:16 STEP 1333 H= 333:15 +CPU=  9.575
  00:46:26 STEP 1334 H= 333:30 +CPU=  9.579
  00:46:36 STEP 1335 H= 333:45 +CPU=  9.718
  00:46:46 STEP 1336 H= 334:00 +CPU= 10.023
  00:46:55 STEP 1337 H= 334:15 +CPU=  9.437
  00:47:05 STEP 1338 H= 334:30 +CPU=  9.498
  00:47:15 STEP 1339 H= 334:45 +CPU=  9.628
  00:47:24 STEP 1340 H= 335:00 +CPU=  9.786
  00:47:34 STEP 1341 H= 335:15 +CPU=  9.442
  00:47:44 STEP 1342 H= 335:30 +CPU=  9.644
  00:47:53 STEP 1343 H= 335:45 +CPU=  9.538
  00:48:07 STEP 1344 H= 336:00 +CPU= 13.808
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2fh_2016092300_20_1017_12284976_0_r410186998_13.zip
Uploading the intermediate file: upload_file_13.zip
  00:48:16 STEP 1345 H= 336:15 +CPU=  9.403
  00:48:26 STEP 1346 H= 336:30 +CPU=  9.509
  00:48:36 STEP 1347 H= 336:45 +CPU=  9.571
  00:48:46 STEP 1348 H= 337:00 +CPU=  9.900
  00:48:55 STEP 1349 H= 337:15 +CPU=  9.535
  00:49:05 STEP 1350 H= 337:30 +CPU=  9.565
  00:49:14 STEP 1351 H= 337:45 +CPU=  9.546
  00:49:24 STEP 1352 H= 338:00 +CPU=  9.833
  00:49:34 STEP 1353 H= 338:15 +CPU=  9.363
  00:49:43 STEP 1354 H= 338:30 +CPU=  9.477
  00:49:53 STEP 1355 H= 338:45 +CPU=  9.636
  00:50:05 STEP 1356 H= 339:00 +CPU= 12.522
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001356
  00:50:15 STEP 1357 H= 339:15 +CPU=  9.721
  00:50:25 STEP 1358 H= 339:30 +CPU=  9.803
  00:50:35 STEP 1359 H= 339:45 +CPU=  9.784
  00:50:45 STEP 1360 H= 340:00 +CPU= 10.011
  00:50:54 STEP 1361 H= 340:15 +CPU=  9.557
  00:51:04 STEP 1362 H= 340:30 +CPU=  9.395
  00:51:14 STEP 1363 H= 340:45 +CPU=  9.763
  00:51:24 STEP 1364 H= 341:00 +CPU= 10.021
  00:51:33 STEP 1365 H= 341:15 +CPU=  9.583
  00:51:43 STEP 1366 H= 341:30 +CPU=  9.598
  00:51:52 STEP 1367 H= 341:45 +CPU=  9.420
  00:52:05 STEP 1368 H= 342:00 +CPU= 12.553
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001368
  00:52:15 STEP 1369 H= 342:15 +CPU=  9.815
  00:52:25 STEP 1370 H= 342:30 +CPU=  9.993
  00:52:35 STEP 1371 H= 342:45 +CPU=  9.829
  00:52:45 STEP 1372 H= 343:00 +CPU= 10.480
  00:52:55 STEP 1373 H= 343:15 +CPU=  9.902
  00:53:05 STEP 1374 H= 343:30 +CPU= 10.065
  00:53:15 STEP 1375 H= 343:45 +CPU=  9.825
  00:53:25 STEP 1376 H= 344:00 +CPU= 10.141
  00:53:35 STEP 1377 H= 344:15 +CPU=  9.801
  00:53:45 STEP 1378 H= 344:30 +CPU=  9.682
  00:53:55 STEP 1379 H= 344:45 +CPU=  9.744
  00:54:08 STEP 1380 H= 345:00 +CPU= 12.857
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001380
  00:54:17 STEP 1381 H= 345:15 +CPU=  9.707
  00:54:27 STEP 1382 H= 345:30 +CPU=  9.687
  00:54:37 STEP 1383 H= 345:45 +CPU=  9.766
  00:54:47 STEP 1384 H= 346:00 +CPU= 10.326
  00:54:57 STEP 1385 H= 346:15 +CPU=  9.650
  00:55:07 STEP 1386 H= 346:30 +CPU=  9.810
  00:55:17 STEP 1387 H= 346:45 +CPU=  9.797
  00:55:27 STEP 1388 H= 347:00 +CPU= 10.108
  00:55:37 STEP 1389 H= 347:15 +CPU=  9.846
  00:55:46 STEP 1390 H= 347:30 +CPU=  9.753
  00:55:56 STEP 1391 H= 347:45 +CPU=  9.625
  00:56:11 STEP 1392 H= 348:00 +CPU= 14.481
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001392
  00:56:21 STEP 1393 H= 348:15 +CPU=  9.955
  00:56:31 STEP 1394 H= 348:30 +CPU= 10.157
  00:56:41 STEP 1395 H= 348:45 +CPU=  9.703
  00:56:51 STEP 1396 H= 349:00 +CPU= 10.123
  00:57:01 STEP 1397 H= 349:15 +CPU=  9.708
  00:57:10 STEP 1398 H= 349:30 +CPU=  9.756
  00:57:20 STEP 1399 H= 349:45 +CPU=  9.705
  00:57:30 STEP 1400 H= 350:00 +CPU= 10.202
  00:57:40 STEP 1401 H= 350:15 +CPU=  9.968
  00:57:50 STEP 1402 H= 350:30 +CPU=  9.965
  00:58:00 STEP 1403 H= 350:45 +CPU=  9.959
  00:58:13 STEP 1404 H= 351:00 +CPU= 12.557
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001404
  00:58:23 STEP 1405 H= 351:15 +CPU=  9.505
  00:58:32 STEP 1406 H= 351:30 +CPU=  9.724
  00:58:42 STEP 1407 H= 351:45 +CPU=  9.970
  00:58:53 STEP 1408 H= 352:00 +CPU= 10.549
  00:59:03 STEP 1409 H= 352:15 +CPU=  9.926
  00:59:13 STEP 1410 H= 352:30 +CPU= 10.067
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:59:44 STEP 1411 H= 352:45 +CPU= 10.206
  00:59:55 STEP 1412 H= 353:00 +CPU= 10.575
  01:00:05 STEP 1413 H= 353:15 +CPU=  9.885
  01:00:15 STEP 1414 H= 353:30 +CPU=  9.976
  01:00:25 STEP 1415 H= 353:45 +CPU=  9.994
  01:00:38 STEP 1416 H= 354:00 +CPU= 12.930
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001416
  01:00:48 STEP 1417 H= 354:15 +CPU=  9.872
  01:00:58 STEP 1418 H= 354:30 +CPU= 10.033
  01:01:08 STEP 1419 H= 354:45 +CPU=  9.971
  01:01:18 STEP 1420 H= 355:00 +CPU= 10.030
  01:01:27 STEP 1421 H= 355:15 +CPU=  9.423
  01:01:37 STEP 1422 H= 355:30 +CPU=  9.858
  01:01:47 STEP 1423 H= 355:45 +CPU=  9.938
  01:01:58 STEP 1424 H= 356:00 +CPU= 10.192
  01:02:08 STEP 1425 H= 356:15 +CPU= 10.096
  01:02:18 STEP 1426 H= 356:30 +CPU=  9.952
  01:02:28 STEP 1427 H= 356:45 +CPU= 10.144
  01:02:41 STEP 1428 H= 357:00 +CPU= 12.819
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001428
  01:02:51 STEP 1429 H= 357:15 +CPU=  9.764
  01:03:01 STEP 1430 H= 357:30 +CPU=  9.977
  01:03:11 STEP 1431 H= 357:45 +CPU= 10.017
  01:03:21 STEP 1432 H= 358:00 +CPU= 10.478
  01:03:31 STEP 1433 H= 358:15 +CPU= 10.013
  01:03:41 STEP 1434 H= 358:30 +CPU=  9.853
  01:03:51 STEP 1435 H= 358:45 +CPU= 10.021
  01:04:02 STEP 1436 H= 359:00 +CPU= 10.380
  01:04:12 STEP 1437 H= 359:15 +CPU=  9.966
  01:04:22 STEP 1438 H= 359:30 +CPU=  9.857
  01:04:31 STEP 1439 H= 359:45 +CPU=  9.897
  01:04:45 STEP 1440 H= 360:00 +CPU= 13.840
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.8232882075E-21      I       0.2592066208E-05      I
ICloud fractionI      0.0000000000E+00      I       0.2976078925E-01      I
I  Relat. Hum. I      0.4746748836E+00      I       0.4993796978E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.4845799297E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    709382740 BYTES IN      7 RECORDS TRANSFERRED IN    0.0004 SECONDS******** Mbytes/s, TOTAL TIME=    0.0055( 7.3%)
 01:04:45 STEP 1440 H= 360:00 +CPU= 13.840
 END CNT3
 NSTEP =  1440 CNT0   000000000   9.735   9.735   9.796   0.994               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN        15730/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    278    0       46      1044068    15730 ************    13.1     1.4    11.7     1.5    22.2
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  573    2040.0    2040.0      6.44      0.00
   9 SPCM     - SPECTRAL COMP.                     528     214.9     214.9      0.63      0.00
  10 SCAN2M - PHYSICS                              529    5289.6    5289.6     15.43      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 44     336.6     336.6      0.08      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 23      15.3      15.3      0.00      0.00
  17 GRIDFPOS IN CNT4                               44      11.8      11.8      0.00      0.00
  27 RESTART FILES - WRITING                        11    1346.2    1346.2      0.08      0.00
  28 RESTART FILES - READING                         1    1817.0    1817.0      0.01      0.00
  29 SU4FPOS IN CNT4                                44       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                                44    2495.5    2495.5      0.61      0.00
  31 POSDDH IN STEPO                                 3       3.0       3.0      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    529    1933.2    1933.2      5.64      0.00
  39 SU0YOMB                                         1     150.1     150.1      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    529       5.7       5.7      0.02      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              528      59.6      59.6      0.17      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              528      15.1      15.1      0.04      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 23       0.1       0.1      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     1148   10998.3   10998.3     69.60      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      1100      84.8      84.8      0.51      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       1100      26.9      26.9      0.16      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      1148      64.8      64.8      0.41      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      17.8      17.8      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           1148      12.0      12.0      0.08      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           1100       7.3       7.3      0.04      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           1148      17.6      17.6      0.11      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           1100      11.1      11.1      0.07      0.00
 400 GSTATS                                      62157       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 57779       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    18140.4 CPU TIME    5118.3 VECTOR TIME     5118.3


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       71.5
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc/slots/5/NODE.001_01
Adding to the zip: /var/lib/boinc/slots/5/ifs.stat
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284976/ICMGGh7zg+001440
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2fh_2016092300_20_1017_12284976_0_r410186998_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
01:08:11 (16292): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a2fh_2016092300_20_1017_12284976_0_r410186998_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2fh_2016092300_20_1017_12284976_0_r410186998_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2fh_2016092300_20_1017_12284976_0_r410186998_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2fh_2016092300_20_1017_12284976_0_r410186998_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2fh_2016092300_20_1017_12284976_0_r410186998_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
14 Jun 2024 18:36:13 1548201 22436567 oifs_43r3_bl_a2fh_2016092300_20_1017_12284976_0 1,295,100 14,062 0.0109


©2024 cpdn.org