climateprediction.net home page
Task 22311535

Task 22311535

Name oifs_43r3_bl_a3hb_2016092300_15_991_12211298_0
Workunit 12211298
Created 13 Feb 2023, 20:18:51 UTC
Sent 13 Feb 2023, 20:21:44 UTC
Report deadline 14 Apr 2023, 20:21:44 UTC
Received 17 Feb 2023, 1:52:18 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1536642
Run time 13 hours 24 min 13 sec
CPU time 13 hours 24 min 13 sec
Validate state Valid
Credit 1,813.14
Device peak FLOPS 4.94 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,065.71 MB
Peak swap size 5,930.78 MB
Peak disk usage 2,032.37 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
rasto.koirankoppi.com:1:1:1514665:1514665] [20230216:060113:1676520073:27583.697] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :                CLOUD_LAYER 
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1514665:1514665] [20230216:060113:1676520073:27583.697] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :                 CLOUDSC 
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1514665:1514665] [20230216:060114:1676520074:27584.698] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1514665:1514665] [20230216:060114:1676520074:27584.698] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x401140 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  000000000081FCF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D8BB20  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000011E1B9A  cloudsc_                  859  cloudsc.F90
oifs_43r3_model.e  00000000011D9EE7  cloud_layer_              131  cloud_layer.F90
oifs_43r3_model.e  00000000011730D0  callpar_                 1223  callpar.F90
oifs_43r3_model.e  00000000010B682F  ec_phys_                  670  ec_phys.F90
oifs_43r3_model.e  00000000010A915C  ec_phys_drv_              599  ec_phys_drv.F90
oifs_43r3_model.e  0000000000E680C3  gp_model_                 613  gp_model.F90
oifs_43r3_model.e  00000000015C1E62  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  00000000015AC40E  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  00000000006620B4  stepo_                    327  stepo.F90
oifs_43r3_model.e  00000000004A0E7C  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  000000000049DC29  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  000000000049CE72  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  000000000049CD68  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  00000000004078AD  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040276F  MAIN__                     96  master.F90
oifs_43r3_model.e  000000000040270D  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D8287A  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D840D7  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000004025E5  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a3hb
(argv4) batchid: 991
(argv5) wuid: 12211298
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/2
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/2/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/2/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_71c26bd0992052775c8d07f04b055eaf to: /var/lib/boinc-client/slots/2/oifs_43r3_bl_a3hb_2016092300_15_991_12211298.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/2/oifs_43r3_bl_a3hb_2016092300_15_991_12211298.zip
ic_ancil_file: ic_ancil_12211298
ifsdata_file: ifsdata_12211298
climate_data_file: clim_data_12211298
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/2/ic_ancil_12211298.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12211298.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_cc06399a935934db108d78ab62c53834 to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12211298.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12211298.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12211298.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12211298.zip
Checking for progress XML file: /var/lib/boinc-client/slots/2/progress_file_12211298.xml
Opened progress file ok : /var/lib/boinc-client/slots/2/progress_file_12211298.xml
-- Model is restarting --
Adjusting last_iter, 983, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/2/progress_file_12211298.xml
last_cpu_time: 32375
upload_file_number: 10
last_iter: 961
last_upload: 864000
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a3hb_2016092300_15_991_12211298_0_r269615233
The child process has been launched with process id: 1533374
Executing the command: /var/lib/boinc-client/slots/2/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:ruokavarasto.koirankoppi.com:1:1:1533374:1533374] [20230216:222130:1676578890:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  22:24:43 STEP  960 H= 240:00 +CPU= 34.253
  22:25:16 STEP  961 H= 240:15 +CPU= 32.400
  22:25:49 STEP  962 H= 240:30 +CPU= 33.237
  22:26:20 STEP  963 H= 240:45 +CPU= 30.866
  22:26:53 STEP  964 H= 241:00 +CPU= 32.406
  22:27:25 STEP  965 H= 241:15 +CPU= 32.144
  22:27:55 STEP  966 H= 241:30 +CPU= 30.208
  22:28:27 STEP  967 H= 241:45 +CPU= 32.015
  22:29:00 STEP  968 H= 242:00 +CPU= 32.503
  22:29:31 STEP  969 H= 242:15 +CPU= 31.778
  22:30:03 STEP  970 H= 242:30 +CPU= 31.254
  22:30:34 STEP  971 H= 242:45 +CPU= 31.638
  22:31:15 STEP  972 H= 243:00 +CPU= 40.483
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000972
  22:31:48 STEP  973 H= 243:15 +CPU= 32.934
  22:32:20 STEP  974 H= 243:30 +CPU= 31.824
  22:32:52 STEP  975 H= 243:45 +CPU= 31.570
  22:33:25 STEP  976 H= 244:00 +CPU= 33.378
  22:33:56 STEP  977 H= 244:15 +CPU= 30.786
  22:34:28 STEP  978 H= 244:30 +CPU= 32.471
  22:35:00 STEP  979 H= 244:45 +CPU= 31.742
  22:35:34 STEP  980 H= 245:00 +CPU= 33.733
  22:36:05 STEP  981 H= 245:15 +CPU= 31.128
  22:36:38 STEP  982 H= 245:30 +CPU= 32.411
  22:37:08 STEP  983 H= 245:45 +CPU= 30.555
  22:37:48 STEP  984 H= 246:00 +CPU= 39.274
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000984
  22:38:20 STEP  985 H= 246:15 +CPU= 31.908
  22:38:51 STEP  986 H= 246:30 +CPU= 31.150
  22:39:22 STEP  987 H= 246:45 +CPU= 31.492
  22:39:55 STEP  988 H= 247:00 +CPU= 32.392
  22:40:26 STEP  989 H= 247:15 +CPU= 31.525
  22:40:59 STEP  990 H= 247:30 +CPU= 32.210
  22:41:29 STEP  991 H= 247:45 +CPU= 30.258
  22:42:01 STEP  992 H= 248:00 +CPU= 31.996
  22:42:32 STEP  993 H= 248:15 +CPU= 31.344
  22:43:04 STEP  994 H= 248:30 +CPU= 31.119
  22:43:35 STEP  995 H= 248:45 +CPU= 31.848
  22:44:17 STEP  996 H= 249:00 +CPU= 41.817
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000996
  22:44:50 STEP  997 H= 249:15 +CPU= 32.991
  22:45:22 STEP  998 H= 249:30 +CPU= 31.171
  22:45:53 STEP  999 H= 249:45 +CPU= 31.646
  22:46:26 STEP 1000 H= 250:00 +CPU= 32.755
  22:47:00 STEP 1001 H= 250:15 +CPU= 33.412
  22:47:31 STEP 1002 H= 250:30 +CPU= 31.621
  22:48:03 STEP 1003 H= 250:45 +CPU= 31.751
  22:48:35 STEP 1004 H= 251:00 +CPU= 32.303
  22:49:08 STEP 1005 H= 251:15 +CPU= 32.251
  22:49:39 STEP 1006 H= 251:30 +CPU= 31.308
  22:50:11 STEP 1007 H= 251:45 +CPU= 32.212
  22:51:01 STEP 1008 H= 252:00 +CPU= 46.688
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001008
  22:51:33 STEP 1009 H= 252:15 +CPU= 31.985
  22:52:05 STEP 1010 H= 252:30 +CPU= 31.879
  22:52:37 STEP 1011 H= 252:45 +CPU= 32.406
  22:53:09 STEP 1012 H= 253:00 +CPU= 31.291
  22:53:42 STEP 1013 H= 253:15 +CPU= 32.926
  22:54:16 STEP 1014 H= 253:30 +CPU= 33.782
  22:54:49 STEP 1015 H= 253:45 +CPU= 33.004
  22:55:21 STEP 1016 H= 254:00 +CPU= 31.699
  22:55:51 STEP 1017 H= 254:15 +CPU= 29.643
  22:56:23 STEP 1018 H= 254:30 +CPU= 32.378
  22:56:56 STEP 1019 H= 254:45 +CPU= 32.682
  22:57:37 STEP 1020 H= 255:00 +CPU= 40.782
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001020
  22:58:08 STEP 1021 H= 255:15 +CPU= 31.831
  22:58:41 STEP 1022 H= 255:30 +CPU= 32.583
  22:59:13 STEP 1023 H= 255:45 +CPU= 31.560
  22:59:45 STEP 1024 H= 256:00 +CPU= 32.210
  23:00:18 STEP 1025 H= 256:15 +CPU= 33.321
  23:00:49 STEP 1026 H= 256:30 +CPU= 30.897
  23:01:22 STEP 1027 H= 256:45 +CPU= 32.469
  23:01:53 STEP 1028 H= 257:00 +CPU= 30.749
  23:02:24 STEP 1029 H= 257:15 +CPU= 31.255
  23:02:56 STEP 1030 H= 257:30 +CPU= 31.886
  23:03:27 STEP 1031 H= 257:45 +CPU= 31.497
  23:04:09 STEP 1032 H= 258:00 +CPU= 41.178
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001032
  23:04:42 STEP 1033 H= 258:15 +CPU= 33.060
  23:05:14 STEP 1034 H= 258:30 +CPU= 31.976
  23:05:46 STEP 1035 H= 258:45 +CPU= 32.260
  23:06:19 STEP 1036 H= 259:00 +CPU= 32.855
  23:06:51 STEP 1037 H= 259:15 +CPU= 32.480
  23:07:24 STEP 1038 H= 259:30 +CPU= 32.566
  23:07:56 STEP 1039 H= 259:45 +CPU= 32.105
  23:08:31 STEP 1040 H= 260:00 +CPU= 34.382
  23:09:03 STEP 1041 H= 260:15 +CPU= 32.171
  23:09:34 STEP 1042 H= 260:30 +CPU= 31.457
  23:10:07 STEP 1043 H= 260:45 +CPU= 32.484
  23:10:48 STEP 1044 H= 261:00 +CPU= 40.626
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001044
  23:11:19 STEP 1045 H= 261:15 +CPU= 31.554
  23:11:51 STEP 1046 H= 261:30 +CPU= 31.209
  23:12:22 STEP 1047 H= 261:45 +CPU= 31.303
  23:12:53 STEP 1048 H= 262:00 +CPU= 31.252
  23:13:25 STEP 1049 H= 262:15 +CPU= 32.128
  23:13:58 STEP 1050 H= 262:30 +CPU= 32.249
  23:14:30 STEP 1051 H= 262:45 +CPU= 32.260
  23:15:01 STEP 1052 H= 263:00 +CPU= 31.464
  23:15:34 STEP 1053 H= 263:15 +CPU= 32.403
  23:16:04 STEP 1054 H= 263:30 +CPU= 29.716
  23:16:36 STEP 1055 H= 263:45 +CPU= 31.880
  23:17:22 STEP 1056 H= 264:00 +CPU= 45.316
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3hb_2016092300_15_991_12211298_0_r269615233_10.zip
Uploading the intermediate file: upload_file_10.zip
  23:17:57 STEP 1057 H= 264:15 +CPU= 34.380
  23:18:30 STEP 1058 H= 264:30 +CPU= 32.748
  23:19:01 STEP 1059 H= 264:45 +CPU= 31.722
  23:19:34 STEP 1060 H= 265:00 +CPU= 32.812
  23:20:05 STEP 1061 H= 265:15 +CPU= 30.960
  23:20:37 STEP 1062 H= 265:30 +CPU= 32.130
  23:21:07 STEP 1063 H= 265:45 +CPU= 29.852
  23:21:40 STEP 1064 H= 266:00 +CPU= 32.214
  23:22:19 STEP 1065 H= 266:15 +CPU= 32.980
  23:22:51 STEP 1066 H= 266:30 +CPU= 32.025
  23:23:23 STEP 1067 H= 266:45 +CPU= 32.274
  23:24:03 STEP 1068 H= 267:00 +CPU= 40.191
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001068
  23:24:35 STEP 1069 H= 267:15 +CPU= 31.958
  23:25:07 STEP 1070 H= 267:30 +CPU= 31.662
  23:25:40 STEP 1071 H= 267:45 +CPU= 32.318
  23:26:13 STEP 1072 H= 268:00 +CPU= 33.165
  23:26:44 STEP 1073 H= 268:15 +CPU= 31.544
  23:27:18 STEP 1074 H= 268:30 +CPU= 33.239
  23:27:48 STEP 1075 H= 268:45 +CPU= 30.286
  23:28:20 STEP 1076 H= 269:00 +CPU= 31.844
  23:28:52 STEP 1077 H= 269:15 +CPU= 32.454
  23:29:25 STEP 1078 H= 269:30 +CPU= 32.312
  23:29:57 STEP 1079 H= 269:45 +CPU= 31.823
  23:30:37 STEP 1080 H= 270:00 +CPU= 40.295
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001080
  23:31:09 STEP 1081 H= 270:15 +CPU= 32.277
  23:31:42 STEP 1082 H= 270:30 +CPU= 32.155
  23:32:13 STEP 1083 H= 270:45 +CPU= 31.367
  23:32:46 STEP 1084 H= 271:00 +CPU= 33.394
  23:33:19 STEP 1085 H= 271:15 +CPU= 32.834
  23:33:50 STEP 1086 H= 271:30 +CPU= 31.099
  23:34:22 STEP 1087 H= 271:45 +CPU= 31.740
  23:34:54 STEP 1088 H= 272:00 +CPU= 32.053
  23:35:26 STEP 1089 H= 272:15 +CPU= 31.138
  23:35:58 STEP 1090 H= 272:30 +CPU= 32.472
  23:36:30 STEP 1091 H= 272:45 +CPU= 32.290
  23:37:10 STEP 1092 H= 273:00 +CPU= 39.941
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001092
  23:37:41 STEP 1093 H= 273:15 +CPU= 30.741
  23:38:14 STEP 1094 H= 273:30 +CPU= 32.278
  23:38:47 STEP 1095 H= 273:45 +CPU= 33.540
  23:39:18 STEP 1096 H= 274:00 +CPU= 30.932
  23:39:52 STEP 1097 H= 274:15 +CPU= 34.134
  23:40:25 STEP 1098 H= 274:30 +CPU= 32.275
  23:40:57 STEP 1099 H= 274:45 +CPU= 32.155
  23:41:29 STEP 1100 H= 275:00 +CPU= 31.703
  23:42:01 STEP 1101 H= 275:15 +CPU= 32.593
  23:42:33 STEP 1102 H= 275:30 +CPU= 32.177
  23:43:06 STEP 1103 H= 275:45 +CPU= 32.484
  23:44:01 STEP 1104 H= 276:00 +CPU= 46.869
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001104
  23:44:33 STEP 1105 H= 276:15 +CPU= 31.894
  23:45:06 STEP 1106 H= 276:30 +CPU= 33.221
  23:45:39 STEP 1107 H= 276:45 +CPU= 32.431
  23:46:12 STEP 1108 H= 277:00 +CPU= 33.454
  23:46:45 STEP 1109 H= 277:15 +CPU= 32.971
  23:47:17 STEP 1110 H= 277:30 +CPU= 31.511
  23:47:50 STEP 1111 H= 277:45 +CPU= 33.122
  23:48:22 STEP 1112 H= 278:00 +CPU= 32.377
  23:48:54 STEP 1113 H= 278:15 +CPU= 31.907
  23:49:26 STEP 1114 H= 278:30 +CPU= 31.369
  23:49:58 STEP 1115 H= 278:45 +CPU= 32.790
  23:50:39 STEP 1116 H= 279:00 +CPU= 39.880
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001116
  23:51:11 STEP 1117 H= 279:15 +CPU= 32.044
  23:51:45 STEP 1118 H= 279:30 +CPU= 34.494
  23:52:18 STEP 1119 H= 279:45 +CPU= 32.392
  23:52:50 STEP 1120 H= 280:00 +CPU= 32.070
  23:53:21 STEP 1121 H= 280:15 +CPU= 31.377
  23:53:54 STEP 1122 H= 280:30 +CPU= 32.438
  23:54:26 STEP 1123 H= 280:45 +CPU= 32.153
  23:54:58 STEP 1124 H= 281:00 +CPU= 31.755
  23:55:31 STEP 1125 H= 281:15 +CPU= 32.765
  23:56:02 STEP 1126 H= 281:30 +CPU= 31.013
  23:56:34 STEP 1127 H= 281:45 +CPU= 31.694
  23:57:12 STEP 1128 H= 282:00 +CPU= 38.369
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001128
  23:57:45 STEP 1129 H= 282:15 +CPU= 32.544
  23:58:16 STEP 1130 H= 282:30 +CPU= 31.300
  23:58:48 STEP 1131 H= 282:45 +CPU= 31.568
  23:59:19 STEP 1132 H= 283:00 +CPU= 31.282
  23:59:52 STEP 1133 H= 283:15 +CPU= 32.929
  00:00:24 STEP 1134 H= 283:30 +CPU= 31.809
  00:00:56 STEP 1135 H= 283:45 +CPU= 31.522
  00:01:28 STEP 1136 H= 284:00 +CPU= 31.932
  00:01:59 STEP 1137 H= 284:15 +CPU= 31.493
  00:02:30 STEP 1138 H= 284:30 +CPU= 31.003
  00:03:03 STEP 1139 H= 284:45 +CPU= 32.964
  00:03:43 STEP 1140 H= 285:00 +CPU= 39.504
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001140
  00:04:15 STEP 1141 H= 285:15 +CPU= 31.652
  00:04:47 STEP 1142 H= 285:30 +CPU= 32.403
  00:05:18 STEP 1143 H= 285:45 +CPU= 31.104
  00:05:51 STEP 1144 H= 286:00 +CPU= 33.134
  00:06:23 STEP 1145 H= 286:15 +CPU= 31.332
  00:06:56 STEP 1146 H= 286:30 +CPU= 32.776
  00:07:28 STEP 1147 H= 286:45 +CPU= 32.018
  00:08:00 STEP 1148 H= 287:00 +CPU= 32.319
  00:08:31 STEP 1149 H= 287:15 +CPU= 31.235
  00:09:03 STEP 1150 H= 287:30 +CPU= 31.609
  00:09:35 STEP 1151 H= 287:45 +CPU= 32.159
  00:10:27 STEP 1152 H= 288:00 +CPU= 45.386
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3hb_2016092300_15_991_12211298_0_r269615233_11.zip
Uploading the intermediate file: upload_file_11.zip
  00:11:01 STEP 1153 H= 288:15 +CPU= 34.423
  00:11:33 STEP 1154 H= 288:30 +CPU= 31.724
  00:12:05 STEP 1155 H= 288:45 +CPU= 31.971
  00:12:38 STEP 1156 H= 289:00 +CPU= 32.756
  00:13:10 STEP 1157 H= 289:15 +CPU= 31.926
  00:13:43 STEP 1158 H= 289:30 +CPU= 32.550
  00:14:15 STEP 1159 H= 289:45 +CPU= 32.379
  00:14:48 STEP 1160 H= 290:00 +CPU= 32.665
  00:15:19 STEP 1161 H= 290:15 +CPU= 30.772
  00:15:49 STEP 1162 H= 290:30 +CPU= 30.546
  00:16:21 STEP 1163 H= 290:45 +CPU= 32.177
  00:17:03 STEP 1164 H= 291:00 +CPU= 41.535
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001164
  00:17:35 STEP 1165 H= 291:15 +CPU= 31.742
  00:18:08 STEP 1166 H= 291:30 +CPU= 33.004
  00:18:39 STEP 1167 H= 291:45 +CPU= 30.918
  00:19:11 STEP 1168 H= 292:00 +CPU= 32.317
  00:19:43 STEP 1169 H= 292:15 +CPU= 31.822
  00:20:15 STEP 1170 H= 292:30 +CPU= 31.541
  00:20:48 STEP 1171 H= 292:45 +CPU= 32.882
  00:21:21 STEP 1172 H= 293:00 +CPU= 32.961
  00:21:52 STEP 1173 H= 293:15 +CPU= 30.860
  00:22:24 STEP 1174 H= 293:30 +CPU= 32.359
  00:22:56 STEP 1175 H= 293:45 +CPU= 31.722
  00:23:36 STEP 1176 H= 294:00 +CPU= 40.118
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001176
  00:24:08 STEP 1177 H= 294:15 +CPU= 32.288
  00:24:39 STEP 1178 H= 294:30 +CPU= 31.057
  00:25:12 STEP 1179 H= 294:45 +CPU= 32.984
  00:25:44 STEP 1180 H= 295:00 +CPU= 31.673
  00:26:16 STEP 1181 H= 295:15 +CPU= 31.641
  00:26:49 STEP 1182 H= 295:30 +CPU= 32.581
  00:27:20 STEP 1183 H= 295:45 +CPU= 31.690
  00:27:53 STEP 1184 H= 296:00 +CPU= 33.005
  00:28:25 STEP 1185 H= 296:15 +CPU= 31.929
  00:28:57 STEP 1186 H= 296:30 +CPU= 31.453
  00:29:28 STEP 1187 H= 296:45 +CPU= 31.429
  00:30:09 STEP 1188 H= 297:00 +CPU= 40.197
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001188
  00:30:40 STEP 1189 H= 297:15 +CPU= 31.677
  00:31:12 STEP 1190 H= 297:30 +CPU= 31.849
  00:31:46 STEP 1191 H= 297:45 +CPU= 33.502
  00:32:20 STEP 1192 H= 298:00 +CPU= 33.946
  00:32:52 STEP 1193 H= 298:15 +CPU= 32.493
  00:33:26 STEP 1194 H= 298:30 +CPU= 33.288
  00:33:57 STEP 1195 H= 298:45 +CPU= 31.691
  00:34:30 STEP 1196 H= 299:00 +CPU= 32.198
  00:35:01 STEP 1197 H= 299:15 +CPU= 31.468
  00:35:32 STEP 1198 H= 299:30 +CPU= 30.435
  00:36:03 STEP 1199 H= 299:45 +CPU= 31.467
  00:36:52 STEP 1200 H= 300:00 +CPU= 46.214
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001200
  00:37:24 STEP 1201 H= 300:15 +CPU= 32.128
  00:37:57 STEP 1202 H= 300:30 +CPU= 33.005
  00:38:29 STEP 1203 H= 300:45 +CPU= 31.792
  00:39:02 STEP 1204 H= 301:00 +CPU= 33.051
  00:39:34 STEP 1205 H= 301:15 +CPU= 32.187
  00:40:07 STEP 1206 H= 301:30 +CPU= 32.451
  00:40:39 STEP 1207 H= 301:45 +CPU= 31.891
  00:41:10 STEP 1208 H= 302:00 +CPU= 31.522
  00:41:43 STEP 1209 H= 302:15 +CPU= 32.703
  00:42:16 STEP 1210 H= 302:30 +CPU= 32.782
  00:42:48 STEP 1211 H= 302:45 +CPU= 31.781
  00:43:29 STEP 1212 H= 303:00 +CPU= 41.279
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001212
  00:44:01 STEP 1213 H= 303:15 +CPU= 31.585
  00:44:33 STEP 1214 H= 303:30 +CPU= 32.309
  00:45:06 STEP 1215 H= 303:45 +CPU= 32.518
  00:45:37 STEP 1216 H= 304:00 +CPU= 31.407
  00:46:10 STEP 1217 H= 304:15 +CPU= 32.561
  00:46:41 STEP 1218 H= 304:30 +CPU= 30.944
  00:47:14 STEP 1219 H= 304:45 +CPU= 32.937
  00:47:46 STEP 1220 H= 305:00 +CPU= 32.542
  00:48:18 STEP 1221 H= 305:15 +CPU= 31.593
  00:48:50 STEP 1222 H= 305:30 +CPU= 31.623
  00:49:25 STEP 1223 H= 305:45 +CPU= 35.487
  00:50:07 STEP 1224 H= 306:00 +CPU= 41.070
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001224
  00:50:39 STEP 1225 H= 306:15 +CPU= 32.536
  00:51:12 STEP 1226 H= 306:30 +CPU= 32.670
  00:51:45 STEP 1227 H= 306:45 +CPU= 32.608
  00:52:18 STEP 1228 H= 307:00 +CPU= 33.609
  00:52:51 STEP 1229 H= 307:15 +CPU= 32.527
  00:53:24 STEP 1230 H= 307:30 +CPU= 32.867
  00:53:54 STEP 1231 H= 307:45 +CPU= 30.471
  00:54:27 STEP 1232 H= 308:00 +CPU= 32.247
  00:54:57 STEP 1233 H= 308:15 +CPU= 30.759
  00:55:30 STEP 1234 H= 308:30 +CPU= 33.067
  00:56:03 STEP 1235 H= 308:45 +CPU= 32.563
  00:56:43 STEP 1236 H= 309:00 +CPU= 40.209
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001236
  00:57:16 STEP 1237 H= 309:15 +CPU= 32.387
  00:57:48 STEP 1238 H= 309:30 +CPU= 31.728
  00:58:19 STEP 1239 H= 309:45 +CPU= 31.599
  00:58:52 STEP 1240 H= 310:00 +CPU= 32.460
  00:59:25 STEP 1241 H= 310:15 +CPU= 32.844
  00:59:57 STEP 1242 H= 310:30 +CPU= 32.515
  01:00:30 STEP 1243 H= 310:45 +CPU= 32.737
  01:01:04 STEP 1244 H= 311:00 +CPU= 33.841
  01:01:37 STEP 1245 H= 311:15 +CPU= 33.283
  01:02:09 STEP 1246 H= 311:30 +CPU= 31.236
  01:02:40 STEP 1247 H= 311:45 +CPU= 31.579
  01:03:29 STEP 1248 H= 312:00 +CPU= 44.477
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3hb_2016092300_15_991_12211298_0_r269615233_12.zip
Uploading the intermediate file: upload_file_12.zip
  01:04:04 STEP 1249 H= 312:15 +CPU= 34.560
  01:04:35 STEP 1250 H= 312:30 +CPU= 31.106
  01:05:07 STEP 1251 H= 312:45 +CPU= 31.999
  01:05:40 STEP 1252 H= 313:00 +CPU= 32.364
  01:06:11 STEP 1253 H= 313:15 +CPU= 31.077
  01:06:42 STEP 1254 H= 313:30 +CPU= 31.090
  01:07:15 STEP 1255 H= 313:45 +CPU= 32.761
  01:07:48 STEP 1256 H= 314:00 +CPU= 33.386
  01:08:22 STEP 1257 H= 314:15 +CPU= 33.876
  01:08:55 STEP 1258 H= 314:30 +CPU= 32.566
  01:09:27 STEP 1259 H= 314:45 +CPU= 32.413
  01:10:08 STEP 1260 H= 315:00 +CPU= 40.862
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001260
  01:10:41 STEP 1261 H= 315:15 +CPU= 33.056
  01:11:15 STEP 1262 H= 315:30 +CPU= 33.205
  01:11:46 STEP 1263 H= 315:45 +CPU= 31.520
  01:12:19 STEP 1264 H= 316:00 +CPU= 32.768
  01:12:52 STEP 1265 H= 316:15 +CPU= 32.851
  01:13:23 STEP 1266 H= 316:30 +CPU= 30.818
  01:13:56 STEP 1267 H= 316:45 +CPU= 32.757
  01:14:28 STEP 1268 H= 317:00 +CPU= 32.617
  01:15:01 STEP 1269 H= 317:15 +CPU= 32.458
  01:15:32 STEP 1270 H= 317:30 +CPU= 31.357
  01:16:03 STEP 1271 H= 317:45 +CPU= 30.976
  01:16:43 STEP 1272 H= 318:00 +CPU= 39.972
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001272
  01:17:16 STEP 1273 H= 318:15 +CPU= 32.389
  01:17:49 STEP 1274 H= 318:30 +CPU= 32.546
  01:18:20 STEP 1275 H= 318:45 +CPU= 31.855
  01:18:52 STEP 1276 H= 319:00 +CPU= 31.624
  01:19:24 STEP 1277 H= 319:15 +CPU= 32.139
  01:19:58 STEP 1278 H= 319:30 +CPU= 33.826
  01:20:33 STEP 1279 H= 319:45 +CPU= 33.896
  01:21:08 STEP 1280 H= 320:00 +CPU= 34.261
  01:21:42 STEP 1281 H= 320:15 +CPU= 33.214
  01:22:14 STEP 1282 H= 320:30 +CPU= 32.172
  01:22:46 STEP 1283 H= 320:45 +CPU= 32.517
  01:23:26 STEP 1284 H= 321:00 +CPU= 39.220
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001284
  01:23:57 STEP 1285 H= 321:15 +CPU= 31.187
  01:24:28 STEP 1286 H= 321:30 +CPU= 31.380
  01:24:59 STEP 1287 H= 321:45 +CPU= 30.960
  01:25:32 STEP 1288 H= 322:00 +CPU= 32.605
  01:26:04 STEP 1289 H= 322:15 +CPU= 32.011
  01:26:37 STEP 1290 H= 322:30 +CPU= 32.657
  01:27:09 STEP 1291 H= 322:45 +CPU= 32.096
  01:27:43 STEP 1292 H= 323:00 +CPU= 33.746
  01:28:15 STEP 1293 H= 323:15 +CPU= 32.113
  01:28:47 STEP 1294 H= 323:30 +CPU= 31.692
  01:29:20 STEP 1295 H= 323:45 +CPU= 32.860
  01:30:12 STEP 1296 H= 324:00 +CPU= 46.108
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001296
  01:30:44 STEP 1297 H= 324:15 +CPU= 32.406
  01:31:17 STEP 1298 H= 324:30 +CPU= 32.291
  01:31:48 STEP 1299 H= 324:45 +CPU= 31.769
  01:32:20 STEP 1300 H= 325:00 +CPU= 32.043
  01:32:52 STEP 1301 H= 325:15 +CPU= 31.814
  01:33:24 STEP 1302 H= 325:30 +CPU= 31.869
  01:33:57 STEP 1303 H= 325:45 +CPU= 33.052
  01:34:31 STEP 1304 H= 326:00 +CPU= 33.206
  01:35:01 STEP 1305 H= 326:15 +CPU= 30.659
  01:35:33 STEP 1306 H= 326:30 +CPU= 31.506
  01:36:06 STEP 1307 H= 326:45 +CPU= 33.186
  01:36:47 STEP 1308 H= 327:00 +CPU= 40.903
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001308
  01:37:19 STEP 1309 H= 327:15 +CPU= 32.262
  01:37:52 STEP 1310 H= 327:30 +CPU= 32.057
  01:38:22 STEP 1311 H= 327:45 +CPU= 30.614
  01:38:56 STEP 1312 H= 328:00 +CPU= 33.373
  01:39:26 STEP 1313 H= 328:15 +CPU= 30.296
  01:39:58 STEP 1314 H= 328:30 +CPU= 31.922
  01:40:30 STEP 1315 H= 328:45 +CPU= 32.354
  01:41:03 STEP 1316 H= 329:00 +CPU= 33.058
  01:41:35 STEP 1317 H= 329:15 +CPU= 31.049
  01:42:07 STEP 1318 H= 329:30 +CPU= 32.544
  01:42:39 STEP 1319 H= 329:45 +CPU= 32.110
  01:43:21 STEP 1320 H= 330:00 +CPU= 41.536
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001320
  01:43:54 STEP 1321 H= 330:15 +CPU= 32.997
  01:44:26 STEP 1322 H= 330:30 +CPU= 32.469
  01:44:59 STEP 1323 H= 330:45 +CPU= 32.280
  01:45:30 STEP 1324 H= 331:00 +CPU= 31.480
  01:46:03 STEP 1325 H= 331:15 +CPU= 32.234
  01:46:36 STEP 1326 H= 331:30 +CPU= 32.973
  01:47:11 STEP 1327 H= 331:45 +CPU= 34.578
  01:47:45 STEP 1328 H= 332:00 +CPU= 34.159
  01:48:16 STEP 1329 H= 332:15 +CPU= 31.349
  01:48:49 STEP 1330 H= 332:30 +CPU= 32.313
  01:49:20 STEP 1331 H= 332:45 +CPU= 31.515
  01:50:01 STEP 1332 H= 333:00 +CPU= 40.560
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001332
  01:50:33 STEP 1333 H= 333:15 +CPU= 32.326
  01:51:06 STEP 1334 H= 333:30 +CPU= 33.192
  01:51:39 STEP 1335 H= 333:45 +CPU= 32.505
  01:52:12 STEP 1336 H= 334:00 +CPU= 32.740
  01:52:45 STEP 1337 H= 334:15 +CPU= 33.178
  01:53:16 STEP 1338 H= 334:30 +CPU= 30.953
  01:53:49 STEP 1339 H= 334:45 +CPU= 32.547
  01:54:22 STEP 1340 H= 335:00 +CPU= 33.004
  01:54:53 STEP 1341 H= 335:15 +CPU= 31.717
  01:55:26 STEP 1342 H= 335:30 +CPU= 32.017
  01:55:57 STEP 1343 H= 335:45 +CPU= 31.803
  01:56:44 STEP 1344 H= 336:00 +CPU= 45.946
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3hb_2016092300_15_991_12211298_0_r269615233_13.zip
Uploading the intermediate file: upload_file_13.zip
  01:57:19 STEP 1345 H= 336:15 +CPU= 34.187
  01:57:52 STEP 1346 H= 336:30 +CPU= 32.797
  01:58:24 STEP 1347 H= 336:45 +CPU= 32.074
  01:58:56 STEP 1348 H= 337:00 +CPU= 32.524
  01:59:28 STEP 1349 H= 337:15 +CPU= 31.138
  01:59:58 STEP 1350 H= 337:30 +CPU= 30.372
  02:00:30 STEP 1351 H= 337:45 +CPU= 31.993
  02:01:02 STEP 1352 H= 338:00 +CPU= 32.062
  02:01:35 STEP 1353 H= 338:15 +CPU= 32.329
  02:02:07 STEP 1354 H= 338:30 +CPU= 32.059
  02:02:40 STEP 1355 H= 338:45 +CPU= 33.347
  02:03:20 STEP 1356 H= 339:00 +CPU= 39.741
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001356
  02:03:51 STEP 1357 H= 339:15 +CPU= 31.534
  02:04:23 STEP 1358 H= 339:30 +CPU= 31.771
  02:04:56 STEP 1359 H= 339:45 +CPU= 32.427
  02:05:29 STEP 1360 H= 340:00 +CPU= 33.093
  02:06:01 STEP 1361 H= 340:15 +CPU= 32.264
  02:06:34 STEP 1362 H= 340:30 +CPU= 32.670
  02:07:07 STEP 1363 H= 340:45 +CPU= 32.991
  02:07:39 STEP 1364 H= 341:00 +CPU= 31.693
  02:08:12 STEP 1365 H= 341:15 +CPU= 32.864
  02:08:43 STEP 1366 H= 341:30 +CPU= 31.317
  02:09:14 STEP 1367 H= 341:45 +CPU= 31.039
  02:09:54 STEP 1368 H= 342:00 +CPU= 39.557
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001368
  02:10:26 STEP 1369 H= 342:15 +CPU= 32.273
  02:10:58 STEP 1370 H= 342:30 +CPU= 31.888
  02:11:30 STEP 1371 H= 342:45 +CPU= 32.282
  02:12:04 STEP 1372 H= 343:00 +CPU= 33.247
  02:12:37 STEP 1373 H= 343:15 +CPU= 32.970
  02:13:10 STEP 1374 H= 343:30 +CPU= 33.336
  02:13:43 STEP 1375 H= 343:45 +CPU= 32.499
  02:14:15 STEP 1376 H= 344:00 +CPU= 32.384
  02:14:48 STEP 1377 H= 344:15 +CPU= 32.603
  02:15:19 STEP 1378 H= 344:30 +CPU= 31.509
  02:15:51 STEP 1379 H= 344:45 +CPU= 31.710
  02:16:31 STEP 1380 H= 345:00 +CPU= 39.679
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001380
  02:17:04 STEP 1381 H= 345:15 +CPU= 32.668
  02:17:36 STEP 1382 H= 345:30 +CPU= 32.778
  02:18:08 STEP 1383 H= 345:45 +CPU= 31.860
  02:18:41 STEP 1384 H= 346:00 +CPU= 32.375
  02:19:14 STEP 1385 H= 346:15 +CPU= 32.976
  02:19:46 STEP 1386 H= 346:30 +CPU= 31.815
  02:20:16 STEP 1387 H= 346:45 +CPU= 30.694
  02:20:50 STEP 1388 H= 347:00 +CPU= 33.265
  02:21:22 STEP 1389 H= 347:15 +CPU= 31.996
  02:21:56 STEP 1390 H= 347:30 +CPU= 33.944
  02:22:28 STEP 1391 H= 347:45 +CPU= 31.710
  02:23:18 STEP 1392 H= 348:00 +CPU= 46.448
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001392
  02:23:49 STEP 1393 H= 348:15 +CPU= 31.310
  02:24:20 STEP 1394 H= 348:30 +CPU= 30.060
  02:24:52 STEP 1395 H= 348:45 +CPU= 32.194
  02:25:25 STEP 1396 H= 349:00 +CPU= 33.047
  02:25:56 STEP 1397 H= 349:15 +CPU= 31.312
  02:26:29 STEP 1398 H= 349:30 +CPU= 32.741
  02:27:01 STEP 1399 H= 349:45 +CPU= 31.655
  02:27:33 STEP 1400 H= 350:00 +CPU= 32.473
  02:28:06 STEP 1401 H= 350:15 +CPU= 32.459
  02:28:38 STEP 1402 H= 350:30 +CPU= 31.921
  02:29:11 STEP 1403 H= 350:45 +CPU= 33.084
  02:29:51 STEP 1404 H= 351:00 +CPU= 40.488
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001404
  02:30:25 STEP 1405 H= 351:15 +CPU= 33.581
  02:30:58 STEP 1406 H= 351:30 +CPU= 32.454
  02:31:30 STEP 1407 H= 351:45 +CPU= 32.339
  02:32:03 STEP 1408 H= 352:00 +CPU= 32.908
  02:32:35 STEP 1409 H= 352:15 +CPU= 32.115
  02:33:08 STEP 1410 H= 352:30 +CPU= 32.682
  02:33:40 STEP 1411 H= 352:45 +CPU= 32.445
  02:34:14 STEP 1412 H= 353:00 +CPU= 33.271
  02:34:45 STEP 1413 H= 353:15 +CPU= 30.996
  02:35:17 STEP 1414 H= 353:30 +CPU= 31.883
  02:35:50 STEP 1415 H= 353:45 +CPU= 33.351
  02:36:30 STEP 1416 H= 354:00 +CPU= 39.512
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001416
  02:37:01 STEP 1417 H= 354:15 +CPU= 31.844
  02:37:34 STEP 1418 H= 354:30 +CPU= 32.512
  02:38:06 STEP 1419 H= 354:45 +CPU= 32.230
  02:38:39 STEP 1420 H= 355:00 +CPU= 32.236
  02:39:11 STEP 1421 H= 355:15 +CPU= 32.579
  02:39:44 STEP 1422 H= 355:30 +CPU= 32.623
  02:40:18 STEP 1423 H= 355:45 +CPU= 33.772
  02:40:51 STEP 1424 H= 356:00 +CPU= 32.931
  02:41:24 STEP 1425 H= 356:15 +CPU= 33.258
  02:41:56 STEP 1426 H= 356:30 +CPU= 31.397
  02:42:30 STEP 1427 H= 356:45 +CPU= 34.450
  02:43:12 STEP 1428 H= 357:00 +CPU= 42.053
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001428
  02:43:45 STEP 1429 H= 357:15 +CPU= 32.671
  02:44:17 STEP 1430 H= 357:30 +CPU= 31.727
  02:44:50 STEP 1431 H= 357:45 +CPU= 33.106
  02:45:24 STEP 1432 H= 358:00 +CPU= 34.012
  02:45:56 STEP 1433 H= 358:15 +CPU= 32.289
  02:46:28 STEP 1434 H= 358:30 +CPU= 31.938
  02:47:02 STEP 1435 H= 358:45 +CPU= 33.443
  02:47:36 STEP 1436 H= 359:00 +CPU= 33.433
  02:48:08 STEP 1437 H= 359:15 +CPU= 32.433
  02:48:40 STEP 1438 H= 359:30 +CPU= 31.784
  02:49:11 STEP 1439 H= 359:45 +CPU= 31.318
  02:49:53 STEP 1440 H= 360:00 +CPU= 41.654
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.1747056477E-20      I       0.5851572226E-07      I
ICloud fractionI      0.0000000000E+00      I       0.8805078784E-04      I
I  Relat. Hum. I      0.2009618073E-01      I       0.7782635749E-01      I
I  PASS 01     I      0.0000000000E+00      I       0.4421479989E+01      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    297076545 BYTES IN      7 RECORDS TRANSFERRED IN    0.0007 SECONDS424395.1 Mbytes/s, TOTAL TIME=    0.0167( 4.2%)
 02:49:53 STEP 1440 H= 360:00 +CPU= 41.654
 END CNT3
 NSTEP =  1440 CNT0   000000000  29.561  29.561  29.860   0.990               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           34/  1069125708 WRITTEN        14180/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    253    0       34      1044068    14180 ************   216.4   156.4    60.0   157.4    91.0
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.01      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  521    5333.6    5333.6     17.26      0.00
   9 SPCM     - SPECTRAL COMP.                     480     868.2     868.2      2.59      0.00
  10 SCAN2M - PHYSICS                              481   15078.6   15078.6     45.04      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 40    1892.7    1892.7      0.47      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 21      31.2      31.2      0.00      0.00
  17 GRIDFPOS IN CNT4                               40      32.8      32.8      0.01      0.00
  27 RESTART FILES - WRITING                        10    7564.0    7564.0      0.47      0.00
  28 RESTART FILES - READING                         1  158232.2  158232.2      0.98      0.00
  29 SU4FPOS IN CNT4                                40       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                                40    7446.8    7446.8      1.85      0.00
  31 POSDDH IN STEPO                                 3      91.2      91.2      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    481    7294.8    7294.8     21.79      0.00
  39 SU0YOMB                                         1     376.6     376.6      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    481      27.3      27.3      0.08      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              480     389.0     389.0      1.16      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              480     126.2     126.2      0.38      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 21       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     1044     555.2     555.2      3.60      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      1000     326.0     326.0      2.02      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       1000     120.8     120.8      0.75      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      1044     171.0     171.0      1.11      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      46.6      46.6      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           1044      82.2      82.2      0.53      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           1000      38.9      38.9      0.24      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           1044      45.7      45.7      0.30      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           1000      24.6      24.6      0.15      0.00
 400 GSTATS                                      56453       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 52473       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    16103.7 CPU TIME   15877.9 VECTOR TIME    15877.9


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       81.3
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/2/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/2/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211298/ICMGGh7zg+001416
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3hb_2016092300_15_991_12211298_0_r269615233_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
02:53:29 (1533355): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:51:59 1536642 22311535 oifs_43r3_bl_a3hb_2016092300_15_991_12211298_0 1,295,100 48,253 0.0373


©2024 cpdn.org