climateprediction.net home page
Task 22312565

Task 22312565

Name oifs_43r3_bl_a49c_2016092300_15_991_12212307_0
Workunit 12212307
Created 13 Feb 2023, 22:10:14 UTC
Sent 14 Feb 2023, 5:18:57 UTC
Report deadline 15 Apr 2023, 5:18:57 UTC
Received 16 Mar 2023, 11:21:56 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1537235
Run time 13 hours 42 min 14 sec
CPU time 13 hours 18 min 37 sec
Validate state Valid
Credit 1,813.14
Device peak FLOPS 4.29 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,065.70 MB
Peak swap size 5,930.79 MB
Peak disk usage 1,684.71 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
000000E+01
 GPNORM CLW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.340973100825280E-07 0.000000000000000E+00 0.240513423245995E-03
 GPNORM CIW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.185780069649526E-07 0.000000000000000E+00 0.403562398419142E-04
 GPNORM CC                   AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.109732576527438E-02 0.000000000000000E+00 0.100000000000000E+01
 GPNORM RFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.110141389750853E-11 0.000000000000000E+00 0.300831619336158E-06
 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.165938826225126E-07 0.000000000000000E+00 0.697008147429177E-04
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.101519825986227E-11 0.000000000000000E+00 0.323530472431900E-06
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.772130069853287E-02 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =  1032 STEPO   A00000000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1032 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001032 MODE=w
 IO-STREAM CLOSED - ICMGGh7zg+001032
 MPI-TASK:   1 -    305297226 BYTES IN      6 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0071( 4.2%)
 NSTEP =  1032 STEPO   0AA000000
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMSHh7zg+001032 MODE=a
 IO-STREAM CLOSED - ./ICMSHh7zg+001032
 MPI-TASK:   1 -    707765250 BYTES IN    202 RECORDS TRANSFERRED IN    0.0083 SECONDS 85272.9 Mbytes/s, TOTAL TIME=    0.2205( 3.8%)
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+001032 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+001032
 MPI-TASK:   1 -   4884755607 BYTES IN    125 RECORDS TRANSFERRED IN    0.0043 SECONDS******** Mbytes/s, TOTAL TIME=    0.1483( 2.9%)
 STEPO_FPOS WAS : B00000F00E
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+001032 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+001032
 MPI-TASK:   1 -    296723593 BYTES IN      2 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0034( 5.9%)
 STEPO_FPOS WAS : V00000000Y
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+001032 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+001032
 MPI-TASK:   1 -    305297226 BYTES IN      4 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0055( 5.5%)
 STEPO_FPOS WAS : T00000000M
 NSTEP =  1032 STEPO   0AAA00AAA
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1032 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001032 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001032
 MPI-TASK:   1 -    305297217 BYTES IN      7 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0112( 2.7%)
 07:07:39 STEP 1032 H= 258:00 +CPU= 31.509
 NSTEP =  1033 STEPO   0AAA00AAA
 07:08:05 STEP 1033 H= 258:15 +CPU= 25.545
 NSTEP =  1034 STEPO   0AAA00AAA
 07:08:32 STEP 1034 H= 258:30 +CPU= 26.854
ISTEP=    1035 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP=    1035 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
 NSTEP =  1035 STEPO   0AAA00AAA
 07:09:00 STEP 1035 H= 258:45 +CPU= 28.214
 NSTEP =  1036 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 07:07:12 FULLPOS-V DYNFPOS   1032     2.802    2.802    2.814    426:41    429:42 0.44492800370292E-06       2GB       0MB
 07:07:12 FULLPOS-T DYNFPOS   1032     0.519    0.519    0.521    426:42    429:42 0.44492800370292E-06       2GB       0MB
 07:07:13 0AAA00AAA STEPO     1032     0.523    0.523    0.524    426:42    429:43 0.44492800370292E-06       2GB       0MB
 07:07:39 0AAA00AAA STEPO     1033    26.263   26.263   26.365    427:09    430:09 0.44492800370292E-06       2GB       0MB
 07:08:05 0AAA00AAA STEPO     1034    25.545   25.545   25.648    427:34    430:35 0.44492800370292E-06       2GB       0MB
 07:08:32 0AAA00AAA STEPO     1035    26.855   26.855   27.303    428:01    431:02 0.44492800370292E-06       2GB       0MB
 07:09:00 0AAA00AAA STEPO     1036    28.214   28.214   28.538    428:29    431:30 0.44492800370292E-06       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "    1008",
 CTIME   = "00101200      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 2*0,         996, 2*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =  0.000000000000000E+000,
 GMASSI  =  0.000000000000000E+000
 /
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc-client/slots/4/progress_file_12212307.xml

<running_values>
  <last_cpu_time>29393.540000</last_cpu_time>
  <upload_file_number>10</upload_file_number>
  <last_iter>1036</last_iter>
  <last_upload>864000</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a49c
(argv4) batchid: 991
(argv5) wuid: 12212307
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/4
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/4/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/4/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_b24c467d4486a8f543da62f9d8c77f2d to: /var/lib/boinc-client/slots/4/oifs_43r3_bl_a49c_2016092300_15_991_12212307.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/4/oifs_43r3_bl_a49c_2016092300_15_991_12212307.zip
ic_ancil_file: ic_ancil_12212307
ifsdata_file: ifsdata_12212307
climate_data_file: clim_data_12212307
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/4/ic_ancil_12212307.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/4/ic_ancil_12212307.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_ebddd99dc42406f11f5d83ac8ba4e849 to: /var/lib/boinc-client/slots/4/ifsdata/ifsdata_12212307.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/4/ifsdata/ifsdata_12212307.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/4/159l_2/clim_data_12212307.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/4/159l_2/clim_data_12212307.zip
Checking for progress XML file: /var/lib/boinc-client/slots/4/progress_file_12212307.xml
Opened progress file ok : /var/lib/boinc-client/slots/4/progress_file_12212307.xml
-- Model is restarting --
Adjusting last_iter, 1036, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/4/progress_file_12212307.xml
last_cpu_time: 29393
upload_file_number: 10
last_iter: 1009
last_upload: 864000
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a49c_2016092300_15_991_12212307_0_r1736403240
The child process has been launched with process id: 3062100
Executing the command: /var/lib/boinc-client/slots/4/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:tulipes-System-Product-Name:1:1:3062100:3062100] [20230316:060013:1678942813:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  06:00:49 STEP 1008 H= 252:00 +CPU= 30.761
  06:01:21 STEP 1009 H= 252:15 +CPU= 29.411
  06:01:52 STEP 1010 H= 252:30 +CPU= 29.456
  06:02:23 STEP 1011 H= 252:45 +CPU= 29.451
  06:02:55 STEP 1012 H= 253:00 +CPU= 30.182
  06:03:26 STEP 1013 H= 253:15 +CPU= 29.432
  06:03:58 STEP 1014 H= 253:30 +CPU= 30.188
  06:04:32 STEP 1015 H= 253:45 +CPU= 32.175
  06:05:08 STEP 1016 H= 254:00 +CPU= 33.163
  06:05:44 STEP 1017 H= 254:15 +CPU= 32.636
  06:06:19 STEP 1018 H= 254:30 +CPU= 32.676
  06:06:54 STEP 1019 H= 254:45 +CPU= 32.588
  06:07:44 STEP 1020 H= 255:00 +CPU= 45.760
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001020
  06:08:23 STEP 1021 H= 255:15 +CPU= 36.169
  06:09:01 STEP 1022 H= 255:30 +CPU= 36.105
  06:09:40 STEP 1023 H= 255:45 +CPU= 36.016
  06:10:20 STEP 1024 H= 256:00 +CPU= 37.357
  06:11:00 STEP 1025 H= 256:15 +CPU= 36.458
  06:11:39 STEP 1026 H= 256:30 +CPU= 36.638
  06:12:18 STEP 1027 H= 256:45 +CPU= 35.660
  06:12:53 STEP 1028 H= 257:00 +CPU= 33.283
  06:13:28 STEP 1029 H= 257:15 +CPU= 32.273
  06:14:02 STEP 1030 H= 257:30 +CPU= 32.484
  06:14:37 STEP 1031 H= 257:45 +CPU= 32.381
  06:15:21 STEP 1032 H= 258:00 +CPU= 40.651
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001032
  06:15:59 STEP 1033 H= 258:15 +CPU= 32.873
  06:16:38 STEP 1034 H= 258:30 +CPU= 34.297
  06:17:18 STEP 1035 H= 258:45 +CPU= 36.340
  06:18:01 STEP 1036 H= 259:00 +CPU= 39.983
  06:18:47 STEP 1037 H= 259:15 +CPU= 41.687
  06:19:34 STEP 1038 H= 259:30 +CPU= 42.070
  06:20:19 STEP 1039 H= 259:45 +CPU= 41.811
  06:21:07 STEP 1040 H= 260:00 +CPU= 42.540
  06:21:53 STEP 1041 H= 260:15 +CPU= 42.523
  06:22:40 STEP 1042 H= 260:30 +CPU= 42.600
  06:23:26 STEP 1043 H= 260:45 +CPU= 42.405
  06:24:23 STEP 1044 H= 261:00 +CPU= 52.255
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001044
  06:25:12 STEP 1045 H= 261:15 +CPU= 42.179
  06:26:00 STEP 1046 H= 261:30 +CPU= 43.283
  06:26:47 STEP 1047 H= 261:45 +CPU= 43.033
  06:27:35 STEP 1048 H= 262:00 +CPU= 43.988
  06:28:23 STEP 1049 H= 262:15 +CPU= 42.844
  06:29:09 STEP 1050 H= 262:30 +CPU= 42.809
  06:29:56 STEP 1051 H= 262:45 +CPU= 42.656
  06:30:42 STEP 1052 H= 263:00 +CPU= 42.825
  06:31:29 STEP 1053 H= 263:15 +CPU= 42.621
  06:32:16 STEP 1054 H= 263:30 +CPU= 42.615
  06:33:02 STEP 1055 H= 263:45 +CPU= 42.830
  06:34:07 STEP 1056 H= 264:00 +CPU= 59.388
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a49c_2016092300_15_991_12212307_0_r1736403240_10.zip
Uploading the intermediate file: upload_file_10.zip
  06:34:56 STEP 1057 H= 264:15 +CPU= 43.126
  06:35:45 STEP 1058 H= 264:30 +CPU= 45.167
  06:36:36 STEP 1059 H= 264:45 +CPU= 45.974
  06:37:26 STEP 1060 H= 265:00 +CPU= 46.719
  06:38:17 STEP 1061 H= 265:15 +CPU= 45.567
  06:39:03 STEP 1062 H= 265:30 +CPU= 42.338
  06:39:50 STEP 1063 H= 265:45 +CPU= 42.713
  06:40:37 STEP 1064 H= 266:00 +CPU= 43.749
  06:41:24 STEP 1065 H= 266:15 +CPU= 42.539
  06:42:11 STEP 1066 H= 266:30 +CPU= 42.850
  06:42:58 STEP 1067 H= 266:45 +CPU= 42.767
  06:43:59 STEP 1068 H= 267:00 +CPU= 55.909
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001068
  06:44:49 STEP 1069 H= 267:15 +CPU= 45.628
  06:45:37 STEP 1070 H= 267:30 +CPU= 44.349
  06:46:24 STEP 1071 H= 267:45 +CPU= 42.675
  06:47:12 STEP 1072 H= 268:00 +CPU= 43.590
  06:47:58 STEP 1073 H= 268:15 +CPU= 42.303
  06:48:44 STEP 1074 H= 268:30 +CPU= 42.649
  06:49:31 STEP 1075 H= 268:45 +CPU= 42.789
  06:50:20 STEP 1076 H= 269:00 +CPU= 44.461
  06:51:07 STEP 1077 H= 269:15 +CPU= 42.879
  06:51:54 STEP 1078 H= 269:30 +CPU= 42.837
  06:52:41 STEP 1079 H= 269:45 +CPU= 43.015
  06:53:39 STEP 1080 H= 270:00 +CPU= 52.961
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001080
  06:54:27 STEP 1081 H= 270:15 +CPU= 43.319
  06:55:13 STEP 1082 H= 270:30 +CPU= 42.201
  06:56:01 STEP 1083 H= 270:45 +CPU= 42.653
  06:56:51 STEP 1084 H= 271:00 +CPU= 43.261
  06:57:38 STEP 1085 H= 271:15 +CPU= 41.883
  06:58:26 STEP 1086 H= 271:30 +CPU= 42.297
  06:59:14 STEP 1087 H= 271:45 +CPU= 42.679
  07:00:02 STEP 1088 H= 272:00 +CPU= 43.426
  07:00:50 STEP 1089 H= 272:15 +CPU= 42.314
  07:01:37 STEP 1090 H= 272:30 +CPU= 42.365
  07:02:24 STEP 1091 H= 272:45 +CPU= 42.719
  07:03:23 STEP 1092 H= 273:00 +CPU= 53.706
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001092
  07:04:10 STEP 1093 H= 273:15 +CPU= 42.772
  07:04:57 STEP 1094 H= 273:30 +CPU= 42.807
  07:05:44 STEP 1095 H= 273:45 +CPU= 42.503
  07:06:32 STEP 1096 H= 274:00 +CPU= 43.622
  07:07:19 STEP 1097 H= 274:15 +CPU= 42.261
  07:08:07 STEP 1098 H= 274:30 +CPU= 42.580
  07:08:54 STEP 1099 H= 274:45 +CPU= 42.917
  07:09:42 STEP 1100 H= 275:00 +CPU= 43.405
  07:10:29 STEP 1101 H= 275:15 +CPU= 42.583
  07:11:18 STEP 1102 H= 275:30 +CPU= 41.772
  07:12:05 STEP 1103 H= 275:45 +CPU= 42.863
  07:13:09 STEP 1104 H= 276:00 +CPU= 58.320
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001104
  07:13:56 STEP 1105 H= 276:15 +CPU= 42.858
  07:14:44 STEP 1106 H= 276:30 +CPU= 43.066
  07:15:30 STEP 1107 H= 276:45 +CPU= 42.498
  07:16:18 STEP 1108 H= 277:00 +CPU= 43.546
  07:17:04 STEP 1109 H= 277:15 +CPU= 42.269
  07:17:51 STEP 1110 H= 277:30 +CPU= 42.989
  07:18:38 STEP 1111 H= 277:45 +CPU= 42.556
  07:19:25 STEP 1112 H= 278:00 +CPU= 43.339
  07:20:12 STEP 1113 H= 278:15 +CPU= 42.523
  07:20:59 STEP 1114 H= 278:30 +CPU= 42.357
  07:21:46 STEP 1115 H= 278:45 +CPU= 42.257
  07:22:44 STEP 1116 H= 279:00 +CPU= 53.678
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001116
  07:23:30 STEP 1117 H= 279:15 +CPU= 42.258
  07:24:16 STEP 1118 H= 279:30 +CPU= 42.213
  07:25:04 STEP 1119 H= 279:45 +CPU= 43.045
  07:25:53 STEP 1120 H= 280:00 +CPU= 44.284
  07:26:40 STEP 1121 H= 280:15 +CPU= 42.856
  07:27:28 STEP 1122 H= 280:30 +CPU= 43.030
  07:28:16 STEP 1123 H= 280:45 +CPU= 42.891
  07:29:03 STEP 1124 H= 281:00 +CPU= 43.705
  07:29:49 STEP 1125 H= 281:15 +CPU= 42.245
  07:30:36 STEP 1126 H= 281:30 +CPU= 42.631
  07:31:22 STEP 1127 H= 281:45 +CPU= 42.569
  07:32:21 STEP 1128 H= 282:00 +CPU= 53.209
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001128
  07:33:07 STEP 1129 H= 282:15 +CPU= 42.514
  07:33:54 STEP 1130 H= 282:30 +CPU= 42.317
  07:34:40 STEP 1131 H= 282:45 +CPU= 42.652
  07:35:28 STEP 1132 H= 283:00 +CPU= 43.343
  07:36:14 STEP 1133 H= 283:15 +CPU= 42.450
  07:37:01 STEP 1134 H= 283:30 +CPU= 42.157
  07:37:48 STEP 1135 H= 283:45 +CPU= 42.586
  07:38:35 STEP 1136 H= 284:00 +CPU= 43.066
  07:39:22 STEP 1137 H= 284:15 +CPU= 42.387
  07:40:09 STEP 1138 H= 284:30 +CPU= 42.621
  07:40:56 STEP 1139 H= 284:45 +CPU= 42.571
  07:41:54 STEP 1140 H= 285:00 +CPU= 52.435
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001140
  07:42:40 STEP 1141 H= 285:15 +CPU= 42.320
  07:43:27 STEP 1142 H= 285:30 +CPU= 42.413
  07:44:13 STEP 1143 H= 285:45 +CPU= 42.313
  07:45:01 STEP 1144 H= 286:00 +CPU= 43.408
  07:45:47 STEP 1145 H= 286:15 +CPU= 42.426
  07:46:34 STEP 1146 H= 286:30 +CPU= 43.032
  07:47:20 STEP 1147 H= 286:45 +CPU= 42.313
  07:48:07 STEP 1148 H= 287:00 +CPU= 43.823
  07:48:53 STEP 1149 H= 287:15 +CPU= 42.255
  07:49:40 STEP 1150 H= 287:30 +CPU= 42.954
  07:50:25 STEP 1151 H= 287:45 +CPU= 42.339
  07:51:29 STEP 1152 H= 288:00 +CPU= 58.557
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a49c_2016092300_15_991_12212307_0_r1736403240_11.zip
Uploading the intermediate file: upload_file_11.zip
  07:52:19 STEP 1153 H= 288:15 +CPU= 42.802
  07:53:05 STEP 1154 H= 288:30 +CPU= 42.598
  07:53:52 STEP 1155 H= 288:45 +CPU= 42.592
  07:54:40 STEP 1156 H= 289:00 +CPU= 43.337
  07:55:26 STEP 1157 H= 289:15 +CPU= 42.385
  07:56:12 STEP 1158 H= 289:30 +CPU= 41.975
  07:56:59 STEP 1159 H= 289:45 +CPU= 42.436
  07:57:46 STEP 1160 H= 290:00 +CPU= 43.046
  07:58:33 STEP 1161 H= 290:15 +CPU= 42.476
  07:59:20 STEP 1162 H= 290:30 +CPU= 42.345
  08:00:07 STEP 1163 H= 290:45 +CPU= 42.529
  08:01:05 STEP 1164 H= 291:00 +CPU= 53.662
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001164
  08:01:52 STEP 1165 H= 291:15 +CPU= 42.717
  08:02:38 STEP 1166 H= 291:30 +CPU= 42.648
  08:03:24 STEP 1167 H= 291:45 +CPU= 43.024
  08:04:11 STEP 1168 H= 292:00 +CPU= 43.160
  08:04:59 STEP 1169 H= 292:15 +CPU= 43.085
  08:05:45 STEP 1170 H= 292:30 +CPU= 42.426
  08:06:31 STEP 1171 H= 292:45 +CPU= 42.629
  08:07:19 STEP 1172 H= 293:00 +CPU= 43.537
  08:08:04 STEP 1173 H= 293:15 +CPU= 42.559
  08:08:50 STEP 1174 H= 293:30 +CPU= 42.524
  08:09:37 STEP 1175 H= 293:45 +CPU= 42.665
  08:10:36 STEP 1176 H= 294:00 +CPU= 53.479
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001176
  08:11:23 STEP 1177 H= 294:15 +CPU= 42.574
  08:12:09 STEP 1178 H= 294:30 +CPU= 42.807
  08:12:56 STEP 1179 H= 294:45 +CPU= 42.338
  08:13:43 STEP 1180 H= 295:00 +CPU= 43.608
  08:14:29 STEP 1181 H= 295:15 +CPU= 41.962
  08:15:16 STEP 1182 H= 295:30 +CPU= 42.543
  08:16:02 STEP 1183 H= 295:45 +CPU= 42.333
  08:16:49 STEP 1184 H= 296:00 +CPU= 43.557
  08:17:36 STEP 1185 H= 296:15 +CPU= 42.348
  08:18:22 STEP 1186 H= 296:30 +CPU= 42.319
  08:19:08 STEP 1187 H= 296:45 +CPU= 42.406
  08:20:06 STEP 1188 H= 297:00 +CPU= 53.428
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001188
  08:20:53 STEP 1189 H= 297:15 +CPU= 42.515
  08:21:40 STEP 1190 H= 297:30 +CPU= 42.771
  08:22:28 STEP 1191 H= 297:45 +CPU= 43.086
  08:23:15 STEP 1192 H= 298:00 +CPU= 43.291
  08:24:02 STEP 1193 H= 298:15 +CPU= 42.731
  08:24:49 STEP 1194 H= 298:30 +CPU= 42.710
  08:25:35 STEP 1195 H= 298:45 +CPU= 42.883
  08:26:23 STEP 1196 H= 299:00 +CPU= 43.487
  08:27:09 STEP 1197 H= 299:15 +CPU= 42.497
  08:27:56 STEP 1198 H= 299:30 +CPU= 42.609
  08:28:43 STEP 1199 H= 299:45 +CPU= 42.313
  08:29:48 STEP 1200 H= 300:00 +CPU= 57.684
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001200
  08:30:34 STEP 1201 H= 300:15 +CPU= 42.469
  08:31:20 STEP 1202 H= 300:30 +CPU= 42.268
  08:32:06 STEP 1203 H= 300:45 +CPU= 42.285
  08:32:53 STEP 1204 H= 301:00 +CPU= 43.160
  08:33:39 STEP 1205 H= 301:15 +CPU= 42.296
  08:34:27 STEP 1206 H= 301:30 +CPU= 43.137
  08:35:14 STEP 1207 H= 301:45 +CPU= 42.385
  08:36:02 STEP 1208 H= 302:00 +CPU= 43.574
  08:36:49 STEP 1209 H= 302:15 +CPU= 42.802
  08:37:36 STEP 1210 H= 302:30 +CPU= 42.419
  08:38:23 STEP 1211 H= 302:45 +CPU= 42.866
  08:39:23 STEP 1212 H= 303:00 +CPU= 54.086
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001212
  08:40:10 STEP 1213 H= 303:15 +CPU= 42.327
  08:40:59 STEP 1214 H= 303:30 +CPU= 42.501
  08:41:45 STEP 1215 H= 303:45 +CPU= 42.397
  08:42:33 STEP 1216 H= 304:00 +CPU= 43.391
  08:43:20 STEP 1217 H= 304:15 +CPU= 42.383
  08:44:07 STEP 1218 H= 304:30 +CPU= 43.238
  08:44:54 STEP 1219 H= 304:45 +CPU= 42.341
  08:45:42 STEP 1220 H= 305:00 +CPU= 43.689
  08:46:29 STEP 1221 H= 305:15 +CPU= 42.234
  08:47:15 STEP 1222 H= 305:30 +CPU= 42.226
  08:48:02 STEP 1223 H= 305:45 +CPU= 42.626
  08:48:59 STEP 1224 H= 306:00 +CPU= 51.850
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001224
  08:49:46 STEP 1225 H= 306:15 +CPU= 42.433
  08:50:32 STEP 1226 H= 306:30 +CPU= 42.219
  08:51:19 STEP 1227 H= 306:45 +CPU= 42.123
  08:52:06 STEP 1228 H= 307:00 +CPU= 43.122
  08:52:52 STEP 1229 H= 307:15 +CPU= 42.521
  08:53:39 STEP 1230 H= 307:30 +CPU= 42.431
  08:54:25 STEP 1231 H= 307:45 +CPU= 41.725
  08:55:14 STEP 1232 H= 308:00 +CPU= 42.925
  08:56:01 STEP 1233 H= 308:15 +CPU= 42.302
  08:56:47 STEP 1234 H= 308:30 +CPU= 42.051
  08:57:34 STEP 1235 H= 308:45 +CPU= 42.881
  08:58:33 STEP 1236 H= 309:00 +CPU= 53.107
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001236
  08:59:20 STEP 1237 H= 309:15 +CPU= 42.521
  09:00:07 STEP 1238 H= 309:30 +CPU= 42.329
  09:00:52 STEP 1239 H= 309:45 +CPU= 42.163
  09:01:40 STEP 1240 H= 310:00 +CPU= 43.559
  09:02:26 STEP 1241 H= 310:15 +CPU= 42.083
  09:03:12 STEP 1242 H= 310:30 +CPU= 42.287
  09:03:59 STEP 1243 H= 310:45 +CPU= 41.916
  09:04:48 STEP 1244 H= 311:00 +CPU= 43.177
  09:05:34 STEP 1245 H= 311:15 +CPU= 42.658
  09:06:21 STEP 1246 H= 311:30 +CPU= 42.510
  09:07:08 STEP 1247 H= 311:45 +CPU= 42.751
  09:08:11 STEP 1248 H= 312:00 +CPU= 57.934
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a49c_2016092300_15_991_12212307_0_r1736403240_12.zip
Uploading the intermediate file: upload_file_12.zip
  09:08:58 STEP 1249 H= 312:15 +CPU= 41.991
  09:09:45 STEP 1250 H= 312:30 +CPU= 42.892
  09:10:32 STEP 1251 H= 312:45 +CPU= 42.936
  09:11:21 STEP 1252 H= 313:00 +CPU= 44.304
  09:12:08 STEP 1253 H= 313:15 +CPU= 42.776
  09:12:54 STEP 1254 H= 313:30 +CPU= 42.469
  09:13:39 STEP 1255 H= 313:45 +CPU= 41.935
  09:14:27 STEP 1256 H= 314:00 +CPU= 43.235
  09:15:14 STEP 1257 H= 314:15 +CPU= 42.732
  09:16:00 STEP 1258 H= 314:30 +CPU= 42.875
  09:16:47 STEP 1259 H= 314:45 +CPU= 42.877
  09:17:45 STEP 1260 H= 315:00 +CPU= 53.465
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001260
  09:18:32 STEP 1261 H= 315:15 +CPU= 42.848
  09:19:19 STEP 1262 H= 315:30 +CPU= 42.994
  09:20:05 STEP 1263 H= 315:45 +CPU= 42.603
  09:20:52 STEP 1264 H= 316:00 +CPU= 43.543
  09:21:39 STEP 1265 H= 316:15 +CPU= 42.642
  09:22:26 STEP 1266 H= 316:30 +CPU= 42.441
  09:23:12 STEP 1267 H= 316:45 +CPU= 42.511
  09:23:59 STEP 1268 H= 317:00 +CPU= 43.582
  09:24:46 STEP 1269 H= 317:15 +CPU= 42.930
  09:25:33 STEP 1270 H= 317:30 +CPU= 43.160
  09:26:20 STEP 1271 H= 317:45 +CPU= 43.294
  09:27:19 STEP 1272 H= 318:00 +CPU= 53.110
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001272
  09:28:05 STEP 1273 H= 318:15 +CPU= 42.450
  09:28:53 STEP 1274 H= 318:30 +CPU= 43.078
  09:29:39 STEP 1275 H= 318:45 +CPU= 42.327
  09:30:27 STEP 1276 H= 319:00 +CPU= 43.358
  09:31:14 STEP 1277 H= 319:15 +CPU= 42.782
  09:32:01 STEP 1278 H= 319:30 +CPU= 42.978
  09:32:47 STEP 1279 H= 319:45 +CPU= 42.744
  09:33:36 STEP 1280 H= 320:00 +CPU= 43.989
  09:34:23 STEP 1281 H= 320:15 +CPU= 42.830
  09:35:10 STEP 1282 H= 320:30 +CPU= 43.162
  09:35:56 STEP 1283 H= 320:45 +CPU= 41.800
  09:36:55 STEP 1284 H= 321:00 +CPU= 53.512
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001284
  09:37:41 STEP 1285 H= 321:15 +CPU= 42.648
  09:38:28 STEP 1286 H= 321:30 +CPU= 42.842
  09:39:14 STEP 1287 H= 321:45 +CPU= 42.314
  09:40:00 STEP 1288 H= 322:00 +CPU= 42.925
  09:40:46 STEP 1289 H= 322:15 +CPU= 42.393
  09:41:32 STEP 1290 H= 322:30 +CPU= 42.239
  09:42:19 STEP 1291 H= 322:45 +CPU= 42.946
  09:43:06 STEP 1292 H= 323:00 +CPU= 43.418
  09:43:53 STEP 1293 H= 323:15 +CPU= 42.977
  09:44:41 STEP 1294 H= 323:30 +CPU= 43.070
  09:45:27 STEP 1295 H= 323:45 +CPU= 42.244
  09:46:30 STEP 1296 H= 324:00 +CPU= 57.993
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001296
  09:47:16 STEP 1297 H= 324:15 +CPU= 42.671
  09:48:02 STEP 1298 H= 324:30 +CPU= 42.200
  09:48:49 STEP 1299 H= 324:45 +CPU= 42.741
  09:49:35 STEP 1300 H= 325:00 +CPU= 42.891
  09:50:22 STEP 1301 H= 325:15 +CPU= 42.838
  09:51:08 STEP 1302 H= 325:30 +CPU= 42.362
  09:51:54 STEP 1303 H= 325:45 +CPU= 42.377
  09:52:42 STEP 1304 H= 326:00 +CPU= 43.495
  09:53:29 STEP 1305 H= 326:15 +CPU= 43.188
  09:54:15 STEP 1306 H= 326:30 +CPU= 43.040
  09:55:03 STEP 1307 H= 326:45 +CPU= 43.342
  09:56:01 STEP 1308 H= 327:00 +CPU= 52.598
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001308
  09:56:48 STEP 1309 H= 327:15 +CPU= 42.625
  09:57:34 STEP 1310 H= 327:30 +CPU= 42.536
  09:58:21 STEP 1311 H= 327:45 +CPU= 42.745
  09:59:09 STEP 1312 H= 328:00 +CPU= 43.581
  09:59:57 STEP 1313 H= 328:15 +CPU= 42.520
  10:00:45 STEP 1314 H= 328:30 +CPU= 42.432
  10:01:31 STEP 1315 H= 328:45 +CPU= 42.090
  10:02:19 STEP 1316 H= 329:00 +CPU= 42.971
  10:03:05 STEP 1317 H= 329:15 +CPU= 42.083
  10:03:52 STEP 1318 H= 329:30 +CPU= 43.199
  10:04:39 STEP 1319 H= 329:45 +CPU= 42.302
  10:05:39 STEP 1320 H= 330:00 +CPU= 53.607
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001320
  10:06:26 STEP 1321 H= 330:15 +CPU= 42.895
  10:07:12 STEP 1322 H= 330:30 +CPU= 42.930
  10:08:00 STEP 1323 H= 330:45 +CPU= 42.898
  10:08:48 STEP 1324 H= 331:00 +CPU= 43.742
  10:09:35 STEP 1325 H= 331:15 +CPU= 42.947
  10:10:21 STEP 1326 H= 331:30 +CPU= 42.858
  10:11:09 STEP 1327 H= 331:45 +CPU= 43.085
  10:11:57 STEP 1328 H= 332:00 +CPU= 43.347
  10:12:46 STEP 1329 H= 332:15 +CPU= 42.415
  10:13:34 STEP 1330 H= 332:30 +CPU= 43.684
  10:14:21 STEP 1331 H= 332:45 +CPU= 42.930
  10:15:19 STEP 1332 H= 333:00 +CPU= 52.781
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001332
  10:16:05 STEP 1333 H= 333:15 +CPU= 42.419
  10:16:53 STEP 1334 H= 333:30 +CPU= 42.831
  10:17:39 STEP 1335 H= 333:45 +CPU= 42.530
  10:18:27 STEP 1336 H= 334:00 +CPU= 43.727
  10:19:14 STEP 1337 H= 334:15 +CPU= 43.070
  10:20:01 STEP 1338 H= 334:30 +CPU= 42.797
  10:20:48 STEP 1339 H= 334:45 +CPU= 42.859
  10:21:35 STEP 1340 H= 335:00 +CPU= 43.367
  10:22:22 STEP 1341 H= 335:15 +CPU= 42.721
  10:23:10 STEP 1342 H= 335:30 +CPU= 43.223
  10:23:56 STEP 1343 H= 335:45 +CPU= 42.482
  10:25:00 STEP 1344 H= 336:00 +CPU= 57.854
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a49c_2016092300_15_991_12212307_0_r1736403240_13.zip
Uploading the intermediate file: upload_file_13.zip
  10:25:49 STEP 1345 H= 336:15 +CPU= 42.295
  10:26:35 STEP 1346 H= 336:30 +CPU= 42.494
  10:27:22 STEP 1347 H= 336:45 +CPU= 42.749
  10:28:10 STEP 1348 H= 337:00 +CPU= 43.989
  10:28:58 STEP 1349 H= 337:15 +CPU= 42.999
  10:29:45 STEP 1350 H= 337:30 +CPU= 42.855
  10:30:32 STEP 1351 H= 337:45 +CPU= 43.110
  10:31:22 STEP 1352 H= 338:00 +CPU= 43.861
  10:32:09 STEP 1353 H= 338:15 +CPU= 43.213
  10:32:55 STEP 1354 H= 338:30 +CPU= 42.149
  10:33:43 STEP 1355 H= 338:45 +CPU= 42.979
  10:34:42 STEP 1356 H= 339:00 +CPU= 54.012
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001356
  10:35:28 STEP 1357 H= 339:15 +CPU= 42.594
  10:36:14 STEP 1358 H= 339:30 +CPU= 42.254
  10:37:01 STEP 1359 H= 339:45 +CPU= 42.658
  10:37:49 STEP 1360 H= 340:00 +CPU= 43.763
  10:38:36 STEP 1361 H= 340:15 +CPU= 42.439
  10:39:23 STEP 1362 H= 340:30 +CPU= 42.779
  10:40:09 STEP 1363 H= 340:45 +CPU= 42.157
  10:40:56 STEP 1364 H= 341:00 +CPU= 42.838
  10:41:43 STEP 1365 H= 341:15 +CPU= 42.605
  10:42:29 STEP 1366 H= 341:30 +CPU= 42.321
  10:43:16 STEP 1367 H= 341:45 +CPU= 42.869
  10:44:14 STEP 1368 H= 342:00 +CPU= 52.632
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001368
  10:45:01 STEP 1369 H= 342:15 +CPU= 42.293
  10:45:47 STEP 1370 H= 342:30 +CPU= 42.274
  10:46:34 STEP 1371 H= 342:45 +CPU= 42.943
  10:47:21 STEP 1372 H= 343:00 +CPU= 43.217
  10:48:08 STEP 1373 H= 343:15 +CPU= 42.556
  10:48:54 STEP 1374 H= 343:30 +CPU= 42.292
  10:49:40 STEP 1375 H= 343:45 +CPU= 42.220
  10:50:28 STEP 1376 H= 344:00 +CPU= 43.950
  10:51:15 STEP 1377 H= 344:15 +CPU= 42.908
  10:52:02 STEP 1378 H= 344:30 +CPU= 42.653
  10:52:49 STEP 1379 H= 344:45 +CPU= 42.406
  10:53:48 STEP 1380 H= 345:00 +CPU= 53.215
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001380
  10:54:35 STEP 1381 H= 345:15 +CPU= 42.933
  10:55:22 STEP 1382 H= 345:30 +CPU= 42.824
  10:56:10 STEP 1383 H= 345:45 +CPU= 42.681
  10:56:57 STEP 1384 H= 346:00 +CPU= 43.203
  10:57:43 STEP 1385 H= 346:15 +CPU= 42.473
  10:58:29 STEP 1386 H= 346:30 +CPU= 42.351
  10:59:16 STEP 1387 H= 346:45 +CPU= 42.403
  11:00:03 STEP 1388 H= 347:00 +CPU= 43.043
  11:00:50 STEP 1389 H= 347:15 +CPU= 42.787
  11:01:37 STEP 1390 H= 347:30 +CPU= 42.390
  11:02:24 STEP 1391 H= 347:45 +CPU= 42.677
  11:03:26 STEP 1392 H= 348:00 +CPU= 57.449
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001392
  11:04:13 STEP 1393 H= 348:15 +CPU= 43.114
  11:04:59 STEP 1394 H= 348:30 +CPU= 42.055
  11:05:45 STEP 1395 H= 348:45 +CPU= 42.239
  11:06:31 STEP 1396 H= 349:00 +CPU= 42.992
  11:07:17 STEP 1397 H= 349:15 +CPU= 42.227
  11:08:03 STEP 1398 H= 349:30 +CPU= 42.379
  11:08:49 STEP 1399 H= 349:45 +CPU= 42.454
  11:09:37 STEP 1400 H= 350:00 +CPU= 43.757
  11:10:24 STEP 1401 H= 350:15 +CPU= 42.583
  11:11:10 STEP 1402 H= 350:30 +CPU= 42.825
  11:11:56 STEP 1403 H= 350:45 +CPU= 42.519
  11:12:56 STEP 1404 H= 351:00 +CPU= 54.470
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001404
  11:13:43 STEP 1405 H= 351:15 +CPU= 43.168
  11:14:30 STEP 1406 H= 351:30 +CPU= 43.045
  11:15:17 STEP 1407 H= 351:45 +CPU= 42.860
  11:16:04 STEP 1408 H= 352:00 +CPU= 43.355
  11:16:50 STEP 1409 H= 352:15 +CPU= 42.759
  11:17:38 STEP 1410 H= 352:30 +CPU= 43.305
  11:18:24 STEP 1411 H= 352:45 +CPU= 42.965
  11:19:12 STEP 1412 H= 353:00 +CPU= 43.774
  11:19:55 STEP 1413 H= 353:15 +CPU= 40.695
  11:20:34 STEP 1414 H= 353:30 +CPU= 37.253
  11:21:13 STEP 1415 H= 353:45 +CPU= 37.395
  11:22:00 STEP 1416 H= 354:00 +CPU= 46.267
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001416
  11:22:38 STEP 1417 H= 354:15 +CPU= 37.055
  11:23:16 STEP 1418 H= 354:30 +CPU= 37.355
  11:23:56 STEP 1419 H= 354:45 +CPU= 37.316
  11:24:38 STEP 1420 H= 355:00 +CPU= 37.945
  11:25:18 STEP 1421 H= 355:15 +CPU= 37.082
  11:25:58 STEP 1422 H= 355:30 +CPU= 37.079
  11:26:38 STEP 1423 H= 355:45 +CPU= 37.146
  11:27:20 STEP 1424 H= 356:00 +CPU= 37.968
  11:28:00 STEP 1425 H= 356:15 +CPU= 37.340
  11:28:43 STEP 1426 H= 356:30 +CPU= 36.833
  11:29:23 STEP 1427 H= 356:45 +CPU= 37.365
  11:30:13 STEP 1428 H= 357:00 +CPU= 46.032
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001428
  11:30:53 STEP 1429 H= 357:15 +CPU= 36.931
  11:31:33 STEP 1430 H= 357:30 +CPU= 36.780
  11:32:13 STEP 1431 H= 357:45 +CPU= 37.039
  11:32:54 STEP 1432 H= 358:00 +CPU= 37.873
  11:33:33 STEP 1433 H= 358:15 +CPU= 36.922
  11:34:13 STEP 1434 H= 358:30 +CPU= 37.130
  11:34:53 STEP 1435 H= 358:45 +CPU= 37.015
  11:35:34 STEP 1436 H= 359:00 +CPU= 37.847
  11:36:14 STEP 1437 H= 359:15 +CPU= 37.062
  11:36:54 STEP 1438 H= 359:30 +CPU= 37.069
  11:37:33 STEP 1439 H= 359:45 +CPU= 37.021
  11:38:25 STEP 1440 H= 360:00 +CPU= 47.363
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.3046837269E-21      I       0.1868549850E-05      I
ICloud fractionI      0.0000000000E+00      I       0.1019329232E-01      I
I  Relat. Hum. I      0.2719859360E+00      I       0.3027791782E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.1849339259E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    319383361 BYTES IN      7 RECORDS TRANSFERRED IN    0.0007 SECONDS456261.9 Mbytes/s, TOTAL TIME=    0.0180( 3.9%)
 11:38:25 STEP 1440 H= 360:00 +CPU= 47.363
 END CNT3
 NSTEP =  1440 CNT0   000000000  35.038  35.038  38.261   0.916               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           34/  1069125708 WRITTEN        12762/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    228    0       34      1044068    12762 ************    36.0     2.2    33.9     3.0    73.9
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.98      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  469    7256.3    7256.3     16.77      0.00
   9 SPCM     - SPECTRAL COMP.                     432    1429.6    1429.6      3.04      0.00
  10 SCAN2M - PHYSICS                              433   23317.2   23317.2     49.75      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 36    1344.4    1344.4      0.24      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 19      91.2      91.2      0.01      0.00
  17 GRIDFPOS IN CNT4                               36      52.6      52.6      0.01      0.00
  27 RESTART FILES - WRITING                         9    5375.5    5375.5      0.24      0.00
  28 RESTART FILES - READING                         1    3903.7    3903.7      0.02      0.00
  29 SU4FPOS IN CNT4                                36       1.3       1.3      0.00      0.00
  30 DYNFPOS IN CNT4                                36    9922.9    9922.9      1.76      0.00
  31 POSDDH IN STEPO                                 2      22.7      22.7      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    433    8561.2    8561.2     18.27      0.00
  39 SU0YOMB                                         1     464.3     464.3      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    433      46.2      46.2      0.10      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              432     796.8     796.8      1.70      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              432     107.5     107.5      0.23      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 19       1.6       1.6      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      940     666.8     666.8      3.09      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       900     409.7     409.7      1.82      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        900     141.6     141.6      0.63      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       940     238.7     238.7      1.11      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      45.3      45.3      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            940      75.8      75.8      0.35      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            900      48.9      48.9      0.22      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            940     186.1     186.1      0.86      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            900      47.3      47.3      0.21      0.00
 400 GSTATS                                      50912       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 47318       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    20293.0 CPU TIME   18524.8 VECTOR TIME    18524.8


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       63.9
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/4/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/4/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212307/ICMSHh7zg+001392
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a49c_2016092300_15_991_12212307_0_r1736403240_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
11:41:58 (3062093): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:55:32 1537235 22312565 oifs_43r3_bl_a49c_2016092300_15_991_12212307_0 1,295,100 47,917 0.0370


©2024 climateprediction.net