climateprediction.net home page
Task 22310275

Task 22310275

Name oifs_43r3_bl_a2j6_2016092300_15_991_12210069_0
Workunit 12210069
Created 13 Feb 2023, 18:03:15 UTC
Sent 14 Feb 2023, 0:33:34 UTC
Report deadline 15 Apr 2023, 0:33:34 UTC
Received 14 Feb 2023, 21:09:45 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1538853
Run time 18 hours 13 min 50 sec
CPU time 17 hours 58 min
Validate state Valid
Credit 1,813.14
Device peak FLOPS 1.00 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 4,903.85 MB
Peak swap size 5,930.78 MB
Peak disk usage 1,338.45 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
limateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2j6_2016092300_15_991_12210069_0_r1444537037_9.zip
Uploading the intermediate file: upload_file_9.zip
  05:18:47 STEP  961 H= 240:15 +CPU= 40.881
Uploading trickle at timestep: 864000
  05:19:31 STEP  962 H= 240:30 +CPU= 43.407
  05:20:13 STEP  963 H= 240:45 +CPU= 41.301
  05:20:57 STEP  964 H= 241:00 +CPU= 43.366
  05:21:41 STEP  965 H= 241:15 +CPU= 43.923
  05:22:26 STEP  966 H= 241:30 +CPU= 43.701
  05:23:10 STEP  967 H= 241:45 +CPU= 43.429
  05:23:56 STEP  968 H= 242:00 +CPU= 45.654
  05:24:42 STEP  969 H= 242:15 +CPU= 44.626
  05:25:25 STEP  970 H= 242:30 +CPU= 42.640
  05:26:10 STEP  971 H= 242:45 +CPU= 43.282
  05:27:04 STEP  972 H= 243:00 +CPU= 52.976
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+000972
  05:27:48 STEP  973 H= 243:15 +CPU= 42.825
  05:28:30 STEP  974 H= 243:30 +CPU= 42.099
  05:29:14 STEP  975 H= 243:45 +CPU= 42.277
  05:29:59 STEP  976 H= 244:00 +CPU= 43.882
  05:30:46 STEP  977 H= 244:15 +CPU= 46.510
  05:31:30 STEP  978 H= 244:30 +CPU= 43.290
  05:32:14 STEP  979 H= 244:45 +CPU= 42.945
  05:32:58 STEP  980 H= 245:00 +CPU= 43.265
  05:33:42 STEP  981 H= 245:15 +CPU= 44.328
  05:34:26 STEP  982 H= 245:30 +CPU= 43.102
  05:35:13 STEP  983 H= 245:45 +CPU= 45.972
  05:36:09 STEP  984 H= 246:00 +CPU= 55.223
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+000984
  05:36:56 STEP  985 H= 246:15 +CPU= 45.827
  05:37:41 STEP  986 H= 246:30 +CPU= 43.948
  05:38:27 STEP  987 H= 246:45 +CPU= 45.081
  05:39:11 STEP  988 H= 247:00 +CPU= 43.905
  05:39:56 STEP  989 H= 247:15 +CPU= 44.065
  05:40:41 STEP  990 H= 247:30 +CPU= 44.372
  05:41:27 STEP  991 H= 247:45 +CPU= 44.756
  05:42:12 STEP  992 H= 248:00 +CPU= 44.145
  05:42:58 STEP  993 H= 248:15 +CPU= 45.334
  05:43:46 STEP  994 H= 248:30 +CPU= 46.987
  05:44:30 STEP  995 H= 248:45 +CPU= 43.330
  05:45:28 STEP  996 H= 249:00 +CPU= 56.982
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+000996
  05:46:12 STEP  997 H= 249:15 +CPU= 43.570
  05:46:59 STEP  998 H= 249:30 +CPU= 45.743
  05:47:43 STEP  999 H= 249:45 +CPU= 43.154
  05:48:27 STEP 1000 H= 250:00 +CPU= 43.552
  05:49:13 STEP 1001 H= 250:15 +CPU= 44.943
  05:50:00 STEP 1002 H= 250:30 +CPU= 46.358
  05:50:42 STEP 1003 H= 250:45 +CPU= 42.062
  05:51:27 STEP 1004 H= 251:00 +CPU= 43.989
  05:52:13 STEP 1005 H= 251:15 +CPU= 44.849
  05:52:58 STEP 1006 H= 251:30 +CPU= 43.938
  05:53:42 STEP 1007 H= 251:45 +CPU= 43.907
  05:54:45 STEP 1008 H= 252:00 +CPU= 60.922
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001008
  05:55:31 STEP 1009 H= 252:15 +CPU= 45.128
  05:56:15 STEP 1010 H= 252:30 +CPU= 43.263
  05:57:00 STEP 1011 H= 252:45 +CPU= 44.194
  05:57:47 STEP 1012 H= 253:00 +CPU= 46.899
  05:58:33 STEP 1013 H= 253:15 +CPU= 45.112
  05:59:18 STEP 1014 H= 253:30 +CPU= 43.907
  06:00:03 STEP 1015 H= 253:45 +CPU= 44.273
  06:00:51 STEP 1016 H= 254:00 +CPU= 46.183
  06:01:37 STEP 1017 H= 254:15 +CPU= 46.147
  06:02:22 STEP 1018 H= 254:30 +CPU= 44.221
  06:03:08 STEP 1019 H= 254:45 +CPU= 45.374
  06:04:06 STEP 1020 H= 255:00 +CPU= 56.895
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001020
  06:04:52 STEP 1021 H= 255:15 +CPU= 44.843
  06:05:37 STEP 1022 H= 255:30 +CPU= 44.962
  06:06:20 STEP 1023 H= 255:45 +CPU= 41.997
  06:07:06 STEP 1024 H= 256:00 +CPU= 45.467
  06:07:49 STEP 1025 H= 256:15 +CPU= 42.276
  06:08:32 STEP 1026 H= 256:30 +CPU= 42.718
  06:09:16 STEP 1027 H= 256:45 +CPU= 42.882
  06:10:03 STEP 1028 H= 257:00 +CPU= 47.158
  06:10:49 STEP 1029 H= 257:15 +CPU= 44.995
  06:11:33 STEP 1030 H= 257:30 +CPU= 42.655
  06:12:17 STEP 1031 H= 257:45 +CPU= 43.666
  06:13:15 STEP 1032 H= 258:00 +CPU= 56.754
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001032
  06:14:02 STEP 1033 H= 258:15 +CPU= 44.518
  06:14:48 STEP 1034 H= 258:30 +CPU= 44.489
  06:15:33 STEP 1035 H= 258:45 +CPU= 44.302
  06:16:19 STEP 1036 H= 259:00 +CPU= 44.160
  06:17:04 STEP 1037 H= 259:15 +CPU= 42.956
  06:17:48 STEP 1038 H= 259:30 +CPU= 42.918
  06:18:34 STEP 1039 H= 259:45 +CPU= 44.456
  06:19:20 STEP 1040 H= 260:00 +CPU= 43.236
  06:20:03 STEP 1041 H= 260:15 +CPU= 42.460
  06:20:48 STEP 1042 H= 260:30 +CPU= 41.871
  06:21:34 STEP 1043 H= 260:45 +CPU= 43.069
  06:22:28 STEP 1044 H= 261:00 +CPU= 51.278
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001044
  06:23:15 STEP 1045 H= 261:15 +CPU= 43.975
  06:24:01 STEP 1046 H= 261:30 +CPU= 43.799
  06:24:46 STEP 1047 H= 261:45 +CPU= 43.571
  06:25:32 STEP 1048 H= 262:00 +CPU= 43.088
  06:26:17 STEP 1049 H= 262:15 +CPU= 43.495
  06:27:01 STEP 1050 H= 262:30 +CPU= 42.663
  06:27:48 STEP 1051 H= 262:45 +CPU= 44.298
  06:28:33 STEP 1052 H= 263:00 +CPU= 42.937
  06:29:19 STEP 1053 H= 263:15 +CPU= 43.650
  06:30:05 STEP 1054 H= 263:30 +CPU= 43.949
  06:30:49 STEP 1055 H= 263:45 +CPU= 41.535
  06:31:51 STEP 1056 H= 264:00 +CPU= 58.346
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2j6_2016092300_15_991_12210069_0_r1444537037_10.zip
Uploading the intermediate file: upload_file_10.zip
  06:32:37 STEP 1057 H= 264:15 +CPU= 42.211
  06:33:23 STEP 1058 H= 264:30 +CPU= 41.753
  06:34:10 STEP 1059 H= 264:45 +CPU= 42.789
  06:34:56 STEP 1060 H= 265:00 +CPU= 43.688
  06:35:43 STEP 1061 H= 265:15 +CPU= 43.489
  06:36:29 STEP 1062 H= 265:30 +CPU= 43.604
  06:37:13 STEP 1063 H= 265:45 +CPU= 41.889
  06:38:00 STEP 1064 H= 266:00 +CPU= 45.498
  06:38:48 STEP 1065 H= 266:15 +CPU= 46.174
  06:39:35 STEP 1066 H= 266:30 +CPU= 44.727
  06:40:22 STEP 1067 H= 266:45 +CPU= 45.834
  06:41:21 STEP 1068 H= 267:00 +CPU= 55.909
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001068
  06:42:07 STEP 1069 H= 267:15 +CPU= 44.163
  06:42:54 STEP 1070 H= 267:30 +CPU= 44.695
  06:43:40 STEP 1071 H= 267:45 +CPU= 44.239
  06:44:25 STEP 1072 H= 268:00 +CPU= 43.966
  06:45:09 STEP 1073 H= 268:15 +CPU= 43.150
  06:45:54 STEP 1074 H= 268:30 +CPU= 43.265
  06:46:38 STEP 1075 H= 268:45 +CPU= 42.776
  06:47:27 STEP 1076 H= 269:00 +CPU= 46.453
  06:48:13 STEP 1077 H= 269:15 +CPU= 44.132
  06:48:58 STEP 1078 H= 269:30 +CPU= 43.625
  06:49:43 STEP 1079 H= 269:45 +CPU= 44.931
  06:50:37 STEP 1080 H= 270:00 +CPU= 52.924
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001080
  06:51:21 STEP 1081 H= 270:15 +CPU= 43.545
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a2j6
(argv4) batchid: 991
(argv5) wuid: 12210069
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/39
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/39/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/39/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_240c28e6d58984ded7aaaff3b71a12f9 to: /var/lib/boinc-client/slots/39/oifs_43r3_bl_a2j6_2016092300_15_991_12210069.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/39/oifs_43r3_bl_a2j6_2016092300_15_991_12210069.zip
ic_ancil_file: ic_ancil_12210069
ifsdata_file: ifsdata_12210069
climate_data_file: clim_data_12210069
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/39/ic_ancil_12210069.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/39/ic_ancil_12210069.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_dbb88b04866b5214177db48515790463 to: /var/lib/boinc-client/slots/39/ifsdata/ifsdata_12210069.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/39/ifsdata/ifsdata_12210069.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/39/159l_2/clim_data_12210069.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/39/159l_2/clim_data_12210069.zip
Checking for progress XML file: /var/lib/boinc-client/slots/39/progress_file_12210069.xml
Opened progress file ok : /var/lib/boinc-client/slots/39/progress_file_12210069.xml
-- Model is restarting --
Adjusting last_iter, 1082, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/39/progress_file_12210069.xml
last_cpu_time: 48200
upload_file_number: 11
last_iter: 1057
last_upload: 950400
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a2j6_2016092300_15_991_12210069_0_r1444537037
The child process has been launched with process id: 2380
Executing the command: /var/lib/boinc-client/slots/39/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:bruce-x99:1:1:2380:2380] [20230214:065633:1676386593:0.001] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  06:57:25 STEP 1056 H= 264:00 +CPU= 38.769
  06:58:08 STEP 1057 H= 264:15 +CPU= 42.218
  06:58:52 STEP 1058 H= 264:30 +CPU= 42.853
  06:59:33 STEP 1059 H= 264:45 +CPU= 40.766
  07:00:16 STEP 1060 H= 265:00 +CPU= 42.648
  07:01:00 STEP 1061 H= 265:15 +CPU= 44.283
  07:01:40 STEP 1062 H= 265:30 +CPU= 39.985
  07:02:24 STEP 1063 H= 265:45 +CPU= 43.436
  07:03:07 STEP 1064 H= 266:00 +CPU= 43.227
  07:03:50 STEP 1065 H= 266:15 +CPU= 42.409
  07:04:34 STEP 1066 H= 266:30 +CPU= 43.992
  07:05:16 STEP 1067 H= 266:45 +CPU= 41.955
  07:06:08 STEP 1068 H= 267:00 +CPU= 51.634
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001068
  07:06:52 STEP 1069 H= 267:15 +CPU= 43.533
  07:07:36 STEP 1070 H= 267:30 +CPU= 43.699
  07:08:16 STEP 1071 H= 267:45 +CPU= 40.108
  07:09:01 STEP 1072 H= 268:00 +CPU= 44.366
  07:09:45 STEP 1073 H= 268:15 +CPU= 43.371
  07:10:27 STEP 1074 H= 268:30 +CPU= 42.368
  07:11:13 STEP 1075 H= 268:45 +CPU= 46.234
  07:11:58 STEP 1076 H= 269:00 +CPU= 44.342
  07:12:41 STEP 1077 H= 269:15 +CPU= 42.720
  07:13:25 STEP 1078 H= 269:30 +CPU= 43.403
  07:14:04 STEP 1079 H= 269:45 +CPU= 39.201
  07:14:58 STEP 1080 H= 270:00 +CPU= 53.531
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001080
  07:15:42 STEP 1081 H= 270:15 +CPU= 43.947
  07:16:24 STEP 1082 H= 270:30 +CPU= 41.659
  07:17:08 STEP 1083 H= 270:45 +CPU= 44.158
  07:17:52 STEP 1084 H= 271:00 +CPU= 43.412
  07:18:34 STEP 1085 H= 271:15 +CPU= 41.631
  07:19:16 STEP 1086 H= 271:30 +CPU= 42.589
  07:20:00 STEP 1087 H= 271:45 +CPU= 43.265
  07:20:41 STEP 1088 H= 272:00 +CPU= 41.562
  07:21:24 STEP 1089 H= 272:15 +CPU= 42.923
  07:22:08 STEP 1090 H= 272:30 +CPU= 43.510
  07:22:50 STEP 1091 H= 272:45 +CPU= 41.522
  07:23:44 STEP 1092 H= 273:00 +CPU= 53.822
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001092
  07:24:27 STEP 1093 H= 273:15 +CPU= 42.992
  07:25:09 STEP 1094 H= 273:30 +CPU= 41.768
  07:25:53 STEP 1095 H= 273:45 +CPU= 42.827
  07:26:37 STEP 1096 H= 274:00 +CPU= 43.500
  07:27:20 STEP 1097 H= 274:15 +CPU= 43.559
  07:28:05 STEP 1098 H= 274:30 +CPU= 44.184
  07:28:47 STEP 1099 H= 274:45 +CPU= 41.808
  07:29:31 STEP 1100 H= 275:00 +CPU= 43.812
  07:30:15 STEP 1101 H= 275:15 +CPU= 44.278
  07:30:57 STEP 1102 H= 275:30 +CPU= 41.154
  07:31:38 STEP 1103 H= 275:45 +CPU= 40.843
  07:32:37 STEP 1104 H= 276:00 +CPU= 58.454
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001104
  07:33:19 STEP 1105 H= 276:15 +CPU= 41.839
  07:33:53 STEP 1106 H= 276:30 +CPU= 34.103
  07:34:29 STEP 1107 H= 276:45 +CPU= 35.015
  07:35:02 STEP 1108 H= 277:00 +CPU= 33.548
  07:35:38 STEP 1109 H= 277:15 +CPU= 35.646
  07:36:16 STEP 1110 H= 277:30 +CPU= 37.398
  07:36:54 STEP 1111 H= 277:45 +CPU= 37.572
  07:37:32 STEP 1112 H= 278:00 +CPU= 37.691
  07:38:08 STEP 1113 H= 278:15 +CPU= 35.730
  07:38:45 STEP 1114 H= 278:30 +CPU= 36.596
  07:39:24 STEP 1115 H= 278:45 +CPU= 38.833
  07:40:10 STEP 1116 H= 279:00 +CPU= 45.121
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001116
  07:40:47 STEP 1117 H= 279:15 +CPU= 37.326
  07:41:26 STEP 1118 H= 279:30 +CPU= 38.527
  07:42:06 STEP 1119 H= 279:45 +CPU= 38.902
  07:42:45 STEP 1120 H= 280:00 +CPU= 38.989
  07:43:24 STEP 1121 H= 280:15 +CPU= 38.716
  07:44:03 STEP 1122 H= 280:30 +CPU= 38.510
  07:44:41 STEP 1123 H= 280:45 +CPU= 38.178
  07:45:22 STEP 1124 H= 281:00 +CPU= 40.375
  07:46:02 STEP 1125 H= 281:15 +CPU= 39.543
  07:46:42 STEP 1126 H= 281:30 +CPU= 39.112
  07:47:22 STEP 1127 H= 281:45 +CPU= 39.625
  07:48:09 STEP 1128 H= 282:00 +CPU= 46.771
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001128
  07:48:48 STEP 1129 H= 282:15 +CPU= 38.917
  07:49:27 STEP 1130 H= 282:30 +CPU= 38.550
  07:50:06 STEP 1131 H= 282:45 +CPU= 38.129
  07:50:46 STEP 1132 H= 283:00 +CPU= 39.529
  07:51:26 STEP 1133 H= 283:15 +CPU= 39.431
  07:52:07 STEP 1134 H= 283:30 +CPU= 39.714
  07:52:46 STEP 1135 H= 283:45 +CPU= 39.019
  07:53:27 STEP 1136 H= 284:00 +CPU= 40.688
  07:54:07 STEP 1137 H= 284:15 +CPU= 39.128
  07:54:47 STEP 1138 H= 284:30 +CPU= 39.466
  07:55:26 STEP 1139 H= 284:45 +CPU= 38.791
  07:56:17 STEP 1140 H= 285:00 +CPU= 49.523
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001140
  07:56:57 STEP 1141 H= 285:15 +CPU= 39.828
  07:57:38 STEP 1142 H= 285:30 +CPU= 40.431
  07:58:19 STEP 1143 H= 285:45 +CPU= 40.333
  07:58:59 STEP 1144 H= 286:00 +CPU= 39.544
  07:59:38 STEP 1145 H= 286:15 +CPU= 38.426
  08:00:18 STEP 1146 H= 286:30 +CPU= 39.751
  08:00:59 STEP 1147 H= 286:45 +CPU= 40.163
  08:01:39 STEP 1148 H= 287:00 +CPU= 39.864
  08:02:18 STEP 1149 H= 287:15 +CPU= 38.707
  08:02:58 STEP 1150 H= 287:30 +CPU= 39.410
  08:03:38 STEP 1151 H= 287:45 +CPU= 39.126
  08:04:31 STEP 1152 H= 288:00 +CPU= 52.298
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2j6_2016092300_15_991_12210069_0_r1444537037_11.zip
Uploading the intermediate file: upload_file_11.zip
  08:05:10 STEP 1153 H= 288:15 +CPU= 38.826
  08:05:50 STEP 1154 H= 288:30 +CPU= 39.269
  08:06:31 STEP 1155 H= 288:45 +CPU= 40.662
  08:07:11 STEP 1156 H= 289:00 +CPU= 40.061
  08:07:51 STEP 1157 H= 289:15 +CPU= 39.443
  08:08:31 STEP 1158 H= 289:30 +CPU= 39.237
  08:09:11 STEP 1159 H= 289:45 +CPU= 39.654
  08:09:51 STEP 1160 H= 290:00 +CPU= 39.953
  08:10:32 STEP 1161 H= 290:15 +CPU= 39.994
  08:11:12 STEP 1162 H= 290:30 +CPU= 39.474
  08:11:51 STEP 1163 H= 290:45 +CPU= 38.847
  08:12:40 STEP 1164 H= 291:00 +CPU= 48.867
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001164
  08:13:18 STEP 1165 H= 291:15 +CPU= 37.708
  08:13:58 STEP 1166 H= 291:30 +CPU= 39.036
  08:14:37 STEP 1167 H= 291:45 +CPU= 38.888
  08:15:18 STEP 1168 H= 292:00 +CPU= 40.864
  08:15:58 STEP 1169 H= 292:15 +CPU= 39.457
  08:16:37 STEP 1170 H= 292:30 +CPU= 39.138
  08:17:17 STEP 1171 H= 292:45 +CPU= 39.705
  08:17:58 STEP 1172 H= 293:00 +CPU= 39.913
  08:18:37 STEP 1173 H= 293:15 +CPU= 38.830
  08:19:17 STEP 1174 H= 293:30 +CPU= 39.825
  08:19:57 STEP 1175 H= 293:45 +CPU= 39.472
  08:20:45 STEP 1176 H= 294:00 +CPU= 47.915
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001176
  08:21:24 STEP 1177 H= 294:15 +CPU= 38.555
  08:22:03 STEP 1178 H= 294:30 +CPU= 38.722
  08:22:43 STEP 1179 H= 294:45 +CPU= 38.859
  08:23:22 STEP 1180 H= 295:00 +CPU= 39.000
  08:24:01 STEP 1181 H= 295:15 +CPU= 38.470
  08:24:40 STEP 1182 H= 295:30 +CPU= 38.481
  08:25:19 STEP 1183 H= 295:45 +CPU= 39.095
  08:25:59 STEP 1184 H= 296:00 +CPU= 39.265
  08:26:38 STEP 1185 H= 296:15 +CPU= 39.211
  08:27:18 STEP 1186 H= 296:30 +CPU= 39.763
  08:27:58 STEP 1187 H= 296:45 +CPU= 39.419
  08:28:48 STEP 1188 H= 297:00 +CPU= 49.600
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001188
  08:29:28 STEP 1189 H= 297:15 +CPU= 39.012
  08:30:07 STEP 1190 H= 297:30 +CPU= 39.405
  08:30:48 STEP 1191 H= 297:45 +CPU= 40.548
  08:31:29 STEP 1192 H= 298:00 +CPU= 40.774
  08:32:10 STEP 1193 H= 298:15 +CPU= 40.107
  08:32:49 STEP 1194 H= 298:30 +CPU= 38.961
  08:33:30 STEP 1195 H= 298:45 +CPU= 40.601
  08:34:11 STEP 1196 H= 299:00 +CPU= 41.082
  08:34:51 STEP 1197 H= 299:15 +CPU= 39.771
  08:35:29 STEP 1198 H= 299:30 +CPU= 37.046
  08:36:09 STEP 1199 H= 299:45 +CPU= 39.560
  08:37:02 STEP 1200 H= 300:00 +CPU= 52.634
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001200
  08:37:42 STEP 1201 H= 300:15 +CPU= 39.464
  08:38:22 STEP 1202 H= 300:30 +CPU= 39.341
  08:39:02 STEP 1203 H= 300:45 +CPU= 40.034
  08:39:43 STEP 1204 H= 301:00 +CPU= 40.249
  08:40:23 STEP 1205 H= 301:15 +CPU= 39.896
  08:41:02 STEP 1206 H= 301:30 +CPU= 38.445
  08:41:41 STEP 1207 H= 301:45 +CPU= 39.315
  08:42:21 STEP 1208 H= 302:00 +CPU= 38.892
  08:43:00 STEP 1209 H= 302:15 +CPU= 39.403
  08:43:40 STEP 1210 H= 302:30 +CPU= 39.025
  08:44:18 STEP 1211 H= 302:45 +CPU= 38.090
  08:45:07 STEP 1212 H= 303:00 +CPU= 48.199
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001212
  08:45:46 STEP 1213 H= 303:15 +CPU= 38.475
  08:46:25 STEP 1214 H= 303:30 +CPU= 38.570
  08:47:04 STEP 1215 H= 303:45 +CPU= 38.910
  08:47:44 STEP 1216 H= 304:00 +CPU= 39.817
  08:48:24 STEP 1217 H= 304:15 +CPU= 39.522
  08:49:04 STEP 1218 H= 304:30 +CPU= 39.431
  08:49:43 STEP 1219 H= 304:45 +CPU= 39.370
  08:50:24 STEP 1220 H= 305:00 +CPU= 40.466
  08:51:03 STEP 1221 H= 305:15 +CPU= 39.155
  08:51:44 STEP 1222 H= 305:30 +CPU= 39.965
  08:52:23 STEP 1223 H= 305:45 +CPU= 38.911
  08:53:12 STEP 1224 H= 306:00 +CPU= 48.623
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001224
  08:53:51 STEP 1225 H= 306:15 +CPU= 38.761
  08:54:30 STEP 1226 H= 306:30 +CPU= 38.624
  08:55:10 STEP 1227 H= 306:45 +CPU= 39.301
  08:55:49 STEP 1228 H= 307:00 +CPU= 38.897
  08:56:29 STEP 1229 H= 307:15 +CPU= 39.399
  08:57:09 STEP 1230 H= 307:30 +CPU= 40.096
  08:57:50 STEP 1231 H= 307:45 +CPU= 40.155
  08:58:32 STEP 1232 H= 308:00 +CPU= 41.539
  08:59:13 STEP 1233 H= 308:15 +CPU= 40.540
  08:59:54 STEP 1234 H= 308:30 +CPU= 40.509
  09:00:44 STEP 1235 H= 308:45 +CPU= 44.122
  09:01:39 STEP 1236 H= 309:00 +CPU= 54.508
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001236
  09:02:21 STEP 1237 H= 309:15 +CPU= 42.031
  09:03:06 STEP 1238 H= 309:30 +CPU= 43.744
  09:03:51 STEP 1239 H= 309:45 +CPU= 44.231
  09:04:43 STEP 1240 H= 310:00 +CPU= 45.828
  09:05:31 STEP 1241 H= 310:15 +CPU= 46.759
  09:06:18 STEP 1242 H= 310:30 +CPU= 45.605
  09:07:05 STEP 1243 H= 310:45 +CPU= 44.480
  09:07:54 STEP 1244 H= 311:00 +CPU= 47.446
  09:08:47 STEP 1245 H= 311:15 +CPU= 43.931
  09:09:35 STEP 1246 H= 311:30 +CPU= 44.913
  09:10:23 STEP 1247 H= 311:45 +CPU= 46.645
  09:11:29 STEP 1248 H= 312:00 +CPU= 60.198
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2j6_2016092300_15_991_12210069_0_r1444537037_12.zip
Uploading the intermediate file: upload_file_12.zip
  09:12:20 STEP 1249 H= 312:15 +CPU= 46.114
  09:13:55 STEP 1250 H= 312:30 +CPU= 45.700
  09:16:39 STEP 1251 H= 312:45 +CPU= 43.535
  09:31:17 STEP 1252 H= 313:00 +CPU= 51.341
  09:32:02 STEP 1253 H= 313:15 +CPU= 44.184
  09:32:50 STEP 1254 H= 313:30 +CPU= 46.784
  09:33:36 STEP 1255 H= 313:45 +CPU= 44.434
  09:34:22 STEP 1256 H= 314:00 +CPU= 45.464
  09:35:10 STEP 1257 H= 314:15 +CPU= 45.799
  10:07:58 STEP 1258 H= 314:30 +CPU= 52.332
  10:08:41 STEP 1259 H= 314:45 +CPU= 42.795
  10:09:39 STEP 1260 H= 315:00 +CPU= 56.585
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001260
  10:10:24 STEP 1261 H= 315:15 +CPU= 44.283
  10:11:08 STEP 1262 H= 315:30 +CPU= 43.608
  10:11:53 STEP 1263 H= 315:45 +CPU= 45.125
  10:12:39 STEP 1264 H= 316:00 +CPU= 44.676
  10:13:24 STEP 1265 H= 316:15 +CPU= 45.183
  10:14:10 STEP 1266 H= 316:30 +CPU= 45.301
  10:14:54 STEP 1267 H= 316:45 +CPU= 42.983
  10:15:40 STEP 1268 H= 317:00 +CPU= 45.358
  10:16:25 STEP 1269 H= 317:15 +CPU= 44.849
  10:17:09 STEP 1270 H= 317:30 +CPU= 43.672
  10:17:54 STEP 1271 H= 317:45 +CPU= 44.112
  10:18:48 STEP 1272 H= 318:00 +CPU= 53.711
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001272
  10:19:31 STEP 1273 H= 318:15 +CPU= 42.778
  10:20:17 STEP 1274 H= 318:30 +CPU= 44.613
  10:21:02 STEP 1275 H= 318:45 +CPU= 44.765
  10:21:47 STEP 1276 H= 319:00 +CPU= 44.266
  10:22:32 STEP 1277 H= 319:15 +CPU= 44.967
  10:23:16 STEP 1278 H= 319:30 +CPU= 43.582
  10:24:00 STEP 1279 H= 319:45 +CPU= 43.144
  10:24:47 STEP 1280 H= 320:00 +CPU= 45.974
  10:25:30 STEP 1281 H= 320:15 +CPU= 42.813
  10:26:15 STEP 1282 H= 320:30 +CPU= 44.234
  10:27:00 STEP 1283 H= 320:45 +CPU= 45.238
  10:27:54 STEP 1284 H= 321:00 +CPU= 53.091
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001284
  10:28:40 STEP 1285 H= 321:15 +CPU= 45.473
  10:29:25 STEP 1286 H= 321:30 +CPU= 44.072
  10:30:08 STEP 1287 H= 321:45 +CPU= 42.283
  10:30:54 STEP 1288 H= 322:00 +CPU= 45.636
  10:31:38 STEP 1289 H= 322:15 +CPU= 43.943
  10:32:21 STEP 1290 H= 322:30 +CPU= 42.385
  10:33:07 STEP 1291 H= 322:45 +CPU= 45.046
  10:33:52 STEP 1292 H= 323:00 +CPU= 44.795
  10:34:36 STEP 1293 H= 323:15 +CPU= 43.377
  10:35:21 STEP 1294 H= 323:30 +CPU= 44.579
  10:36:04 STEP 1295 H= 323:45 +CPU= 42.693
  10:37:05 STEP 1296 H= 324:00 +CPU= 59.642
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001296
  10:37:50 STEP 1297 H= 324:15 +CPU= 44.487
  10:38:34 STEP 1298 H= 324:30 +CPU= 43.387
  10:39:18 STEP 1299 H= 324:45 +CPU= 43.783
  10:40:03 STEP 1300 H= 325:00 +CPU= 44.013
  10:40:46 STEP 1301 H= 325:15 +CPU= 42.476
  10:41:31 STEP 1302 H= 325:30 +CPU= 44.614
  10:42:15 STEP 1303 H= 325:45 +CPU= 43.515
  10:43:00 STEP 1304 H= 326:00 +CPU= 44.425
  10:43:45 STEP 1305 H= 326:15 +CPU= 44.901
  10:44:29 STEP 1306 H= 326:30 +CPU= 43.170
  10:45:13 STEP 1307 H= 326:45 +CPU= 43.226
  10:46:08 STEP 1308 H= 327:00 +CPU= 54.809
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001308
  10:46:50 STEP 1309 H= 327:15 +CPU= 41.493
  10:47:33 STEP 1310 H= 327:30 +CPU= 42.786
  10:48:18 STEP 1311 H= 327:45 +CPU= 44.357
  10:49:01 STEP 1312 H= 328:00 +CPU= 42.752
  10:49:46 STEP 1313 H= 328:15 +CPU= 43.476
  10:50:30 STEP 1314 H= 328:30 +CPU= 44.114
  10:51:15 STEP 1315 H= 328:45 +CPU= 43.774
  10:52:00 STEP 1316 H= 329:00 +CPU= 44.940
  10:52:44 STEP 1317 H= 329:15 +CPU= 43.287
  10:53:27 STEP 1318 H= 329:30 +CPU= 42.739
  10:54:12 STEP 1319 H= 329:45 +CPU= 44.694
  10:55:07 STEP 1320 H= 330:00 +CPU= 54.263
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001320
  10:55:51 STEP 1321 H= 330:15 +CPU= 43.834
  10:56:37 STEP 1322 H= 330:30 +CPU= 45.409
  10:57:21 STEP 1323 H= 330:45 +CPU= 43.539
  10:58:07 STEP 1324 H= 331:00 +CPU= 45.668
  10:58:52 STEP 1325 H= 331:15 +CPU= 44.143
  10:59:36 STEP 1326 H= 331:30 +CPU= 43.583
  11:00:20 STEP 1327 H= 331:45 +CPU= 43.645
  11:01:05 STEP 1328 H= 332:00 +CPU= 44.359
  11:01:48 STEP 1329 H= 332:15 +CPU= 42.859
  11:02:34 STEP 1330 H= 332:30 +CPU= 44.892
  11:03:19 STEP 1331 H= 332:45 +CPU= 44.884
  11:04:14 STEP 1332 H= 333:00 +CPU= 53.809
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001332
  11:04:58 STEP 1333 H= 333:15 +CPU= 43.376
  11:05:41 STEP 1334 H= 333:30 +CPU= 42.414
  11:06:25 STEP 1335 H= 333:45 +CPU= 43.739
  11:07:10 STEP 1336 H= 334:00 +CPU= 45.035
  11:07:55 STEP 1337 H= 334:15 +CPU= 43.457
  11:08:39 STEP 1338 H= 334:30 +CPU= 43.976
  11:09:24 STEP 1339 H= 334:45 +CPU= 43.642
  11:10:07 STEP 1340 H= 335:00 +CPU= 43.091
  11:10:51 STEP 1341 H= 335:15 +CPU= 42.953
  11:11:34 STEP 1342 H= 335:30 +CPU= 43.101
  11:12:17 STEP 1343 H= 335:45 +CPU= 41.960
  11:13:16 STEP 1344 H= 336:00 +CPU= 59.192
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2j6_2016092300_15_991_12210069_0_r1444537037_13.zip
Uploading the intermediate file: upload_file_13.zip
  11:14:00 STEP 1345 H= 336:15 +CPU= 43.015
  11:14:44 STEP 1346 H= 336:30 +CPU= 43.024
  11:15:27 STEP 1347 H= 336:45 +CPU= 42.647
  11:16:10 STEP 1348 H= 337:00 +CPU= 42.879
  11:16:54 STEP 1349 H= 337:15 +CPU= 43.368
  11:17:37 STEP 1350 H= 337:30 +CPU= 42.490
  11:18:20 STEP 1351 H= 337:45 +CPU= 42.465
  11:19:04 STEP 1352 H= 338:00 +CPU= 43.823
  11:19:48 STEP 1353 H= 338:15 +CPU= 43.128
  11:20:30 STEP 1354 H= 338:30 +CPU= 41.809
  11:21:14 STEP 1355 H= 338:45 +CPU= 43.814
  11:22:08 STEP 1356 H= 339:00 +CPU= 53.374
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001356
  11:22:51 STEP 1357 H= 339:15 +CPU= 42.180
  11:23:35 STEP 1358 H= 339:30 +CPU= 43.607
  11:24:18 STEP 1359 H= 339:45 +CPU= 42.598
  11:25:02 STEP 1360 H= 340:00 +CPU= 43.835
  11:25:45 STEP 1361 H= 340:15 +CPU= 42.644
  11:26:29 STEP 1362 H= 340:30 +CPU= 43.589
  11:27:13 STEP 1363 H= 340:45 +CPU= 43.506
  11:27:57 STEP 1364 H= 341:00 +CPU= 43.543
  11:28:40 STEP 1365 H= 341:15 +CPU= 42.973
  11:29:25 STEP 1366 H= 341:30 +CPU= 44.510
  11:30:10 STEP 1367 H= 341:45 +CPU= 44.575
  11:31:04 STEP 1368 H= 342:00 +CPU= 52.799
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001368
  11:31:48 STEP 1369 H= 342:15 +CPU= 43.482
  11:32:31 STEP 1370 H= 342:30 +CPU= 42.735
  11:33:16 STEP 1371 H= 342:45 +CPU= 44.373
  11:34:00 STEP 1372 H= 343:00 +CPU= 44.045
  11:34:43 STEP 1373 H= 343:15 +CPU= 42.685
  11:35:27 STEP 1374 H= 343:30 +CPU= 43.234
  11:36:10 STEP 1375 H= 343:45 +CPU= 42.845
  11:36:55 STEP 1376 H= 344:00 +CPU= 44.222
  11:37:39 STEP 1377 H= 344:15 +CPU= 43.148
  11:38:22 STEP 1378 H= 344:30 +CPU= 42.681
  11:39:04 STEP 1379 H= 344:45 +CPU= 41.871
  11:39:59 STEP 1380 H= 345:00 +CPU= 54.074
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001380
  11:40:41 STEP 1381 H= 345:15 +CPU= 41.922
  11:41:24 STEP 1382 H= 345:30 +CPU= 42.800
  11:42:08 STEP 1383 H= 345:45 +CPU= 43.533
  11:42:53 STEP 1384 H= 346:00 +CPU= 44.172
  11:43:37 STEP 1385 H= 346:15 +CPU= 43.987
  11:44:21 STEP 1386 H= 346:30 +CPU= 43.622
  11:45:05 STEP 1387 H= 346:45 +CPU= 43.354
  11:45:51 STEP 1388 H= 347:00 +CPU= 45.178
  11:46:35 STEP 1389 H= 347:15 +CPU= 43.437
  11:47:18 STEP 1390 H= 347:30 +CPU= 43.391
  11:48:02 STEP 1391 H= 347:45 +CPU= 42.991
  11:49:02 STEP 1392 H= 348:00 +CPU= 59.763
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001392
  11:49:46 STEP 1393 H= 348:15 +CPU= 43.723
  11:50:30 STEP 1394 H= 348:30 +CPU= 43.414
  11:51:14 STEP 1395 H= 348:45 +CPU= 43.182
  11:51:59 STEP 1396 H= 349:00 +CPU= 44.463
  11:52:42 STEP 1397 H= 349:15 +CPU= 42.887
  11:53:25 STEP 1398 H= 349:30 +CPU= 42.424
  11:54:09 STEP 1399 H= 349:45 +CPU= 43.711
  11:54:54 STEP 1400 H= 350:00 +CPU= 43.770
  11:55:37 STEP 1401 H= 350:15 +CPU= 43.144
  11:56:21 STEP 1402 H= 350:30 +CPU= 43.201
  11:57:04 STEP 1403 H= 350:45 +CPU= 42.987
  11:57:58 STEP 1404 H= 351:00 +CPU= 53.477
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001404
  11:58:41 STEP 1405 H= 351:15 +CPU= 42.926
  11:59:24 STEP 1406 H= 351:30 +CPU= 42.700
  12:00:08 STEP 1407 H= 351:45 +CPU= 43.174
  12:00:50 STEP 1408 H= 352:00 +CPU= 42.510
  12:01:32 STEP 1409 H= 352:15 +CPU= 41.314
  12:02:14 STEP 1410 H= 352:30 +CPU= 42.120
  12:02:57 STEP 1411 H= 352:45 +CPU= 42.042
  12:03:40 STEP 1412 H= 353:00 +CPU= 42.698
  12:04:21 STEP 1413 H= 353:15 +CPU= 41.404
  12:05:03 STEP 1414 H= 353:30 +CPU= 40.955
  12:05:44 STEP 1415 H= 353:45 +CPU= 40.960
  12:06:35 STEP 1416 H= 354:00 +CPU= 51.075
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001416
  12:07:16 STEP 1417 H= 354:15 +CPU= 40.600
  12:08:00 STEP 1418 H= 354:30 +CPU= 44.163
  12:08:43 STEP 1419 H= 354:45 +CPU= 41.910
  12:09:23 STEP 1420 H= 355:00 +CPU= 40.665
  12:10:07 STEP 1421 H= 355:15 +CPU= 43.256
  12:10:49 STEP 1422 H= 355:30 +CPU= 41.253
  12:11:28 STEP 1423 H= 355:45 +CPU= 39.575
  12:12:10 STEP 1424 H= 356:00 +CPU= 41.782
  12:12:52 STEP 1425 H= 356:15 +CPU= 41.123
  12:13:34 STEP 1426 H= 356:30 +CPU= 41.968
  12:14:14 STEP 1427 H= 356:45 +CPU= 40.121
  12:15:06 STEP 1428 H= 357:00 +CPU= 51.675
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001428
  12:15:46 STEP 1429 H= 357:15 +CPU= 39.438
  12:16:25 STEP 1430 H= 357:30 +CPU= 38.887
  12:17:02 STEP 1431 H= 357:45 +CPU= 37.193
  12:17:46 STEP 1432 H= 358:00 +CPU= 43.961
  12:18:25 STEP 1433 H= 358:15 +CPU= 38.785
  12:19:05 STEP 1434 H= 358:30 +CPU= 39.409
  12:19:44 STEP 1435 H= 358:45 +CPU= 39.311
  12:20:25 STEP 1436 H= 359:00 +CPU= 40.987
  12:21:06 STEP 1437 H= 359:15 +CPU= 40.238
  12:21:42 STEP 1438 H= 359:30 +CPU= 36.374
  12:22:22 STEP 1439 H= 359:45 +CPU= 39.660
  12:23:13 STEP 1440 H= 360:00 +CPU= 50.332
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.8859858653E-21      I       0.2253127110E-07      I
ICloud fractionI      0.0000000000E+00      I       0.1286877610E-01      I
I  Relat. Hum. I      0.1826178666E+00      I       0.2524007601E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.8990301170E+02      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    301175745 BYTES IN      7 RECORDS TRANSFERRED IN    0.0006 SECONDS501959.6 Mbytes/s, TOTAL TIME=    0.0152( 3.9%)
 12:23:13 STEP 1440 H= 360:00 +CPU= 50.332
 END CNT3
 NSTEP =  1440 CNT0   000000000  36.821  36.821  37.029   0.994               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           34/  1069125708 WRITTEN        11344/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    203    0       34      1044068    11344 ************    38.5    10.0    28.5    10.9    61.8
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.94      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  417    6544.8    6544.8     13.92      0.00
   9 SPCM     - SPECTRAL COMP.                     384    1300.1    1300.1      2.55      0.00
  10 SCAN2M - PHYSICS                              385   21139.6   21139.6     41.52      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 32    1277.0    1277.0      0.21      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 17      83.8      83.8      0.01      0.00
  17 GRIDFPOS IN CNT4                               32      48.7      48.7      0.01      0.00
  27 RESTART FILES - WRITING                         8    5103.7    5103.7      0.21      0.00
  28 RESTART FILES - READING                         1   11792.5   11792.5      0.06      0.00
  29 SU4FPOS IN CNT4                                32       0.4       0.4      0.00      0.00
  30 DYNFPOS IN CNT4                                32    9131.1    9131.1      1.49      0.00
  31 POSDDH IN STEPO                                 2       4.7       4.7      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    385   16424.2   16424.2     32.26      0.00
  39 SU0YOMB                                         1     462.2     462.2      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    385      48.7      48.7      0.10      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              384     509.3     509.3      1.00      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              384      86.3      86.3      0.17      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 17       0.7       0.7      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      836     649.2     649.2      2.77      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       800     378.8     378.8      1.55      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        800     133.9     133.9      0.55      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       836     212.8     212.8      0.91      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      53.2      53.2      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            836      66.8      66.8      0.28      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            800      34.8      34.8      0.14      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            836     129.0     129.0      0.55      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            800      38.2      38.2      0.16      0.00
 400 GSTATS                                      45376       0.1       0.1      0.03      0.00
 401 GSTATS HOOK                                 42168       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    19599.8 CPU TIME   16480.5 VECTOR TIME    16480.5


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       66.2
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/39/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/39/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12210069/ICMSHh7zg+001428
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2j6_2016092300_15_991_12210069_0_r1444537037_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
12:26:46 (2263): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:51:24 1538853 22310275 oifs_43r3_bl_a2j6_2016092300_15_991_12210069_0 1,295,100 64,680 0.0499
09 May 2023 16:51:14 1538853 22310275 oifs_43r3_bl_a2j6_2016092300_15_991_12210069_0 864,000 42,761 0.0495


©2024 cpdn.org