climateprediction.net home page
Task 22287199

Task 22287199

Name oifs_43r3_ps_0219_2005050100_123_974_12190863_1
Workunit 12190863
Created 24 Dec 2022, 12:23:40 UTC
Sent 6 Jan 2023, 2:23:52 UTC
Report deadline 5 Feb 2023, 2:23:52 UTC
Received 7 Jan 2023, 21:33:18 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1493665
Run time 16 hours 13 min 58 sec
CPU time 15 hours 16 min 54 sec
Validate state Invalid
Credit 7,257.60
Device peak FLOPS 4.47 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,509.54 MB
Peak swap size 4,978.07 MB
Peak disk usage 7,883.67 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
4:08 STEP 1125 H=1125:00 +CPU= 40.300
  06:24:35 STEP 1126 H=1126:00 +CPU= 26.242
  06:25:02 STEP 1127 H=1127:00 +CPU= 26.012
  06:25:51 STEP 1128 H=1128:00 +CPU= 47.113
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001128
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001128
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001116
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_46.zip
Uploading the intermediate file: upload_file_46.zip
  06:26:17 STEP 1129 H=1129:00 +CPU= 25.637
  06:26:45 STEP 1130 H=1130:00 +CPU= 26.043
  06:27:26 STEP 1131 H=1131:00 +CPU= 40.504
  06:27:53 STEP 1132 H=1132:00 +CPU= 26.012
  06:28:20 STEP 1133 H=1133:00 +CPU= 25.391
  06:29:02 STEP 1134 H=1134:00 +CPU= 41.091
  06:29:31 STEP 1135 H=1135:00 +CPU= 25.899
  06:30:02 STEP 1136 H=1136:00 +CPU= 26.602
  06:30:45 STEP 1137 H=1137:00 +CPU= 40.525
  06:31:13 STEP 1138 H=1138:00 +CPU= 26.381
  06:31:40 STEP 1139 H=1139:00 +CPU= 25.391
  06:32:28 STEP 1140 H=1140:00 +CPU= 45.588
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001140
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001140
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001140
  06:32:55 STEP 1141 H=1141:00 +CPU= 25.700
  06:33:23 STEP 1142 H=1142:00 +CPU= 26.610
  06:34:06 STEP 1143 H=1143:00 +CPU= 40.411
  06:34:34 STEP 1144 H=1144:00 +CPU= 26.514
  06:35:01 STEP 1145 H=1145:00 +CPU= 25.913
  06:35:45 STEP 1146 H=1146:00 +CPU= 41.613
  06:36:12 STEP 1147 H=1147:00 +CPU= 25.703
  06:36:40 STEP 1148 H=1148:00 +CPU= 26.840
  06:37:23 STEP 1149 H=1149:00 +CPU= 40.634
  06:37:50 STEP 1150 H=1150:00 +CPU= 26.313
  06:38:19 STEP 1151 H=1151:00 +CPU= 26.580
  06:39:08 STEP 1152 H=1152:00 +CPU= 47.064
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001152
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001152
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001140
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001140
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001140
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_47.zip
Uploading the intermediate file: upload_file_47.zip
  06:39:35 STEP 1153 H=1153:00 +CPU= 25.397
  06:40:02 STEP 1154 H=1154:00 +CPU= 26.193
  06:40:45 STEP 1155 H=1155:00 +CPU= 40.654
  06:41:13 STEP 1156 H=1156:00 +CPU= 26.185
  06:41:39 STEP 1157 H=1157:00 +CPU= 25.643
  06:42:23 STEP 1158 H=1158:00 +CPU= 41.405
  06:42:50 STEP 1159 H=1159:00 +CPU= 25.707
  06:43:18 STEP 1160 H=1160:00 +CPU= 26.330
  06:44:01 STEP 1161 H=1161:00 +CPU= 40.937
  06:44:29 STEP 1162 H=1162:00 +CPU= 26.517
  06:44:57 STEP 1163 H=1163:00 +CPU= 25.833
  06:45:44 STEP 1164 H=1164:00 +CPU= 45.332
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001164
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001164
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001164
  06:46:11 STEP 1165 H=1165:00 +CPU= 25.547
  06:46:40 STEP 1166 H=1166:00 +CPU= 26.572
  06:47:22 STEP 1167 H=1167:00 +CPU= 40.595
  06:47:50 STEP 1168 H=1168:00 +CPU= 26.274
  06:48:16 STEP 1169 H=1169:00 +CPU= 25.406
  06:49:00 STEP 1170 H=1170:00 +CPU= 41.608
  06:49:27 STEP 1171 H=1171:00 +CPU= 25.627
  06:49:55 STEP 1172 H=1172:00 +CPU= 26.768
  06:50:38 STEP 1173 H=1173:00 +CPU= 40.402
  06:51:06 STEP 1174 H=1174:00 +CPU= 26.671
  06:51:35 STEP 1175 H=1175:00 +CPU= 27.905
  06:52:25 STEP 1176 H=1176:00 +CPU= 47.950
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001176
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001176
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001164
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_48.zip
Uploading the intermediate file: upload_file_48.zip
  06:52:53 STEP 1177 H=1177:00 +CPU= 25.620
  06:53:21 STEP 1178 H=1178:00 +CPU= 26.497
  06:54:03 STEP 1179 H=1179:00 +CPU= 40.503
  06:54:31 STEP 1180 H=1180:00 +CPU= 26.474
  06:54:58 STEP 1181 H=1181:00 +CPU= 25.302
  06:55:42 STEP 1182 H=1182:00 +CPU= 41.835
  06:56:08 STEP 1183 H=1183:00 +CPU= 25.272
  06:56:36 STEP 1184 H=1184:00 +CPU= 26.247
  06:57:18 STEP 1185 H=1185:00 +CPU= 40.468
  06:57:47 STEP 1186 H=1186:00 +CPU= 26.309
  06:58:16 STEP 1187 H=1187:00 +CPU= 25.604
  06:59:03 STEP 1188 H=1188:00 +CPU= 44.733
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001188
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001188
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001188
  06:59:30 STEP 1189 H=1189:00 +CPU= 25.446
  06:59:58 STEP 1190 H=1190:00 +CPU= 26.403
  07:00:41 STEP 1191 H=1191:00 +CPU= 40.741
  07:01:09 STEP 1192 H=1192:00 +CPU= 26.582
  07:01:36 STEP 1193 H=1193:00 +CPU= 25.543
  07:02:19 STEP 1194 H=1194:00 +CPU= 41.537
  07:02:47 STEP 1195 H=1195:00 +CPU= 25.766
  07:03:14 STEP 1196 H=1196:00 +CPU= 26.386
  07:03:57 STEP 1197 H=1197:00 +CPU= 40.554
  07:04:24 STEP 1198 H=1198:00 +CPU= 26.195
  07:04:52 STEP 1199 H=1199:00 +CPU= 26.362
  07:05:42 STEP 1200 H=1200:00 +CPU= 47.618
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001200
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001200
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001188
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_49.zip
Uploading the intermediate file: upload_file_49.zip
  07:06:09 STEP 1201 H=1201:00 +CPU= 25.355
Uploading trickle at timestep: 4320000
  07:06:36 STEP 1202 H=1202:00 +CPU= 25.682
  07:07:18 STEP 1203 H=1203:00 +CPU= 39.880
  07:07:45 STEP 1204 H=1204:00 +CPU= 25.691
  07:08:11 STEP 1205 H=1205:00 +CPU= 25.108
  07:08:55 STEP 1206 H=1206:00 +CPU= 40.945
  07:09:21 STEP 1207 H=1207:00 +CPU= 25.068
  07:09:48 STEP 1208 H=1208:00 +CPU= 25.804
  07:10:30 STEP 1209 H=1209:00 +CPU= 39.799
  07:10:57 STEP 1210 H=1210:00 +CPU= 25.748
  07:11:23 STEP 1211 H=1211:00 +CPU= 24.901
  07:12:09 STEP 1212 H=1212:00 +CPU= 44.153
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001212
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001212
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001212
  07:12:35 STEP 1213 H=1213:00 +CPU= 24.726
  07:13:02 STEP 1214 H=1214:00 +CPU= 25.709
  07:13:44 STEP 1215 H=1215:00 +CPU= 39.944
  07:14:11 STEP 1216 H=1216:00 +CPU= 25.921
  07:14:38 STEP 1217 H=1217:00 +CPU= 25.049
  07:15:21 STEP 1218 H=1218:00 +CPU= 40.824
  07:15:47 STEP 1219 H=1219:00 +CPU= 24.686
  07:16:15 STEP 1220 H=1220:00 +CPU= 25.779
  07:16:57 STEP 1221 H=1221:00 +CPU= 40.035
  07:17:24 STEP 1222 H=1222:00 +CPU= 25.829
  07:17:51 STEP 1223 H=1223:00 +CPU= 25.709
  07:18:39 STEP 1224 H=1224:00 +CPU= 46.233
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001224
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001224
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001212
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_50.zip
Uploading the intermediate file: upload_file_50.zip
  07:19:06 STEP 1225 H=1225:00 +CPU= 24.806
  07:19:33 STEP 1226 H=1226:00 +CPU= 25.940
  07:20:15 STEP 1227 H=1227:00 +CPU= 40.232
  07:20:43 STEP 1228 H=1228:00 +CPU= 25.936
  07:21:09 STEP 1229 H=1229:00 +CPU= 24.861
  07:21:52 STEP 1230 H=1230:00 +CPU= 40.853
  07:22:18 STEP 1231 H=1231:00 +CPU= 24.902
  07:22:47 STEP 1232 H=1232:00 +CPU= 25.933
  07:23:29 STEP 1233 H=1233:00 +CPU= 40.276
  07:24:00 STEP 1234 H=1234:00 +CPU= 25.928
  07:24:25 STEP 1235 H=1235:00 +CPU= 24.719
  07:25:12 STEP 1236 H=1236:00 +CPU= 44.389
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001236
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001236
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001236
  07:25:38 STEP 1237 H=1237:00 +CPU= 24.891
  07:26:06 STEP 1238 H=1238:00 +CPU= 26.245
  07:26:49 STEP 1239 H=1239:00 +CPU= 40.782
  07:27:16 STEP 1240 H=1240:00 +CPU= 25.552
  07:27:42 STEP 1241 H=1241:00 +CPU= 24.967
  07:28:24 STEP 1242 H=1242:00 +CPU= 40.737
  07:28:51 STEP 1243 H=1243:00 +CPU= 24.683
  07:29:18 STEP 1244 H=1244:00 +CPU= 26.131
  07:30:00 STEP 1245 H=1245:00 +CPU= 39.769
  07:30:29 STEP 1246 H=1246:00 +CPU= 25.888
  07:30:56 STEP 1247 H=1247:00 +CPU= 25.810
  07:31:45 STEP 1248 H=1248:00 +CPU= 45.691
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001248
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001248
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001236
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_51.zip
Uploading the intermediate file: upload_file_51.zip
  07:32:11 STEP 1249 H=1249:00 +CPU= 24.914
  07:32:38 STEP 1250 H=1250:00 +CPU= 25.610
  07:33:20 STEP 1251 H=1251:00 +CPU= 39.887
  07:33:47 STEP 1252 H=1252:00 +CPU= 25.768
  07:34:13 STEP 1253 H=1253:00 +CPU= 24.845
  07:34:56 STEP 1254 H=1254:00 +CPU= 40.793
  07:35:22 STEP 1255 H=1255:00 +CPU= 24.738
  07:35:49 STEP 1256 H=1256:00 +CPU= 26.121
  07:36:32 STEP 1257 H=1257:00 +CPU= 39.991
  07:36:59 STEP 1258 H=1258:00 +CPU= 25.707
  07:37:25 STEP 1259 H=1259:00 +CPU= 25.145
  07:38:11 STEP 1260 H=1260:00 +CPU= 43.883
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001260
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001260
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001260
  07:38:38 STEP 1261 H=1261:00 +CPU= 24.968
  07:39:05 STEP 1262 H=1262:00 +CPU= 25.631
  07:39:47 STEP 1263 H=1263:00 +CPU= 40.357
  07:40:14 STEP 1264 H=1264:00 +CPU= 25.528
  07:40:40 STEP 1265 H=1265:00 +CPU= 25.366
  07:41:23 STEP 1266 H=1266:00 +CPU= 41.052
  07:41:50 STEP 1267 H=1267:00 +CPU= 25.062
  07:42:17 STEP 1268 H=1268:00 +CPU= 25.808
  07:42:59 STEP 1269 H=1269:00 +CPU= 39.809
  07:43:26 STEP 1270 H=1270:00 +CPU= 25.589
  07:43:53 STEP 1271 H=1271:00 +CPU= 26.023
  07:44:42 STEP 1272 H=1272:00 +CPU= 45.916
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001272
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001272
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001260
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_52.zip
Uploading the intermediate file: upload_file_52.zip
  07:45:08 STEP 1273 H=1273:00 +CPU= 24.888
  07:45:36 STEP 1274 H=1274:00 +CPU= 26.033
  07:46:18 STEP 1275 H=1275:00 +CPU= 39.771
  07:46:45 STEP 1276 H=1276:00 +CPU= 26.032
  07:47:11 STEP 1277 H=1277:00 +CPU= 24.864
  07:47:54 STEP 1278 H=1278:00 +CPU= 40.949
  07:48:20 STEP 1279 H=1279:00 +CPU= 25.076
  07:48:48 STEP 1280 H=1280:00 +CPU= 25.789
  07:49:30 STEP 1281 H=1281:00 +CPU= 39.858
  07:49:57 STEP 1282 H=1282:00 +CPU= 25.973
  07:50:24 STEP 1283 H=1283:00 +CPU= 25.042
  07:51:11 STEP 1284 H=1284:00 +CPU= 44.606
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001284
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001284
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001284
  07:51:37 STEP 1285 H=1285:00 +CPU= 25.011
  07:52:05 STEP 1286 H=1286:00 +CPU= 25.998
  07:52:48 STEP 1287 H=1287:00 +CPU= 40.314
  07:53:15 STEP 1288 H=1288:00 +CPU= 25.943
  07:53:42 STEP 1289 H=1289:00 +CPU= 24.947
  07:54:30 STEP 1290 H=1290:00 +CPU= 41.283
  07:54:56 STEP 1291 H=1291:00 +CPU= 24.973
  07:55:24 STEP 1292 H=1292:00 +CPU= 25.791
  07:56:05 STEP 1293 H=1293:00 +CPU= 39.880
  07:56:33 STEP 1294 H=1294:00 +CPU= 25.898
  07:57:00 STEP 1295 H=1295:00 +CPU= 25.772
  07:57:48 STEP 1296 H=1296:00 +CPU= 45.995
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001296
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001296
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001284
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_53.zip
Uploading the intermediate file: upload_file_53.zip
  07:58:15 STEP 1297 H=1297:00 +CPU= 24.743
  07:58:41 STEP 1298 H=1298:00 +CPU= 25.579
  07:59:24 STEP 1299 H=1299:00 +CPU= 39.841
  07:59:50 STEP 1300 H=1300:00 +CPU= 25.576
  08:00:16 STEP 1301 H=1301:00 +CPU= 24.682
  08:00:59 STEP 1302 H=1302:00 +CPU= 40.597
  08:01:26 STEP 1303 H=1303:00 +CPU= 24.875
  08:01:53 STEP 1304 H=1304:00 +CPU= 26.056
  08:02:35 STEP 1305 H=1305:00 +CPU= 39.872
  08:03:03 STEP 1306 H=1306:00 +CPU= 25.814
  08:03:30 STEP 1307 H=1307:00 +CPU= 24.923
  08:04:16 STEP 1308 H=1308:00 +CPU= 43.979
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001308
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001308
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001308
  08:04:42 STEP 1309 H=1309:00 +CPU= 24.951
  08:05:10 STEP 1310 H=1310:00 +CPU= 25.925
  08:05:52 STEP 1311 H=1311:00 +CPU= 39.763
  08:06:19 STEP 1312 H=1312:00 +CPU= 25.575
  08:06:45 STEP 1313 H=1313:00 +CPU= 25.063
  08:07:28 STEP 1314 H=1314:00 +CPU= 41.080
  08:07:54 STEP 1315 H=1315:00 +CPU= 24.828
  08:08:21 STEP 1316 H=1316:00 +CPU= 25.896
  08:09:03 STEP 1317 H=1317:00 +CPU= 40.048
  08:09:30 STEP 1318 H=1318:00 +CPU= 25.832
  08:09:57 STEP 1319 H=1319:00 +CPU= 25.522
  08:10:46 STEP 1320 H=1320:00 +CPU= 46.109
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001320
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001320
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001308
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_54.zip
Uploading the intermediate file: upload_file_54.zip
  08:11:13 STEP 1321 H=1321:00 +CPU= 25.087
  08:11:41 STEP 1322 H=1322:00 +CPU= 26.076
  08:12:24 STEP 1323 H=1323:00 +CPU= 40.242
  08:12:51 STEP 1324 H=1324:00 +CPU= 26.092
  08:13:18 STEP 1325 H=1325:00 +CPU= 25.345
  08:14:01 STEP 1326 H=1326:00 +CPU= 40.799
  08:14:27 STEP 1327 H=1327:00 +CPU= 25.043
  08:14:54 STEP 1328 H=1328:00 +CPU= 25.668
  08:15:36 STEP 1329 H=1329:00 +CPU= 39.955
  08:16:04 STEP 1330 H=1330:00 +CPU= 25.839
  08:16:30 STEP 1331 H=1331:00 +CPU= 24.870
  08:17:16 STEP 1332 H=1332:00 +CPU= 44.281
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001332
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001332
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001332
  08:17:43 STEP 1333 H=1333:00 +CPU= 25.051
  08:18:10 STEP 1334 H=1334:00 +CPU= 26.147
  08:18:52 STEP 1335 H=1335:00 +CPU= 39.804
  08:19:20 STEP 1336 H=1336:00 +CPU= 26.018
  08:19:46 STEP 1337 H=1337:00 +CPU= 24.957
  08:20:31 STEP 1338 H=1338:00 +CPU= 41.308
  08:20:58 STEP 1339 H=1339:00 +CPU= 25.142
  08:21:25 STEP 1340 H=1340:00 +CPU= 25.581
  08:22:07 STEP 1341 H=1341:00 +CPU= 40.197
  08:22:35 STEP 1342 H=1342:00 +CPU= 26.840
  08:23:02 STEP 1343 H=1343:00 +CPU= 25.816
  08:23:53 STEP 1344 H=1344:00 +CPU= 46.129
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001344
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001344
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001332
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_55.zip
Uploading the intermediate file: upload_file_55.zip
  08:24:20 STEP 1345 H=1345:00 +CPU= 25.198
  08:24:49 STEP 1346 H=1346:00 +CPU= 26.408
  08:25:37 STEP 1347 H=1347:00 +CPU= 40.558
  08:26:07 STEP 1348 H=1348:00 +CPU= 25.958
  08:26:33 STEP 1349 H=1349:00 +CPU= 24.921
  08:27:16 STEP 1350 H=1350:00 +CPU= 40.805
  08:27:43 STEP 1351 H=1351:00 +CPU= 24.981
  08:28:10 STEP 1352 H=1352:00 +CPU= 25.680
  08:28:52 STEP 1353 H=1353:00 +CPU= 39.882
  08:29:19 STEP 1354 H=1354:00 +CPU= 25.883
  08:29:45 STEP 1355 H=1355:00 +CPU= 25.168
  08:30:32 STEP 1356 H=1356:00 +CPU= 43.979
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001356
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001356
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001356
  08:31:01 STEP 1357 H=1357:00 +CPU= 25.135
  08:31:29 STEP 1358 H=1358:00 +CPU= 26.007
  08:32:14 STEP 1359 H=1359:00 +CPU= 40.620
  08:32:41 STEP 1360 H=1360:00 +CPU= 25.838
  08:33:07 STEP 1361 H=1361:00 +CPU= 24.760
  08:33:51 STEP 1362 H=1362:00 +CPU= 40.912
  08:34:18 STEP 1363 H=1363:00 +CPU= 25.217
  08:34:45 STEP 1364 H=1364:00 +CPU= 25.717
  08:35:27 STEP 1365 H=1365:00 +CPU= 39.661
  08:35:54 STEP 1366 H=1366:00 +CPU= 25.560
  08:36:21 STEP 1367 H=1367:00 +CPU= 26.096
  08:37:11 STEP 1368 H=1368:00 +CPU= 46.532
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001368
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001368
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001356
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_56.zip
Uploading the intermediate file: upload_file_56.zip
  08:37:37 STEP 1369 H=1369:00 +CPU= 24.938
  08:38:04 STEP 1370 H=1370:00 +CPU= 25.553
  08:38:46 STEP 1371 H=1371:00 +CPU= 39.892
  08:39:13 STEP 1372 H=1372:00 +CPU= 25.552
  08:39:40 STEP 1373 H=1373:00 +CPU= 25.127
  08:40:23 STEP 1374 H=1374:00 +CPU= 41.234
  08:40:50 STEP 1375 H=1375:00 +CPU= 24.928
  08:41:19 STEP 1376 H=1376:00 +CPU= 26.021
  08:42:13 STEP 1377 H=1377:00 +CPU= 40.879
  08:42:42 STEP 1378 H=1378:00 +CPU= 26.364
  08:43:10 STEP 1379 H=1379:00 +CPU= 25.561
  08:43:59 STEP 1380 H=1380:00 +CPU= 44.697
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001380
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001380
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001380
  08:44:26 STEP 1381 H=1381:00 +CPU= 25.431
  08:44:54 STEP 1382 H=1382:00 +CPU= 26.354
  08:45:36 STEP 1383 H=1383:00 +CPU= 40.010
  08:46:03 STEP 1384 H=1384:00 +CPU= 26.223
  08:46:30 STEP 1385 H=1385:00 +CPU= 25.150
  08:47:13 STEP 1386 H=1386:00 +CPU= 40.626
  08:47:39 STEP 1387 H=1387:00 +CPU= 24.293
  08:48:06 STEP 1388 H=1388:00 +CPU= 25.126
  08:48:47 STEP 1389 H=1389:00 +CPU= 38.883
  08:49:14 STEP 1390 H=1390:00 +CPU= 25.484
  08:49:40 STEP 1391 H=1391:00 +CPU= 25.207
  08:50:28 STEP 1392 H=1392:00 +CPU= 45.259
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001392
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001392
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001380
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_57.zip
Uploading the intermediate file: upload_file_57.zip
  08:50:54 STEP 1393 H=1393:00 +CPU= 24.525
  08:51:20 STEP 1394 H=1394:00 +CPU= 25.166
  08:52:01 STEP 1395 H=1395:00 +CPU= 38.734
  08:52:28 STEP 1396 H=1396:00 +CPU= 25.355
  08:52:54 STEP 1397 H=1397:00 +CPU= 24.379
  08:53:36 STEP 1398 H=1398:00 +CPU= 39.844
  08:54:02 STEP 1399 H=1399:00 +CPU= 24.358
  08:54:28 STEP 1400 H=1400:00 +CPU= 25.370
  08:55:09 STEP 1401 H=1401:00 +CPU= 39.131
  08:55:36 STEP 1402 H=1402:00 +CPU= 25.495
  08:56:02 STEP 1403 H=1403:00 +CPU= 24.316
  08:56:48 STEP 1404 H=1404:00 +CPU= 43.333
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001404
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001404
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001404
  08:57:14 STEP 1405 H=1405:00 +CPU= 24.565
  08:57:40 STEP 1406 H=1406:00 +CPU= 25.361
  08:58:22 STEP 1407 H=1407:00 +CPU= 39.289
  08:58:48 STEP 1408 H=1408:00 +CPU= 25.099
  08:59:14 STEP 1409 H=1409:00 +CPU= 24.663
  08:59:56 STEP 1410 H=1410:00 +CPU= 39.782
  09:00:21 STEP 1411 H=1411:00 +CPU= 24.320
  09:00:48 STEP 1412 H=1412:00 +CPU= 25.298
  09:01:29 STEP 1413 H=1413:00 +CPU= 38.788
  09:01:56 STEP 1414 H=1414:00 +CPU= 25.538
  09:02:23 STEP 1415 H=1415:00 +CPU= 25.603
  09:03:11 STEP 1416 H=1416:00 +CPU= 44.966
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001416
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001416
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001404
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_58.zip
Uploading the intermediate file: upload_file_58.zip
  09:03:36 STEP 1417 H=1417:00 +CPU= 24.242
  09:04:07 STEP 1418 H=1418:00 +CPU= 25.406
  09:04:49 STEP 1419 H=1419:00 +CPU= 39.064
  09:05:16 STEP 1420 H=1420:00 +CPU= 25.399
  09:05:41 STEP 1421 H=1421:00 +CPU= 24.391
  09:06:23 STEP 1422 H=1422:00 +CPU= 39.729
  09:06:50 STEP 1423 H=1423:00 +CPU= 24.407
  09:07:19 STEP 1424 H=1424:00 +CPU= 25.988
  09:08:03 STEP 1425 H=1425:00 +CPU= 39.238
  09:08:30 STEP 1426 H=1426:00 +CPU= 25.953
  09:08:56 STEP 1427 H=1427:00 +CPU= 24.812
  09:09:42 STEP 1428 H=1428:00 +CPU= 43.354
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001428
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001428
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001428
  09:10:08 STEP 1429 H=1429:00 +CPU= 24.421
  09:10:35 STEP 1430 H=1430:00 +CPU= 25.752
  09:11:16 STEP 1431 H=1431:00 +CPU= 39.105
  09:11:43 STEP 1432 H=1432:00 +CPU= 25.466
  09:12:09 STEP 1433 H=1433:00 +CPU= 24.513
  09:12:51 STEP 1434 H=1434:00 +CPU= 40.453
  09:13:17 STEP 1435 H=1435:00 +CPU= 24.643
  09:13:44 STEP 1436 H=1436:00 +CPU= 25.486
  09:14:25 STEP 1437 H=1437:00 +CPU= 39.162
  09:14:52 STEP 1438 H=1438:00 +CPU= 25.616
  09:15:19 STEP 1439 H=1439:00 +CPU= 25.485
  09:16:07 STEP 1440 H=1440:00 +CPU= 46.252
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001440
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001440
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001428
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_59.zip
Uploading the intermediate file: upload_file_59.zip
  09:16:34 STEP 1441 H=1441:00 +CPU= 24.860
Uploading trickle at timestep: 5184000
  09:17:01 STEP 1442 H=1442:00 +CPU= 25.755
  09:17:43 STEP 1443 H=1443:00 +CPU= 39.960
  09:18:10 STEP 1444 H=1444:00 +CPU= 25.587
  09:18:36 STEP 1445 H=1445:00 +CPU= 24.874
  09:19:19 STEP 1446 H=1446:00 +CPU= 40.768
  09:19:46 STEP 1447 H=1447:00 +CPU= 25.453
  09:20:14 STEP 1448 H=1448:00 +CPU= 26.108
  09:21:03 STEP 1449 H=1449:00 +CPU= 40.149
  09:21:29 STEP 1450 H=1450:00 +CPU= 25.663
  09:21:55 STEP 1451 H=1451:00 +CPU= 24.741
  09:22:42 STEP 1452 H=1452:00 +CPU= 44.358
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001452
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001452
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001452
  09:23:08 STEP 1453 H=1453:00 +CPU= 24.710
  09:23:35 STEP 1454 H=1454:00 +CPU= 25.835
  09:24:17 STEP 1455 H=1455:00 +CPU= 39.763
  09:24:44 STEP 1456 H=1456:00 +CPU= 25.874
  09:25:10 STEP 1457 H=1457:00 +CPU= 24.982
  09:25:54 STEP 1458 H=1458:00 +CPU= 40.968
  09:26:20 STEP 1459 H=1459:00 +CPU= 24.729
  09:26:47 STEP 1460 H=1460:00 +CPU= 25.565
  09:27:28 STEP 1461 H=1461:00 +CPU= 39.681
  09:27:55 STEP 1462 H=1462:00 +CPU= 25.427
  09:28:22 STEP 1463 H=1463:00 +CPU= 25.847
  09:29:11 STEP 1464 H=1464:00 +CPU= 46.338
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001464
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001464
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001464
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001452
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001452
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001452
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_60.zip
Uploading the intermediate file: upload_file_60.zip
  09:29:38 STEP 1465 H=1465:00 +CPU= 24.878
  09:30:07 STEP 1466 H=1466:00 +CPU= 26.018
  09:30:51 STEP 1467 H=1467:00 +CPU= 40.124
  09:31:18 STEP 1468 H=1468:00 +CPU= 25.812
  09:31:44 STEP 1469 H=1469:00 +CPU= 24.870
  09:32:28 STEP 1470 H=1470:00 +CPU= 41.050
  09:32:55 STEP 1471 H=1471:00 +CPU= 24.858
  09:33:23 STEP 1472 H=1472:00 +CPU= 26.072
  09:34:05 STEP 1473 H=1473:00 +CPU= 39.945
  09:34:33 STEP 1474 H=1474:00 +CPU= 25.849
  09:34:59 STEP 1475 H=1475:00 +CPU= 25.358
  09:35:46 STEP 1476 H=1476:00 +CPU= 44.193
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001476
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001476
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001476
  09:36:13 STEP 1477 H=1477:00 +CPU= 25.500
  09:36:39 STEP 1478 H=1478:00 +CPU= 25.548
  09:37:21 STEP 1479 H=1479:00 +CPU= 39.820
  09:37:49 STEP 1480 H=1480:00 +CPU= 25.881
  09:38:14 STEP 1481 H=1481:00 +CPU= 24.693
  09:38:58 STEP 1482 H=1482:00 +CPU= 41.031
  09:39:24 STEP 1483 H=1483:00 +CPU= 24.824
  09:39:51 STEP 1484 H=1484:00 +CPU= 25.885
  09:40:33 STEP 1485 H=1485:00 +CPU= 39.791
  09:41:01 STEP 1486 H=1486:00 +CPU= 26.082
  09:41:27 STEP 1487 H=1487:00 +CPU= 25.403
  09:42:17 STEP 1488 H=1488:00 +CPU= 46.142
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001488
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001488
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001488
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001464
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001464
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001464
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001476
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001476
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001476
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_61.zip
Uploading the intermediate file: upload_file_61.zip
  09:42:44 STEP 1489 H=1489:00 +CPU= 24.784
  09:43:11 STEP 1490 H=1490:00 +CPU= 25.875
  09:43:52 STEP 1491 H=1491:00 +CPU= 39.706
  09:44:19 STEP 1492 H=1492:00 +CPU= 25.616
  09:44:46 STEP 1493 H=1493:00 +CPU= 24.853
  09:45:28 STEP 1494 H=1494:00 +CPU= 40.672
  09:45:54 STEP 1495 H=1495:00 +CPU= 24.986
  09:46:21 STEP 1496 H=1496:00 +CPU= 25.784
  09:47:03 STEP 1497 H=1497:00 +CPU= 39.758
  09:47:30 STEP 1498 H=1498:00 +CPU= 25.756
  09:47:57 STEP 1499 H=1499:00 +CPU= 25.188
  09:48:43 STEP 1500 H=1500:00 +CPU= 44.014
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001500
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001500
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001500
  09:49:08 STEP 1501 H=1501:00 +CPU= 24.835
  09:49:35 STEP 1502 H=1502:00 +CPU= 25.670
  09:50:19 STEP 1503 H=1503:00 +CPU= 40.290
  09:50:47 STEP 1504 H=1504:00 +CPU= 25.731
  09:51:13 STEP 1505 H=1505:00 +CPU= 25.002
  09:51:56 STEP 1506 H=1506:00 +CPU= 40.788
  09:52:23 STEP 1507 H=1507:00 +CPU= 24.969
  09:52:50 STEP 1508 H=1508:00 +CPU= 25.478
  09:53:32 STEP 1509 H=1509:00 +CPU= 39.739
  09:53:59 STEP 1510 H=1510:00 +CPU= 25.688
  09:54:26 STEP 1511 H=1511:00 +CPU= 25.675
  09:55:14 STEP 1512 H=1512:00 +CPU= 45.974
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001512
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001512
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001512
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001488
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001488
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001488
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001500
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001500
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001500
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_62.zip
Uploading the intermediate file: upload_file_62.zip
  09:55:40 STEP 1513 H=1513:00 +CPU= 24.990
  09:56:08 STEP 1514 H=1514:00 +CPU= 26.432
  09:56:50 STEP 1515 H=1515:00 +CPU= 40.734
  09:57:17 STEP 1516 H=1516:00 +CPU= 25.613
  09:57:43 STEP 1517 H=1517:00 +CPU= 24.943
  09:58:26 STEP 1518 H=1518:00 +CPU= 41.028
  09:58:53 STEP 1519 H=1519:00 +CPU= 25.129
  09:59:20 STEP 1520 H=1520:00 +CPU= 25.696
  10:00:02 STEP 1521 H=1521:00 +CPU= 40.043
  10:00:30 STEP 1522 H=1522:00 +CPU= 25.961
  10:00:56 STEP 1523 H=1523:00 +CPU= 25.150
  10:01:43 STEP 1524 H=1524:00 +CPU= 44.229
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001524
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001524
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001524
  10:02:09 STEP 1525 H=1525:00 +CPU= 24.830
  10:02:36 STEP 1526 H=1526:00 +CPU= 25.954
  10:03:19 STEP 1527 H=1527:00 +CPU= 40.154
  10:03:47 STEP 1528 H=1528:00 +CPU= 25.949
  10:04:13 STEP 1529 H=1529:00 +CPU= 24.874
  10:04:56 STEP 1530 H=1530:00 +CPU= 40.763
  10:05:22 STEP 1531 H=1531:00 +CPU= 24.678
  10:05:49 STEP 1532 H=1532:00 +CPU= 25.558
  10:06:32 STEP 1533 H=1533:00 +CPU= 39.787
  10:06:59 STEP 1534 H=1534:00 +CPU= 25.664
  10:07:26 STEP 1535 H=1535:00 +CPU= 25.772
  10:08:15 STEP 1536 H=1536:00 +CPU= 46.090
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001536
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001536
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001512
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001512
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001512
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001524
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001524
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001524
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_63.zip
Uploading the intermediate file: upload_file_63.zip
  10:08:41 STEP 1537 H=1537:00 +CPU= 24.696
  10:09:08 STEP 1538 H=1538:00 +CPU= 25.761
  10:09:50 STEP 1539 H=1539:00 +CPU= 39.569
  10:10:17 STEP 1540 H=1540:00 +CPU= 26.042
  10:10:43 STEP 1541 H=1541:00 +CPU= 24.788
  10:11:27 STEP 1542 H=1542:00 +CPU= 40.995
  10:11:54 STEP 1543 H=1543:00 +CPU= 24.993
  10:12:21 STEP 1544 H=1544:00 +CPU= 25.884
  10:13:03 STEP 1545 H=1545:00 +CPU= 40.014
  10:13:31 STEP 1546 H=1546:00 +CPU= 26.146
  10:13:57 STEP 1547 H=1547:00 +CPU= 24.955
  10:14:44 STEP 1548 H=1548:00 +CPU= 44.306
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001548
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001548
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001548
  10:15:10 STEP 1549 H=1549:00 +CPU= 24.818
  10:15:37 STEP 1550 H=1550:00 +CPU= 25.639
  10:16:19 STEP 1551 H=1551:00 +CPU= 39.890
  10:16:46 STEP 1552 H=1552:00 +CPU= 25.826
  10:17:12 STEP 1553 H=1553:00 +CPU= 24.489
  10:17:55 STEP 1554 H=1554:00 +CPU= 40.226
  10:18:20 STEP 1555 H=1555:00 +CPU= 24.483
  10:18:47 STEP 1556 H=1556:00 +CPU= 25.586
  10:19:29 STEP 1557 H=1557:00 +CPU= 39.727
  10:19:56 STEP 1558 H=1558:00 +CPU= 25.608
  10:20:23 STEP 1559 H=1559:00 +CPU= 26.148
  10:21:12 STEP 1560 H=1560:00 +CPU= 46.006
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001560
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001560
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001560
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001548
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001548
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001548
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_64.zip
Uploading the intermediate file: upload_file_64.zip
  10:21:38 STEP 1561 H=1561:00 +CPU= 24.671
  10:22:05 STEP 1562 H=1562:00 +CPU= 25.630
  10:22:47 STEP 1563 H=1563:00 +CPU= 39.845
  10:23:14 STEP 1564 H=1564:00 +CPU= 25.604
  10:23:40 STEP 1565 H=1565:00 +CPU= 25.259
  10:24:23 STEP 1566 H=1566:00 +CPU= 40.696
  10:24:49 STEP 1567 H=1567:00 +CPU= 24.740
  10:25:16 STEP 1568 H=1568:00 +CPU= 25.716
  10:25:59 STEP 1569 H=1569:00 +CPU= 40.246
  10:26:26 STEP 1570 H=1570:00 +CPU= 25.704
  10:26:52 STEP 1571 H=1571:00 +CPU= 24.907
  10:27:38 STEP 1572 H=1572:00 +CPU= 44.696
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001572
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001572
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001572
  10:28:05 STEP 1573 H=1573:00 +CPU= 24.742
  10:28:32 STEP 1574 H=1574:00 +CPU= 25.781
  10:29:14 STEP 1575 H=1575:00 +CPU= 39.891
  10:29:41 STEP 1576 H=1576:00 +CPU= 25.894
  10:30:07 STEP 1577 H=1577:00 +CPU= 24.799
  10:30:50 STEP 1578 H=1578:00 +CPU= 40.800
  10:31:16 STEP 1579 H=1579:00 +CPU= 24.623
  10:31:43 STEP 1580 H=1580:00 +CPU= 25.978
  10:32:26 STEP 1581 H=1581:00 +CPU= 39.998
  10:32:52 STEP 1582 H=1582:00 +CPU= 25.492
  10:33:19 STEP 1583 H=1583:00 +CPU= 25.546
  10:34:10 STEP 1584 H=1584:00 +CPU= 46.078
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001584
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001584
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001584
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001560
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001560
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001560
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001572
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001572
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001572
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_65.zip
Uploading the intermediate file: upload_file_65.zip
  10:34:37 STEP 1585 H=1585:00 +CPU= 24.790
  10:35:04 STEP 1586 H=1586:00 +CPU= 25.465
  10:35:48 STEP 1587 H=1587:00 +CPU= 39.868
  10:36:16 STEP 1588 H=1588:00 +CPU= 25.694
  10:36:42 STEP 1589 H=1589:00 +CPU= 24.925
  10:37:25 STEP 1590 H=1590:00 +CPU= 41.376
  10:37:53 STEP 1591 H=1591:00 +CPU= 24.934
  10:38:23 STEP 1592 H=1592:00 +CPU= 25.959
  10:39:05 STEP 1593 H=1593:00 +CPU= 40.004
  10:39:32 STEP 1594 H=1594:00 +CPU= 25.756
  10:39:58 STEP 1595 H=1595:00 +CPU= 24.862
  10:40:45 STEP 1596 H=1596:00 +CPU= 44.207
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001596
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001596
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001596
  10:41:11 STEP 1597 H=1597:00 +CPU= 25.152
  10:41:38 STEP 1598 H=1598:00 +CPU= 25.479
  10:42:20 STEP 1599 H=1599:00 +CPU= 39.838
  10:42:51 STEP 1600 H=1600:00 +CPU= 26.103
  10:43:20 STEP 1601 H=1601:00 +CPU= 25.044
  10:44:08 STEP 1602 H=1602:00 +CPU= 41.289
  10:44:35 STEP 1603 H=1603:00 +CPU= 25.275
  10:45:03 STEP 1604 H=1604:00 +CPU= 25.788
  10:45:47 STEP 1605 H=1605:00 +CPU= 39.992
  10:46:16 STEP 1606 H=1606:00 +CPU= 25.957
  10:46:45 STEP 1607 H=1607:00 +CPU= 26.017
  10:47:35 STEP 1608 H=1608:00 +CPU= 46.363
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001608
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001608
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001608
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001584
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001584
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001584
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001596
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001596
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001596
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_66.zip
Uploading the intermediate file: upload_file_66.zip
  10:48:03 STEP 1609 H=1609:00 +CPU= 24.920
  10:48:30 STEP 1610 H=1610:00 +CPU= 25.564
  10:49:15 STEP 1611 H=1611:00 +CPU= 39.962
  10:49:42 STEP 1612 H=1612:00 +CPU= 25.509
  10:50:09 STEP 1613 H=1613:00 +CPU= 25.316
  10:50:52 STEP 1614 H=1614:00 +CPU= 40.819
  10:51:18 STEP 1615 H=1615:00 +CPU= 24.674
  10:51:45 STEP 1616 H=1616:00 +CPU= 25.645
  10:52:27 STEP 1617 H=1617:00 +CPU= 40.023
  10:52:54 STEP 1618 H=1618:00 +CPU= 25.559
  10:53:20 STEP 1619 H=1619:00 +CPU= 24.635
  10:54:06 STEP 1620 H=1620:00 +CPU= 44.378
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001620
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001620
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001620
  10:54:32 STEP 1621 H=1621:00 +CPU= 24.987
  10:54:59 STEP 1622 H=1622:00 +CPU= 25.711
  10:55:42 STEP 1623 H=1623:00 +CPU= 40.159
  10:56:11 STEP 1624 H=1624:00 +CPU= 25.794
  10:56:39 STEP 1625 H=1625:00 +CPU= 24.967
  10:57:22 STEP 1626 H=1626:00 +CPU= 40.794
  10:57:48 STEP 1627 H=1627:00 +CPU= 24.703
  10:58:15 STEP 1628 H=1628:00 +CPU= 25.840
  10:58:56 STEP 1629 H=1629:00 +CPU= 39.562
  10:59:24 STEP 1630 H=1630:00 +CPU= 26.121
  10:59:50 STEP 1631 H=1631:00 +CPU= 25.534
  11:00:39 STEP 1632 H=1632:00 +CPU= 45.763
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001632
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001632
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001608
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001608
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001608
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001620
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001620
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001620
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_67.zip
Uploading the intermediate file: upload_file_67.zip
  11:01:05 STEP 1633 H=1633:00 +CPU= 25.090
  11:01:33 STEP 1634 H=1634:00 +CPU= 25.577
  11:02:18 STEP 1635 H=1635:00 +CPU= 40.025
  11:02:49 STEP 1636 H=1636:00 +CPU= 25.935
  11:03:18 STEP 1637 H=1637:00 +CPU= 25.150
  11:04:07 STEP 1638 H=1638:00 +CPU= 41.267
  11:04:36 STEP 1639 H=1639:00 +CPU= 25.052
  11:05:04 STEP 1640 H=1640:00 +CPU= 25.617
  11:05:47 STEP 1641 H=1641:00 +CPU= 39.885
  11:06:13 STEP 1642 H=1642:00 +CPU= 25.486
  11:06:40 STEP 1643 H=1643:00 +CPU= 25.060
  11:07:26 STEP 1644 H=1644:00 +CPU= 44.136
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001644
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001644
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001644
  11:07:52 STEP 1645 H=1645:00 +CPU= 24.711
  11:08:19 STEP 1646 H=1646:00 +CPU= 25.805
  11:09:02 STEP 1647 H=1647:00 +CPU= 40.199
  11:09:29 STEP 1648 H=1648:00 +CPU= 25.653
  11:09:55 STEP 1649 H=1649:00 +CPU= 24.821
  11:10:38 STEP 1650 H=1650:00 +CPU= 40.751
  11:11:04 STEP 1651 H=1651:00 +CPU= 24.830
  11:11:30 STEP 1652 H=1652:00 +CPU= 25.523
  11:12:13 STEP 1653 H=1653:00 +CPU= 40.382
  11:12:40 STEP 1654 H=1654:00 +CPU= 25.439
  11:13:07 STEP 1655 H=1655:00 +CPU= 25.434
  11:13:55 STEP 1656 H=1656:00 +CPU= 45.920
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001656
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001656
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001644
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001644
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001644
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_68.zip
Uploading the intermediate file: upload_file_68.zip
  11:14:21 STEP 1657 H=1657:00 +CPU= 24.602
  11:14:48 STEP 1658 H=1658:00 +CPU= 25.405
  11:15:29 STEP 1659 H=1659:00 +CPU= 40.091
  11:15:56 STEP 1660 H=1660:00 +CPU= 25.629
  11:16:23 STEP 1661 H=1661:00 +CPU= 25.092
  11:17:06 STEP 1662 H=1662:00 +CPU= 40.633
  11:17:32 STEP 1663 H=1663:00 +CPU= 24.826
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2005050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0219
(argv4) batchid: 974
(argv5) wuid: 12190863
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/10
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_7cf030568d1a3cecc265a654c4316fee to: /var/lib/boinc/slots/10/oifs_43r3_ps_0219_2005050100_123_974_12190863.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/10/oifs_43r3_ps_0219_2005050100_123_974_12190863.zip
ic_ancil_file: ic_ancil_12190863
ifsdata_file: ifsdata_12190863
climate_data_file: clim_data_12190863
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_73c73a0ba8a61480cd5a8a03a7afa3b4 to: /var/lib/boinc/slots/10/ic_ancil_12190863.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/10/ic_ancil_12190863.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_1bc4df334ed97784e13c0e4d454a6f8e to: /var/lib/boinc/slots/10/ifsdata/ifsdata_12190863.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/10/ifsdata/ifsdata_12190863.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/10/159l_2/clim_data_12190863.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/10/159l_2/clim_data_12190863.zip
Checking for progress XML file: /var/lib/boinc/slots/10/progress_file_12190863.xml
Opened progress file ok : /var/lib/boinc/slots/10/progress_file_12190863.xml
-- Model is restarting --
Adjusting last_iter, 1664, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/10/progress_file_12190863.xml
last_cpu_time: 54066
upload_file_number: 69
last_iter: 1655
last_upload: 5961600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309
The child process has been launched with process id: 27616
Executing the command: /var/lib/boinc/slots/10/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:gokuraku:1:1:27616:27616] [20230107:131539:1673122539:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  13:16:39 STEP 1656 H=1656:00 +CPU= 46.976
  13:17:09 STEP 1657 H=1657:00 +CPU= 26.654
  13:17:39 STEP 1658 H=1658:00 +CPU= 27.034
  13:18:23 STEP 1659 H=1659:00 +CPU= 41.171
  13:18:51 STEP 1660 H=1660:00 +CPU= 26.923
  13:19:19 STEP 1661 H=1661:00 +CPU= 26.043
  13:20:04 STEP 1662 H=1662:00 +CPU= 42.320
  13:20:32 STEP 1663 H=1663:00 +CPU= 26.212
  13:21:02 STEP 1664 H=1664:00 +CPU= 27.584
  13:21:46 STEP 1665 H=1665:00 +CPU= 41.566
  13:22:15 STEP 1666 H=1666:00 +CPU= 26.794
  13:22:43 STEP 1667 H=1667:00 +CPU= 26.028
  13:23:32 STEP 1668 H=1668:00 +CPU= 45.965
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001668
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001668
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001668
  13:24:00 STEP 1669 H=1669:00 +CPU= 25.958
  13:24:29 STEP 1670 H=1670:00 +CPU= 26.900
  13:25:13 STEP 1671 H=1671:00 +CPU= 41.507
  13:25:42 STEP 1672 H=1672:00 +CPU= 27.077
  13:26:10 STEP 1673 H=1673:00 +CPU= 26.204
  13:26:55 STEP 1674 H=1674:00 +CPU= 42.782
  13:27:23 STEP 1675 H=1675:00 +CPU= 26.052
  13:27:52 STEP 1676 H=1676:00 +CPU= 27.155
  13:28:36 STEP 1677 H=1677:00 +CPU= 41.053
  13:29:05 STEP 1678 H=1678:00 +CPU= 26.940
  13:29:34 STEP 1679 H=1679:00 +CPU= 27.346
  13:30:26 STEP 1680 H=1680:00 +CPU= 48.592
Moving to projects directory: /var/lib/boinc/slots/10/ICMGGhq0f+001680
Moving to projects directory: /var/lib/boinc/slots/10/ICMSHhq0f+001680
Moving to projects directory: /var/lib/boinc/slots/10/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMGGhq0f+001668
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMSHhq0f+001668
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12190863/ICMUAhq0f+001668
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0219_2005050100_123_974_12190863_1_r1470681309_69.zip
Uploading the intermediate file: upload_file_69.zip
  13:30:54 STEP 1681 H=1681:00 +CPU= 26.028
  13:31:24 STEP 1682 H=1682:00 +CPU= 26.738
  13:32:09 STEP 1683 H=1683:00 +CPU= 41.525
  13:32:39 STEP 1684 H=1684:00 +CPU= 27.273
Abort request received from BOINC client, ending the child process

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:11:52 1493665 22287199 oifs_43r3_ps_0219_2005050100_123_974_12190863_1 5,184,000 47,198 0.0091
09 May 2023 16:11:46 1493665 22287199 oifs_43r3_ps_0219_2005050100_123_974_12190863_1 4,320,000 39,830 0.0092
09 May 2023 16:11:29 1493665 22287199 oifs_43r3_ps_0219_2005050100_123_974_12190863_1 2,851,200 26,750 0.0094


©2024 climateprediction.net