climateprediction.net home page
Task 22250143

Task 22250143

Name oifs_43r3_ps_0989_2021050100_123_945_12164078_1
Workunit 12164078
Created 13 Dec 2022, 2:49:51 UTC
Sent 13 Dec 2022, 3:05:27 UTC
Report deadline 12 Jan 2023, 3:05:27 UTC
Received 13 Dec 2022, 17:12:35 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1494087
Run time 12 hours 44 min 55 sec
CPU time 12 hours 32 min 29 sec
Validate state Invalid
Credit 8,467.20
Device peak FLOPS 5.80 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,415.56 MB
Peak swap size 4,974.32 MB
Peak disk usage 1,898.11 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
EP 1215 H=1215:00 +CPU= 38.687
  06:20:19 STEP 1216 H=1216:00 +CPU= 19.439
  06:20:43 STEP 1217 H=1217:00 +CPU= 22.993
  06:21:18 STEP 1218 H=1218:00 +CPU= 34.896
  06:21:38 STEP 1219 H=1219:00 +CPU= 19.460
  06:22:05 STEP 1220 H=1220:00 +CPU= 26.569
  06:22:37 STEP 1221 H=1221:00 +CPU= 31.441
  06:23:03 STEP 1222 H=1222:00 +CPU= 25.795
  06:23:28 STEP 1223 H=1223:00 +CPU= 24.486
  06:23:56 STEP 1224 H=1224:00 +CPU= 28.627
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001224
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001224
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001224
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001200
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001200
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001200
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001212
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001212
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001212
Zipping up the intermediate file: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_0989_2021050100_123_945_12164078_1_r1856596290_50.zip
Uploading the intermediate file: upload_file_50.zip
  06:24:12 STEP 1225 H=1225:00 +CPU= 15.338
  06:24:32 STEP 1226 H=1226:00 +CPU= 19.292
  06:25:11 STEP 1227 H=1227:00 +CPU= 38.133
  06:25:31 STEP 1228 H=1228:00 +CPU= 20.266
  06:25:51 STEP 1229 H=1229:00 +CPU= 19.179
  06:26:28 STEP 1230 H=1230:00 +CPU= 37.142
  06:26:47 STEP 1231 H=1231:00 +CPU= 18.126
  06:27:09 STEP 1232 H=1232:00 +CPU= 22.017
  06:27:45 STEP 1233 H=1233:00 +CPU= 35.677
  06:28:06 STEP 1234 H=1234:00 +CPU= 20.796
  06:28:32 STEP 1235 H=1235:00 +CPU= 25.726
  06:29:07 STEP 1236 H=1236:00 +CPU= 33.786
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001236
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001236
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001236
  06:29:35 STEP 1237 H=1237:00 +CPU= 27.727
  06:29:56 STEP 1238 H=1238:00 +CPU= 21.061
  06:30:21 STEP 1239 H=1239:00 +CPU= 24.210
  06:30:37 STEP 1240 H=1240:00 +CPU= 16.241
  06:30:56 STEP 1241 H=1241:00 +CPU= 18.793
  06:31:35 STEP 1242 H=1242:00 +CPU= 37.967
  06:31:56 STEP 1243 H=1243:00 +CPU= 21.189
  06:32:17 STEP 1244 H=1244:00 +CPU= 20.605
  06:32:54 STEP 1245 H=1245:00 +CPU= 36.491
  06:33:14 STEP 1246 H=1246:00 +CPU= 20.073
  06:33:42 STEP 1247 H=1247:00 +CPU= 27.434
  06:34:18 STEP 1248 H=1248:00 +CPU= 35.284
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001248
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001248
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001248
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001224
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001224
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001224
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001236
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001236
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001236
Zipping up the intermediate file: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_0989_2021050100_123_945_12164078_1_r1856596290_51.zip
Uploading the intermediate file: upload_file_51.zip
  06:34:39 STEP 1249 H=1249:00 +CPU= 20.147
  06:35:03 STEP 1250 H=1250:00 +CPU= 23.686
  06:35:35 STEP 1251 H=1251:00 +CPU= 31.384
  06:36:03 STEP 1252 H=1252:00 +CPU= 28.099
  06:36:23 STEP 1253 H=1253:00 +CPU= 19.280
  06:36:47 STEP 1254 H=1254:00 +CPU= 24.035
  06:37:03 STEP 1255 H=1255:00 +CPU= 16.384
  06:37:23 STEP 1256 H=1256:00 +CPU= 19.754
  06:38:00 STEP 1257 H=1257:00 +CPU= 36.060
  06:38:22 STEP 1258 H=1258:00 +CPU= 21.436
  06:38:43 STEP 1259 H=1259:00 +CPU= 20.523
  06:39:24 STEP 1260 H=1260:00 +CPU= 39.907
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001260
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001260
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001260
  06:39:43 STEP 1261 H=1261:00 +CPU= 18.752
  06:40:12 STEP 1262 H=1262:00 +CPU= 28.235
  06:40:44 STEP 1263 H=1263:00 +CPU= 32.030
  06:41:06 STEP 1264 H=1264:00 +CPU= 22.024
  06:41:29 STEP 1265 H=1265:00 +CPU= 22.340
  06:41:59 STEP 1266 H=1266:00 +CPU= 29.503
  06:42:28 STEP 1267 H=1267:00 +CPU= 28.419
  06:42:48 STEP 1268 H=1268:00 +CPU= 19.639
  06:43:11 STEP 1269 H=1269:00 +CPU= 23.469
  06:43:28 STEP 1270 H=1270:00 +CPU= 16.599
  06:43:48 STEP 1271 H=1271:00 +CPU= 19.346
  06:44:35 STEP 1272 H=1272:00 +CPU= 46.832
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001272
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001272
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001272
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001248
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001248
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001248
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001260
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001260
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001260
Zipping up the intermediate file: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_0989_2021050100_123_945_12164078_1_r1856596290_52.zip
Uploading the intermediate file: upload_file_52.zip
  06:44:55 STEP 1273 H=1273:00 +CPU= 19.216
  06:45:21 STEP 1274 H=1274:00 +CPU= 24.825
  06:45:52 STEP 1275 H=1275:00 +CPU= 31.245
  06:46:13 STEP 1276 H=1276:00 +CPU= 20.408
  06:46:38 STEP 1277 H=1277:00 +CPU= 24.910
  06:47:10 STEP 1278 H=1278:00 +CPU= 30.749
  06:47:36 STEP 1279 H=1279:00 +CPU= 25.737
  06:48:00 STEP 1280 H=1280:00 +CPU= 24.346
  06:48:34 STEP 1281 H=1281:00 +CPU= 32.791
  06:49:00 STEP 1282 H=1282:00 +CPU= 25.466
  06:49:16 STEP 1283 H=1283:00 +CPU= 16.304
  06:49:43 STEP 1284 H=1284:00 +CPU= 26.784
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001284
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001284
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001284
  06:50:01 STEP 1285 H=1285:00 +CPU= 18.018
  06:50:23 STEP 1286 H=1286:00 +CPU= 21.431
  06:51:02 STEP 1287 H=1287:00 +CPU= 37.793
  06:51:21 STEP 1288 H=1288:00 +CPU= 19.525
  06:51:45 STEP 1289 H=1289:00 +CPU= 23.440
  06:52:21 STEP 1290 H=1290:00 +CPU= 35.417
  06:52:42 STEP 1291 H=1291:00 +CPU= 20.714
  06:53:11 STEP 1292 H=1292:00 +CPU= 28.278
  06:53:40 STEP 1293 H=1293:00 +CPU= 28.506
  06:54:08 STEP 1294 H=1294:00 +CPU= 27.335
  06:54:31 STEP 1295 H=1295:00 +CPU= 22.828
  06:55:14 STEP 1296 H=1296:00 +CPU= 41.774
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001296
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001296
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001296
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001272
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001272
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001272
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001284
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001284
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001284
Zipping up the intermediate file: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_0989_2021050100_123_945_12164078_1_r1856596290_53.zip
Uploading the intermediate file: upload_file_53.zip
  06:55:37 STEP 1297 H=1297:00 +CPU= 23.079
  06:55:53 STEP 1298 H=1298:00 +CPU= 15.192
  06:56:18 STEP 1299 H=1299:00 +CPU= 25.041
  06:56:37 STEP 1300 H=1300:00 +CPU= 19.288
  06:57:00 STEP 1301 H=1301:00 +CPU= 22.415
  06:57:39 STEP 1302 H=1302:00 +CPU= 37.788
  06:57:59 STEP 1303 H=1303:00 +CPU= 20.188
  06:58:27 STEP 1304 H=1304:00 +CPU= 27.620
  06:58:58 STEP 1305 H=1305:00 +CPU= 30.205
  06:59:25 STEP 1306 H=1306:00 +CPU= 26.948
  06:59:49 STEP 1307 H=1307:00 +CPU= 23.981
  07:00:25 STEP 1308 H=1308:00 +CPU= 34.950
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001308
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001308
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001308
  07:00:53 STEP 1309 H=1309:00 +CPU= 27.025
  07:01:12 STEP 1310 H=1310:00 +CPU= 19.524
  07:01:51 STEP 1311 H=1311:00 +CPU= 37.582
  07:02:13 STEP 1312 H=1312:00 +CPU= 21.624
  07:02:28 STEP 1313 H=1313:00 +CPU= 14.895
  07:02:53 STEP 1314 H=1314:00 +CPU= 24.808
  07:03:10 STEP 1315 H=1315:00 +CPU= 17.687
  07:03:34 STEP 1316 H=1316:00 +CPU= 22.933
  07:04:10 STEP 1317 H=1317:00 +CPU= 35.958
  07:04:30 STEP 1318 H=1318:00 +CPU= 19.594
  07:04:57 STEP 1319 H=1319:00 +CPU= 26.885
  07:05:35 STEP 1320 H=1320:00 +CPU= 37.304
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001320
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001320
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001320
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001296
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001296
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001296
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001308
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001308
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001308
Zipping up the intermediate file: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_0989_2021050100_123_945_12164078_1_r1856596290_54.zip
Uploading the intermediate file: upload_file_54.zip
  07:06:00 STEP 1321 H=1321:00 +CPU= 24.426
  07:06:25 STEP 1322 H=1322:00 +CPU= 24.972
  07:06:57 STEP 1323 H=1323:00 +CPU= 31.367
  07:07:25 STEP 1324 H=1324:00 +CPU= 27.544
  07:07:44 STEP 1325 H=1325:00 +CPU= 19.208
  07:08:24 STEP 1326 H=1326:00 +CPU= 39.184
  07:08:47 STEP 1327 H=1327:00 +CPU= 22.166
  07:09:02 STEP 1328 H=1328:00 +CPU= 15.060
  07:09:27 STEP 1329 H=1329:00 +CPU= 25.214
  07:09:47 STEP 1330 H=1330:00 +CPU= 19.889
  07:10:12 STEP 1331 H=1331:00 +CPU= 24.127
  07:10:49 STEP 1332 H=1332:00 +CPU= 36.153
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001332
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001332
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001332
  07:11:09 STEP 1333 H=1333:00 +CPU= 19.952
  07:11:36 STEP 1334 H=1334:00 +CPU= 26.967
  07:12:07 STEP 1335 H=1335:00 +CPU= 30.663
  07:12:34 STEP 1336 H=1336:00 +CPU= 26.698
  07:12:58 STEP 1337 H=1337:00 +CPU= 23.989
  07:13:28 STEP 1338 H=1338:00 +CPU= 29.572
  07:13:57 STEP 1339 H=1339:00 +CPU= 28.278
  07:14:18 STEP 1340 H=1340:00 +CPU= 20.385
  07:14:52 STEP 1341 H=1341:00 +CPU= 33.628
  07:15:17 STEP 1342 H=1342:00 +CPU= 24.171
  07:15:32 STEP 1343 H=1343:00 +CPU= 15.064
  07:16:03 STEP 1344 H=1344:00 +CPU= 30.251
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001344
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001344
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001344
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001320
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001320
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001320
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001332
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001332
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001332
Zipping up the intermediate file: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_0989_2021050100_123_945_12164078_1_r1856596290_55.zip
Uploading the intermediate file: upload_file_55.zip
  07:16:21 STEP 1345 H=1345:00 +CPU= 18.494
  07:16:44 STEP 1346 H=1346:00 +CPU= 22.789
  07:17:18 STEP 1347 H=1347:00 +CPU= 33.584
  07:17:40 STEP 1348 H=1348:00 +CPU= 21.337
  07:18:06 STEP 1349 H=1349:00 +CPU= 25.292
  07:18:38 STEP 1350 H=1350:00 +CPU= 31.381
  07:19:05 STEP 1351 H=1351:00 +CPU= 26.289
  07:19:29 STEP 1352 H=1352:00 +CPU= 24.337
  07:20:01 STEP 1353 H=1353:00 +CPU= 30.824
  07:20:28 STEP 1354 H=1354:00 +CPU= 26.838
  07:20:47 STEP 1355 H=1355:00 +CPU= 17.875
  07:21:27 STEP 1356 H=1356:00 +CPU= 39.888
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001356
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001356
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001356
  07:21:46 STEP 1357 H=1357:00 +CPU= 18.800
  07:22:02 STEP 1358 H=1358:00 +CPU= 15.854
  07:22:27 STEP 1359 H=1359:00 +CPU= 24.495
  07:22:45 STEP 1360 H=1360:00 +CPU= 18.018
  07:23:09 STEP 1361 H=1361:00 +CPU= 23.375
  07:23:45 STEP 1362 H=1362:00 +CPU= 35.960
  07:24:06 STEP 1363 H=1363:00 +CPU= 20.615
  07:24:35 STEP 1364 H=1364:00 +CPU= 28.386
  07:25:06 STEP 1365 H=1365:00 +CPU= 31.035
  07:25:34 STEP 1366 H=1366:00 +CPU= 26.834
  07:25:57 STEP 1367 H=1367:00 +CPU= 22.628
  07:26:40 STEP 1368 H=1368:00 +CPU= 42.735
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001368
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001368
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001368
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001344
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001344
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001344
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001356
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001356
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001356
Zipping up the intermediate file: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_0989_2021050100_123_945_12164078_1_r1856596290_56.zip
Uploading the intermediate file: upload_file_56.zip
  07:27:02 STEP 1369 H=1369:00 +CPU= 21.840
  07:27:22 STEP 1370 H=1370:00 +CPU= 19.374
  07:27:58 STEP 1371 H=1371:00 +CPU= 35.749
  07:28:15 STEP 1372 H=1372:00 +CPU= 16.431
  07:28:31 STEP 1373 H=1373:00 +CPU= 15.956
  07:28:58 STEP 1374 H=1374:00 +CPU= 27.085
  07:29:18 STEP 1375 H=1375:00 +CPU= 19.121
  07:29:47 STEP 1376 H=1376:00 +CPU= 28.237
  07:30:19 STEP 1377 H=1377:00 +CPU= 31.790
  07:30:42 STEP 1378 H=1378:00 +CPU= 22.568
  07:31:07 STEP 1379 H=1379:00 +CPU= 24.929
  07:31:44 STEP 1380 H=1380:00 +CPU= 35.863
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001380
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001380
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001380
  07:32:09 STEP 1381 H=1381:00 +CPU= 24.804
  07:32:30 STEP 1382 H=1382:00 +CPU= 20.568
  07:33:07 STEP 1383 H=1383:00 +CPU= 36.283
  07:33:32 STEP 1384 H=1384:00 +CPU= 24.728
  07:33:50 STEP 1385 H=1385:00 +CPU= 17.789
  07:34:26 STEP 1386 H=1386:00 +CPU= 35.831
  07:34:44 STEP 1387 H=1387:00 +CPU= 16.993
  07:34:59 STEP 1388 H=1388:00 +CPU= 15.390
  07:35:26 STEP 1389 H=1389:00 +CPU= 26.506
  07:35:45 STEP 1390 H=1390:00 +CPU= 19.336
  07:36:14 STEP 1391 H=1391:00 +CPU= 28.101
  07:36:50 STEP 1392 H=1392:00 +CPU= 35.547
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001392
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001392
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001392
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001368
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001368
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001368
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001380
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001380
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001380
Zipping up the intermediate file: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_0989_2021050100_123_945_12164078_1_r1856596290_57.zip
Uploading the intermediate file: upload_file_57.zip
  07:37:14 STEP 1393 H=1393:00 +CPU= 23.907
  07:37:40 STEP 1394 H=1394:00 +CPU= 25.743
  07:38:09 STEP 1395 H=1395:00 +CPU= 28.168
  07:38:38 STEP 1396 H=1396:00 +CPU= 27.887
  07:38:58 STEP 1397 H=1397:00 +CPU= 19.745
  07:39:33 STEP 1398 H=1398:00 +CPU= 34.780
  07:39:57 STEP 1399 H=1399:00 +CPU= 23.111
  07:40:17 STEP 1400 H=1400:00 +CPU= 19.513
  07:40:59 STEP 1401 H=1401:00 +CPU= 41.232
  07:41:15 STEP 1402 H=1402:00 +CPU= 15.806
  07:41:31 STEP 1403 H=1403:00 +CPU= 15.704
  07:42:01 STEP 1404 H=1404:00 +CPU= 29.682
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001404
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001404
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001404
  07:42:21 STEP 1405 H=1405:00 +CPU= 19.978
  07:42:50 STEP 1406 H=1406:00 +CPU= 29.137
  07:43:20 STEP 1407 H=1407:00 +CPU= 29.359
  07:43:46 STEP 1408 H=1408:00 +CPU= 25.608
  07:44:10 STEP 1409 H=1409:00 +CPU= 23.716
  07:44:43 STEP 1410 H=1410:00 +CPU= 32.179
  07:45:09 STEP 1411 H=1411:00 +CPU= 25.354
  07:45:29 STEP 1412 H=1412:00 +CPU= 19.741
  07:46:03 STEP 1413 H=1413:00 +CPU= 33.622
  07:46:31 STEP 1414 H=1414:00 +CPU= 27.126
  07:46:50 STEP 1415 H=1415:00 +CPU= 19.172
  07:47:35 STEP 1416 H=1416:00 +CPU= 43.970
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001416
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001416
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001416
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001392
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001392
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001392
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001404
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001404
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001404
Zipping up the intermediate file: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_0989_2021050100_123_945_12164078_1_r1856596290_58.zip
Uploading the intermediate file: upload_file_58.zip
  07:47:51 STEP 1417 H=1417:00 +CPU= 15.653
  07:48:06 STEP 1418 H=1418:00 +CPU= 15.766
  07:48:33 STEP 1419 H=1419:00 +CPU= 26.083
  07:48:52 STEP 1420 H=1420:00 +CPU= 18.646
  07:49:20 STEP 1421 H=1421:00 +CPU= 27.245
  07:49:51 STEP 1422 H=1422:00 +CPU= 30.867
  07:50:15 STEP 1423 H=1423:00 +CPU= 23.341
  07:50:40 STEP 1424 H=1424:00 +CPU= 24.742
  07:51:10 STEP 1425 H=1425:00 +CPU= 29.752
  07:51:37 STEP 1426 H=1426:00 +CPU= 26.513
  07:51:57 STEP 1427 H=1427:00 +CPU= 19.492
  07:52:38 STEP 1428 H=1428:00 +CPU= 40.061
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001428
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001428
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001428
  07:53:00 STEP 1429 H=1429:00 +CPU= 22.130
  07:53:19 STEP 1430 H=1430:00 +CPU= 18.742
  07:53:57 STEP 1431 H=1431:00 +CPU= 37.449
  07:54:14 STEP 1432 H=1432:00 +CPU= 16.897
  07:54:30 STEP 1433 H=1433:00 +CPU= 15.541
  07:54:57 STEP 1434 H=1434:00 +CPU= 26.685
  07:55:17 STEP 1435 H=1435:00 +CPU= 19.642
  07:55:46 STEP 1436 H=1436:00 +CPU= 28.136
  07:56:17 STEP 1437 H=1437:00 +CPU= 30.870
  07:56:43 STEP 1438 H=1438:00 +CPU= 25.280
  07:57:08 STEP 1439 H=1439:00 +CPU= 24.736
  07:57:47 STEP 1440 H=1440:00 +CPU= 38.251
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001440
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001440
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001440
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001416
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001416
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001416
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001428
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001428
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001428
Zipping up the intermediate file: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_0989_2021050100_123_945_12164078_1_r1856596290_59.zip
Uploading the intermediate file: upload_file_59.zip
  07:58:13 STEP 1441 H=1441:00 +CPU= 25.392
Uploading trickle at timestep: 5184000
  07:58:31 STEP 1442 H=1442:00 +CPU= 18.085
  07:59:11 STEP 1443 H=1443:00 +CPU= 38.598
  07:59:32 STEP 1444 H=1444:00 +CPU= 21.266
  07:59:53 STEP 1445 H=1445:00 +CPU= 20.670
  08:00:33 STEP 1446 H=1446:00 +CPU= 38.225
  08:00:47 STEP 1447 H=1447:00 +CPU= 14.656
  08:01:03 STEP 1448 H=1448:00 +CPU= 15.680
  08:01:30 STEP 1449 H=1449:00 +CPU= 26.392
  08:01:50 STEP 1450 H=1450:00 +CPU= 20.249
  08:02:17 STEP 1451 H=1451:00 +CPU= 26.583
  08:02:52 STEP 1452 H=1452:00 +CPU= 33.639
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001452
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001452
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001452
  08:03:18 STEP 1453 H=1453:00 +CPU= 25.393
  08:03:41 STEP 1454 H=1454:00 +CPU= 23.278
  08:04:14 STEP 1455 H=1455:00 +CPU= 31.814
  08:04:43 STEP 1456 H=1456:00 +CPU= 29.021
  08:05:02 STEP 1457 H=1457:00 +CPU= 18.816
  08:05:40 STEP 1458 H=1458:00 +CPU= 37.407
  08:06:02 STEP 1459 H=1459:00 +CPU= 21.605
  08:06:21 STEP 1460 H=1460:00 +CPU= 19.303
  08:07:00 STEP 1461 H=1461:00 +CPU= 37.759
  08:07:18 STEP 1462 H=1462:00 +CPU= 17.730
  08:07:34 STEP 1463 H=1463:00 +CPU= 16.219
  08:08:07 STEP 1464 H=1464:00 +CPU= 32.353
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001464
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001464
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001464
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001440
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001440
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001440
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001452
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001452
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001452
Zipping up the intermediate file: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_0989_2021050100_123_945_12164078_1_r1856596290_60.zip
Uploading the intermediate file: upload_file_60.zip
  08:08:28 STEP 1465 H=1465:00 +CPU= 20.461
  08:08:54 STEP 1466 H=1466:00 +CPU= 26.137
  08:09:25 STEP 1467 H=1467:00 +CPU= 30.229
  08:09:52 STEP 1468 H=1468:00 +CPU= 26.794
  08:10:16 STEP 1469 H=1469:00 +CPU= 23.503
  08:10:50 STEP 1470 H=1470:00 +CPU= 33.145
  08:11:18 STEP 1471 H=1471:00 +CPU= 27.941
  08:11:38 STEP 1472 H=1472:00 +CPU= 19.424
  08:12:16 STEP 1473 H=1473:00 +CPU= 37.488
  08:12:38 STEP 1474 H=1474:00 +CPU= 21.211
  08:12:59 STEP 1475 H=1475:00 +CPU= 21.090
  08:13:40 STEP 1476 H=1476:00 +CPU= 40.257
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001476
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001476
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001476
  08:13:55 STEP 1477 H=1477:00 +CPU= 14.763
  08:14:11 STEP 1478 H=1478:00 +CPU= 15.553
  08:14:39 STEP 1479 H=1479:00 +CPU= 28.521
  08:15:04 STEP 1480 H=1480:00 +CPU= 24.365
  08:15:31 STEP 1481 H=1481:00 +CPU= 25.853
  08:16:03 STEP 1482 H=1482:00 +CPU= 31.787
  08:16:29 STEP 1483 H=1483:00 +CPU= 25.993
  08:16:50 STEP 1484 H=1484:00 +CPU= 20.204
  08:17:26 STEP 1485 H=1485:00 +CPU= 35.847
  08:17:52 STEP 1486 H=1486:00 +CPU= 25.918
  08:18:13 STEP 1487 H=1487:00 +CPU= 20.197
  08:19:00 STEP 1488 H=1488:00 +CPU= 45.872
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001488
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001488
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001488
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001464
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001464
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001464
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001476
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001476
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001476
Zipping up the intermediate file: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_0989_2021050100_123_945_12164078_1_r1856596290_61.zip
Uploading the intermediate file: upload_file_61.zip
  08:19:18 STEP 1489 H=1489:00 +CPU= 18.466
  08:19:44 STEP 1490 H=1490:00 +CPU= 25.212
  08:20:16 STEP 1491 H=1491:00 +CPU= 32.005
  08:20:33 STEP 1492 H=1492:00 +CPU= 16.093
  08:20:49 STEP 1493 H=1493:00 +CPU= 15.763
  08:21:20 STEP 1494 H=1494:00 +CPU= 30.612
  08:21:49 STEP 1495 H=1495:00 +CPU= 28.857
  08:22:12 STEP 1496 H=1496:00 +CPU= 22.444
  08:22:48 STEP 1497 H=1497:00 +CPU= 36.144
  08:23:12 STEP 1498 H=1498:00 +CPU= 22.587
  08:23:31 STEP 1499 H=1499:00 +CPU= 19.319
  08:24:13 STEP 1500 H=1500:00 +CPU= 41.131
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001500
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001500
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001500
  08:24:32 STEP 1501 H=1501:00 +CPU= 19.277
  08:24:54 STEP 1502 H=1502:00 +CPU= 21.239
  08:25:34 STEP 1503 H=1503:00 +CPU= 38.342
  08:25:53 STEP 1504 H=1504:00 +CPU= 19.055
  08:26:21 STEP 1505 H=1505:00 +CPU= 27.750
  08:26:50 STEP 1506 H=1506:00 +CPU= 28.363
  08:27:05 STEP 1507 H=1507:00 +CPU= 15.452
  08:27:23 STEP 1508 H=1508:00 +CPU= 17.445
  08:27:54 STEP 1509 H=1509:00 +CPU= 30.832
  08:28:19 STEP 1510 H=1510:00 +CPU= 24.555
  08:28:39 STEP 1511 H=1511:00 +CPU= 19.957
  08:29:22 STEP 1512 H=1512:00 +CPU= 42.484
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001512
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001512
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001512
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001488
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001488
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001488
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001500
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001500
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001500
Zipping up the intermediate file: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_0989_2021050100_123_945_12164078_1_r1856596290_62.zip
Uploading the intermediate file: upload_file_62.zip
  08:29:43 STEP 1513 H=1513:00 +CPU= 20.670
  08:30:03 STEP 1514 H=1514:00 +CPU= 18.835
  08:30:43 STEP 1515 H=1515:00 +CPU= 39.268
  08:31:03 STEP 1516 H=1516:00 +CPU= 19.871
  08:31:24 STEP 1517 H=1517:00 +CPU= 20.759
  08:32:00 STEP 1518 H=1518:00 +CPU= 35.998
  08:32:20 STEP 1519 H=1519:00 +CPU= 18.979
  08:32:46 STEP 1520 H=1520:00 +CPU= 25.529
  08:33:13 STEP 1521 H=1521:00 +CPU= 26.756
  08:33:29 STEP 1522 H=1522:00 +CPU= 16.171
  08:33:45 STEP 1523 H=1523:00 +CPU= 15.635
  08:34:20 STEP 1524 H=1524:00 +CPU= 34.497
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001524
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001524
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001524
  08:34:45 STEP 1525 H=1525:00 +CPU= 24.941
  08:35:06 STEP 1526 H=1526:00 +CPU= 20.018
  08:35:40 STEP 1527 H=1527:00 +CPU= 33.575
  08:36:05 STEP 1528 H=1528:00 +CPU= 25.217
  08:36:24 STEP 1529 H=1529:00 +CPU= 18.571
  08:37:04 STEP 1530 H=1530:00 +CPU= 38.816
  08:37:23 STEP 1531 H=1531:00 +CPU= 19.161
  08:37:44 STEP 1532 H=1532:00 +CPU= 20.742
  08:38:22 STEP 1533 H=1533:00 +CPU= 37.321
  08:38:41 STEP 1534 H=1534:00 +CPU= 18.469
  08:39:03 STEP 1535 H=1535:00 +CPU= 21.522
  08:39:42 STEP 1536 H=1536:00 +CPU= 38.627
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001536
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001536
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001536
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001512
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001512
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001512
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001524
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001524
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001524
Zipping up the intermediate file: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_0989_2021050100_123_945_12164078_1_r1856596290_63.zip
Uploading the intermediate file: upload_file_63.zip
  08:39:57 STEP 1537 H=1537:00 +CPU= 15.408
  08:40:14 STEP 1538 H=1538:00 +CPU= 16.520
  08:40:44 STEP 1539 H=1539:00 +CPU= 29.126
  08:41:12 STEP 1540 H=1540:00 +CPU= 27.373
  08:41:33 STEP 1541 H=1541:00 +CPU= 21.652
  08:42:08 STEP 1542 H=1542:00 +CPU= 34.400
  08:42:32 STEP 1543 H=1543:00 +CPU= 23.323
  08:42:52 STEP 1544 H=1544:00 +CPU= 19.648
  08:43:29 STEP 1545 H=1545:00 +CPU= 36.527
  08:43:51 STEP 1546 H=1546:00 +CPU= 21.443
  08:44:12 STEP 1547 H=1547:00 +CPU= 20.144
  08:44:53 STEP 1548 H=1548:00 +CPU= 40.675
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001548
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001548
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001548
  08:45:12 STEP 1549 H=1549:00 +CPU= 19.011
  08:45:41 STEP 1550 H=1550:00 +CPU= 27.880
  08:46:08 STEP 1551 H=1551:00 +CPU= 27.209
  08:46:24 STEP 1552 H=1552:00 +CPU= 16.095
  08:46:41 STEP 1553 H=1553:00 +CPU= 16.338
  08:47:12 STEP 1554 H=1554:00 +CPU= 30.434
  08:47:38 STEP 1555 H=1555:00 +CPU= 25.996
  08:48:00 STEP 1556 H=1556:00 +CPU= 21.148
  08:48:34 STEP 1557 H=1557:00 +CPU= 33.573
  08:49:00 STEP 1558 H=1558:00 +CPU= 25.833
  08:49:19 STEP 1559 H=1559:00 +CPU= 19.214
  08:50:07 STEP 1560 H=1560:00 +CPU= 46.330
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001560
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001560
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001560
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001536
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001536
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001536
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001548
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001548
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001548
Zipping up the intermediate file: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_0989_2021050100_123_945_12164078_1_r1856596290_64.zip
Uploading the intermediate file: upload_file_64.zip
  08:50:26 STEP 1561 H=1561:00 +CPU= 18.845
  08:50:49 STEP 1562 H=1562:00 +CPU= 22.543
  08:51:26 STEP 1563 H=1563:00 +CPU= 36.413
  08:51:46 STEP 1564 H=1564:00 +CPU= 19.573
  08:52:15 STEP 1565 H=1565:00 +CPU= 28.052
  08:52:44 STEP 1566 H=1566:00 +CPU= 29.050
  08:52:59 STEP 1567 H=1567:00 +CPU= 15.363
  08:53:15 STEP 1568 H=1568:00 +CPU= 15.484
  08:53:46 STEP 1569 H=1569:00 +CPU= 30.513
  08:54:15 STEP 1570 H=1570:00 +CPU= 28.613
  08:54:36 STEP 1571 H=1571:00 +CPU= 20.259
  08:55:16 STEP 1572 H=1572:00 +CPU= 39.400
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001572
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001572
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001572
  08:55:40 STEP 1573 H=1573:00 +CPU= 22.900
  08:55:59 STEP 1574 H=1574:00 +CPU= 18.912
  08:56:36 STEP 1575 H=1575:00 +CPU= 36.734
  08:56:56 STEP 1576 H=1576:00 +CPU= 19.948
  08:57:16 STEP 1577 H=1577:00 +CPU= 19.305
  08:57:58 STEP 1578 H=1578:00 +CPU= 41.248
  08:58:17 STEP 1579 H=1579:00 +CPU= 18.852
  08:58:41 STEP 1580 H=1580:00 +CPU= 23.663
  08:59:13 STEP 1581 H=1581:00 +CPU= 32.043
  08:59:31 STEP 1582 H=1582:00 +CPU= 17.010
  08:59:46 STEP 1583 H=1583:00 +CPU= 15.584
  09:00:26 STEP 1584 H=1584:00 +CPU= 39.061
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001584
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001584
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001584
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001560
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001560
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001560
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001572
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001572
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001572
Zipping up the intermediate file: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_0989_2021050100_123_945_12164078_1_r1856596290_65.zip
Uploading the intermediate file: upload_file_65.zip
  09:00:52 STEP 1585 H=1585:00 +CPU= 25.676
  09:01:13 STEP 1586 H=1586:00 +CPU= 20.694
  09:01:49 STEP 1587 H=1587:00 +CPU= 35.163
  09:02:13 STEP 1588 H=1588:00 +CPU= 23.915
  09:02:32 STEP 1589 H=1589:00 +CPU= 18.903
  09:03:11 STEP 1590 H=1590:00 +CPU= 38.239
  09:03:30 STEP 1591 H=1591:00 +CPU= 18.726
  09:03:52 STEP 1592 H=1592:00 +CPU= 21.581
  09:04:29 STEP 1593 H=1593:00 +CPU= 36.093
  09:04:50 STEP 1594 H=1594:00 +CPU= 20.761
  09:05:20 STEP 1595 H=1595:00 +CPU= 28.920
  09:05:50 STEP 1596 H=1596:00 +CPU= 29.389
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001596
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001596
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001596
  09:06:05 STEP 1597 H=1597:00 +CPU= 14.942
  09:06:22 STEP 1598 H=1598:00 +CPU= 17.240
  09:06:54 STEP 1599 H=1599:00 +CPU= 31.722
  09:07:21 STEP 1600 H=1600:00 +CPU= 26.253
  09:07:41 STEP 1601 H=1601:00 +CPU= 19.524
  09:08:19 STEP 1602 H=1602:00 +CPU= 37.895
  09:08:42 STEP 1603 H=1603:00 +CPU= 22.312
  09:09:01 STEP 1604 H=1604:00 +CPU= 18.662
  09:09:40 STEP 1605 H=1605:00 +CPU= 38.971
  09:10:00 STEP 1606 H=1606:00 +CPU= 18.957
  09:10:24 STEP 1607 H=1607:00 +CPU= 23.104
  09:11:04 STEP 1608 H=1608:00 +CPU= 39.438
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001608
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001608
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001608
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001584
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001584
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001584
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001596
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001596
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001596
Zipping up the intermediate file: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_0989_2021050100_123_945_12164078_1_r1856596290_66.zip
Uploading the intermediate file: upload_file_66.zip
  09:11:23 STEP 1609 H=1609:00 +CPU= 19.161
  09:11:49 STEP 1610 H=1610:00 +CPU= 25.277
  09:12:14 STEP 1611 H=1611:00 +CPU= 25.372
  09:12:30 STEP 1612 H=1612:00 +CPU= 15.365
  09:12:46 STEP 1613 H=1613:00 +CPU= 15.964
  09:13:17 STEP 1614 H=1614:00 +CPU= 31.178
  09:13:44 STEP 1615 H=1615:00 +CPU= 26.037
  09:14:02 STEP 1616 H=1616:00 +CPU= 18.160
  09:14:37 STEP 1617 H=1617:00 +CPU= 35.007
  09:15:01 STEP 1618 H=1618:00 +CPU= 23.153
  09:15:20 STEP 1619 H=1619:00 +CPU= 18.671
  09:16:02 STEP 1620 H=1620:00 +CPU= 40.977
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001620
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001620
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001620
  09:16:20 STEP 1621 H=1621:00 +CPU= 18.766
  09:16:44 STEP 1622 H=1622:00 +CPU= 23.605
  09:17:17 STEP 1623 H=1623:00 +CPU= 32.629
  09:17:38 STEP 1624 H=1624:00 +CPU= 20.098
  09:18:03 STEP 1625 H=1625:00 +CPU= 24.959
  09:18:29 STEP 1626 H=1626:00 +CPU= 25.437
  09:18:44 STEP 1627 H=1627:00 +CPU= 15.047
  09:19:00 STEP 1628 H=1628:00 +CPU= 15.737
  09:19:28 STEP 1629 H=1629:00 +CPU= 27.887
  09:19:55 STEP 1630 H=1630:00 +CPU= 27.055
  09:20:16 STEP 1631 H=1631:00 +CPU= 19.897
  09:20:59 STEP 1632 H=1632:00 +CPU= 42.225
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001632
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001632
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001632
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001608
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001608
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001608
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001620
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001620
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001620
Zipping up the intermediate file: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_0989_2021050100_123_945_12164078_1_r1856596290_67.zip
Uploading the intermediate file: upload_file_67.zip
  09:21:19 STEP 1633 H=1633:00 +CPU= 19.860
  09:21:38 STEP 1634 H=1634:00 +CPU= 19.034
  09:22:17 STEP 1635 H=1635:00 +CPU= 39.110
  09:22:36 STEP 1636 H=1636:00 +CPU= 18.539
  09:22:59 STEP 1637 H=1637:00 +CPU= 22.075
  09:23:34 STEP 1638 H=1638:00 +CPU= 35.519
  09:23:51 STEP 1639 H=1639:00 +CPU= 16.749
  09:24:16 STEP 1640 H=1640:00 +CPU= 24.637
  09:24:45 STEP 1641 H=1641:00 +CPU= 28.313
  09:25:00 STEP 1642 H=1642:00 +CPU= 15.455
  09:25:16 STEP 1643 H=1643:00 +CPU= 15.476
  09:25:48 STEP 1644 H=1644:00 +CPU= 31.732
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001644
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001644
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001644
  09:26:13 STEP 1645 H=1645:00 +CPU= 24.377
  09:26:32 STEP 1646 H=1646:00 +CPU= 19.255
  09:27:06 STEP 1647 H=1647:00 +CPU= 33.472
  09:27:30 STEP 1648 H=1648:00 +CPU= 23.238
  09:27:47 STEP 1649 H=1649:00 +CPU= 17.335
  09:28:22 STEP 1650 H=1650:00 +CPU= 34.648
  09:28:43 STEP 1651 H=1651:00 +CPU= 21.044
  09:29:01 STEP 1652 H=1652:00 +CPU= 17.789
  09:29:41 STEP 1653 H=1653:00 +CPU= 39.416
  09:29:59 STEP 1654 H=1654:00 +CPU= 17.519
  09:30:22 STEP 1655 H=1655:00 +CPU= 22.712
  09:31:01 STEP 1656 H=1656:00 +CPU= 37.848
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001656
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001656
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001656
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001632
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001632
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001632
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001644
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001644
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001644
Zipping up the intermediate file: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_0989_2021050100_123_945_12164078_1_r1856596290_68.zip
Uploading the intermediate file: upload_file_68.zip
  09:31:15 STEP 1657 H=1657:00 +CPU= 14.342
  09:31:29 STEP 1658 H=1658:00 +CPU= 14.308
  09:31:56 STEP 1659 H=1659:00 +CPU= 26.771
  09:32:18 STEP 1660 H=1660:00 +CPU= 21.508
  09:32:44 STEP 1661 H=1661:00 +CPU= 25.843
  09:33:13 STEP 1662 H=1662:00 +CPU= 28.577
  09:33:37 STEP 1663 H=1663:00 +CPU= 23.508
  09:34:00 STEP 1664 H=1664:00 +CPU= 22.746
  09:34:28 STEP 1665 H=1665:00 +CPU= 27.590
  09:34:56 STEP 1666 H=1666:00 +CPU= 27.046
  09:35:18 STEP 1667 H=1667:00 +CPU= 21.882
  09:35:56 STEP 1668 H=1668:00 +CPU= 37.607
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001668
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001668
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001668
  09:36:19 STEP 1669 H=1669:00 +CPU= 22.347
  09:36:38 STEP 1670 H=1670:00 +CPU= 19.084
  09:37:16 STEP 1671 H=1671:00 +CPU= 37.006
  09:37:34 STEP 1672 H=1672:00 +CPU= 17.879
  09:37:49 STEP 1673 H=1673:00 +CPU= 15.415
  09:38:17 STEP 1674 H=1674:00 +CPU= 26.763
  09:38:36 STEP 1675 H=1675:00 +CPU= 19.390
  09:39:06 STEP 1676 H=1676:00 +CPU= 29.465
  09:39:40 STEP 1677 H=1677:00 +CPU= 33.061
  09:40:05 STEP 1678 H=1678:00 +CPU= 23.561
  09:40:34 STEP 1679 H=1679:00 +CPU= 27.040
  09:41:48 STEP 1680 H=1680:00 +CPU= 43.443
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001680
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001680
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001680
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001656
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001656
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001656
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001668
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001668
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001668
Zipping up the intermediate file: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_0989_2021050100_123_945_12164078_1_r1856596290_69.zip
Uploading the intermediate file: upload_file_69.zip
  09:42:13 STEP 1681 H=1681:00 +CPU= 21.164
Uploading trickle at timestep: 6048000
  09:42:36 STEP 1682 H=1682:00 +CPU= 21.716
  09:43:16 STEP 1683 H=1683:00 +CPU= 38.773
  09:43:36 STEP 1684 H=1684:00 +CPU= 19.882
  09:44:01 STEP 1685 H=1685:00 +CPU= 23.832
  09:44:32 STEP 1686 H=1686:00 +CPU= 31.434
  09:44:48 STEP 1687 H=1687:00 +CPU= 15.874
  09:45:04 STEP 1688 H=1688:00 +CPU= 15.698
  09:45:33 STEP 1689 H=1689:00 +CPU= 28.421
  09:46:01 STEP 1690 H=1690:00 +CPU= 27.440
  09:46:22 STEP 1691 H=1691:00 +CPU= 20.650
  09:46:58 STEP 1692 H=1692:00 +CPU= 35.678
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001692
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001692
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001692
  09:47:24 STEP 1693 H=1693:00 +CPU= 26.006
  09:47:42 STEP 1694 H=1694:00 +CPU= 17.830
  09:48:18 STEP 1695 H=1695:00 +CPU= 35.844
  09:48:41 STEP 1696 H=1696:00 +CPU= 22.709
  09:49:00 STEP 1697 H=1697:00 +CPU= 18.286
  09:49:39 STEP 1698 H=1698:00 +CPU= 38.386
  09:49:57 STEP 1699 H=1699:00 +CPU= 18.244
  09:50:21 STEP 1700 H=1700:00 +CPU= 22.662
  09:50:57 STEP 1701 H=1701:00 +CPU= 35.816
  09:51:13 STEP 1702 H=1702:00 +CPU= 15.982
  09:51:29 STEP 1703 H=1703:00 +CPU= 15.872
  09:52:03 STEP 1704 H=1704:00 +CPU= 33.366
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001704
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001704
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001704
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001680
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001680
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001680
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMGGhpi1+001692
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMSHhpi1+001692
Adding to the zip: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078/ICMUAhpi1+001692
Zipping up the intermediate file: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_0989_2021050100_123_945_12164078_1_r1856596290_70.zip
Uploading the intermediate file: upload_file_70.zip
  09:52:25 STEP 1705 H=1705:00 +CPU= 22.082
  09:52:51 STEP 1706 H=1706:00 +CPU= 25.244
  09:53:20 STEP 1707 H=1707:00 +CPU= 28.552
  09:53:45 STEP 1708 H=1708:00 +CPU= 25.118
  09:54:07 STEP 1709 H=1709:00 +CPU= 21.443
  09:54:40 STEP 1710 H=1710:00 +CPU= 32.522
  09:55:08 STEP 1711 H=1711:00 +CPU= 27.477
  09:55:27 STEP 1712 H=1712:00 +CPU= 19.558
  09:56:04 STEP 1713 H=1713:00 +CPU= 36.009
  09:56:26 STEP 1714 H=1714:00 +CPU= 21.777
  09:56:45 STEP 1715 H=1715:00 +CPU= 18.724
  09:57:28 STEP 1716 H=1716:00 +CPU= 42.539
Moving to projects directory: /home/boinc/boinc/slots/9/ICMGGhpi1+001716
Moving to projects directory: /home/boinc/boinc/slots/9/ICMSHhpi1+001716
Moving to projects directory: /home/boinc/boinc/slots/9/ICMUAhpi1+001716
  09:57:43 STEP 1717 H=1717:00 +CPU= 14.663
  09:58:00 STEP 1718 H=1718:00 +CPU= 16.406
  09:58:27 STEP 1719 H=1719:00 +CPU= 27.359
  09:58:48 STEP 1720 H=1720:00 +CPU= 20.722
  09:59:14 STEP 1721 H=1721:00 +CPU= 25.560
  09:59:44 STEP 1722 H=1722:00 +CPU= 29.730
  10:00:12 STEP 1723 H=1723:00 +CPU= 26.664
  10:00:34 STEP 1724 H=1724:00 +CPU= 21.983
  10:01:06 STEP 1725 H=1725:00 +CPU= 31.386
  10:01:33 STEP 1726 H=1726:00 +CPU= 26.583
  10:01:52 STEP 1727 H=1727:00 +CPU= 18.897
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2021050100
(argv2) exptid: hpi1
(argv3) unique_member_id: 0989
(argv4) batchid: 945
(argv5) wuid: 12164078
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /home/boinc/boinc/slots/9
Project directory is: /home/boinc/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_12164078
..mkdir for temp folder for results failed
Copying: /home/boinc/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /home/boinc/boinc/slots/9/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /home/boinc/boinc/slots/9/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_c420155745626181e5ed08cc44b237d5 to: /home/boinc/boinc/slots/9/oifs_43r3_ps_0989_2021050100_123_945_12164078.zip
Unzipping the namelist zip file: /home/boinc/boinc/slots/9/oifs_43r3_ps_0989_2021050100_123_945_12164078.zip
ic_ancil_file: ic_ancil_12164078
ifsdata_file: ifsdata_12164078
climate_data_file: clim_data_12164078
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_396de393b616abb14a60370ff61490c8 to: /home/boinc/boinc/slots/9/ic_ancil_12164078.zip
Unzipping the IC ancils zip file: /home/boinc/boinc/slots/9/ic_ancil_12164078.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_b0b25f4019999f287558acc03157b120 to: /home/boinc/boinc/slots/9/ifsdata/ifsdata_12164078.zip
Unzipping the ifsdata_zip file: /home/boinc/boinc/slots/9/ifsdata/ifsdata_12164078.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /home/boinc/boinc/slots/9/159l_2/clim_data_12164078.zip
Unzipping the climate data zip file: /home/boinc/boinc/slots/9/159l_2/clim_data_12164078.zip
Checking for progress XML file: /home/boinc/boinc/slots/9/progress_file_12164078.xml
Opened progress file ok : /home/boinc/boinc/slots/9/progress_file_12164078.xml
-- Model is restarting --
Adjusting last_iter, 1727, to previous model restart step.
Creating progress file: /home/boinc/boinc/slots/9/progress_file_12164078.xml
last_cpu_time: 45149
upload_file_number: 71
last_iter: 1703
last_upload: 6134400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0989_2021050100_123_945_12164078_1_r1856596290
The child process has been launched with process id: 4292
Executing the command: /home/boinc/boinc/slots/9/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101232:1670947952:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
ECCODES ERROR   :  IO ERROR: Inappropriate ioctl for device (Inappropriate ioctl for device)
 GRIB_READ_BYTES_REAL8        50000  FAILED         -11
 GRIB_API ERROR MSG: Input output problem
MPL_ABORT: CALLED FROM PROCESSOR      1 THRD     1
 MPL_ABORT: THRD           1   GRIB_READ_BYTES_REAL8 FAILED
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101233:1670947953:1.386] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 1170 MB (maxheap), 366 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101233:1670947953:1.386] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101233:1670947953:1.386] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101233:1670947953:1.386] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101233:1670947953:1.386] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101233:1670947953:1.386] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101233:1670947953:1.386] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       RERESF 
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101233:1670947953:1.386] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        IOSTREAM_MIX:IO_GET 
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101233:1670947953:1.386] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         IOSTREAM_MIX:READ_RECORD 
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101233:1670947953:1.386] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          >MPL-IOSTREAM READ_RECORD ( 650) 
[EC_DRHOOK:fc12dastor:1:1:4292:4292] [20221213:101233:1670947953:1.386] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GRIB_API:IGRIB_READ_BYTES_REAL8 
 SDL_TRACEBACK: Calling INTEL_TRBK, THRD =            1
 Process            1  thread            1  calling linux_trbk from intel_trbk()
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/home/boinc/boinc/slots/9/oifs_43r3_model.exe' : sigcontextptr=0x7ffe37f2c280
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 16) with addr2line-cmd
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/home/boinc/boinc/slots/9/oifs_43r3_model.exe' 0x839273 0x839879 0x8c2957 0x8c3229 0xa048b9 0x9e3c9a 0x9db20d 0x54b599 0x546a18 0x546412 0x545e28 0x40708d 0x40220f 0x4021a2 0x1dca390 0x40206e
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x839273] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x839879] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x8c2957] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x8c3229] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0xa048b9] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x9e3c9a] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x9db20d] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x54b599] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0x546a18] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0x546412] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0x545e28] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x40708d] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x40220f] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x4021a2] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x1dca390] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x40206e] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
 SDL_TRACEBACK: Done INTEL_TRBK, THRD =            1
abort: 
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:41:59 1494087 22250143 oifs_43r3_ps_0989_2021050100_123_945_12164078_1 6,048,000 43,972 0.0073
09 May 2023 15:41:54 1494087 22250143 oifs_43r3_ps_0989_2021050100_123_945_12164078_1 5,184,000 37,861 0.0073
09 May 2023 15:41:51 1494087 22250143 oifs_43r3_ps_0989_2021050100_123_945_12164078_1 4,320,000 31,689 0.0073
09 May 2023 15:41:45 1494087 22250143 oifs_43r3_ps_0989_2021050100_123_945_12164078_1 3,456,000 25,487 0.0074
09 May 2023 15:41:38 1494087 22250143 oifs_43r3_ps_0989_2021050100_123_945_12164078_1 2,592,000 19,024 0.0073
09 May 2023 15:41:32 1494087 22250143 oifs_43r3_ps_0989_2021050100_123_945_12164078_1 1,728,000 12,642 0.0073
09 May 2023 15:41:26 1494087 22250143 oifs_43r3_ps_0989_2021050100_123_945_12164078_1 864,000 6,349 0.0073


©2024 cpdn.org