climateprediction.net home page
Task 22442136

Task 22442136

Name oifs_43r3_bl_a071_2016092300_20_1018_12288580_0
Workunit 12288580
Created 12 Jun 2024, 20:20:37 UTC
Sent 13 Jun 2024, 14:48:33 UTC
Report deadline 12 Aug 2024, 14:48:33 UTC
Received 14 Jun 2024, 10:28:02 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1549780
Run time 11 hours 58 min 39 sec
CPU time 11 hours 52 min 47 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 5.04 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,011.73 MB
Peak swap size 5,981.13 MB
Peak disk usage 1,359.21 MB
Stderr
<core_client_version>7.22.1</core_client_version>
<![CDATA[
<stderr_txt>
STEP 1251 H= 312:45 +CPU= 20.978
  00:52:56 STEP 1252 H= 313:00 +CPU= 21.232
  00:53:17 STEP 1253 H= 313:15 +CPU= 20.822
  00:53:39 STEP 1254 H= 313:30 +CPU= 21.820
  00:54:00 STEP 1255 H= 313:45 +CPU= 21.053
  00:54:22 STEP 1256 H= 314:00 +CPU= 22.584
  00:54:45 STEP 1257 H= 314:15 +CPU= 23.124
  00:55:07 STEP 1258 H= 314:30 +CPU= 21.261
  00:55:28 STEP 1259 H= 314:45 +CPU= 21.301
  00:55:55 STEP 1260 H= 315:00 +CPU= 26.840
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001260
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001260
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001260
  00:56:16 STEP 1261 H= 315:15 +CPU= 20.952
  00:56:38 STEP 1262 H= 315:30 +CPU= 21.964
  00:56:58 STEP 1263 H= 315:45 +CPU= 19.650
  00:57:20 STEP 1264 H= 316:00 +CPU= 21.760
  00:57:42 STEP 1265 H= 316:15 +CPU= 22.086
  00:58:03 STEP 1266 H= 316:30 +CPU= 21.641
  00:58:25 STEP 1267 H= 316:45 +CPU= 22.079
  00:58:48 STEP 1268 H= 317:00 +CPU= 22.039
  00:59:08 STEP 1269 H= 317:15 +CPU= 20.619
  00:59:30 STEP 1270 H= 317:30 +CPU= 21.643
  00:59:51 STEP 1271 H= 317:45 +CPU= 21.512
  01:00:17 STEP 1272 H= 318:00 +CPU= 25.927
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001272
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001272
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001272
  01:00:40 STEP 1273 H= 318:15 +CPU= 22.409
  01:01:03 STEP 1274 H= 318:30 +CPU= 22.921
  01:01:24 STEP 1275 H= 318:45 +CPU= 21.262
  01:01:47 STEP 1276 H= 319:00 +CPU= 22.691
  01:02:08 STEP 1277 H= 319:15 +CPU= 21.438
  01:02:31 STEP 1278 H= 319:30 +CPU= 22.740
  01:02:53 STEP 1279 H= 319:45 +CPU= 21.445
  01:03:16 STEP 1280 H= 320:00 +CPU= 23.316
  01:03:37 STEP 1281 H= 320:15 +CPU= 21.224
  01:03:58 STEP 1282 H= 320:30 +CPU= 20.653
  01:04:20 STEP 1283 H= 320:45 +CPU= 21.878
  01:04:48 STEP 1284 H= 321:00 +CPU= 28.470
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001284
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001284
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001284
  01:05:10 STEP 1285 H= 321:15 +CPU= 21.522
  01:05:32 STEP 1286 H= 321:30 +CPU= 22.156
  01:05:53 STEP 1287 H= 321:45 +CPU= 20.620
  01:06:15 STEP 1288 H= 322:00 +CPU= 22.427
  01:06:37 STEP 1289 H= 322:15 +CPU= 21.475
  01:06:58 STEP 1290 H= 322:30 +CPU= 20.845
  01:07:20 STEP 1291 H= 322:45 +CPU= 22.895
  01:07:43 STEP 1292 H= 323:00 +CPU= 22.708
  01:08:05 STEP 1293 H= 323:15 +CPU= 22.143
  01:08:27 STEP 1294 H= 323:30 +CPU= 21.315
  01:08:49 STEP 1295 H= 323:45 +CPU= 22.624
  01:09:21 STEP 1296 H= 324:00 +CPU= 31.078
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001296
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001296
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001296
  01:09:43 STEP 1297 H= 324:15 +CPU= 21.845
  01:10:05 STEP 1298 H= 324:30 +CPU= 22.457
  01:10:27 STEP 1299 H= 324:45 +CPU= 21.537
  01:10:51 STEP 1300 H= 325:00 +CPU= 23.938
  01:11:13 STEP 1301 H= 325:15 +CPU= 22.033
  01:11:34 STEP 1302 H= 325:30 +CPU= 21.251
  01:11:54 STEP 1303 H= 325:45 +CPU= 20.079
  01:12:17 STEP 1304 H= 326:00 +CPU= 22.729
  01:12:38 STEP 1305 H= 326:15 +CPU= 21.316
  01:13:00 STEP 1306 H= 326:30 +CPU= 21.512
  01:13:20 STEP 1307 H= 326:45 +CPU= 20.305
  01:13:47 STEP 1308 H= 327:00 +CPU= 26.385
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001308
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001308
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001308
  01:14:08 STEP 1309 H= 327:15 +CPU= 21.515
  01:14:29 STEP 1310 H= 327:30 +CPU= 20.874
  01:14:51 STEP 1311 H= 327:45 +CPU= 21.806
  01:15:14 STEP 1312 H= 328:00 +CPU= 22.562
  01:15:35 STEP 1313 H= 328:15 +CPU= 21.732
  01:15:57 STEP 1314 H= 328:30 +CPU= 21.380
  01:16:19 STEP 1315 H= 328:45 +CPU= 21.697
  01:16:42 STEP 1316 H= 329:00 +CPU= 23.155
  01:17:04 STEP 1317 H= 329:15 +CPU= 22.458
  01:17:26 STEP 1318 H= 329:30 +CPU= 22.203
  01:17:48 STEP 1319 H= 329:45 +CPU= 21.437
  01:18:16 STEP 1320 H= 330:00 +CPU= 28.011
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001320
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001320
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001320
  01:18:38 STEP 1321 H= 330:15 +CPU= 22.413
  01:19:01 STEP 1322 H= 330:30 +CPU= 23.013
  01:19:25 STEP 1323 H= 330:45 +CPU= 23.597
  01:19:48 STEP 1324 H= 331:00 +CPU= 22.760
  01:20:11 STEP 1325 H= 331:15 +CPU= 22.681
  01:20:32 STEP 1326 H= 331:30 +CPU= 21.780
  01:20:52 STEP 1327 H= 331:45 +CPU= 19.775
  01:21:15 STEP 1328 H= 332:00 +CPU= 22.827
  01:21:37 STEP 1329 H= 332:15 +CPU= 21.730
  01:21:58 STEP 1330 H= 332:30 +CPU= 21.561
  01:22:18 STEP 1331 H= 332:45 +CPU= 19.907
  01:22:45 STEP 1332 H= 333:00 +CPU= 26.380
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001332
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001332
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001332
  01:23:05 STEP 1333 H= 333:15 +CPU= 20.461
  01:23:28 STEP 1334 H= 333:30 +CPU= 22.373
  01:23:49 STEP 1335 H= 333:45 +CPU= 21.188
  01:24:12 STEP 1336 H= 334:00 +CPU= 22.613
  01:24:35 STEP 1337 H= 334:15 +CPU= 23.270
  01:24:58 STEP 1338 H= 334:30 +CPU= 22.570
  01:25:19 STEP 1339 H= 334:45 +CPU= 21.388
  01:25:42 STEP 1340 H= 335:00 +CPU= 22.434
  01:26:01 STEP 1341 H= 335:15 +CPU= 19.482
  01:26:22 STEP 1342 H= 335:30 +CPU= 20.947
  01:26:44 STEP 1343 H= 335:45 +CPU= 22.301
  01:27:14 STEP 1344 H= 336:00 +CPU= 29.530
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001344
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001344
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001344
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001248
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001248
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001248
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001260
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001260
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001260
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001272
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001272
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001272
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001284
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001284
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001284
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001296
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001296
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001296
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001308
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001308
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001308
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001320
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001320
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001320
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001332
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001332
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001332
Zipping up the intermediate file: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_a071_2016092300_20_1018_12288580_0_r1536939563_13.zip
Uploading the intermediate file: upload_file_13.zip
  01:27:37 STEP 1345 H= 336:15 +CPU= 22.327
  01:27:59 STEP 1346 H= 336:30 +CPU= 22.121
  01:28:21 STEP 1347 H= 336:45 +CPU= 21.968
  01:28:44 STEP 1348 H= 337:00 +CPU= 22.729
  01:29:07 STEP 1349 H= 337:15 +CPU= 22.798
  01:29:29 STEP 1350 H= 337:30 +CPU= 22.516
  01:29:50 STEP 1351 H= 337:45 +CPU= 21.033
  01:30:13 STEP 1352 H= 338:00 +CPU= 22.460
  01:30:35 STEP 1353 H= 338:15 +CPU= 21.696
  01:30:58 STEP 1354 H= 338:30 +CPU= 23.626
  01:31:20 STEP 1355 H= 338:45 +CPU= 21.564
  01:31:49 STEP 1356 H= 339:00 +CPU= 28.419
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001356
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001356
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001356
  01:32:10 STEP 1357 H= 339:15 +CPU= 21.095
  01:32:30 STEP 1358 H= 339:30 +CPU= 20.677
  01:32:53 STEP 1359 H= 339:45 +CPU= 22.951
  01:33:17 STEP 1360 H= 340:00 +CPU= 22.990
  01:33:39 STEP 1361 H= 340:15 +CPU= 22.453
  01:34:01 STEP 1362 H= 340:30 +CPU= 21.680
  01:34:22 STEP 1363 H= 340:45 +CPU= 21.025
  01:34:46 STEP 1364 H= 341:00 +CPU= 24.268
  01:35:08 STEP 1365 H= 341:15 +CPU= 22.017
  01:35:29 STEP 1366 H= 341:30 +CPU= 21.195
  01:35:52 STEP 1367 H= 341:45 +CPU= 22.412
  01:36:21 STEP 1368 H= 342:00 +CPU= 28.854
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001368
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001368
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001368
  01:36:42 STEP 1369 H= 342:15 +CPU= 21.698
  01:37:05 STEP 1370 H= 342:30 +CPU= 22.477
  01:37:27 STEP 1371 H= 342:45 +CPU= 22.155
  01:37:50 STEP 1372 H= 343:00 +CPU= 22.692
  01:38:12 STEP 1373 H= 343:15 +CPU= 21.692
  01:38:33 STEP 1374 H= 343:30 +CPU= 21.785
  01:38:55 STEP 1375 H= 343:45 +CPU= 22.021
  01:39:17 STEP 1376 H= 344:00 +CPU= 21.952
  01:39:39 STEP 1377 H= 344:15 +CPU= 21.022
  01:40:01 STEP 1378 H= 344:30 +CPU= 22.060
  01:40:23 STEP 1379 H= 344:45 +CPU= 22.209
  01:40:52 STEP 1380 H= 345:00 +CPU= 29.199
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001380
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001380
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001380
  01:41:14 STEP 1381 H= 345:15 +CPU= 22.335
  01:41:36 STEP 1382 H= 345:30 +CPU= 21.467
  01:41:59 STEP 1383 H= 345:45 +CPU= 22.754
  01:42:21 STEP 1384 H= 346:00 +CPU= 22.100
  01:42:45 STEP 1385 H= 346:15 +CPU= 23.963
  01:43:07 STEP 1386 H= 346:30 +CPU= 22.277
  01:43:30 STEP 1387 H= 346:45 +CPU= 22.142
  01:43:54 STEP 1388 H= 347:00 +CPU= 24.344
  01:44:15 STEP 1389 H= 347:15 +CPU= 21.399
  01:44:38 STEP 1390 H= 347:30 +CPU= 22.086
  01:44:59 STEP 1391 H= 347:45 +CPU= 21.325
  01:45:30 STEP 1392 H= 348:00 +CPU= 31.204
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001392
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001392
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001392
  01:45:54 STEP 1393 H= 348:15 +CPU= 23.417
  01:46:16 STEP 1394 H= 348:30 +CPU= 22.412
  01:46:38 STEP 1395 H= 348:45 +CPU= 21.278
  01:47:00 STEP 1396 H= 349:00 +CPU= 22.205
  01:47:22 STEP 1397 H= 349:15 +CPU= 21.783
  01:47:44 STEP 1398 H= 349:30 +CPU= 22.107
  01:48:05 STEP 1399 H= 349:45 +CPU= 21.394
  01:48:29 STEP 1400 H= 350:00 +CPU= 23.513
  01:48:50 STEP 1401 H= 350:15 +CPU= 21.369
  01:49:11 STEP 1402 H= 350:30 +CPU= 20.711
  01:49:33 STEP 1403 H= 350:45 +CPU= 21.887
  01:50:00 STEP 1404 H= 351:00 +CPU= 27.544
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001404
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001404
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001404
  01:50:22 STEP 1405 H= 351:15 +CPU= 21.616
  01:50:44 STEP 1406 H= 351:30 +CPU= 21.361
  01:51:06 STEP 1407 H= 351:45 +CPU= 22.006
  01:51:29 STEP 1408 H= 352:00 +CPU= 23.004
  01:51:50 STEP 1409 H= 352:15 +CPU= 20.932
  01:52:13 STEP 1410 H= 352:30 +CPU= 22.979
  01:52:34 STEP 1411 H= 352:45 +CPU= 20.912
  01:52:56 STEP 1412 H= 353:00 +CPU= 21.899
  01:53:18 STEP 1413 H= 353:15 +CPU= 22.203
  01:53:41 STEP 1414 H= 353:30 +CPU= 23.388
  01:54:05 STEP 1415 H= 353:45 +CPU= 23.716
  01:54:34 STEP 1416 H= 354:00 +CPU= 28.770
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001416
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001416
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001416
  01:54:57 STEP 1417 H= 354:15 +CPU= 22.690
  01:55:19 STEP 1418 H= 354:30 +CPU= 22.215
  01:55:39 STEP 1419 H= 354:45 +CPU= 20.039
  01:56:01 STEP 1420 H= 355:00 +CPU= 22.408
  01:56:21 STEP 1421 H= 355:15 +CPU= 19.701
  01:56:43 STEP 1422 H= 355:30 +CPU= 22.282
  01:57:04 STEP 1423 H= 355:45 +CPU= 21.012
  01:57:27 STEP 1424 H= 356:00 +CPU= 22.507
  01:57:49 STEP 1425 H= 356:15 +CPU= 21.619
  01:58:10 STEP 1426 H= 356:30 +CPU= 21.136
  01:58:32 STEP 1427 H= 356:45 +CPU= 22.634
  01:59:00 STEP 1428 H= 357:00 +CPU= 27.274
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001428
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001428
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001428
  01:59:20 STEP 1429 H= 357:15 +CPU= 20.357
  01:59:43 STEP 1430 H= 357:30 +CPU= 22.438
  02:00:04 STEP 1431 H= 357:45 +CPU= 20.881
  02:00:27 STEP 1432 H= 358:00 +CPU= 22.936
  02:00:48 STEP 1433 H= 358:15 +CPU= 21.781
  02:01:10 STEP 1434 H= 358:30 +CPU= 21.387
  02:01:32 STEP 1435 H= 358:45 +CPU= 22.112
  02:01:54 STEP 1436 H= 359:00 +CPU= 22.133
  02:02:17 STEP 1437 H= 359:15 +CPU= 22.825
  02:02:40 STEP 1438 H= 359:30 +CPU= 22.920
  02:03:02 STEP 1439 H= 359:45 +CPU= 21.757
  02:03:34 STEP 1440 H= 360:00 +CPU= 31.735
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001440
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001440
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001440
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001344
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001344
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001344
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001356
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001356
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001356
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001368
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001368
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001368
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001380
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001380
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001380
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001392
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001392
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001392
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001404
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001404
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001404
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001416
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001416
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001416
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001428
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001428
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001428
Zipping up the intermediate file: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_a071_2016092300_20_1018_12288580_0_r1536939563_14.zip
Uploading the intermediate file: upload_file_14.zip
  02:03:56 STEP 1441 H= 360:15 +CPU= 22.281
  02:04:20 STEP 1442 H= 360:30 +CPU= 23.167
  02:04:42 STEP 1443 H= 360:45 +CPU= 21.912
  02:05:05 STEP 1444 H= 361:00 +CPU= 22.899
  02:05:27 STEP 1445 H= 361:15 +CPU= 22.135
  02:05:50 STEP 1446 H= 361:30 +CPU= 22.869
  02:06:11 STEP 1447 H= 361:45 +CPU= 21.240
  02:06:34 STEP 1448 H= 362:00 +CPU= 22.822
  02:06:55 STEP 1449 H= 362:15 +CPU= 21.327
  02:07:17 STEP 1450 H= 362:30 +CPU= 21.386
  02:07:39 STEP 1451 H= 362:45 +CPU= 22.285
  02:08:07 STEP 1452 H= 363:00 +CPU= 28.527
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001452
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001452
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001452
  02:08:30 STEP 1453 H= 363:15 +CPU= 22.273
  02:08:52 STEP 1454 H= 363:30 +CPU= 22.421
  02:09:15 STEP 1455 H= 363:45 +CPU= 22.501
  02:09:38 STEP 1456 H= 364:00 +CPU= 22.771
  02:09:59 STEP 1457 H= 364:15 +CPU= 21.471
  02:10:23 STEP 1458 H= 364:30 +CPU= 24.113
  02:10:47 STEP 1459 H= 364:45 +CPU= 23.406
  02:11:10 STEP 1460 H= 365:00 +CPU= 23.207
  02:11:32 STEP 1461 H= 365:15 +CPU= 22.324
  02:11:54 STEP 1462 H= 365:30 +CPU= 21.037
  02:12:16 STEP 1463 H= 365:45 +CPU= 22.001
  02:12:45 STEP 1464 H= 366:00 +CPU= 29.543
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001464
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001464
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001464
  02:13:08 STEP 1465 H= 366:15 +CPU= 23.004
  02:13:31 STEP 1466 H= 366:30 +CPU= 22.318
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:55:16 STEP 1467 H= 366:45 +CPU= 21.724
  08:55:39 STEP 1468 H= 367:00 +CPU= 22.709
  08:56:02 STEP 1469 H= 367:15 +CPU= 22.449
  08:56:23 STEP 1470 H= 367:30 +CPU= 21.636
  08:56:47 STEP 1471 H= 367:45 +CPU= 23.114
  08:57:09 STEP 1472 H= 368:00 +CPU= 22.893
  08:57:31 STEP 1473 H= 368:15 +CPU= 21.207
  08:57:51 STEP 1474 H= 368:30 +CPU= 20.708
  08:58:12 STEP 1475 H= 368:45 +CPU= 20.890
  08:58:40 STEP 1476 H= 369:00 +CPU= 27.292
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001476
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001476
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001476
  08:59:00 STEP 1477 H= 369:15 +CPU= 20.010
  08:59:22 STEP 1478 H= 369:30 +CPU= 22.403
  08:59:44 STEP 1479 H= 369:45 +CPU= 22.025
  09:00:08 STEP 1480 H= 370:00 +CPU= 23.311
  09:00:28 STEP 1481 H= 370:15 +CPU= 20.333
  09:00:50 STEP 1482 H= 370:30 +CPU= 22.304
  09:01:12 STEP 1483 H= 370:45 +CPU= 21.826
  09:01:36 STEP 1484 H= 371:00 +CPU= 23.965
  09:01:58 STEP 1485 H= 371:15 +CPU= 21.215
  09:02:19 STEP 1486 H= 371:30 +CPU= 21.425
  09:02:42 STEP 1487 H= 371:45 +CPU= 22.704
  09:03:13 STEP 1488 H= 372:00 +CPU= 30.810
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001488
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001488
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001488
  09:03:33 STEP 1489 H= 372:15 +CPU= 19.980
  09:03:55 STEP 1490 H= 372:30 +CPU= 21.662
  09:04:17 STEP 1491 H= 372:45 +CPU= 21.816
  09:04:39 STEP 1492 H= 373:00 +CPU= 22.586
  09:05:00 STEP 1493 H= 373:15 +CPU= 21.154
  09:05:22 STEP 1494 H= 373:30 +CPU= 21.249
  09:05:43 STEP 1495 H= 373:45 +CPU= 21.058
  09:06:05 STEP 1496 H= 374:00 +CPU= 21.784
  09:06:27 STEP 1497 H= 374:15 +CPU= 22.902
  09:06:50 STEP 1498 H= 374:30 +CPU= 22.071
  09:07:12 STEP 1499 H= 374:45 +CPU= 21.987
  09:07:40 STEP 1500 H= 375:00 +CPU= 28.077
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001500
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001500
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001500
  09:08:03 STEP 1501 H= 375:15 +CPU= 21.621
  09:08:25 STEP 1502 H= 375:30 +CPU= 22.065
  09:08:47 STEP 1503 H= 375:45 +CPU= 21.918
  09:09:10 STEP 1504 H= 376:00 +CPU= 23.361
  09:09:32 STEP 1505 H= 376:15 +CPU= 21.804
  09:09:54 STEP 1506 H= 376:30 +CPU= 22.311
  09:10:18 STEP 1507 H= 376:45 +CPU= 23.564
  09:10:39 STEP 1508 H= 377:00 +CPU= 21.149
  09:11:02 STEP 1509 H= 377:15 +CPU= 22.298
  09:11:23 STEP 1510 H= 377:30 +CPU= 21.759
  09:11:44 STEP 1511 H= 377:45 +CPU= 20.261
  09:12:11 STEP 1512 H= 378:00 +CPU= 26.461
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001512
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001512
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001512
  09:12:35 STEP 1513 H= 378:15 +CPU= 23.843
  09:12:56 STEP 1514 H= 378:30 +CPU= 21.369
  09:13:18 STEP 1515 H= 378:45 +CPU= 21.706
  09:13:40 STEP 1516 H= 379:00 +CPU= 21.937
  09:14:02 STEP 1517 H= 379:15 +CPU= 21.675
  09:14:23 STEP 1518 H= 379:30 +CPU= 21.732
  09:14:45 STEP 1519 H= 379:45 +CPU= 21.089
  09:15:07 STEP 1520 H= 380:00 +CPU= 22.380
  09:15:29 STEP 1521 H= 380:15 +CPU= 21.621
  09:15:51 STEP 1522 H= 380:30 +CPU= 22.028
  09:16:12 STEP 1523 H= 380:45 +CPU= 21.528
  09:16:40 STEP 1524 H= 381:00 +CPU= 27.793
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001524
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001524
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001524
  09:17:02 STEP 1525 H= 381:15 +CPU= 21.965
  09:17:23 STEP 1526 H= 381:30 +CPU= 20.839
  09:17:44 STEP 1527 H= 381:45 +CPU= 21.288
  09:18:07 STEP 1528 H= 382:00 +CPU= 22.319
  09:18:27 STEP 1529 H= 382:15 +CPU= 20.512
  09:18:50 STEP 1530 H= 382:30 +CPU= 22.207
  09:19:11 STEP 1531 H= 382:45 +CPU= 21.444
  09:19:34 STEP 1532 H= 383:00 +CPU= 22.664
  09:19:56 STEP 1533 H= 383:15 +CPU= 21.900
  09:20:18 STEP 1534 H= 383:30 +CPU= 21.774
  09:20:40 STEP 1535 H= 383:45 +CPU= 22.442
  09:21:10 STEP 1536 H= 384:00 +CPU= 30.122
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001536
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001536
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001536
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001440
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001440
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001440
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001452
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001452
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001452
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001464
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001464
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001464
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001476
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001476
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001476
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001488
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001488
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001488
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001500
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001500
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001500
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001512
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001512
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001512
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001524
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001524
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001524
Zipping up the intermediate file: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_a071_2016092300_20_1018_12288580_0_r1536939563_15.zip
Uploading the intermediate file: upload_file_15.zip
  09:21:32 STEP 1537 H= 384:15 +CPU= 21.273
  09:21:55 STEP 1538 H= 384:30 +CPU= 22.865
  09:22:17 STEP 1539 H= 384:45 +CPU= 22.441
  09:22:39 STEP 1540 H= 385:00 +CPU= 22.151
  09:23:02 STEP 1541 H= 385:15 +CPU= 22.904
  09:23:24 STEP 1542 H= 385:30 +CPU= 21.241
  09:23:46 STEP 1543 H= 385:45 +CPU= 22.704
  09:24:11 STEP 1544 H= 386:00 +CPU= 24.302
  09:24:32 STEP 1545 H= 386:15 +CPU= 21.526
  09:24:54 STEP 1546 H= 386:30 +CPU= 21.389
  09:25:15 STEP 1547 H= 386:45 +CPU= 21.548
  09:25:42 STEP 1548 H= 387:00 +CPU= 26.859
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001548
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001548
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001548
  09:26:03 STEP 1549 H= 387:15 +CPU= 20.684
  09:26:23 STEP 1550 H= 387:30 +CPU= 19.621
  09:26:44 STEP 1551 H= 387:45 +CPU= 21.413
  09:27:05 STEP 1552 H= 388:00 +CPU= 20.985
  09:27:27 STEP 1553 H= 388:15 +CPU= 21.734
  09:27:49 STEP 1554 H= 388:30 +CPU= 21.732
  09:28:11 STEP 1555 H= 388:45 +CPU= 22.310
  09:28:33 STEP 1556 H= 389:00 +CPU= 22.000
  09:28:54 STEP 1557 H= 389:15 +CPU= 20.896
  09:29:15 STEP 1558 H= 389:30 +CPU= 20.674
  09:29:37 STEP 1559 H= 389:45 +CPU= 21.688
  09:30:07 STEP 1560 H= 390:00 +CPU= 29.996
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001560
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001560
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001560
  09:30:31 STEP 1561 H= 390:15 +CPU= 23.870
  09:30:51 STEP 1562 H= 390:30 +CPU= 20.790
  09:31:16 STEP 1563 H= 390:45 +CPU= 22.572
  09:31:39 STEP 1564 H= 391:00 +CPU= 23.418
  09:32:00 STEP 1565 H= 391:15 +CPU= 20.979
  09:32:21 STEP 1566 H= 391:30 +CPU= 21.417
  09:32:43 STEP 1567 H= 391:45 +CPU= 21.076
  09:33:04 STEP 1568 H= 392:00 +CPU= 21.571
  09:33:25 STEP 1569 H= 392:15 +CPU= 20.329
  09:33:46 STEP 1570 H= 392:30 +CPU= 21.173
  09:34:09 STEP 1571 H= 392:45 +CPU= 23.478
  09:34:36 STEP 1572 H= 393:00 +CPU= 26.296
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001572
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001572
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001572
  09:34:57 STEP 1573 H= 393:15 +CPU= 21.563
  09:35:19 STEP 1574 H= 393:30 +CPU= 21.777
  09:35:42 STEP 1575 H= 393:45 +CPU= 22.920
  09:36:06 STEP 1576 H= 394:00 +CPU= 23.617
  09:36:27 STEP 1577 H= 394:15 +CPU= 21.410
  09:36:50 STEP 1578 H= 394:30 +CPU= 22.157
  09:37:11 STEP 1579 H= 394:45 +CPU= 21.015
  09:37:32 STEP 1580 H= 395:00 +CPU= 21.400
  09:37:53 STEP 1581 H= 395:15 +CPU= 21.080
  09:38:14 STEP 1582 H= 395:30 +CPU= 20.867
  09:38:37 STEP 1583 H= 395:45 +CPU= 22.888
  09:39:06 STEP 1584 H= 396:00 +CPU= 28.586
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001584
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001584
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001584
  09:39:28 STEP 1585 H= 396:15 +CPU= 21.772
  09:39:49 STEP 1586 H= 396:30 +CPU= 21.319
  09:40:11 STEP 1587 H= 396:45 +CPU= 21.341
  09:40:33 STEP 1588 H= 397:00 +CPU= 22.580
  09:40:57 STEP 1589 H= 397:15 +CPU= 23.049
  09:41:18 STEP 1590 H= 397:30 +CPU= 20.878
  09:41:41 STEP 1591 H= 397:45 +CPU= 23.025
  09:42:03 STEP 1592 H= 398:00 +CPU= 21.923
  09:42:25 STEP 1593 H= 398:15 +CPU= 22.282
  09:42:46 STEP 1594 H= 398:30 +CPU= 21.174
  09:43:08 STEP 1595 H= 398:45 +CPU= 21.726
  09:43:38 STEP 1596 H= 399:00 +CPU= 29.676
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001596
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001596
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001596
  09:43:58 STEP 1597 H= 399:15 +CPU= 20.241
  09:44:19 STEP 1598 H= 399:30 +CPU= 20.836
  09:44:41 STEP 1599 H= 399:45 +CPU= 22.607
  09:45:05 STEP 1600 H= 400:00 +CPU= 23.093
  09:45:25 STEP 1601 H= 400:15 +CPU= 20.540
  09:45:47 STEP 1602 H= 400:30 +CPU= 21.269
  09:46:08 STEP 1603 H= 400:45 +CPU= 21.842
  09:46:31 STEP 1604 H= 401:00 +CPU= 22.780
  09:46:52 STEP 1605 H= 401:15 +CPU= 21.031
  09:47:16 STEP 1606 H= 401:30 +CPU= 23.377
  09:47:39 STEP 1607 H= 401:45 +CPU= 23.160
  09:48:06 STEP 1608 H= 402:00 +CPU= 27.005
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001608
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001608
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001608
  09:48:27 STEP 1609 H= 402:15 +CPU= 21.047
  09:48:47 STEP 1610 H= 402:30 +CPU= 20.439
  09:49:08 STEP 1611 H= 402:45 +CPU= 21.033
  09:49:31 STEP 1612 H= 403:00 +CPU= 22.317
  09:49:51 STEP 1613 H= 403:15 +CPU= 20.386
  09:50:13 STEP 1614 H= 403:30 +CPU= 21.409
  09:50:34 STEP 1615 H= 403:45 +CPU= 21.329
  09:50:56 STEP 1616 H= 404:00 +CPU= 21.831
  09:51:17 STEP 1617 H= 404:15 +CPU= 20.870
  09:51:38 STEP 1618 H= 404:30 +CPU= 21.410
  09:52:01 STEP 1619 H= 404:45 +CPU= 22.252
  09:52:26 STEP 1620 H= 405:00 +CPU= 25.593
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001620
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001620
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001620
  09:52:47 STEP 1621 H= 405:15 +CPU= 20.667
  09:53:08 STEP 1622 H= 405:30 +CPU= 21.217
  09:53:28 STEP 1623 H= 405:45 +CPU= 20.257
  09:53:51 STEP 1624 H= 406:00 +CPU= 22.899
  09:54:13 STEP 1625 H= 406:15 +CPU= 21.204
  09:54:34 STEP 1626 H= 406:30 +CPU= 21.362
  09:54:56 STEP 1627 H= 406:45 +CPU= 21.843
  09:55:16 STEP 1628 H= 407:00 +CPU= 20.134
  09:55:37 STEP 1629 H= 407:15 +CPU= 20.970
  09:55:57 STEP 1630 H= 407:30 +CPU= 20.115
  09:56:19 STEP 1631 H= 407:45 +CPU= 21.505
  09:56:50 STEP 1632 H= 408:00 +CPU= 30.926
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001632
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001632
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001632
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001536
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001536
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001536
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001548
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001548
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001548
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001560
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001560
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001560
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001572
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001572
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001572
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001584
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001584
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001584
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001596
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001596
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001596
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001608
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001608
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001608
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001620
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001620
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001620
Zipping up the intermediate file: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_a071_2016092300_20_1018_12288580_0_r1536939563_16.zip
Uploading the intermediate file: upload_file_16.zip
  09:57:11 STEP 1633 H= 408:15 +CPU= 21.319
  09:57:33 STEP 1634 H= 408:30 +CPU= 21.887
  09:57:53 STEP 1635 H= 408:45 +CPU= 20.213
  09:58:16 STEP 1636 H= 409:00 +CPU= 22.900
  09:58:38 STEP 1637 H= 409:15 +CPU= 21.428
  09:58:59 STEP 1638 H= 409:30 +CPU= 20.686
  09:59:20 STEP 1639 H= 409:45 +CPU= 21.032
  09:59:43 STEP 1640 H= 410:00 +CPU= 23.391
  10:00:04 STEP 1641 H= 410:15 +CPU= 20.449
  10:00:25 STEP 1642 H= 410:30 +CPU= 21.091
  10:00:47 STEP 1643 H= 410:45 +CPU= 21.585
  10:01:13 STEP 1644 H= 411:00 +CPU= 25.976
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001644
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001644
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001644
  10:01:33 STEP 1645 H= 411:15 +CPU= 20.026
  10:01:53 STEP 1646 H= 411:30 +CPU= 20.645
  10:02:14 STEP 1647 H= 411:45 +CPU= 20.317
  10:02:35 STEP 1648 H= 412:00 +CPU= 21.663
  10:02:56 STEP 1649 H= 412:15 +CPU= 20.532
  10:03:18 STEP 1650 H= 412:30 +CPU= 22.511
  10:03:41 STEP 1651 H= 412:45 +CPU= 22.243
  10:04:03 STEP 1652 H= 413:00 +CPU= 21.873
  10:04:23 STEP 1653 H= 413:15 +CPU= 20.563
  10:04:45 STEP 1654 H= 413:30 +CPU= 21.857
  10:05:07 STEP 1655 H= 413:45 +CPU= 21.326
  10:05:34 STEP 1656 H= 414:00 +CPU= 27.228
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001656
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001656
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001656
  10:05:55 STEP 1657 H= 414:15 +CPU= 21.065
  10:06:16 STEP 1658 H= 414:30 +CPU= 20.527
  10:06:38 STEP 1659 H= 414:45 +CPU= 22.815
  10:07:01 STEP 1660 H= 415:00 +CPU= 22.815
  10:07:24 STEP 1661 H= 415:15 +CPU= 22.650
  10:07:45 STEP 1662 H= 415:30 +CPU= 21.276
  10:08:08 STEP 1663 H= 415:45 +CPU= 22.556
  10:08:30 STEP 1664 H= 416:00 +CPU= 22.371
  10:08:52 STEP 1665 H= 416:15 +CPU= 21.505
  10:09:14 STEP 1666 H= 416:30 +CPU= 22.088
  10:09:35 STEP 1667 H= 416:45 +CPU= 21.119
  10:10:03 STEP 1668 H= 417:00 +CPU= 27.685
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001668
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001668
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001668
  10:10:23 STEP 1669 H= 417:15 +CPU= 20.328
  10:10:44 STEP 1670 H= 417:30 +CPU= 21.119
  10:11:06 STEP 1671 H= 417:45 +CPU= 21.446
  10:11:27 STEP 1672 H= 418:00 +CPU= 21.321
  10:11:48 STEP 1673 H= 418:15 +CPU= 21.023
  10:12:09 STEP 1674 H= 418:30 +CPU= 20.892
  10:12:31 STEP 1675 H= 418:45 +CPU= 21.812
  10:12:54 STEP 1676 H= 419:00 +CPU= 22.647
  10:13:17 STEP 1677 H= 419:15 +CPU= 22.789
  10:13:40 STEP 1678 H= 419:30 +CPU= 23.396
  10:14:03 STEP 1679 H= 419:45 +CPU= 22.847
  10:14:32 STEP 1680 H= 420:00 +CPU= 28.588
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001680
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001680
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001680
  10:14:54 STEP 1681 H= 420:15 +CPU= 21.723
  10:15:14 STEP 1682 H= 420:30 +CPU= 20.558
  10:15:37 STEP 1683 H= 420:45 +CPU= 22.768
  10:15:57 STEP 1684 H= 421:00 +CPU= 20.134
  10:16:18 STEP 1685 H= 421:15 +CPU= 20.554
  10:16:37 STEP 1686 H= 421:30 +CPU= 19.083
  10:16:56 STEP 1687 H= 421:45 +CPU= 19.162
  10:17:16 STEP 1688 H= 422:00 +CPU= 19.796
  10:17:35 STEP 1689 H= 422:15 +CPU= 19.044
  10:17:54 STEP 1690 H= 422:30 +CPU= 19.297
  10:18:13 STEP 1691 H= 422:45 +CPU= 18.238
  10:18:37 STEP 1692 H= 423:00 +CPU= 24.383
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001692
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001692
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001692
  10:18:56 STEP 1693 H= 423:15 +CPU= 19.238
  10:19:15 STEP 1694 H= 423:30 +CPU= 18.648
  10:19:32 STEP 1695 H= 423:45 +CPU= 17.492
  10:19:53 STEP 1696 H= 424:00 +CPU= 20.117
  10:20:11 STEP 1697 H= 424:15 +CPU= 18.798
  10:20:29 STEP 1698 H= 424:30 +CPU= 18.038
  10:20:49 STEP 1699 H= 424:45 +CPU= 19.827
  10:21:10 STEP 1700 H= 425:00 +CPU= 20.622
  10:21:29 STEP 1701 H= 425:15 +CPU= 18.869
  10:21:48 STEP 1702 H= 425:30 +CPU= 19.190
  10:22:06 STEP 1703 H= 425:45 +CPU= 17.882
  10:22:31 STEP 1704 H= 426:00 +CPU= 24.966
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001704
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001704
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001704
  10:22:50 STEP 1705 H= 426:15 +CPU= 18.492
  10:23:08 STEP 1706 H= 426:30 +CPU= 18.555
  10:23:27 STEP 1707 H= 426:45 +CPU= 18.759
  10:23:46 STEP 1708 H= 427:00 +CPU= 19.283
  10:24:04 STEP 1709 H= 427:15 +CPU= 18.023
  10:24:22 STEP 1710 H= 427:30 +CPU= 17.888
  10:24:41 STEP 1711 H= 427:45 +CPU= 18.315
  10:24:59 STEP 1712 H= 428:00 +CPU= 18.796
  10:25:17 STEP 1713 H= 428:15 +CPU= 18.097
  10:25:36 STEP 1714 H= 428:30 +CPU= 18.153
  10:25:54 STEP 1715 H= 428:45 +CPU= 18.106
  10:26:16 STEP 1716 H= 429:00 +CPU= 22.363
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001716
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001716
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001716
  10:26:34 STEP 1717 H= 429:15 +CPU= 17.990
  10:26:52 STEP 1718 H= 429:30 +CPU= 17.336
  10:27:09 STEP 1719 H= 429:45 +CPU= 17.682
  10:27:29 STEP 1720 H= 430:00 +CPU= 19.219
  10:27:47 STEP 1721 H= 430:15 +CPU= 18.086
  10:28:05 STEP 1722 H= 430:30 +CPU= 18.470
  10:28:24 STEP 1723 H= 430:45 +CPU= 18.876
  10:28:43 STEP 1724 H= 431:00 +CPU= 18.825
  10:29:01 STEP 1725 H= 431:15 +CPU= 18.012
  10:29:19 STEP 1726 H= 431:30 +CPU= 17.719
  10:29:37 STEP 1727 H= 431:45 +CPU= 18.104
  10:30:03 STEP 1728 H= 432:00 +CPU= 25.697
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001728
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001728
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001728
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001632
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001632
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001632
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001644
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001644
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001644
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001656
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001656
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001656
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001668
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001668
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001668
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001680
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001680
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001680
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001692
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001692
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001692
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001704
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001704
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001704
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001716
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001716
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001716
Zipping up the intermediate file: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_a071_2016092300_20_1018_12288580_0_r1536939563_17.zip
Uploading the intermediate file: upload_file_17.zip
  10:30:21 STEP 1729 H= 432:15 +CPU= 18.289
  10:30:39 STEP 1730 H= 432:30 +CPU= 17.473
  10:30:56 STEP 1731 H= 432:45 +CPU= 17.622
  10:31:15 STEP 1732 H= 433:00 +CPU= 18.114
  10:31:33 STEP 1733 H= 433:15 +CPU= 17.886
  10:31:50 STEP 1734 H= 433:30 +CPU= 17.603
  10:32:08 STEP 1735 H= 433:45 +CPU= 18.261
  10:32:27 STEP 1736 H= 434:00 +CPU= 18.626
  10:32:45 STEP 1737 H= 434:15 +CPU= 17.508
  10:33:02 STEP 1738 H= 434:30 +CPU= 17.081
  10:33:20 STEP 1739 H= 434:45 +CPU= 17.994
  10:33:42 STEP 1740 H= 435:00 +CPU= 22.310
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001740
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001740
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001740
  10:33:59 STEP 1741 H= 435:15 +CPU= 17.202
  10:34:17 STEP 1742 H= 435:30 +CPU= 17.264
  10:34:34 STEP 1743 H= 435:45 +CPU= 17.803
  10:34:53 STEP 1744 H= 436:00 +CPU= 18.408
  10:35:11 STEP 1745 H= 436:15 +CPU= 17.694
  10:35:28 STEP 1746 H= 436:30 +CPU= 17.266
  10:35:45 STEP 1747 H= 436:45 +CPU= 17.573
  10:36:04 STEP 1748 H= 437:00 +CPU= 18.042
  10:36:22 STEP 1749 H= 437:15 +CPU= 18.189
  10:36:40 STEP 1750 H= 437:30 +CPU= 17.642
  10:36:57 STEP 1751 H= 437:45 +CPU= 17.843
  10:37:19 STEP 1752 H= 438:00 +CPU= 22.029
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001752
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001752
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001752
  10:37:37 STEP 1753 H= 438:15 +CPU= 17.730
  10:37:55 STEP 1754 H= 438:30 +CPU= 17.539
  10:38:13 STEP 1755 H= 438:45 +CPU= 18.529
  10:38:32 STEP 1756 H= 439:00 +CPU= 18.287
  10:38:49 STEP 1757 H= 439:15 +CPU= 17.333
  10:39:06 STEP 1758 H= 439:30 +CPU= 17.294
  10:39:24 STEP 1759 H= 439:45 +CPU= 17.946
  10:39:42 STEP 1760 H= 440:00 +CPU= 17.740
  10:40:00 STEP 1761 H= 440:15 +CPU= 17.468
  10:40:17 STEP 1762 H= 440:30 +CPU= 17.440
  10:40:35 STEP 1763 H= 440:45 +CPU= 17.740
  10:40:57 STEP 1764 H= 441:00 +CPU= 22.343
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001764
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001764
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001764
  10:41:15 STEP 1765 H= 441:15 +CPU= 17.478
  10:41:32 STEP 1766 H= 441:30 +CPU= 17.396
  10:41:50 STEP 1767 H= 441:45 +CPU= 17.759
  10:42:08 STEP 1768 H= 442:00 +CPU= 18.595
  10:42:26 STEP 1769 H= 442:15 +CPU= 17.701
  10:42:44 STEP 1770 H= 442:30 +CPU= 17.803
  10:43:02 STEP 1771 H= 442:45 +CPU= 17.565
  10:43:20 STEP 1772 H= 443:00 +CPU= 18.484
  10:43:38 STEP 1773 H= 443:15 +CPU= 18.064
  10:43:55 STEP 1774 H= 443:30 +CPU= 17.211
  10:44:13 STEP 1775 H= 443:45 +CPU= 17.915
  10:44:39 STEP 1776 H= 444:00 +CPU= 24.938
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001776
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001776
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001776
  10:44:57 STEP 1777 H= 444:15 +CPU= 17.367
  10:45:14 STEP 1778 H= 444:30 +CPU= 17.532
  10:45:32 STEP 1779 H= 444:45 +CPU= 17.694
  10:45:50 STEP 1780 H= 445:00 +CPU= 18.336
  10:46:08 STEP 1781 H= 445:15 +CPU= 17.994
  10:46:26 STEP 1782 H= 445:30 +CPU= 17.991
  10:46:44 STEP 1783 H= 445:45 +CPU= 17.658
  10:47:03 STEP 1784 H= 446:00 +CPU= 19.160
  10:47:21 STEP 1785 H= 446:15 +CPU= 17.403
  10:47:38 STEP 1786 H= 446:30 +CPU= 17.581
  10:47:55 STEP 1787 H= 446:45 +CPU= 17.093
  10:48:18 STEP 1788 H= 447:00 +CPU= 22.290
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001788
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001788
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001788
  10:48:35 STEP 1789 H= 447:15 +CPU= 17.370
  10:48:52 STEP 1790 H= 447:30 +CPU= 17.421
  10:49:10 STEP 1791 H= 447:45 +CPU= 17.213
  10:49:27 STEP 1792 H= 448:00 +CPU= 17.734
  10:49:45 STEP 1793 H= 448:15 +CPU= 17.151
  10:50:02 STEP 1794 H= 448:30 +CPU= 17.608
  10:50:20 STEP 1795 H= 448:45 +CPU= 17.346
  10:50:38 STEP 1796 H= 449:00 +CPU= 18.172
  10:50:55 STEP 1797 H= 449:15 +CPU= 17.109
  10:51:13 STEP 1798 H= 449:30 +CPU= 17.872
  10:51:30 STEP 1799 H= 449:45 +CPU= 17.632
  10:51:52 STEP 1800 H= 450:00 +CPU= 22.016
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001800
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001800
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001800
  10:52:10 STEP 1801 H= 450:15 +CPU= 17.148
  10:52:27 STEP 1802 H= 450:30 +CPU= 17.720
  10:52:45 STEP 1803 H= 450:45 +CPU= 17.184
  10:53:03 STEP 1804 H= 451:00 +CPU= 18.550
  10:53:22 STEP 1805 H= 451:15 +CPU= 18.320
  10:53:39 STEP 1806 H= 451:30 +CPU= 17.427
  10:53:57 STEP 1807 H= 451:45 +CPU= 17.713
  10:54:15 STEP 1808 H= 452:00 +CPU= 18.401
  10:54:33 STEP 1809 H= 452:15 +CPU= 17.339
  10:54:50 STEP 1810 H= 452:30 +CPU= 17.477
  10:55:07 STEP 1811 H= 452:45 +CPU= 17.101
  10:55:29 STEP 1812 H= 453:00 +CPU= 22.163
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001812
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001812
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001812
  10:55:47 STEP 1813 H= 453:15 +CPU= 17.358
  10:56:04 STEP 1814 H= 453:30 +CPU= 17.657
  10:56:22 STEP 1815 H= 453:45 +CPU= 17.112
  10:56:41 STEP 1816 H= 454:00 +CPU= 18.948
  10:56:58 STEP 1817 H= 454:15 +CPU= 17.647
  10:57:16 STEP 1818 H= 454:30 +CPU= 17.467
  10:57:33 STEP 1819 H= 454:45 +CPU= 17.173
  10:57:51 STEP 1820 H= 455:00 +CPU= 17.953
  10:58:09 STEP 1821 H= 455:15 +CPU= 17.735
  10:58:26 STEP 1822 H= 455:30 +CPU= 17.032
  10:58:43 STEP 1823 H= 455:45 +CPU= 17.500
  10:59:08 STEP 1824 H= 456:00 +CPU= 24.628
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001824
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001824
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001824
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001728
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001728
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001728
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001740
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001740
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001740
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001752
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001752
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001752
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001764
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001764
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001764
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001776
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001776
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001776
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001788
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001788
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001788
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001800
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001800
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001800
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001812
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001812
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001812
Zipping up the intermediate file: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_a071_2016092300_20_1018_12288580_0_r1536939563_18.zip
Uploading the intermediate file: upload_file_18.zip
  10:59:26 STEP 1825 H= 456:15 +CPU= 18.113
  10:59:44 STEP 1826 H= 456:30 +CPU= 17.327
  11:00:01 STEP 1827 H= 456:45 +CPU= 17.584
  11:00:19 STEP 1828 H= 457:00 +CPU= 18.142
  11:00:37 STEP 1829 H= 457:15 +CPU= 17.632
  11:00:55 STEP 1830 H= 457:30 +CPU= 17.698
  11:01:12 STEP 1831 H= 457:45 +CPU= 17.515
  11:01:30 STEP 1832 H= 458:00 +CPU= 17.635
  11:01:48 STEP 1833 H= 458:15 +CPU= 17.622
  11:02:05 STEP 1834 H= 458:30 +CPU= 17.551
  11:02:23 STEP 1835 H= 458:45 +CPU= 17.359
  11:02:45 STEP 1836 H= 459:00 +CPU= 22.187
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001836
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001836
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001836
  11:03:02 STEP 1837 H= 459:15 +CPU= 17.158
  11:03:19 STEP 1838 H= 459:30 +CPU= 16.958
  11:03:36 STEP 1839 H= 459:45 +CPU= 17.369
  11:03:54 STEP 1840 H= 460:00 +CPU= 17.950
  11:04:12 STEP 1841 H= 460:15 +CPU= 17.372
  11:04:29 STEP 1842 H= 460:30 +CPU= 17.236
  11:04:46 STEP 1843 H= 460:45 +CPU= 17.146
  11:05:14 STEP 1844 H= 461:00 +CPU= 17.995
  11:05:32 STEP 1845 H= 461:15 +CPU= 17.468
  11:05:49 STEP 1846 H= 461:30 +CPU= 17.490
  11:06:07 STEP 1847 H= 461:45 +CPU= 17.230
  11:06:30 STEP 1848 H= 462:00 +CPU= 22.340
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001848
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001848
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001848
  11:06:47 STEP 1849 H= 462:15 +CPU= 17.763
  11:07:05 STEP 1850 H= 462:30 +CPU= 17.452
  11:07:22 STEP 1851 H= 462:45 +CPU= 17.413
  11:07:40 STEP 1852 H= 463:00 +CPU= 17.894
  11:07:57 STEP 1853 H= 463:15 +CPU= 17.264
  11:08:15 STEP 1854 H= 463:30 +CPU= 17.105
  11:08:32 STEP 1855 H= 463:45 +CPU= 17.516
  11:08:50 STEP 1856 H= 464:00 +CPU= 17.864
  11:09:07 STEP 1857 H= 464:15 +CPU= 17.433
  11:09:24 STEP 1858 H= 464:30 +CPU= 17.073
  11:09:42 STEP 1859 H= 464:45 +CPU= 17.645
  11:10:04 STEP 1860 H= 465:00 +CPU= 21.837
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001860
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001860
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001860
  11:10:21 STEP 1861 H= 465:15 +CPU= 17.360
  11:10:38 STEP 1862 H= 465:30 +CPU= 16.648
  11:10:56 STEP 1863 H= 465:45 +CPU= 17.456
  11:11:14 STEP 1864 H= 466:00 +CPU= 18.473
  11:11:32 STEP 1865 H= 466:15 +CPU= 17.635
  11:11:49 STEP 1866 H= 466:30 +CPU= 17.573
  11:12:07 STEP 1867 H= 466:45 +CPU= 17.175
  11:12:24 STEP 1868 H= 467:00 +CPU= 17.642
  11:12:41 STEP 1869 H= 467:15 +CPU= 16.874
  11:12:59 STEP 1870 H= 467:30 +CPU= 17.610
  11:13:16 STEP 1871 H= 467:45 +CPU= 17.175
  11:13:41 STEP 1872 H= 468:00 +CPU= 24.871
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001872
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001872
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001872
  11:13:58 STEP 1873 H= 468:15 +CPU= 17.235
  11:14:16 STEP 1874 H= 468:30 +CPU= 17.093
  11:14:33 STEP 1875 H= 468:45 +CPU= 16.990
  11:14:50 STEP 1876 H= 469:00 +CPU= 17.660
  11:15:07 STEP 1877 H= 469:15 +CPU= 17.197
  11:15:25 STEP 1878 H= 469:30 +CPU= 17.458
  11:15:42 STEP 1879 H= 469:45 +CPU= 16.945
  11:16:00 STEP 1880 H= 470:00 +CPU= 17.720
  11:16:17 STEP 1881 H= 470:15 +CPU= 17.377
  11:16:35 STEP 1882 H= 470:30 +CPU= 17.500
  11:16:51 STEP 1883 H= 470:45 +CPU= 16.742
  11:17:13 STEP 1884 H= 471:00 +CPU= 21.586
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001884
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001884
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001884
  11:17:30 STEP 1885 H= 471:15 +CPU= 17.005
  11:17:47 STEP 1886 H= 471:30 +CPU= 17.047
  11:18:04 STEP 1887 H= 471:45 +CPU= 17.110
  11:18:22 STEP 1888 H= 472:00 +CPU= 17.976
  11:18:39 STEP 1889 H= 472:15 +CPU= 16.915
  11:18:56 STEP 1890 H= 472:30 +CPU= 17.359
  11:19:14 STEP 1891 H= 472:45 +CPU= 17.262
  11:19:32 STEP 1892 H= 473:00 +CPU= 18.187
  11:19:49 STEP 1893 H= 473:15 +CPU= 17.067
  11:20:06 STEP 1894 H= 473:30 +CPU= 17.170
  11:20:23 STEP 1895 H= 473:45 +CPU= 17.112
  11:20:45 STEP 1896 H= 474:00 +CPU= 21.853
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001896
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001896
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001896
  11:21:02 STEP 1897 H= 474:15 +CPU= 17.103
  11:21:20 STEP 1898 H= 474:30 +CPU= 17.771
  11:21:37 STEP 1899 H= 474:45 +CPU= 17.183
  11:21:55 STEP 1900 H= 475:00 +CPU= 17.813
  11:22:12 STEP 1901 H= 475:15 +CPU= 17.076
  11:22:29 STEP 1902 H= 475:30 +CPU= 17.167
  11:22:47 STEP 1903 H= 475:45 +CPU= 17.250
  11:23:05 STEP 1904 H= 476:00 +CPU= 18.350
  11:23:23 STEP 1905 H= 476:15 +CPU= 17.620
  11:23:40 STEP 1906 H= 476:30 +CPU= 17.282
  11:23:57 STEP 1907 H= 476:45 +CPU= 16.883
  11:24:18 STEP 1908 H= 477:00 +CPU= 21.630
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001908
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001908
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001908
  11:24:36 STEP 1909 H= 477:15 +CPU= 17.562
  11:24:53 STEP 1910 H= 477:30 +CPU= 16.893
  11:25:11 STEP 1911 H= 477:45 +CPU= 17.834
  11:25:29 STEP 1912 H= 478:00 +CPU= 17.808
  11:25:46 STEP 1913 H= 478:15 +CPU= 17.108
  11:26:03 STEP 1914 H= 478:30 +CPU= 17.389
  11:26:20 STEP 1915 H= 478:45 +CPU= 16.556
  11:26:37 STEP 1916 H= 479:00 +CPU= 17.412
  11:26:54 STEP 1917 H= 479:15 +CPU= 16.622
  11:27:11 STEP 1918 H= 479:30 +CPU= 16.772
  11:27:27 STEP 1919 H= 479:45 +CPU= 16.517
  11:27:50 STEP 1920 H= 480:00 +CPU= 22.746
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.2480627631E-20      I       0.5642189716E-06      I
ICloud fractionI      0.0000000000E+00      I       0.3773697639E-01      I
I  Relat. Hum. I      0.1572451094E+00      I       0.2298191151E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.2349071637E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    315150292 BYTES IN      7 RECORDS TRANSFERRED IN    0.0004 SECONDS787875.7 Mbytes/s, TOTAL TIME=    0.0074( 5.4%)
 11:27:50 STEP 1920 H= 480:00 +CPU= 22.746
 END CNT3
 NSTEP =  1920 CNT0   000000000  16.436  16.436  16.612   0.989               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        57546/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1   1008    0        0            0    57546 ************    80.0     0.0    80.0     0.0   169.4
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 2082    3613.0    3613.0     11.23      0.00
   9 SPCM     - SPECTRAL COMP.                    1920     572.9     572.9      1.64      0.00
  10 SCAN2M - PHYSICS                             1921   22979.5   22979.5     65.88      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                161     747.2     747.2      0.18      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 83      40.4      40.4      0.01      0.00
  14 SUINIF                                          1    5239.4    5239.4      0.01      0.00
  17 GRIDFPOS IN CNT4                              161      23.8      23.8      0.01      0.00
  18 SUSPECG                                         1    2605.8    2605.8      0.00      0.00
  19 SUSPEC                                          1    2612.7    2612.7      0.00      0.00
  24 SUGRIDU                                         1    2004.2    2004.2      0.00      0.00
  25 SPECRT                                          1     203.0     203.0      0.00      0.00
  26 SUGRIDF                                         1     419.4     419.4      0.00      0.00
  27 RESTART FILES - WRITING                        40    3006.8    3006.8      0.18      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               161       0.2       0.2      0.00      0.00
  30 DYNFPOS IN CNT4                               161    5053.6    5053.6      1.21      0.00
  31 POSDDH IN STEPO                                 9      41.3      41.3      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1921    4761.5    4761.5     13.65      0.00
  39 SU0YOMB                                         1     582.3     582.3      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1921      20.0      20.0      0.06      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1920     190.8     190.8      0.55      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1920      47.8      47.8      0.14      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 83       1.1       1.1      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     4165     307.9     307.9      1.91      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      4006     193.9     193.9      1.16      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       4006      95.7      95.7      0.57      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      4165     107.8     107.8      0.67      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      46.5      46.5      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           4165      60.8      60.8      0.38      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           4006      30.2      30.2      0.18      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           4165      67.7      67.7      0.42      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           4006      32.4      32.4      0.19      0.00
 400 GSTATS                                     223224       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                207696       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    67008.2 CPU TIME   42767.5 VECTOR TIME    42767.5


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       25.8
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /home/ij2/slots/20/ICMGGh7zg+001920
Moving to projects directory: /home/ij2/slots/20/ICMSHh7zg+001920
Moving to projects directory: /home/ij2/slots/20/ICMUAh7zg+001920
Adding to the zip: /home/ij2/slots/20/NODE.001_01
Adding to the zip: /home/ij2/slots/20/ifs.stat
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001836
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001836
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001884
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001860
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001860
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001884
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001836
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001884
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001860
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001848
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001848
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001848
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001824
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001896
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001872
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001908
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001824
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001824
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001896
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001908
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001872
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001872
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001908
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001896
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMUAh7zg+001920
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMSHh7zg+001920
Adding to the zip: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_12288580/ICMGGh7zg+001920
Zipping up the final file: /home/ij2/projects/climateprediction.net/oifs_43r3_bl_a071_2016092300_20_1018_12288580_0_r1536939563_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
11:31:22 (1159): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
14 Jun 2024 10:29:37 1549780 22442136 oifs_43r3_bl_a071_2016092300_20_1018_12288580_0 1,727,100 42,767 0.0248
14 Jun 2024 10:29:37 1549780 22442136 oifs_43r3_bl_a071_2016092300_20_1018_12288580_0 1,727,100 42,767 0.0248
13 Jun 2024 21:44:10 1549780 22442136 oifs_43r3_bl_a071_2016092300_20_1018_12288580_0 864,000 22,146 0.0256


©2024 cpdn.org