climateprediction.net home page
Task 22444144

Task 22444144

Name oifs_43r3_bl_a1po_2016092300_20_1018_12290547_0
Workunit 12290547
Created 12 Jun 2024, 23:10:58 UTC
Sent 12 Jun 2024, 23:32:25 UTC
Report deadline 11 Aug 2024, 23:32:25 UTC
Received 13 Jun 2024, 20:56:37 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1542649
Run time 18 hours 40 min 41 sec
CPU time 11 hours 13 min 45 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 4.95 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,025.26 MB
Peak swap size 5,981.07 MB
Peak disk usage 2,769.70 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
06:13 STEP 1272 H= 318:00 +CPU= 25.439
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001272
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001272
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001272
  07:06:47 STEP 1273 H= 318:15 +CPU= 20.172
  07:07:23 STEP 1274 H= 318:30 +CPU= 20.341
  07:07:57 STEP 1275 H= 318:45 +CPU= 20.232
  07:08:32 STEP 1276 H= 319:00 +CPU= 20.783
  07:09:08 STEP 1277 H= 319:15 +CPU= 20.390
  07:09:43 STEP 1278 H= 319:30 +CPU= 20.244
  07:10:19 STEP 1279 H= 319:45 +CPU= 20.559
  07:10:54 STEP 1280 H= 320:00 +CPU= 20.597
  07:11:30 STEP 1281 H= 320:15 +CPU= 20.481
  07:12:05 STEP 1282 H= 320:30 +CPU= 20.458
  07:12:41 STEP 1283 H= 320:45 +CPU= 20.184
  07:13:24 STEP 1284 H= 321:00 +CPU= 25.274
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001284
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001284
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001284
  07:13:59 STEP 1285 H= 321:15 +CPU= 20.208
  07:14:35 STEP 1286 H= 321:30 +CPU= 20.347
  07:15:11 STEP 1287 H= 321:45 +CPU= 20.657
  07:15:45 STEP 1288 H= 322:00 +CPU= 20.521
  07:16:19 STEP 1289 H= 322:15 +CPU= 20.395
  07:16:53 STEP 1290 H= 322:30 +CPU= 20.151
  07:17:29 STEP 1291 H= 322:45 +CPU= 20.450
  07:18:06 STEP 1292 H= 323:00 +CPU= 20.906
  07:18:41 STEP 1293 H= 323:15 +CPU= 20.189
  07:19:17 STEP 1294 H= 323:30 +CPU= 20.435
  07:19:50 STEP 1295 H= 323:45 +CPU= 20.120
  07:20:41 STEP 1296 H= 324:00 +CPU= 28.462
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001296
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001296
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001296
  07:21:17 STEP 1297 H= 324:15 +CPU= 20.430
  07:21:50 STEP 1298 H= 324:30 +CPU= 20.182
  07:22:26 STEP 1299 H= 324:45 +CPU= 20.428
  07:23:00 STEP 1300 H= 325:00 +CPU= 20.551
  07:23:36 STEP 1301 H= 325:15 +CPU= 20.541
  07:24:11 STEP 1302 H= 325:30 +CPU= 20.466
  07:24:45 STEP 1303 H= 325:45 +CPU= 20.152
  07:25:24 STEP 1304 H= 326:00 +CPU= 21.259
  07:25:58 STEP 1305 H= 326:15 +CPU= 20.163
  07:26:33 STEP 1306 H= 326:30 +CPU= 20.448
  07:27:10 STEP 1307 H= 326:45 +CPU= 20.471
  07:27:54 STEP 1308 H= 327:00 +CPU= 25.159
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001308
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001308
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001308
  07:28:29 STEP 1309 H= 327:15 +CPU= 20.411
  07:29:05 STEP 1310 H= 327:30 +CPU= 20.428
  07:29:41 STEP 1311 H= 327:45 +CPU= 20.275
  07:30:17 STEP 1312 H= 328:00 +CPU= 21.032
  07:30:52 STEP 1313 H= 328:15 +CPU= 20.213
  07:31:28 STEP 1314 H= 328:30 +CPU= 20.451
  07:32:01 STEP 1315 H= 328:45 +CPU= 20.246
  07:32:36 STEP 1316 H= 329:00 +CPU= 20.665
  07:33:12 STEP 1317 H= 329:15 +CPU= 20.410
  07:33:46 STEP 1318 H= 329:30 +CPU= 20.226
  07:34:21 STEP 1319 H= 329:45 +CPU= 20.442
  07:35:06 STEP 1320 H= 330:00 +CPU= 25.499
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001320
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001320
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001320
  07:35:41 STEP 1321 H= 330:15 +CPU= 20.314
  07:36:16 STEP 1322 H= 330:30 +CPU= 20.390
  07:36:53 STEP 1323 H= 330:45 +CPU= 20.236
  07:37:28 STEP 1324 H= 331:00 +CPU= 20.713
  07:38:01 STEP 1325 H= 331:15 +CPU= 20.189
  07:38:37 STEP 1326 H= 331:30 +CPU= 20.385
  07:39:12 STEP 1327 H= 331:45 +CPU= 20.319
  07:39:47 STEP 1328 H= 332:00 +CPU= 20.574
  07:40:23 STEP 1329 H= 332:15 +CPU= 20.514
  07:40:57 STEP 1330 H= 332:30 +CPU= 20.230
  07:41:32 STEP 1331 H= 332:45 +CPU= 20.413
  07:42:17 STEP 1332 H= 333:00 +CPU= 25.371
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001332
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001332
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001332
  07:42:52 STEP 1333 H= 333:15 +CPU= 20.186
  07:43:25 STEP 1334 H= 333:30 +CPU= 20.298
  07:44:00 STEP 1335 H= 333:45 +CPU= 20.234
  07:44:36 STEP 1336 H= 334:00 +CPU= 20.720
  07:45:11 STEP 1337 H= 334:15 +CPU= 20.473
  07:45:46 STEP 1338 H= 334:30 +CPU= 20.235
  07:46:20 STEP 1339 H= 334:45 +CPU= 20.405
  07:46:56 STEP 1340 H= 335:00 +CPU= 20.609
  07:47:31 STEP 1341 H= 335:15 +CPU= 20.434
  07:48:06 STEP 1342 H= 335:30 +CPU= 20.374
  07:48:41 STEP 1343 H= 335:45 +CPU= 20.253
  07:49:30 STEP 1344 H= 336:00 +CPU= 28.037
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001344
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001344
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001344
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001248
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001248
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001248
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001260
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001260
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001260
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001272
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001272
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001272
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001284
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001284
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001284
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001296
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001296
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001296
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001308
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001308
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001308
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001320
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001320
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001320
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001332
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001332
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001332
Zipping up the intermediate file: /home/amar/projects/climateprediction.net/oifs_43r3_bl_a1po_2016092300_20_1018_12290547_0_r2001001278_13.zip
Uploading the intermediate file: upload_file_13.zip
  07:50:02 STEP 1345 H= 336:15 +CPU= 21.191
  07:50:38 STEP 1346 H= 336:30 +CPU= 20.532
  07:51:14 STEP 1347 H= 336:45 +CPU= 20.437
  07:51:51 STEP 1348 H= 337:00 +CPU= 20.667
  07:52:25 STEP 1349 H= 337:15 +CPU= 20.305
  07:52:59 STEP 1350 H= 337:30 +CPU= 20.280
  07:53:35 STEP 1351 H= 337:45 +CPU= 20.424
  07:54:11 STEP 1352 H= 338:00 +CPU= 20.787
  07:54:47 STEP 1353 H= 338:15 +CPU= 20.240
  07:55:22 STEP 1354 H= 338:30 +CPU= 20.550
  07:55:56 STEP 1355 H= 338:45 +CPU= 20.238
  07:56:41 STEP 1356 H= 339:00 +CPU= 25.396
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001356
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001356
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001356
  07:57:16 STEP 1357 H= 339:15 +CPU= 20.387
  07:57:49 STEP 1358 H= 339:30 +CPU= 20.222
  07:58:23 STEP 1359 H= 339:45 +CPU= 20.414
  07:58:58 STEP 1360 H= 340:00 +CPU= 20.588
  07:59:33 STEP 1361 H= 340:15 +CPU= 20.490
  08:00:09 STEP 1362 H= 340:30 +CPU= 20.399
  08:00:44 STEP 1363 H= 340:45 +CPU= 20.422
  08:01:21 STEP 1364 H= 341:00 +CPU= 20.848
  08:01:56 STEP 1365 H= 341:15 +CPU= 20.248
  08:02:31 STEP 1366 H= 341:30 +CPU= 20.440
  08:03:08 STEP 1367 H= 341:45 +CPU= 20.467
  08:03:52 STEP 1368 H= 342:00 +CPU= 25.273
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001368
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001368
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001368
  08:04:27 STEP 1369 H= 342:15 +CPU= 20.442
  08:05:02 STEP 1370 H= 342:30 +CPU= 20.402
  08:05:38 STEP 1371 H= 342:45 +CPU= 20.498
  08:06:13 STEP 1372 H= 343:00 +CPU= 20.792
  08:06:47 STEP 1373 H= 343:15 +CPU= 20.231
  08:07:24 STEP 1374 H= 343:30 +CPU= 20.456
  08:07:58 STEP 1375 H= 343:45 +CPU= 20.270
  08:08:33 STEP 1376 H= 344:00 +CPU= 20.816
  08:09:08 STEP 1377 H= 344:15 +CPU= 20.358
  08:09:42 STEP 1378 H= 344:30 +CPU= 20.244
  08:10:17 STEP 1379 H= 344:45 +CPU= 20.594
  08:11:01 STEP 1380 H= 345:00 +CPU= 25.332
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001380
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001380
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001380
  08:11:37 STEP 1381 H= 345:15 +CPU= 20.381
  08:12:13 STEP 1382 H= 345:30 +CPU= 20.507
  08:12:48 STEP 1383 H= 345:45 +CPU= 20.287
  08:13:23 STEP 1384 H= 346:00 +CPU= 20.827
  08:13:58 STEP 1385 H= 346:15 +CPU= 20.315
  08:14:33 STEP 1386 H= 346:30 +CPU= 20.413
  08:15:08 STEP 1387 H= 346:45 +CPU= 20.349
  08:15:43 STEP 1388 H= 347:00 +CPU= 20.828
  08:16:19 STEP 1389 H= 347:15 +CPU= 20.425
  08:16:54 STEP 1390 H= 347:30 +CPU= 20.285
  08:17:29 STEP 1391 H= 347:45 +CPU= 20.392
  08:18:18 STEP 1392 H= 348:00 +CPU= 28.169
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001392
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001392
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001392
  08:18:52 STEP 1393 H= 348:15 +CPU= 20.240
  08:19:27 STEP 1394 H= 348:30 +CPU= 20.305
  08:20:03 STEP 1395 H= 348:45 +CPU= 20.448
  08:20:39 STEP 1396 H= 349:00 +CPU= 20.832
  08:21:14 STEP 1397 H= 349:15 +CPU= 20.476
  08:21:50 STEP 1398 H= 349:30 +CPU= 20.239
  08:22:25 STEP 1399 H= 349:45 +CPU= 20.433
  08:23:00 STEP 1400 H= 350:00 +CPU= 20.607
  08:23:37 STEP 1401 H= 350:15 +CPU= 20.647
  08:24:12 STEP 1402 H= 350:30 +CPU= 20.530
  08:24:47 STEP 1403 H= 350:45 +CPU= 20.187
  08:25:31 STEP 1404 H= 351:00 +CPU= 25.623
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001404
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001404
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001404
  08:26:07 STEP 1405 H= 351:15 +CPU= 20.394
  08:26:42 STEP 1406 H= 351:30 +CPU= 20.284
  08:27:17 STEP 1407 H= 351:45 +CPU= 20.405
  08:27:53 STEP 1408 H= 352:00 +CPU= 20.639
  08:28:28 STEP 1409 H= 352:15 +CPU= 20.480
  08:29:03 STEP 1410 H= 352:30 +CPU= 20.415
  08:29:39 STEP 1411 H= 352:45 +CPU= 20.339
  08:30:14 STEP 1412 H= 353:00 +CPU= 20.807
  08:30:51 STEP 1413 H= 353:15 +CPU= 20.502
  08:31:27 STEP 1414 H= 353:30 +CPU= 20.536
  08:32:03 STEP 1415 H= 353:45 +CPU= 20.394
  08:32:46 STEP 1416 H= 354:00 +CPU= 25.286
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001416
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001416
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001416
  08:33:20 STEP 1417 H= 354:15 +CPU= 20.471
  08:33:55 STEP 1418 H= 354:30 +CPU= 20.306
  08:34:31 STEP 1419 H= 354:45 +CPU= 20.504
  08:35:08 STEP 1420 H= 355:00 +CPU= 20.875
  08:35:43 STEP 1421 H= 355:15 +CPU= 20.480
  08:36:19 STEP 1422 H= 355:30 +CPU= 20.454
  08:36:54 STEP 1423 H= 355:45 +CPU= 20.256
  08:37:30 STEP 1424 H= 356:00 +CPU= 20.771
  08:38:04 STEP 1425 H= 356:15 +CPU= 20.436
  08:38:39 STEP 1426 H= 356:30 +CPU= 20.311
  08:39:14 STEP 1427 H= 356:45 +CPU= 20.416
  08:39:59 STEP 1428 H= 357:00 +CPU= 25.247
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001428
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001428
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001428
  08:40:34 STEP 1429 H= 357:15 +CPU= 20.657
  08:41:08 STEP 1430 H= 357:30 +CPU= 20.368
  08:41:43 STEP 1431 H= 357:45 +CPU= 20.318
  08:42:20 STEP 1432 H= 358:00 +CPU= 20.802
  08:42:55 STEP 1433 H= 358:15 +CPU= 20.285
  08:43:30 STEP 1434 H= 358:30 +CPU= 20.373
  08:44:05 STEP 1435 H= 358:45 +CPU= 20.458
  08:44:39 STEP 1436 H= 359:00 +CPU= 20.577
  08:45:14 STEP 1437 H= 359:15 +CPU= 20.375
  08:45:51 STEP 1438 H= 359:30 +CPU= 20.478
  08:46:26 STEP 1439 H= 359:45 +CPU= 20.403
  08:47:14 STEP 1440 H= 360:00 +CPU= 28.032
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001440
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001440
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001440
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001344
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001344
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001344
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001356
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001356
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001356
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001368
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001368
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001368
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001380
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001380
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001380
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001392
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001392
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001392
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001404
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001404
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001404
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001416
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001416
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001416
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001428
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001428
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001428
Zipping up the intermediate file: /home/amar/projects/climateprediction.net/oifs_43r3_bl_a1po_2016092300_20_1018_12290547_0_r2001001278_14.zip
Uploading the intermediate file: upload_file_14.zip
  08:47:46 STEP 1441 H= 360:15 +CPU= 21.328
  08:48:15 STEP 1442 H= 360:30 +CPU= 20.591
  08:48:52 STEP 1443 H= 360:45 +CPU= 20.340
  08:49:29 STEP 1444 H= 361:00 +CPU= 20.751
  08:50:03 STEP 1445 H= 361:15 +CPU= 20.449
  08:50:39 STEP 1446 H= 361:30 +CPU= 21.611
  08:51:09 STEP 1447 H= 361:45 +CPU= 20.604
  08:51:37 STEP 1448 H= 362:00 +CPU= 20.802
  08:52:12 STEP 1449 H= 362:15 +CPU= 20.424
  08:52:49 STEP 1450 H= 362:30 +CPU= 20.394
  08:53:24 STEP 1451 H= 362:45 +CPU= 20.360
  08:54:08 STEP 1452 H= 363:00 +CPU= 25.483
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001452
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001452
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001452
  08:54:43 STEP 1453 H= 363:15 +CPU= 20.258
  08:55:18 STEP 1454 H= 363:30 +CPU= 20.396
  08:55:54 STEP 1455 H= 363:45 +CPU= 20.425
  08:56:30 STEP 1456 H= 364:00 +CPU= 20.773
  08:57:06 STEP 1457 H= 364:15 +CPU= 20.415
  08:57:41 STEP 1458 H= 364:30 +CPU= 20.404
  08:58:16 STEP 1459 H= 364:45 +CPU= 20.442
  08:58:52 STEP 1460 H= 365:00 +CPU= 20.623
  08:59:28 STEP 1461 H= 365:15 +CPU= 20.463
  09:00:04 STEP 1462 H= 365:30 +CPU= 20.580
  09:00:39 STEP 1463 H= 365:45 +CPU= 20.400
  09:01:24 STEP 1464 H= 366:00 +CPU= 25.548
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001464
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001464
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001464
  09:01:57 STEP 1465 H= 366:15 +CPU= 20.183
  09:02:33 STEP 1466 H= 366:30 +CPU= 20.470
  09:03:08 STEP 1467 H= 366:45 +CPU= 20.491
  09:03:44 STEP 1468 H= 367:00 +CPU= 20.579
  09:04:20 STEP 1469 H= 367:15 +CPU= 20.489
  09:04:54 STEP 1470 H= 367:30 +CPU= 20.243
  09:05:30 STEP 1471 H= 367:45 +CPU= 20.604
  09:06:07 STEP 1472 H= 368:00 +CPU= 20.974
  09:06:41 STEP 1473 H= 368:15 +CPU= 20.259
  09:07:16 STEP 1474 H= 368:30 +CPU= 20.430
  09:07:50 STEP 1475 H= 368:45 +CPU= 20.272
  09:08:36 STEP 1476 H= 369:00 +CPU= 25.484
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001476
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001476
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001476
  09:09:11 STEP 1477 H= 369:15 +CPU= 20.362
  09:09:45 STEP 1478 H= 369:30 +CPU= 20.233
  09:10:20 STEP 1479 H= 369:45 +CPU= 20.427
  09:10:57 STEP 1480 H= 370:00 +CPU= 20.828
  09:11:32 STEP 1481 H= 370:15 +CPU= 20.388
  09:12:08 STEP 1482 H= 370:30 +CPU= 20.447
  09:12:42 STEP 1483 H= 370:45 +CPU= 20.294
  09:13:19 STEP 1484 H= 371:00 +CPU= 20.746
  09:13:53 STEP 1485 H= 371:15 +CPU= 20.268
  09:14:29 STEP 1486 H= 371:30 +CPU= 20.427
  09:15:04 STEP 1487 H= 371:45 +CPU= 20.364
  09:15:53 STEP 1488 H= 372:00 +CPU= 28.201
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001488
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001488
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001488
  09:16:29 STEP 1489 H= 372:15 +CPU= 20.473
  09:17:05 STEP 1490 H= 372:30 +CPU= 20.479
  09:17:39 STEP 1491 H= 372:45 +CPU= 20.295
  09:18:15 STEP 1492 H= 373:00 +CPU= 20.786
  09:18:49 STEP 1493 H= 373:15 +CPU= 20.240
  09:19:25 STEP 1494 H= 373:30 +CPU= 20.459
  09:20:00 STEP 1495 H= 373:45 +CPU= 20.286
  09:20:39 STEP 1496 H= 374:00 +CPU= 21.641
  09:21:25 STEP 1497 H= 374:15 +CPU= 24.885
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:22:23 STEP 1498 H= 374:30 +CPU= 25.904
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:23:26 STEP 1499 H= 374:45 +CPU= 26.508
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:25:01 STEP 1500 H= 375:00 +CPU= 33.112
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001500
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001500
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001500
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:26:01 STEP 1501 H= 375:15 +CPU= 25.750
  09:26:31 STEP 1502 H= 375:30 +CPU= 22.259
  09:27:06 STEP 1503 H= 375:45 +CPU= 22.993
  09:27:41 STEP 1504 H= 376:00 +CPU= 22.732
  09:28:15 STEP 1505 H= 376:15 +CPU= 22.646
  09:28:54 STEP 1506 H= 376:30 +CPU= 23.491
  09:29:26 STEP 1507 H= 376:45 +CPU= 22.371
  09:30:02 STEP 1508 H= 377:00 +CPU= 23.181
  09:30:37 STEP 1509 H= 377:15 +CPU= 22.604
  09:31:16 STEP 1510 H= 377:30 +CPU= 23.910
  09:31:52 STEP 1511 H= 377:45 +CPU= 22.892
  09:32:42 STEP 1512 H= 378:00 +CPU= 29.313
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001512
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001512
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001512
  09:33:18 STEP 1513 H= 378:15 +CPU= 22.968
  09:33:48 STEP 1514 H= 378:30 +CPU= 21.972
  09:34:23 STEP 1515 H= 378:45 +CPU= 22.915
  09:35:03 STEP 1516 H= 379:00 +CPU= 24.131
  09:35:33 STEP 1517 H= 379:15 +CPU= 22.282
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:36:36 STEP 1518 H= 379:30 +CPU= 24.315
  09:37:11 STEP 1519 H= 379:45 +CPU= 22.571
  09:37:44 STEP 1520 H= 380:00 +CPU= 22.280
  09:38:20 STEP 1521 H= 380:15 +CPU= 23.025
  09:38:55 STEP 1522 H= 380:30 +CPU= 22.663
  09:39:31 STEP 1523 H= 380:45 +CPU= 23.194
  09:40:11 STEP 1524 H= 381:00 +CPU= 27.949
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001524
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001524
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001524
  09:40:51 STEP 1525 H= 381:15 +CPU= 23.895
  09:41:20 STEP 1526 H= 381:30 +CPU= 21.578
  09:41:50 STEP 1527 H= 381:45 +CPU= 21.124
  09:42:20 STEP 1528 H= 382:00 +CPU= 21.501
  09:42:52 STEP 1529 H= 382:15 +CPU= 21.086
  09:43:24 STEP 1530 H= 382:30 +CPU= 21.429
  09:43:52 STEP 1531 H= 382:45 +CPU= 21.090
  09:44:21 STEP 1532 H= 383:00 +CPU= 21.456
  09:44:50 STEP 1533 H= 383:15 +CPU= 21.060
  09:45:19 STEP 1534 H= 383:30 +CPU= 21.109
  09:45:49 STEP 1535 H= 383:45 +CPU= 21.204
  09:46:32 STEP 1536 H= 384:00 +CPU= 29.528
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001536
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001536
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001536
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001440
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001440
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001440
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001452
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001452
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001452
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001464
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001464
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001464
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001476
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001476
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001476
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001488
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001488
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001488
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001500
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001500
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001500
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001512
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001512
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001512
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001524
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001524
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001524
Zipping up the intermediate file: /home/amar/projects/climateprediction.net/oifs_43r3_bl_a1po_2016092300_20_1018_12290547_0_r2001001278_15.zip
Uploading the intermediate file: upload_file_15.zip
  09:47:01 STEP 1537 H= 384:15 +CPU= 21.479
  09:47:31 STEP 1538 H= 384:30 +CPU= 21.217
  09:48:02 STEP 1539 H= 384:45 +CPU= 21.294
  09:48:34 STEP 1540 H= 385:00 +CPU= 21.478
  09:49:07 STEP 1541 H= 385:15 +CPU= 21.726
  09:49:36 STEP 1542 H= 385:30 +CPU= 21.300
  09:50:05 STEP 1543 H= 385:45 +CPU= 21.252
  09:50:38 STEP 1544 H= 386:00 +CPU= 23.584
  09:51:23 STEP 1545 H= 386:15 +CPU= 25.432
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:52:17 STEP 1546 H= 386:30 +CPU= 22.924
  09:52:50 STEP 1547 H= 386:45 +CPU= 22.870
  09:53:26 STEP 1548 H= 387:00 +CPU= 26.840
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001548
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001548
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001548
  09:53:57 STEP 1549 H= 387:15 +CPU= 21.334
  09:54:30 STEP 1550 H= 387:30 +CPU= 21.488
  09:55:01 STEP 1551 H= 387:45 +CPU= 22.074
  09:55:30 STEP 1552 H= 388:00 +CPU= 21.541
  09:56:03 STEP 1553 H= 388:15 +CPU= 22.119
  09:56:36 STEP 1554 H= 388:30 +CPU= 21.528
  09:57:09 STEP 1555 H= 388:45 +CPU= 21.881
  09:57:39 STEP 1556 H= 389:00 +CPU= 21.549
  09:58:09 STEP 1557 H= 389:15 +CPU= 21.507
  09:58:41 STEP 1558 H= 389:30 +CPU= 21.303
  09:59:15 STEP 1559 H= 389:45 +CPU= 22.064
  09:59:52 STEP 1560 H= 390:00 +CPU= 26.847
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001560
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001560
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001560
  10:00:24 STEP 1561 H= 390:15 +CPU= 21.566
  10:00:58 STEP 1562 H= 390:30 +CPU= 21.864
  10:01:27 STEP 1563 H= 390:45 +CPU= 21.385
  10:01:57 STEP 1564 H= 391:00 +CPU= 21.402
  10:02:28 STEP 1565 H= 391:15 +CPU= 21.391
  10:03:00 STEP 1566 H= 391:30 +CPU= 21.194
  10:03:33 STEP 1567 H= 391:45 +CPU= 21.977
  10:04:06 STEP 1568 H= 392:00 +CPU= 21.736
  10:04:37 STEP 1569 H= 392:15 +CPU= 21.546
  10:05:10 STEP 1570 H= 392:30 +CPU= 21.623
  10:05:40 STEP 1571 H= 392:45 +CPU= 21.618
  10:06:15 STEP 1572 H= 393:00 +CPU= 26.532
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001572
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001572
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001572
  10:06:47 STEP 1573 H= 393:15 +CPU= 21.828
  10:07:19 STEP 1574 H= 393:30 +CPU= 21.492
  10:07:50 STEP 1575 H= 393:45 +CPU= 21.029
  10:08:22 STEP 1576 H= 394:00 +CPU= 22.047
  10:08:51 STEP 1577 H= 394:15 +CPU= 21.073
  10:09:20 STEP 1578 H= 394:30 +CPU= 21.246
  10:09:52 STEP 1579 H= 394:45 +CPU= 23.011
  10:10:24 STEP 1580 H= 395:00 +CPU= 21.690
  10:10:56 STEP 1581 H= 395:15 +CPU= 21.246
  10:11:29 STEP 1582 H= 395:30 +CPU= 21.761
  10:12:01 STEP 1583 H= 395:45 +CPU= 21.153
  10:12:45 STEP 1584 H= 396:00 +CPU= 29.947
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001584
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001584
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001584
  10:13:19 STEP 1585 H= 396:15 +CPU= 22.542
  10:13:48 STEP 1586 H= 396:30 +CPU= 21.093
  10:14:17 STEP 1587 H= 396:45 +CPU= 21.255
  10:14:48 STEP 1588 H= 397:00 +CPU= 21.503
  10:15:20 STEP 1589 H= 397:15 +CPU= 21.377
  10:15:52 STEP 1590 H= 397:30 +CPU= 21.403
  10:16:24 STEP 1591 H= 397:45 +CPU= 21.853
  10:16:58 STEP 1592 H= 398:00 +CPU= 22.037
  10:17:30 STEP 1593 H= 398:15 +CPU= 21.607
  10:18:03 STEP 1594 H= 398:30 +CPU= 21.794
  10:18:32 STEP 1595 H= 398:45 +CPU= 21.168
  10:19:07 STEP 1596 H= 399:00 +CPU= 26.312
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001596
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001596
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001596
  10:19:39 STEP 1597 H= 399:15 +CPU= 21.557
  10:20:12 STEP 1598 H= 399:30 +CPU= 22.090
  10:20:44 STEP 1599 H= 399:45 +CPU= 21.695
  10:21:19 STEP 1600 H= 400:00 +CPU= 22.672
  10:21:51 STEP 1601 H= 400:15 +CPU= 21.238
  10:22:23 STEP 1602 H= 400:30 +CPU= 21.773
  10:22:52 STEP 1603 H= 400:45 +CPU= 21.166
  10:23:22 STEP 1604 H= 401:00 +CPU= 22.078
  10:23:57 STEP 1605 H= 401:15 +CPU= 23.046
  10:24:26 STEP 1606 H= 401:30 +CPU= 21.513
  10:24:59 STEP 1607 H= 401:45 +CPU= 21.684
  10:25:39 STEP 1608 H= 402:00 +CPU= 26.550
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001608
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001608
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001608
  10:26:13 STEP 1609 H= 402:15 +CPU= 22.427
  10:26:44 STEP 1610 H= 402:30 +CPU= 21.140
  10:27:17 STEP 1611 H= 402:45 +CPU= 21.823
  10:27:49 STEP 1612 H= 403:00 +CPU= 22.013
  10:28:18 STEP 1613 H= 403:15 +CPU= 21.355
  10:28:48 STEP 1614 H= 403:30 +CPU= 21.801
  10:29:34 STEP 1615 H= 403:45 +CPU= 25.272
  10:30:03 STEP 1616 H= 404:00 +CPU= 21.536
  10:30:31 STEP 1617 H= 404:15 +CPU= 20.962
  10:31:00 STEP 1618 H= 404:30 +CPU= 20.929
  10:31:29 STEP 1619 H= 404:45 +CPU= 21.061
  10:32:10 STEP 1620 H= 405:00 +CPU= 26.412
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001620
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001620
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001620
  10:32:41 STEP 1621 H= 405:15 +CPU= 21.462
  10:33:09 STEP 1622 H= 405:30 +CPU= 20.962
  10:33:37 STEP 1623 H= 405:45 +CPU= 20.844
  10:34:06 STEP 1624 H= 406:00 +CPU= 21.379
  10:34:34 STEP 1625 H= 406:15 +CPU= 20.943
  10:35:04 STEP 1626 H= 406:30 +CPU= 20.950
  10:35:35 STEP 1627 H= 406:45 +CPU= 21.382
  10:36:09 STEP 1628 H= 407:00 +CPU= 22.934
  10:36:40 STEP 1629 H= 407:15 +CPU= 20.964
  10:37:09 STEP 1630 H= 407:30 +CPU= 21.413
  10:37:40 STEP 1631 H= 407:45 +CPU= 22.750
  10:38:28 STEP 1632 H= 408:00 +CPU= 31.822
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001632
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001632
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001632
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001536
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001536
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001536
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001548
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001548
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001548
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001560
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001560
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001560
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001572
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001572
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001572
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001584
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001584
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001584
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001596
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001596
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001596
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001608
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001608
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001608
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001620
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001620
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001620
Zipping up the intermediate file: /home/amar/projects/climateprediction.net/oifs_43r3_bl_a1po_2016092300_20_1018_12290547_0_r2001001278_16.zip
Uploading the intermediate file: upload_file_16.zip
  10:39:07 STEP 1633 H= 408:15 +CPU= 24.922
  10:39:45 STEP 1634 H= 408:30 +CPU= 24.088
  10:40:22 STEP 1635 H= 408:45 +CPU= 22.872
  10:40:54 STEP 1636 H= 409:00 +CPU= 22.571
  10:41:28 STEP 1637 H= 409:15 +CPU= 22.797
  10:42:02 STEP 1638 H= 409:30 +CPU= 22.704
  10:42:41 STEP 1639 H= 409:45 +CPU= 23.344
  10:43:15 STEP 1640 H= 410:00 +CPU= 22.955
  10:43:45 STEP 1641 H= 410:15 +CPU= 21.929
  10:44:20 STEP 1642 H= 410:30 +CPU= 22.724
  10:44:54 STEP 1643 H= 410:45 +CPU= 22.225
  10:45:42 STEP 1644 H= 411:00 +CPU= 29.280
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001644
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001644
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001644
  10:46:15 STEP 1645 H= 411:15 +CPU= 22.321
  10:46:50 STEP 1646 H= 411:30 +CPU= 22.416
  10:47:25 STEP 1647 H= 411:45 +CPU= 22.925
  10:48:01 STEP 1648 H= 412:00 +CPU= 23.122
  10:48:36 STEP 1649 H= 412:15 +CPU= 22.675
  10:49:16 STEP 1650 H= 412:30 +CPU= 24.536
  10:49:51 STEP 1651 H= 412:45 +CPU= 22.516
  10:50:27 STEP 1652 H= 413:00 +CPU= 23.114
  10:51:09 STEP 1653 H= 413:15 +CPU= 24.259
  10:51:45 STEP 1654 H= 413:30 +CPU= 22.880
  10:52:21 STEP 1655 H= 413:45 +CPU= 23.293
  10:53:06 STEP 1656 H= 414:00 +CPU= 29.063
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001656
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001656
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001656
  10:53:47 STEP 1657 H= 414:15 +CPU= 24.920
  10:54:17 STEP 1658 H= 414:30 +CPU= 22.206
  10:54:48 STEP 1659 H= 414:45 +CPU= 22.157
  10:55:22 STEP 1660 H= 415:00 +CPU= 22.217
  10:55:53 STEP 1661 H= 415:15 +CPU= 21.195
  10:56:25 STEP 1662 H= 415:30 +CPU= 21.431
  10:56:57 STEP 1663 H= 415:45 +CPU= 21.403
  10:57:26 STEP 1664 H= 416:00 +CPU= 21.456
  10:57:55 STEP 1665 H= 416:15 +CPU= 21.129
  10:58:24 STEP 1666 H= 416:30 +CPU= 21.216
  10:58:53 STEP 1667 H= 416:45 +CPU= 21.194
  10:59:42 STEP 1668 H= 417:00 +CPU= 28.287
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001668
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001668
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001668
  11:00:20 STEP 1669 H= 417:15 +CPU= 24.833
  11:00:49 STEP 1670 H= 417:30 +CPU= 20.810
  11:01:18 STEP 1671 H= 417:45 +CPU= 21.221
  11:01:53 STEP 1672 H= 418:00 +CPU= 23.230
  11:02:23 STEP 1673 H= 418:15 +CPU= 21.171
  11:02:53 STEP 1674 H= 418:30 +CPU= 20.754
  11:03:26 STEP 1675 H= 418:45 +CPU= 21.989
  11:04:02 STEP 1676 H= 419:00 +CPU= 23.601
  11:04:32 STEP 1677 H= 419:15 +CPU= 20.890
  11:05:03 STEP 1678 H= 419:30 +CPU= 21.089
  11:05:33 STEP 1679 H= 419:45 +CPU= 20.938
  11:06:14 STEP 1680 H= 420:00 +CPU= 29.789
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001680
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001680
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001680
  11:06:41 STEP 1681 H= 420:15 +CPU= 20.489
  11:07:15 STEP 1682 H= 420:30 +CPU= 22.324
  11:07:44 STEP 1683 H= 420:45 +CPU= 20.959
  11:08:15 STEP 1684 H= 421:00 +CPU= 21.440
  11:08:45 STEP 1685 H= 421:15 +CPU= 20.817
  11:09:15 STEP 1686 H= 421:30 +CPU= 21.601
  11:09:43 STEP 1687 H= 421:45 +CPU= 20.870
  11:10:12 STEP 1688 H= 422:00 +CPU= 21.326
  11:10:40 STEP 1689 H= 422:15 +CPU= 20.815
  11:11:09 STEP 1690 H= 422:30 +CPU= 21.393
  11:11:38 STEP 1691 H= 422:45 +CPU= 20.807
  11:12:18 STEP 1692 H= 423:00 +CPU= 26.675
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001692
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001692
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001692
  11:12:46 STEP 1693 H= 423:15 +CPU= 20.837
  11:13:15 STEP 1694 H= 423:30 +CPU= 21.038
  11:13:43 STEP 1695 H= 423:45 +CPU= 20.771
  11:14:12 STEP 1696 H= 424:00 +CPU= 21.372
  11:14:40 STEP 1697 H= 424:15 +CPU= 20.753
  11:15:11 STEP 1698 H= 424:30 +CPU= 21.772
  11:15:47 STEP 1699 H= 424:45 +CPU= 22.503
  11:16:21 STEP 1700 H= 425:00 +CPU= 22.682
  11:16:51 STEP 1701 H= 425:15 +CPU= 20.844
  11:17:22 STEP 1702 H= 425:30 +CPU= 21.142
  11:17:52 STEP 1703 H= 425:45 +CPU= 20.574
  11:18:34 STEP 1704 H= 426:00 +CPU= 27.847
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001704
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001704
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001704
  11:19:03 STEP 1705 H= 426:15 +CPU= 21.135
  11:19:31 STEP 1706 H= 426:30 +CPU= 20.836
  11:19:59 STEP 1707 H= 426:45 +CPU= 20.794
  11:20:28 STEP 1708 H= 427:00 +CPU= 21.385
  11:20:58 STEP 1709 H= 427:15 +CPU= 20.935
  11:21:29 STEP 1710 H= 427:30 +CPU= 21.342
  11:21:59 STEP 1711 H= 427:45 +CPU= 20.960
  11:22:28 STEP 1712 H= 428:00 +CPU= 21.687
  11:22:56 STEP 1713 H= 428:15 +CPU= 20.804
  11:23:25 STEP 1714 H= 428:30 +CPU= 21.031
  11:23:53 STEP 1715 H= 428:45 +CPU= 20.852
  11:24:31 STEP 1716 H= 429:00 +CPU= 25.966
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001716
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001716
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001716
  11:25:02 STEP 1717 H= 429:15 +CPU= 21.554
  11:25:30 STEP 1718 H= 429:30 +CPU= 20.808
  11:25:58 STEP 1719 H= 429:45 +CPU= 20.735
  11:26:27 STEP 1720 H= 430:00 +CPU= 21.665
  11:26:55 STEP 1721 H= 430:15 +CPU= 20.915
  11:27:24 STEP 1722 H= 430:30 +CPU= 21.019
  11:27:54 STEP 1723 H= 430:45 +CPU= 20.875
  11:28:25 STEP 1724 H= 431:00 +CPU= 21.390
  11:28:55 STEP 1725 H= 431:15 +CPU= 20.703
  11:29:26 STEP 1726 H= 431:30 +CPU= 21.272
  11:29:56 STEP 1727 H= 431:45 +CPU= 20.725
  11:30:40 STEP 1728 H= 432:00 +CPU= 29.122
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001728
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001728
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001728
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001632
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001632
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001632
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001644
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001644
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001644
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001656
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001656
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001656
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001668
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001668
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001668
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001680
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001680
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001680
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001692
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001692
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001692
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001704
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001704
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001704
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001716
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001716
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001716
Zipping up the intermediate file: /home/amar/projects/climateprediction.net/oifs_43r3_bl_a1po_2016092300_20_1018_12290547_0_r2001001278_17.zip
Uploading the intermediate file: upload_file_17.zip
  11:31:10 STEP 1729 H= 432:15 +CPU= 22.148
  11:31:38 STEP 1730 H= 432:30 +CPU= 20.864
  11:32:07 STEP 1731 H= 432:45 +CPU= 20.964
  11:32:40 STEP 1732 H= 433:00 +CPU= 21.594
  11:33:08 STEP 1733 H= 433:15 +CPU= 20.921
  11:33:37 STEP 1734 H= 433:30 +CPU= 20.669
  11:34:06 STEP 1735 H= 433:45 +CPU= 20.935
  11:34:41 STEP 1736 H= 434:00 +CPU= 23.105
  11:35:09 STEP 1737 H= 434:15 +CPU= 21.021
  11:35:38 STEP 1738 H= 434:30 +CPU= 20.912
  11:36:06 STEP 1739 H= 434:45 +CPU= 21.118
  11:36:42 STEP 1740 H= 435:00 +CPU= 26.127
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001740
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001740
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001740
  11:37:13 STEP 1741 H= 435:15 +CPU= 21.090
  11:37:43 STEP 1742 H= 435:30 +CPU= 20.851
  11:38:14 STEP 1743 H= 435:45 +CPU= 21.281
  11:38:43 STEP 1744 H= 436:00 +CPU= 21.076
  11:39:11 STEP 1745 H= 436:15 +CPU= 20.975
  11:39:39 STEP 1746 H= 436:30 +CPU= 20.740
  11:40:08 STEP 1747 H= 436:45 +CPU= 20.975
  11:40:37 STEP 1748 H= 437:00 +CPU= 21.151
  11:41:06 STEP 1749 H= 437:15 +CPU= 21.026
  11:41:37 STEP 1750 H= 437:30 +CPU= 21.275
  11:42:09 STEP 1751 H= 437:45 +CPU= 21.570
  11:42:43 STEP 1752 H= 438:00 +CPU= 26.019
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001752
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001752
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001752
  11:43:11 STEP 1753 H= 438:15 +CPU= 21.010
  11:43:40 STEP 1754 H= 438:30 +CPU= 20.508
  11:44:08 STEP 1755 H= 438:45 +CPU= 20.872
  11:44:39 STEP 1756 H= 439:00 +CPU= 21.191
  11:45:09 STEP 1757 H= 439:15 +CPU= 20.898
  11:45:40 STEP 1758 H= 439:30 +CPU= 21.384
  11:46:08 STEP 1759 H= 439:45 +CPU= 20.962
  11:46:37 STEP 1760 H= 440:00 +CPU= 22.022
  11:47:05 STEP 1761 H= 440:15 +CPU= 21.126
  11:47:34 STEP 1762 H= 440:30 +CPU= 20.796
  11:48:03 STEP 1763 H= 440:45 +CPU= 20.980
  11:48:43 STEP 1764 H= 441:00 +CPU= 26.522
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001764
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001764
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001764
  11:49:11 STEP 1765 H= 441:15 +CPU= 21.015
  11:49:39 STEP 1766 H= 441:30 +CPU= 20.761
  11:50:08 STEP 1767 H= 441:45 +CPU= 21.322
  11:50:36 STEP 1768 H= 442:00 +CPU= 21.076
  11:51:05 STEP 1769 H= 442:15 +CPU= 20.959
  11:51:35 STEP 1770 H= 442:30 +CPU= 21.191
  11:52:05 STEP 1771 H= 442:45 +CPU= 20.878
  11:52:36 STEP 1772 H= 443:00 +CPU= 21.313
  11:53:06 STEP 1773 H= 443:15 +CPU= 20.819
  11:53:37 STEP 1774 H= 443:30 +CPU= 22.057
  11:54:05 STEP 1775 H= 443:45 +CPU= 20.992
  11:54:43 STEP 1776 H= 444:00 +CPU= 28.066
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001776
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001776
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001776
  11:55:13 STEP 1777 H= 444:15 +CPU= 20.820
  11:55:42 STEP 1778 H= 444:30 +CPU= 20.624
  11:56:12 STEP 1779 H= 444:45 +CPU= 20.727
  11:56:44 STEP 1780 H= 445:00 +CPU= 21.889
  11:57:13 STEP 1781 H= 445:15 +CPU= 21.065
  11:57:41 STEP 1782 H= 445:30 +CPU= 20.739
  11:58:08 STEP 1783 H= 445:45 +CPU= 20.648
  11:58:37 STEP 1784 H= 446:00 +CPU= 20.989
  11:59:05 STEP 1785 H= 446:15 +CPU= 20.764
  11:59:34 STEP 1786 H= 446:30 +CPU= 20.665
  12:00:04 STEP 1787 H= 446:45 +CPU= 20.953
  12:00:41 STEP 1788 H= 447:00 +CPU= 26.035
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001788
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001788
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001788
  12:01:09 STEP 1789 H= 447:15 +CPU= 21.115
  12:01:52 STEP 1790 H= 447:30 +CPU= 24.293
  12:02:20 STEP 1791 H= 447:45 +CPU= 21.003
  12:02:49 STEP 1792 H= 448:00 +CPU= 21.044
  12:03:17 STEP 1793 H= 448:15 +CPU= 20.881
  12:03:44 STEP 1794 H= 448:30 +CPU= 20.393
  12:04:13 STEP 1795 H= 448:45 +CPU= 20.770
  12:04:42 STEP 1796 H= 449:00 +CPU= 21.228
  12:05:12 STEP 1797 H= 449:15 +CPU= 20.824
  12:05:42 STEP 1798 H= 449:30 +CPU= 20.643
  12:06:12 STEP 1799 H= 449:45 +CPU= 21.649
  12:06:46 STEP 1800 H= 450:00 +CPU= 26.347
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001800
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001800
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001800
  12:07:15 STEP 1801 H= 450:15 +CPU= 20.854
  12:07:43 STEP 1802 H= 450:30 +CPU= 20.721
  12:08:13 STEP 1803 H= 450:45 +CPU= 21.020
  12:08:43 STEP 1804 H= 451:00 +CPU= 20.788
  12:09:13 STEP 1805 H= 451:15 +CPU= 20.897
  12:09:43 STEP 1806 H= 451:30 +CPU= 20.758
  12:10:12 STEP 1807 H= 451:45 +CPU= 21.067
  12:10:41 STEP 1808 H= 452:00 +CPU= 20.993
  12:11:09 STEP 1809 H= 452:15 +CPU= 20.844
  12:11:37 STEP 1810 H= 452:30 +CPU= 20.837
  12:12:05 STEP 1811 H= 452:45 +CPU= 21.024
  12:12:43 STEP 1812 H= 453:00 +CPU= 25.581
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001812
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001812
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001812
  12:13:13 STEP 1813 H= 453:15 +CPU= 21.016
  12:13:46 STEP 1814 H= 453:30 +CPU= 20.797
  12:14:15 STEP 1815 H= 453:45 +CPU= 20.957
  12:14:45 STEP 1816 H= 454:00 +CPU= 21.067
  12:15:14 STEP 1817 H= 454:15 +CPU= 20.980
  12:15:43 STEP 1818 H= 454:30 +CPU= 20.475
  12:16:13 STEP 1819 H= 454:45 +CPU= 20.862
  12:16:45 STEP 1820 H= 455:00 +CPU= 21.814
  12:17:16 STEP 1821 H= 455:15 +CPU= 21.390
  12:17:44 STEP 1822 H= 455:30 +CPU= 20.628
  12:18:12 STEP 1823 H= 455:45 +CPU= 20.979
  12:18:50 STEP 1824 H= 456:00 +CPU= 28.277
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001824
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001824
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001824
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001728
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001728
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001728
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001740
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001740
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001740
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001752
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001752
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001752
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001764
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001764
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001764
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001776
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001776
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001776
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001788
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001788
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001788
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001800
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001800
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001800
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001812
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001812
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001812
Zipping up the intermediate file: /home/amar/projects/climateprediction.net/oifs_43r3_bl_a1po_2016092300_20_1018_12290547_0_r2001001278_18.zip
Uploading the intermediate file: upload_file_18.zip
  12:19:25 STEP 1825 H= 456:15 +CPU= 23.108
  12:19:55 STEP 1826 H= 456:30 +CPU= 20.843
  12:20:25 STEP 1827 H= 456:45 +CPU= 21.643
  12:20:53 STEP 1828 H= 457:00 +CPU= 21.174
  12:21:21 STEP 1829 H= 457:15 +CPU= 21.035
  12:21:49 STEP 1830 H= 457:30 +CPU= 20.841
  12:22:18 STEP 1831 H= 457:45 +CPU= 20.968
  12:22:48 STEP 1832 H= 458:00 +CPU= 21.245
  12:23:18 STEP 1833 H= 458:15 +CPU= 20.960
  12:23:48 STEP 1834 H= 458:30 +CPU= 20.763
  12:24:19 STEP 1835 H= 458:45 +CPU= 21.228
  12:24:57 STEP 1836 H= 459:00 +CPU= 26.055
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001836
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001836
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001836
  12:25:25 STEP 1837 H= 459:15 +CPU= 20.982
  12:25:53 STEP 1838 H= 459:30 +CPU= 20.662
  12:26:22 STEP 1839 H= 459:45 +CPU= 21.138
  12:26:51 STEP 1840 H= 460:00 +CPU= 21.191
  12:27:20 STEP 1841 H= 460:15 +CPU= 21.235
  12:27:50 STEP 1842 H= 460:30 +CPU= 20.771
  12:28:20 STEP 1843 H= 460:45 +CPU= 20.919
  12:28:51 STEP 1844 H= 461:00 +CPU= 21.540
  12:29:19 STEP 1845 H= 461:15 +CPU= 20.855
  12:29:47 STEP 1846 H= 461:30 +CPU= 20.707
  12:30:15 STEP 1847 H= 461:45 +CPU= 21.027
  12:30:53 STEP 1848 H= 462:00 +CPU= 26.777
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001848
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001848
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001848
  12:31:24 STEP 1849 H= 462:15 +CPU= 21.414
  12:31:54 STEP 1850 H= 462:30 +CPU= 20.796
  12:32:25 STEP 1851 H= 462:45 +CPU= 21.406
  12:32:56 STEP 1852 H= 463:00 +CPU= 21.222
  12:33:27 STEP 1853 H= 463:15 +CPU= 21.303
  12:33:56 STEP 1854 H= 463:30 +CPU= 21.553
  12:34:24 STEP 1855 H= 463:45 +CPU= 20.805
  12:34:57 STEP 1856 H= 464:00 +CPU= 22.484
  12:35:25 STEP 1857 H= 464:15 +CPU= 20.898
  12:35:53 STEP 1858 H= 464:30 +CPU= 20.455
  12:36:22 STEP 1859 H= 464:45 +CPU= 20.931
  12:37:03 STEP 1860 H= 465:00 +CPU= 26.223
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001860
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001860
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001860
  12:37:33 STEP 1861 H= 465:15 +CPU= 20.933
  12:38:01 STEP 1862 H= 465:30 +CPU= 20.629
  12:38:29 STEP 1863 H= 465:45 +CPU= 20.917
  12:38:57 STEP 1864 H= 466:00 +CPU= 20.998
  12:39:25 STEP 1865 H= 466:15 +CPU= 20.850
  12:39:55 STEP 1866 H= 466:30 +CPU= 20.676
  12:40:25 STEP 1867 H= 466:45 +CPU= 21.010
  12:40:54 STEP 1868 H= 467:00 +CPU= 21.087
  12:41:26 STEP 1869 H= 467:15 +CPU= 21.777
  12:41:57 STEP 1870 H= 467:30 +CPU= 21.614
  12:42:28 STEP 1871 H= 467:45 +CPU= 21.220
  12:43:07 STEP 1872 H= 468:00 +CPU= 29.100
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001872
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001872
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001872
  12:43:35 STEP 1873 H= 468:15 +CPU= 20.647
  12:44:04 STEP 1874 H= 468:30 +CPU= 20.757
  12:44:33 STEP 1875 H= 468:45 +CPU= 20.858
  12:45:05 STEP 1876 H= 469:00 +CPU= 21.268
  12:45:35 STEP 1877 H= 469:15 +CPU= 20.665
  12:46:05 STEP 1878 H= 469:30 +CPU= 20.896
  12:46:45 STEP 1879 H= 469:45 +CPU= 20.601
  12:47:24 STEP 1880 H= 470:00 +CPU= 20.842
  12:48:04 STEP 1881 H= 470:15 +CPU= 21.407
  12:48:34 STEP 1882 H= 470:30 +CPU= 20.516
  12:49:12 STEP 1883 H= 470:45 +CPU= 20.623
  12:49:58 STEP 1884 H= 471:00 +CPU= 25.273
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001884
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001884
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001884
  12:50:34 STEP 1885 H= 471:15 +CPU= 20.482
  12:51:11 STEP 1886 H= 471:30 +CPU= 20.618
  12:51:50 STEP 1887 H= 471:45 +CPU= 22.081
  12:52:24 STEP 1888 H= 472:00 +CPU= 20.831
  12:53:00 STEP 1889 H= 472:15 +CPU= 20.434
  12:53:37 STEP 1890 H= 472:30 +CPU= 20.436
  12:54:13 STEP 1891 H= 472:45 +CPU= 20.611
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:55:07 STEP 1892 H= 473:00 +CPU= 23.277
  12:55:46 STEP 1893 H= 473:15 +CPU= 21.528
  12:56:28 STEP 1894 H= 473:30 +CPU= 21.927
  12:57:12 STEP 1895 H= 473:45 +CPU= 22.515
  12:58:03 STEP 1896 H= 474:00 +CPU= 26.844
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001896
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001896
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001896
  12:58:43 STEP 1897 H= 474:15 +CPU= 21.366
  12:59:22 STEP 1898 H= 474:30 +CPU= 21.518
  13:00:03 STEP 1899 H= 474:45 +CPU= 21.792
  13:00:45 STEP 1900 H= 475:00 +CPU= 21.788
  13:01:25 STEP 1901 H= 475:15 +CPU= 21.722
  13:02:09 STEP 1902 H= 475:30 +CPU= 22.238
  13:02:50 STEP 1903 H= 475:45 +CPU= 21.384
  13:03:26 STEP 1904 H= 476:00 +CPU= 23.078
  13:04:10 STEP 1905 H= 476:15 +CPU= 21.624
  13:04:50 STEP 1906 H= 476:30 +CPU= 21.463
  13:05:36 STEP 1907 H= 476:45 +CPU= 24.314
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:06:52 STEP 1908 H= 477:00 +CPU= 31.034
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001908
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001908
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001908
  13:07:22 STEP 1909 H= 477:15 +CPU= 21.744
  13:07:52 STEP 1910 H= 477:30 +CPU= 21.383
  13:08:24 STEP 1911 H= 477:45 +CPU= 21.689
  13:08:56 STEP 1912 H= 478:00 +CPU= 21.709
  13:09:30 STEP 1913 H= 478:15 +CPU= 22.033
  13:10:03 STEP 1914 H= 478:30 +CPU= 21.659
  13:10:35 STEP 1915 H= 478:45 +CPU= 22.063
  13:11:05 STEP 1916 H= 479:00 +CPU= 22.077
  13:11:35 STEP 1917 H= 479:15 +CPU= 21.492
  13:12:08 STEP 1918 H= 479:30 +CPU= 22.666
  13:12:41 STEP 1919 H= 479:45 +CPU= 21.807
  13:13:21 STEP 1920 H= 480:00 +CPU= 28.020
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.1744948456E-21      I       0.3412763771E-05      I
ICloud fractionI      0.0000000000E+00      I       0.8026671697E-01      I
I  Relat. Hum. I      0.4722750907E+00      I       0.5145726961E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.7671957802E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    300334852 BYTES IN      7 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0085( 3.5%)
 13:13:21 STEP 1920 H= 480:00 +CPU= 28.020
 END CNT3
 NSTEP =  1920 CNT0   000000000  20.176  20.176  27.930   0.722               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        57546/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1   1008    0        0            0    57546 ************   118.0     0.0   117.9     0.0   259.9
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 2082    5536.4    5536.4     17.16      0.00
   9 SPCM     - SPECTRAL COMP.                    1920    1028.9    1028.9      2.94      0.00
  10 SCAN2M - PHYSICS                             1921   15956.5   15956.5     45.64      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                161    1028.1    1028.1      0.25      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 83      40.9      40.9      0.01      0.00
  14 SUINIF                                          1    6728.8    6728.8      0.01      0.00
  17 GRIDFPOS IN CNT4                              161      30.0      30.0      0.01      0.00
  18 SUSPECG                                         1    3846.1    3846.1      0.01      0.00
  19 SUSPEC                                          1    3851.3    3851.3      0.01      0.00
  24 SUGRIDU                                         1    2408.5    2408.5      0.00      0.00
  25 SPECRT                                          1     289.3     289.3      0.00      0.00
  26 SUGRIDF                                         1     179.7     179.7      0.00      0.00
  27 RESTART FILES - WRITING                        40    4138.2    4138.2      0.25      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               161       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                               161    7880.0    7880.0      1.89      0.00
  31 POSDDH IN STEPO                                 9       0.7       0.7      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1921    7463.7    7463.7     21.35      0.00
  39 SU0YOMB                                         1     465.3     465.3      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1921      38.2      38.2      0.11      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1920     641.3     641.3      1.83      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1920     171.2     171.2      0.49      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 83       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     4165     518.7     518.7      3.22      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      4006     314.2     314.2      1.87      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       4006     134.7     134.7      0.80      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      4165     201.8     201.8      1.25      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      57.6      57.6      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           4165      81.3      81.3      0.50      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           4006      40.4      40.4      0.24      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           4165      70.5      70.5      0.44      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           4006      31.6      31.6      0.19      0.00
 400 GSTATS                                     223224       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                207696       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    67156.5 CPU TIME   40425.6 VECTOR TIME    40425.6


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       25.7
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /home/amar/slots/1/ICMGGh7zg+001920
Moving to projects directory: /home/amar/slots/1/ICMSHh7zg+001920
Moving to projects directory: /home/amar/slots/1/ICMUAh7zg+001920
Adding to the zip: /home/amar/slots/1/NODE.001_01
Adding to the zip: /home/amar/slots/1/ifs.stat
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001872
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001872
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001860
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001872
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001908
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001860
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001884
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001836
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001896
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001848
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001824
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001824
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001908
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001848
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001920
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001824
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001848
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001884
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001884
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001920
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001836
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001896
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001896
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMGGh7zg+001860
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMSHh7zg+001908
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001920
Adding to the zip: /home/amar/projects/climateprediction.net/oifs_43r3_bl_12290547/ICMUAh7zg+001836
Zipping up the final file: /home/amar/projects/climateprediction.net/oifs_43r3_bl_a1po_2016092300_20_1018_12290547_0_r2001001278_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
13:16:52 (237280): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
13 Jun 2024 19:08:59 1542649 22444144 oifs_43r3_bl_a1po_2016092300_20_1018_12290547_0 1,727,100 40,425 0.0234
13 Jun 2024 14:22:58 1542649 22444144 oifs_43r3_bl_a1po_2016092300_20_1018_12290547_0 864,000 19,841 0.0230


©2024 cpdn.org