climateprediction.net home page
Task 22506770

Task 22506770

Name oifs_43r3_bl_a0c9_2016092300_20_1018_12288768_2
Workunit 12288768
Created 15 Aug 2024, 13:39:54 UTC
Sent 15 Aug 2024, 13:41:56 UTC
Report deadline 14 Oct 2024, 13:41:56 UTC
Received 24 Aug 2024, 12:14:38 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1532165
Run time 10 hours 34 min 42 sec
CPU time 10 hours 33 min 24 sec
Validate state Valid
Credit 2,638.30
Device peak FLOPS 3.22 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,003.27 MB
Peak swap size 5,981.06 MB
Peak disk usage 1,283.13 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
1:09 STEP 1407 H= 351:45 +CPU= 19.030
  21:31:29 STEP 1408 H= 352:00 +CPU= 19.499
  21:31:48 STEP 1409 H= 352:15 +CPU= 19.063
  21:32:07 STEP 1410 H= 352:30 +CPU= 19.029
  21:32:26 STEP 1411 H= 352:45 +CPU= 19.047
  21:32:46 STEP 1412 H= 353:00 +CPU= 19.538
  21:33:05 STEP 1413 H= 353:15 +CPU= 19.095
  21:33:24 STEP 1414 H= 353:30 +CPU= 19.067
  21:33:43 STEP 1415 H= 353:45 +CPU= 19.054
  21:34:06 STEP 1416 H= 354:00 +CPU= 23.708
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001416
  21:34:25 STEP 1417 H= 354:15 +CPU= 19.052
  21:34:45 STEP 1418 H= 354:30 +CPU= 19.042
  21:35:04 STEP 1419 H= 354:45 +CPU= 19.169
  21:35:24 STEP 1420 H= 355:00 +CPU= 19.828
  21:35:43 STEP 1421 H= 355:15 +CPU= 19.117
  21:36:02 STEP 1422 H= 355:30 +CPU= 19.039
  21:36:21 STEP 1423 H= 355:45 +CPU= 19.051
  21:36:41 STEP 1424 H= 356:00 +CPU= 19.856
  21:37:00 STEP 1425 H= 356:15 +CPU= 19.414
  21:37:19 STEP 1426 H= 356:30 +CPU= 19.448
  21:37:39 STEP 1427 H= 356:45 +CPU= 19.441
  21:38:03 STEP 1428 H= 357:00 +CPU= 24.119
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001428
  21:38:22 STEP 1429 H= 357:15 +CPU= 19.433
  21:38:42 STEP 1430 H= 357:30 +CPU= 19.350
  21:39:01 STEP 1431 H= 357:45 +CPU= 19.033
  21:39:20 STEP 1432 H= 358:00 +CPU= 19.592
  21:39:40 STEP 1433 H= 358:15 +CPU= 19.135
  21:39:59 STEP 1434 H= 358:30 +CPU= 19.038
  21:40:19 STEP 1435 H= 358:45 +CPU= 20.280
  21:40:39 STEP 1436 H= 359:00 +CPU= 20.417
  21:40:58 STEP 1437 H= 359:15 +CPU= 19.088
  21:41:17 STEP 1438 H= 359:30 +CPU= 19.053
  21:41:37 STEP 1439 H= 359:45 +CPU= 19.065
  21:42:09 STEP 1440 H= 360:00 +CPU= 26.161
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001428
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a0c9_2016092300_20_1018_12288768_2_r1110180154_14.zip
Uploading the intermediate file: upload_file_14.zip
  21:42:28 STEP 1441 H= 360:15 +CPU= 19.279
  21:42:47 STEP 1442 H= 360:30 +CPU= 19.395
  21:43:07 STEP 1443 H= 360:45 +CPU= 19.101
  21:43:26 STEP 1444 H= 361:00 +CPU= 19.913
  21:43:46 STEP 1445 H= 361:15 +CPU= 19.228
  21:44:05 STEP 1446 H= 361:30 +CPU= 19.061
  21:44:24 STEP 1447 H= 361:45 +CPU= 19.090
  21:44:44 STEP 1448 H= 362:00 +CPU= 19.670
  21:45:03 STEP 1449 H= 362:15 +CPU= 19.232
  21:45:23 STEP 1450 H= 362:30 +CPU= 19.929
  21:45:42 STEP 1451 H= 362:45 +CPU= 19.225
  21:46:07 STEP 1452 H= 363:00 +CPU= 24.200
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001452
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001452
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001452
  21:46:26 STEP 1453 H= 363:15 +CPU= 19.864
  21:46:46 STEP 1454 H= 363:30 +CPU= 19.906
  21:47:06 STEP 1455 H= 363:45 +CPU= 19.872
  21:47:26 STEP 1456 H= 364:00 +CPU= 20.067
  21:47:46 STEP 1457 H= 364:15 +CPU= 19.502
  21:48:05 STEP 1458 H= 364:30 +CPU= 19.595
  21:48:25 STEP 1459 H= 364:45 +CPU= 19.678
  21:48:45 STEP 1460 H= 365:00 +CPU= 19.957
  21:49:05 STEP 1461 H= 365:15 +CPU= 19.479
  21:49:24 STEP 1462 H= 365:30 +CPU= 19.471
  21:49:43 STEP 1463 H= 365:45 +CPU= 19.434
  21:50:08 STEP 1464 H= 366:00 +CPU= 24.508
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001464
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001464
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001464
  21:50:28 STEP 1465 H= 366:15 +CPU= 19.746
  21:50:47 STEP 1466 H= 366:30 +CPU= 19.466
  21:51:06 STEP 1467 H= 366:45 +CPU= 19.157
  21:51:26 STEP 1468 H= 367:00 +CPU= 19.549
  21:51:45 STEP 1469 H= 367:15 +CPU= 19.100
  21:52:04 STEP 1470 H= 367:30 +CPU= 19.090
  21:52:23 STEP 1471 H= 367:45 +CPU= 19.144
  21:52:43 STEP 1472 H= 368:00 +CPU= 19.918
  21:53:03 STEP 1473 H= 368:15 +CPU= 19.424
  21:53:22 STEP 1474 H= 368:30 +CPU= 19.088
  21:53:41 STEP 1475 H= 368:45 +CPU= 19.116
  21:54:05 STEP 1476 H= 369:00 +CPU= 24.049
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001476
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001476
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001476
  21:54:24 STEP 1477 H= 369:15 +CPU= 19.589
  21:54:44 STEP 1478 H= 369:30 +CPU= 19.687
  21:55:04 STEP 1479 H= 369:45 +CPU= 19.581
  21:55:24 STEP 1480 H= 370:00 +CPU= 20.609
  21:55:44 STEP 1481 H= 370:15 +CPU= 19.520
  21:56:03 STEP 1482 H= 370:30 +CPU= 19.051
  21:56:22 STEP 1483 H= 370:45 +CPU= 19.064
  21:56:41 STEP 1484 H= 371:00 +CPU= 19.545
  21:57:01 STEP 1485 H= 371:15 +CPU= 19.352
  21:57:20 STEP 1486 H= 371:30 +CPU= 19.456
  21:57:40 STEP 1487 H= 371:45 +CPU= 19.435
  21:58:06 STEP 1488 H= 372:00 +CPU= 26.706
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001488
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001488
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001488
  21:58:26 STEP 1489 H= 372:15 +CPU= 19.576
  21:58:45 STEP 1490 H= 372:30 +CPU= 19.448
  21:59:05 STEP 1491 H= 372:45 +CPU= 19.420
  21:59:25 STEP 1492 H= 373:00 +CPU= 19.817
  21:59:44 STEP 1493 H= 373:15 +CPU= 19.081
  22:00:03 STEP 1494 H= 373:30 +CPU= 19.148
  22:00:22 STEP 1495 H= 373:45 +CPU= 19.382
  22:00:42 STEP 1496 H= 374:00 +CPU= 19.698
  22:01:01 STEP 1497 H= 374:15 +CPU= 19.057
  22:01:20 STEP 1498 H= 374:30 +CPU= 19.104
  22:01:39 STEP 1499 H= 374:45 +CPU= 19.056
  22:02:03 STEP 1500 H= 375:00 +CPU= 23.760
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001500
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001500
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001500
  22:02:22 STEP 1501 H= 375:15 +CPU= 19.041
  22:02:41 STEP 1502 H= 375:30 +CPU= 19.059
  22:03:00 STEP 1503 H= 375:45 +CPU= 19.045
  22:03:20 STEP 1504 H= 376:00 +CPU= 19.518
  22:03:39 STEP 1505 H= 376:15 +CPU= 19.073
  22:03:58 STEP 1506 H= 376:30 +CPU= 19.102
  22:04:17 STEP 1507 H= 376:45 +CPU= 19.054
  22:04:37 STEP 1508 H= 377:00 +CPU= 19.869
  22:04:56 STEP 1509 H= 377:15 +CPU= 19.321
  22:05:16 STEP 1510 H= 377:30 +CPU= 19.867
  22:05:35 STEP 1511 H= 377:45 +CPU= 19.233
  22:05:59 STEP 1512 H= 378:00 +CPU= 23.676
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001512
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001512
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001512
  22:06:18 STEP 1513 H= 378:15 +CPU= 19.070
  22:06:37 STEP 1514 H= 378:30 +CPU= 19.371
  22:06:57 STEP 1515 H= 378:45 +CPU= 19.417
  22:07:17 STEP 1516 H= 379:00 +CPU= 19.974
  22:07:36 STEP 1517 H= 379:15 +CPU= 19.652
  22:07:56 STEP 1518 H= 379:30 +CPU= 20.049
  22:08:16 STEP 1519 H= 379:45 +CPU= 19.965
  22:08:37 STEP 1520 H= 380:00 +CPU= 20.407
  22:08:56 STEP 1521 H= 380:15 +CPU= 19.734
  22:09:16 STEP 1522 H= 380:30 +CPU= 19.590
  22:09:36 STEP 1523 H= 380:45 +CPU= 19.782
  22:10:01 STEP 1524 H= 381:00 +CPU= 24.296
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001524
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001524
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001524
  22:10:21 STEP 1525 H= 381:15 +CPU= 19.846
  22:10:41 STEP 1526 H= 381:30 +CPU= 19.720
  22:11:00 STEP 1527 H= 381:45 +CPU= 19.421
  22:11:20 STEP 1528 H= 382:00 +CPU= 19.902
  22:11:39 STEP 1529 H= 382:15 +CPU= 19.121
  22:11:58 STEP 1530 H= 382:30 +CPU= 19.062
  22:12:18 STEP 1531 H= 382:45 +CPU= 19.530
  22:12:38 STEP 1532 H= 383:00 +CPU= 20.456
  22:12:58 STEP 1533 H= 383:15 +CPU= 20.063
  22:13:18 STEP 1534 H= 383:30 +CPU= 20.108
  22:13:38 STEP 1535 H= 383:45 +CPU= 19.718
  22:14:05 STEP 1536 H= 384:00 +CPU= 26.791
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001536
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001536
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001452
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001452
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001452
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001464
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001464
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001464
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001476
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001476
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001476
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001488
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001488
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001488
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001500
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001500
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001500
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001512
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001512
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001512
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001524
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001524
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001524
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a0c9_2016092300_20_1018_12288768_2_r1110180154_15.zip
Uploading the intermediate file: upload_file_15.zip
  22:14:25 STEP 1537 H= 384:15 +CPU= 19.514
  22:14:44 STEP 1538 H= 384:30 +CPU= 19.108
  22:15:03 STEP 1539 H= 384:45 +CPU= 19.709
  22:15:24 STEP 1540 H= 385:00 +CPU= 20.194
  22:15:43 STEP 1541 H= 385:15 +CPU= 19.187
  22:16:02 STEP 1542 H= 385:30 +CPU= 19.083
  22:16:21 STEP 1543 H= 385:45 +CPU= 19.406
  22:16:41 STEP 1544 H= 386:00 +CPU= 19.879
  22:17:00 STEP 1545 H= 386:15 +CPU= 19.259
  22:17:19 STEP 1546 H= 386:30 +CPU= 19.037
  22:17:39 STEP 1547 H= 386:45 +CPU= 19.181
  22:18:03 STEP 1548 H= 387:00 +CPU= 24.115
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001548
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001548
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001548
  22:18:22 STEP 1549 H= 387:15 +CPU= 19.397
  22:18:42 STEP 1550 H= 387:30 +CPU= 19.431
  22:19:01 STEP 1551 H= 387:45 +CPU= 19.459
  22:19:21 STEP 1552 H= 388:00 +CPU= 19.930
  22:19:40 STEP 1553 H= 388:15 +CPU= 19.192
  22:19:59 STEP 1554 H= 388:30 +CPU= 19.068
  22:20:19 STEP 1555 H= 388:45 +CPU= 19.670
  22:20:39 STEP 1556 H= 389:00 +CPU= 19.846
  22:20:58 STEP 1557 H= 389:15 +CPU= 19.060
  22:21:17 STEP 1558 H= 389:30 +CPU= 19.081
  22:21:36 STEP 1559 H= 389:45 +CPU= 19.090
  22:22:00 STEP 1560 H= 390:00 +CPU= 24.091
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001560
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001560
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001560
  22:22:20 STEP 1561 H= 390:15 +CPU= 19.704
  22:22:40 STEP 1562 H= 390:30 +CPU= 19.783
  22:22:59 STEP 1563 H= 390:45 +CPU= 19.628
  22:23:19 STEP 1564 H= 391:00 +CPU= 19.691
  22:23:38 STEP 1565 H= 391:15 +CPU= 19.474
  22:23:58 STEP 1566 H= 391:30 +CPU= 19.364
  22:24:17 STEP 1567 H= 391:45 +CPU= 19.623
  22:24:38 STEP 1568 H= 392:00 +CPU= 20.472
  22:24:58 STEP 1569 H= 392:15 +CPU= 19.945
  22:25:18 STEP 1570 H= 392:30 +CPU= 20.128
  22:25:37 STEP 1571 H= 392:45 +CPU= 19.586
  22:26:02 STEP 1572 H= 393:00 +CPU= 24.139
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001572
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001572
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001572
  22:26:21 STEP 1573 H= 393:15 +CPU= 19.085
  22:26:40 STEP 1574 H= 393:30 +CPU= 19.066
  22:26:59 STEP 1575 H= 393:45 +CPU= 19.113
  22:27:18 STEP 1576 H= 394:00 +CPU= 19.538
  22:27:37 STEP 1577 H= 394:15 +CPU= 19.061
  22:27:57 STEP 1578 H= 394:30 +CPU= 19.237
  22:28:16 STEP 1579 H= 394:45 +CPU= 19.625
  22:28:37 STEP 1580 H= 395:00 +CPU= 20.202
  22:28:56 STEP 1581 H= 395:15 +CPU= 19.871
  22:29:16 STEP 1582 H= 395:30 +CPU= 19.729
  22:29:36 STEP 1583 H= 395:45 +CPU= 19.679
  22:30:03 STEP 1584 H= 396:00 +CPU= 26.609
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001584
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001584
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001584
  22:30:22 STEP 1585 H= 396:15 +CPU= 19.366
  22:30:41 STEP 1586 H= 396:30 +CPU= 19.455
  22:31:01 STEP 1587 H= 396:45 +CPU= 19.647
  22:31:21 STEP 1588 H= 397:00 +CPU= 20.242
  22:31:41 STEP 1589 H= 397:15 +CPU= 19.715
  22:32:01 STEP 1590 H= 397:30 +CPU= 19.495
  22:32:20 STEP 1591 H= 397:45 +CPU= 19.289
  22:32:39 STEP 1592 H= 398:00 +CPU= 19.571
  22:32:58 STEP 1593 H= 398:15 +CPU= 19.050
  22:33:18 STEP 1594 H= 398:30 +CPU= 19.061
  22:33:37 STEP 1595 H= 398:45 +CPU= 19.090
  22:34:00 STEP 1596 H= 399:00 +CPU= 23.734
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001596
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001596
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001596
  22:34:19 STEP 1597 H= 399:15 +CPU= 19.129
  22:34:39 STEP 1598 H= 399:30 +CPU= 19.117
  22:34:58 STEP 1599 H= 399:45 +CPU= 19.121
  22:35:18 STEP 1600 H= 400:00 +CPU= 20.289
  22:35:37 STEP 1601 H= 400:15 +CPU= 19.315
  22:35:56 STEP 1602 H= 400:30 +CPU= 19.102
  22:36:15 STEP 1603 H= 400:45 +CPU= 19.052
  22:36:35 STEP 1604 H= 401:00 +CPU= 19.751
  22:36:55 STEP 1605 H= 401:15 +CPU= 19.427
  22:37:14 STEP 1606 H= 401:30 +CPU= 19.424
  22:37:33 STEP 1607 H= 401:45 +CPU= 19.080
  22:37:57 STEP 1608 H= 402:00 +CPU= 23.747
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001608
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001608
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001608
  22:38:16 STEP 1609 H= 402:15 +CPU= 19.111
  22:38:35 STEP 1610 H= 402:30 +CPU= 19.403
  22:38:55 STEP 1611 H= 402:45 +CPU= 19.667
  22:39:15 STEP 1612 H= 403:00 +CPU= 19.917
  22:39:34 STEP 1613 H= 403:15 +CPU= 19.391
  22:39:54 STEP 1614 H= 403:30 +CPU= 19.415
  22:40:14 STEP 1615 H= 403:45 +CPU= 20.569
  22:40:36 STEP 1616 H= 404:00 +CPU= 21.397
  22:40:56 STEP 1617 H= 404:15 +CPU= 20.092
  22:41:15 STEP 1618 H= 404:30 +CPU= 19.158
  22:41:34 STEP 1619 H= 404:45 +CPU= 19.026
  22:41:58 STEP 1620 H= 405:00 +CPU= 23.967
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001620
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001620
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001620
  22:42:18 STEP 1621 H= 405:15 +CPU= 19.464
  22:42:37 STEP 1622 H= 405:30 +CPU= 19.432
  22:42:56 STEP 1623 H= 405:45 +CPU= 19.358
  22:43:16 STEP 1624 H= 406:00 +CPU= 19.542
  22:43:35 STEP 1625 H= 406:15 +CPU= 19.247
  22:43:55 STEP 1626 H= 406:30 +CPU= 19.496
  22:44:14 STEP 1627 H= 406:45 +CPU= 19.631
  22:44:34 STEP 1628 H= 407:00 +CPU= 20.253
  22:44:54 STEP 1629 H= 407:15 +CPU= 19.623
  22:45:14 STEP 1630 H= 407:30 +CPU= 20.089
  22:45:34 STEP 1631 H= 407:45 +CPU= 19.330
  22:46:00 STEP 1632 H= 408:00 +CPU= 26.487
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001632
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001632
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001548
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001548
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001548
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001560
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001560
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001560
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001572
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001572
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001572
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001584
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001584
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001584
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001596
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001596
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001596
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001608
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001608
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001608
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001620
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001620
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001620
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a0c9_2016092300_20_1018_12288768_2_r1110180154_16.zip
Uploading the intermediate file: upload_file_16.zip
  22:46:20 STEP 1633 H= 408:15 +CPU= 19.669
  22:46:40 STEP 1634 H= 408:30 +CPU= 20.095
  22:47:00 STEP 1635 H= 408:45 +CPU= 20.075
  22:47:21 STEP 1636 H= 409:00 +CPU= 20.669
  22:47:41 STEP 1637 H= 409:15 +CPU= 20.272
  22:48:02 STEP 1638 H= 409:30 +CPU= 20.275
  22:48:21 STEP 1639 H= 409:45 +CPU= 19.973
  22:48:42 STEP 1640 H= 410:00 +CPU= 20.401
  22:49:02 STEP 1641 H= 410:15 +CPU= 19.809
  22:49:22 STEP 1642 H= 410:30 +CPU= 20.027
  22:49:42 STEP 1643 H= 410:45 +CPU= 20.126
  22:50:07 STEP 1644 H= 411:00 +CPU= 24.939
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001644
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001644
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001644
  22:50:27 STEP 1645 H= 411:15 +CPU= 20.132
  22:50:47 STEP 1646 H= 411:30 +CPU= 20.005
  22:51:07 STEP 1647 H= 411:45 +CPU= 19.945
  22:51:27 STEP 1648 H= 412:00 +CPU= 20.486
  22:51:48 STEP 1649 H= 412:15 +CPU= 20.235
  22:52:08 STEP 1650 H= 412:30 +CPU= 20.138
  22:52:28 STEP 1651 H= 412:45 +CPU= 20.393
  22:52:49 STEP 1652 H= 413:00 +CPU= 21.305
  22:53:10 STEP 1653 H= 413:15 +CPU= 20.247
  22:53:30 STEP 1654 H= 413:30 +CPU= 20.323
  22:53:50 STEP 1655 H= 413:45 +CPU= 20.312
  22:54:15 STEP 1656 H= 414:00 +CPU= 25.014
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001656
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001656
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001656
  22:54:36 STEP 1657 H= 414:15 +CPU= 20.250
  22:54:56 STEP 1658 H= 414:30 +CPU= 20.212
  22:55:17 STEP 1659 H= 414:45 +CPU= 20.760
  22:55:37 STEP 1660 H= 415:00 +CPU= 20.675
  22:55:57 STEP 1661 H= 415:15 +CPU= 20.181
  22:56:18 STEP 1662 H= 415:30 +CPU= 20.363
  22:56:38 STEP 1663 H= 415:45 +CPU= 20.203
  22:56:59 STEP 1664 H= 416:00 +CPU= 20.806
  22:57:19 STEP 1665 H= 416:15 +CPU= 20.212
  22:57:39 STEP 1666 H= 416:30 +CPU= 19.947
  22:57:59 STEP 1667 H= 416:45 +CPU= 20.156
  22:58:24 STEP 1668 H= 417:00 +CPU= 25.079
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001668
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001668
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001668
  22:58:44 STEP 1669 H= 417:15 +CPU= 20.159
  22:59:04 STEP 1670 H= 417:30 +CPU= 19.894
  22:59:24 STEP 1671 H= 417:45 +CPU= 19.903
  22:59:45 STEP 1672 H= 418:00 +CPU= 20.496
  23:00:05 STEP 1673 H= 418:15 +CPU= 20.173
  23:00:25 STEP 1674 H= 418:30 +CPU= 20.303
  23:00:45 STEP 1675 H= 418:45 +CPU= 19.975
  23:01:05 STEP 1676 H= 419:00 +CPU= 20.351
  23:01:26 STEP 1677 H= 419:15 +CPU= 20.039
  23:01:46 STEP 1678 H= 419:30 +CPU= 20.299
  23:02:06 STEP 1679 H= 419:45 +CPU= 20.368
  23:02:36 STEP 1680 H= 420:00 +CPU= 27.755
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001680
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001680
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001680
  23:02:56 STEP 1681 H= 420:15 +CPU= 20.565
  23:03:17 STEP 1682 H= 420:30 +CPU= 20.353
  23:03:37 STEP 1683 H= 420:45 +CPU= 20.385
  23:03:58 STEP 1684 H= 421:00 +CPU= 21.051
  23:04:19 STEP 1685 H= 421:15 +CPU= 20.471
  23:04:39 STEP 1686 H= 421:30 +CPU= 20.213
  23:04:59 STEP 1687 H= 421:45 +CPU= 19.776
  23:05:19 STEP 1688 H= 422:00 +CPU= 20.791
  23:05:39 STEP 1689 H= 422:15 +CPU= 19.931
  23:05:59 STEP 1690 H= 422:30 +CPU= 19.740
  23:06:19 STEP 1691 H= 422:45 +CPU= 19.699
  23:06:43 STEP 1692 H= 423:00 +CPU= 24.038
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001692
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001692
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001692
  23:07:02 STEP 1693 H= 423:15 +CPU= 19.318
  23:07:22 STEP 1694 H= 423:30 +CPU= 19.787
  23:07:42 STEP 1695 H= 423:45 +CPU= 19.961
  23:08:02 STEP 1696 H= 424:00 +CPU= 20.399
  23:08:22 STEP 1697 H= 424:15 +CPU= 19.519
  23:08:42 STEP 1698 H= 424:30 +CPU= 19.779
  23:09:01 STEP 1699 H= 424:45 +CPU= 19.676
  23:09:21 STEP 1700 H= 425:00 +CPU= 20.161
  23:09:41 STEP 1701 H= 425:15 +CPU= 19.481
  23:10:00 STEP 1702 H= 425:30 +CPU= 19.507
  23:10:20 STEP 1703 H= 425:45 +CPU= 19.979
  23:10:46 STEP 1704 H= 426:00 +CPU= 25.128
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001704
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001704
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001704
  23:11:06 STEP 1705 H= 426:15 +CPU= 20.277
  23:11:26 STEP 1706 H= 426:30 +CPU= 20.302
  23:11:46 STEP 1707 H= 426:45 +CPU= 20.071
  23:12:07 STEP 1708 H= 427:00 +CPU= 20.558
  23:12:27 STEP 1709 H= 427:15 +CPU= 20.146
  23:12:47 STEP 1710 H= 427:30 +CPU= 20.042
  23:13:07 STEP 1711 H= 427:45 +CPU= 19.900
  23:13:27 STEP 1712 H= 428:00 +CPU= 20.400
  23:13:47 STEP 1713 H= 428:15 +CPU= 19.720
  23:14:07 STEP 1714 H= 428:30 +CPU= 19.630
  23:14:27 STEP 1715 H= 428:45 +CPU= 19.752
  23:14:51 STEP 1716 H= 429:00 +CPU= 24.548
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001716
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001716
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001716
  23:15:11 STEP 1717 H= 429:15 +CPU= 20.193
  23:15:31 STEP 1718 H= 429:30 +CPU= 19.466
  23:15:50 STEP 1719 H= 429:45 +CPU= 19.576
  23:16:12 STEP 1720 H= 430:00 +CPU= 20.569
  23:16:32 STEP 1721 H= 430:15 +CPU= 20.121
  23:16:51 STEP 1722 H= 430:30 +CPU= 19.834
  23:17:11 STEP 1723 H= 430:45 +CPU= 19.750
  23:17:31 STEP 1724 H= 431:00 +CPU= 20.245
  23:17:51 STEP 1725 H= 431:15 +CPU= 19.086
  23:18:10 STEP 1726 H= 431:30 +CPU= 19.083
  23:18:29 STEP 1727 H= 431:45 +CPU= 19.097
  23:18:57 STEP 1728 H= 432:00 +CPU= 26.645
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001728
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001728
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001644
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001644
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001644
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001668
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001668
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001668
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001692
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001692
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001692
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001716
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001716
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001716
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a0c9_2016092300_20_1018_12288768_2_r1110180154_17.zip
Uploading the intermediate file: upload_file_17.zip
  23:19:17 STEP 1729 H= 432:15 +CPU= 19.617
  23:19:36 STEP 1730 H= 432:30 +CPU= 19.071
  23:19:55 STEP 1731 H= 432:45 +CPU= 19.173
  23:20:15 STEP 1732 H= 433:00 +CPU= 19.883
  23:20:34 STEP 1733 H= 433:15 +CPU= 19.265
  23:20:54 STEP 1734 H= 433:30 +CPU= 19.331
  23:21:13 STEP 1735 H= 433:45 +CPU= 19.589
  23:21:34 STEP 1736 H= 434:00 +CPU= 20.171
  23:21:53 STEP 1737 H= 434:15 +CPU= 19.509
  23:22:13 STEP 1738 H= 434:30 +CPU= 19.650
  23:22:32 STEP 1739 H= 434:45 +CPU= 19.705
  23:22:57 STEP 1740 H= 435:00 +CPU= 24.330
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001740
  23:23:16 STEP 1741 H= 435:15 +CPU= 19.436
  23:23:36 STEP 1742 H= 435:30 +CPU= 19.370
  23:23:55 STEP 1743 H= 435:45 +CPU= 19.043
  23:24:14 STEP 1744 H= 436:00 +CPU= 19.475
  23:24:33 STEP 1745 H= 436:15 +CPU= 19.024
  23:24:52 STEP 1746 H= 436:30 +CPU= 19.080
  23:25:13 STEP 1747 H= 436:45 +CPU= 20.493
  23:25:33 STEP 1748 H= 437:00 +CPU= 20.774
  23:25:53 STEP 1749 H= 437:15 +CPU= 20.001
  23:26:13 STEP 1750 H= 437:30 +CPU= 19.950
  23:26:33 STEP 1751 H= 437:45 +CPU= 19.830
  23:26:58 STEP 1752 H= 438:00 +CPU= 24.484
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001752
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001752
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001752
  23:27:17 STEP 1753 H= 438:15 +CPU= 19.121
  23:27:36 STEP 1754 H= 438:30 +CPU= 19.097
  23:27:55 STEP 1755 H= 438:45 +CPU= 19.086
  23:28:15 STEP 1756 H= 439:00 +CPU= 19.536
  23:28:34 STEP 1757 H= 439:15 +CPU= 19.109
  23:28:53 STEP 1758 H= 439:30 +CPU= 19.278
  23:29:13 STEP 1759 H= 439:45 +CPU= 19.719
  23:29:33 STEP 1760 H= 440:00 +CPU= 20.320
  23:29:53 STEP 1761 H= 440:15 +CPU= 19.635
  23:30:13 STEP 1762 H= 440:30 +CPU= 19.711
  23:30:32 STEP 1763 H= 440:45 +CPU= 19.332
  23:30:56 STEP 1764 H= 441:00 +CPU= 23.706
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001764
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001764
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001764
  23:31:15 STEP 1765 H= 441:15 +CPU= 19.010
  23:31:34 STEP 1766 H= 441:30 +CPU= 19.067
  23:31:53 STEP 1767 H= 441:45 +CPU= 19.091
  23:32:12 STEP 1768 H= 442:00 +CPU= 19.526
  23:32:31 STEP 1769 H= 442:15 +CPU= 19.072
  23:32:51 STEP 1770 H= 442:30 +CPU= 19.416
  23:33:10 STEP 1771 H= 442:45 +CPU= 19.406
  23:33:30 STEP 1772 H= 443:00 +CPU= 19.774
  23:33:49 STEP 1773 H= 443:15 +CPU= 19.120
  23:34:09 STEP 1774 H= 443:30 +CPU= 19.581
  23:34:28 STEP 1775 H= 443:45 +CPU= 19.700
  23:34:55 STEP 1776 H= 444:00 +CPU= 26.440
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001776
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001776
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001776
  23:35:15 STEP 1777 H= 444:15 +CPU= 20.095
  23:35:34 STEP 1778 H= 444:30 +CPU= 19.225
  23:35:53 STEP 1779 H= 444:45 +CPU= 19.035
  23:36:13 STEP 1780 H= 445:00 +CPU= 19.473
  23:36:32 STEP 1781 H= 445:15 +CPU= 19.192
  23:36:51 STEP 1782 H= 445:30 +CPU= 19.399
  23:37:11 STEP 1783 H= 445:45 +CPU= 19.584
  23:37:31 STEP 1784 H= 446:00 +CPU= 20.253
  23:37:51 STEP 1785 H= 446:15 +CPU= 19.751
  23:38:11 STEP 1786 H= 446:30 +CPU= 19.686
  23:38:30 STEP 1787 H= 446:45 +CPU= 19.456
  23:38:54 STEP 1788 H= 447:00 +CPU= 24.174
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001788
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001788
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001788
  23:39:14 STEP 1789 H= 447:15 +CPU= 19.393
  23:39:33 STEP 1790 H= 447:30 +CPU= 19.644
  23:39:53 STEP 1791 H= 447:45 +CPU= 19.953
  23:40:14 STEP 1792 H= 448:00 +CPU= 21.136
  23:40:35 STEP 1793 H= 448:15 +CPU= 20.679
  23:40:55 STEP 1794 H= 448:30 +CPU= 19.622
  23:41:14 STEP 1795 H= 448:45 +CPU= 19.708
  23:41:34 STEP 1796 H= 449:00 +CPU= 19.682
  23:41:53 STEP 1797 H= 449:15 +CPU= 19.103
  23:42:12 STEP 1798 H= 449:30 +CPU= 19.052
  23:42:31 STEP 1799 H= 449:45 +CPU= 19.074
  23:42:55 STEP 1800 H= 450:00 +CPU= 23.776
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001800
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001800
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001800
  23:43:14 STEP 1801 H= 450:15 +CPU= 19.074
  23:43:33 STEP 1802 H= 450:30 +CPU= 19.096
  23:43:52 STEP 1803 H= 450:45 +CPU= 19.103
  23:44:12 STEP 1804 H= 451:00 +CPU= 19.607
  23:44:31 STEP 1805 H= 451:15 +CPU= 19.513
  23:44:51 STEP 1806 H= 451:30 +CPU= 19.517
  23:45:11 STEP 1807 H= 451:45 +CPU= 20.161
  23:45:31 STEP 1808 H= 452:00 +CPU= 20.033
  23:45:50 STEP 1809 H= 452:15 +CPU= 19.190
  23:46:10 STEP 1810 H= 452:30 +CPU= 19.139
  23:46:29 STEP 1811 H= 452:45 +CPU= 19.038
  23:46:52 STEP 1812 H= 453:00 +CPU= 23.693
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001812
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001812
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001812
  23:47:11 STEP 1813 H= 453:15 +CPU= 19.056
  23:47:31 STEP 1814 H= 453:30 +CPU= 19.232
  23:47:50 STEP 1815 H= 453:45 +CPU= 19.621
  23:48:10 STEP 1816 H= 454:00 +CPU= 20.226
  23:48:30 STEP 1817 H= 454:15 +CPU= 19.408
  23:48:49 STEP 1818 H= 454:30 +CPU= 19.072
  23:49:08 STEP 1819 H= 454:45 +CPU= 19.109
  23:49:28 STEP 1820 H= 455:00 +CPU= 19.794
  23:49:47 STEP 1821 H= 455:15 +CPU= 19.427
  23:50:07 STEP 1822 H= 455:30 +CPU= 19.487
  23:50:26 STEP 1823 H= 455:45 +CPU= 19.362
  23:50:52 STEP 1824 H= 456:00 +CPU= 26.342
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001824
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001824
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001740
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001740
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001740
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001764
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001764
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001764
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001788
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001788
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001788
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001812
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001812
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001812
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a0c9_2016092300_20_1018_12288768_2_r1110180154_18.zip
Uploading the intermediate file: upload_file_18.zip
  23:51:12 STEP 1825 H= 456:15 +CPU= 19.579
  23:51:31 STEP 1826 H= 456:30 +CPU= 19.290
  23:51:50 STEP 1827 H= 456:45 +CPU= 19.057
  23:52:10 STEP 1828 H= 457:00 +CPU= 19.515
  23:52:29 STEP 1829 H= 457:15 +CPU= 19.300
  23:52:49 STEP 1830 H= 457:30 +CPU= 19.481
  23:53:08 STEP 1831 H= 457:45 +CPU= 19.779
  23:53:29 STEP 1832 H= 458:00 +CPU= 20.338
  23:53:49 STEP 1833 H= 458:15 +CPU= 19.882
  23:54:09 STEP 1834 H= 458:30 +CPU= 20.039
  23:54:29 STEP 1835 H= 458:45 +CPU= 19.883
  23:54:53 STEP 1836 H= 459:00 +CPU= 24.564
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001836
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001836
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001836
  23:55:14 STEP 1837 H= 459:15 +CPU= 20.406
  23:55:34 STEP 1838 H= 459:30 +CPU= 20.191
  23:55:54 STEP 1839 H= 459:45 +CPU= 19.996
  23:56:14 STEP 1840 H= 460:00 +CPU= 20.100
  23:56:33 STEP 1841 H= 460:15 +CPU= 19.034
  23:56:52 STEP 1842 H= 460:30 +CPU= 19.073
  23:57:11 STEP 1843 H= 460:45 +CPU= 19.043
  23:57:31 STEP 1844 H= 461:00 +CPU= 19.554
  23:57:50 STEP 1845 H= 461:15 +CPU= 19.043
  23:58:09 STEP 1846 H= 461:30 +CPU= 19.021
  23:58:28 STEP 1847 H= 461:45 +CPU= 19.049
  23:58:52 STEP 1848 H= 462:00 +CPU= 23.840
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001848
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001848
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001848
  23:59:11 STEP 1849 H= 462:15 +CPU= 19.085
  23:59:30 STEP 1850 H= 462:30 +CPU= 19.126
  23:59:49 STEP 1851 H= 462:45 +CPU= 19.114
  00:00:09 STEP 1852 H= 463:00 +CPU= 19.843
  00:00:28 STEP 1853 H= 463:15 +CPU= 19.450
  00:00:48 STEP 1854 H= 463:30 +CPU= 19.151
  00:01:07 STEP 1855 H= 463:45 +CPU= 19.202
  00:01:26 STEP 1856 H= 464:00 +CPU= 19.598
  00:01:45 STEP 1857 H= 464:15 +CPU= 19.089
  00:02:05 STEP 1858 H= 464:30 +CPU= 19.178
  00:02:24 STEP 1859 H= 464:45 +CPU= 19.086
  00:02:47 STEP 1860 H= 465:00 +CPU= 23.801
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001860
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001860
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001860
  00:03:07 STEP 1861 H= 465:15 +CPU= 19.152
  00:03:26 STEP 1862 H= 465:30 +CPU= 19.078
  00:03:45 STEP 1863 H= 465:45 +CPU= 19.059
  00:04:04 STEP 1864 H= 466:00 +CPU= 19.558
  00:04:23 STEP 1865 H= 466:15 +CPU= 19.162
  00:04:43 STEP 1866 H= 466:30 +CPU= 19.289
  00:05:02 STEP 1867 H= 466:45 +CPU= 19.319
  00:05:23 STEP 1868 H= 467:00 +CPU= 20.765
  00:05:42 STEP 1869 H= 467:15 +CPU= 19.561
  00:06:02 STEP 1870 H= 467:30 +CPU= 19.114
  00:06:21 STEP 1871 H= 467:45 +CPU= 19.107
  00:06:47 STEP 1872 H= 468:00 +CPU= 26.202
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001872
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001872
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001872
  00:07:06 STEP 1873 H= 468:15 +CPU= 19.109
  00:07:25 STEP 1874 H= 468:30 +CPU= 19.106
  00:07:44 STEP 1875 H= 468:45 +CPU= 19.056
  00:08:04 STEP 1876 H= 469:00 +CPU= 19.586
  00:08:23 STEP 1877 H= 469:15 +CPU= 19.112
  00:08:42 STEP 1878 H= 469:30 +CPU= 19.071
  00:09:01 STEP 1879 H= 469:45 +CPU= 19.074
  00:09:21 STEP 1880 H= 470:00 +CPU= 19.571
  00:09:40 STEP 1881 H= 470:15 +CPU= 19.430
  00:10:00 STEP 1882 H= 470:30 +CPU= 19.553
  00:10:19 STEP 1883 H= 470:45 +CPU= 19.457
  00:10:43 STEP 1884 H= 471:00 +CPU= 23.929
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001884
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001884
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001884
  00:11:03 STEP 1885 H= 471:15 +CPU= 19.041
  00:11:22 STEP 1886 H= 471:30 +CPU= 19.054
  00:11:41 STEP 1887 H= 471:45 +CPU= 19.053
  00:12:00 STEP 1888 H= 472:00 +CPU= 19.541
  00:12:19 STEP 1889 H= 472:15 +CPU= 19.039
  00:12:38 STEP 1890 H= 472:30 +CPU= 19.049
  00:12:57 STEP 1891 H= 472:45 +CPU= 19.066
  00:13:17 STEP 1892 H= 473:00 +CPU= 19.555
  00:13:36 STEP 1893 H= 473:15 +CPU= 19.061
  00:13:55 STEP 1894 H= 473:30 +CPU= 19.044
  00:14:14 STEP 1895 H= 473:45 +CPU= 19.032
  00:14:38 STEP 1896 H= 474:00 +CPU= 23.775
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001896
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001896
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001896
  00:14:57 STEP 1897 H= 474:15 +CPU= 19.090
  00:15:17 STEP 1898 H= 474:30 +CPU= 19.781
  00:15:36 STEP 1899 H= 474:45 +CPU= 19.352
  00:15:56 STEP 1900 H= 475:00 +CPU= 19.535
  00:16:15 STEP 1901 H= 475:15 +CPU= 19.031
  00:16:34 STEP 1902 H= 475:30 +CPU= 19.030
  00:16:53 STEP 1903 H= 475:45 +CPU= 19.035
  00:17:12 STEP 1904 H= 476:00 +CPU= 19.483
  00:17:31 STEP 1905 H= 476:15 +CPU= 19.042
  00:17:50 STEP 1906 H= 476:30 +CPU= 19.033
  00:18:09 STEP 1907 H= 476:45 +CPU= 19.038
  00:18:33 STEP 1908 H= 477:00 +CPU= 23.672
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001908
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001908
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001908
  00:18:52 STEP 1909 H= 477:15 +CPU= 19.027
  00:19:11 STEP 1910 H= 477:30 +CPU= 19.033
  00:19:30 STEP 1911 H= 477:45 +CPU= 19.003
  00:19:50 STEP 1912 H= 478:00 +CPU= 19.495
  00:20:09 STEP 1913 H= 478:15 +CPU= 19.309
  00:20:28 STEP 1914 H= 478:30 +CPU= 19.241
  00:20:47 STEP 1915 H= 478:45 +CPU= 19.337
  00:21:07 STEP 1916 H= 479:00 +CPU= 19.912
  00:21:26 STEP 1917 H= 479:15 +CPU= 19.059
  00:21:45 STEP 1918 H= 479:30 +CPU= 19.075
  00:22:05 STEP 1919 H= 479:45 +CPU= 19.067
  00:22:29 STEP 1920 H= 480:00 +CPU= 24.616
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a0c9
(argv4) batchid: 1018
(argv5) wuid: 12288768
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/2
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/2/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/2/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_8a220f2ad51cf82324e5bfda4f40e25d to: /var/lib/boinc/slots/2/oifs_43r3_bl_a0c9_2016092300_20_1018_12288768.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/2/oifs_43r3_bl_a0c9_2016092300_20_1018_12288768.zip
ic_ancil_file: ic_ancil_12288768
ifsdata_file: ifsdata_12288768
climate_data_file: clim_data_12288768
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc/slots/2/ic_ancil_12288768.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/2/ic_ancil_12288768.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_8994c2e48fafeddd04da6dcd9e5c4196 to: /var/lib/boinc/slots/2/ifsdata/ifsdata_12288768.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/2/ifsdata/ifsdata_12288768.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/2/159l_2/clim_data_12288768.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/2/159l_2/clim_data_12288768.zip
Checking for progress XML file: /var/lib/boinc/slots/2/progress_file_12288768.xml
Opened progress file ok : /var/lib/boinc/slots/2/progress_file_12288768.xml
-- Model is restarting --
Adjusting last_iter, 1920, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/2/progress_file_12288768.xml
last_cpu_time: 37986
upload_file_number: 19
last_iter: 1921
last_upload: 1641600
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a0c9_2016092300_20_1018_12288768_2_r1110180154
The child process has been launched with process id: 9398
Executing the command: /var/lib/boinc/slots/2/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:knuth.rechenkraft.net:1:1:9398:9398] [20240824:131303:1724497983:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  13:13:32 STEP 1920 H= 480:00 +CPU= 17.203
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I      I Hor. Flux of PEII     -0.00000 I              I              I              I               I
I      I Vert.Flux of PEII      0.00000 I              I              I              I               I
I      I Work Pres.G.F  II              I      0.04650 I              I              I               I
I      I Conv. Ad.-Int. II     -0.04650 I              I              I              I               I
DDH--------------------------------------------------------------------------------------------------I
I DYN- Horizont. Flux   II      0.01598 I      0.00008 I      0.19597 I      0.00230 I     -0.00015  I
I    I Vertical Flux    II      0.00000 I      0.00000 I      0.00000 I      0.00000 I      0.00000  I
DDH--------------------------------------------------------------------------------------------------I
  
DDH----------------------------------------------------------------------------------------------------------------------------------
  I   - Mass balance    (10**(-6)  KG/M**2) 
  
  I INITIAL      I HORIZ. FLUX  I DYN. FLUX    I DYN. FLUX    I PHYS. FLUX   I PHYS. FLUX   I CURRENT      I I I RESIDUAL     I
  I MASS         I              I TOA          I SURFACE      I TOA          I SURFACE      I MASS         I I I              I
  ---------------------------------------------------------------------------------------------------------- I ----------------
  -              -              -              -              -              -              -              - I -              -
  - 10341776742. I           0. .           0. .           0. .           0. .           0. I 10341858175. - I -       81433. -
  -              -              -              -              -              -              -              - I -              -
  ---------------------------------------------------------------------------------------------------------- I ----------------
 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  480.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.4871266762E-22      I       0.6982156063E-06      I
ICloud fractionI      0.0000000000E+00      I       0.8729613104E-02      I
I  Relat. Hum. I      0.3052416475E+00      I       0.3448741201E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.1421705931E+03      I
DDH------------------------------------------------------------------------
  
 13:13:32 STEP 1920 H= 480:00 +CPU= 17.203
 END CNT3
 NSTEP =  1920 CNT0   000000000  17.088  17.088  17.892   0.955               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN            0/           0
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1      3    0       46      1044068        0            0    10.4    10.4     0.0    10.7     0.0
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1   29534.9   29534.9    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1   18006.6   18006.6     60.97      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                    1    2285.2    2285.2      7.74      0.00
  10 SCAN2M - PHYSICS                                1   10625.4   10625.4     35.98      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                  1      24.1      24.1      0.08      0.00
  28 RESTART FILES - READING                         1   11173.9   11173.9     37.83      0.00
  31 POSDDH IN STEPO                                 1     619.3     619.3      2.10      0.00
  37 CPGLAG   - SL COMPUTATIONS                      1    3322.5    3322.5     11.25      0.00
  39 SU0YOMB                                         1     192.6     192.6      0.65      0.00
  51 SCAN2M   - SL COMM. PART 1                      1      11.2      11.2      0.04      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                  1       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM        4     124.8     124.8      1.69      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM         4      48.4      48.4      0.66      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      27.9      27.9      0.09      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION              4       7.7       7.7      0.10      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION              4      27.3      27.3      0.37      0.00
 400 GSTATS                                       1119       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                   987       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME       29.5 CPU TIME      19.3 VECTOR TIME       19.3


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY    95964.8
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001920
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001920
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc/slots/2/NODE.001_01
Adding to the zip: /var/lib/boinc/slots/2/ifs.stat
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001884
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001860
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001860
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001836
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001884
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001884
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001908
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001908
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001836
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001860
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001908
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMGGh7zg+001836
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288768/ICMSHh7zg+001896
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a0c9_2016092300_20_1018_12288768_2_r1110180154_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1728900
13:17:00 (9378): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
24 Aug 2024 12:15:42 1532165 22506770 oifs_43r3_bl_a0c9_2016092300_20_1018_12288768_2 1,728,900 38,005 0.0220
18 Aug 2024 17:04:20 1532165 22506770 oifs_43r3_bl_a0c9_2016092300_20_1018_12288768_2 864,000 18,877 0.0218


©2024 cpdn.org