climateprediction.net home page
Task 22442367

Task 22442367

Name oifs_43r3_bl_a0d7_2016092300_20_1018_12288802_0
Workunit 12288802
Created 12 Jun 2024, 20:39:51 UTC
Sent 13 Jun 2024, 23:18:17 UTC
Report deadline 12 Aug 2024, 23:18:17 UTC
Received 15 Jun 2024, 19:19:46 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1547562
Run time 12 hours 22 min 57 sec
CPU time 12 hours 22 min 57 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 5.97 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,002.53 MB
Peak swap size 5,981.13 MB
Peak disk usage 1,825.04 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
STEP 1521 H= 380:15 +CPU= 18.203
  22:57:52 STEP 1522 H= 380:30 +CPU= 17.888
  22:58:10 STEP 1523 H= 380:45 +CPU= 17.366
  22:58:44 STEP 1524 H= 381:00 +CPU= 30.864
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001524
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001524
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001524
  22:59:18 STEP 1525 H= 381:15 +CPU= 31.301
  22:59:51 STEP 1526 H= 381:30 +CPU= 30.858
  23:00:17 STEP 1527 H= 381:45 +CPU= 24.369
  23:00:46 STEP 1528 H= 382:00 +CPU= 26.448
  23:01:09 STEP 1529 H= 382:15 +CPU= 22.461
  23:01:29 STEP 1530 H= 382:30 +CPU= 18.835
  23:01:48 STEP 1531 H= 382:45 +CPU= 18.667
  23:02:12 STEP 1532 H= 383:00 +CPU= 22.251
  23:02:35 STEP 1533 H= 383:15 +CPU= 22.211
  23:02:56 STEP 1534 H= 383:30 +CPU= 20.037
  23:03:17 STEP 1535 H= 383:45 +CPU= 20.351
  23:03:47 STEP 1536 H= 384:00 +CPU= 27.776
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001536
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001536
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001524
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0d7_2016092300_20_1018_12288802_0_r1568687900_15.zip
Uploading the intermediate file: upload_file_15.zip
  23:04:07 STEP 1537 H= 384:15 +CPU= 19.640
  23:04:29 STEP 1538 H= 384:30 +CPU= 20.853
  23:04:49 STEP 1539 H= 384:45 +CPU= 18.733
  23:05:08 STEP 1540 H= 385:00 +CPU= 18.978
  23:05:28 STEP 1541 H= 385:15 +CPU= 19.094
  23:05:47 STEP 1542 H= 385:30 +CPU= 18.866
  23:06:06 STEP 1543 H= 385:45 +CPU= 18.419
  23:06:30 STEP 1544 H= 386:00 +CPU= 22.341
  23:06:52 STEP 1545 H= 386:15 +CPU= 21.513
  23:07:13 STEP 1546 H= 386:30 +CPU= 19.911
  23:07:34 STEP 1547 H= 386:45 +CPU= 20.192
  23:08:01 STEP 1548 H= 387:00 +CPU= 25.310
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001548
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001548
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001548
  23:08:25 STEP 1549 H= 387:15 +CPU= 22.835
  23:08:46 STEP 1550 H= 387:30 +CPU= 19.962
  23:09:07 STEP 1551 H= 387:45 +CPU= 20.134
  23:09:28 STEP 1552 H= 388:00 +CPU= 20.438
  23:09:49 STEP 1553 H= 388:15 +CPU= 19.688
  23:10:10 STEP 1554 H= 388:30 +CPU= 20.207
  23:10:31 STEP 1555 H= 388:45 +CPU= 20.028
  23:10:52 STEP 1556 H= 389:00 +CPU= 20.453
  23:11:13 STEP 1557 H= 389:15 +CPU= 19.861
  23:11:34 STEP 1558 H= 389:30 +CPU= 20.102
  23:11:55 STEP 1559 H= 389:45 +CPU= 20.409
  23:12:20 STEP 1560 H= 390:00 +CPU= 24.148
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001560
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001560
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001560
  23:12:41 STEP 1561 H= 390:15 +CPU= 19.888
  23:13:00 STEP 1562 H= 390:30 +CPU= 18.547
  23:13:19 STEP 1563 H= 390:45 +CPU= 18.645
  23:13:39 STEP 1564 H= 391:00 +CPU= 19.167
  23:13:58 STEP 1565 H= 391:15 +CPU= 18.688
  23:14:17 STEP 1566 H= 391:30 +CPU= 18.434
  23:14:39 STEP 1567 H= 391:45 +CPU= 21.263
  23:15:02 STEP 1568 H= 392:00 +CPU= 21.871
  23:15:24 STEP 1569 H= 392:15 +CPU= 20.503
  23:15:46 STEP 1570 H= 392:30 +CPU= 21.092
  23:16:09 STEP 1571 H= 392:45 +CPU= 21.540
  23:16:38 STEP 1572 H= 393:00 +CPU= 27.556
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001572
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001572
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001572
  23:16:57 STEP 1573 H= 393:15 +CPU= 19.114
  23:17:18 STEP 1574 H= 393:30 +CPU= 19.195
  23:17:39 STEP 1575 H= 393:45 +CPU= 20.139
  23:18:00 STEP 1576 H= 394:00 +CPU= 20.277
  23:18:20 STEP 1577 H= 394:15 +CPU= 19.372
  23:18:41 STEP 1578 H= 394:30 +CPU= 19.801
  23:19:02 STEP 1579 H= 394:45 +CPU= 20.056
  23:19:22 STEP 1580 H= 395:00 +CPU= 19.303
  23:19:41 STEP 1581 H= 395:15 +CPU= 18.811
  23:20:01 STEP 1582 H= 395:30 +CPU= 19.032
  23:20:21 STEP 1583 H= 395:45 +CPU= 18.571
  23:20:47 STEP 1584 H= 396:00 +CPU= 25.649
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001584
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001584
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001584
  23:21:07 STEP 1585 H= 396:15 +CPU= 18.810
  23:21:26 STEP 1586 H= 396:30 +CPU= 18.809
  23:21:45 STEP 1587 H= 396:45 +CPU= 18.132
  23:22:14 STEP 1588 H= 397:00 +CPU= 27.157
  23:23:10 STEP 1589 H= 397:15 +CPU= 48.743
  23:23:54 STEP 1590 H= 397:30 +CPU= 40.591
  23:24:37 STEP 1591 H= 397:45 +CPU= 40.104
  23:25:25 STEP 1592 H= 398:00 +CPU= 44.881
  23:26:08 STEP 1593 H= 398:15 +CPU= 40.589
  23:26:57 STEP 1594 H= 398:30 +CPU= 45.245
  23:27:45 STEP 1595 H= 398:45 +CPU= 44.967
  23:28:45 STEP 1596 H= 399:00 +CPU= 56.099
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001596
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001596
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001596
  23:29:28 STEP 1597 H= 399:15 +CPU= 39.320
  23:30:20 STEP 1598 H= 399:30 +CPU= 49.598
  23:31:05 STEP 1599 H= 399:45 +CPU= 41.892
  23:31:56 STEP 1600 H= 400:00 +CPU= 47.860
  23:32:42 STEP 1601 H= 400:15 +CPU= 42.963
  23:33:31 STEP 1602 H= 400:30 +CPU= 45.287
  23:34:27 STEP 1603 H= 400:45 +CPU= 51.271
  23:35:16 STEP 1604 H= 401:00 +CPU= 45.835
  23:36:04 STEP 1605 H= 401:15 +CPU= 44.188
  23:36:58 STEP 1606 H= 401:30 +CPU= 48.861
  23:37:49 STEP 1607 H= 401:45 +CPU= 47.336
  23:38:56 STEP 1608 H= 402:00 +CPU= 61.388
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001608
  23:39:44 STEP 1609 H= 402:15 +CPU= 44.256
  23:40:37 STEP 1610 H= 402:30 +CPU= 49.792
  23:41:32 STEP 1611 H= 402:45 +CPU= 50.817
  23:42:21 STEP 1612 H= 403:00 +CPU= 44.963
  23:43:12 STEP 1613 H= 403:15 +CPU= 47.066
  23:43:57 STEP 1614 H= 403:30 +CPU= 41.734
  23:44:47 STEP 1615 H= 403:45 +CPU= 46.069
  23:45:30 STEP 1616 H= 404:00 +CPU= 39.576
  23:46:14 STEP 1617 H= 404:15 +CPU= 39.909
  23:47:02 STEP 1618 H= 404:30 +CPU= 43.990
  23:47:47 STEP 1619 H= 404:45 +CPU= 41.054
  23:48:42 STEP 1620 H= 405:00 +CPU= 50.822
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001620
  23:49:24 STEP 1621 H= 405:15 +CPU= 38.303
  23:50:05 STEP 1622 H= 405:30 +CPU= 38.413
  23:50:52 STEP 1623 H= 405:45 +CPU= 43.257
  23:51:43 STEP 1624 H= 406:00 +CPU= 47.588
  23:52:28 STEP 1625 H= 406:15 +CPU= 41.211
  23:53:13 STEP 1626 H= 406:30 +CPU= 42.767
  23:54:01 STEP 1627 H= 406:45 +CPU= 43.902
  23:54:51 STEP 1628 H= 407:00 +CPU= 47.631
  23:55:34 STEP 1629 H= 407:15 +CPU= 39.006
  23:56:22 STEP 1630 H= 407:30 +CPU= 45.276
  23:57:08 STEP 1631 H= 407:45 +CPU= 42.932
  23:58:14 STEP 1632 H= 408:00 +CPU= 60.729
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001620
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0d7_2016092300_20_1018_12288802_0_r1568687900_16.zip
Uploading the intermediate file: upload_file_16.zip
  23:59:00 STEP 1633 H= 408:15 +CPU= 40.802
  23:59:47 STEP 1634 H= 408:30 +CPU= 44.399
  00:00:38 STEP 1635 H= 408:45 +CPU= 47.142
  00:01:24 STEP 1636 H= 409:00 +CPU= 42.771
  00:02:13 STEP 1637 H= 409:15 +CPU= 45.846
  00:03:01 STEP 1638 H= 409:30 +CPU= 44.769
  00:03:48 STEP 1639 H= 409:45 +CPU= 44.621
  00:04:29 STEP 1640 H= 410:00 +CPU= 37.630
  00:05:11 STEP 1641 H= 410:15 +CPU= 39.208
  00:05:54 STEP 1642 H= 410:30 +CPU= 39.335
  00:06:22 STEP 1643 H= 410:45 +CPU= 26.367
  00:07:11 STEP 1644 H= 411:00 +CPU= 45.217
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001644
  00:07:53 STEP 1645 H= 411:15 +CPU= 39.358
  00:08:39 STEP 1646 H= 411:30 +CPU= 41.391
  00:09:28 STEP 1647 H= 411:45 +CPU= 45.259
  00:10:18 STEP 1648 H= 412:00 +CPU= 45.696
  00:11:10 STEP 1649 H= 412:15 +CPU= 48.262
  00:12:04 STEP 1650 H= 412:30 +CPU= 49.273
  00:13:00 STEP 1651 H= 412:45 +CPU= 51.847
  00:13:55 STEP 1652 H= 413:00 +CPU= 51.627
  00:14:50 STEP 1653 H= 413:15 +CPU= 50.864
  00:15:38 STEP 1654 H= 413:30 +CPU= 44.263
  00:16:23 STEP 1655 H= 413:45 +CPU= 42.078
  00:17:48 STEP 1656 H= 414:00 +CPU= 77.335
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001656
  00:18:38 STEP 1657 H= 414:15 +CPU= 45.959
  00:19:36 STEP 1658 H= 414:30 +CPU= 54.322
  00:20:36 STEP 1659 H= 414:45 +CPU= 56.009
  00:21:38 STEP 1660 H= 415:00 +CPU= 57.512
  00:22:38 STEP 1661 H= 415:15 +CPU= 54.938
  00:23:31 STEP 1662 H= 415:30 +CPU= 48.764
  00:24:00 STEP 1663 H= 415:45 +CPU= 27.761
  00:24:30 STEP 1664 H= 416:00 +CPU= 28.352
  00:25:04 STEP 1665 H= 416:15 +CPU= 30.910
  00:25:34 STEP 1666 H= 416:30 +CPU= 28.090
  00:26:04 STEP 1667 H= 416:45 +CPU= 28.009
  00:26:40 STEP 1668 H= 417:00 +CPU= 33.777
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001668
  00:27:10 STEP 1669 H= 417:15 +CPU= 27.643
  00:27:39 STEP 1670 H= 417:30 +CPU= 27.362
  00:28:08 STEP 1671 H= 417:45 +CPU= 27.659
  00:28:48 STEP 1672 H= 418:00 +CPU= 36.367
  00:29:43 STEP 1673 H= 418:15 +CPU= 51.255
  00:30:34 STEP 1674 H= 418:30 +CPU= 46.446
  00:31:25 STEP 1675 H= 418:45 +CPU= 47.527
  00:32:14 STEP 1676 H= 419:00 +CPU= 45.195
  00:33:05 STEP 1677 H= 419:15 +CPU= 46.703
  00:33:59 STEP 1678 H= 419:30 +CPU= 49.109
  00:34:37 STEP 1679 H= 419:45 +CPU= 35.232
  00:35:03 STEP 1680 H= 420:00 +CPU= 25.355
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001680
  00:35:21 STEP 1681 H= 420:15 +CPU= 17.420
  00:35:39 STEP 1682 H= 420:30 +CPU= 17.948
  00:35:59 STEP 1683 H= 420:45 +CPU= 18.921
  00:36:19 STEP 1684 H= 421:00 +CPU= 19.026
  00:36:39 STEP 1685 H= 421:15 +CPU= 19.860
  00:36:58 STEP 1686 H= 421:30 +CPU= 18.245
  00:37:17 STEP 1687 H= 421:45 +CPU= 18.298
  00:37:37 STEP 1688 H= 422:00 +CPU= 18.830
  00:37:57 STEP 1689 H= 422:15 +CPU= 19.276
  00:38:17 STEP 1690 H= 422:30 +CPU= 19.358
  00:38:41 STEP 1691 H= 422:45 +CPU= 22.689
  00:39:10 STEP 1692 H= 423:00 +CPU= 27.034
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001692
  00:39:32 STEP 1693 H= 423:15 +CPU= 21.264
  00:39:54 STEP 1694 H= 423:30 +CPU= 21.103
  00:40:15 STEP 1695 H= 423:45 +CPU= 19.732
  00:40:36 STEP 1696 H= 424:00 +CPU= 20.233
  00:40:56 STEP 1697 H= 424:15 +CPU= 19.044
  00:41:17 STEP 1698 H= 424:30 +CPU= 19.741
  00:41:38 STEP 1699 H= 424:45 +CPU= 20.226
  00:41:59 STEP 1700 H= 425:00 +CPU= 20.207
  00:42:20 STEP 1701 H= 425:15 +CPU= 19.937
  00:42:40 STEP 1702 H= 425:30 +CPU= 19.338
  00:43:03 STEP 1703 H= 425:45 +CPU= 21.676
  00:43:28 STEP 1704 H= 426:00 +CPU= 24.025
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001704
  00:43:48 STEP 1705 H= 426:15 +CPU= 19.576
  00:44:08 STEP 1706 H= 426:30 +CPU= 18.991
  00:44:28 STEP 1707 H= 426:45 +CPU= 18.705
  00:44:48 STEP 1708 H= 427:00 +CPU= 19.801
  00:45:11 STEP 1709 H= 427:15 +CPU= 21.682
  00:45:31 STEP 1710 H= 427:30 +CPU= 18.830
  00:45:51 STEP 1711 H= 427:45 +CPU= 19.710
[EC_DRHOOK:naturerick-i7:1:1:2296:2296] [20240615:004558:1718437558:14968.051] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 3536MB (heap), 4796MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:naturerick-i7:1:1:2296:2296] [20240615:004558:1718437558:14968.065] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:naturerick-i7:1:1:2296:2296] [20240615:004558:1718437558:14968.065] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x820890 (old at (nil))
[EC_DRHOOK:naturerick-i7:1:1:2296:2296] [20240615:004558:1718437558:14968.065] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:naturerick-i7:1:1:2296:2296] [20240615:004558:1718437558:14968.065] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:naturerick-i7:1:1:2296:2296] [20240615:004558:1718437558:14968.065] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3843] 3536 MB (maxheap), 4796 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:naturerick-i7:1:1:2296:2296] [20240615:004558:1718437558:14968.065] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:naturerick-i7:1:1:2296:2296] [20240615:004558:1718437558:14968.065] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:naturerick-i7:1:1:2296:2296] [20240615:004558:1718437558:14968.065] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:naturerick-i7:1:1:2296:2296] [20240615:004558:1718437558:14968.066] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:naturerick-i7:1:1:2296:2296] [20240615:004558:1718437558:14968.066] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:naturerick-i7:1:1:2296:2296] [20240615:004558:1718437558:14968.066] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:naturerick-i7:1:1:2296:2296] [20240615:004558:1718437558:14968.066] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:naturerick-i7:1:1:2296:2296] [20240615:004558:1718437558:14968.066] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:naturerick-i7:1:1:2296:2296] [20240615:004558:1718437558:14968.066] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:naturerick-i7:1:1:2296:2296] [20240615:004558:1718437558:14968.066] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:naturerick-i7:1:1:2296:2296] [20240615:004558:1718437558:14968.066] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :            CPG_DRV 
[EC_DRHOOK:naturerick-i7:1:1:2296:2296] [20240615:004558:1718437558:14968.066] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :             >OMP-CPG                  (1025) 
[EC_DRHOOK:naturerick-i7:1:1:2296:2296] [20240615:004558:1718437558:14968.066] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :              CPG 
[EC_DRHOOK:naturerick-i7:1:1:2296:2296] [20240615:004559:1718437559:14969.066] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:naturerick-i7:1:1:2296:2296] [20240615:004559:1718437559:14969.066] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1cf8da0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CF935B  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000008214C1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DD5490  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000C25874  cpg_                      805  cpg.F90
oifs_43r3_model.e  0000000000C22238  cpg_drv_                  351  cpg_drv.F90
oifs_43r3_model.e  0000000000BCC914  gp_model_                 419  gp_model.F90
oifs_43r3_model.e  00000000012C5002  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BACBAE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  0000000000688153  stepo_                    327  stepo.F90
oifs_43r3_model.e  00000000004CD1DC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000004B5D85  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  00000000004B4F52  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  000000000049D638  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  0000000000406FBD  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  0000000000401E7F  MAIN__                     96  master.F90
oifs_43r3_model.e  0000000000401E12  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCC34A  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCDBE7  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000401CD5  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a0d7
(argv4) batchid: 1018
(argv5) wuid: 12288802
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/11
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/11/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/11/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_1b6078bb4e59bc65c1743e6b8075fbca to: /var/lib/boinc-client/slots/11/oifs_43r3_bl_a0d7_2016092300_20_1018_12288802.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/11/oifs_43r3_bl_a0d7_2016092300_20_1018_12288802.zip
ic_ancil_file: ic_ancil_12288802
ifsdata_file: ifsdata_12288802
climate_data_file: clim_data_12288802
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/11/ic_ancil_12288802.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/11/ic_ancil_12288802.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_728d52ebc840d45100a8a5bd06e9c81b to: /var/lib/boinc-client/slots/11/ifsdata/ifsdata_12288802.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/11/ifsdata/ifsdata_12288802.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/11/159l_2/clim_data_12288802.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/11/159l_2/clim_data_12288802.zip
Checking for progress XML file: /var/lib/boinc-client/slots/11/progress_file_12288802.xml
Opened progress file ok : /var/lib/boinc-client/slots/11/progress_file_12288802.xml
-- Model is restarting --
Adjusting last_iter, 1712, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/11/progress_file_12288802.xml
last_cpu_time: 39910
upload_file_number: 17
last_iter: 1681
last_upload: 1468800
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a0d7_2016092300_20_1018_12288802_0_r1568687900
The child process has been launched with process id: 2227
Executing the command: /var/lib/boinc-client/slots/11/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:naturerick-i7:1:1:2227:2227] [20240615:101222:1718471542:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  10:12:59 STEP 1680 H= 420:00 +CPU= 26.762
  10:13:34 STEP 1681 H= 420:15 +CPU= 31.958
  10:14:05 STEP 1682 H= 420:30 +CPU= 29.497
  10:14:34 STEP 1683 H= 420:45 +CPU= 26.828
  10:14:55 STEP 1684 H= 421:00 +CPU= 20.133
  10:15:16 STEP 1685 H= 421:15 +CPU= 20.278
  10:15:38 STEP 1686 H= 421:30 +CPU= 20.415
  10:15:58 STEP 1687 H= 421:45 +CPU= 19.717
  10:16:17 STEP 1688 H= 422:00 +CPU= 18.750
  10:16:36 STEP 1689 H= 422:15 +CPU= 18.181
  10:16:56 STEP 1690 H= 422:30 +CPU= 18.806
  10:17:15 STEP 1691 H= 422:45 +CPU= 18.854
  10:17:39 STEP 1692 H= 423:00 +CPU= 22.726
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001692
  10:18:00 STEP 1693 H= 423:15 +CPU= 19.951
  10:18:20 STEP 1694 H= 423:30 +CPU= 19.069
  10:18:39 STEP 1695 H= 423:45 +CPU= 18.532
  10:18:57 STEP 1696 H= 424:00 +CPU= 17.918
  10:19:16 STEP 1697 H= 424:15 +CPU= 17.763
  10:19:34 STEP 1698 H= 424:30 +CPU= 17.927
  10:19:52 STEP 1699 H= 424:45 +CPU= 17.836
  10:20:11 STEP 1700 H= 425:00 +CPU= 17.919
  10:20:29 STEP 1701 H= 425:15 +CPU= 17.832
  10:20:47 STEP 1702 H= 425:30 +CPU= 17.690
  10:21:05 STEP 1703 H= 425:45 +CPU= 17.669
  10:21:27 STEP 1704 H= 426:00 +CPU= 21.604
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001704
  10:21:46 STEP 1705 H= 426:15 +CPU= 17.785
  10:22:04 STEP 1706 H= 426:30 +CPU= 17.757
  10:22:22 STEP 1707 H= 426:45 +CPU= 17.522
  10:22:40 STEP 1708 H= 427:00 +CPU= 18.133
  10:22:59 STEP 1709 H= 427:15 +CPU= 18.050
  10:23:17 STEP 1710 H= 427:30 +CPU= 17.947
  10:23:36 STEP 1711 H= 427:45 +CPU= 17.809
  10:23:55 STEP 1712 H= 428:00 +CPU= 18.592
  10:24:13 STEP 1713 H= 428:15 +CPU= 17.800
  10:24:31 STEP 1714 H= 428:30 +CPU= 17.674
  10:24:49 STEP 1715 H= 428:45 +CPU= 17.425
  10:25:11 STEP 1716 H= 429:00 +CPU= 21.653
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001716
  10:25:29 STEP 1717 H= 429:15 +CPU= 17.669
  10:25:47 STEP 1718 H= 429:30 +CPU= 17.715
  10:26:05 STEP 1719 H= 429:45 +CPU= 17.576
  10:26:24 STEP 1720 H= 430:00 +CPU= 17.982
  10:26:42 STEP 1721 H= 430:15 +CPU= 17.657
  10:27:00 STEP 1722 H= 430:30 +CPU= 17.540
  10:27:18 STEP 1723 H= 430:45 +CPU= 17.558
  10:27:36 STEP 1724 H= 431:00 +CPU= 17.953
  10:27:55 STEP 1725 H= 431:15 +CPU= 17.768
  10:28:12 STEP 1726 H= 431:30 +CPU= 17.364
  10:28:30 STEP 1727 H= 431:45 +CPU= 17.372
  10:28:54 STEP 1728 H= 432:00 +CPU= 23.395
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001716
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0d7_2016092300_20_1018_12288802_0_r1568687900_17.zip
  10:29:12 STEP 1729 H= 432:15 +CPU= 17.438
Uploading the intermediate file: upload_file_17.zip
  10:29:30 STEP 1730 H= 432:30 +CPU= 17.382
  10:29:48 STEP 1731 H= 432:45 +CPU= 17.677
  10:30:07 STEP 1732 H= 433:00 +CPU= 17.919
  10:30:24 STEP 1733 H= 433:15 +CPU= 17.271
  10:30:42 STEP 1734 H= 433:30 +CPU= 17.386
  10:31:00 STEP 1735 H= 433:45 +CPU= 17.376
  10:31:18 STEP 1736 H= 434:00 +CPU= 17.699
  10:31:36 STEP 1737 H= 434:15 +CPU= 17.284
  10:31:54 STEP 1738 H= 434:30 +CPU= 17.497
  10:32:12 STEP 1739 H= 434:45 +CPU= 17.735
  10:32:34 STEP 1740 H= 435:00 +CPU= 21.709
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001740
  10:32:56 STEP 1741 H= 435:15 +CPU= 20.825
  10:33:21 STEP 1742 H= 435:30 +CPU= 24.320
  10:33:51 STEP 1743 H= 435:45 +CPU= 27.620
  10:34:18 STEP 1744 H= 436:00 +CPU= 25.908
  10:34:44 STEP 1745 H= 436:15 +CPU= 24.759
  10:35:11 STEP 1746 H= 436:30 +CPU= 24.826
  10:35:36 STEP 1747 H= 436:45 +CPU= 24.240
  10:36:03 STEP 1748 H= 437:00 +CPU= 24.988
  10:36:29 STEP 1749 H= 437:15 +CPU= 24.676
  10:36:55 STEP 1750 H= 437:30 +CPU= 24.555
  10:37:21 STEP 1751 H= 437:45 +CPU= 24.616
  10:37:53 STEP 1752 H= 438:00 +CPU= 30.488
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001752
  10:38:18 STEP 1753 H= 438:15 +CPU= 24.057
  10:38:45 STEP 1754 H= 438:30 +CPU= 25.364
  10:39:13 STEP 1755 H= 438:45 +CPU= 26.313
  10:39:39 STEP 1756 H= 439:00 +CPU= 24.799
  10:40:06 STEP 1757 H= 439:15 +CPU= 25.244
  10:40:33 STEP 1758 H= 439:30 +CPU= 25.754
  10:41:00 STEP 1759 H= 439:45 +CPU= 25.209
  10:41:27 STEP 1760 H= 440:00 +CPU= 26.011
  10:41:53 STEP 1761 H= 440:15 +CPU= 24.836
  10:42:19 STEP 1762 H= 440:30 +CPU= 24.706
  10:42:46 STEP 1763 H= 440:45 +CPU= 24.790
  10:43:18 STEP 1764 H= 441:00 +CPU= 30.378
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001764
  10:43:45 STEP 1765 H= 441:15 +CPU= 25.709
  10:44:10 STEP 1766 H= 441:30 +CPU= 23.780
  10:44:37 STEP 1767 H= 441:45 +CPU= 25.496
  10:45:03 STEP 1768 H= 442:00 +CPU= 24.751
  10:45:22 STEP 1769 H= 442:15 +CPU= 17.775
  10:45:40 STEP 1770 H= 442:30 +CPU= 18.112
  10:45:59 STEP 1771 H= 442:45 +CPU= 17.830
  10:46:17 STEP 1772 H= 443:00 +CPU= 18.208
  10:46:35 STEP 1773 H= 443:15 +CPU= 17.785
  10:46:54 STEP 1774 H= 443:30 +CPU= 18.026
  10:47:13 STEP 1775 H= 443:45 +CPU= 17.968
  10:47:38 STEP 1776 H= 444:00 +CPU= 24.475
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001776
  10:47:57 STEP 1777 H= 444:15 +CPU= 18.665
  10:48:16 STEP 1778 H= 444:30 +CPU= 18.348
  10:48:34 STEP 1779 H= 444:45 +CPU= 17.818
  10:48:53 STEP 1780 H= 445:00 +CPU= 18.202
  10:49:11 STEP 1781 H= 445:15 +CPU= 17.639
  10:49:29 STEP 1782 H= 445:30 +CPU= 17.750
  10:49:48 STEP 1783 H= 445:45 +CPU= 17.636
  10:50:06 STEP 1784 H= 446:00 +CPU= 18.211
  10:50:25 STEP 1785 H= 446:15 +CPU= 17.860
  10:50:43 STEP 1786 H= 446:30 +CPU= 17.957
  10:51:01 STEP 1787 H= 446:45 +CPU= 17.742
  10:51:23 STEP 1788 H= 447:00 +CPU= 21.689
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001788
  10:51:41 STEP 1789 H= 447:15 +CPU= 17.574
  10:52:00 STEP 1790 H= 447:30 +CPU= 17.794
  10:52:18 STEP 1791 H= 447:45 +CPU= 17.735
  10:52:37 STEP 1792 H= 448:00 +CPU= 18.363
  10:52:55 STEP 1793 H= 448:15 +CPU= 17.645
  10:53:13 STEP 1794 H= 448:30 +CPU= 17.810
  10:53:31 STEP 1795 H= 448:45 +CPU= 17.712
  10:53:50 STEP 1796 H= 449:00 +CPU= 18.195
  10:54:08 STEP 1797 H= 449:15 +CPU= 17.747
  10:54:27 STEP 1798 H= 449:30 +CPU= 17.785
  10:54:45 STEP 1799 H= 449:45 +CPU= 17.819
  10:55:07 STEP 1800 H= 450:00 +CPU= 21.957
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001800
  10:55:25 STEP 1801 H= 450:15 +CPU= 17.356
  10:55:43 STEP 1802 H= 450:30 +CPU= 17.336
  10:56:01 STEP 1803 H= 450:45 +CPU= 17.329
  10:56:18 STEP 1804 H= 451:00 +CPU= 17.523
  10:56:36 STEP 1805 H= 451:15 +CPU= 17.425
  10:56:54 STEP 1806 H= 451:30 +CPU= 17.338
  10:57:12 STEP 1807 H= 451:45 +CPU= 17.675
  10:57:30 STEP 1808 H= 452:00 +CPU= 17.467
  10:57:48 STEP 1809 H= 452:15 +CPU= 17.387
  10:58:05 STEP 1810 H= 452:30 +CPU= 17.346
  10:58:23 STEP 1811 H= 452:45 +CPU= 17.426
  10:58:45 STEP 1812 H= 453:00 +CPU= 21.390
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001812
  10:59:03 STEP 1813 H= 453:15 +CPU= 17.446
  10:59:21 STEP 1814 H= 453:30 +CPU= 17.316
  10:59:39 STEP 1815 H= 453:45 +CPU= 17.484
  10:59:57 STEP 1816 H= 454:00 +CPU= 17.865
  11:00:15 STEP 1817 H= 454:15 +CPU= 17.396
  11:00:32 STEP 1818 H= 454:30 +CPU= 17.243
  11:00:50 STEP 1819 H= 454:45 +CPU= 17.225
  11:01:08 STEP 1820 H= 455:00 +CPU= 17.830
  11:01:26 STEP 1821 H= 455:15 +CPU= 17.382
  11:01:44 STEP 1822 H= 455:30 +CPU= 17.342
  11:02:01 STEP 1823 H= 455:45 +CPU= 17.292
  11:02:25 STEP 1824 H= 456:00 +CPU= 23.489
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001812
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0d7_2016092300_20_1018_12288802_0_r1568687900_18.zip
Uploading the intermediate file: upload_file_18.zip
  11:02:43 STEP 1825 H= 456:15 +CPU= 17.609
  11:03:01 STEP 1826 H= 456:30 +CPU= 17.547
  11:03:19 STEP 1827 H= 456:45 +CPU= 17.539
  11:03:38 STEP 1828 H= 457:00 +CPU= 17.961
  11:03:56 STEP 1829 H= 457:15 +CPU= 17.492
  11:04:13 STEP 1830 H= 457:30 +CPU= 17.313
  11:04:31 STEP 1831 H= 457:45 +CPU= 17.309
  11:04:50 STEP 1832 H= 458:00 +CPU= 17.948
  11:05:09 STEP 1833 H= 458:15 +CPU= 19.194
  11:05:36 STEP 1834 H= 458:30 +CPU= 24.755
  11:06:03 STEP 1835 H= 458:45 +CPU= 26.043
  11:06:36 STEP 1836 H= 459:00 +CPU= 30.580
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001836
  11:07:03 STEP 1837 H= 459:15 +CPU= 25.305
  11:07:29 STEP 1838 H= 459:30 +CPU= 24.310
  11:07:55 STEP 1839 H= 459:45 +CPU= 24.896
  11:08:21 STEP 1840 H= 460:00 +CPU= 24.775
  11:08:47 STEP 1841 H= 460:15 +CPU= 24.735
  11:09:15 STEP 1842 H= 460:30 +CPU= 25.626
  11:09:41 STEP 1843 H= 460:45 +CPU= 24.686
  11:10:07 STEP 1844 H= 461:00 +CPU= 25.020
  11:10:33 STEP 1845 H= 461:15 +CPU= 23.800
  11:10:57 STEP 1846 H= 461:30 +CPU= 22.968
  11:11:18 STEP 1847 H= 461:45 +CPU= 20.769
  11:11:40 STEP 1848 H= 462:00 +CPU= 21.495
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001848
  11:11:58 STEP 1849 H= 462:15 +CPU= 17.682
  11:12:17 STEP 1850 H= 462:30 +CPU= 17.739
  11:12:35 STEP 1851 H= 462:45 +CPU= 17.815
  11:12:53 STEP 1852 H= 463:00 +CPU= 17.987
  11:13:12 STEP 1853 H= 463:15 +CPU= 18.025
  11:13:32 STEP 1854 H= 463:30 +CPU= 18.882
  11:13:50 STEP 1855 H= 463:45 +CPU= 18.314
  11:14:10 STEP 1856 H= 464:00 +CPU= 18.613
  11:14:28 STEP 1857 H= 464:15 +CPU= 17.792
  11:14:46 STEP 1858 H= 464:30 +CPU= 17.932
  11:15:05 STEP 1859 H= 464:45 +CPU= 17.806
  11:15:27 STEP 1860 H= 465:00 +CPU= 21.749
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001860
  11:15:46 STEP 1861 H= 465:15 +CPU= 18.009
  11:16:04 STEP 1862 H= 465:30 +CPU= 17.826
  11:16:22 STEP 1863 H= 465:45 +CPU= 18.035
  11:16:41 STEP 1864 H= 466:00 +CPU= 18.112
  11:16:59 STEP 1865 H= 466:15 +CPU= 17.797
  11:17:17 STEP 1866 H= 466:30 +CPU= 17.608
  11:17:35 STEP 1867 H= 466:45 +CPU= 17.000
  11:17:52 STEP 1868 H= 467:00 +CPU= 16.845
  11:18:09 STEP 1869 H= 467:15 +CPU= 16.541
  11:18:26 STEP 1870 H= 467:30 +CPU= 16.512
  11:18:42 STEP 1871 H= 467:45 +CPU= 16.512
  11:19:05 STEP 1872 H= 468:00 +CPU= 22.532
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001872
  11:19:23 STEP 1873 H= 468:15 +CPU= 17.071
  11:19:40 STEP 1874 H= 468:30 +CPU= 16.692
  11:19:57 STEP 1875 H= 468:45 +CPU= 16.390
  11:20:14 STEP 1876 H= 469:00 +CPU= 16.823
  11:20:31 STEP 1877 H= 469:15 +CPU= 16.548
  11:20:48 STEP 1878 H= 469:30 +CPU= 16.581
  11:21:05 STEP 1879 H= 469:45 +CPU= 16.585
  11:21:22 STEP 1880 H= 470:00 +CPU= 16.385
  11:21:38 STEP 1881 H= 470:15 +CPU= 16.128
  11:21:55 STEP 1882 H= 470:30 +CPU= 16.128
  11:22:11 STEP 1883 H= 470:45 +CPU= 16.054
  11:22:31 STEP 1884 H= 471:00 +CPU= 19.908
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001884
  11:22:48 STEP 1885 H= 471:15 +CPU= 16.093
  11:23:04 STEP 1886 H= 471:30 +CPU= 16.275
  11:23:21 STEP 1887 H= 471:45 +CPU= 16.141
  11:23:37 STEP 1888 H= 472:00 +CPU= 16.412
  11:23:54 STEP 1889 H= 472:15 +CPU= 16.079
  11:24:10 STEP 1890 H= 472:30 +CPU= 16.091
  11:24:28 STEP 1891 H= 472:45 +CPU= 17.405
  11:24:48 STEP 1892 H= 473:00 +CPU= 19.497
  11:25:05 STEP 1893 H= 473:15 +CPU= 16.619
  11:25:23 STEP 1894 H= 473:30 +CPU= 16.607
  11:25:40 STEP 1895 H= 473:45 +CPU= 16.685
  11:26:00 STEP 1896 H= 474:00 +CPU= 20.258
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001896
  11:26:17 STEP 1897 H= 474:15 +CPU= 16.529
  11:26:34 STEP 1898 H= 474:30 +CPU= 16.497
  11:26:51 STEP 1899 H= 474:45 +CPU= 16.533
  11:27:08 STEP 1900 H= 475:00 +CPU= 16.705
  11:27:25 STEP 1901 H= 475:15 +CPU= 16.527
  11:27:42 STEP 1902 H= 475:30 +CPU= 16.503
  11:27:59 STEP 1903 H= 475:45 +CPU= 16.635
  11:28:17 STEP 1904 H= 476:00 +CPU= 16.761
  11:28:34 STEP 1905 H= 476:15 +CPU= 16.550
  11:28:50 STEP 1906 H= 476:30 +CPU= 16.507
  11:29:07 STEP 1907 H= 476:45 +CPU= 16.404
  11:29:28 STEP 1908 H= 477:00 +CPU= 20.215
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001908
  11:29:45 STEP 1909 H= 477:15 +CPU= 16.458
  11:30:02 STEP 1910 H= 477:30 +CPU= 16.404
  11:30:18 STEP 1911 H= 477:45 +CPU= 16.412
  11:30:36 STEP 1912 H= 478:00 +CPU= 16.718
  11:30:53 STEP 1913 H= 478:15 +CPU= 16.655
  11:31:10 STEP 1914 H= 478:30 +CPU= 16.518
  11:31:27 STEP 1915 H= 478:45 +CPU= 16.519
  11:31:44 STEP 1916 H= 479:00 +CPU= 16.717
  11:32:01 STEP 1917 H= 479:15 +CPU= 16.435
  11:32:18 STEP 1918 H= 479:30 +CPU= 16.741
  11:32:35 STEP 1919 H= 479:45 +CPU= 16.450
  11:32:56 STEP 1920 H= 480:00 +CPU= 21.195
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  480.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.4743569214E-21      I       0.3791538031E-05      I
ICloud fractionI      0.0000000000E+00      I       0.6922924059E-01      I
I  Relat. Hum. I      0.3343454737E+00      I       0.4926088143E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.1178553879E+04      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    302203924 BYTES IN      7 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0060( 5.0%)
 11:32:56 STEP 1920 H= 480:00 +CPU= 21.195
 END CNT3
 NSTEP =  1920 CNT0   000000000  15.477  15.477  15.915   0.972               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN         7150/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    128    0       46      1044068     7150 ************    13.0     4.7     8.3     5.2    18.2
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 4834129.0 4834129.0    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 4827929.9 4827929.9     99.87      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  261    3114.4    3114.4     16.81      0.00
   9 SPCM     - SPECTRAL COMP.                     240     618.2     618.2      3.07      0.00
  10 SCAN2M - PHYSICS                              241    9153.4    9153.4     45.63      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 20     587.6     587.6      0.24      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 11      23.3      23.3      0.01      0.00
  17 GRIDFPOS IN CNT4                               20      23.2      23.2      0.01      0.00
  27 RESTART FILES - WRITING                         5    2350.2    2350.2      0.24      0.00
  28 RESTART FILES - READING                         1    5779.9    5779.9      0.12      0.00
  29 SU4FPOS IN CNT4                                20       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                                20    3785.8    3785.8      1.57      0.00
  31 POSDDH IN STEPO                                 2       2.9       2.9      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    241    4446.7    4446.7     22.17      0.00
  39 SU0YOMB                                         1     285.2     285.2      0.01      0.00
  51 SCAN2M   - SL COMM. PART 1                    241      23.2      23.2      0.12      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              240     397.0     397.0      1.97      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              240      83.4      83.4      0.41      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 11       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      524     299.6     299.6      3.25      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       500     164.8     164.8      1.70      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        500      66.0      66.0      0.68      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       524      95.3      95.3      1.03      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      25.6      25.6      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            524      56.5      56.5      0.61      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            500      27.1      27.1      0.28      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            524      28.2      28.2      0.31      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            500      15.7      15.7      0.16      0.00
 400 GSTATS                                      28864       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 26802       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME     4834.1 CPU TIME    4667.7 VECTOR TIME     4667.7


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      357.9
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/slots/11/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/11/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMGGh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMSHh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288802/ICMUAh7zg+001872
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0d7_2016092300_20_1018_12288802_0_r1568687900_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
11:36:29 (2195): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
15 Jun 2024 19:20:52 1547562 22442367 oifs_43r3_bl_a0d7_2016092300_20_1018_12288802_0 1,727,100 44,577 0.0258


©2024 cpdn.org