climateprediction.net home page
Task 22445676

Task 22445676

Name oifs_43r3_bl_a2w2_2016092300_20_1018_12292073_0
Workunit 12292073
Created 13 Jun 2024, 1:27:12 UTC
Sent 14 Jun 2024, 8:37:51 UTC
Report deadline 13 Aug 2024, 8:37:51 UTC
Received 23 Jun 2024, 11:34:52 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1496581
Run time 20 hours 27 min 32 sec
CPU time 20 hours 16 min 42 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 4.08 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,024.27 MB
Peak swap size 5,981.07 MB
Peak disk usage 1,331.34 MB
Stderr
<core_client_version>7.24.1</core_client_version>
<![CDATA[
<stderr_txt>
/mnt/WDred/boinc/slots/0/ICMSHh7zg+001656
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001656
  19:02:39 STEP 1657 H= 414:15 +CPU= 37.655
  19:03:19 STEP 1658 H= 414:30 +CPU= 37.582
  19:03:59 STEP 1659 H= 414:45 +CPU= 37.544
  19:04:40 STEP 1660 H= 415:00 +CPU= 38.395
  19:05:20 STEP 1661 H= 415:15 +CPU= 37.681
  19:05:59 STEP 1662 H= 415:30 +CPU= 37.588
  19:06:39 STEP 1663 H= 415:45 +CPU= 37.523
  19:07:19 STEP 1664 H= 416:00 +CPU= 38.482
  19:07:59 STEP 1665 H= 416:15 +CPU= 37.674
  19:08:39 STEP 1666 H= 416:30 +CPU= 37.789
  19:09:18 STEP 1667 H= 416:45 +CPU= 37.787
  19:10:09 STEP 1668 H= 417:00 +CPU= 47.360
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001668
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001668
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001668
  19:10:49 STEP 1669 H= 417:15 +CPU= 37.792
  19:11:28 STEP 1670 H= 417:30 +CPU= 37.680
  19:12:08 STEP 1671 H= 417:45 +CPU= 37.756
  19:12:50 STEP 1672 H= 418:00 +CPU= 38.532
  19:13:30 STEP 1673 H= 418:15 +CPU= 37.664
  19:14:10 STEP 1674 H= 418:30 +CPU= 37.639
  19:14:50 STEP 1675 H= 418:45 +CPU= 37.639
  19:15:32 STEP 1676 H= 419:00 +CPU= 38.697
  19:16:12 STEP 1677 H= 419:15 +CPU= 37.808
  19:16:51 STEP 1678 H= 419:30 +CPU= 37.693
  19:17:31 STEP 1679 H= 419:45 +CPU= 37.716
  19:18:25 STEP 1680 H= 420:00 +CPU= 51.225
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001680
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001680
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001680
  19:19:05 STEP 1681 H= 420:15 +CPU= 37.729
  19:19:45 STEP 1682 H= 420:30 +CPU= 37.762
  19:20:25 STEP 1683 H= 420:45 +CPU= 37.726
  19:21:05 STEP 1684 H= 421:00 +CPU= 38.528
  19:21:45 STEP 1685 H= 421:15 +CPU= 37.657
  19:22:25 STEP 1686 H= 421:30 +CPU= 37.715
  19:23:05 STEP 1687 H= 421:45 +CPU= 37.742
  19:23:45 STEP 1688 H= 422:00 +CPU= 38.547
  19:24:25 STEP 1689 H= 422:15 +CPU= 37.719
  19:25:07 STEP 1690 H= 422:30 +CPU= 37.880
  19:25:46 STEP 1691 H= 422:45 +CPU= 36.511
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:27:12 STEP 1692 H= 423:00 +CPU= 39.726
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001692
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001692
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001692
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:28:27 STEP 1693 H= 423:15 +CPU= 31.818
  19:28:59 STEP 1694 H= 423:30 +CPU= 30.435
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:30:59 STEP 1695 H= 423:45 +CPU= 32.771
  19:31:29 STEP 1696 H= 424:00 +CPU= 29.717
  19:32:02 STEP 1697 H= 424:15 +CPU= 30.852
  19:32:35 STEP 1698 H= 424:30 +CPU= 31.022
  19:33:06 STEP 1699 H= 424:45 +CPU= 29.838
  19:33:37 STEP 1700 H= 425:00 +CPU= 30.476
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:34:33 STEP 1701 H= 425:15 +CPU= 31.887
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:35:29 STEP 1702 H= 425:30 +CPU= 32.294
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:36:21 STEP 1703 H= 425:45 +CPU= 29.634
  19:36:58 STEP 1704 H= 426:00 +CPU= 36.689
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001704
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001704
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001704
  19:37:28 STEP 1705 H= 426:15 +CPU= 28.700
  19:37:57 STEP 1706 H= 426:30 +CPU= 28.680
  19:38:26 STEP 1707 H= 426:45 +CPU= 28.794
  19:38:56 STEP 1708 H= 427:00 +CPU= 29.036
  19:39:25 STEP 1709 H= 427:15 +CPU= 28.773
  19:39:54 STEP 1710 H= 427:30 +CPU= 28.612
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:40:48 STEP 1711 H= 427:45 +CPU= 31.238
  19:41:22 STEP 1712 H= 428:00 +CPU= 31.348
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:43:26 STEP 1713 H= 428:15 +CPU= 33.309
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:44:20 STEP 1714 H= 428:30 +CPU= 30.213
  19:44:51 STEP 1715 H= 428:45 +CPU= 29.817
  19:45:29 STEP 1716 H= 429:00 +CPU= 36.863
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001716
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001716
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001716
  19:46:01 STEP 1717 H= 429:15 +CPU= 30.725
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:46:55 STEP 1718 H= 429:30 +CPU= 30.891
  19:47:25 STEP 1719 H= 429:45 +CPU= 28.813
  19:47:55 STEP 1720 H= 430:00 +CPU= 29.519
  19:48:25 STEP 1721 H= 430:15 +CPU= 28.920
  19:48:54 STEP 1722 H= 430:30 +CPU= 28.712
  19:49:23 STEP 1723 H= 430:45 +CPU= 28.558
  19:49:53 STEP 1724 H= 431:00 +CPU= 29.011
  19:50:23 STEP 1725 H= 431:15 +CPU= 29.203
  19:50:53 STEP 1726 H= 431:30 +CPU= 29.545
  19:51:22 STEP 1727 H= 431:45 +CPU= 28.481
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:52:29 STEP 1728 H= 432:00 +CPU= 41.261
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001728
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001728
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001728
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001632
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001632
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001632
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001644
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001644
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001644
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001656
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001656
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001656
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001668
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001668
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001668
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001680
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001680
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001680
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001692
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001692
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001692
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001704
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001704
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001704
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001716
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001716
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001716
Zipping up the intermediate file: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_a2w2_2016092300_20_1018_12292073_0_r241113823_17.zip
Uploading the intermediate file: upload_file_17.zip
  19:53:01 STEP 1729 H= 432:15 +CPU= 30.578
  19:53:35 STEP 1730 H= 432:30 +CPU= 31.877
  19:54:07 STEP 1731 H= 432:45 +CPU= 30.408
  19:54:39 STEP 1732 H= 433:00 +CPU= 30.548
  19:55:11 STEP 1733 H= 433:15 +CPU= 30.327
  19:55:41 STEP 1734 H= 433:30 +CPU= 29.686
  19:56:13 STEP 1735 H= 433:45 +CPU= 30.100
  19:57:02 STEP 1736 H= 434:00 +CPU= 39.172
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:58:10 STEP 1737 H= 434:15 +CPU= 38.518
  19:58:52 STEP 1738 H= 434:30 +CPU= 37.834
  19:59:33 STEP 1739 H= 434:45 +CPU= 37.725
  20:00:23 STEP 1740 H= 435:00 +CPU= 47.373
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001740
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001740
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001740
  20:01:04 STEP 1741 H= 435:15 +CPU= 37.774
  20:01:43 STEP 1742 H= 435:30 +CPU= 37.734
  20:02:24 STEP 1743 H= 435:45 +CPU= 37.650
  20:03:05 STEP 1744 H= 436:00 +CPU= 38.506
  20:03:45 STEP 1745 H= 436:15 +CPU= 37.729
  20:04:26 STEP 1746 H= 436:30 +CPU= 37.697
  20:05:09 STEP 1747 H= 436:45 +CPU= 37.728
  20:05:51 STEP 1748 H= 437:00 +CPU= 38.488
  20:06:32 STEP 1749 H= 437:15 +CPU= 37.726
  20:07:13 STEP 1750 H= 437:30 +CPU= 37.661
  20:07:53 STEP 1751 H= 437:45 +CPU= 37.657
  20:08:43 STEP 1752 H= 438:00 +CPU= 47.303
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001752
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001752
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001752
  20:09:24 STEP 1753 H= 438:15 +CPU= 37.727
  20:10:06 STEP 1754 H= 438:30 +CPU= 37.654
  20:10:46 STEP 1755 H= 438:45 +CPU= 37.706
  20:11:27 STEP 1756 H= 439:00 +CPU= 38.479
  20:12:07 STEP 1757 H= 439:15 +CPU= 37.771
  20:12:47 STEP 1758 H= 439:30 +CPU= 37.752
  20:13:27 STEP 1759 H= 439:45 +CPU= 37.691
  20:14:08 STEP 1760 H= 440:00 +CPU= 38.425
  20:14:48 STEP 1761 H= 440:15 +CPU= 37.669
  20:15:29 STEP 1762 H= 440:30 +CPU= 37.862
  20:16:08 STEP 1763 H= 440:45 +CPU= 37.697
  20:16:59 STEP 1764 H= 441:00 +CPU= 47.269
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001764
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001764
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001764
  20:17:59 STEP 1765 H= 441:15 +CPU= 36.862
  20:18:40 STEP 1766 H= 441:30 +CPU= 37.612
  20:19:20 STEP 1767 H= 441:45 +CPU= 37.696
  20:20:02 STEP 1768 H= 442:00 +CPU= 38.471
  20:20:43 STEP 1769 H= 442:15 +CPU= 37.585
  20:21:25 STEP 1770 H= 442:30 +CPU= 37.632
  20:22:05 STEP 1771 H= 442:45 +CPU= 37.671
  20:22:46 STEP 1772 H= 443:00 +CPU= 38.469
  20:23:27 STEP 1773 H= 443:15 +CPU= 37.723
  20:24:07 STEP 1774 H= 443:30 +CPU= 37.624
  20:24:47 STEP 1775 H= 443:45 +CPU= 37.580
  20:25:45 STEP 1776 H= 444:00 +CPU= 51.066
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001776
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001776
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001776
  20:26:27 STEP 1777 H= 444:15 +CPU= 37.703
  20:27:06 STEP 1778 H= 444:30 +CPU= 37.626
  20:27:48 STEP 1779 H= 444:45 +CPU= 37.671
  20:28:28 STEP 1780 H= 445:00 +CPU= 38.312
  20:29:08 STEP 1781 H= 445:15 +CPU= 37.569
  20:29:47 STEP 1782 H= 445:30 +CPU= 37.554
  20:30:28 STEP 1783 H= 445:45 +CPU= 37.590
  20:31:08 STEP 1784 H= 446:00 +CPU= 38.350
  20:31:48 STEP 1785 H= 446:15 +CPU= 37.596
  20:32:28 STEP 1786 H= 446:30 +CPU= 37.592
  20:33:07 STEP 1787 H= 446:45 +CPU= 37.636
  20:34:00 STEP 1788 H= 447:00 +CPU= 47.091
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001788
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001788
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001788
  20:34:40 STEP 1789 H= 447:15 +CPU= 37.629
  20:35:23 STEP 1790 H= 447:30 +CPU= 37.806
  20:36:09 STEP 1791 H= 447:45 +CPU= 38.008
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:37:12 STEP 1792 H= 448:00 +CPU= 37.941
  20:37:53 STEP 1793 H= 448:15 +CPU= 37.715
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:39:22 STEP 1794 H= 448:30 +CPU= 37.502
  20:40:01 STEP 1795 H= 448:45 +CPU= 37.577
  20:40:43 STEP 1796 H= 449:00 +CPU= 38.431
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:41:47 STEP 1797 H= 449:15 +CPU= 37.311
  20:42:27 STEP 1798 H= 449:30 +CPU= 37.621
  20:43:07 STEP 1799 H= 449:45 +CPU= 37.552
  20:43:57 STEP 1800 H= 450:00 +CPU= 47.019
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001800
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001800
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001800
  20:44:37 STEP 1801 H= 450:15 +CPU= 37.589
  20:45:18 STEP 1802 H= 450:30 +CPU= 37.687
  20:45:58 STEP 1803 H= 450:45 +CPU= 37.561
  20:46:38 STEP 1804 H= 451:00 +CPU= 38.406
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:47:45 STEP 1805 H= 451:15 +CPU= 37.568
  20:48:25 STEP 1806 H= 451:30 +CPU= 37.626
  20:49:05 STEP 1807 H= 451:45 +CPU= 37.621
Suspend request received from the BOINC client, suspending the child process
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211326:1719083606:86121.280] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 5298MB (heap), 4796MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211326:1719083606:86121.294] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211326:1719083606:86121.295] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x820890 (old at (nil))
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211326:1719083606:86121.295] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211326:1719083606:86121.295] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211326:1719083606:86121.295] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3843] 5298 MB (maxheap), 4796 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211326:1719083606:86121.356] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211326:1719083606:86121.374] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211326:1719083606:86121.493] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211326:1719083606:86121.493] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211326:1719083606:86121.493] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211326:1719083606:86121.493] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211326:1719083606:86121.493] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211326:1719083606:86121.493] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211326:1719083606:86121.493] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211326:1719083606:86121.493] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211326:1719083606:86121.493] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :            CALL_SL_HEAP 
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211326:1719083606:86121.493] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :             CALL_SL 
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211326:1719083606:86121.493] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :              >OMP-CALL_SL     2        (1005) 
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211326:1719083606:86121.494] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :               LAPINEB 
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211326:1719083606:86121.494] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                LARCINB 
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211326:1719083606:86121.494] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                 LAITRE_GFL 
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211326:1719083606:86121.494] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                  LAITRI 
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211327:1719083607:86122.494] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:svarten.tribun:1:1:7256:7256] [20240622:211327:1719083607:86122.494] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1cf8da0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CF935B  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000008214C1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DD5490  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000DCCC32  laitri_                   333  laitri.F90
oifs_43r3_model.e  0000000000DD9AAB  laitre_gfl_               289  laitre_gfl.F90
oifs_43r3_model.e  0000000000DD7516  larcinb_                  865  larcinb.F90
oifs_43r3_model.e  0000000000D8A8F8  lapineb_                  451  lapineb.F90
oifs_43r3_model.e  0000000000D57FC1  call_sl_                  363  call_sl.F90
oifs_43r3_model.e  0000000000D54BBC  call_sl_heap_              94  call_sl_heap.F90
oifs_43r3_model.e  0000000000BD4FD8  gp_model_                 533  gp_model.F90
oifs_43r3_model.e  00000000012C5002  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BACBAE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  0000000000688153  stepo_                    327  stepo.F90
oifs_43r3_model.e  00000000004CD1DC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000004B5D85  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  00000000004B4F52  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  000000000049D638  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  0000000000406FBD  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  0000000000401E7F  MAIN__                     96  master.F90
oifs_43r3_model.e  0000000000401E12  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCC34A  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCDBE7  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000401CD5  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a2w2
(argv4) batchid: 1018
(argv5) wuid: 12292073
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /mnt/WDred/boinc/slots/0
Project directory is: /mnt/WDred/boinc/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073
..mkdir for temp folder for results failed
Copying: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /mnt/WDred/boinc/slots/0/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /mnt/WDred/boinc/slots/0/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_ba8398c4aa90dacf56e7b483c60ca141 to: /mnt/WDred/boinc/slots/0/oifs_43r3_bl_a2w2_2016092300_20_1018_12292073.zip
Unzipping the namelist zip file: /mnt/WDred/boinc/slots/0/oifs_43r3_bl_a2w2_2016092300_20_1018_12292073.zip
ic_ancil_file: ic_ancil_12292073
ifsdata_file: ifsdata_12292073
climate_data_file: clim_data_12292073
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /mnt/WDred/boinc/slots/0/ic_ancil_12292073.zip
Unzipping the IC ancils zip file: /mnt/WDred/boinc/slots/0/ic_ancil_12292073.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_73fa35a913fe03d03b1a4831d050a0d2 to: /mnt/WDred/boinc/slots/0/ifsdata/ifsdata_12292073.zip
Unzipping the ifsdata_zip file: /mnt/WDred/boinc/slots/0/ifsdata/ifsdata_12292073.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /mnt/WDred/boinc/slots/0/159l_2/clim_data_12292073.zip
Unzipping the climate data zip file: /mnt/WDred/boinc/slots/0/159l_2/clim_data_12292073.zip
Checking for progress XML file: /mnt/WDred/boinc/slots/0/progress_file_12292073.xml
Opened progress file ok : /mnt/WDred/boinc/slots/0/progress_file_12292073.xml
-- Model is restarting --
Adjusting last_iter, 1808, to previous model restart step.
Creating progress file: /mnt/WDred/boinc/slots/0/progress_file_12292073.xml
last_cpu_time: 67425
upload_file_number: 18
last_iter: 1777
last_upload: 1555200
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a2w2_2016092300_20_1018_12292073_0_r241113823
The child process has been launched with process id: 7054
Executing the command: /mnt/WDred/boinc/slots/0/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:svarten.tribun:1:1:7054:7054] [20240622:211448:1719083688:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a2w2
(argv4) batchid: 1018
(argv5) wuid: 12292073
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /mnt/WDred/boinc/slots/0
Project directory is: /mnt/WDred/boinc/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073
..mkdir for temp folder for results failed
Copying: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /mnt/WDred/boinc/slots/0/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /mnt/WDred/boinc/slots/0/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_ba8398c4aa90dacf56e7b483c60ca141 to: /mnt/WDred/boinc/slots/0/oifs_43r3_bl_a2w2_2016092300_20_1018_12292073.zip
Unzipping the namelist zip file: /mnt/WDred/boinc/slots/0/oifs_43r3_bl_a2w2_2016092300_20_1018_12292073.zip
ic_ancil_file: ic_ancil_12292073
ifsdata_file: ifsdata_12292073
climate_data_file: clim_data_12292073
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /mnt/WDred/boinc/slots/0/ic_ancil_12292073.zip
Unzipping the IC ancils zip file: /mnt/WDred/boinc/slots/0/ic_ancil_12292073.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_73fa35a913fe03d03b1a4831d050a0d2 to: /mnt/WDred/boinc/slots/0/ifsdata/ifsdata_12292073.zip
Unzipping the ifsdata_zip file: /mnt/WDred/boinc/slots/0/ifsdata/ifsdata_12292073.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /mnt/WDred/boinc/slots/0/159l_2/clim_data_12292073.zip
Unzipping the climate data zip file: /mnt/WDred/boinc/slots/0/159l_2/clim_data_12292073.zip
Checking for progress XML file: /mnt/WDred/boinc/slots/0/progress_file_12292073.xml
Opened progress file ok : /mnt/WDred/boinc/slots/0/progress_file_12292073.xml
-- Model is restarting --
Adjusting last_iter, 1777, to previous model restart step.
Creating progress file: /mnt/WDred/boinc/slots/0/progress_file_12292073.xml
last_cpu_time: 67427
upload_file_number: 18
last_iter: 1777
last_upload: 1555200
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a2w2_2016092300_20_1018_12292073_0_r241113823
The child process has been launched with process id: 36216
Executing the command: /mnt/WDred/boinc/slots/0/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:svarten.tribun:1:1:36216:36216] [20240623:101210:1719130330:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  10:13:08 STEP 1776 H= 444:00 +CPU= 39.333
  10:13:50 STEP 1777 H= 444:15 +CPU= 37.742
  10:14:30 STEP 1778 H= 444:30 +CPU= 37.707
  10:15:11 STEP 1779 H= 444:45 +CPU= 37.699
  10:15:50 STEP 1780 H= 445:00 +CPU= 38.385
  10:16:28 STEP 1781 H= 445:15 +CPU= 37.533
  10:17:07 STEP 1782 H= 445:30 +CPU= 37.568
  10:17:46 STEP 1783 H= 445:45 +CPU= 37.589
  10:18:26 STEP 1784 H= 446:00 +CPU= 38.340
  10:19:04 STEP 1785 H= 446:15 +CPU= 37.497
  10:19:44 STEP 1786 H= 446:30 +CPU= 37.599
  10:20:23 STEP 1787 H= 446:45 +CPU= 37.573
  10:21:12 STEP 1788 H= 447:00 +CPU= 47.284
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001788
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001788
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001788
  10:21:51 STEP 1789 H= 447:15 +CPU= 37.682
  10:22:29 STEP 1790 H= 447:30 +CPU= 37.730
  10:23:08 STEP 1791 H= 447:45 +CPU= 37.690
  10:23:48 STEP 1792 H= 448:00 +CPU= 38.484
  10:24:27 STEP 1793 H= 448:15 +CPU= 37.708
  10:25:07 STEP 1794 H= 448:30 +CPU= 37.703
  10:25:45 STEP 1795 H= 448:45 +CPU= 37.651
  10:26:25 STEP 1796 H= 449:00 +CPU= 38.399
  10:27:03 STEP 1797 H= 449:15 +CPU= 37.496
  10:27:42 STEP 1798 H= 449:30 +CPU= 37.639
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:33:27 STEP 1799 H= 449:45 +CPU= 38.129
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:35:37 STEP 1800 H= 450:00 +CPU= 48.849
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001800
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001800
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001800
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:09:19 STEP 1801 H= 450:15 +CPU= 38.395
  12:10:00 STEP 1802 H= 450:30 +CPU= 38.374
  12:10:43 STEP 1803 H= 450:45 +CPU= 38.423
  12:11:23 STEP 1804 H= 451:00 +CPU= 38.664
  12:12:04 STEP 1805 H= 451:15 +CPU= 37.909
  12:12:44 STEP 1806 H= 451:30 +CPU= 37.954
  12:13:24 STEP 1807 H= 451:45 +CPU= 37.958
  12:14:04 STEP 1808 H= 452:00 +CPU= 38.722
  12:14:44 STEP 1809 H= 452:15 +CPU= 37.986
  12:15:25 STEP 1810 H= 452:30 +CPU= 38.077
  12:16:05 STEP 1811 H= 452:45 +CPU= 37.930
  12:16:54 STEP 1812 H= 453:00 +CPU= 47.485
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001812
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001812
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001812
  12:17:33 STEP 1813 H= 453:15 +CPU= 37.851
  12:18:13 STEP 1814 H= 453:30 +CPU= 37.836
  12:18:52 STEP 1815 H= 453:45 +CPU= 37.920
  12:19:33 STEP 1816 H= 454:00 +CPU= 38.717
  12:20:13 STEP 1817 H= 454:15 +CPU= 37.972
  12:20:52 STEP 1818 H= 454:30 +CPU= 37.844
  12:21:32 STEP 1819 H= 454:45 +CPU= 37.941
  12:22:12 STEP 1820 H= 455:00 +CPU= 38.614
  12:22:52 STEP 1821 H= 455:15 +CPU= 37.889
  12:23:31 STEP 1822 H= 455:30 +CPU= 37.865
  12:24:10 STEP 1823 H= 455:45 +CPU= 37.827
  12:25:05 STEP 1824 H= 456:00 +CPU= 51.160
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001824
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001824
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001824
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001728
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001728
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001728
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001740
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001740
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001740
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001752
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001752
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001752
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001764
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001764
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001764
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001776
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001776
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001776
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001788
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001788
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001788
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001800
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001800
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001800
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001812
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001812
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001812
Zipping up the intermediate file: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_a2w2_2016092300_20_1018_12292073_0_r241113823_18.zip
Uploading the intermediate file: upload_file_18.zip
  12:25:49 STEP 1825 H= 456:15 +CPU= 37.728
  12:26:30 STEP 1826 H= 456:30 +CPU= 38.121
  12:27:09 STEP 1827 H= 456:45 +CPU= 37.795
  12:27:49 STEP 1828 H= 457:00 +CPU= 38.709
  12:28:29 STEP 1829 H= 457:15 +CPU= 37.861
  12:29:08 STEP 1830 H= 457:30 +CPU= 37.848
  12:29:48 STEP 1831 H= 457:45 +CPU= 37.876
  12:30:29 STEP 1832 H= 458:00 +CPU= 38.715
  12:31:08 STEP 1833 H= 458:15 +CPU= 37.809
  12:31:48 STEP 1834 H= 458:30 +CPU= 37.860
  12:32:27 STEP 1835 H= 458:45 +CPU= 37.875
  12:33:16 STEP 1836 H= 459:00 +CPU= 47.321
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001836
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001836
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001836
  12:33:56 STEP 1837 H= 459:15 +CPU= 37.851
  12:34:35 STEP 1838 H= 459:30 +CPU= 37.859
  12:35:19 STEP 1839 H= 459:45 +CPU= 38.036
  12:36:07 STEP 1840 H= 460:00 +CPU= 39.200
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  12:37:07 STEP 1841 H= 460:15 +CPU= 37.624
  12:37:47 STEP 1842 H= 460:30 +CPU= 37.831
  12:38:26 STEP 1843 H= 460:45 +CPU= 37.959
  12:39:07 STEP 1844 H= 461:00 +CPU= 38.725
  12:39:46 STEP 1845 H= 461:15 +CPU= 37.954
  12:40:27 STEP 1846 H= 461:30 +CPU= 38.015
  12:41:06 STEP 1847 H= 461:45 +CPU= 37.871
  12:41:56 STEP 1848 H= 462:00 +CPU= 47.485
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001848
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001848
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001848
  12:42:36 STEP 1849 H= 462:15 +CPU= 37.896
  12:43:15 STEP 1850 H= 462:30 +CPU= 37.840
  12:43:55 STEP 1851 H= 462:45 +CPU= 37.883
  12:44:35 STEP 1852 H= 463:00 +CPU= 38.654
  12:45:15 STEP 1853 H= 463:15 +CPU= 37.992
  12:45:55 STEP 1854 H= 463:30 +CPU= 37.855
  12:46:34 STEP 1855 H= 463:45 +CPU= 37.901
  12:47:15 STEP 1856 H= 464:00 +CPU= 38.806
  12:47:54 STEP 1857 H= 464:15 +CPU= 37.911
  12:48:34 STEP 1858 H= 464:30 +CPU= 37.949
  12:49:14 STEP 1859 H= 464:45 +CPU= 37.946
  12:50:05 STEP 1860 H= 465:00 +CPU= 47.540
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001860
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001860
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001860
  12:50:44 STEP 1861 H= 465:15 +CPU= 38.026
  12:51:25 STEP 1862 H= 465:30 +CPU= 38.367
  12:52:04 STEP 1863 H= 465:45 +CPU= 38.146
  12:52:45 STEP 1864 H= 466:00 +CPU= 38.646
  12:53:24 STEP 1865 H= 466:15 +CPU= 37.891
  12:54:04 STEP 1866 H= 466:30 +CPU= 37.918
  12:54:44 STEP 1867 H= 466:45 +CPU= 37.937
  12:55:26 STEP 1868 H= 467:00 +CPU= 38.837
  12:56:05 STEP 1869 H= 467:15 +CPU= 38.023
  12:56:45 STEP 1870 H= 467:30 +CPU= 38.011
  12:57:24 STEP 1871 H= 467:45 +CPU= 37.918
  12:58:18 STEP 1872 H= 468:00 +CPU= 51.326
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001872
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001872
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001872
  12:58:57 STEP 1873 H= 468:15 +CPU= 37.937
  12:59:37 STEP 1874 H= 468:30 +CPU= 37.895
  13:00:18 STEP 1875 H= 468:45 +CPU= 37.990
  13:00:58 STEP 1876 H= 469:00 +CPU= 38.670
  13:01:37 STEP 1877 H= 469:15 +CPU= 37.942
  13:02:17 STEP 1878 H= 469:30 +CPU= 37.862
  13:02:56 STEP 1879 H= 469:45 +CPU= 37.794
  13:03:36 STEP 1880 H= 470:00 +CPU= 38.734
  13:04:16 STEP 1881 H= 470:15 +CPU= 37.863
  13:04:55 STEP 1882 H= 470:30 +CPU= 37.929
  13:05:36 STEP 1883 H= 470:45 +CPU= 37.978
  13:06:25 STEP 1884 H= 471:00 +CPU= 47.544
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001884
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001884
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001884
  13:07:05 STEP 1885 H= 471:15 +CPU= 37.892
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:08:06 STEP 1886 H= 471:30 +CPU= 37.468
  13:08:46 STEP 1887 H= 471:45 +CPU= 38.086
  13:09:27 STEP 1888 H= 472:00 +CPU= 38.818
  13:10:08 STEP 1889 H= 472:15 +CPU= 38.084
  13:10:48 STEP 1890 H= 472:30 +CPU= 38.015
  13:11:27 STEP 1891 H= 472:45 +CPU= 38.024
  13:12:08 STEP 1892 H= 473:00 +CPU= 38.815
  13:12:47 STEP 1893 H= 473:15 +CPU= 38.037
  13:13:28 STEP 1894 H= 473:30 +CPU= 38.070
  13:14:08 STEP 1895 H= 473:45 +CPU= 38.032
  13:14:58 STEP 1896 H= 474:00 +CPU= 47.665
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001896
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001896
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001896
  13:15:39 STEP 1897 H= 474:15 +CPU= 38.036
  13:16:18 STEP 1898 H= 474:30 +CPU= 38.095
  13:16:58 STEP 1899 H= 474:45 +CPU= 38.005
  13:17:38 STEP 1900 H= 475:00 +CPU= 38.841
  13:18:17 STEP 1901 H= 475:15 +CPU= 38.019
  13:18:57 STEP 1902 H= 475:30 +CPU= 38.024
  13:19:36 STEP 1903 H= 475:45 +CPU= 38.081
  13:20:18 STEP 1904 H= 476:00 +CPU= 38.867
  13:20:58 STEP 1905 H= 476:15 +CPU= 38.058
  13:21:37 STEP 1906 H= 476:30 +CPU= 38.036
  13:22:17 STEP 1907 H= 476:45 +CPU= 37.994
  13:23:06 STEP 1908 H= 477:00 +CPU= 47.603
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001908
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001908
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001908
  13:23:46 STEP 1909 H= 477:15 +CPU= 37.990
  13:24:26 STEP 1910 H= 477:30 +CPU= 37.987
  13:25:07 STEP 1911 H= 477:45 +CPU= 38.040
  13:25:47 STEP 1912 H= 478:00 +CPU= 38.832
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:26:42 STEP 1913 H= 478:15 +CPU= 32.013
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:27:36 STEP 1914 H= 478:30 +CPU= 30.651
  13:28:05 STEP 1915 H= 478:45 +CPU= 28.947
  13:28:35 STEP 1916 H= 479:00 +CPU= 29.370
  13:29:04 STEP 1917 H= 479:15 +CPU= 28.456
  13:29:33 STEP 1918 H= 479:30 +CPU= 28.603
  13:30:02 STEP 1919 H= 479:45 +CPU= 28.557
  13:30:40 STEP 1920 H= 480:00 +CPU= 36.952
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  480.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.7124478262E-21      I      -0.5094742324E-05      I
ICloud fractionI      0.0000000000E+00      I       0.1820272547E-01      I
I  Relat. Hum. I      0.2972400317E+00      I       0.3996005564E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.3490745131E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    324960292 BYTES IN      7 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0084( 3.6%)
 13:30:40 STEP 1920 H= 480:00 +CPU= 36.952
 END CNT3
 NSTEP =  1920 CNT0   000000000  27.330  27.330  27.858   0.981               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN         4290/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1     78    0       46      1044068     4290 ************    22.3    14.1     8.2    15.0    18.7
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.86      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  157    5874.3    5874.3      7.74      0.00
   9 SPCM     - SPECTRAL COMP.                     144    1233.6    1233.6      1.49      0.00
  10 SCAN2M - PHYSICS                              145   22672.4   22672.4     27.60      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 12     981.5     981.5      0.10      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                  7      78.5      78.5      0.00      0.00
  17 GRIDFPOS IN CNT4                               12      43.0      43.0      0.00      0.00
  27 RESTART FILES - WRITING                         3    3925.9    3925.9      0.10      0.00
  28 RESTART FILES - READING                         1   15964.9   15964.9      0.13      0.00
  29 SU4FPOS IN CNT4                                12       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                                12   10495.2   10495.2      1.06      0.00
  31 POSDDH IN STEPO                                 1       2.6       2.6      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    145    8450.2    8450.2     10.29      0.00
  39 SU0YOMB                                         1     548.0     548.0      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    145      31.8      31.8      0.04      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              144     334.3     334.3      0.40      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              144      57.5      57.5      0.07      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                  7       0.3       0.3      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      316   18267.7   18267.7     48.47      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       300     394.7     394.7      0.99      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        300     153.2     153.2      0.39      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       316     253.9     253.9      0.67      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      49.4      49.4      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            316      61.2      61.2      0.16      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            300      32.6      32.6      0.08      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            316     127.7     127.7      0.34      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            300      41.7      41.7      0.10      0.00
 400 GSTATS                                      17763       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 16473       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    11910.0 CPU TIME    5575.3 VECTOR TIME     5575.3


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      145.3
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMGGh7zg+001920
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMSHh7zg+001920
Moving to projects directory: /mnt/WDred/boinc/slots/0/ICMUAh7zg+001920
Adding to the zip: /mnt/WDred/boinc/slots/0/NODE.001_01
Adding to the zip: /mnt/WDred/boinc/slots/0/ifs.stat
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001848
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001884
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001860
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001824
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001908
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001884
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001824
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001896
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001836
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001860
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001848
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001920
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001872
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001872
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001836
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001824
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001860
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001836
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001884
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001920
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001848
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMUAh7zg+001896
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001908
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001872
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001920
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMSHh7zg+001896
Adding to the zip: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_12292073/ICMGGh7zg+001908
Zipping up the final file: /mnt/WDred/boinc/projects/climateprediction.net/oifs_43r3_bl_a2w2_2016092300_20_1018_12292073_0_r241113823_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
13:34:12 (36206): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
23 Jun 2024 11:35:13 1496581 22445676 oifs_43r3_bl_a2w2_2016092300_20_1018_12292073_0 1,727,100 73,002 0.0423


©2024 cpdn.org