climateprediction.net home page
Task 22271286

Task 22271286

Name oifs_43r3_ps_0294_2000050100_123_969_12185938_0
Workunit 12185938
Created 22 Dec 2022, 21:04:15 UTC
Sent 11 Jan 2023, 0:31:31 UTC
Report deadline 10 Feb 2023, 0:31:31 UTC
Received 13 Jan 2023, 0:30:15 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1534673
Run time 23 hours 30 min 39 sec
CPU time 22 hours 59 min 40 sec
Validate state Invalid
Credit 10,402.56
Device peak FLOPS 4.67 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,412.39 MB
Peak swap size 4,978.16 MB
Peak disk usage 7,300.63 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
969_12185938_0_r1252675912_68.zip
Uploading the intermediate file: upload_file_68.zip
  18:06:48 STEP 1657 H=1657:00 +CPU= 30.763
  18:07:21 STEP 1658 H=1658:00 +CPU= 31.156
  18:08:13 STEP 1659 H=1659:00 +CPU= 47.846
  18:08:45 STEP 1660 H=1660:00 +CPU= 29.959
  18:09:16 STEP 1661 H=1661:00 +CPU= 29.170
  18:10:07 STEP 1662 H=1662:00 +CPU= 47.970
  18:10:38 STEP 1663 H=1663:00 +CPU= 28.527
  18:11:11 STEP 1664 H=1664:00 +CPU= 30.660
  18:12:06 STEP 1665 H=1665:00 +CPU= 51.714
  18:12:38 STEP 1666 H=1666:00 +CPU= 29.863
  18:13:10 STEP 1667 H=1667:00 +CPU= 29.355
  18:14:05 STEP 1668 H=1668:00 +CPU= 51.606
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001668
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001668
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001668
  18:14:37 STEP 1669 H=1669:00 +CPU= 29.791
  18:15:08 STEP 1670 H=1670:00 +CPU= 28.784
  18:15:58 STEP 1671 H=1671:00 +CPU= 47.033
  18:16:29 STEP 1672 H=1672:00 +CPU= 29.310
  18:17:02 STEP 1673 H=1673:00 +CPU= 30.208
  18:17:54 STEP 1674 H=1674:00 +CPU= 48.255
  18:18:27 STEP 1675 H=1675:00 +CPU= 30.585
  18:18:59 STEP 1676 H=1676:00 +CPU= 29.622
  18:19:50 STEP 1677 H=1677:00 +CPU= 48.391
  18:20:26 STEP 1678 H=1678:00 +CPU= 34.070
  18:21:04 STEP 1679 H=1679:00 +CPU= 35.211
  18:22:11 STEP 1680 H=1680:00 +CPU= 62.818
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001680
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001680
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001668
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0294_2000050100_123_969_12185938_0_r1252675912_69.zip
Uploading the intermediate file: upload_file_69.zip
  18:22:47 STEP 1681 H=1681:00 +CPU= 33.452
  18:23:23 STEP 1682 H=1682:00 +CPU= 33.769
  18:24:16 STEP 1683 H=1683:00 +CPU= 49.984
  18:24:52 STEP 1684 H=1684:00 +CPU= 33.281
  18:25:28 STEP 1685 H=1685:00 +CPU= 33.580
  18:26:23 STEP 1686 H=1686:00 +CPU= 51.121
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:27:09 STEP 1687 H=1687:00 +CPU= 32.605
  18:27:45 STEP 1688 H=1688:00 +CPU= 33.009
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:28:50 STEP 1689 H=1689:00 +CPU= 50.012
  18:29:29 STEP 1690 H=1690:00 +CPU= 36.951
  18:30:05 STEP 1691 H=1691:00 +CPU= 32.746
  18:31:09 STEP 1692 H=1692:00 +CPU= 60.452
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001692
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001692
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001692
  18:31:44 STEP 1693 H=1693:00 +CPU= 31.935
  18:32:19 STEP 1694 H=1694:00 +CPU= 32.174
  18:33:12 STEP 1695 H=1695:00 +CPU= 48.409
  18:33:45 STEP 1696 H=1696:00 +CPU= 31.378
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:36:01 STEP 1697 H=1697:00 +CPU= 30.861
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:38:55 STEP 1698 H=1698:00 +CPU= 48.806
  18:39:29 STEP 1699 H=1699:00 +CPU= 32.046
  18:40:05 STEP 1700 H=1700:00 +CPU= 33.080
  18:41:01 STEP 1701 H=1701:00 +CPU= 52.392
  18:41:37 STEP 1702 H=1702:00 +CPU= 32.916
  18:42:12 STEP 1703 H=1703:00 +CPU= 33.591
  18:43:20 STEP 1704 H=1704:00 +CPU= 65.140
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001704
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001704
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001692
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0294_2000050100_123_969_12185938_0_r1252675912_70.zip
Uploading the intermediate file: upload_file_70.zip
  18:43:55 STEP 1705 H=1705:00 +CPU= 32.787
  18:44:28 STEP 1706 H=1706:00 +CPU= 31.868
  18:45:21 STEP 1707 H=1707:00 +CPU= 51.268
  18:45:57 STEP 1708 H=1708:00 +CPU= 34.220
  18:46:30 STEP 1709 H=1709:00 +CPU= 32.032
  18:47:25 STEP 1710 H=1710:00 +CPU= 52.221
  18:48:00 STEP 1711 H=1711:00 +CPU= 33.660
  18:48:37 STEP 1712 H=1712:00 +CPU= 35.204
  18:49:31 STEP 1713 H=1713:00 +CPU= 52.230
  18:50:07 STEP 1714 H=1714:00 +CPU= 34.298
  18:50:42 STEP 1715 H=1715:00 +CPU= 33.305
  18:51:41 STEP 1716 H=1716:00 +CPU= 56.870
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001716
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001716
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001716
  18:52:15 STEP 1717 H=1717:00 +CPU= 32.728
  18:52:51 STEP 1718 H=1718:00 +CPU= 33.635
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:54:36 STEP 1719 H=1719:00 +CPU= 51.885
  18:55:13 STEP 1720 H=1720:00 +CPU= 35.227
  18:55:48 STEP 1721 H=1721:00 +CPU= 33.562
  18:56:47 STEP 1722 H=1722:00 +CPU= 56.222
  18:57:23 STEP 1723 H=1723:00 +CPU= 34.115
  18:57:59 STEP 1724 H=1724:00 +CPU= 34.997
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:59:30 STEP 1725 H=1725:00 +CPU= 55.918
  19:00:09 STEP 1726 H=1726:00 +CPU= 35.705
  19:00:45 STEP 1727 H=1727:00 +CPU= 34.782
  19:01:50 STEP 1728 H=1728:00 +CPU= 61.397
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001728
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001728
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001716
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0294_2000050100_123_969_12185938_0_r1252675912_71.zip
Uploading the intermediate file: upload_file_71.zip
  19:02:25 STEP 1729 H=1729:00 +CPU= 34.074
  19:03:04 STEP 1730 H=1730:00 +CPU= 37.263
  19:04:01 STEP 1731 H=1731:00 +CPU= 53.661
  19:04:37 STEP 1732 H=1732:00 +CPU= 33.923
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:05:41 STEP 1733 H=1733:00 +CPU= 30.311
  19:06:35 STEP 1734 H=1734:00 +CPU= 49.527
  19:07:08 STEP 1735 H=1735:00 +CPU= 30.387
  19:07:42 STEP 1736 H=1736:00 +CPU= 31.282
  19:08:34 STEP 1737 H=1737:00 +CPU= 48.318
  19:09:08 STEP 1738 H=1738:00 +CPU= 31.302
  19:09:42 STEP 1739 H=1739:00 +CPU= 30.825
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:10:50 STEP 1740 H=1740:00 +CPU= 53.726
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001740
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001740
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001740
  19:11:26 STEP 1741 H=1741:00 +CPU= 32.885
  19:12:00 STEP 1742 H=1742:00 +CPU= 31.802
  19:12:52 STEP 1743 H=1743:00 +CPU= 48.912
  19:13:26 STEP 1744 H=1744:00 +CPU= 31.398
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:14:21 STEP 1745 H=1745:00 +CPU= 30.908
  19:15:14 STEP 1746 H=1746:00 +CPU= 49.948
  19:15:46 STEP 1747 H=1747:00 +CPU= 30.375
  19:16:19 STEP 1748 H=1748:00 +CPU= 30.695
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:17:28 STEP 1749 H=1749:00 +CPU= 55.677
  19:18:05 STEP 1750 H=1750:00 +CPU= 35.614
  19:18:41 STEP 1751 H=1751:00 +CPU= 34.988
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:19:55 STEP 1752 H=1752:00 +CPU= 60.566
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001752
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001752
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001740
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0294_2000050100_123_969_12185938_0_r1252675912_72.zip
Uploading the intermediate file: upload_file_72.zip
  19:20:28 STEP 1753 H=1753:00 +CPU= 31.528
  19:21:04 STEP 1754 H=1754:00 +CPU= 34.616
  19:21:55 STEP 1755 H=1755:00 +CPU= 49.256
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:22:51 STEP 1756 H=1756:00 +CPU= 33.581
  19:23:25 STEP 1757 H=1757:00 +CPU= 32.810
  19:24:19 STEP 1758 H=1758:00 +CPU= 52.267
  19:24:55 STEP 1759 H=1759:00 +CPU= 34.286
  19:25:28 STEP 1760 H=1760:00 +CPU= 31.780
  19:26:20 STEP 1761 H=1761:00 +CPU= 49.778
  19:26:56 STEP 1762 H=1762:00 +CPU= 34.727
  19:27:30 STEP 1763 H=1763:00 +CPU= 32.443
  19:28:27 STEP 1764 H=1764:00 +CPU= 54.569
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001764
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001764
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001764
  19:28:59 STEP 1765 H=1765:00 +CPU= 31.249
  19:29:34 STEP 1766 H=1766:00 +CPU= 32.709
  19:30:24 STEP 1767 H=1767:00 +CPU= 48.611
  19:30:57 STEP 1768 H=1768:00 +CPU= 31.389
  19:31:29 STEP 1769 H=1769:00 +CPU= 30.479
  19:32:21 STEP 1770 H=1770:00 +CPU= 49.281
  19:32:53 STEP 1771 H=1771:00 +CPU= 30.450
  19:33:26 STEP 1772 H=1772:00 +CPU= 31.267
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:34:28 STEP 1773 H=1773:00 +CPU= 48.456
  19:35:01 STEP 1774 H=1774:00 +CPU= 31.360
  19:35:35 STEP 1775 H=1775:00 +CPU= 32.342
  19:36:37 STEP 1776 H=1776:00 +CPU= 58.227
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001776
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001776
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001764
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0294_2000050100_123_969_12185938_0_r1252675912_73.zip
Uploading the intermediate file: upload_file_73.zip
  19:37:09 STEP 1777 H=1777:00 +CPU= 30.642
  19:37:43 STEP 1778 H=1778:00 +CPU= 31.909
  19:38:35 STEP 1779 H=1779:00 +CPU= 49.066
  19:39:08 STEP 1780 H=1780:00 +CPU= 31.596
  19:39:41 STEP 1781 H=1781:00 +CPU= 32.162
  19:40:33 STEP 1782 H=1782:00 +CPU= 49.919
  19:41:06 STEP 1783 H=1783:00 +CPU= 31.032
  19:41:39 STEP 1784 H=1784:00 +CPU= 31.985
  19:42:30 STEP 1785 H=1785:00 +CPU= 48.532
  19:43:03 STEP 1786 H=1786:00 +CPU= 31.388
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:44:41 STEP 1787 H=1787:00 +CPU= 33.864
  19:45:36 STEP 1788 H=1788:00 +CPU= 53.469
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001788
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001788
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001788
  19:46:09 STEP 1789 H=1789:00 +CPU= 30.919
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:47:03 STEP 1790 H=1790:00 +CPU= 31.220
  19:47:53 STEP 1791 H=1791:00 +CPU= 48.468
  19:48:27 STEP 1792 H=1792:00 +CPU= 31.815
  19:48:58 STEP 1793 H=1793:00 +CPU= 29.959
  19:49:49 STEP 1794 H=1794:00 +CPU= 48.850
  19:50:21 STEP 1795 H=1795:00 +CPU= 30.464
  19:50:54 STEP 1796 H=1796:00 +CPU= 31.612
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:52:08 STEP 1797 H=1797:00 +CPU= 49.304
  19:52:40 STEP 1798 H=1798:00 +CPU= 31.075
  19:53:12 STEP 1799 H=1799:00 +CPU= 31.386
  19:54:16 STEP 1800 H=1800:00 +CPU= 60.876
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001800
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001800
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001788
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0294_2000050100_123_969_12185938_0_r1252675912_74.zip
Uploading the intermediate file: upload_file_74.zip
  19:54:50 STEP 1801 H=1801:00 +CPU= 32.414
  19:55:25 STEP 1802 H=1802:00 +CPU= 33.077
  19:56:17 STEP 1803 H=1803:00 +CPU= 49.997
  19:56:50 STEP 1804 H=1804:00 +CPU= 31.794
  19:57:23 STEP 1805 H=1805:00 +CPU= 31.293
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:58:30 STEP 1806 H=1806:00 +CPU= 54.291
  19:59:04 STEP 1807 H=1807:00 +CPU= 32.255
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:00:42 STEP 1808 H=1808:00 +CPU= 34.784
  20:01:39 STEP 1809 H=1809:00 +CPU= 54.012
  20:02:17 STEP 1810 H=1810:00 +CPU= 35.969
  20:02:52 STEP 1811 H=1811:00 +CPU= 31.873
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:04:03 STEP 1812 H=1812:00 +CPU= 54.727
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001812
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001812
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001812
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:04:49 STEP 1813 H=1813:00 +CPU= 32.500
  20:05:25 STEP 1814 H=1814:00 +CPU= 33.836
  20:06:18 STEP 1815 H=1815:00 +CPU= 49.601
  20:06:53 STEP 1816 H=1816:00 +CPU= 32.245
  20:07:27 STEP 1817 H=1817:00 +CPU= 31.967
  20:08:23 STEP 1818 H=1818:00 +CPU= 51.454
  20:08:56 STEP 1819 H=1819:00 +CPU= 31.473
  20:09:34 STEP 1820 H=1820:00 +CPU= 36.002
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:11:18 STEP 1821 H=1821:00 +CPU= 48.290
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:12:13 STEP 1822 H=1822:00 +CPU= 31.667
  20:12:47 STEP 1823 H=1823:00 +CPU= 31.372
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:14:02 STEP 1824 H=1824:00 +CPU= 59.357
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001824
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001824
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001812
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0294_2000050100_123_969_12185938_0_r1252675912_75.zip
Uploading the intermediate file: upload_file_75.zip
Uploading trickle at timestep: 6566400
  20:14:38 STEP 1825 H=1825:00 +CPU= 33.452
  20:15:12 STEP 1826 H=1826:00 +CPU= 32.177
  20:16:04 STEP 1827 H=1827:00 +CPU= 48.210
  20:16:42 STEP 1828 H=1828:00 +CPU= 35.888
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:17:50 STEP 1829 H=1829:00 +CPU= 33.265
  20:18:46 STEP 1830 H=1830:00 +CPU= 53.065
  20:19:19 STEP 1831 H=1831:00 +CPU= 31.438
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:20:16 STEP 1832 H=1832:00 +CPU= 32.843
  20:21:09 STEP 1833 H=1833:00 +CPU= 49.563
  20:21:43 STEP 1834 H=1834:00 +CPU= 31.448
  20:22:17 STEP 1835 H=1835:00 +CPU= 31.843
  20:23:15 STEP 1836 H=1836:00 +CPU= 54.083
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001836
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001836
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001836
  20:23:54 STEP 1837 H=1837:00 +CPU= 37.681
  20:24:29 STEP 1838 H=1838:00 +CPU= 34.226
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:25:44 STEP 1839 H=1839:00 +CPU= 51.054
  20:26:19 STEP 1840 H=1840:00 +CPU= 34.346
  20:26:53 STEP 1841 H=1841:00 +CPU= 32.512
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:27:58 STEP 1842 H=1842:00 +CPU= 53.054
  20:28:33 STEP 1843 H=1843:00 +CPU= 33.797
  20:29:10 STEP 1844 H=1844:00 +CPU= 35.257
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:30:24 STEP 1845 H=1845:00 +CPU= 51.701
  20:30:59 STEP 1846 H=1846:00 +CPU= 33.965
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:32:28 STEP 1847 H=1847:00 +CPU= 35.669
  20:33:35 STEP 1848 H=1848:00 +CPU= 65.691
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001848
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001848
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001836
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0294_2000050100_123_969_12185938_0_r1252675912_76.zip
Uploading the intermediate file: upload_file_76.zip
  20:34:12 STEP 1849 H=1849:00 +CPU= 36.584
  20:34:52 STEP 1850 H=1850:00 +CPU= 38.005
  20:35:45 STEP 1851 H=1851:00 +CPU= 52.197
  20:36:21 STEP 1852 H=1852:00 +CPU= 35.055
  20:36:56 STEP 1853 H=1853:00 +CPU= 33.338
  20:37:50 STEP 1854 H=1854:00 +CPU= 52.573
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:39:05 STEP 1855 H=1855:00 +CPU= 33.106
  20:39:41 STEP 1856 H=1856:00 +CPU= 34.518
  20:40:36 STEP 1857 H=1857:00 +CPU= 54.108
  20:41:12 STEP 1858 H=1858:00 +CPU= 34.876
  20:41:47 STEP 1859 H=1859:00 +CPU= 33.499
  20:42:47 STEP 1860 H=1860:00 +CPU= 58.940
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001860
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:43:53 STEP 1861 H=1861:00 +CPU= 33.687
  20:44:30 STEP 1862 H=1862:00 +CPU= 35.732
  20:45:28 STEP 1863 H=1863:00 +CPU= 55.866
  20:46:05 STEP 1864 H=1864:00 +CPU= 35.478
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:47:02 STEP 1865 H=1865:00 +CPU= 33.477
  20:47:57 STEP 1866 H=1866:00 +CPU= 54.173
  20:48:33 STEP 1867 H=1867:00 +CPU= 34.242
  20:49:08 STEP 1868 H=1868:00 +CPU= 34.088
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:50:12 STEP 1869 H=1869:00 +CPU= 51.778
  20:50:49 STEP 1870 H=1870:00 +CPU= 35.196
  20:51:26 STEP 1871 H=1871:00 +CPU= 35.963
  20:52:33 STEP 1872 H=1872:00 +CPU= 63.507
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001872
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001872
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001860
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0294_2000050100_123_969_12185938_0_r1252675912_77.zip
Uploading the intermediate file: upload_file_77.zip
  20:53:09 STEP 1873 H=1873:00 +CPU= 34.821
  20:53:46 STEP 1874 H=1874:00 +CPU= 36.122
  20:54:42 STEP 1875 H=1875:00 +CPU= 54.022
  20:55:18 STEP 1876 H=1876:00 +CPU= 34.642
  20:55:53 STEP 1877 H=1877:00 +CPU= 33.841
  20:56:47 STEP 1878 H=1878:00 +CPU= 53.098
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:57:34 STEP 1879 H=1879:00 +CPU= 34.901
  20:58:12 STEP 1880 H=1880:00 +CPU= 36.163
  20:59:08 STEP 1881 H=1881:00 +CPU= 54.399
  20:59:44 STEP 1882 H=1882:00 +CPU= 35.750
  21:00:21 STEP 1883 H=1883:00 +CPU= 35.013
  21:01:22 STEP 1884 H=1884:00 +CPU= 59.255
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001884
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001884
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001884
  21:01:57 STEP 1885 H=1885:00 +CPU= 34.415
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:02:44 STEP 1886 H=1886:00 +CPU= 35.111
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:04:52 STEP 1887 H=1887:00 +CPU= 53.049
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:06:42 STEP 1888 H=1888:00 +CPU= 35.277
  21:07:16 STEP 1889 H=1889:00 +CPU= 33.837
  21:08:13 STEP 1890 H=1890:00 +CPU= 55.019
  21:08:48 STEP 1891 H=1891:00 +CPU= 34.323
  21:09:24 STEP 1892 H=1892:00 +CPU= 34.660
  21:10:23 STEP 1893 H=1893:00 +CPU= 57.097
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:12:45 STEP 1894 H=1894:00 +CPU= 35.665
  21:13:23 STEP 1895 H=1895:00 +CPU= 36.982
  21:14:28 STEP 1896 H=1896:00 +CPU= 62.975
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001896
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001896
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001884
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0294_2000050100_123_969_12185938_0_r1252675912_78.zip
Uploading the intermediate file: upload_file_78.zip
  21:15:04 STEP 1897 H=1897:00 +CPU= 35.077
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:16:24 STEP 1898 H=1898:00 +CPU= 35.734
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:17:44 STEP 1899 H=1899:00 +CPU= 55.923
  21:18:22 STEP 1900 H=1900:00 +CPU= 36.593
  21:18:56 STEP 1901 H=1901:00 +CPU= 33.415
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:20:34 STEP 1902 H=1902:00 +CPU= 52.764
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:21:30 STEP 1903 H=1903:00 +CPU= 34.201
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:22:28 STEP 1904 H=1904:00 +CPU= 35.018
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:25:17 STEP 1905 H=1905:00 +CPU= 52.612
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:26:05 STEP 1906 H=1906:00 +CPU= 36.091
  21:26:42 STEP 1907 H=1907:00 +CPU= 34.158
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:28:10 STEP 1908 H=1908:00 +CPU= 53.749
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001908
  21:28:43 STEP 1909 H=1909:00 +CPU= 30.686
  21:29:18 STEP 1910 H=1910:00 +CPU= 32.401
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:30:33 STEP 1911 H=1911:00 +CPU= 50.324
  21:31:08 STEP 1912 H=1912:00 +CPU= 32.226
  21:31:42 STEP 1913 H=1913:00 +CPU= 32.076
  21:32:35 STEP 1914 H=1914:00 +CPU= 49.429
  21:33:08 STEP 1915 H=1915:00 +CPU= 31.108
  21:33:44 STEP 1916 H=1916:00 +CPU= 33.788
  21:34:35 STEP 1917 H=1917:00 +CPU= 47.843
  21:35:10 STEP 1918 H=1918:00 +CPU= 32.540
  21:35:48 STEP 1919 H=1919:00 +CPU= 35.968
  21:36:49 STEP 1920 H=1920:00 +CPU= 57.335
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001908
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0294_2000050100_123_969_12185938_0_r1252675912_79.zip
Uploading the intermediate file: upload_file_79.zip
  21:37:22 STEP 1921 H=1921:00 +CPU= 30.547
  21:37:57 STEP 1922 H=1922:00 +CPU= 32.546
  21:38:49 STEP 1923 H=1923:00 +CPU= 48.461
  21:39:24 STEP 1924 H=1924:00 +CPU= 32.692
  21:39:57 STEP 1925 H=1925:00 +CPU= 31.363
  21:40:55 STEP 1926 H=1926:00 +CPU= 55.279
  21:41:32 STEP 1927 H=1927:00 +CPU= 34.781
  21:42:10 STEP 1928 H=1928:00 +CPU= 37.397
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:43:30 STEP 1929 H=1929:00 +CPU= 55.204
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:44:16 STEP 1930 H=1930:00 +CPU= 34.207
  21:44:52 STEP 1931 H=1931:00 +CPU= 33.992
  21:45:52 STEP 1932 H=1932:00 +CPU= 58.365
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001932
  21:46:25 STEP 1933 H=1933:00 +CPU= 31.070
  21:47:03 STEP 1934 H=1934:00 +CPU= 36.430
  21:47:58 STEP 1935 H=1935:00 +CPU= 53.008
  21:48:33 STEP 1936 H=1936:00 +CPU= 33.867
  21:49:08 STEP 1937 H=1937:00 +CPU= 33.768
  21:50:03 STEP 1938 H=1938:00 +CPU= 53.752
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:50:50 STEP 1939 H=1939:00 +CPU= 34.539
  21:51:27 STEP 1940 H=1940:00 +CPU= 34.868
  21:52:23 STEP 1941 H=1941:00 +CPU= 54.087
  21:53:02 STEP 1942 H=1942:00 +CPU= 36.959
  21:53:39 STEP 1943 H=1943:00 +CPU= 35.538
  21:54:44 STEP 1944 H=1944:00 +CPU= 62.253
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001932
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0294_2000050100_123_969_12185938_0_r1252675912_80.zip
Uploading the intermediate file: upload_file_80.zip
  21:55:20 STEP 1945 H=1945:00 +CPU= 34.312
  21:55:56 STEP 1946 H=1946:00 +CPU= 34.619
  21:56:50 STEP 1947 H=1947:00 +CPU= 51.674
  21:57:27 STEP 1948 H=1948:00 +CPU= 35.188
  21:58:02 STEP 1949 H=1949:00 +CPU= 33.643
  21:58:58 STEP 1950 H=1950:00 +CPU= 53.482
  21:59:33 STEP 1951 H=1951:00 +CPU= 33.031
  22:00:08 STEP 1952 H=1952:00 +CPU= 34.355
  22:01:01 STEP 1953 H=1953:00 +CPU= 50.643
  22:01:36 STEP 1954 H=1954:00 +CPU= 33.309
  22:02:13 STEP 1955 H=1955:00 +CPU= 34.939
  22:03:12 STEP 1956 H=1956:00 +CPU= 55.514
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001956
  22:03:45 STEP 1957 H=1957:00 +CPU= 30.732
  22:04:19 STEP 1958 H=1958:00 +CPU= 32.095
  22:05:10 STEP 1959 H=1959:00 +CPU= 48.276
  22:05:44 STEP 1960 H=1960:00 +CPU= 31.302
  22:06:17 STEP 1961 H=1961:00 +CPU= 30.773
  22:07:09 STEP 1962 H=1962:00 +CPU= 49.464
  22:07:42 STEP 1963 H=1963:00 +CPU= 31.247
  22:08:17 STEP 1964 H=1964:00 +CPU= 32.729
  22:09:10 STEP 1965 H=1965:00 +CPU= 50.107
  22:09:45 STEP 1966 H=1966:00 +CPU= 33.359
  22:10:19 STEP 1967 H=1967:00 +CPU= 31.770
  22:11:20 STEP 1968 H=1968:00 +CPU= 57.044
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001956
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0294_2000050100_123_969_12185938_0_r1252675912_81.zip
Uploading the intermediate file: upload_file_81.zip
  22:11:53 STEP 1969 H=1969:00 +CPU= 30.484
  22:12:29 STEP 1970 H=1970:00 +CPU= 33.642
  22:13:22 STEP 1971 H=1971:00 +CPU= 49.702
  22:13:58 STEP 1972 H=1972:00 +CPU= 34.261
  22:14:31 STEP 1973 H=1973:00 +CPU= 31.422
  22:15:24 STEP 1974 H=1974:00 +CPU= 49.446
  22:15:57 STEP 1975 H=1975:00 +CPU= 31.321
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:16:51 STEP 1976 H=1976:00 +CPU= 31.095
  22:17:43 STEP 1977 H=1977:00 +CPU= 49.683
  22:18:20 STEP 1978 H=1978:00 +CPU= 34.897
  22:18:53 STEP 1979 H=1979:00 +CPU= 31.939
  22:19:52 STEP 1980 H=1980:00 +CPU= 54.510
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001980
  22:20:25 STEP 1981 H=1981:00 +CPU= 31.585
  22:21:01 STEP 1982 H=1982:00 +CPU= 33.597
  22:21:59 STEP 1983 H=1983:00 +CPU= 55.751
  22:22:38 STEP 1984 H=1984:00 +CPU= 37.003
  22:23:14 STEP 1985 H=1985:00 +CPU= 34.339
  22:24:09 STEP 1986 H=1986:00 +CPU= 53.256
  22:24:44 STEP 1987 H=1987:00 +CPU= 32.712
  22:25:19 STEP 1988 H=1988:00 +CPU= 33.597
  22:26:13 STEP 1989 H=1989:00 +CPU= 51.664
  22:26:49 STEP 1990 H=1990:00 +CPU= 34.022
  22:27:25 STEP 1991 H=1991:00 +CPU= 34.635
  22:28:29 STEP 1992 H=1992:00 +CPU= 61.302
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001980
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0294_2000050100_123_969_12185938_0_r1252675912_82.zip
Uploading the intermediate file: upload_file_82.zip
  22:29:06 STEP 1993 H=1993:00 +CPU= 34.792
  22:29:42 STEP 1994 H=1994:00 +CPU= 34.677
  22:30:35 STEP 1995 H=1995:00 +CPU= 50.841
  22:31:12 STEP 1996 H=1996:00 +CPU= 35.483
  22:31:47 STEP 1997 H=1997:00 +CPU= 33.387
  22:32:44 STEP 1998 H=1998:00 +CPU= 54.960
  22:33:20 STEP 1999 H=1999:00 +CPU= 33.882
  22:33:57 STEP 2000 H=2000:00 +CPU= 35.916
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:35:05 STEP 2001 H=2001:00 +CPU= 53.821
  22:35:41 STEP 2002 H=2002:00 +CPU= 34.259
  22:36:15 STEP 2003 H=2003:00 +CPU= 32.643
  22:37:15 STEP 2004 H=2004:00 +CPU= 57.478
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002004
  22:37:51 STEP 2005 H=2005:00 +CPU= 34.432
  22:38:27 STEP 2006 H=2006:00 +CPU= 34.206
  22:39:21 STEP 2007 H=2007:00 +CPU= 51.634
  22:39:59 STEP 2008 H=2008:00 +CPU= 35.764
  22:40:33 STEP 2009 H=2009:00 +CPU= 32.694
  22:41:24 STEP 2010 H=2010:00 +CPU= 48.302
  22:41:55 STEP 2011 H=2011:00 +CPU= 29.297
  22:42:28 STEP 2012 H=2012:00 +CPU= 31.145
  22:43:18 STEP 2013 H=2013:00 +CPU= 47.857
  22:43:52 STEP 2014 H=2014:00 +CPU= 32.205
  22:44:27 STEP 2015 H=2015:00 +CPU= 34.103
  22:45:28 STEP 2016 H=2016:00 +CPU= 57.647
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+002004
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0294_2000050100_123_969_12185938_0_r1252675912_83.zip
Uploading the intermediate file: upload_file_83.zip
  22:46:03 STEP 2017 H=2017:00 +CPU= 33.844
  22:46:38 STEP 2018 H=2018:00 +CPU= 33.092
  22:47:36 STEP 2019 H=2019:00 +CPU= 54.144
  22:48:12 STEP 2020 H=2020:00 +CPU= 34.562
  22:48:46 STEP 2021 H=2021:00 +CPU= 32.387
  22:49:44 STEP 2022 H=2022:00 +CPU= 54.782
  22:50:17 STEP 2023 H=2023:00 +CPU= 31.346
  22:50:53 STEP 2024 H=2024:00 +CPU= 34.974
  22:51:51 STEP 2025 H=2025:00 +CPU= 54.307
  22:52:26 STEP 2026 H=2026:00 +CPU= 34.069
  22:53:01 STEP 2027 H=2027:00 +CPU= 33.735
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:54:12 STEP 2028 H=2028:00 +CPU= 56.697
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002028
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:54:56 STEP 2029 H=2029:00 +CPU= 32.194
  22:55:34 STEP 2030 H=2030:00 +CPU= 35.822
  22:56:33 STEP 2031 H=2031:00 +CPU= 55.823
  22:57:07 STEP 2032 H=2032:00 +CPU= 31.476
  22:57:41 STEP 2033 H=2033:00 +CPU= 31.434
  22:58:35 STEP 2034 H=2034:00 +CPU= 49.863
  22:59:09 STEP 2035 H=2035:00 +CPU= 31.744
  22:59:45 STEP 2036 H=2036:00 +CPU= 33.245
  23:00:43 STEP 2037 H=2037:00 +CPU= 54.007
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:01:30 STEP 2038 H=2038:00 +CPU= 33.009
  23:02:06 STEP 2039 H=2039:00 +CPU= 32.534
  23:03:13 STEP 2040 H=2040:00 +CPU= 63.551
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+002028
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0294_2000050100_123_969_12185938_0_r1252675912_84.zip
Uploading the intermediate file: upload_file_84.zip
  23:03:49 STEP 2041 H=2041:00 +CPU= 32.719
  23:04:24 STEP 2042 H=2042:00 +CPU= 32.521
  23:05:17 STEP 2043 H=2043:00 +CPU= 49.440
  23:05:52 STEP 2044 H=2044:00 +CPU= 32.148
  23:06:26 STEP 2045 H=2045:00 +CPU= 30.773
  23:07:22 STEP 2046 H=2046:00 +CPU= 52.287
  23:07:56 STEP 2047 H=2047:00 +CPU= 31.859
  23:08:30 STEP 2048 H=2048:00 +CPU= 31.220
  23:09:22 STEP 2049 H=2049:00 +CPU= 47.689
  23:09:59 STEP 2050 H=2050:00 +CPU= 34.598
  23:10:33 STEP 2051 H=2051:00 +CPU= 31.341
  23:11:33 STEP 2052 H=2052:00 +CPU= 57.036
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002052
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:12:18 STEP 2053 H=2053:00 +CPU= 31.227
  23:12:52 STEP 2054 H=2054:00 +CPU= 31.654
  23:13:46 STEP 2055 H=2055:00 +CPU= 49.756
  23:14:19 STEP 2056 H=2056:00 +CPU= 30.928
  23:14:52 STEP 2057 H=2057:00 +CPU= 30.574
  23:15:46 STEP 2058 H=2058:00 +CPU= 49.813
  23:16:19 STEP 2059 H=2059:00 +CPU= 30.655
  23:16:54 STEP 2060 H=2060:00 +CPU= 32.260
  23:17:49 STEP 2061 H=2061:00 +CPU= 52.275
  23:18:27 STEP 2062 H=2062:00 +CPU= 35.263
  23:19:03 STEP 2063 H=2063:00 +CPU= 33.651
  23:20:06 STEP 2064 H=2064:00 +CPU= 58.033
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+002052
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0294_2000050100_123_969_12185938_0_r1252675912_85.zip
Uploading the intermediate file: upload_file_85.zip
Uploading trickle at timestep: 7430400
  23:20:39 STEP 2065 H=2065:00 +CPU= 30.573
  23:21:14 STEP 2066 H=2066:00 +CPU= 31.970
  23:22:14 STEP 2067 H=2067:00 +CPU= 57.283
  23:22:55 STEP 2068 H=2068:00 +CPU= 39.739
  23:23:31 STEP 2069 H=2069:00 +CPU= 34.725
  23:24:28 STEP 2070 H=2070:00 +CPU= 54.223
  23:25:04 STEP 2071 H=2071:00 +CPU= 34.614
  23:25:43 STEP 2072 H=2072:00 +CPU= 38.434
  23:26:39 STEP 2073 H=2073:00 +CPU= 53.351
  23:27:17 STEP 2074 H=2074:00 +CPU= 36.273
  23:27:53 STEP 2075 H=2075:00 +CPU= 35.332
  23:28:55 STEP 2076 H=2076:00 +CPU= 59.852
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002076
  23:29:30 STEP 2077 H=2077:00 +CPU= 33.753
  23:30:06 STEP 2078 H=2078:00 +CPU= 34.270
  23:31:00 STEP 2079 H=2079:00 +CPU= 51.734
  23:31:34 STEP 2080 H=2080:00 +CPU= 32.789
  23:32:08 STEP 2081 H=2081:00 +CPU= 32.643
  23:33:03 STEP 2082 H=2082:00 +CPU= 52.760
  23:33:38 STEP 2083 H=2083:00 +CPU= 33.273
  23:34:13 STEP 2084 H=2084:00 +CPU= 33.883
  23:35:05 STEP 2085 H=2085:00 +CPU= 49.804
  23:35:43 STEP 2086 H=2086:00 +CPU= 35.528
  23:36:20 STEP 2087 H=2087:00 +CPU= 36.009
  23:37:26 STEP 2088 H=2088:00 +CPU= 61.933
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+002076
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0294_2000050100_123_969_12185938_0_r1252675912_86.zip
Uploading the intermediate file: upload_file_86.zip
  23:38:01 STEP 2089 H=2089:00 +CPU= 33.476
  23:38:36 STEP 2090 H=2090:00 +CPU= 33.819
  23:39:29 STEP 2091 H=2091:00 +CPU= 50.567
  23:40:06 STEP 2092 H=2092:00 +CPU= 34.702
  23:40:41 STEP 2093 H=2093:00 +CPU= 33.651
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:41:46 STEP 2094 H=2094:00 +CPU= 51.865
  23:42:20 STEP 2095 H=2095:00 +CPU= 32.055
  23:42:53 STEP 2096 H=2096:00 +CPU= 32.635
  23:43:45 STEP 2097 H=2097:00 +CPU= 49.460
  23:44:19 STEP 2098 H=2098:00 +CPU= 33.236
  23:44:53 STEP 2099 H=2099:00 +CPU= 32.686
  23:45:51 STEP 2100 H=2100:00 +CPU= 55.926
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002100
  23:46:26 STEP 2101 H=2101:00 +CPU= 32.760
  23:46:59 STEP 2102 H=2102:00 +CPU= 32.101
  23:47:51 STEP 2103 H=2103:00 +CPU= 49.896
  23:48:25 STEP 2104 H=2104:00 +CPU= 32.462
  23:48:57 STEP 2105 H=2105:00 +CPU= 31.393
  23:49:50 STEP 2106 H=2106:00 +CPU= 49.855
  23:50:22 STEP 2107 H=2107:00 +CPU= 31.412
  23:50:57 STEP 2108 H=2108:00 +CPU= 33.859
  23:51:49 STEP 2109 H=2109:00 +CPU= 49.659
  23:52:23 STEP 2110 H=2110:00 +CPU= 32.933
  23:52:59 STEP 2111 H=2111:00 +CPU= 34.015
  23:54:00 STEP 2112 H=2112:00 +CPU= 58.273
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMGGhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMSHhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938/ICMUAhq0f+002100
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0294_2000050100_123_969_12185938_0_r1252675912_87.zip
Uploading the intermediate file: upload_file_87.zip
  23:54:35 STEP 2113 H=2113:00 +CPU= 32.563
  23:55:10 STEP 2114 H=2114:00 +CPU= 33.553
  23:56:03 STEP 2115 H=2115:00 +CPU= 50.304
  23:56:38 STEP 2116 H=2116:00 +CPU= 32.819
  23:57:11 STEP 2117 H=2117:00 +CPU= 31.436
  23:58:05 STEP 2118 H=2118:00 +CPU= 51.379
  23:58:38 STEP 2119 H=2119:00 +CPU= 31.793
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2000050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0294
(argv4) batchid: 969
(argv5) wuid: 12185938
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/10
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185938
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_50bf4b6db7f41809c5e1b01d6d583fb9 to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0294_2000050100_123_969_12185938.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0294_2000050100_123_969_12185938.zip
ic_ancil_file: ic_ancil_12185938
ifsdata_file: ifsdata_12185938
climate_data_file: clim_data_12185938
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_04ec4c8c5aac8b70192e623743592768 to: /var/lib/boinc-client/slots/10/ic_ancil_12185938.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/10/ic_ancil_12185938.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_f79fafb870230b5b5bd114e1f7c47598 to: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12185938.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12185938.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/10/159l_2/clim_data_12185938.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/10/159l_2/clim_data_12185938.zip
Checking for progress XML file: /var/lib/boinc-client/slots/10/progress_file_12185938.xml
Opened progress file ok : /var/lib/boinc-client/slots/10/progress_file_12185938.xml
-- Model is restarting --
Adjusting last_iter, 2120, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/10/progress_file_12185938.xml
last_cpu_time: 81775
upload_file_number: 88
last_iter: 2111
last_upload: 7603200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0294_2000050100_123_969_12185938_0_r1252675912
The child process has been launched with process id: 135124
Executing the command: /var/lib/boinc-client/slots/10/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:taman-jurong:1:1:135124:135124] [20230113:060005:1673560805:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  06:01:16 STEP 2112 H=2112:00 +CPU= 62.763
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:02:11 STEP 2113 H=2113:00 +CPU= 32.496
  06:02:47 STEP 2114 H=2114:00 +CPU= 34.012
  06:03:43 STEP 2115 H=2115:00 +CPU= 53.894
  06:04:21 STEP 2116 H=2116:00 +CPU= 36.955
  06:04:57 STEP 2117 H=2117:00 +CPU= 34.093
  06:05:53 STEP 2118 H=2118:00 +CPU= 54.646
  06:06:30 STEP 2119 H=2119:00 +CPU= 35.736
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:07:19 STEP 2120 H=2120:00 +CPU= 35.629
  06:08:21 STEP 2121 H=2121:00 +CPU= 59.205
  06:09:01 STEP 2122 H=2122:00 +CPU= 38.279
  06:09:39 STEP 2123 H=2123:00 +CPU= 36.361
  06:10:40 STEP 2124 H=2124:00 +CPU= 56.224
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002124
  06:11:17 STEP 2125 H=2125:00 +CPU= 34.653
  06:11:55 STEP 2126 H=2126:00 +CPU= 34.124
  06:12:47 STEP 2127 H=2127:00 +CPU= 48.386
  06:13:22 STEP 2128 H=2128:00 +CPU= 32.707
  06:13:57 STEP 2129 H=2129:00 +CPU= 32.035
  06:14:53 STEP 2130 H=2130:00 +CPU= 50.795
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:15:40 STEP 2131 H=2131:00 +CPU= 32.371
  06:16:15 STEP 2132 H=2132:00 +CPU= 32.413
  06:17:08 STEP 2133 H=2133:00 +CPU= 49.323
  06:17:44 STEP 2134 H=2134:00 +CPU= 33.291
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:20:33 STEP 2135 H=2135:00 +CPU= 35.269
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Abort request received from BOINC client, ending the child process

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:17:22 1534673 22271286 oifs_43r3_ps_0294_2000050100_123_969_12185938_0 7,430,400 79,558 0.0107
09 May 2023 16:17:22 1534673 22271286 oifs_43r3_ps_0294_2000050100_123_969_12185938_0 6,566,400 69,876 0.0106
09 May 2023 16:16:11 1534673 22271286 oifs_43r3_ps_0294_2000050100_123_969_12185938_0 5,184,000 53,391 0.0103
09 May 2023 16:16:11 1534673 22271286 oifs_43r3_ps_0294_2000050100_123_969_12185938_0 5,184,000 53,391 0.0103
09 May 2023 16:16:05 1534673 22271286 oifs_43r3_ps_0294_2000050100_123_969_12185938_0 4,320,000 45,002 0.0104
09 May 2023 16:16:05 1534673 22271286 oifs_43r3_ps_0294_2000050100_123_969_12185938_0 2,851,200 29,078 0.0102
09 May 2023 16:16:05 1534673 22271286 oifs_43r3_ps_0294_2000050100_123_969_12185938_0 1,987,200 20,315 0.0102
09 May 2023 16:15:21 1534673 22271286 oifs_43r3_ps_0294_2000050100_123_969_12185938_0 864,000 8,720 0.0101
09 May 2023 16:15:21 1534673 22271286 oifs_43r3_ps_0294_2000050100_123_969_12185938_0 864,000 8,720 0.0101


©2024 climateprediction.net