climateprediction.net home page
Task 22280943

Task 22280943

Name oifs_43r3_ps_0406_2009050100_123_978_12195050_0
Workunit 12195050
Created 23 Dec 2022, 20:58:29 UTC
Sent 13 Jan 2023, 8:47:20 UTC
Report deadline 12 Feb 2023, 8:47:20 UTC
Received 14 Jan 2023, 22:51:37 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1507457
Run time 14 hours 21 min 17 sec
CPU time 12 hours 35 min 48 sec
Validate state Invalid
Credit 10,886.40
Device peak FLOPS 5.98 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,773.57 MB
Peak swap size 4,978.08 MB
Peak disk usage 7,204.44 MB
Stderr
<core_client_version>7.16.16</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
18:19:41 STEP 1774 H=1774:00 +CPU= 16.352
  18:19:58 STEP 1775 H=1775:00 +CPU= 16.159
  18:20:28 STEP 1776 H=1776:00 +CPU= 29.528
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+001776
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+001776
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+001776
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+001752
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+001752
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+001752
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+001764
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+001764
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+001764
Zipping up the intermediate file: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_0406_2009050100_123_978_12195050_0_r1878420204_73.zip
Uploading the intermediate file: upload_file_73.zip
  18:20:45 STEP 1777 H=1777:00 +CPU= 16.029
  18:21:02 STEP 1778 H=1778:00 +CPU= 16.149
  18:21:28 STEP 1779 H=1779:00 +CPU= 25.386
  18:21:45 STEP 1780 H=1780:00 +CPU= 16.530
  18:22:02 STEP 1781 H=1781:00 +CPU= 15.784
  18:22:29 STEP 1782 H=1782:00 +CPU= 25.876
  18:22:45 STEP 1783 H=1783:00 +CPU= 16.099
  18:23:02 STEP 1784 H=1784:00 +CPU= 16.255
  18:23:29 STEP 1785 H=1785:00 +CPU= 25.374
  18:23:46 STEP 1786 H=1786:00 +CPU= 16.557
  18:24:02 STEP 1787 H=1787:00 +CPU= 15.809
  18:24:31 STEP 1788 H=1788:00 +CPU= 27.943
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+001788
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+001788
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+001788
  18:24:48 STEP 1789 H=1789:00 +CPU= 16.080
  18:25:05 STEP 1790 H=1790:00 +CPU= 16.282
  18:25:31 STEP 1791 H=1791:00 +CPU= 25.219
  18:25:48 STEP 1792 H=1792:00 +CPU= 16.438
  18:26:05 STEP 1793 H=1793:00 +CPU= 15.848
  18:26:32 STEP 1794 H=1794:00 +CPU= 25.782
  18:26:48 STEP 1795 H=1795:00 +CPU= 15.997
  18:27:05 STEP 1796 H=1796:00 +CPU= 16.322
  18:27:31 STEP 1797 H=1797:00 +CPU= 25.276
  18:27:49 STEP 1798 H=1798:00 +CPU= 16.495
  18:28:06 STEP 1799 H=1799:00 +CPU= 16.331
  18:28:36 STEP 1800 H=1800:00 +CPU= 29.686
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+001800
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+001800
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+001800
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+001776
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+001776
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+001776
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+001788
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+001788
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+001788
Zipping up the intermediate file: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_0406_2009050100_123_978_12195050_0_r1878420204_74.zip
Uploading the intermediate file: upload_file_74.zip
  18:28:53 STEP 1801 H=1801:00 +CPU= 16.014
  18:29:10 STEP 1802 H=1802:00 +CPU= 16.186
  18:29:36 STEP 1803 H=1803:00 +CPU= 25.265
  18:29:53 STEP 1804 H=1804:00 +CPU= 16.331
  18:30:10 STEP 1805 H=1805:00 +CPU= 15.773
  18:30:36 STEP 1806 H=1806:00 +CPU= 25.785
  18:30:53 STEP 1807 H=1807:00 +CPU= 15.941
  18:31:10 STEP 1808 H=1808:00 +CPU= 16.220
  18:31:36 STEP 1809 H=1809:00 +CPU= 25.261
  18:31:53 STEP 1810 H=1810:00 +CPU= 16.429
  18:32:09 STEP 1811 H=1811:00 +CPU= 15.793
  18:32:38 STEP 1812 H=1812:00 +CPU= 27.920
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+001812
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+001812
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+001812
  18:32:55 STEP 1813 H=1813:00 +CPU= 16.089
  18:33:12 STEP 1814 H=1814:00 +CPU= 16.434
  18:33:38 STEP 1815 H=1815:00 +CPU= 25.373
  18:33:56 STEP 1816 H=1816:00 +CPU= 16.527
  18:34:12 STEP 1817 H=1817:00 +CPU= 15.872
  18:34:39 STEP 1818 H=1818:00 +CPU= 25.810
  18:34:56 STEP 1819 H=1819:00 +CPU= 16.118
  18:35:13 STEP 1820 H=1820:00 +CPU= 16.288
  18:35:39 STEP 1821 H=1821:00 +CPU= 25.264
  18:35:56 STEP 1822 H=1822:00 +CPU= 16.463
  18:36:13 STEP 1823 H=1823:00 +CPU= 16.298
  18:36:44 STEP 1824 H=1824:00 +CPU= 29.630
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+001824
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+001824
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+001824
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+001800
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+001800
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+001800
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+001812
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+001812
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+001812
Zipping up the intermediate file: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_0406_2009050100_123_978_12195050_0_r1878420204_75.zip
Uploading the intermediate file: upload_file_75.zip
  18:37:00 STEP 1825 H=1825:00 +CPU= 15.995
  18:37:17 STEP 1826 H=1826:00 +CPU= 16.270
  18:37:44 STEP 1827 H=1827:00 +CPU= 25.279
  18:38:01 STEP 1828 H=1828:00 +CPU= 16.417
  18:38:17 STEP 1829 H=1829:00 +CPU= 15.836
  18:38:44 STEP 1830 H=1830:00 +CPU= 25.806
  18:39:00 STEP 1831 H=1831:00 +CPU= 16.003
  18:39:17 STEP 1832 H=1832:00 +CPU= 16.283
  18:39:44 STEP 1833 H=1833:00 +CPU= 25.350
  18:40:01 STEP 1834 H=1834:00 +CPU= 16.479
  18:40:17 STEP 1835 H=1835:00 +CPU= 15.784
  18:40:46 STEP 1836 H=1836:00 +CPU= 27.942
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+001836
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+001836
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+001836
  18:41:03 STEP 1837 H=1837:00 +CPU= 15.975
  18:41:20 STEP 1838 H=1838:00 +CPU= 16.386
  18:41:46 STEP 1839 H=1839:00 +CPU= 25.313
  18:42:03 STEP 1840 H=1840:00 +CPU= 16.489
  18:42:20 STEP 1841 H=1841:00 +CPU= 15.967
  18:42:47 STEP 1842 H=1842:00 +CPU= 25.715
  18:43:03 STEP 1843 H=1843:00 +CPU= 16.011
  18:43:20 STEP 1844 H=1844:00 +CPU= 16.329
  18:43:46 STEP 1845 H=1845:00 +CPU= 25.207
  18:44:03 STEP 1846 H=1846:00 +CPU= 16.444
  18:44:20 STEP 1847 H=1847:00 +CPU= 16.320
  18:44:51 STEP 1848 H=1848:00 +CPU= 29.597
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+001848
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+001848
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+001848
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+001824
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+001824
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+001824
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+001836
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+001836
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+001836
Zipping up the intermediate file: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_0406_2009050100_123_978_12195050_0_r1878420204_76.zip
Uploading the intermediate file: upload_file_76.zip
  18:45:08 STEP 1849 H=1849:00 +CPU= 15.895
  18:45:25 STEP 1850 H=1850:00 +CPU= 16.234
  18:45:51 STEP 1851 H=1851:00 +CPU= 25.322
  18:46:08 STEP 1852 H=1852:00 +CPU= 16.551
  18:46:25 STEP 1853 H=1853:00 +CPU= 15.905
  18:46:52 STEP 1854 H=1854:00 +CPU= 26.070
  18:47:08 STEP 1855 H=1855:00 +CPU= 16.165
  18:47:25 STEP 1856 H=1856:00 +CPU= 16.366
  18:47:52 STEP 1857 H=1857:00 +CPU= 25.392
  18:48:09 STEP 1858 H=1858:00 +CPU= 16.591
  18:48:26 STEP 1859 H=1859:00 +CPU= 15.917
  18:48:55 STEP 1860 H=1860:00 +CPU= 28.046
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+001860
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+001860
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+001860
  18:49:11 STEP 1861 H=1861:00 +CPU= 16.004
  18:49:29 STEP 1862 H=1862:00 +CPU= 16.437
  18:49:55 STEP 1863 H=1863:00 +CPU= 25.400
  18:50:12 STEP 1864 H=1864:00 +CPU= 16.529
  18:50:29 STEP 1865 H=1865:00 +CPU= 15.941
  18:50:56 STEP 1866 H=1866:00 +CPU= 25.892
  18:51:12 STEP 1867 H=1867:00 +CPU= 16.006
  18:51:29 STEP 1868 H=1868:00 +CPU= 16.294
  18:51:56 STEP 1869 H=1869:00 +CPU= 25.368
  18:52:13 STEP 1870 H=1870:00 +CPU= 16.425
  18:52:30 STEP 1871 H=1871:00 +CPU= 16.338
  18:53:00 STEP 1872 H=1872:00 +CPU= 29.583
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+001872
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+001872
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+001872
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+001848
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+001848
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+001848
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+001860
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+001860
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+001860
Zipping up the intermediate file: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_0406_2009050100_123_978_12195050_0_r1878420204_77.zip
Uploading the intermediate file: upload_file_77.zip
  18:53:17 STEP 1873 H=1873:00 +CPU= 15.917
  18:53:34 STEP 1874 H=1874:00 +CPU= 16.355
  18:54:00 STEP 1875 H=1875:00 +CPU= 25.320
  18:54:17 STEP 1876 H=1876:00 +CPU= 16.571
  18:54:34 STEP 1877 H=1877:00 +CPU= 15.914
  18:55:01 STEP 1878 H=1878:00 +CPU= 25.853
  18:55:18 STEP 1879 H=1879:00 +CPU= 16.129
  18:55:35 STEP 1880 H=1880:00 +CPU= 16.369
  18:56:01 STEP 1881 H=1881:00 +CPU= 25.423
  18:56:18 STEP 1882 H=1882:00 +CPU= 16.599
  18:56:35 STEP 1883 H=1883:00 +CPU= 15.876
  18:57:04 STEP 1884 H=1884:00 +CPU= 27.900
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+001884
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+001884
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+001884
  18:57:20 STEP 1885 H=1885:00 +CPU= 15.957
  18:57:38 STEP 1886 H=1886:00 +CPU= 16.457
  18:58:04 STEP 1887 H=1887:00 +CPU= 25.314
  18:58:21 STEP 1888 H=1888:00 +CPU= 16.492
  18:58:37 STEP 1889 H=1889:00 +CPU= 15.894
  18:59:04 STEP 1890 H=1890:00 +CPU= 25.868
  18:59:21 STEP 1891 H=1891:00 +CPU= 16.039
  18:59:38 STEP 1892 H=1892:00 +CPU= 16.308
  19:00:04 STEP 1893 H=1893:00 +CPU= 25.290
  19:00:21 STEP 1894 H=1894:00 +CPU= 16.464
  19:00:38 STEP 1895 H=1895:00 +CPU= 16.297
  19:01:09 STEP 1896 H=1896:00 +CPU= 29.619
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+001896
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+001896
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+001896
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+001872
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+001872
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+001872
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+001884
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+001884
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+001884
Zipping up the intermediate file: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_0406_2009050100_123_978_12195050_0_r1878420204_78.zip
Uploading the intermediate file: upload_file_78.zip
  19:01:26 STEP 1897 H=1897:00 +CPU= 15.887
  19:01:43 STEP 1898 H=1898:00 +CPU= 16.293
  19:02:09 STEP 1899 H=1899:00 +CPU= 25.360
  19:02:26 STEP 1900 H=1900:00 +CPU= 16.725
  19:02:43 STEP 1901 H=1901:00 +CPU= 15.870
  19:03:10 STEP 1902 H=1902:00 +CPU= 25.987
  19:03:27 STEP 1903 H=1903:00 +CPU= 16.199
  19:03:44 STEP 1904 H=1904:00 +CPU= 16.373
  19:04:10 STEP 1905 H=1905:00 +CPU= 25.350
  19:04:27 STEP 1906 H=1906:00 +CPU= 16.585
  19:04:44 STEP 1907 H=1907:00 +CPU= 15.900
  19:05:13 STEP 1908 H=1908:00 +CPU= 27.963
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+001908
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+001908
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+001908
  19:05:29 STEP 1909 H=1909:00 +CPU= 15.958
  19:05:46 STEP 1910 H=1910:00 +CPU= 16.461
  19:06:13 STEP 1911 H=1911:00 +CPU= 25.433
  19:06:30 STEP 1912 H=1912:00 +CPU= 16.505
  19:06:46 STEP 1913 H=1913:00 +CPU= 15.902
  19:07:13 STEP 1914 H=1914:00 +CPU= 25.884
  19:07:30 STEP 1915 H=1915:00 +CPU= 16.019
  19:07:47 STEP 1916 H=1916:00 +CPU= 16.277
  19:08:13 STEP 1917 H=1917:00 +CPU= 25.302
  19:08:30 STEP 1918 H=1918:00 +CPU= 16.438
  19:08:47 STEP 1919 H=1919:00 +CPU= 16.292
  19:09:19 STEP 1920 H=1920:00 +CPU= 29.757
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+001920
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+001920
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+001920
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+001896
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+001896
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+001896
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+001908
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+001908
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+001908
Zipping up the intermediate file: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_0406_2009050100_123_978_12195050_0_r1878420204_79.zip
Uploading the intermediate file: upload_file_79.zip
  19:09:37 STEP 1921 H=1921:00 +CPU= 16.159
Uploading trickle at timestep: 6912000
  19:09:56 STEP 1922 H=1922:00 +CPU= 16.791
  19:10:24 STEP 1923 H=1923:00 +CPU= 25.648
  19:10:43 STEP 1924 H=1924:00 +CPU= 16.986
  19:11:00 STEP 1925 H=1925:00 +CPU= 16.007
  19:11:29 STEP 1926 H=1926:00 +CPU= 26.278
  19:11:48 STEP 1927 H=1927:00 +CPU= 16.445
  19:12:05 STEP 1928 H=1928:00 +CPU= 16.136
  19:12:29 STEP 1929 H=1929:00 +CPU= 24.363
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191243:1673719963:15125.718] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 3996MB (heap), 4421MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191244:1673719964:15126.023] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191244:1673719964:15126.023] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191244:1673719964:15126.023] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191244:1673719964:15126.023] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191244:1673719964:15126.023] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 3996 MB (maxheap), 4421 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191244:1673719964:15126.023] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191244:1673719964:15126.024] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191244:1673719964:15126.024] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191244:1673719964:15126.024] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191244:1673719964:15126.024] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191244:1673719964:15126.024] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191244:1673719964:15126.024] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191244:1673719964:15126.024] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191244:1673719964:15126.024] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191244:1673719964:15126.024] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191244:1673719964:15126.024] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :            EC_PHYS_DRV 
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191244:1673719964:15126.024] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :             >OMP-PHYSICS              (1001) 
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191244:1673719964:15126.024] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :              EC_PHYS 
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191244:1673719964:15126.024] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :               CALLPAR 
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191244:1673719964:15126.024] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                CLOUD_LAYER 
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191244:1673719964:15126.024] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                 CLOUDSC 
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191245:1673719965:15127.062] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:debian-desktop:1:1:107203:107203] [20230114:191245:1673719965:15127.062] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CE916B  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000081FFF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC9090  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001018F05  cloudsc_                  748  cloudsc.F90
oifs_43r3_model.e  0000000001014D57  cloud_layer_              131  cloud_layer.F90
oifs_43r3_model.e  0000000000F10C1B  callpar_                 1011  callpar.F90
oifs_43r3_model.e  0000000000E4940F  ec_phys_                  670  ec_phys.F90
oifs_43r3_model.e  0000000000E3610C  ec_phys_drv_              599  ec_phys_drv.F90
oifs_43r3_model.e  0000000000BFA3D3  gp_model_                 613  gp_model.F90
oifs_43r3_model.e  00000000012E9482  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BBC1CE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  000000000057A664  stepo_                    327  stepo.F90
oifs_43r3_model.e  000000000055DEEC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2009050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0406
(argv4) batchid: 978
(argv5) wuid: 12195050
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /media/nathan/512gb/boinc/slots/2
Project directory is: /media/nathan/512gb/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050
..mkdir for temp folder for results failed
Copying: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /media/nathan/512gb/boinc/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /media/nathan/512gb/boinc/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_a8270473ea2ad7c311f11abe57e51b99 to: /media/nathan/512gb/boinc/slots/2/oifs_43r3_ps_0406_2009050100_123_978_12195050.zip
Unzipping the namelist zip file: /media/nathan/512gb/boinc/slots/2/oifs_43r3_ps_0406_2009050100_123_978_12195050.zip
ic_ancil_file: ic_ancil_12195050
ifsdata_file: ifsdata_12195050
climate_data_file: clim_data_12195050
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_9d8bb003769847c97c157162de8ccf64 to: /media/nathan/512gb/boinc/slots/2/ic_ancil_12195050.zip
Unzipping the IC ancils zip file: /media/nathan/512gb/boinc/slots/2/ic_ancil_12195050.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_b2580e752db236803b414a06a78e77ca to: /media/nathan/512gb/boinc/slots/2/ifsdata/ifsdata_12195050.zip
Unzipping the ifsdata_zip file: /media/nathan/512gb/boinc/slots/2/ifsdata/ifsdata_12195050.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /media/nathan/512gb/boinc/slots/2/159l_2/clim_data_12195050.zip
Unzipping the climate data zip file: /media/nathan/512gb/boinc/slots/2/159l_2/clim_data_12195050.zip
Checking for progress XML file: /media/nathan/512gb/boinc/slots/2/progress_file_12195050.xml
Opened progress file ok : /media/nathan/512gb/boinc/slots/2/progress_file_12195050.xml
-- Model is restarting --
Adjusting last_iter, 1930, to previous model restart step.
Creating progress file: /media/nathan/512gb/boinc/slots/2/progress_file_12195050.xml
last_cpu_time: 39735
upload_file_number: 80
last_iter: 1919
last_upload: 6912000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0406_2009050100_123_978_12195050_0_r1878420204
The child process has been launched with process id: 2608
Executing the command: /media/nathan/512gb/boinc/slots/2/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:debian-desktop:1:1:2608:2608] [20230114:204942:1673725782:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  20:50:40 STEP 1920 H=1920:00 +CPU= 26.401
  20:50:56 STEP 1921 H=1921:00 +CPU= 15.075
  20:51:12 STEP 1922 H=1922:00 +CPU= 15.505
  20:51:36 STEP 1923 H=1923:00 +CPU= 23.594
  20:51:54 STEP 1924 H=1924:00 +CPU= 16.045
  20:52:14 STEP 1925 H=1925:00 +CPU= 15.852
  20:52:51 STEP 1926 H=1926:00 +CPU= 25.888
  20:53:26 STEP 1927 H=1927:00 +CPU= 16.127
  20:53:50 STEP 1928 H=1928:00 +CPU= 16.759
  20:54:19 STEP 1929 H=1929:00 +CPU= 25.205
  20:54:39 STEP 1930 H=1930:00 +CPU= 16.664
  20:54:58 STEP 1931 H=1931:00 +CPU= 16.146
  20:55:30 STEP 1932 H=1932:00 +CPU= 27.486
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+001932
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+001932
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+001932
  20:55:47 STEP 1933 H=1933:00 +CPU= 15.999
  20:56:05 STEP 1934 H=1934:00 +CPU= 16.429
  20:56:32 STEP 1935 H=1935:00 +CPU= 25.066
  20:56:50 STEP 1936 H=1936:00 +CPU= 16.514
  20:57:07 STEP 1937 H=1937:00 +CPU= 15.946
  20:57:34 STEP 1938 H=1938:00 +CPU= 25.494
  20:57:51 STEP 1939 H=1939:00 +CPU= 15.951
  20:58:08 STEP 1940 H=1940:00 +CPU= 16.322
  20:58:35 STEP 1941 H=1941:00 +CPU= 24.915
  20:58:55 STEP 1942 H=1942:00 +CPU= 16.556
  20:59:16 STEP 1943 H=1943:00 +CPU= 16.919
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:00:44 STEP 1944 H=1944:00 +CPU= 29.836
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+001944
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+001944
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+001944
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+001920
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+001920
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+001920
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+001932
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+001932
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+001932
Zipping up the intermediate file: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_0406_2009050100_123_978_12195050_0_r1878420204_80.zip
Uploading the intermediate file: upload_file_80.zip
  21:01:03 STEP 1945 H=1945:00 +CPU= 16.577
  21:01:26 STEP 1946 H=1946:00 +CPU= 16.795
  21:01:57 STEP 1947 H=1947:00 +CPU= 25.967
  21:02:18 STEP 1948 H=1948:00 +CPU= 16.797
  21:02:36 STEP 1949 H=1949:00 +CPU= 16.019
  21:03:09 STEP 1950 H=1950:00 +CPU= 26.449
  21:03:30 STEP 1951 H=1951:00 +CPU= 16.205
  21:03:49 STEP 1952 H=1952:00 +CPU= 16.799
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:04:35 STEP 1953 H=1953:00 +CPU= 25.423
  21:04:52 STEP 1954 H=1954:00 +CPU= 16.423
  21:05:09 STEP 1955 H=1955:00 +CPU= 16.148
  21:05:38 STEP 1956 H=1956:00 +CPU= 27.718
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+001956
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+001956
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+001956
  21:05:55 STEP 1957 H=1957:00 +CPU= 16.079
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:06:37 STEP 1958 H=1958:00 +CPU= 16.680
  21:07:06 STEP 1959 H=1959:00 +CPU= 25.679
  21:07:25 STEP 1960 H=1960:00 +CPU= 16.862
  21:07:42 STEP 1961 H=1961:00 +CPU= 16.440
  21:08:10 STEP 1962 H=1962:00 +CPU= 26.262
  21:08:29 STEP 1963 H=1963:00 +CPU= 16.451
  21:08:48 STEP 1964 H=1964:00 +CPU= 16.719
  21:09:15 STEP 1965 H=1965:00 +CPU= 25.379
  21:09:33 STEP 1966 H=1966:00 +CPU= 16.550
  21:09:51 STEP 1967 H=1967:00 +CPU= 16.699
  21:10:25 STEP 1968 H=1968:00 +CPU= 29.616
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+001968
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+001968
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+001968
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+001944
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+001944
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+001944
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+001956
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+001956
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+001956
Zipping up the intermediate file: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_0406_2009050100_123_978_12195050_0_r1878420204_81.zip
Uploading the intermediate file: upload_file_81.zip
  21:10:43 STEP 1969 H=1969:00 +CPU= 16.342
  21:11:00 STEP 1970 H=1970:00 +CPU= 16.601
  21:11:30 STEP 1971 H=1971:00 +CPU= 25.746
  21:11:48 STEP 1972 H=1972:00 +CPU= 16.752
  21:12:07 STEP 1973 H=1973:00 +CPU= 16.285
  21:12:44 STEP 1974 H=1974:00 +CPU= 26.432
  21:13:05 STEP 1975 H=1975:00 +CPU= 16.558
  21:13:23 STEP 1976 H=1976:00 +CPU= 16.979
  21:13:50 STEP 1977 H=1977:00 +CPU= 25.874
  21:14:09 STEP 1978 H=1978:00 +CPU= 17.443
  21:14:28 STEP 1979 H=1979:00 +CPU= 16.412
  21:15:05 STEP 1980 H=1980:00 +CPU= 27.958
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+001980
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+001980
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+001980
  21:15:24 STEP 1981 H=1981:00 +CPU= 16.576
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:16:03 STEP 1982 H=1982:00 +CPU= 17.029
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:16:50 STEP 1983 H=1983:00 +CPU= 25.573
  21:17:10 STEP 1984 H=1984:00 +CPU= 17.124
  21:17:32 STEP 1985 H=1985:00 +CPU= 16.452
  21:18:01 STEP 1986 H=1986:00 +CPU= 25.926
  21:18:19 STEP 1987 H=1987:00 +CPU= 16.145
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:19:12 STEP 1988 H=1988:00 +CPU= 16.800
  21:19:45 STEP 1989 H=1989:00 +CPU= 25.556
  21:20:06 STEP 1990 H=1990:00 +CPU= 17.264
  21:20:24 STEP 1991 H=1991:00 +CPU= 17.101
  21:21:10 STEP 1992 H=1992:00 +CPU= 29.965
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+001992
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+001992
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+001992
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+001968
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+001968
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+001968
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+001980
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+001980
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+001980
Zipping up the intermediate file: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_0406_2009050100_123_978_12195050_0_r1878420204_82.zip
Uploading the intermediate file: upload_file_82.zip
  21:21:28 STEP 1993 H=1993:00 +CPU= 16.493
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:22:31 STEP 1994 H=1994:00 +CPU= 16.962
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:26:25 STEP 1995 H=1995:00 +CPU= 25.003
  21:26:46 STEP 1996 H=1996:00 +CPU= 16.501
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:29:48 STEP 1997 H=1997:00 +CPU= 15.952
  21:30:21 STEP 1998 H=1998:00 +CPU= 26.141
  21:30:57 STEP 1999 H=1999:00 +CPU= 16.139
  21:31:18 STEP 2000 H=2000:00 +CPU= 16.788
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:33:47 STEP 2001 H=2001:00 +CPU= 25.676
  21:34:10 STEP 2002 H=2002:00 +CPU= 17.469
  21:34:34 STEP 2003 H=2003:00 +CPU= 16.750
  21:35:12 STEP 2004 H=2004:00 +CPU= 28.705
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+002004
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+002004
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+002004
  21:35:33 STEP 2005 H=2005:00 +CPU= 17.024
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:37:09 STEP 2006 H=2006:00 +CPU= 17.338
  21:37:48 STEP 2007 H=2007:00 +CPU= 26.658
  21:38:13 STEP 2008 H=2008:00 +CPU= 17.631
  21:38:37 STEP 2009 H=2009:00 +CPU= 17.091
  21:39:14 STEP 2010 H=2010:00 +CPU= 27.014
  21:39:38 STEP 2011 H=2011:00 +CPU= 16.939
  21:40:01 STEP 2012 H=2012:00 +CPU= 17.377
  21:40:34 STEP 2013 H=2013:00 +CPU= 26.428
  21:40:56 STEP 2014 H=2014:00 +CPU= 17.309
  21:41:20 STEP 2015 H=2015:00 +CPU= 17.367
  21:42:00 STEP 2016 H=2016:00 +CPU= 30.460
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+002016
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+002016
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+002016
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+001992
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+001992
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+001992
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+002004
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+002004
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+002004
Zipping up the intermediate file: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_0406_2009050100_123_978_12195050_0_r1878420204_83.zip
Uploading the intermediate file: upload_file_83.zip
  21:42:22 STEP 2017 H=2017:00 +CPU= 16.561
  21:42:49 STEP 2018 H=2018:00 +CPU= 17.350
  21:43:23 STEP 2019 H=2019:00 +CPU= 25.966
  21:43:47 STEP 2020 H=2020:00 +CPU= 17.059
  21:44:09 STEP 2021 H=2021:00 +CPU= 16.588
  21:44:42 STEP 2022 H=2022:00 +CPU= 26.613
  21:45:03 STEP 2023 H=2023:00 +CPU= 16.901
  21:45:25 STEP 2024 H=2024:00 +CPU= 17.400
  21:45:59 STEP 2025 H=2025:00 +CPU= 26.411
  21:46:21 STEP 2026 H=2026:00 +CPU= 17.557
  21:46:42 STEP 2027 H=2027:00 +CPU= 17.198
  21:47:15 STEP 2028 H=2028:00 +CPU= 29.187
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+002028
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+002028
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+002028
  21:47:35 STEP 2029 H=2029:00 +CPU= 17.021
  21:47:57 STEP 2030 H=2030:00 +CPU= 17.458
  21:48:29 STEP 2031 H=2031:00 +CPU= 26.421
  21:48:50 STEP 2032 H=2032:00 +CPU= 17.448
  21:49:11 STEP 2033 H=2033:00 +CPU= 16.905
  21:49:44 STEP 2034 H=2034:00 +CPU= 26.721
  21:50:05 STEP 2035 H=2035:00 +CPU= 16.751
  21:50:25 STEP 2036 H=2036:00 +CPU= 17.083
  21:50:57 STEP 2037 H=2037:00 +CPU= 26.007
  21:51:17 STEP 2038 H=2038:00 +CPU= 17.044
  21:51:38 STEP 2039 H=2039:00 +CPU= 17.234
  21:52:18 STEP 2040 H=2040:00 +CPU= 30.773
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+002040
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+002040
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+002040
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+002016
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+002016
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+002016
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+002028
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+002028
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+002028
Zipping up the intermediate file: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_0406_2009050100_123_978_12195050_0_r1878420204_84.zip
Uploading the intermediate file: upload_file_84.zip
  21:52:44 STEP 2041 H=2041:00 +CPU= 17.205
  21:53:06 STEP 2042 H=2042:00 +CPU= 17.448
  21:53:34 STEP 2043 H=2043:00 +CPU= 25.913
  21:53:52 STEP 2044 H=2044:00 +CPU= 16.851
  21:54:11 STEP 2045 H=2045:00 +CPU= 16.414
  21:54:39 STEP 2046 H=2046:00 +CPU= 26.073
  21:54:58 STEP 2047 H=2047:00 +CPU= 16.512
  21:55:16 STEP 2048 H=2048:00 +CPU= 16.690
  21:55:44 STEP 2049 H=2049:00 +CPU= 25.614
  21:56:03 STEP 2050 H=2050:00 +CPU= 17.023
  21:56:21 STEP 2051 H=2051:00 +CPU= 16.825
  21:56:52 STEP 2052 H=2052:00 +CPU= 28.761
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+002052
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+002052
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+002052
  21:57:10 STEP 2053 H=2053:00 +CPU= 16.594
  21:57:30 STEP 2054 H=2054:00 +CPU= 17.021
  21:58:00 STEP 2055 H=2055:00 +CPU= 25.858
  21:58:19 STEP 2056 H=2056:00 +CPU= 16.917
  21:58:37 STEP 2057 H=2057:00 +CPU= 16.317
  21:59:05 STEP 2058 H=2058:00 +CPU= 25.749
  21:59:23 STEP 2059 H=2059:00 +CPU= 16.086
  21:59:42 STEP 2060 H=2060:00 +CPU= 16.408
  22:00:09 STEP 2061 H=2061:00 +CPU= 24.924
  22:00:28 STEP 2062 H=2062:00 +CPU= 16.396
  22:00:46 STEP 2063 H=2063:00 +CPU= 16.357
  22:01:51 STEP 2064 H=2064:00 +CPU= 29.342
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+002064
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+002064
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+002064
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+002040
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+002040
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+002040
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+002052
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+002052
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+002052
Zipping up the intermediate file: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_0406_2009050100_123_978_12195050_0_r1878420204_85.zip
  22:02:09 STEP 2065 H=2065:00 +CPU= 15.874
Uploading the intermediate file: upload_file_85.zip
  22:02:26 STEP 2066 H=2066:00 +CPU= 16.567
  22:02:55 STEP 2067 H=2067:00 +CPU= 25.713
  22:03:13 STEP 2068 H=2068:00 +CPU= 16.604
  22:03:32 STEP 2069 H=2069:00 +CPU= 16.506
  22:04:01 STEP 2070 H=2070:00 +CPU= 26.233
  22:04:19 STEP 2071 H=2071:00 +CPU= 16.142
  22:04:37 STEP 2072 H=2072:00 +CPU= 16.708
  22:05:05 STEP 2073 H=2073:00 +CPU= 25.714
  22:05:23 STEP 2074 H=2074:00 +CPU= 16.640
  22:05:41 STEP 2075 H=2075:00 +CPU= 16.503
  22:06:12 STEP 2076 H=2076:00 +CPU= 28.084
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+002076
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+002076
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+002076
  22:06:30 STEP 2077 H=2077:00 +CPU= 16.153
  22:06:49 STEP 2078 H=2078:00 +CPU= 16.606
  22:07:17 STEP 2079 H=2079:00 +CPU= 25.594
  22:07:35 STEP 2080 H=2080:00 +CPU= 16.543
  22:07:54 STEP 2081 H=2081:00 +CPU= 16.247
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:08:48 STEP 2082 H=2082:00 +CPU= 26.523
  22:09:07 STEP 2083 H=2083:00 +CPU= 16.282
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:09:42 STEP 2084 H=2084:00 +CPU= 16.950
  22:10:12 STEP 2085 H=2085:00 +CPU= 25.306
  22:10:31 STEP 2086 H=2086:00 +CPU= 16.141
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:11:23 STEP 2087 H=2087:00 +CPU= 16.719
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:12:59 STEP 2088 H=2088:00 +CPU= 29.708
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+002088
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+002088
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+002088
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+002064
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+002064
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+002064
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+002076
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+002076
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+002076
Zipping up the intermediate file: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_0406_2009050100_123_978_12195050_0_r1878420204_86.zip
Uploading the intermediate file: upload_file_86.zip
  22:13:32 STEP 2089 H=2089:00 +CPU= 15.891
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:15:35 STEP 2090 H=2090:00 +CPU= 16.149
  22:16:00 STEP 2091 H=2091:00 +CPU= 24.323
  22:16:16 STEP 2092 H=2092:00 +CPU= 15.836
  22:16:32 STEP 2093 H=2093:00 +CPU= 16.134
  22:16:58 STEP 2094 H=2094:00 +CPU= 25.313
  22:17:14 STEP 2095 H=2095:00 +CPU= 15.263
  22:17:30 STEP 2096 H=2096:00 +CPU= 15.956
  22:17:55 STEP 2097 H=2097:00 +CPU= 23.983
  22:18:11 STEP 2098 H=2098:00 +CPU= 15.445
  22:18:26 STEP 2099 H=2099:00 +CPU= 14.967
  22:18:54 STEP 2100 H=2100:00 +CPU= 26.617
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+002100
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+002100
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+002100
  22:19:09 STEP 2101 H=2101:00 +CPU= 15.251
  22:19:26 STEP 2102 H=2102:00 +CPU= 15.832
  22:19:50 STEP 2103 H=2103:00 +CPU= 23.643
  22:20:07 STEP 2104 H=2104:00 +CPU= 15.971
  22:20:22 STEP 2105 H=2105:00 +CPU= 15.324
  22:20:48 STEP 2106 H=2106:00 +CPU= 24.619
  22:21:03 STEP 2107 H=2107:00 +CPU= 15.068
  22:21:19 STEP 2108 H=2108:00 +CPU= 15.242
  22:21:44 STEP 2109 H=2109:00 +CPU= 24.011
  22:21:59 STEP 2110 H=2110:00 +CPU= 15.464
  22:22:16 STEP 2111 H=2111:00 +CPU= 15.230
  22:23:10 STEP 2112 H=2112:00 +CPU= 27.655
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+002112
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+002112
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+002112
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+002088
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+002088
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+002088
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+002100
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+002100
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+002100
Zipping up the intermediate file: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_0406_2009050100_123_978_12195050_0_r1878420204_87.zip
Uploading the intermediate file: upload_file_87.zip
  22:23:26 STEP 2113 H=2113:00 +CPU= 15.378
  22:23:42 STEP 2114 H=2114:00 +CPU= 15.870
  22:24:07 STEP 2115 H=2115:00 +CPU= 24.116
  22:24:24 STEP 2116 H=2116:00 +CPU= 16.358
  22:24:41 STEP 2117 H=2117:00 +CPU= 15.774
  22:25:06 STEP 2118 H=2118:00 +CPU= 24.680
  22:25:23 STEP 2119 H=2119:00 +CPU= 15.812
  22:25:40 STEP 2120 H=2120:00 +CPU= 16.335
  22:26:04 STEP 2121 H=2121:00 +CPU= 24.138
  22:26:21 STEP 2122 H=2122:00 +CPU= 15.817
  22:26:37 STEP 2123 H=2123:00 +CPU= 15.490
  22:27:04 STEP 2124 H=2124:00 +CPU= 26.670
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+002124
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+002124
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+002124
  22:27:23 STEP 2125 H=2125:00 +CPU= 15.306
  22:27:40 STEP 2126 H=2126:00 +CPU= 15.915
  22:28:05 STEP 2127 H=2127:00 +CPU= 24.154
  22:28:21 STEP 2128 H=2128:00 +CPU= 15.900
  22:28:37 STEP 2129 H=2129:00 +CPU= 15.471
  22:29:03 STEP 2130 H=2130:00 +CPU= 24.763
  22:29:19 STEP 2131 H=2131:00 +CPU= 15.646
  22:29:36 STEP 2132 H=2132:00 +CPU= 16.142
  22:30:00 STEP 2133 H=2133:00 +CPU= 24.028
  22:30:17 STEP 2134 H=2134:00 +CPU= 15.917
  22:30:34 STEP 2135 H=2135:00 +CPU= 16.161
  22:31:05 STEP 2136 H=2136:00 +CPU= 28.251
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+002136
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+002136
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+002136
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+002112
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+002112
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+002112
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+002124
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+002124
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+002124
Zipping up the intermediate file: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_0406_2009050100_123_978_12195050_0_r1878420204_88.zip
Uploading the intermediate file: upload_file_88.zip
  22:31:21 STEP 2137 H=2137:00 +CPU= 15.562
  22:31:37 STEP 2138 H=2138:00 +CPU= 15.924
  22:32:02 STEP 2139 H=2139:00 +CPU= 24.012
  22:32:18 STEP 2140 H=2140:00 +CPU= 15.779
  22:32:34 STEP 2141 H=2141:00 +CPU= 15.361
  22:32:59 STEP 2142 H=2142:00 +CPU= 24.466
  22:33:15 STEP 2143 H=2143:00 +CPU= 15.334
  22:33:31 STEP 2144 H=2144:00 +CPU= 15.646
  22:33:56 STEP 2145 H=2145:00 +CPU= 24.157
  22:34:13 STEP 2146 H=2146:00 +CPU= 16.101
  22:34:29 STEP 2147 H=2147:00 +CPU= 15.574
  22:34:57 STEP 2148 H=2148:00 +CPU= 26.523
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+002148
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+002148
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+002148
  22:35:14 STEP 2149 H=2149:00 +CPU= 15.807
  22:35:31 STEP 2150 H=2150:00 +CPU= 16.232
  22:35:57 STEP 2151 H=2151:00 +CPU= 24.495
  22:36:13 STEP 2152 H=2152:00 +CPU= 15.950
  22:36:31 STEP 2153 H=2153:00 +CPU= 15.345
  22:36:56 STEP 2154 H=2154:00 +CPU= 24.435
  22:37:12 STEP 2155 H=2155:00 +CPU= 15.537
  22:37:30 STEP 2156 H=2156:00 +CPU= 16.266
  22:37:54 STEP 2157 H=2157:00 +CPU= 23.225
  22:38:10 STEP 2158 H=2158:00 +CPU= 15.603
  22:38:27 STEP 2159 H=2159:00 +CPU= 16.095
  22:39:07 STEP 2160 H=2160:00 +CPU= 28.537
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+002160
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+002160
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+002160
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+002136
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+002136
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+002136
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+002148
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+002148
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+002148
Zipping up the intermediate file: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_0406_2009050100_123_978_12195050_0_r1878420204_89.zip
  22:39:25 STEP 2161 H=2161:00 +CPU= 15.396
Uploading the intermediate file: upload_file_89.zip
  22:39:41 STEP 2162 H=2162:00 +CPU= 15.911
Uploading trickle at timestep: 7776000
  22:40:06 STEP 2163 H=2163:00 +CPU= 24.155
  22:40:23 STEP 2164 H=2164:00 +CPU= 15.984
  22:40:39 STEP 2165 H=2165:00 +CPU= 15.526
  22:41:04 STEP 2166 H=2166:00 +CPU= 24.672
  22:41:20 STEP 2167 H=2167:00 +CPU= 15.542
  22:41:37 STEP 2168 H=2168:00 +CPU= 16.084
  22:42:02 STEP 2169 H=2169:00 +CPU= 24.220
  22:42:19 STEP 2170 H=2170:00 +CPU= 16.126
  22:42:35 STEP 2171 H=2171:00 +CPU= 15.636
  22:43:03 STEP 2172 H=2172:00 +CPU= 26.670
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+002172
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+002172
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+002172
  22:43:19 STEP 2173 H=2173:00 +CPU= 15.701
  22:43:35 STEP 2174 H=2174:00 +CPU= 15.882
  22:44:00 STEP 2175 H=2175:00 +CPU= 23.830
  22:44:16 STEP 2176 H=2176:00 +CPU= 15.851
  22:44:32 STEP 2177 H=2177:00 +CPU= 15.150
  22:44:57 STEP 2178 H=2178:00 +CPU= 24.401
  22:45:13 STEP 2179 H=2179:00 +CPU= 15.408
  22:45:29 STEP 2180 H=2180:00 +CPU= 15.812
  22:45:53 STEP 2181 H=2181:00 +CPU= 23.249
  22:46:13 STEP 2182 H=2182:00 +CPU= 15.549
  22:46:31 STEP 2183 H=2183:00 +CPU= 15.704
  22:47:20 STEP 2184 H=2184:00 +CPU= 27.903
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+002184
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+002184
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+002184
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+002160
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+002160
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+002160
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMGGhq0f+002172
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMSHhq0f+002172
Adding to the zip: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_12195050/ICMUAhq0f+002172
Zipping up the intermediate file: /media/nathan/512gb/boinc/projects/climateprediction.net/oifs_43r3_ps_0406_2009050100_123_978_12195050_0_r1878420204_90.zip
Uploading the intermediate file: upload_file_90.zip
  22:47:36 STEP 2185 H=2185:00 +CPU= 15.340
  22:47:53 STEP 2186 H=2186:00 +CPU= 15.744
  22:48:17 STEP 2187 H=2187:00 +CPU= 24.104
  22:48:34 STEP 2188 H=2188:00 +CPU= 15.729
  22:48:54 STEP 2189 H=2189:00 +CPU= 15.488
  22:49:19 STEP 2190 H=2190:00 +CPU= 24.486
  22:49:35 STEP 2191 H=2191:00 +CPU= 15.459
  22:49:51 STEP 2192 H=2192:00 +CPU= 15.852
  22:50:16 STEP 2193 H=2193:00 +CPU= 24.075
  22:50:32 STEP 2194 H=2194:00 +CPU= 15.934
  22:50:48 STEP 2195 H=2195:00 +CPU= 15.390
  22:51:16 STEP 2196 H=2196:00 +CPU= 26.529
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMGGhq0f+002196
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMSHhq0f+002196
Moving to projects directory: /media/nathan/512gb/boinc/slots/2/ICMUAhq0f+002196
  22:51:32 STEP 2197 H=2197:00 +CPU= 15.437
  22:51:48 STEP 2198 H=2198:00 +CPU= 15.783
  22:52:13 STEP 2199 H=2199:00 +CPU= 23.891
  22:52:29 STEP 2200 H=2200:00 +CPU= 15.658
  22:52:44 STEP 2201 H=2201:00 +CPU= 15.282
  22:53:10 STEP 2202 H=2202:00 +CPU= 24.427
  22:53:25 STEP 2203 H=2203:00 +CPU= 15.305
  22:53:41 STEP 2204 H=2204:00 +CPU= 15.421
  22:54:06 STEP 2205 H=2205:00 +CPU= 23.454
  22:54:23 STEP 2206 H=2206:00 +CPU= 15.833
  22:54:41 STEP 2207 H=2207:00 +CPU= 15.762
Abort request received from BOINC client, ending the child process

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:19:45 1507457 22280943 oifs_43r3_ps_0406_2009050100_123_978_12195050_0 7,776,000 44,484 0.0057
09 May 2023 16:19:38 1507457 22280943 oifs_43r3_ps_0406_2009050100_123_978_12195050_0 6,912,000 39,560 0.0057
09 May 2023 16:19:28 1507457 22280943 oifs_43r3_ps_0406_2009050100_123_978_12195050_0 6,048,000 34,863 0.0058
09 May 2023 16:19:25 1507457 22280943 oifs_43r3_ps_0406_2009050100_123_978_12195050_0 5,184,000 30,133 0.0058
09 May 2023 16:19:00 1507457 22280943 oifs_43r3_ps_0406_2009050100_123_978_12195050_0 1,987,200 10,978 0.0055
09 May 2023 16:18:18 1507457 22280943 oifs_43r3_ps_0406_2009050100_123_978_12195050_0 1,123,200 6,180 0.0055


©2024 climateprediction.net