Name | oifs_43r3_ps_0509_1985050100_123_954_12171153_0 |
Workunit | 12171153 |
Created | 21 Dec 2022, 6:12:05 UTC |
Sent | 4 Jan 2023, 21:08:20 UTC |
Report deadline | 3 Feb 2023, 21:08:20 UTC |
Received | 5 Jan 2023, 13:22:58 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 1 (0x00000001) Unknown error code |
Computer ID | 1537636 |
Run time | 15 hours 14 min 2 sec |
CPU time | 15 hours 4 min 9 sec |
Validate state | Invalid |
Credit | 12,096.00 |
Device peak FLOPS | 1.00 GFLOPS |
Application version | OpenIFS 43r3 Perturbed Surface v1.05 x86_64-pc-linux-gnu |
Peak working set size | 4,238.55 MB |
Peak swap size | 4,974.27 MB |
Peak disk usage | 2,022.74 MB |
Stderr | <core_client_version>7.16.16</core_client_version> <![CDATA[ <message> process exited with code 1 (0x1, -255)</message> <stderr_txt> EP 1901 H=1901:00 +CPU= 16.982 00:24:25 STEP 1902 H=1902:00 +CPU= 27.725 00:24:42 STEP 1903 H=1903:00 +CPU= 16.992 00:25:00 STEP 1904 H=1904:00 +CPU= 17.565 00:25:27 STEP 1905 H=1905:00 +CPU= 27.161 00:25:45 STEP 1906 H=1906:00 +CPU= 17.509 00:26:02 STEP 1907 H=1907:00 +CPU= 17.013 00:26:32 STEP 1908 H=1908:00 +CPU= 29.926 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+001908 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+001908 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+001908 00:26:49 STEP 1909 H=1909:00 +CPU= 17.003 00:27:06 STEP 1910 H=1910:00 +CPU= 17.530 00:27:34 STEP 1911 H=1911:00 +CPU= 27.103 00:27:51 STEP 1912 H=1912:00 +CPU= 17.491 00:28:08 STEP 1913 H=1913:00 +CPU= 16.998 00:28:36 STEP 1914 H=1914:00 +CPU= 27.685 00:28:53 STEP 1915 H=1915:00 +CPU= 16.993 00:29:11 STEP 1916 H=1916:00 +CPU= 17.491 00:29:38 STEP 1917 H=1917:00 +CPU= 27.087 00:29:55 STEP 1918 H=1918:00 +CPU= 17.468 00:30:13 STEP 1919 H=1919:00 +CPU= 17.475 00:30:45 STEP 1920 H=1920:00 +CPU= 31.714 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+001920 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+001920 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+001920 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+001896 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+001896 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+001896 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+001908 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+001908 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+001908 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_79.zip Uploading the intermediate file: upload_file_79.zip 00:31:02 STEP 1921 H=1921:00 +CPU= 17.007 Uploading trickle at timestep: 6912000 00:31:19 STEP 1922 H=1922:00 +CPU= 17.478 00:31:47 STEP 1923 H=1923:00 +CPU= 27.110 00:32:04 STEP 1924 H=1924:00 +CPU= 17.518 00:32:21 STEP 1925 H=1925:00 +CPU= 16.983 00:32:49 STEP 1926 H=1926:00 +CPU= 27.786 00:33:06 STEP 1927 H=1927:00 +CPU= 17.065 00:33:24 STEP 1928 H=1928:00 +CPU= 17.598 00:33:51 STEP 1929 H=1929:00 +CPU= 27.163 00:34:09 STEP 1930 H=1930:00 +CPU= 17.566 00:34:26 STEP 1931 H=1931:00 +CPU= 17.023 00:34:56 STEP 1932 H=1932:00 +CPU= 29.976 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+001932 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+001932 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+001932 00:35:13 STEP 1933 H=1933:00 +CPU= 17.063 00:35:31 STEP 1934 H=1934:00 +CPU= 17.564 00:35:58 STEP 1935 H=1935:00 +CPU= 27.125 00:36:16 STEP 1936 H=1936:00 +CPU= 17.528 00:36:33 STEP 1937 H=1937:00 +CPU= 17.019 00:37:01 STEP 1938 H=1938:00 +CPU= 27.744 00:37:18 STEP 1939 H=1939:00 +CPU= 16.988 00:37:35 STEP 1940 H=1940:00 +CPU= 17.491 00:38:03 STEP 1941 H=1941:00 +CPU= 27.093 00:38:20 STEP 1942 H=1942:00 +CPU= 17.473 00:38:38 STEP 1943 H=1943:00 +CPU= 17.489 00:39:10 STEP 1944 H=1944:00 +CPU= 31.667 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+001944 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+001944 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+001944 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+001920 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+001920 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+001920 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+001932 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+001932 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+001932 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_80.zip Uploading the intermediate file: upload_file_80.zip 00:39:27 STEP 1945 H=1945:00 +CPU= 16.959 00:39:44 STEP 1946 H=1946:00 +CPU= 17.473 00:40:11 STEP 1947 H=1947:00 +CPU= 27.174 00:40:29 STEP 1948 H=1948:00 +CPU= 17.490 00:40:46 STEP 1949 H=1949:00 +CPU= 16.980 00:41:14 STEP 1950 H=1950:00 +CPU= 27.749 00:41:31 STEP 1951 H=1951:00 +CPU= 17.022 00:41:49 STEP 1952 H=1952:00 +CPU= 17.579 00:42:16 STEP 1953 H=1953:00 +CPU= 27.172 00:42:34 STEP 1954 H=1954:00 +CPU= 17.524 00:42:51 STEP 1955 H=1955:00 +CPU= 17.002 00:43:21 STEP 1956 H=1956:00 +CPU= 29.972 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+001956 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+001956 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+001956 00:43:38 STEP 1957 H=1957:00 +CPU= 17.001 00:43:55 STEP 1958 H=1958:00 +CPU= 17.505 00:44:23 STEP 1959 H=1959:00 +CPU= 27.160 00:44:40 STEP 1960 H=1960:00 +CPU= 17.544 00:44:57 STEP 1961 H=1961:00 +CPU= 16.969 00:45:25 STEP 1962 H=1962:00 +CPU= 27.720 00:45:42 STEP 1963 H=1963:00 +CPU= 17.009 00:46:00 STEP 1964 H=1964:00 +CPU= 17.478 00:46:27 STEP 1965 H=1965:00 +CPU= 27.203 00:46:45 STEP 1966 H=1966:00 +CPU= 17.528 00:47:02 STEP 1967 H=1967:00 +CPU= 17.483 00:47:34 STEP 1968 H=1968:00 +CPU= 31.704 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+001968 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+001968 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+001968 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+001944 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+001944 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+001944 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+001956 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+001956 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+001956 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_81.zip Uploading the intermediate file: upload_file_81.zip 00:47:51 STEP 1969 H=1969:00 +CPU= 16.984 00:48:09 STEP 1970 H=1970:00 +CPU= 17.512 00:48:36 STEP 1971 H=1971:00 +CPU= 27.153 00:48:54 STEP 1972 H=1972:00 +CPU= 17.531 00:49:11 STEP 1973 H=1973:00 +CPU= 17.019 00:49:39 STEP 1974 H=1974:00 +CPU= 27.749 00:49:56 STEP 1975 H=1975:00 +CPU= 17.003 00:50:13 STEP 1976 H=1976:00 +CPU= 17.607 00:50:41 STEP 1977 H=1977:00 +CPU= 27.178 00:50:58 STEP 1978 H=1978:00 +CPU= 17.526 00:51:15 STEP 1979 H=1979:00 +CPU= 17.038 00:51:45 STEP 1980 H=1980:00 +CPU= 29.952 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+001980 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+001980 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+001980 00:52:02 STEP 1981 H=1981:00 +CPU= 17.030 00:52:20 STEP 1982 H=1982:00 +CPU= 17.504 00:52:47 STEP 1983 H=1983:00 +CPU= 27.174 00:53:05 STEP 1984 H=1984:00 +CPU= 17.520 00:53:22 STEP 1985 H=1985:00 +CPU= 16.971 00:53:50 STEP 1986 H=1986:00 +CPU= 27.687 00:54:07 STEP 1987 H=1987:00 +CPU= 16.989 00:54:24 STEP 1988 H=1988:00 +CPU= 17.456 00:54:52 STEP 1989 H=1989:00 +CPU= 27.116 00:55:09 STEP 1990 H=1990:00 +CPU= 17.481 00:55:27 STEP 1991 H=1991:00 +CPU= 17.436 00:55:58 STEP 1992 H=1992:00 +CPU= 31.671 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+001992 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+001992 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+001992 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+001968 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+001968 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+001968 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+001980 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+001980 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+001980 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_82.zip Uploading the intermediate file: upload_file_82.zip 00:56:15 STEP 1993 H=1993:00 +CPU= 16.968 00:56:33 STEP 1994 H=1994:00 +CPU= 17.453 00:57:00 STEP 1995 H=1995:00 +CPU= 27.094 00:57:18 STEP 1996 H=1996:00 +CPU= 17.496 00:57:35 STEP 1997 H=1997:00 +CPU= 16.968 00:58:03 STEP 1998 H=1998:00 +CPU= 27.719 00:58:20 STEP 1999 H=1999:00 +CPU= 16.980 00:58:37 STEP 2000 H=2000:00 +CPU= 17.558 00:59:05 STEP 2001 H=2001:00 +CPU= 27.145 00:59:22 STEP 2002 H=2002:00 +CPU= 17.503 00:59:39 STEP 2003 H=2003:00 +CPU= 16.988 01:00:09 STEP 2004 H=2004:00 +CPU= 29.965 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002004 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002004 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002004 01:00:26 STEP 2005 H=2005:00 +CPU= 16.986 01:00:44 STEP 2006 H=2006:00 +CPU= 17.503 01:01:11 STEP 2007 H=2007:00 +CPU= 27.139 01:01:29 STEP 2008 H=2008:00 +CPU= 17.496 01:01:46 STEP 2009 H=2009:00 +CPU= 16.979 01:02:14 STEP 2010 H=2010:00 +CPU= 27.727 01:02:31 STEP 2011 H=2011:00 +CPU= 16.967 01:02:48 STEP 2012 H=2012:00 +CPU= 17.481 01:03:16 STEP 2013 H=2013:00 +CPU= 27.115 01:03:33 STEP 2014 H=2014:00 +CPU= 17.466 01:03:51 STEP 2015 H=2015:00 +CPU= 17.441 01:04:22 STEP 2016 H=2016:00 +CPU= 31.677 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002016 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002016 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002016 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+001992 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+001992 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+001992 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002004 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002004 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002004 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_83.zip Uploading the intermediate file: upload_file_83.zip 01:04:39 STEP 2017 H=2017:00 +CPU= 16.967 01:04:57 STEP 2018 H=2018:00 +CPU= 17.464 01:05:24 STEP 2019 H=2019:00 +CPU= 27.114 01:05:42 STEP 2020 H=2020:00 +CPU= 17.474 01:05:59 STEP 2021 H=2021:00 +CPU= 16.972 01:06:27 STEP 2022 H=2022:00 +CPU= 27.739 01:06:44 STEP 2023 H=2023:00 +CPU= 16.985 01:07:01 STEP 2024 H=2024:00 +CPU= 17.589 01:07:29 STEP 2025 H=2025:00 +CPU= 27.129 01:07:46 STEP 2026 H=2026:00 +CPU= 17.509 01:08:03 STEP 2027 H=2027:00 +CPU= 17.025 01:08:33 STEP 2028 H=2028:00 +CPU= 29.931 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002028 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002028 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002028 01:08:50 STEP 2029 H=2029:00 +CPU= 16.994 01:09:08 STEP 2030 H=2030:00 +CPU= 17.531 01:09:35 STEP 2031 H=2031:00 +CPU= 27.122 01:09:53 STEP 2032 H=2032:00 +CPU= 17.486 01:10:10 STEP 2033 H=2033:00 +CPU= 16.989 01:10:38 STEP 2034 H=2034:00 +CPU= 27.700 01:10:55 STEP 2035 H=2035:00 +CPU= 16.962 01:11:12 STEP 2036 H=2036:00 +CPU= 17.492 01:11:39 STEP 2037 H=2037:00 +CPU= 27.119 01:11:57 STEP 2038 H=2038:00 +CPU= 17.454 01:12:14 STEP 2039 H=2039:00 +CPU= 17.463 01:12:46 STEP 2040 H=2040:00 +CPU= 31.664 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002040 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002040 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002040 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002016 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002016 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002016 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002028 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002028 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002028 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_84.zip Uploading the intermediate file: upload_file_84.zip 01:13:03 STEP 2041 H=2041:00 +CPU= 16.994 01:13:21 STEP 2042 H=2042:00 +CPU= 17.465 01:13:48 STEP 2043 H=2043:00 +CPU= 27.105 01:14:06 STEP 2044 H=2044:00 +CPU= 17.502 01:14:23 STEP 2045 H=2045:00 +CPU= 16.964 01:14:50 STEP 2046 H=2046:00 +CPU= 27.723 01:15:08 STEP 2047 H=2047:00 +CPU= 17.010 01:15:25 STEP 2048 H=2048:00 +CPU= 17.577 01:15:52 STEP 2049 H=2049:00 +CPU= 27.139 01:16:10 STEP 2050 H=2050:00 +CPU= 17.526 01:16:27 STEP 2051 H=2051:00 +CPU= 17.001 01:16:57 STEP 2052 H=2052:00 +CPU= 29.951 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002052 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002052 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002052 01:17:14 STEP 2053 H=2053:00 +CPU= 17.030 01:17:32 STEP 2054 H=2054:00 +CPU= 17.538 01:17:59 STEP 2055 H=2055:00 +CPU= 27.132 01:18:17 STEP 2056 H=2056:00 +CPU= 17.535 01:18:34 STEP 2057 H=2057:00 +CPU= 16.973 01:19:02 STEP 2058 H=2058:00 +CPU= 27.747 01:19:19 STEP 2059 H=2059:00 +CPU= 16.964 01:19:36 STEP 2060 H=2060:00 +CPU= 17.466 01:20:03 STEP 2061 H=2061:00 +CPU= 27.134 01:20:21 STEP 2062 H=2062:00 +CPU= 17.493 01:20:39 STEP 2063 H=2063:00 +CPU= 17.449 01:21:10 STEP 2064 H=2064:00 +CPU= 31.670 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002064 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002064 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002064 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002040 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002040 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002040 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002052 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002052 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002052 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_85.zip Uploading the intermediate file: upload_file_85.zip 01:21:27 STEP 2065 H=2065:00 +CPU= 16.954 01:21:45 STEP 2066 H=2066:00 +CPU= 17.458 01:22:12 STEP 2067 H=2067:00 +CPU= 27.096 01:22:30 STEP 2068 H=2068:00 +CPU= 17.474 01:22:47 STEP 2069 H=2069:00 +CPU= 16.966 01:23:14 STEP 2070 H=2070:00 +CPU= 27.701 01:23:32 STEP 2071 H=2071:00 +CPU= 16.977 01:23:49 STEP 2072 H=2072:00 +CPU= 17.536 01:24:16 STEP 2073 H=2073:00 +CPU= 27.124 01:24:34 STEP 2074 H=2074:00 +CPU= 17.509 01:24:51 STEP 2075 H=2075:00 +CPU= 16.997 01:25:21 STEP 2076 H=2076:00 +CPU= 29.928 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002076 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002076 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002076 01:25:38 STEP 2077 H=2077:00 +CPU= 16.996 01:25:56 STEP 2078 H=2078:00 +CPU= 17.510 01:26:23 STEP 2079 H=2079:00 +CPU= 27.125 01:26:41 STEP 2080 H=2080:00 +CPU= 17.493 01:26:58 STEP 2081 H=2081:00 +CPU= 16.965 01:27:25 STEP 2082 H=2082:00 +CPU= 27.686 01:27:42 STEP 2083 H=2083:00 +CPU= 17.033 01:28:00 STEP 2084 H=2084:00 +CPU= 17.478 01:28:27 STEP 2085 H=2085:00 +CPU= 27.116 01:28:45 STEP 2086 H=2086:00 +CPU= 17.452 01:29:02 STEP 2087 H=2087:00 +CPU= 17.460 01:29:34 STEP 2088 H=2088:00 +CPU= 31.623 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002088 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002088 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002088 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002064 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002064 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002064 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002076 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002076 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002076 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_86.zip Uploading the intermediate file: upload_file_86.zip 01:29:51 STEP 2089 H=2089:00 +CPU= 16.960 01:30:09 STEP 2090 H=2090:00 +CPU= 17.502 01:30:36 STEP 2091 H=2091:00 +CPU= 27.079 01:30:53 STEP 2092 H=2092:00 +CPU= 17.477 01:31:10 STEP 2093 H=2093:00 +CPU= 16.993 01:31:38 STEP 2094 H=2094:00 +CPU= 27.666 01:31:55 STEP 2095 H=2095:00 +CPU= 16.988 01:32:13 STEP 2096 H=2096:00 +CPU= 17.569 01:32:40 STEP 2097 H=2097:00 +CPU= 27.136 01:32:58 STEP 2098 H=2098:00 +CPU= 17.517 01:33:15 STEP 2099 H=2099:00 +CPU= 17.027 01:33:45 STEP 2100 H=2100:00 +CPU= 29.903 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002100 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002100 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002100 01:34:02 STEP 2101 H=2101:00 +CPU= 17.017 01:34:20 STEP 2102 H=2102:00 +CPU= 17.500 01:34:47 STEP 2103 H=2103:00 +CPU= 27.079 01:35:04 STEP 2104 H=2104:00 +CPU= 17.516 01:35:21 STEP 2105 H=2105:00 +CPU= 16.966 01:35:49 STEP 2106 H=2106:00 +CPU= 27.650 01:36:06 STEP 2107 H=2107:00 +CPU= 16.987 01:36:24 STEP 2108 H=2108:00 +CPU= 17.462 01:36:51 STEP 2109 H=2109:00 +CPU= 27.051 01:37:08 STEP 2110 H=2110:00 +CPU= 17.464 01:37:26 STEP 2111 H=2111:00 +CPU= 17.429 01:37:58 STEP 2112 H=2112:00 +CPU= 31.600 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002112 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002112 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002112 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002088 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002088 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002088 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002100 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002100 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002100 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_87.zip Uploading the intermediate file: upload_file_87.zip 01:38:15 STEP 2113 H=2113:00 +CPU= 16.965 01:38:32 STEP 2114 H=2114:00 +CPU= 17.451 01:38:59 STEP 2115 H=2115:00 +CPU= 27.069 01:39:17 STEP 2116 H=2116:00 +CPU= 17.498 01:39:34 STEP 2117 H=2117:00 +CPU= 16.962 01:40:02 STEP 2118 H=2118:00 +CPU= 27.689 01:40:19 STEP 2119 H=2119:00 +CPU= 16.982 01:40:36 STEP 2120 H=2120:00 +CPU= 17.556 01:41:04 STEP 2121 H=2121:00 +CPU= 27.112 01:41:21 STEP 2122 H=2122:00 +CPU= 17.496 01:41:38 STEP 2123 H=2123:00 +CPU= 16.998 01:42:08 STEP 2124 H=2124:00 +CPU= 29.918 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002124 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002124 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002124 01:42:25 STEP 2125 H=2125:00 +CPU= 17.018 01:42:43 STEP 2126 H=2126:00 +CPU= 17.512 01:43:10 STEP 2127 H=2127:00 +CPU= 27.128 01:43:28 STEP 2128 H=2128:00 +CPU= 17.508 01:43:45 STEP 2129 H=2129:00 +CPU= 16.985 01:44:13 STEP 2130 H=2130:00 +CPU= 27.700 01:44:30 STEP 2131 H=2131:00 +CPU= 16.980 01:44:47 STEP 2132 H=2132:00 +CPU= 17.484 01:45:15 STEP 2133 H=2133:00 +CPU= 27.091 01:45:32 STEP 2134 H=2134:00 +CPU= 17.472 01:45:50 STEP 2135 H=2135:00 +CPU= 17.449 01:46:21 STEP 2136 H=2136:00 +CPU= 31.646 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002136 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002136 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002136 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002112 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002112 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002112 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002124 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002124 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002124 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_88.zip Uploading the intermediate file: upload_file_88.zip 01:46:38 STEP 2137 H=2137:00 +CPU= 16.946 01:46:56 STEP 2138 H=2138:00 +CPU= 17.456 01:47:23 STEP 2139 H=2139:00 +CPU= 27.086 01:47:41 STEP 2140 H=2140:00 +CPU= 17.484 01:47:58 STEP 2141 H=2141:00 +CPU= 16.964 01:48:26 STEP 2142 H=2142:00 +CPU= 27.692 01:48:43 STEP 2143 H=2143:00 +CPU= 16.984 01:49:00 STEP 2144 H=2144:00 +CPU= 17.571 01:49:28 STEP 2145 H=2145:00 +CPU= 27.189 01:49:45 STEP 2146 H=2146:00 +CPU= 17.507 01:50:02 STEP 2147 H=2147:00 +CPU= 17.013 01:50:32 STEP 2148 H=2148:00 +CPU= 29.887 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002148 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002148 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002148 01:50:49 STEP 2149 H=2149:00 +CPU= 17.010 01:51:07 STEP 2150 H=2150:00 +CPU= 17.546 01:51:34 STEP 2151 H=2151:00 +CPU= 27.085 01:51:52 STEP 2152 H=2152:00 +CPU= 17.503 01:52:09 STEP 2153 H=2153:00 +CPU= 17.022 01:52:37 STEP 2154 H=2154:00 +CPU= 27.684 01:52:54 STEP 2155 H=2155:00 +CPU= 16.976 01:53:11 STEP 2156 H=2156:00 +CPU= 17.504 01:53:39 STEP 2157 H=2157:00 +CPU= 27.083 01:53:56 STEP 2158 H=2158:00 +CPU= 17.473 01:54:14 STEP 2159 H=2159:00 +CPU= 17.483 01:54:45 STEP 2160 H=2160:00 +CPU= 31.613 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002160 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002160 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002160 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002136 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002136 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002136 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002148 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002148 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002148 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_89.zip Uploading the intermediate file: upload_file_89.zip 01:55:02 STEP 2161 H=2161:00 +CPU= 16.989 Uploading trickle at timestep: 7776000 01:55:20 STEP 2162 H=2162:00 +CPU= 17.460 01:55:47 STEP 2163 H=2163:00 +CPU= 27.057 01:56:05 STEP 2164 H=2164:00 +CPU= 17.512 01:56:22 STEP 2165 H=2165:00 +CPU= 16.976 01:56:50 STEP 2166 H=2166:00 +CPU= 27.674 01:57:07 STEP 2167 H=2167:00 +CPU= 17.018 01:57:24 STEP 2168 H=2168:00 +CPU= 17.549 01:57:51 STEP 2169 H=2169:00 +CPU= 27.109 01:58:09 STEP 2170 H=2170:00 +CPU= 17.548 01:58:26 STEP 2171 H=2171:00 +CPU= 17.008 01:58:56 STEP 2172 H=2172:00 +CPU= 29.895 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002172 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002172 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002172 01:59:13 STEP 2173 H=2173:00 +CPU= 17.048 01:59:31 STEP 2174 H=2174:00 +CPU= 17.521 01:59:58 STEP 2175 H=2175:00 +CPU= 27.100 02:00:16 STEP 2176 H=2176:00 +CPU= 17.532 02:00:33 STEP 2177 H=2177:00 +CPU= 16.991 02:01:01 STEP 2178 H=2178:00 +CPU= 27.682 02:01:18 STEP 2179 H=2179:00 +CPU= 17.001 02:01:35 STEP 2180 H=2180:00 +CPU= 17.485 02:02:02 STEP 2181 H=2181:00 +CPU= 27.140 02:02:20 STEP 2182 H=2182:00 +CPU= 17.463 02:02:38 STEP 2183 H=2183:00 +CPU= 17.517 02:03:09 STEP 2184 H=2184:00 +CPU= 31.654 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002184 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002184 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002184 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002160 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002160 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002160 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002172 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002172 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002172 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_90.zip Uploading the intermediate file: upload_file_90.zip 02:03:26 STEP 2185 H=2185:00 +CPU= 16.976 02:03:44 STEP 2186 H=2186:00 +CPU= 17.466 02:04:11 STEP 2187 H=2187:00 +CPU= 27.104 02:04:29 STEP 2188 H=2188:00 +CPU= 17.539 02:04:46 STEP 2189 H=2189:00 +CPU= 17.006 02:05:14 STEP 2190 H=2190:00 +CPU= 27.729 02:05:31 STEP 2191 H=2191:00 +CPU= 17.004 02:05:48 STEP 2192 H=2192:00 +CPU= 17.518 02:06:16 STEP 2193 H=2193:00 +CPU= 27.151 02:06:33 STEP 2194 H=2194:00 +CPU= 17.528 02:06:50 STEP 2195 H=2195:00 +CPU= 17.006 02:07:20 STEP 2196 H=2196:00 +CPU= 29.911 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002196 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002196 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002196 02:07:37 STEP 2197 H=2197:00 +CPU= 17.012 02:07:55 STEP 2198 H=2198:00 +CPU= 17.516 02:08:22 STEP 2199 H=2199:00 +CPU= 27.129 02:08:40 STEP 2200 H=2200:00 +CPU= 17.499 02:08:57 STEP 2201 H=2201:00 +CPU= 17.033 02:09:25 STEP 2202 H=2202:00 +CPU= 27.717 02:09:42 STEP 2203 H=2203:00 +CPU= 16.982 02:09:59 STEP 2204 H=2204:00 +CPU= 17.484 02:10:27 STEP 2205 H=2205:00 +CPU= 27.129 02:10:44 STEP 2206 H=2206:00 +CPU= 17.468 02:11:02 STEP 2207 H=2207:00 +CPU= 17.499 02:11:34 STEP 2208 H=2208:00 +CPU= 31.648 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002208 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002208 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002208 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002184 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002184 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002184 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002196 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002196 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002196 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_91.zip Uploading the intermediate file: upload_file_91.zip 02:11:51 STEP 2209 H=2209:00 +CPU= 16.978 02:12:08 STEP 2210 H=2210:00 +CPU= 17.500 02:12:35 STEP 2211 H=2211:00 +CPU= 27.110 02:12:53 STEP 2212 H=2212:00 +CPU= 17.534 02:13:10 STEP 2213 H=2213:00 +CPU= 17.037 02:13:38 STEP 2214 H=2214:00 +CPU= 27.721 02:13:55 STEP 2215 H=2215:00 +CPU= 17.026 02:14:13 STEP 2216 H=2216:00 +CPU= 17.557 02:14:40 STEP 2217 H=2217:00 +CPU= 27.141 02:14:58 STEP 2218 H=2218:00 +CPU= 17.535 02:15:15 STEP 2219 H=2219:00 +CPU= 17.043 02:15:45 STEP 2220 H=2220:00 +CPU= 29.953 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002220 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002220 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002220 02:16:02 STEP 2221 H=2221:00 +CPU= 17.057 02:16:19 STEP 2222 H=2222:00 +CPU= 17.534 02:16:47 STEP 2223 H=2223:00 +CPU= 27.141 02:17:04 STEP 2224 H=2224:00 +CPU= 17.543 02:17:21 STEP 2225 H=2225:00 +CPU= 16.993 02:17:49 STEP 2226 H=2226:00 +CPU= 27.713 02:18:06 STEP 2227 H=2227:00 +CPU= 17.013 02:18:24 STEP 2228 H=2228:00 +CPU= 17.485 02:18:51 STEP 2229 H=2229:00 +CPU= 27.130 02:19:09 STEP 2230 H=2230:00 +CPU= 17.502 02:19:26 STEP 2231 H=2231:00 +CPU= 17.460 02:19:58 STEP 2232 H=2232:00 +CPU= 31.651 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002232 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002232 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002232 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002208 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002208 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002208 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002220 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002220 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002220 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_92.zip Uploading the intermediate file: upload_file_92.zip 02:20:15 STEP 2233 H=2233:00 +CPU= 17.003 02:20:33 STEP 2234 H=2234:00 +CPU= 17.475 02:21:00 STEP 2235 H=2235:00 +CPU= 27.185 02:21:18 STEP 2236 H=2236:00 +CPU= 17.526 02:21:35 STEP 2237 H=2237:00 +CPU= 16.990 02:22:02 STEP 2238 H=2238:00 +CPU= 27.749 02:22:20 STEP 2239 H=2239:00 +CPU= 17.008 02:22:37 STEP 2240 H=2240:00 +CPU= 17.532 02:23:04 STEP 2241 H=2241:00 +CPU= 27.175 02:23:22 STEP 2242 H=2242:00 +CPU= 17.522 02:23:39 STEP 2243 H=2243:00 +CPU= 17.010 02:24:09 STEP 2244 H=2244:00 +CPU= 29.975 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002244 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002244 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002244 02:24:26 STEP 2245 H=2245:00 +CPU= 17.014 02:24:44 STEP 2246 H=2246:00 +CPU= 17.525 02:25:11 STEP 2247 H=2247:00 +CPU= 27.158 02:25:29 STEP 2248 H=2248:00 +CPU= 17.506 02:25:46 STEP 2249 H=2249:00 +CPU= 16.982 02:26:14 STEP 2250 H=2250:00 +CPU= 27.720 02:26:31 STEP 2251 H=2251:00 +CPU= 16.979 02:26:48 STEP 2252 H=2252:00 +CPU= 17.473 02:27:15 STEP 2253 H=2253:00 +CPU= 27.118 02:27:33 STEP 2254 H=2254:00 +CPU= 17.476 02:27:50 STEP 2255 H=2255:00 +CPU= 17.445 02:28:22 STEP 2256 H=2256:00 +CPU= 31.668 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002256 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002256 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002256 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002232 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002232 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002232 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002244 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002244 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002244 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_93.zip Uploading the intermediate file: upload_file_93.zip 02:28:39 STEP 2257 H=2257:00 +CPU= 16.962 02:28:57 STEP 2258 H=2258:00 +CPU= 17.463 02:29:24 STEP 2259 H=2259:00 +CPU= 27.104 02:29:42 STEP 2260 H=2260:00 +CPU= 17.485 02:29:59 STEP 2261 H=2261:00 +CPU= 16.972 02:30:26 STEP 2262 H=2262:00 +CPU= 27.739 02:30:44 STEP 2263 H=2263:00 +CPU= 17.005 02:31:01 STEP 2264 H=2264:00 +CPU= 17.561 02:31:28 STEP 2265 H=2265:00 +CPU= 27.121 02:31:46 STEP 2266 H=2266:00 +CPU= 17.521 02:32:03 STEP 2267 H=2267:00 +CPU= 17.043 02:32:33 STEP 2268 H=2268:00 +CPU= 29.930 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002268 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002268 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002268 02:32:50 STEP 2269 H=2269:00 +CPU= 17.015 02:33:08 STEP 2270 H=2270:00 +CPU= 17.543 02:33:35 STEP 2271 H=2271:00 +CPU= 27.099 02:33:53 STEP 2272 H=2272:00 +CPU= 17.500 02:34:10 STEP 2273 H=2273:00 +CPU= 17.019 02:34:38 STEP 2274 H=2274:00 +CPU= 27.684 02:34:55 STEP 2275 H=2275:00 +CPU= 16.989 02:35:12 STEP 2276 H=2276:00 +CPU= 17.508 02:35:39 STEP 2277 H=2277:00 +CPU= 27.112 02:35:57 STEP 2278 H=2278:00 +CPU= 17.480 02:36:15 STEP 2279 H=2279:00 +CPU= 17.476 02:36:46 STEP 2280 H=2280:00 +CPU= 31.659 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002280 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002280 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002280 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002256 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002256 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002256 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002268 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002268 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002268 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_94.zip Uploading the intermediate file: upload_file_94.zip 02:37:03 STEP 2281 H=2281:00 +CPU= 17.008 02:37:21 STEP 2282 H=2282:00 +CPU= 17.473 02:37:48 STEP 2283 H=2283:00 +CPU= 27.138 02:38:06 STEP 2284 H=2284:00 +CPU= 17.515 02:38:23 STEP 2285 H=2285:00 +CPU= 16.974 02:38:51 STEP 2286 H=2286:00 +CPU= 27.668 02:39:08 STEP 2287 H=2287:00 +CPU= 17.027 02:39:25 STEP 2288 H=2288:00 +CPU= 17.559 02:39:53 STEP 2289 H=2289:00 +CPU= 27.143 02:40:10 STEP 2290 H=2290:00 +CPU= 17.541 02:40:27 STEP 2291 H=2291:00 +CPU= 17.001 02:40:57 STEP 2292 H=2292:00 +CPU= 29.895 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002292 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002292 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002292 02:41:15 STEP 2293 H=2293:00 +CPU= 17.037 02:41:32 STEP 2294 H=2294:00 +CPU= 17.522 02:41:59 STEP 2295 H=2295:00 +CPU= 27.106 02:42:17 STEP 2296 H=2296:00 +CPU= 17.539 02:42:34 STEP 2297 H=2297:00 +CPU= 17.000 02:43:02 STEP 2298 H=2298:00 +CPU= 27.691 02:43:19 STEP 2299 H=2299:00 +CPU= 16.992 02:43:36 STEP 2300 H=2300:00 +CPU= 17.489 02:44:04 STEP 2301 H=2301:00 +CPU= 27.096 02:44:21 STEP 2302 H=2302:00 +CPU= 17.472 02:44:39 STEP 2303 H=2303:00 +CPU= 17.452 02:45:10 STEP 2304 H=2304:00 +CPU= 31.650 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002304 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002304 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002304 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002280 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002280 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002280 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002292 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002292 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002292 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_95.zip Uploading the intermediate file: upload_file_95.zip 02:45:27 STEP 2305 H=2305:00 +CPU= 16.949 02:45:45 STEP 2306 H=2306:00 +CPU= 17.467 02:46:12 STEP 2307 H=2307:00 +CPU= 27.110 02:46:30 STEP 2308 H=2308:00 +CPU= 17.475 02:46:47 STEP 2309 H=2309:00 +CPU= 16.976 02:47:15 STEP 2310 H=2310:00 +CPU= 27.711 02:47:32 STEP 2311 H=2311:00 +CPU= 17.005 02:47:49 STEP 2312 H=2312:00 +CPU= 17.563 02:48:17 STEP 2313 H=2313:00 +CPU= 27.140 02:48:34 STEP 2314 H=2314:00 +CPU= 17.558 02:48:51 STEP 2315 H=2315:00 +CPU= 16.998 02:49:21 STEP 2316 H=2316:00 +CPU= 29.949 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002316 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002316 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002316 02:49:38 STEP 2317 H=2317:00 +CPU= 17.006 02:49:56 STEP 2318 H=2318:00 +CPU= 17.530 02:50:23 STEP 2319 H=2319:00 +CPU= 27.147 02:50:41 STEP 2320 H=2320:00 +CPU= 17.502 02:50:58 STEP 2321 H=2321:00 +CPU= 16.984 02:51:26 STEP 2322 H=2322:00 +CPU= 27.723 02:51:43 STEP 2323 H=2323:00 +CPU= 16.978 02:52:00 STEP 2324 H=2324:00 +CPU= 17.486 02:52:28 STEP 2325 H=2325:00 +CPU= 27.133 02:52:45 STEP 2326 H=2326:00 +CPU= 17.470 02:53:03 STEP 2327 H=2327:00 +CPU= 17.456 02:53:35 STEP 2328 H=2328:00 +CPU= 31.663 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002328 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002328 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002328 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002304 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002304 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002304 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002316 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002316 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002316 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_96.zip Uploading the intermediate file: upload_file_96.zip 02:53:52 STEP 2329 H=2329:00 +CPU= 16.960 02:54:09 STEP 2330 H=2330:00 +CPU= 17.488 02:54:36 STEP 2331 H=2331:00 +CPU= 27.119 02:54:54 STEP 2332 H=2332:00 +CPU= 17.477 02:55:11 STEP 2333 H=2333:00 +CPU= 17.009 02:55:39 STEP 2334 H=2334:00 +CPU= 27.716 02:55:56 STEP 2335 H=2335:00 +CPU= 16.999 02:56:14 STEP 2336 H=2336:00 +CPU= 17.599 02:56:41 STEP 2337 H=2337:00 +CPU= 27.140 02:56:58 STEP 2338 H=2338:00 +CPU= 17.524 02:57:16 STEP 2339 H=2339:00 +CPU= 17.034 02:57:46 STEP 2340 H=2340:00 +CPU= 29.917 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002340 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002340 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002340 02:58:03 STEP 2341 H=2341:00 +CPU= 17.043 02:58:20 STEP 2342 H=2342:00 +CPU= 17.540 02:58:48 STEP 2343 H=2343:00 +CPU= 27.152 02:59:05 STEP 2344 H=2344:00 +CPU= 17.548 02:59:22 STEP 2345 H=2345:00 +CPU= 17.001 02:59:50 STEP 2346 H=2346:00 +CPU= 27.724 03:00:07 STEP 2347 H=2347:00 +CPU= 17.021 03:00:25 STEP 2348 H=2348:00 +CPU= 17.500 03:00:52 STEP 2349 H=2349:00 +CPU= 27.140 03:01:10 STEP 2350 H=2350:00 +CPU= 17.513 03:01:27 STEP 2351 H=2351:00 +CPU= 17.457 03:01:59 STEP 2352 H=2352:00 +CPU= 31.634 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002352 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002352 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002352 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002328 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002328 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002328 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002340 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002340 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002340 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_97.zip Uploading the intermediate file: upload_file_97.zip 03:02:16 STEP 2353 H=2353:00 +CPU= 16.990 03:02:34 STEP 2354 H=2354:00 +CPU= 17.476 03:03:01 STEP 2355 H=2355:00 +CPU= 27.100 03:03:18 STEP 2356 H=2356:00 +CPU= 17.485 03:03:35 STEP 2357 H=2357:00 +CPU= 16.983 03:04:03 STEP 2358 H=2358:00 +CPU= 27.738 03:04:20 STEP 2359 H=2359:00 +CPU= 16.990 03:04:38 STEP 2360 H=2360:00 +CPU= 17.560 03:05:05 STEP 2361 H=2361:00 +CPU= 27.200 03:05:23 STEP 2362 H=2362:00 +CPU= 17.522 03:05:40 STEP 2363 H=2363:00 +CPU= 17.011 03:06:10 STEP 2364 H=2364:00 +CPU= 29.976 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002364 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002364 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002364 03:06:27 STEP 2365 H=2365:00 +CPU= 17.015 03:06:45 STEP 2366 H=2366:00 +CPU= 17.533 03:07:12 STEP 2367 H=2367:00 +CPU= 27.158 03:07:30 STEP 2368 H=2368:00 +CPU= 17.509 03:07:47 STEP 2369 H=2369:00 +CPU= 16.985 03:08:15 STEP 2370 H=2370:00 +CPU= 27.749 03:08:32 STEP 2371 H=2371:00 +CPU= 16.989 03:08:49 STEP 2372 H=2372:00 +CPU= 17.494 03:09:16 STEP 2373 H=2373:00 +CPU= 27.137 03:09:34 STEP 2374 H=2374:00 +CPU= 17.489 03:09:51 STEP 2375 H=2375:00 +CPU= 17.459 03:10:23 STEP 2376 H=2376:00 +CPU= 31.678 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002376 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002376 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002376 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002352 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002352 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002352 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002364 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002364 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002364 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_98.zip Uploading the intermediate file: upload_file_98.zip 03:10:40 STEP 2377 H=2377:00 +CPU= 16.982 03:10:58 STEP 2378 H=2378:00 +CPU= 17.483 03:11:25 STEP 2379 H=2379:00 +CPU= 27.144 03:11:43 STEP 2380 H=2380:00 +CPU= 17.513 03:12:00 STEP 2381 H=2381:00 +CPU= 16.996 03:12:28 STEP 2382 H=2382:00 +CPU= 27.763 03:12:45 STEP 2383 H=2383:00 +CPU= 17.077 03:13:03 STEP 2384 H=2384:00 +CPU= 17.585 03:13:30 STEP 2385 H=2385:00 +CPU= 27.156 03:13:48 STEP 2386 H=2386:00 +CPU= 17.524 03:14:05 STEP 2387 H=2387:00 +CPU= 17.041 03:14:35 STEP 2388 H=2388:00 +CPU= 29.942 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002388 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002388 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002388 03:14:52 STEP 2389 H=2389:00 +CPU= 17.013 03:15:09 STEP 2390 H=2390:00 +CPU= 17.554 03:15:37 STEP 2391 H=2391:00 +CPU= 27.127 03:15:54 STEP 2392 H=2392:00 +CPU= 17.522 03:16:11 STEP 2393 H=2393:00 +CPU= 17.027 03:16:39 STEP 2394 H=2394:00 +CPU= 27.724 03:16:56 STEP 2395 H=2395:00 +CPU= 16.994 03:17:14 STEP 2396 H=2396:00 +CPU= 17.546 03:17:41 STEP 2397 H=2397:00 +CPU= 27.146 03:17:59 STEP 2398 H=2398:00 +CPU= 17.485 03:18:16 STEP 2399 H=2399:00 +CPU= 17.509 03:18:48 STEP 2400 H=2400:00 +CPU= 31.680 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002400 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002400 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002400 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002376 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002376 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002376 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002388 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002388 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002388 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_99.zip Uploading the intermediate file: upload_file_99.zip 03:19:05 STEP 2401 H=2401:00 +CPU= 17.034 Uploading trickle at timestep: 8640000 03:19:23 STEP 2402 H=2402:00 +CPU= 17.481 03:19:50 STEP 2403 H=2403:00 +CPU= 27.121 03:20:08 STEP 2404 H=2404:00 +CPU= 17.519 03:20:25 STEP 2405 H=2405:00 +CPU= 16.980 03:20:52 STEP 2406 H=2406:00 +CPU= 27.719 03:21:10 STEP 2407 H=2407:00 +CPU= 17.017 03:21:27 STEP 2408 H=2408:00 +CPU= 17.561 03:21:54 STEP 2409 H=2409:00 +CPU= 27.149 03:22:12 STEP 2410 H=2410:00 +CPU= 17.547 03:22:29 STEP 2411 H=2411:00 +CPU= 17.014 03:22:59 STEP 2412 H=2412:00 +CPU= 29.945 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002412 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002412 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002412 03:23:16 STEP 2413 H=2413:00 +CPU= 17.037 03:23:34 STEP 2414 H=2414:00 +CPU= 17.518 03:24:01 STEP 2415 H=2415:00 +CPU= 27.128 03:24:19 STEP 2416 H=2416:00 +CPU= 17.497 03:24:36 STEP 2417 H=2417:00 +CPU= 16.987 03:25:04 STEP 2418 H=2418:00 +CPU= 27.715 03:25:21 STEP 2419 H=2419:00 +CPU= 16.983 03:25:38 STEP 2420 H=2420:00 +CPU= 17.479 03:26:05 STEP 2421 H=2421:00 +CPU= 27.168 03:26:23 STEP 2422 H=2422:00 +CPU= 17.477 03:26:41 STEP 2423 H=2423:00 +CPU= 17.461 03:27:12 STEP 2424 H=2424:00 +CPU= 31.724 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002424 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002424 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002424 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002400 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002400 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002400 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002412 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002412 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002412 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_100.zip Uploading the intermediate file: upload_file_100.zip 03:27:29 STEP 2425 H=2425:00 +CPU= 16.974 03:27:47 STEP 2426 H=2426:00 +CPU= 17.495 03:28:14 STEP 2427 H=2427:00 +CPU= 27.150 03:28:32 STEP 2428 H=2428:00 +CPU= 17.507 03:28:49 STEP 2429 H=2429:00 +CPU= 17.042 03:29:17 STEP 2430 H=2430:00 +CPU= 27.867 03:29:34 STEP 2431 H=2431:00 +CPU= 17.015 03:29:52 STEP 2432 H=2432:00 +CPU= 17.531 03:30:19 STEP 2433 H=2433:00 +CPU= 27.160 03:30:37 STEP 2434 H=2434:00 +CPU= 17.530 03:30:54 STEP 2435 H=2435:00 +CPU= 17.016 03:31:24 STEP 2436 H=2436:00 +CPU= 29.953 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002436 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002436 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002436 03:31:41 STEP 2437 H=2437:00 +CPU= 17.021 03:31:59 STEP 2438 H=2438:00 +CPU= 17.534 03:32:26 STEP 2439 H=2439:00 +CPU= 27.145 03:32:43 STEP 2440 H=2440:00 +CPU= 17.518 03:33:00 STEP 2441 H=2441:00 +CPU= 16.991 03:33:28 STEP 2442 H=2442:00 +CPU= 27.712 03:33:45 STEP 2443 H=2443:00 +CPU= 16.980 03:34:03 STEP 2444 H=2444:00 +CPU= 17.533 03:34:30 STEP 2445 H=2445:00 +CPU= 27.163 03:34:48 STEP 2446 H=2446:00 +CPU= 17.486 03:35:05 STEP 2447 H=2447:00 +CPU= 17.498 03:35:37 STEP 2448 H=2448:00 +CPU= 31.659 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002448 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002448 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002448 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002424 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002424 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002424 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002436 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002436 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002436 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_101.zip Uploading the intermediate file: upload_file_101.zip 03:35:54 STEP 2449 H=2449:00 +CPU= 16.995 03:36:12 STEP 2450 H=2450:00 +CPU= 17.525 03:36:39 STEP 2451 H=2451:00 +CPU= 27.132 03:36:57 STEP 2452 H=2452:00 +CPU= 17.492 03:37:14 STEP 2453 H=2453:00 +CPU= 17.030 03:37:42 STEP 2454 H=2454:00 +CPU= 27.708 03:37:59 STEP 2455 H=2455:00 +CPU= 17.014 03:38:16 STEP 2456 H=2456:00 +CPU= 17.574 03:38:44 STEP 2457 H=2457:00 +CPU= 27.133 03:39:01 STEP 2458 H=2458:00 +CPU= 17.553 03:39:18 STEP 2459 H=2459:00 +CPU= 17.012 03:39:48 STEP 2460 H=2460:00 +CPU= 29.894 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002460 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002460 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002460 03:40:05 STEP 2461 H=2461:00 +CPU= 17.050 03:40:23 STEP 2462 H=2462:00 +CPU= 17.534 03:40:50 STEP 2463 H=2463:00 +CPU= 27.114 03:41:08 STEP 2464 H=2464:00 +CPU= 17.536 03:41:25 STEP 2465 H=2465:00 +CPU= 17.003 03:41:53 STEP 2466 H=2466:00 +CPU= 27.691 03:42:10 STEP 2467 H=2467:00 +CPU= 17.007 03:42:27 STEP 2468 H=2468:00 +CPU= 17.487 03:42:55 STEP 2469 H=2469:00 +CPU= 27.095 03:43:12 STEP 2470 H=2470:00 +CPU= 17.503 03:43:30 STEP 2471 H=2471:00 +CPU= 17.460 03:44:02 STEP 2472 H=2472:00 +CPU= 31.645 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002472 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002472 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002472 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002448 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002448 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002448 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002460 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002460 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002460 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_102.zip Uploading the intermediate file: upload_file_102.zip 03:44:19 STEP 2473 H=2473:00 +CPU= 16.965 03:44:36 STEP 2474 H=2474:00 +CPU= 17.463 03:45:03 STEP 2475 H=2475:00 +CPU= 27.124 03:45:21 STEP 2476 H=2476:00 +CPU= 17.477 03:45:38 STEP 2477 H=2477:00 +CPU= 16.967 03:46:06 STEP 2478 H=2478:00 +CPU= 27.744 03:46:23 STEP 2479 H=2479:00 +CPU= 16.987 03:46:41 STEP 2480 H=2480:00 +CPU= 17.585 03:47:08 STEP 2481 H=2481:00 +CPU= 27.128 03:47:26 STEP 2482 H=2482:00 +CPU= 17.536 03:47:43 STEP 2483 H=2483:00 +CPU= 17.084 03:48:13 STEP 2484 H=2484:00 +CPU= 29.949 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002484 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002484 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002484 03:48:30 STEP 2485 H=2485:00 +CPU= 16.999 03:48:47 STEP 2486 H=2486:00 +CPU= 17.504 03:49:15 STEP 2487 H=2487:00 +CPU= 27.147 03:49:32 STEP 2488 H=2488:00 +CPU= 17.481 03:49:49 STEP 2489 H=2489:00 +CPU= 16.966 03:50:17 STEP 2490 H=2490:00 +CPU= 27.702 03:50:34 STEP 2491 H=2491:00 +CPU= 16.962 03:50:52 STEP 2492 H=2492:00 +CPU= 17.456 03:51:19 STEP 2493 H=2493:00 +CPU= 27.108 03:51:36 STEP 2494 H=2494:00 +CPU= 17.453 03:51:54 STEP 2495 H=2495:00 +CPU= 17.437 03:52:26 STEP 2496 H=2496:00 +CPU= 31.630 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002496 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002496 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002496 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002472 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002472 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002472 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002484 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002484 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002484 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_103.zip Uploading the intermediate file: upload_file_103.zip 03:52:43 STEP 2497 H=2497:00 +CPU= 16.958 03:53:00 STEP 2498 H=2498:00 +CPU= 17.448 03:53:27 STEP 2499 H=2499:00 +CPU= 27.098 03:53:45 STEP 2500 H=2500:00 +CPU= 17.458 03:54:02 STEP 2501 H=2501:00 +CPU= 16.974 03:54:30 STEP 2502 H=2502:00 +CPU= 27.673 03:54:47 STEP 2503 H=2503:00 +CPU= 16.983 03:55:04 STEP 2504 H=2504:00 +CPU= 17.566 03:55:32 STEP 2505 H=2505:00 +CPU= 27.105 03:55:49 STEP 2506 H=2506:00 +CPU= 17.505 03:56:06 STEP 2507 H=2507:00 +CPU= 17.025 03:56:36 STEP 2508 H=2508:00 +CPU= 29.908 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002508 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002508 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002508 03:56:53 STEP 2509 H=2509:00 +CPU= 16.977 03:57:11 STEP 2510 H=2510:00 +CPU= 17.525 03:57:38 STEP 2511 H=2511:00 +CPU= 27.083 03:57:56 STEP 2512 H=2512:00 +CPU= 17.485 03:58:13 STEP 2513 H=2513:00 +CPU= 16.997 03:58:41 STEP 2514 H=2514:00 +CPU= 27.663 03:58:58 STEP 2515 H=2515:00 +CPU= 16.947 03:59:15 STEP 2516 H=2516:00 +CPU= 17.481 03:59:42 STEP 2517 H=2517:00 +CPU= 27.045 04:00:00 STEP 2518 H=2518:00 +CPU= 17.446 04:00:17 STEP 2519 H=2519:00 +CPU= 17.451 04:00:49 STEP 2520 H=2520:00 +CPU= 31.608 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002520 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002520 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002520 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002496 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002496 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002496 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002508 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002508 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002508 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_104.zip Uploading the intermediate file: upload_file_104.zip 04:01:06 STEP 2521 H=2521:00 +CPU= 16.974 04:01:24 STEP 2522 H=2522:00 +CPU= 17.443 04:01:51 STEP 2523 H=2523:00 +CPU= 27.063 04:02:08 STEP 2524 H=2524:00 +CPU= 17.488 04:02:25 STEP 2525 H=2525:00 +CPU= 16.965 04:02:53 STEP 2526 H=2526:00 +CPU= 27.701 04:03:10 STEP 2527 H=2527:00 +CPU= 17.008 04:03:28 STEP 2528 H=2528:00 +CPU= 17.557 04:03:55 STEP 2529 H=2529:00 +CPU= 27.115 04:04:13 STEP 2530 H=2530:00 +CPU= 17.535 04:04:30 STEP 2531 H=2531:00 +CPU= 16.995 04:05:00 STEP 2532 H=2532:00 +CPU= 29.904 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002532 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002532 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002532 04:05:17 STEP 2533 H=2533:00 +CPU= 17.047 04:05:35 STEP 2534 H=2534:00 +CPU= 17.531 04:06:02 STEP 2535 H=2535:00 +CPU= 27.099 04:06:19 STEP 2536 H=2536:00 +CPU= 17.509 04:06:36 STEP 2537 H=2537:00 +CPU= 16.992 04:07:04 STEP 2538 H=2538:00 +CPU= 27.715 04:07:21 STEP 2539 H=2539:00 +CPU= 16.974 04:07:39 STEP 2540 H=2540:00 +CPU= 17.485 04:08:06 STEP 2541 H=2541:00 +CPU= 27.130 04:08:24 STEP 2542 H=2542:00 +CPU= 17.476 04:08:41 STEP 2543 H=2543:00 +CPU= 17.459 04:09:13 STEP 2544 H=2544:00 +CPU= 31.657 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002544 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002544 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002544 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002520 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002520 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002520 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002532 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002532 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002532 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_105.zip Uploading the intermediate file: upload_file_105.zip 04:09:30 STEP 2545 H=2545:00 +CPU= 16.954 04:09:47 STEP 2546 H=2546:00 +CPU= 17.456 04:10:15 STEP 2547 H=2547:00 +CPU= 27.109 04:10:32 STEP 2548 H=2548:00 +CPU= 17.474 04:10:49 STEP 2549 H=2549:00 +CPU= 16.960 04:11:17 STEP 2550 H=2550:00 +CPU= 27.726 04:11:34 STEP 2551 H=2551:00 +CPU= 16.993 04:11:52 STEP 2552 H=2552:00 +CPU= 17.566 04:12:19 STEP 2553 H=2553:00 +CPU= 27.171 04:12:37 STEP 2554 H=2554:00 +CPU= 17.509 04:12:54 STEP 2555 H=2555:00 +CPU= 17.000 04:13:24 STEP 2556 H=2556:00 +CPU= 29.952 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002556 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002556 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002556 04:13:41 STEP 2557 H=2557:00 +CPU= 17.006 04:13:58 STEP 2558 H=2558:00 +CPU= 17.506 04:14:26 STEP 2559 H=2559:00 +CPU= 27.138 04:14:43 STEP 2560 H=2560:00 +CPU= 17.490 04:15:00 STEP 2561 H=2561:00 +CPU= 16.961 04:15:28 STEP 2562 H=2562:00 +CPU= 27.703 04:15:45 STEP 2563 H=2563:00 +CPU= 16.960 04:16:03 STEP 2564 H=2564:00 +CPU= 17.475 04:16:30 STEP 2565 H=2565:00 +CPU= 27.077 04:16:47 STEP 2566 H=2566:00 +CPU= 17.446 04:17:05 STEP 2567 H=2567:00 +CPU= 17.462 04:17:37 STEP 2568 H=2568:00 +CPU= 31.633 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002568 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002568 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002568 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002544 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002544 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002544 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMGGhq0f+002556 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMSHhq0f+002556 Adding to the zip: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_12171153/ICMUAhq0f+002556 Zipping up the intermediate file: /home/stjude/projects/climateprediction.net/oifs_43r3_ps_0509_1985050100_123_954_12171153_0_r816069511_106.zip Uploading the intermediate file: upload_file_106.zip 04:17:54 STEP 2569 H=2569:00 +CPU= 16.951 04:18:11 STEP 2570 H=2570:00 +CPU= 17.487 04:18:38 STEP 2571 H=2571:00 +CPU= 27.097 04:18:56 STEP 2572 H=2572:00 +CPU= 17.514 04:19:13 STEP 2573 H=2573:00 +CPU= 16.998 04:19:41 STEP 2574 H=2574:00 +CPU= 27.714 04:19:58 STEP 2575 H=2575:00 +CPU= 16.989 04:20:16 STEP 2576 H=2576:00 +CPU= 17.568 04:20:43 STEP 2577 H=2577:00 +CPU= 27.149 04:21:00 STEP 2578 H=2578:00 +CPU= 17.501 04:21:17 STEP 2579 H=2579:00 +CPU= 17.006 04:21:47 STEP 2580 H=2580:00 +CPU= 29.931 Moving to projects directory: /home/stjude/slots/0/ICMGGhq0f+002580 Moving to projects directory: /home/stjude/slots/0/ICMSHhq0f+002580 Moving to projects directory: /home/stjude/slots/0/ICMUAhq0f+002580 04:22:05 STEP 2581 H=2581:00 +CPU= 17.032 04:22:22 STEP 2582 H=2582:00 +CPU= 17.525 04:22:51 STEP 2583 H=2583:00 +CPU= 28.072 The child process terminated with status: 0 ..Failed, model did not complete successfully </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
09 May 2023 16:08:54 | 1537636 | 22255499 | oifs_43r3_ps_0509_1985050100_123_954_12171153_0 | 8,640,000 | 50,421 | 0.0058 |
09 May 2023 16:08:50 | 1537636 | 22255499 | oifs_43r3_ps_0509_1985050100_123_954_12171153_0 | 7,776,000 | 45,408 | 0.0058 |
09 May 2023 16:08:47 | 1537636 | 22255499 | oifs_43r3_ps_0509_1985050100_123_954_12171153_0 | 6,912,000 | 40,385 | 0.0058 |
09 May 2023 16:08:39 | 1537636 | 22255499 | oifs_43r3_ps_0509_1985050100_123_954_12171153_0 | 6,048,000 | 35,363 | 0.0058 |
09 May 2023 16:08:36 | 1537636 | 22255499 | oifs_43r3_ps_0509_1985050100_123_954_12171153_0 | 5,184,000 | 30,352 | 0.0059 |
09 May 2023 16:08:33 | 1537636 | 22255499 | oifs_43r3_ps_0509_1985050100_123_954_12171153_0 | 4,320,000 | 25,330 | 0.0059 |
09 May 2023 16:08:27 | 1537636 | 22255499 | oifs_43r3_ps_0509_1985050100_123_954_12171153_0 | 3,456,000 | 20,303 | 0.0059 |
09 May 2023 16:08:24 | 1537636 | 22255499 | oifs_43r3_ps_0509_1985050100_123_954_12171153_0 | 2,592,000 | 15,173 | 0.0059 |
09 May 2023 16:08:18 | 1537636 | 22255499 | oifs_43r3_ps_0509_1985050100_123_954_12171153_0 | 1,728,000 | 10,144 | 0.0059 |
09 May 2023 16:08:15 | 1537636 | 22255499 | oifs_43r3_ps_0509_1985050100_123_954_12171153_0 | 864,000 | 5,096 | 0.0059 |
©2024 cpdn.org