climateprediction.net home page
Task 22256087

Task 22256087

Name oifs_43r3_ps_0064_1986050100_123_955_12171708_0
Workunit 12171708
Created 21 Dec 2022, 7:39:22 UTC
Sent 16 Jan 2023, 5:17:17 UTC
Report deadline 15 Feb 2023, 5:17:17 UTC
Received 17 Jan 2023, 2:34:36 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 9 (0x00000009) Unknown error code
Computer ID 1538037
Run time 19 hours 53 min 50 sec
CPU time 19 hours 53 min 50 sec
Validate state Invalid
Credit 11,128.32
Device peak FLOPS 4.76 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,776.48 MB
Peak swap size 4,978.07 MB
Peak disk usage 2,028.12 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<message>
process exited with code 9 (0x9, -247)</message>
<stderr_txt>
ojects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+001908
  05:50:30 STEP 1909 H=1909:00 +CPU= 25.544
  05:50:55 STEP 1910 H=1910:00 +CPU= 25.215
  05:51:34 STEP 1911 H=1911:00 +CPU= 38.280
  05:51:59 STEP 1912 H=1912:00 +CPU= 25.714
  05:52:25 STEP 1913 H=1913:00 +CPU= 25.175
  05:53:05 STEP 1914 H=1914:00 +CPU= 39.863
  05:53:30 STEP 1915 H=1915:00 +CPU= 24.935
  05:53:55 STEP 1916 H=1916:00 +CPU= 25.710
  05:54:34 STEP 1917 H=1917:00 +CPU= 38.328
  05:54:59 STEP 1918 H=1918:00 +CPU= 25.130
  05:55:24 STEP 1919 H=1919:00 +CPU= 25.065
  05:56:10 STEP 1920 H=1920:00 +CPU= 45.817
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+001908
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649_79.zip
Uploading the intermediate file: upload_file_79.zip
  05:56:35 STEP 1921 H=1921:00 +CPU= 25.755
  05:57:01 STEP 1922 H=1922:00 +CPU= 25.699
  05:57:40 STEP 1923 H=1923:00 +CPU= 38.681
  05:58:05 STEP 1924 H=1924:00 +CPU= 24.906
  05:58:30 STEP 1925 H=1925:00 +CPU= 25.135
  05:59:10 STEP 1926 H=1926:00 +CPU= 39.432
  05:59:35 STEP 1927 H=1927:00 +CPU= 24.644
  06:00:00 STEP 1928 H=1928:00 +CPU= 25.563
  06:00:39 STEP 1929 H=1929:00 +CPU= 38.467
  06:01:04 STEP 1930 H=1930:00 +CPU= 25.498
  06:01:29 STEP 1931 H=1931:00 +CPU= 24.260
  06:02:16 STEP 1932 H=1932:00 +CPU= 43.152
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+001932
  06:02:41 STEP 1933 H=1933:00 +CPU= 24.815
  06:03:07 STEP 1934 H=1934:00 +CPU= 25.136
  06:03:45 STEP 1935 H=1935:00 +CPU= 38.522
  06:04:11 STEP 1936 H=1936:00 +CPU= 25.281
  06:04:36 STEP 1937 H=1937:00 +CPU= 24.589
  06:05:16 STEP 1938 H=1938:00 +CPU= 39.906
  06:05:40 STEP 1939 H=1939:00 +CPU= 24.635
  06:06:05 STEP 1940 H=1940:00 +CPU= 25.113
  06:06:44 STEP 1941 H=1941:00 +CPU= 38.300
  06:07:09 STEP 1942 H=1942:00 +CPU= 25.324
  06:07:35 STEP 1943 H=1943:00 +CPU= 26.164
  06:08:22 STEP 1944 H=1944:00 +CPU= 46.667
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+001932
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649_80.zip
Uploading the intermediate file: upload_file_80.zip
  06:08:46 STEP 1945 H=1945:00 +CPU= 24.492
  06:09:11 STEP 1946 H=1946:00 +CPU= 24.831
  06:09:50 STEP 1947 H=1947:00 +CPU= 38.177
  06:10:15 STEP 1948 H=1948:00 +CPU= 25.025
  06:10:39 STEP 1949 H=1949:00 +CPU= 24.539
  06:11:19 STEP 1950 H=1950:00 +CPU= 39.631
  06:11:43 STEP 1951 H=1951:00 +CPU= 24.353
  06:12:09 STEP 1952 H=1952:00 +CPU= 24.839
  06:12:48 STEP 1953 H=1953:00 +CPU= 38.959
  06:13:13 STEP 1954 H=1954:00 +CPU= 25.126
  06:13:38 STEP 1955 H=1955:00 +CPU= 24.135
  06:14:24 STEP 1956 H=1956:00 +CPU= 42.762
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+001956
  06:14:49 STEP 1957 H=1957:00 +CPU= 24.564
  06:15:15 STEP 1958 H=1958:00 +CPU= 25.409
  06:15:54 STEP 1959 H=1959:00 +CPU= 38.926
  06:16:19 STEP 1960 H=1960:00 +CPU= 25.535
  06:16:44 STEP 1961 H=1961:00 +CPU= 24.718
  06:17:24 STEP 1962 H=1962:00 +CPU= 39.684
  06:17:49 STEP 1963 H=1963:00 +CPU= 25.077
  06:18:13 STEP 1964 H=1964:00 +CPU= 24.013
  06:18:51 STEP 1965 H=1965:00 +CPU= 38.727
  06:19:16 STEP 1966 H=1966:00 +CPU= 24.155
  06:19:42 STEP 1967 H=1967:00 +CPU= 26.278
  06:20:28 STEP 1968 H=1968:00 +CPU= 45.543
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+001956
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649_81.zip
  06:20:52 STEP 1969 H=1969:00 +CPU= 23.726
Uploading the intermediate file: upload_file_81.zip
  06:21:17 STEP 1970 H=1970:00 +CPU= 24.576
Uploading trickle at timestep: 7084800
  06:21:55 STEP 1971 H=1971:00 +CPU= 38.294
  06:22:20 STEP 1972 H=1972:00 +CPU= 24.860
  06:22:45 STEP 1973 H=1973:00 +CPU= 24.769
  06:23:24 STEP 1974 H=1974:00 +CPU= 39.242
  06:23:49 STEP 1975 H=1975:00 +CPU= 24.997
  06:24:15 STEP 1976 H=1976:00 +CPU= 25.099
  06:24:54 STEP 1977 H=1977:00 +CPU= 38.480
  06:25:19 STEP 1978 H=1978:00 +CPU= 24.953
  06:25:44 STEP 1979 H=1979:00 +CPU= 24.345
  06:26:27 STEP 1980 H=1980:00 +CPU= 42.753
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+001980
  06:26:52 STEP 1981 H=1981:00 +CPU= 24.378
  06:27:18 STEP 1982 H=1982:00 +CPU= 24.901
  06:27:56 STEP 1983 H=1983:00 +CPU= 37.933
  06:28:21 STEP 1984 H=1984:00 +CPU= 25.396
  06:28:46 STEP 1985 H=1985:00 +CPU= 24.243
  06:29:25 STEP 1986 H=1986:00 +CPU= 39.354
  06:29:50 STEP 1987 H=1987:00 +CPU= 24.807
  06:30:16 STEP 1988 H=1988:00 +CPU= 25.485
  06:30:55 STEP 1989 H=1989:00 +CPU= 39.106
  06:31:21 STEP 1990 H=1990:00 +CPU= 25.285
  06:31:46 STEP 1991 H=1991:00 +CPU= 25.366
  06:32:34 STEP 1992 H=1992:00 +CPU= 44.996
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+001980
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649_82.zip
Uploading the intermediate file: upload_file_82.zip
  06:32:59 STEP 1993 H=1993:00 +CPU= 25.068
  06:33:24 STEP 1994 H=1994:00 +CPU= 24.773
  06:34:02 STEP 1995 H=1995:00 +CPU= 38.081
  06:34:28 STEP 1996 H=1996:00 +CPU= 25.518
  06:34:53 STEP 1997 H=1997:00 +CPU= 24.674
  06:35:33 STEP 1998 H=1998:00 +CPU= 39.565
  06:35:59 STEP 1999 H=1999:00 +CPU= 25.170
  06:36:25 STEP 2000 H=2000:00 +CPU= 25.809
  06:37:04 STEP 2001 H=2001:00 +CPU= 38.535
  06:37:30 STEP 2002 H=2002:00 +CPU= 25.800
  06:37:54 STEP 2003 H=2003:00 +CPU= 24.693
  06:38:42 STEP 2004 H=2004:00 +CPU= 41.881
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002004
  06:39:07 STEP 2005 H=2005:00 +CPU= 24.369
  06:39:35 STEP 2006 H=2006:00 +CPU= 25.084
  06:40:14 STEP 2007 H=2007:00 +CPU= 38.829
  06:40:39 STEP 2008 H=2008:00 +CPU= 25.522
  06:41:04 STEP 2009 H=2009:00 +CPU= 24.742
  06:41:44 STEP 2010 H=2010:00 +CPU= 39.417
  06:42:10 STEP 2011 H=2011:00 +CPU= 24.947
  06:42:36 STEP 2012 H=2012:00 +CPU= 24.989
  06:43:16 STEP 2013 H=2013:00 +CPU= 38.287
  06:43:41 STEP 2014 H=2014:00 +CPU= 25.105
  06:44:07 STEP 2015 H=2015:00 +CPU= 25.490
  06:45:05 STEP 2016 H=2016:00 +CPU= 46.828
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002004
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649_83.zip
  06:45:30 STEP 2017 H=2017:00 +CPU= 24.619
Uploading the intermediate file: upload_file_83.zip
  06:45:56 STEP 2018 H=2018:00 +CPU= 25.591
  06:46:35 STEP 2019 H=2019:00 +CPU= 38.757
  06:47:01 STEP 2020 H=2020:00 +CPU= 25.309
  06:47:26 STEP 2021 H=2021:00 +CPU= 25.264
  06:48:05 STEP 2022 H=2022:00 +CPU= 39.376
  06:48:30 STEP 2023 H=2023:00 +CPU= 24.499
  06:48:55 STEP 2024 H=2024:00 +CPU= 25.052
  06:49:36 STEP 2025 H=2025:00 +CPU= 40.020
  06:50:02 STEP 2026 H=2026:00 +CPU= 25.573
  06:50:28 STEP 2027 H=2027:00 +CPU= 25.414
  06:51:15 STEP 2028 H=2028:00 +CPU= 43.290
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002028
  06:51:40 STEP 2029 H=2029:00 +CPU= 24.755
  06:52:06 STEP 2030 H=2030:00 +CPU= 25.913
  06:52:45 STEP 2031 H=2031:00 +CPU= 38.779
  06:53:10 STEP 2032 H=2032:00 +CPU= 25.208
  06:53:34 STEP 2033 H=2033:00 +CPU= 24.635
  06:54:16 STEP 2034 H=2034:00 +CPU= 39.547
  06:54:41 STEP 2035 H=2035:00 +CPU= 24.589
  06:55:06 STEP 2036 H=2036:00 +CPU= 25.438
  06:55:45 STEP 2037 H=2037:00 +CPU= 39.261
  06:56:11 STEP 2038 H=2038:00 +CPU= 25.349
  06:56:37 STEP 2039 H=2039:00 +CPU= 25.994
  06:57:29 STEP 2040 H=2040:00 +CPU= 46.145
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002028
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649_84.zip
Uploading the intermediate file: upload_file_84.zip
  06:57:53 STEP 2041 H=2041:00 +CPU= 24.629
  06:58:19 STEP 2042 H=2042:00 +CPU= 25.864
  06:58:58 STEP 2043 H=2043:00 +CPU= 38.528
  06:59:23 STEP 2044 H=2044:00 +CPU= 25.689
  06:59:49 STEP 2045 H=2045:00 +CPU= 25.106
  07:00:30 STEP 2046 H=2046:00 +CPU= 40.193
  07:00:55 STEP 2047 H=2047:00 +CPU= 24.697
  07:01:20 STEP 2048 H=2048:00 +CPU= 24.885
  07:01:59 STEP 2049 H=2049:00 +CPU= 38.689
  07:02:25 STEP 2050 H=2050:00 +CPU= 25.637
  07:02:50 STEP 2051 H=2051:00 +CPU= 25.480
  07:03:34 STEP 2052 H=2052:00 +CPU= 44.357
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002052
  07:03:59 STEP 2053 H=2053:00 +CPU= 24.605
  07:04:25 STEP 2054 H=2054:00 +CPU= 26.179
  07:05:05 STEP 2055 H=2055:00 +CPU= 39.495
  07:05:30 STEP 2056 H=2056:00 +CPU= 24.952
  07:05:55 STEP 2057 H=2057:00 +CPU= 24.952
  07:06:35 STEP 2058 H=2058:00 +CPU= 39.958
  07:07:00 STEP 2059 H=2059:00 +CPU= 25.013
  07:07:26 STEP 2060 H=2060:00 +CPU= 25.571
  07:08:06 STEP 2061 H=2061:00 +CPU= 39.073
  07:08:31 STEP 2062 H=2062:00 +CPU= 25.575
  07:08:57 STEP 2063 H=2063:00 +CPU= 25.879
  07:09:51 STEP 2064 H=2064:00 +CPU= 45.725
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002052
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649_85.zip
Uploading the intermediate file: upload_file_85.zip
  07:10:17 STEP 2065 H=2065:00 +CPU= 25.089
  07:10:43 STEP 2066 H=2066:00 +CPU= 25.338
  07:11:24 STEP 2067 H=2067:00 +CPU= 38.966
  07:11:49 STEP 2068 H=2068:00 +CPU= 25.518
  07:12:15 STEP 2069 H=2069:00 +CPU= 24.320
  07:12:55 STEP 2070 H=2070:00 +CPU= 38.785
  07:13:19 STEP 2071 H=2071:00 +CPU= 24.315
  07:13:45 STEP 2072 H=2072:00 +CPU= 25.482
  07:14:23 STEP 2073 H=2073:00 +CPU= 38.111
  07:14:48 STEP 2074 H=2074:00 +CPU= 25.679
  07:15:13 STEP 2075 H=2075:00 +CPU= 24.820
  07:16:00 STEP 2076 H=2076:00 +CPU= 44.081
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002076
  07:16:26 STEP 2077 H=2077:00 +CPU= 25.553
  07:16:53 STEP 2078 H=2078:00 +CPU= 26.521
  07:17:32 STEP 2079 H=2079:00 +CPU= 38.935
  07:17:57 STEP 2080 H=2080:00 +CPU= 25.166
  07:18:22 STEP 2081 H=2081:00 +CPU= 25.019
  07:19:02 STEP 2082 H=2082:00 +CPU= 39.489
  07:19:29 STEP 2083 H=2083:00 +CPU= 24.743
  07:19:54 STEP 2084 H=2084:00 +CPU= 25.398
  07:20:34 STEP 2085 H=2085:00 +CPU= 38.444
  07:21:00 STEP 2086 H=2086:00 +CPU= 25.536
  07:21:27 STEP 2087 H=2087:00 +CPU= 25.772
  07:22:24 STEP 2088 H=2088:00 +CPU= 46.212
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002076
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649_86.zip
Uploading the intermediate file: upload_file_86.zip
  07:22:49 STEP 2089 H=2089:00 +CPU= 25.171
  07:23:15 STEP 2090 H=2090:00 +CPU= 25.642
  07:23:54 STEP 2091 H=2091:00 +CPU= 39.294
  07:24:21 STEP 2092 H=2092:00 +CPU= 25.265
  07:24:46 STEP 2093 H=2093:00 +CPU= 24.894
  07:25:29 STEP 2094 H=2094:00 +CPU= 39.188
  07:25:54 STEP 2095 H=2095:00 +CPU= 24.708
  07:26:20 STEP 2096 H=2096:00 +CPU= 26.030
  07:27:00 STEP 2097 H=2097:00 +CPU= 39.587
  07:27:26 STEP 2098 H=2098:00 +CPU= 26.014
  07:27:52 STEP 2099 H=2099:00 +CPU= 25.987
  07:28:35 STEP 2100 H=2100:00 +CPU= 43.076
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002100
  07:29:00 STEP 2101 H=2101:00 +CPU= 24.891
  07:29:26 STEP 2102 H=2102:00 +CPU= 25.341
  07:30:05 STEP 2103 H=2103:00 +CPU= 39.312
  07:30:31 STEP 2104 H=2104:00 +CPU= 25.849
  07:30:56 STEP 2105 H=2105:00 +CPU= 25.012
  07:31:36 STEP 2106 H=2106:00 +CPU= 39.724
  07:32:01 STEP 2107 H=2107:00 +CPU= 24.977
  07:32:27 STEP 2108 H=2108:00 +CPU= 25.753
  07:33:06 STEP 2109 H=2109:00 +CPU= 39.257
  07:33:32 STEP 2110 H=2110:00 +CPU= 25.326
  07:33:58 STEP 2111 H=2111:00 +CPU= 25.619
  07:34:49 STEP 2112 H=2112:00 +CPU= 46.414
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002100
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649_87.zip
Uploading the intermediate file: upload_file_87.zip
  07:35:15 STEP 2113 H=2113:00 +CPU= 25.217
  07:35:40 STEP 2114 H=2114:00 +CPU= 25.351
  07:36:19 STEP 2115 H=2115:00 +CPU= 38.675
  07:36:44 STEP 2116 H=2116:00 +CPU= 25.489
  07:37:10 STEP 2117 H=2117:00 +CPU= 25.016
  07:37:49 STEP 2118 H=2118:00 +CPU= 39.433
  07:38:14 STEP 2119 H=2119:00 +CPU= 24.859
  07:38:40 STEP 2120 H=2120:00 +CPU= 25.705
  07:39:21 STEP 2121 H=2121:00 +CPU= 39.479
  07:39:47 STEP 2122 H=2122:00 +CPU= 25.983
  07:40:13 STEP 2123 H=2123:00 +CPU= 25.272
  07:40:56 STEP 2124 H=2124:00 +CPU= 43.362
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002124
  07:41:22 STEP 2125 H=2125:00 +CPU= 25.421
  07:41:48 STEP 2126 H=2126:00 +CPU= 26.163
  07:42:26 STEP 2127 H=2127:00 +CPU= 38.712
  07:42:53 STEP 2128 H=2128:00 +CPU= 26.648
  07:43:19 STEP 2129 H=2129:00 +CPU= 25.260
  07:43:59 STEP 2130 H=2130:00 +CPU= 39.958
  07:44:23 STEP 2131 H=2131:00 +CPU= 24.651
  07:44:49 STEP 2132 H=2132:00 +CPU= 25.512
  07:45:29 STEP 2133 H=2133:00 +CPU= 38.696
  07:45:55 STEP 2134 H=2134:00 +CPU= 25.534
  07:46:22 STEP 2135 H=2135:00 +CPU= 25.850
  07:47:13 STEP 2136 H=2136:00 +CPU= 45.916
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002124
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649_88.zip
  07:47:37 STEP 2137 H=2137:00 +CPU= 24.307
Uploading the intermediate file: upload_file_88.zip
  07:48:03 STEP 2138 H=2138:00 +CPU= 25.490
  07:48:42 STEP 2139 H=2139:00 +CPU= 39.290
  07:49:08 STEP 2140 H=2140:00 +CPU= 25.640
  07:49:33 STEP 2141 H=2141:00 +CPU= 25.881
  07:50:14 STEP 2142 H=2142:00 +CPU= 40.219
  07:50:39 STEP 2143 H=2143:00 +CPU= 25.171
  07:51:05 STEP 2144 H=2144:00 +CPU= 26.021
  07:51:44 STEP 2145 H=2145:00 +CPU= 39.284
  07:52:10 STEP 2146 H=2146:00 +CPU= 25.861
  07:52:36 STEP 2147 H=2147:00 +CPU= 25.845
  07:53:23 STEP 2148 H=2148:00 +CPU= 43.370
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002148
  07:53:48 STEP 2149 H=2149:00 +CPU= 25.152
  07:54:13 STEP 2150 H=2150:00 +CPU= 25.309
  07:54:52 STEP 2151 H=2151:00 +CPU= 39.192
  07:55:18 STEP 2152 H=2152:00 +CPU= 25.515
  07:55:43 STEP 2153 H=2153:00 +CPU= 24.817
  07:56:23 STEP 2154 H=2154:00 +CPU= 39.440
  07:56:48 STEP 2155 H=2155:00 +CPU= 24.556
  07:57:14 STEP 2156 H=2156:00 +CPU= 25.226
  07:57:54 STEP 2157 H=2157:00 +CPU= 38.627
  07:58:19 STEP 2158 H=2158:00 +CPU= 25.159
  07:58:48 STEP 2159 H=2159:00 +CPU= 25.341
  07:59:38 STEP 2160 H=2160:00 +CPU= 46.038
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002148
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649_89.zip
Uploading the intermediate file: upload_file_89.zip
  08:00:03 STEP 2161 H=2161:00 +CPU= 24.787
  08:00:29 STEP 2162 H=2162:00 +CPU= 26.102
  08:01:08 STEP 2163 H=2163:00 +CPU= 39.714
  08:01:35 STEP 2164 H=2164:00 +CPU= 26.182
  08:02:00 STEP 2165 H=2165:00 +CPU= 25.568
  08:02:40 STEP 2166 H=2166:00 +CPU= 39.979
  08:03:05 STEP 2167 H=2167:00 +CPU= 25.182
  08:03:31 STEP 2168 H=2168:00 +CPU= 26.131
  08:04:12 STEP 2169 H=2169:00 +CPU= 40.259
  08:04:37 STEP 2170 H=2170:00 +CPU= 25.806
  08:05:02 STEP 2171 H=2171:00 +CPU= 24.974
  08:05:53 STEP 2172 H=2172:00 +CPU= 44.240
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002172
  08:06:17 STEP 2173 H=2173:00 +CPU= 24.632
  08:06:44 STEP 2174 H=2174:00 +CPU= 25.637
  08:07:23 STEP 2175 H=2175:00 +CPU= 39.488
  08:07:50 STEP 2176 H=2176:00 +CPU= 25.331
  08:08:14 STEP 2177 H=2177:00 +CPU= 24.609
  08:08:54 STEP 2178 H=2178:00 +CPU= 39.997
  08:09:19 STEP 2179 H=2179:00 +CPU= 24.972
  08:09:45 STEP 2180 H=2180:00 +CPU= 25.435
  08:10:24 STEP 2181 H=2181:00 +CPU= 39.055
  08:10:49 STEP 2182 H=2182:00 +CPU= 25.136
  08:11:16 STEP 2183 H=2183:00 +CPU= 25.606
  08:12:04 STEP 2184 H=2184:00 +CPU= 47.129
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002172
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649_90.zip
Uploading the intermediate file: upload_file_90.zip
  08:12:29 STEP 2185 H=2185:00 +CPU= 24.933
  08:12:55 STEP 2186 H=2186:00 +CPU= 25.856
  08:13:36 STEP 2187 H=2187:00 +CPU= 40.729
  08:14:01 STEP 2188 H=2188:00 +CPU= 25.821
  08:14:27 STEP 2189 H=2189:00 +CPU= 25.398
  08:15:08 STEP 2190 H=2190:00 +CPU= 40.757
  08:15:33 STEP 2191 H=2191:00 +CPU= 24.955
  08:15:59 STEP 2192 H=2192:00 +CPU= 26.490
  08:16:38 STEP 2193 H=2193:00 +CPU= 38.834
  08:17:04 STEP 2194 H=2194:00 +CPU= 25.610
  08:17:30 STEP 2195 H=2195:00 +CPU= 25.335
  08:18:14 STEP 2196 H=2196:00 +CPU= 43.052
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002196
  08:18:40 STEP 2197 H=2197:00 +CPU= 24.610
  08:19:05 STEP 2198 H=2198:00 +CPU= 25.420
  08:19:43 STEP 2199 H=2199:00 +CPU= 38.240
  08:20:09 STEP 2200 H=2200:00 +CPU= 25.320
  08:20:34 STEP 2201 H=2201:00 +CPU= 25.398
  08:21:14 STEP 2202 H=2202:00 +CPU= 39.412
  08:21:38 STEP 2203 H=2203:00 +CPU= 23.980
  08:22:03 STEP 2204 H=2204:00 +CPU= 24.898
  08:22:41 STEP 2205 H=2205:00 +CPU= 38.687
  08:23:07 STEP 2206 H=2206:00 +CPU= 25.954
  08:23:33 STEP 2207 H=2207:00 +CPU= 26.022
  08:24:20 STEP 2208 H=2208:00 +CPU= 46.010
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002196
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649_91.zip
Uploading the intermediate file: upload_file_91.zip
Uploading trickle at timestep: 7948800
  08:24:46 STEP 2209 H=2209:00 +CPU= 25.421
  08:25:12 STEP 2210 H=2210:00 +CPU= 25.556
  08:25:51 STEP 2211 H=2211:00 +CPU= 39.702
  08:26:17 STEP 2212 H=2212:00 +CPU= 25.878
  08:26:42 STEP 2213 H=2213:00 +CPU= 25.003
  08:27:22 STEP 2214 H=2214:00 +CPU= 39.447
  08:27:47 STEP 2215 H=2215:00 +CPU= 24.802
  08:28:13 STEP 2216 H=2216:00 +CPU= 25.343
  08:28:51 STEP 2217 H=2217:00 +CPU= 37.816
  08:29:17 STEP 2218 H=2218:00 +CPU= 25.782
  08:29:43 STEP 2219 H=2219:00 +CPU= 25.228
  08:30:28 STEP 2220 H=2220:00 +CPU= 43.577
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002220
  08:30:54 STEP 2221 H=2221:00 +CPU= 25.313
  08:31:19 STEP 2222 H=2222:00 +CPU= 25.679
  08:31:59 STEP 2223 H=2223:00 +CPU= 39.195
  08:32:24 STEP 2224 H=2224:00 +CPU= 25.599
  08:32:49 STEP 2225 H=2225:00 +CPU= 24.851
  08:33:28 STEP 2226 H=2226:00 +CPU= 39.084
  08:33:52 STEP 2227 H=2227:00 +CPU= 24.305
  08:34:18 STEP 2228 H=2228:00 +CPU= 25.081
  08:34:56 STEP 2229 H=2229:00 +CPU= 38.902
  08:35:22 STEP 2230 H=2230:00 +CPU= 25.419
  08:35:47 STEP 2231 H=2231:00 +CPU= 25.274
  08:36:34 STEP 2232 H=2232:00 +CPU= 46.149
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002220
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649_92.zip
Uploading the intermediate file: upload_file_92.zip
  08:36:59 STEP 2233 H=2233:00 +CPU= 25.233
  08:37:25 STEP 2234 H=2234:00 +CPU= 25.841
  08:38:05 STEP 2235 H=2235:00 +CPU= 39.501
  08:38:30 STEP 2236 H=2236:00 +CPU= 25.516
  08:38:55 STEP 2237 H=2237:00 +CPU= 25.016
  08:39:36 STEP 2238 H=2238:00 +CPU= 40.149
  08:40:01 STEP 2239 H=2239:00 +CPU= 25.061
  08:40:27 STEP 2240 H=2240:00 +CPU= 25.908
  08:41:06 STEP 2241 H=2241:00 +CPU= 39.295
  08:41:43 STEP 2242 H=2242:00 +CPU= 24.762
  08:42:08 STEP 2243 H=2243:00 +CPU= 24.622
  08:43:11 STEP 2244 H=2244:00 +CPU= 42.615
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002244
  08:43:37 STEP 2245 H=2245:00 +CPU= 24.712
  08:44:02 STEP 2246 H=2246:00 +CPU= 25.135
  08:44:41 STEP 2247 H=2247:00 +CPU= 38.097
  08:45:06 STEP 2248 H=2248:00 +CPU= 24.997
  08:45:30 STEP 2249 H=2249:00 +CPU= 24.395
  08:46:09 STEP 2250 H=2250:00 +CPU= 38.502
  08:46:33 STEP 2251 H=2251:00 +CPU= 23.947
  08:46:57 STEP 2252 H=2252:00 +CPU= 24.621
  08:47:38 STEP 2253 H=2253:00 +CPU= 38.505
  08:48:03 STEP 2254 H=2254:00 +CPU= 24.820
  08:48:28 STEP 2255 H=2255:00 +CPU= 25.637
  08:49:17 STEP 2256 H=2256:00 +CPU= 46.005
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002244
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649_93.zip
Uploading the intermediate file: upload_file_93.zip
  08:49:59 STEP 2257 H=2257:00 +CPU= 24.711
  08:50:25 STEP 2258 H=2258:00 +CPU= 25.709
  08:51:08 STEP 2259 H=2259:00 +CPU= 38.436
  08:51:34 STEP 2260 H=2260:00 +CPU= 25.906
  08:51:58 STEP 2261 H=2261:00 +CPU= 24.630
  08:52:38 STEP 2262 H=2262:00 +CPU= 39.740
  08:53:02 STEP 2263 H=2263:00 +CPU= 24.294
  08:53:46 STEP 2264 H=2264:00 +CPU= 25.092
  08:54:34 STEP 2265 H=2265:00 +CPU= 38.790
  08:54:59 STEP 2266 H=2266:00 +CPU= 25.289
  08:55:25 STEP 2267 H=2267:00 +CPU= 25.488
  08:56:08 STEP 2268 H=2268:00 +CPU= 43.055
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002268
  08:56:33 STEP 2269 H=2269:00 +CPU= 24.780
  08:56:58 STEP 2270 H=2270:00 +CPU= 25.546
  08:57:37 STEP 2271 H=2271:00 +CPU= 39.079
  08:58:03 STEP 2272 H=2272:00 +CPU= 25.208
  08:58:27 STEP 2273 H=2273:00 +CPU= 24.537
  08:59:07 STEP 2274 H=2274:00 +CPU= 40.100
  08:59:32 STEP 2275 H=2275:00 +CPU= 24.743
  08:59:57 STEP 2276 H=2276:00 +CPU= 25.188
  09:00:36 STEP 2277 H=2277:00 +CPU= 38.756
  09:01:02 STEP 2278 H=2278:00 +CPU= 25.939
  09:01:27 STEP 2279 H=2279:00 +CPU= 25.499
  09:07:15 STEP 2280 H=2280:00 +CPU= 45.884
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002268
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649_94.zip
Uploading the intermediate file: upload_file_94.zip
  09:07:39 STEP 2281 H=2281:00 +CPU= 24.236
  09:08:04 STEP 2282 H=2282:00 +CPU= 24.758
  09:08:49 STEP 2283 H=2283:00 +CPU= 39.101
  09:09:13 STEP 2284 H=2284:00 +CPU= 24.233
  09:09:37 STEP 2285 H=2285:00 +CPU= 23.535
  09:10:19 STEP 2286 H=2286:00 +CPU= 39.955
  09:10:44 STEP 2287 H=2287:00 +CPU= 24.994
  09:11:08 STEP 2288 H=2288:00 +CPU= 24.856
  09:11:49 STEP 2289 H=2289:00 +CPU= 38.924
  09:12:15 STEP 2290 H=2290:00 +CPU= 25.009
  09:12:39 STEP 2291 H=2291:00 +CPU= 24.577
  09:13:25 STEP 2292 H=2292:00 +CPU= 42.873
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002292
  09:13:51 STEP 2293 H=2293:00 +CPU= 24.566
  09:14:17 STEP 2294 H=2294:00 +CPU= 25.030
  09:14:55 STEP 2295 H=2295:00 +CPU= 38.568
  09:15:22 STEP 2296 H=2296:00 +CPU= 25.477
  09:15:46 STEP 2297 H=2297:00 +CPU= 23.826
  09:16:26 STEP 2298 H=2298:00 +CPU= 39.707
  09:16:50 STEP 2299 H=2299:00 +CPU= 24.638
  09:17:15 STEP 2300 H=2300:00 +CPU= 24.835
  09:17:54 STEP 2301 H=2301:00 +CPU= 38.586
  09:18:19 STEP 2302 H=2302:00 +CPU= 25.260
  09:18:44 STEP 2303 H=2303:00 +CPU= 25.171
  09:19:38 STEP 2304 H=2304:00 +CPU= 45.538
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002292
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649_95.zip
Uploading the intermediate file: upload_file_95.zip
  09:20:03 STEP 2305 H=2305:00 +CPU= 24.710
  09:20:28 STEP 2306 H=2306:00 +CPU= 25.097
  09:21:07 STEP 2307 H=2307:00 +CPU= 38.703
  09:21:33 STEP 2308 H=2308:00 +CPU= 25.599
  09:21:58 STEP 2309 H=2309:00 +CPU= 24.426
  09:22:38 STEP 2310 H=2310:00 +CPU= 39.781
  09:23:08 STEP 2311 H=2311:00 +CPU= 25.058
  09:23:33 STEP 2312 H=2312:00 +CPU= 25.308
  09:24:17 STEP 2313 H=2313:00 +CPU= 39.309
  09:24:43 STEP 2314 H=2314:00 +CPU= 26.037
  09:25:09 STEP 2315 H=2315:00 +CPU= 25.946
  09:25:53 STEP 2316 H=2316:00 +CPU= 43.902
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002316
  09:26:18 STEP 2317 H=2317:00 +CPU= 24.861
  09:26:44 STEP 2318 H=2318:00 +CPU= 26.532
  09:27:24 STEP 2319 H=2319:00 +CPU= 39.875
  09:27:49 STEP 2320 H=2320:00 +CPU= 25.051
  09:28:14 STEP 2321 H=2321:00 +CPU= 24.585
  09:28:53 STEP 2322 H=2322:00 +CPU= 39.744
  09:29:18 STEP 2323 H=2323:00 +CPU= 24.692
  09:29:43 STEP 2324 H=2324:00 +CPU= 25.281
  09:30:22 STEP 2325 H=2325:00 +CPU= 38.684
  09:30:48 STEP 2326 H=2326:00 +CPU= 25.380
  09:31:13 STEP 2327 H=2327:00 +CPU= 25.504
  09:32:02 STEP 2328 H=2328:00 +CPU= 46.927
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002316
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649_96.zip
Uploading the intermediate file: upload_file_96.zip
  09:32:27 STEP 2329 H=2329:00 +CPU= 25.557
  09:32:54 STEP 2330 H=2330:00 +CPU= 25.563
  09:33:34 STEP 2331 H=2331:00 +CPU= 38.912
  09:34:00 STEP 2332 H=2332:00 +CPU= 25.252
  09:34:26 STEP 2333 H=2333:00 +CPU= 25.006
  09:35:06 STEP 2334 H=2334:00 +CPU= 39.403
  09:35:32 STEP 2335 H=2335:00 +CPU= 24.831
  09:35:58 STEP 2336 H=2336:00 +CPU= 25.392
  09:36:36 STEP 2337 H=2337:00 +CPU= 38.876
  09:37:03 STEP 2338 H=2338:00 +CPU= 25.864
  09:37:28 STEP 2339 H=2339:00 +CPU= 25.158
  09:38:14 STEP 2340 H=2340:00 +CPU= 43.167
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002340
  09:38:39 STEP 2341 H=2341:00 +CPU= 24.881
  09:39:04 STEP 2342 H=2342:00 +CPU= 25.571
  09:39:44 STEP 2343 H=2343:00 +CPU= 39.396
  09:40:09 STEP 2344 H=2344:00 +CPU= 25.491
  09:40:35 STEP 2345 H=2345:00 +CPU= 25.186
  09:41:15 STEP 2346 H=2346:00 +CPU= 40.139
  09:41:40 STEP 2347 H=2347:00 +CPU= 24.758
  09:42:05 STEP 2348 H=2348:00 +CPU= 25.226
  09:42:45 STEP 2349 H=2349:00 +CPU= 39.221
  09:43:10 STEP 2350 H=2350:00 +CPU= 25.433
  09:43:36 STEP 2351 H=2351:00 +CPU= 25.463
  09:44:22 STEP 2352 H=2352:00 +CPU= 46.150
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002340
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649_97.zip
Uploading the intermediate file: upload_file_97.zip
  09:44:45 STEP 2353 H=2353:00 +CPU= 23.411
  09:45:10 STEP 2354 H=2354:00 +CPU= 24.618
  09:45:48 STEP 2355 H=2355:00 +CPU= 38.588
  09:46:14 STEP 2356 H=2356:00 +CPU= 25.109
  09:46:38 STEP 2357 H=2357:00 +CPU= 23.985
  09:47:16 STEP 2358 H=2358:00 +CPU= 37.199
  09:47:42 STEP 2359 H=2359:00 +CPU= 23.907
  09:48:07 STEP 2360 H=2360:00 +CPU= 24.877
  09:48:46 STEP 2361 H=2361:00 +CPU= 38.361
  09:49:11 STEP 2362 H=2362:00 +CPU= 24.479
  09:49:37 STEP 2363 H=2363:00 +CPU= 25.160
  09:50:40 STEP 2364 H=2364:00 +CPU= 41.115
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002364
  09:51:07 STEP 2365 H=2365:00 +CPU= 25.084
  09:51:32 STEP 2366 H=2366:00 +CPU= 25.270
  09:52:12 STEP 2367 H=2367:00 +CPU= 39.477
  09:52:38 STEP 2368 H=2368:00 +CPU= 26.375
  09:53:03 STEP 2369 H=2369:00 +CPU= 24.703
  09:53:42 STEP 2370 H=2370:00 +CPU= 38.744
  09:54:07 STEP 2371 H=2371:00 +CPU= 24.721
  09:54:31 STEP 2372 H=2372:00 +CPU= 24.508
  09:55:09 STEP 2373 H=2373:00 +CPU= 38.362
  09:55:35 STEP 2374 H=2374:00 +CPU= 25.405
  09:56:00 STEP 2375 H=2375:00 +CPU= 25.538
  09:56:46 STEP 2376 H=2376:00 +CPU= 45.873
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002364
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649_98.zip
Uploading the intermediate file: upload_file_98.zip
  09:57:11 STEP 2377 H=2377:00 +CPU= 24.648
  09:57:37 STEP 2378 H=2378:00 +CPU= 25.919
  09:58:24 STEP 2379 H=2379:00 +CPU= 37.818
  09:58:52 STEP 2380 H=2380:00 +CPU= 25.403
  09:59:18 STEP 2381 H=2381:00 +CPU= 24.368
  10:00:04 STEP 2382 H=2382:00 +CPU= 39.705
  10:00:30 STEP 2383 H=2383:00 +CPU= 24.540
  10:00:55 STEP 2384 H=2384:00 +CPU= 25.894
  10:01:34 STEP 2385 H=2385:00 +CPU= 38.561
  10:02:00 STEP 2386 H=2386:00 +CPU= 25.836
  10:02:25 STEP 2387 H=2387:00 +CPU= 24.630
  10:03:11 STEP 2388 H=2388:00 +CPU= 42.619
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002388
  10:03:36 STEP 2389 H=2389:00 +CPU= 24.982
  10:04:01 STEP 2390 H=2390:00 +CPU= 24.977
  10:04:39 STEP 2391 H=2391:00 +CPU= 37.749
  10:05:05 STEP 2392 H=2392:00 +CPU= 25.553
  10:05:30 STEP 2393 H=2393:00 +CPU= 24.477
  10:06:09 STEP 2394 H=2394:00 +CPU= 38.983
  10:06:34 STEP 2395 H=2395:00 +CPU= 25.026
  10:07:00 STEP 2396 H=2396:00 +CPU= 25.973
  10:07:39 STEP 2397 H=2397:00 +CPU= 39.029
  10:08:06 STEP 2398 H=2398:00 +CPU= 25.852
  10:08:31 STEP 2399 H=2399:00 +CPU= 25.493
  10:09:20 STEP 2400 H=2400:00 +CPU= 46.191
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002388
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649_99.zip
Uploading the intermediate file: upload_file_99.zip
  10:09:44 STEP 2401 H=2401:00 +CPU= 24.369
  10:10:09 STEP 2402 H=2402:00 +CPU= 25.072
  10:10:48 STEP 2403 H=2403:00 +CPU= 38.528
  10:11:13 STEP 2404 H=2404:00 +CPU= 25.024
  10:11:39 STEP 2405 H=2405:00 +CPU= 24.488
  10:12:20 STEP 2406 H=2406:00 +CPU= 39.165
  10:12:45 STEP 2407 H=2407:00 +CPU= 24.931
  10:13:10 STEP 2408 H=2408:00 +CPU= 25.569
  10:13:49 STEP 2409 H=2409:00 +CPU= 38.995
  10:14:14 STEP 2410 H=2410:00 +CPU= 24.956
  10:14:39 STEP 2411 H=2411:00 +CPU= 24.515
  10:15:21 STEP 2412 H=2412:00 +CPU= 42.386
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002412
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002412
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002412
  10:15:46 STEP 2413 H=2413:00 +CPU= 24.674
  10:16:12 STEP 2414 H=2414:00 +CPU= 25.273
  10:16:50 STEP 2415 H=2415:00 +CPU= 38.002
  10:17:16 STEP 2416 H=2416:00 +CPU= 25.499
  10:17:41 STEP 2417 H=2417:00 +CPU= 25.213
  10:18:20 STEP 2418 H=2418:00 +CPU= 39.311
  10:18:45 STEP 2419 H=2419:00 +CPU= 24.593
  10:19:10 STEP 2420 H=2420:00 +CPU= 25.511
  10:19:49 STEP 2421 H=2421:00 +CPU= 38.254
  10:20:15 STEP 2422 H=2422:00 +CPU= 25.728
  10:20:40 STEP 2423 H=2423:00 +CPU= 25.539
  10:21:26 STEP 2424 H=2424:00 +CPU= 45.342
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649_100.zip
Uploading the intermediate file: upload_file_100.zip
  10:21:50 STEP 2425 H=2425:00 +CPU= 24.414
  10:22:15 STEP 2426 H=2426:00 +CPU= 25.112
  10:22:54 STEP 2427 H=2427:00 +CPU= 37.927
  10:23:19 STEP 2428 H=2428:00 +CPU= 25.442
  10:23:44 STEP 2429 H=2429:00 +CPU= 24.799
  10:24:23 STEP 2430 H=2430:00 +CPU= 39.050
  10:24:48 STEP 2431 H=2431:00 +CPU= 24.445
  10:25:13 STEP 2432 H=2432:00 +CPU= 25.376
  10:25:51 STEP 2433 H=2433:00 +CPU= 38.151
  10:26:17 STEP 2434 H=2434:00 +CPU= 25.400
  10:26:41 STEP 2435 H=2435:00 +CPU= 24.597
  10:27:25 STEP 2436 H=2436:00 +CPU= 42.495
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002436
  10:27:50 STEP 2437 H=2437:00 +CPU= 24.519
  10:28:20 STEP 2438 H=2438:00 +CPU= 25.852
  10:29:01 STEP 2439 H=2439:00 +CPU= 38.507
  10:29:26 STEP 2440 H=2440:00 +CPU= 24.706
  10:29:50 STEP 2441 H=2441:00 +CPU= 24.430
  10:30:33 STEP 2442 H=2442:00 +CPU= 38.385
  10:30:57 STEP 2443 H=2443:00 +CPU= 23.891
  10:31:22 STEP 2444 H=2444:00 +CPU= 25.290
  10:32:02 STEP 2445 H=2445:00 +CPU= 39.121
  10:32:27 STEP 2446 H=2446:00 +CPU= 25.313
  10:32:52 STEP 2447 H=2447:00 +CPU= 25.421
  10:33:39 STEP 2448 H=2448:00 +CPU= 45.970
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1986050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0064
(argv4) batchid: 955
(argv5) wuid: 12171708
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/18
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/18/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/18/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_c351ef0a3b1df74c83fe9a3dd513b726 to: /var/lib/boinc-client/slots/18/oifs_43r3_ps_0064_1986050100_123_955_12171708.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/18/oifs_43r3_ps_0064_1986050100_123_955_12171708.zip
ic_ancil_file: ic_ancil_12171708
ifsdata_file: ifsdata_12171708
climate_data_file: clim_data_12171708
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_a3fb8d00ba4a04b2292a9ebe07442dec to: /var/lib/boinc-client/slots/18/ic_ancil_12171708.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/18/ic_ancil_12171708.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_b1db92d7c204d1c5eee60b8e20c7c986 to: /var/lib/boinc-client/slots/18/ifsdata/ifsdata_12171708.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/18/ifsdata/ifsdata_12171708.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/18/159l_2/clim_data_12171708.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/18/159l_2/clim_data_12171708.zip
Checking for progress XML file: /var/lib/boinc-client/slots/18/progress_file_12171708.xml
Opened progress file ok : /var/lib/boinc-client/slots/18/progress_file_12171708.xml
-- Model is restarting --
Adjusting last_iter, 2448, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/18/progress_file_12171708.xml
last_cpu_time: 71457
upload_file_number: 101
last_iter: 2447
last_upload: 8726400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649
The child process has been launched with process id: 445643
Executing the command: /var/lib/boinc-client/slots/18/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:debian:1:1:445643:445643] [20230117:103525:1673919325:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  10:36:07 STEP 2448 H=2448:00 +CPU= 39.481
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171708/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0064_1986050100_123_955_12171708_0_r832224649_101.zip
  10:36:30 STEP 2449 H=2449:00 +CPU= 22.441
Uploading the intermediate file: upload_file_101.zip
  10:36:53 STEP 2450 H=2450:00 +CPU= 22.938
  10:37:29 STEP 2451 H=2451:00 +CPU= 35.462
  10:37:53 STEP 2452 H=2452:00 +CPU= 23.900
  10:38:16 STEP 2453 H=2453:00 +CPU= 22.839
double free or corruption (out)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:23:09 1538037 22256087 oifs_43r3_ps_0064_1986050100_123_955_12171708_0 7,948,800 64,227 0.0081
09 May 2023 16:22:59 1538037 22256087 oifs_43r3_ps_0064_1986050100_123_955_12171708_0 7,084,800 56,939 0.0080
09 May 2023 16:22:59 1538037 22256087 oifs_43r3_ps_0064_1986050100_123_955_12171708_0 7,084,800 56,939 0.0080
09 May 2023 16:22:49 1538037 22256087 oifs_43r3_ps_0064_1986050100_123_955_12171708_0 6,220,800 49,721 0.0080
09 May 2023 16:22:41 1538037 22256087 oifs_43r3_ps_0064_1986050100_123_955_12171708_0 5,356,800 42,473 0.0079
09 May 2023 16:22:32 1538037 22256087 oifs_43r3_ps_0064_1986050100_123_955_12171708_0 4,492,800 35,508 0.0079
09 May 2023 16:22:28 1538037 22256087 oifs_43r3_ps_0064_1986050100_123_955_12171708_0 3,628,800 28,814 0.0079
09 May 2023 16:22:15 1538037 22256087 oifs_43r3_ps_0064_1986050100_123_955_12171708_0 2,592,000 20,249 0.0078
09 May 2023 16:22:08 1538037 22256087 oifs_43r3_ps_0064_1986050100_123_955_12171708_0 1,728,000 13,558 0.0078
09 May 2023 16:21:59 1538037 22256087 oifs_43r3_ps_0064_1986050100_123_955_12171708_0 864,000 6,819 0.0079


©2024 climateprediction.net