climateprediction.net home page
Task 22280733

Task 22280733

Name oifs_43r3_ps_0206_2009050100_123_978_12194850_0
Workunit 12194850
Created 23 Dec 2022, 20:27:19 UTC
Sent 20 Jan 2023, 6:01:17 UTC
Report deadline 21 Mar 2023, 6:01:17 UTC
Received 21 Jan 2023, 8:03:05 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1515830
Run time 11 hours 23 min 56 sec
CPU time 11 hours 18 min 50 sec
Validate state Invalid
Credit 4,596.48
Device peak FLOPS 6.33 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,419.36 MB
Peak swap size 4,978.08 MB
Peak disk usage 7,674.14 MB
Stderr 
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
o projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+001884
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0206_2009050100_123_978_12194850_0_r176895912_78.zip
Uploading the intermediate file: upload_file_78.zip
  21:55:22 STEP 1897 H=1897:00 +CPU= 13.509
  21:55:36 STEP 1898 H=1898:00 +CPU= 13.846
  21:55:58 STEP 1899 H=1899:00 +CPU= 21.282
  21:56:11 STEP 1900 H=1900:00 +CPU= 13.886
  21:56:25 STEP 1901 H=1901:00 +CPU= 13.511
  21:56:47 STEP 1902 H=1902:00 +CPU= 21.596
  21:57:00 STEP 1903 H=1903:00 +CPU= 13.494
  21:57:14 STEP 1904 H=1904:00 +CPU= 13.875
  21:57:35 STEP 1905 H=1905:00 +CPU= 21.149
  21:57:49 STEP 1906 H=1906:00 +CPU= 13.882
  21:58:03 STEP 1907 H=1907:00 +CPU= 13.503
  21:58:26 STEP 1908 H=1908:00 +CPU= 23.375
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+001908
  21:58:40 STEP 1909 H=1909:00 +CPU= 13.513
  21:58:53 STEP 1910 H=1910:00 +CPU= 13.887
  21:59:15 STEP 1911 H=1911:00 +CPU= 21.158
  21:59:29 STEP 1912 H=1912:00 +CPU= 13.877
  21:59:42 STEP 1913 H=1913:00 +CPU= 13.511
  22:00:04 STEP 1914 H=1914:00 +CPU= 21.599
  22:00:17 STEP 1915 H=1915:00 +CPU= 13.487
  22:00:31 STEP 1916 H=1916:00 +CPU= 13.875
  22:00:52 STEP 1917 H=1917:00 +CPU= 21.144
  22:01:06 STEP 1918 H=1918:00 +CPU= 13.845
  22:01:20 STEP 1919 H=1919:00 +CPU= 13.892
  22:01:45 STEP 1920 H=1920:00 +CPU= 25.209
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+001908
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0206_2009050100_123_978_12194850_0_r176895912_79.zip
Uploading the intermediate file: upload_file_79.zip
  22:01:59 STEP 1921 H=1921:00 +CPU= 13.512
  22:02:13 STEP 1922 H=1922:00 +CPU= 13.864
  22:02:34 STEP 1923 H=1923:00 +CPU= 21.327
  22:02:48 STEP 1924 H=1924:00 +CPU= 13.862
  22:03:01 STEP 1925 H=1925:00 +CPU= 13.506
  22:03:23 STEP 1926 H=1926:00 +CPU= 21.621
  22:03:37 STEP 1927 H=1927:00 +CPU= 13.505
  22:03:51 STEP 1928 H=1928:00 +CPU= 13.888
  22:04:12 STEP 1929 H=1929:00 +CPU= 21.200
  22:04:26 STEP 1930 H=1930:00 +CPU= 13.908
  22:04:39 STEP 1931 H=1931:00 +CPU= 13.514
  22:05:03 STEP 1932 H=1932:00 +CPU= 23.401
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+001932
  22:05:16 STEP 1933 H=1933:00 +CPU= 13.503
  22:05:30 STEP 1934 H=1934:00 +CPU= 13.897
  22:05:51 STEP 1935 H=1935:00 +CPU= 21.194
  22:06:05 STEP 1936 H=1936:00 +CPU= 13.896
  22:06:19 STEP 1937 H=1937:00 +CPU= 13.501
  22:06:40 STEP 1938 H=1938:00 +CPU= 21.618
  22:06:54 STEP 1939 H=1939:00 +CPU= 13.494
  22:07:08 STEP 1940 H=1940:00 +CPU= 13.857
  22:07:29 STEP 1941 H=1941:00 +CPU= 21.198
  22:07:43 STEP 1942 H=1942:00 +CPU= 13.865
  22:07:57 STEP 1943 H=1943:00 +CPU= 13.912
  22:08:22 STEP 1944 H=1944:00 +CPU= 25.233
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+001932
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0206_2009050100_123_978_12194850_0_r176895912_80.zip
Uploading the intermediate file: upload_file_80.zip
  22:08:36 STEP 1945 H=1945:00 +CPU= 13.489
  22:08:49 STEP 1946 H=1946:00 +CPU= 13.857
  22:09:11 STEP 1947 H=1947:00 +CPU= 21.352
  22:09:25 STEP 1948 H=1948:00 +CPU= 13.879
  22:09:38 STEP 1949 H=1949:00 +CPU= 13.498
  22:10:00 STEP 1950 H=1950:00 +CPU= 21.639
  22:10:13 STEP 1951 H=1951:00 +CPU= 13.506
  22:10:27 STEP 1952 H=1952:00 +CPU= 13.908
  22:10:49 STEP 1953 H=1953:00 +CPU= 21.195
  22:11:02 STEP 1954 H=1954:00 +CPU= 13.891
  22:11:16 STEP 1955 H=1955:00 +CPU= 13.525
  22:11:39 STEP 1956 H=1956:00 +CPU= 23.403
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+001956
  22:11:53 STEP 1957 H=1957:00 +CPU= 13.518
  22:12:07 STEP 1958 H=1958:00 +CPU= 13.894
  22:12:28 STEP 1959 H=1959:00 +CPU= 21.183
  22:12:42 STEP 1960 H=1960:00 +CPU= 13.880
  22:12:56 STEP 1961 H=1961:00 +CPU= 13.511
  22:13:17 STEP 1962 H=1962:00 +CPU= 21.623
  22:13:31 STEP 1963 H=1963:00 +CPU= 13.503
  22:13:45 STEP 1964 H=1964:00 +CPU= 13.873
  22:14:06 STEP 1965 H=1965:00 +CPU= 21.196
  22:14:20 STEP 1966 H=1966:00 +CPU= 13.863
  22:14:34 STEP 1967 H=1967:00 +CPU= 13.901
  22:14:59 STEP 1968 H=1968:00 +CPU= 25.206
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+001956
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0206_2009050100_123_978_12194850_0_r176895912_81.zip
Uploading the intermediate file: upload_file_81.zip
  22:15:12 STEP 1969 H=1969:00 +CPU= 13.510
  22:15:26 STEP 1970 H=1970:00 +CPU= 13.851
  22:15:48 STEP 1971 H=1971:00 +CPU= 21.313
  22:16:02 STEP 1972 H=1972:00 +CPU= 13.860
  22:16:15 STEP 1973 H=1973:00 +CPU= 13.495
  22:16:37 STEP 1974 H=1974:00 +CPU= 21.626
  22:16:50 STEP 1975 H=1975:00 +CPU= 13.502
  22:17:04 STEP 1976 H=1976:00 +CPU= 13.895
  22:17:25 STEP 1977 H=1977:00 +CPU= 21.188
  22:17:39 STEP 1978 H=1978:00 +CPU= 13.890
  22:17:53 STEP 1979 H=1979:00 +CPU= 13.499
  22:18:16 STEP 1980 H=1980:00 +CPU= 23.401
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+001980
  22:18:30 STEP 1981 H=1981:00 +CPU= 13.511
  22:18:44 STEP 1982 H=1982:00 +CPU= 13.881
  22:19:05 STEP 1983 H=1983:00 +CPU= 21.196
  22:19:19 STEP 1984 H=1984:00 +CPU= 13.885
  22:19:32 STEP 1985 H=1985:00 +CPU= 13.494
  22:19:54 STEP 1986 H=1986:00 +CPU= 21.609
  22:20:07 STEP 1987 H=1987:00 +CPU= 13.488
  22:20:21 STEP 1988 H=1988:00 +CPU= 13.848
  22:20:42 STEP 1989 H=1989:00 +CPU= 21.180
  22:20:56 STEP 1990 H=1990:00 +CPU= 13.837
  22:21:10 STEP 1991 H=1991:00 +CPU= 13.900
  22:21:35 STEP 1992 H=1992:00 +CPU= 25.202
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+001980
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0206_2009050100_123_978_12194850_0_r176895912_82.zip
Uploading the intermediate file: upload_file_82.zip
  22:21:49 STEP 1993 H=1993:00 +CPU= 13.490
  22:22:03 STEP 1994 H=1994:00 +CPU= 13.843
  22:22:24 STEP 1995 H=1995:00 +CPU= 21.267
  22:22:38 STEP 1996 H=1996:00 +CPU= 13.850
  22:22:51 STEP 1997 H=1997:00 +CPU= 13.481
  22:23:13 STEP 1998 H=1998:00 +CPU= 21.578
  22:23:27 STEP 1999 H=1999:00 +CPU= 13.497
  22:23:40 STEP 2000 H=2000:00 +CPU= 13.861
  22:24:02 STEP 2001 H=2001:00 +CPU= 21.155
  22:24:16 STEP 2002 H=2002:00 +CPU= 13.860
  22:24:29 STEP 2003 H=2003:00 +CPU= 13.498
  22:24:52 STEP 2004 H=2004:00 +CPU= 23.362
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002004
  22:25:06 STEP 2005 H=2005:00 +CPU= 13.471
  22:25:20 STEP 2006 H=2006:00 +CPU= 13.869
  22:25:41 STEP 2007 H=2007:00 +CPU= 21.145
  22:25:55 STEP 2008 H=2008:00 +CPU= 13.846
  22:26:08 STEP 2009 H=2009:00 +CPU= 13.479
  22:26:30 STEP 2010 H=2010:00 +CPU= 21.579
  22:26:43 STEP 2011 H=2011:00 +CPU= 13.458
  22:26:57 STEP 2012 H=2012:00 +CPU= 13.827
  22:27:18 STEP 2013 H=2013:00 +CPU= 21.152
  22:27:32 STEP 2014 H=2014:00 +CPU= 13.836
  22:27:46 STEP 2015 H=2015:00 +CPU= 13.870
  22:28:11 STEP 2016 H=2016:00 +CPU= 25.175
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002004
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0206_2009050100_123_978_12194850_0_r176895912_83.zip
Uploading the intermediate file: upload_file_83.zip
  22:28:25 STEP 2017 H=2017:00 +CPU= 13.487
  22:28:39 STEP 2018 H=2018:00 +CPU= 13.816
  22:29:00 STEP 2019 H=2019:00 +CPU= 21.311
  22:29:14 STEP 2020 H=2020:00 +CPU= 13.832
  22:29:27 STEP 2021 H=2021:00 +CPU= 13.464
  22:29:49 STEP 2022 H=2022:00 +CPU= 21.576
  22:30:03 STEP 2023 H=2023:00 +CPU= 13.481
  22:30:16 STEP 2024 H=2024:00 +CPU= 13.853
  22:30:38 STEP 2025 H=2025:00 +CPU= 21.148
  22:30:51 STEP 2026 H=2026:00 +CPU= 13.871
  22:31:05 STEP 2027 H=2027:00 +CPU= 13.480
  22:31:28 STEP 2028 H=2028:00 +CPU= 23.368
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002028
  22:31:42 STEP 2029 H=2029:00 +CPU= 13.497
  22:31:56 STEP 2030 H=2030:00 +CPU= 13.870
  22:32:17 STEP 2031 H=2031:00 +CPU= 21.163
  22:32:31 STEP 2032 H=2032:00 +CPU= 13.852
  22:32:44 STEP 2033 H=2033:00 +CPU= 13.483
  22:33:06 STEP 2034 H=2034:00 +CPU= 21.597
  22:33:19 STEP 2035 H=2035:00 +CPU= 13.474
  22:33:33 STEP 2036 H=2036:00 +CPU= 13.854
  22:33:55 STEP 2037 H=2037:00 +CPU= 21.158
  22:34:08 STEP 2038 H=2038:00 +CPU= 13.833
  22:34:22 STEP 2039 H=2039:00 +CPU= 13.882
  22:34:47 STEP 2040 H=2040:00 +CPU= 25.199
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002028
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0206_2009050100_123_978_12194850_0_r176895912_84.zip
Uploading the intermediate file: upload_file_84.zip
  22:35:01 STEP 2041 H=2041:00 +CPU= 13.480
  22:35:15 STEP 2042 H=2042:00 +CPU= 13.828
  22:35:36 STEP 2043 H=2043:00 +CPU= 21.279
  22:35:50 STEP 2044 H=2044:00 +CPU= 13.845
  22:36:03 STEP 2045 H=2045:00 +CPU= 13.461
  22:36:25 STEP 2046 H=2046:00 +CPU= 21.604
  22:36:39 STEP 2047 H=2047:00 +CPU= 13.490
  22:36:52 STEP 2048 H=2048:00 +CPU= 13.859
  22:37:14 STEP 2049 H=2049:00 +CPU= 21.171
  22:37:28 STEP 2050 H=2050:00 +CPU= 13.863
  22:37:41 STEP 2051 H=2051:00 +CPU= 13.486
  22:38:04 STEP 2052 H=2052:00 +CPU= 23.374
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002052
  22:38:18 STEP 2053 H=2053:00 +CPU= 13.491
  22:38:32 STEP 2054 H=2054:00 +CPU= 13.870
  22:38:53 STEP 2055 H=2055:00 +CPU= 21.154
  22:39:07 STEP 2056 H=2056:00 +CPU= 13.854
  22:39:20 STEP 2057 H=2057:00 +CPU= 13.484
  22:39:42 STEP 2058 H=2058:00 +CPU= 21.592
  22:39:56 STEP 2059 H=2059:00 +CPU= 13.474
  22:40:09 STEP 2060 H=2060:00 +CPU= 13.835
  22:40:31 STEP 2061 H=2061:00 +CPU= 21.162
  22:40:44 STEP 2062 H=2062:00 +CPU= 13.841
  22:40:58 STEP 2063 H=2063:00 +CPU= 13.856
  22:41:24 STEP 2064 H=2064:00 +CPU= 25.241
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002052
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0206_2009050100_123_978_12194850_0_r176895912_85.zip
Uploading the intermediate file: upload_file_85.zip
  22:41:37 STEP 2065 H=2065:00 +CPU= 13.481
  22:41:51 STEP 2066 H=2066:00 +CPU= 13.836
  22:42:12 STEP 2067 H=2067:00 +CPU= 21.254
  22:42:26 STEP 2068 H=2068:00 +CPU= 13.828
  22:42:40 STEP 2069 H=2069:00 +CPU= 13.471
  22:43:01 STEP 2070 H=2070:00 +CPU= 21.564
  22:43:15 STEP 2071 H=2071:00 +CPU= 13.488
  22:43:29 STEP 2072 H=2072:00 +CPU= 13.867
  22:43:50 STEP 2073 H=2073:00 +CPU= 21.135
  22:44:04 STEP 2074 H=2074:00 +CPU= 13.856
  22:44:17 STEP 2075 H=2075:00 +CPU= 13.475
  22:44:40 STEP 2076 H=2076:00 +CPU= 23.325
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002076
  22:44:54 STEP 2077 H=2077:00 +CPU= 13.471
  22:45:08 STEP 2078 H=2078:00 +CPU= 13.853
  22:45:29 STEP 2079 H=2079:00 +CPU= 21.117
  22:45:43 STEP 2080 H=2080:00 +CPU= 13.850
  22:45:56 STEP 2081 H=2081:00 +CPU= 13.467
  22:46:18 STEP 2082 H=2082:00 +CPU= 21.565
  22:46:31 STEP 2083 H=2083:00 +CPU= 13.457
  22:46:45 STEP 2084 H=2084:00 +CPU= 13.831
  22:47:06 STEP 2085 H=2085:00 +CPU= 21.122
  22:47:20 STEP 2086 H=2086:00 +CPU= 13.816
  22:47:34 STEP 2087 H=2087:00 +CPU= 13.867
  22:47:59 STEP 2088 H=2088:00 +CPU= 25.205
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002076
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0206_2009050100_123_978_12194850_0_r176895912_86.zip
Uploading the intermediate file: upload_file_86.zip
  22:48:13 STEP 2089 H=2089:00 +CPU= 13.469
  22:48:27 STEP 2090 H=2090:00 +CPU= 13.978
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2009050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0206
(argv4) batchid: 978
(argv5) wuid: 12194850
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/0
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_8f7054c445dad6402af3d9996fe5b13a to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0206_2009050100_123_978_12194850.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0206_2009050100_123_978_12194850.zip
ic_ancil_file: ic_ancil_12194850
ifsdata_file: ifsdata_12194850
climate_data_file: clim_data_12194850
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_66074c1735cbe2e9426103097db6d28c to: /var/lib/boinc-client/slots/0/ic_ancil_12194850.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/0/ic_ancil_12194850.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_fac520ec373b111fc3b5ca04adde1ee9 to: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12194850.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12194850.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/0/159l_2/clim_data_12194850.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/0/159l_2/clim_data_12194850.zip
Checking for progress XML file: /var/lib/boinc-client/slots/0/progress_file_12194850.xml
Opened progress file ok : /var/lib/boinc-client/slots/0/progress_file_12194850.xml
-- Model is restarting --
Adjusting last_iter, 2089, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/0/progress_file_12194850.xml
last_cpu_time: 36466
upload_file_number: 87
last_iter: 2087
last_upload: 7516800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0206_2009050100_123_978_12194850_0_r176895912
The child process has been launched with process id: 83944
Executing the command: /var/lib/boinc-client/slots/0/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:annares:1:1:83944:83944] [20230120:234947:1674276587:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  23:50:13 STEP 2088 H=2088:00 +CPU= 23.883
  23:50:27 STEP 2089 H=2089:00 +CPU= 13.417
  23:50:40 STEP 2090 H=2090:00 +CPU= 13.772
  23:51:01 STEP 2091 H=2091:00 +CPU= 21.058
  23:51:15 STEP 2092 H=2092:00 +CPU= 13.777
  23:51:29 STEP 2093 H=2093:00 +CPU= 13.424
  23:51:50 STEP 2094 H=2094:00 +CPU= 21.496
  23:52:04 STEP 2095 H=2095:00 +CPU= 13.431
  23:52:18 STEP 2096 H=2096:00 +CPU= 13.817
  23:52:39 STEP 2097 H=2097:00 +CPU= 21.058
  23:52:52 STEP 2098 H=2098:00 +CPU= 13.800
  23:53:06 STEP 2099 H=2099:00 +CPU= 13.433
  23:53:29 STEP 2100 H=2100:00 +CPU= 23.243
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002100
  23:53:43 STEP 2101 H=2101:00 +CPU= 13.459
  23:53:56 STEP 2102 H=2102:00 +CPU= 13.804
  23:54:18 STEP 2103 H=2103:00 +CPU= 21.070
  23:54:31 STEP 2104 H=2104:00 +CPU= 13.817
  23:54:45 STEP 2105 H=2105:00 +CPU= 13.443
  23:55:06 STEP 2106 H=2106:00 +CPU= 21.501
  23:55:20 STEP 2107 H=2107:00 +CPU= 13.427
  23:55:34 STEP 2108 H=2108:00 +CPU= 13.783
  23:55:55 STEP 2109 H=2109:00 +CPU= 21.069
  23:56:09 STEP 2110 H=2110:00 +CPU= 13.808
  23:56:22 STEP 2111 H=2111:00 +CPU= 13.836
  23:56:47 STEP 2112 H=2112:00 +CPU= 25.007
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002100
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0206_2009050100_123_978_12194850_0_r176895912_87.zip
Uploading the intermediate file: upload_file_87.zip
  23:57:01 STEP 2113 H=2113:00 +CPU= 13.431
  23:57:15 STEP 2114 H=2114:00 +CPU= 13.839
  23:57:36 STEP 2115 H=2115:00 +CPU= 21.213
  23:57:50 STEP 2116 H=2116:00 +CPU= 13.805
  23:58:03 STEP 2117 H=2117:00 +CPU= 13.443
  23:58:25 STEP 2118 H=2118:00 +CPU= 21.529
  23:58:38 STEP 2119 H=2119:00 +CPU= 13.443
  23:58:52 STEP 2120 H=2120:00 +CPU= 13.837
  23:59:13 STEP 2121 H=2121:00 +CPU= 21.105
  23:59:27 STEP 2122 H=2122:00 +CPU= 13.825
  23:59:41 STEP 2123 H=2123:00 +CPU= 13.459
  00:00:04 STEP 2124 H=2124:00 +CPU= 23.289
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002124
  00:00:17 STEP 2125 H=2125:00 +CPU= 13.429
  00:00:31 STEP 2126 H=2126:00 +CPU= 13.815
  00:00:52 STEP 2127 H=2127:00 +CPU= 21.074
  00:01:06 STEP 2128 H=2128:00 +CPU= 13.815
  00:01:20 STEP 2129 H=2129:00 +CPU= 13.434
  00:01:41 STEP 2130 H=2130:00 +CPU= 21.526
  00:01:55 STEP 2131 H=2131:00 +CPU= 13.434
  00:02:08 STEP 2132 H=2132:00 +CPU= 13.798
  00:02:30 STEP 2133 H=2133:00 +CPU= 21.072
  00:02:43 STEP 2134 H=2134:00 +CPU= 13.796
  00:02:57 STEP 2135 H=2135:00 +CPU= 13.841
  00:03:22 STEP 2136 H=2136:00 +CPU= 25.095
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002124
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0206_2009050100_123_978_12194850_0_r176895912_88.zip
Uploading the intermediate file: upload_file_88.zip
  00:03:36 STEP 2137 H=2137:00 +CPU= 13.440
  00:03:50 STEP 2138 H=2138:00 +CPU= 13.783
  00:04:11 STEP 2139 H=2139:00 +CPU= 21.253
  00:04:25 STEP 2140 H=2140:00 +CPU= 13.799
  00:04:38 STEP 2141 H=2141:00 +CPU= 13.433
  00:05:00 STEP 2142 H=2142:00 +CPU= 21.500
  00:05:13 STEP 2143 H=2143:00 +CPU= 13.452
  00:05:27 STEP 2144 H=2144:00 +CPU= 13.832
  00:05:48 STEP 2145 H=2145:00 +CPU= 21.071
  00:06:02 STEP 2146 H=2146:00 +CPU= 13.832
  00:06:15 STEP 2147 H=2147:00 +CPU= 13.432
  00:06:39 STEP 2148 H=2148:00 +CPU= 23.282
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002148
  00:06:52 STEP 2149 H=2149:00 +CPU= 13.448
  00:07:06 STEP 2150 H=2150:00 +CPU= 13.834
  00:07:27 STEP 2151 H=2151:00 +CPU= 21.072
  00:07:41 STEP 2152 H=2152:00 +CPU= 13.818
  00:07:54 STEP 2153 H=2153:00 +CPU= 13.424
  00:08:16 STEP 2154 H=2154:00 +CPU= 21.503
  00:08:29 STEP 2155 H=2155:00 +CPU= 13.428
  00:08:43 STEP 2156 H=2156:00 +CPU= 13.805
  00:09:04 STEP 2157 H=2157:00 +CPU= 21.055
  00:09:18 STEP 2158 H=2158:00 +CPU= 13.805
  00:09:32 STEP 2159 H=2159:00 +CPU= 13.823
  00:09:57 STEP 2160 H=2160:00 +CPU= 25.088
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002148
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0206_2009050100_123_978_12194850_0_r176895912_89.zip
Uploading the intermediate file: upload_file_89.zip
  00:10:10 STEP 2161 H=2161:00 +CPU= 13.456
  00:10:24 STEP 2162 H=2162:00 +CPU= 13.808
  00:10:46 STEP 2163 H=2163:00 +CPU= 21.196
  00:10:59 STEP 2164 H=2164:00 +CPU= 13.804
  00:11:13 STEP 2165 H=2165:00 +CPU= 13.434
  00:11:34 STEP 2166 H=2166:00 +CPU= 21.499
  00:11:48 STEP 2167 H=2167:00 +CPU= 13.444
  00:12:02 STEP 2168 H=2168:00 +CPU= 13.830
  00:12:23 STEP 2169 H=2169:00 +CPU= 21.066
  00:12:37 STEP 2170 H=2170:00 +CPU= 13.834
  00:12:50 STEP 2171 H=2171:00 +CPU= 13.443
  00:13:13 STEP 2172 H=2172:00 +CPU= 23.275
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002172
  00:13:27 STEP 2173 H=2173:00 +CPU= 13.449
  00:13:41 STEP 2174 H=2174:00 +CPU= 13.819
  00:14:02 STEP 2175 H=2175:00 +CPU= 21.072
  00:14:16 STEP 2176 H=2176:00 +CPU= 13.815
  00:14:29 STEP 2177 H=2177:00 +CPU= 13.427
  00:14:51 STEP 2178 H=2178:00 +CPU= 21.520
  00:15:04 STEP 2179 H=2179:00 +CPU= 13.429
  00:15:18 STEP 2180 H=2180:00 +CPU= 13.806
  00:15:39 STEP 2181 H=2181:00 +CPU= 21.076
  00:15:53 STEP 2182 H=2182:00 +CPU= 13.800
  00:16:07 STEP 2183 H=2183:00 +CPU= 13.831
  00:16:32 STEP 2184 H=2184:00 +CPU= 25.109
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002172
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0206_2009050100_123_978_12194850_0_r176895912_90.zip
Uploading the intermediate file: upload_file_90.zip
  00:16:45 STEP 2185 H=2185:00 +CPU= 13.467
  00:16:59 STEP 2186 H=2186:00 +CPU= 13.821
  00:17:20 STEP 2187 H=2187:00 +CPU= 21.209
  00:17:34 STEP 2188 H=2188:00 +CPU= 13.804
  00:17:48 STEP 2189 H=2189:00 +CPU= 13.435
  00:18:09 STEP 2190 H=2190:00 +CPU= 21.517
  00:18:23 STEP 2191 H=2191:00 +CPU= 13.440
  00:18:36 STEP 2192 H=2192:00 +CPU= 13.836
  00:18:58 STEP 2193 H=2193:00 +CPU= 21.088
  00:19:11 STEP 2194 H=2194:00 +CPU= 13.831
  00:19:25 STEP 2195 H=2195:00 +CPU= 13.448
  00:19:48 STEP 2196 H=2196:00 +CPU= 23.281
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002196
  00:20:02 STEP 2197 H=2197:00 +CPU= 13.460
  00:20:16 STEP 2198 H=2198:00 +CPU= 13.824
  00:20:37 STEP 2199 H=2199:00 +CPU= 21.050
  00:20:50 STEP 2200 H=2200:00 +CPU= 13.813
  00:21:04 STEP 2201 H=2201:00 +CPU= 13.430
  00:21:25 STEP 2202 H=2202:00 +CPU= 21.477
  00:21:39 STEP 2203 H=2203:00 +CPU= 13.421
  00:21:53 STEP 2204 H=2204:00 +CPU= 13.790
  00:22:14 STEP 2205 H=2205:00 +CPU= 21.072
  00:22:28 STEP 2206 H=2206:00 +CPU= 13.784
  00:22:41 STEP 2207 H=2207:00 +CPU= 13.829
  00:23:06 STEP 2208 H=2208:00 +CPU= 25.075
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002196
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0206_2009050100_123_978_12194850_0_r176895912_91.zip
Uploading the intermediate file: upload_file_91.zip
  00:23:20 STEP 2209 H=2209:00 +CPU= 13.422
  00:23:34 STEP 2210 H=2210:00 +CPU= 13.765
  00:23:55 STEP 2211 H=2211:00 +CPU= 21.124
  00:24:09 STEP 2212 H=2212:00 +CPU= 13.779
  00:24:22 STEP 2213 H=2213:00 +CPU= 13.409
  00:24:44 STEP 2214 H=2214:00 +CPU= 21.481
  00:24:57 STEP 2215 H=2215:00 +CPU= 13.401
  00:25:11 STEP 2216 H=2216:00 +CPU= 13.802
  00:25:32 STEP 2217 H=2217:00 +CPU= 21.058
  00:25:46 STEP 2218 H=2218:00 +CPU= 13.784
  00:25:59 STEP 2219 H=2219:00 +CPU= 13.407
  00:26:22 STEP 2220 H=2220:00 +CPU= 23.228
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002220
  00:26:36 STEP 2221 H=2221:00 +CPU= 13.423
  00:26:50 STEP 2222 H=2222:00 +CPU= 13.795
  00:27:11 STEP 2223 H=2223:00 +CPU= 21.041
  00:27:24 STEP 2224 H=2224:00 +CPU= 13.780
  00:27:38 STEP 2225 H=2225:00 +CPU= 13.407
  00:27:59 STEP 2226 H=2226:00 +CPU= 21.458
  00:28:13 STEP 2227 H=2227:00 +CPU= 13.382
  00:28:27 STEP 2228 H=2228:00 +CPU= 13.766
  00:28:48 STEP 2229 H=2229:00 +CPU= 21.045
  00:29:01 STEP 2230 H=2230:00 +CPU= 13.770
  00:29:15 STEP 2231 H=2231:00 +CPU= 13.809
  00:29:40 STEP 2232 H=2232:00 +CPU= 25.099
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002220
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0206_2009050100_123_978_12194850_0_r176895912_92.zip
Uploading the intermediate file: upload_file_92.zip
  00:29:54 STEP 2233 H=2233:00 +CPU= 13.401
  00:30:08 STEP 2234 H=2234:00 +CPU= 13.781
  00:30:29 STEP 2235 H=2235:00 +CPU= 21.155
  00:30:43 STEP 2236 H=2236:00 +CPU= 13.776
  00:30:56 STEP 2237 H=2237:00 +CPU= 13.410
  00:31:18 STEP 2238 H=2238:00 +CPU= 21.510
  00:31:31 STEP 2239 H=2239:00 +CPU= 13.421
  00:31:45 STEP 2240 H=2240:00 +CPU= 13.795
  00:32:06 STEP 2241 H=2241:00 +CPU= 21.090
  00:32:20 STEP 2242 H=2242:00 +CPU= 13.810
  00:32:33 STEP 2243 H=2243:00 +CPU= 13.421
  00:32:57 STEP 2244 H=2244:00 +CPU= 23.278
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002244
  00:33:10 STEP 2245 H=2245:00 +CPU= 13.431
  00:33:24 STEP 2246 H=2246:00 +CPU= 13.782
  00:33:45 STEP 2247 H=2247:00 +CPU= 21.074
  00:33:59 STEP 2248 H=2248:00 +CPU= 13.793
  00:34:12 STEP 2249 H=2249:00 +CPU= 13.418
  00:34:34 STEP 2250 H=2250:00 +CPU= 21.508
  00:34:47 STEP 2251 H=2251:00 +CPU= 13.408
  00:35:01 STEP 2252 H=2252:00 +CPU= 13.786
  00:35:22 STEP 2253 H=2253:00 +CPU= 21.067
  00:35:36 STEP 2254 H=2254:00 +CPU= 13.763
  00:35:50 STEP 2255 H=2255:00 +CPU= 13.820
  00:36:15 STEP 2256 H=2256:00 +CPU= 25.132
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002244
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0206_2009050100_123_978_12194850_0_r176895912_93.zip
Uploading the intermediate file: upload_file_93.zip
  00:36:28 STEP 2257 H=2257:00 +CPU= 13.405
  00:36:42 STEP 2258 H=2258:00 +CPU= 13.772
  00:37:03 STEP 2259 H=2259:00 +CPU= 21.208
  00:37:17 STEP 2260 H=2260:00 +CPU= 13.765
  00:37:30 STEP 2261 H=2261:00 +CPU= 13.410
  00:37:52 STEP 2262 H=2262:00 +CPU= 21.506
  00:38:05 STEP 2263 H=2263:00 +CPU= 13.423
  00:38:19 STEP 2264 H=2264:00 +CPU= 13.803
  00:38:40 STEP 2265 H=2265:00 +CPU= 21.065
  00:38:54 STEP 2266 H=2266:00 +CPU= 13.798
  00:39:08 STEP 2267 H=2267:00 +CPU= 13.411
  00:39:31 STEP 2268 H=2268:00 +CPU= 23.270
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002268
  00:39:44 STEP 2269 H=2269:00 +CPU= 13.420
  00:39:58 STEP 2270 H=2270:00 +CPU= 13.795
  00:40:19 STEP 2271 H=2271:00 +CPU= 21.100
  00:40:33 STEP 2272 H=2272:00 +CPU= 13.788
  00:40:46 STEP 2273 H=2273:00 +CPU= 13.410
  00:41:08 STEP 2274 H=2274:00 +CPU= 21.477
  00:41:21 STEP 2275 H=2275:00 +CPU= 13.398
  00:41:35 STEP 2276 H=2276:00 +CPU= 13.785
  00:41:56 STEP 2277 H=2277:00 +CPU= 21.067
  00:42:10 STEP 2278 H=2278:00 +CPU= 13.760
  00:42:24 STEP 2279 H=2279:00 +CPU= 13.801
  00:42:49 STEP 2280 H=2280:00 +CPU= 25.097
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002268
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0206_2009050100_123_978_12194850_0_r176895912_94.zip
Uploading the intermediate file: upload_file_94.zip
  00:43:02 STEP 2281 H=2281:00 +CPU= 13.420
  00:43:16 STEP 2282 H=2282:00 +CPU= 13.774
  00:43:38 STEP 2283 H=2283:00 +CPU= 21.281
  00:43:51 STEP 2284 H=2284:00 +CPU= 13.783
  00:44:05 STEP 2285 H=2285:00 +CPU= 13.416
  00:44:26 STEP 2286 H=2286:00 +CPU= 21.491
  00:44:40 STEP 2287 H=2287:00 +CPU= 13.435
  00:44:54 STEP 2288 H=2288:00 +CPU= 13.822
  00:45:15 STEP 2289 H=2289:00 +CPU= 21.089
  00:45:29 STEP 2290 H=2290:00 +CPU= 13.820
  00:45:42 STEP 2291 H=2291:00 +CPU= 13.448
  00:46:05 STEP 2292 H=2292:00 +CPU= 23.303
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002292
  00:46:19 STEP 2293 H=2293:00 +CPU= 13.434
  00:46:33 STEP 2294 H=2294:00 +CPU= 13.796
  00:46:54 STEP 2295 H=2295:00 +CPU= 21.057
  00:47:08 STEP 2296 H=2296:00 +CPU= 13.795
  00:47:21 STEP 2297 H=2297:00 +CPU= 13.423
  00:47:42 STEP 2298 H=2298:00 +CPU= 21.531
  00:47:56 STEP 2299 H=2299:00 +CPU= 13.415
  00:48:10 STEP 2300 H=2300:00 +CPU= 13.793
  00:48:31 STEP 2301 H=2301:00 +CPU= 21.046
  00:48:45 STEP 2302 H=2302:00 +CPU= 13.767
  00:48:58 STEP 2303 H=2303:00 +CPU= 13.828
  00:49:24 STEP 2304 H=2304:00 +CPU= 25.089
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002292
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0206_2009050100_123_978_12194850_0_r176895912_95.zip
Uploading the intermediate file: upload_file_95.zip
  00:49:37 STEP 2305 H=2305:00 +CPU= 13.418
  00:49:51 STEP 2306 H=2306:00 +CPU= 13.768
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2009050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0206
(argv4) batchid: 978
(argv5) wuid: 12194850
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/0
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_8f7054c445dad6402af3d9996fe5b13a to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0206_2009050100_123_978_12194850.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0206_2009050100_123_978_12194850.zip
ic_ancil_file: ic_ancil_12194850
ifsdata_file: ifsdata_12194850
climate_data_file: clim_data_12194850
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_66074c1735cbe2e9426103097db6d28c to: /var/lib/boinc-client/slots/0/ic_ancil_12194850.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/0/ic_ancil_12194850.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_fac520ec373b111fc3b5ca04adde1ee9 to: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12194850.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12194850.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/0/159l_2/clim_data_12194850.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/0/159l_2/clim_data_12194850.zip
Checking for progress XML file: /var/lib/boinc-client/slots/0/progress_file_12194850.xml
Opened progress file ok : /var/lib/boinc-client/slots/0/progress_file_12194850.xml
-- Model is restarting --
Adjusting last_iter, 2307, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/0/progress_file_12194850.xml
last_cpu_time: 40072
upload_file_number: 96
last_iter: 2303
last_upload: 8294400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0206_2009050100_123_978_12194850_0_r176895912
The child process has been launched with process id: 84235
Executing the command: /var/lib/boinc-client/slots/0/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:annares:1:1:84235:84235] [20230121:015140:1674283900:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  01:52:05 STEP 2304 H=2304:00 +CPU= 23.276
  01:52:18 STEP 2305 H=2305:00 +CPU= 12.991
  01:52:31 STEP 2306 H=2306:00 +CPU= 13.396
  01:52:52 STEP 2307 H=2307:00 +CPU= 20.491
  01:53:05 STEP 2308 H=2308:00 +CPU= 13.339
  01:53:18 STEP 2309 H=2309:00 +CPU= 13.032
  01:53:39 STEP 2310 H=2310:00 +CPU= 20.962
  01:53:52 STEP 2311 H=2311:00 +CPU= 12.995
  01:54:05 STEP 2312 H=2312:00 +CPU= 13.348
  01:54:26 STEP 2313 H=2313:00 +CPU= 20.494
  01:54:39 STEP 2314 H=2314:00 +CPU= 13.421
  01:54:52 STEP 2315 H=2315:00 +CPU= 13.047
  01:55:15 STEP 2316 H=2316:00 +CPU= 22.640
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002316
  01:55:28 STEP 2317 H=2317:00 +CPU= 13.058
  01:55:42 STEP 2318 H=2318:00 +CPU= 13.364
  01:56:02 STEP 2319 H=2319:00 +CPU= 20.482
  01:56:15 STEP 2320 H=2320:00 +CPU= 13.387
  01:56:28 STEP 2321 H=2321:00 +CPU= 12.993
  01:56:49 STEP 2322 H=2322:00 +CPU= 20.900
  01:57:02 STEP 2323 H=2323:00 +CPU= 12.959
  01:57:16 STEP 2324 H=2324:00 +CPU= 13.369
  01:57:36 STEP 2325 H=2325:00 +CPU= 20.541
  01:57:50 STEP 2326 H=2326:00 +CPU= 13.352
  01:58:03 STEP 2327 H=2327:00 +CPU= 13.367
  01:58:27 STEP 2328 H=2328:00 +CPU= 24.338
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMGGhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMSHhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194850/ICMUAhq0f+002316
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0206_2009050100_123_978_12194850_0_r176895912_96.zip
Uploading the intermediate file: upload_file_96.zip
  01:58:40 STEP 2329 H=2329:00 +CPU= 13.039
  01:58:54 STEP 2330 H=2330:00 +CPU= 13.413
  01:59:15 STEP 2331 H=2331:00 +CPU= 20.616
  01:59:28 STEP 2332 H=2332:00 +CPU= 13.375
  01:59:41 STEP 2333 H=2333:00 +CPU= 13.051
  02:00:02 STEP 2334 H=2334:00 +CPU= 20.958
  02:00:15 STEP 2335 H=2335:00 +CPU= 13.000
  02:00:28 STEP 2336 H=2336:00 +CPU= 13.360
  02:00:49 STEP 2337 H=2337:00 +CPU= 20.538
  02:01:02 STEP 2338 H=2338:00 +CPU= 13.435
  02:01:15 STEP 2339 H=2339:00 +CPU= 13.016
  02:01:38 STEP 2340 H=2340:00 +CPU= 22.709
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002340
  02:01:51 STEP 2341 H=2341:00 +CPU= 13.046
  02:02:05 STEP 2342 H=2342:00 +CPU= 13.361
  02:02:25 STEP 2343 H=2343:00 +CPU= 20.513
  02:02:39 STEP 2344 H=2344:00 +CPU= 13.414
Abort request received from BOINC client, ending the child process

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:31:03 1515830 22280733 oifs_43r3_ps_0206_2009050100_123_978_12194850_0 3,283,200 15,848 0.0048
09 May 2023 16:30:57 1515830 22280733 oifs_43r3_ps_0206_2009050100_123_978_12194850_0 2,419,200 11,767 0.0049
09 May 2023 16:30:51 1515830 22280733 oifs_43r3_ps_0206_2009050100_123_978_12194850_0 1,555,200 7,687 0.0049


©2024 cpdn.org