climateprediction.net home page
Task 22306464

Task 22306464

Name oifs_43r3_ps_0175_2015050100_123_984_12200819_1
Workunit 12200819
Created 7 Feb 2023, 12:06:12 UTC
Sent 7 Feb 2023, 12:07:22 UTC
Report deadline 8 Apr 2023, 12:07:22 UTC
Received 17 Feb 2023, 11:33:41 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1536947
Run time 19 hours 8 min 26 sec
CPU time 17 hours 47 min 3 sec
Validate state Invalid
Credit 7,983.36
Device peak FLOPS 4.87 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,799.75 MB
Peak swap size 4,978.08 MB
Peak disk usage 7,674.63 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
+CPU= 21.770
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:26:51 STEP 1953 H=1953:00 +CPU= 33.281
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:27:15 STEP 1954 H=1954:00 +CPU= 21.755
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:27:39 STEP 1955 H=1955:00 +CPU= 19.987
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:28:19 STEP 1956 H=1956:00 +CPU= 37.025
Moving to projects directory: /root/slots/6/ICMGGhq0f+001956
Moving to projects directory: /root/slots/6/ICMSHhq0f+001956
Moving to projects directory: /root/slots/6/ICMUAhq0f+001956
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:28:42 STEP 1957 H=1957:00 +CPU= 20.604
  18:29:04 STEP 1958 H=1958:00 +CPU= 21.156
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:29:39 STEP 1959 H=1959:00 +CPU= 33.377
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:30:04 STEP 1960 H=1960:00 +CPU= 21.584
  18:30:24 STEP 1961 H=1961:00 +CPU= 20.381
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:31:03 STEP 1962 H=1962:00 +CPU= 34.635
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:31:27 STEP 1963 H=1963:00 +CPU= 21.108
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:31:51 STEP 1964 H=1964:00 +CPU= 21.993
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:32:29 STEP 1965 H=1965:00 +CPU= 33.566
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:32:53 STEP 1966 H=1966:00 +CPU= 21.664
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:33:19 STEP 1967 H=1967:00 +CPU= 21.375
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:34:03 STEP 1968 H=1968:00 +CPU= 38.917
Moving to projects directory: /root/slots/6/ICMGGhq0f+001968
Moving to projects directory: /root/slots/6/ICMSHhq0f+001968
Moving to projects directory: /root/slots/6/ICMUAhq0f+001968
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMGGhq0f+001944
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMSHhq0f+001944
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMUAhq0f+001944
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMGGhq0f+001956
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMSHhq0f+001956
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMUAhq0f+001956
Zipping up the intermediate file: /root/projects/climateprediction.net/oifs_43r3_ps_0175_2015050100_123_984_12200819_1_r2044291994_81.zip
Uploading the intermediate file: upload_file_81.zip
  18:34:24 STEP 1969 H=1969:00 +CPU= 20.254
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:34:48 STEP 1970 H=1970:00 +CPU= 21.583
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:35:25 STEP 1971 H=1971:00 +CPU= 33.263
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:35:49 STEP 1972 H=1972:00 +CPU= 21.503
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:36:13 STEP 1973 H=1973:00 +CPU= 20.907
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:36:52 STEP 1974 H=1974:00 +CPU= 34.303
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:37:15 STEP 1975 H=1975:00 +CPU= 20.520
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:37:40 STEP 1976 H=1976:00 +CPU= 20.958
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:38:18 STEP 1977 H=1977:00 +CPU= 33.321
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:38:43 STEP 1978 H=1978:00 +CPU= 21.805
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:39:06 STEP 1979 H=1979:00 +CPU= 20.688
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:39:48 STEP 1980 H=1980:00 +CPU= 37.367
Moving to projects directory: /root/slots/6/ICMGGhq0f+001980
Moving to projects directory: /root/slots/6/ICMSHhq0f+001980
Moving to projects directory: /root/slots/6/ICMUAhq0f+001980
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:40:11 STEP 1981 H=1981:00 +CPU= 20.868
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:40:35 STEP 1982 H=1982:00 +CPU= 21.719
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:41:14 STEP 1983 H=1983:00 +CPU= 34.827
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:41:41 STEP 1984 H=1984:00 +CPU= 22.654
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:42:05 STEP 1985 H=1985:00 +CPU= 21.974
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:42:46 STEP 1986 H=1986:00 +CPU= 36.476
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:43:10 STEP 1987 H=1987:00 +CPU= 21.615
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:43:34 STEP 1988 H=1988:00 +CPU= 22.167
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:44:13 STEP 1989 H=1989:00 +CPU= 35.208
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:44:39 STEP 1990 H=1990:00 +CPU= 21.976
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:45:05 STEP 1991 H=1991:00 +CPU= 23.143
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:45:50 STEP 1992 H=1992:00 +CPU= 40.675
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /root/slots/6/ICMGGhq0f+001992
Moving to projects directory: /root/slots/6/ICMSHhq0f+001992
Moving to projects directory: /root/slots/6/ICMUAhq0f+001992
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMGGhq0f+001968
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMSHhq0f+001968
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMUAhq0f+001968
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMGGhq0f+001980
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMSHhq0f+001980
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMUAhq0f+001980
Zipping up the intermediate file: /root/projects/climateprediction.net/oifs_43r3_ps_0175_2015050100_123_984_12200819_1_r2044291994_82.zip
Uploading the intermediate file: upload_file_82.zip
  18:46:14 STEP 1993 H=1993:00 +CPU= 22.298
  18:46:36 STEP 1994 H=1994:00 +CPU= 22.297
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:47:15 STEP 1995 H=1995:00 +CPU= 34.613
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:47:42 STEP 1996 H=1996:00 +CPU= 23.076
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:48:06 STEP 1997 H=1997:00 +CPU= 21.394
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:48:45 STEP 1998 H=1998:00 +CPU= 35.081
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:49:08 STEP 1999 H=1999:00 +CPU= 21.024
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:49:33 STEP 2000 H=2000:00 +CPU= 22.216
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:50:13 STEP 2001 H=2001:00 +CPU= 35.868
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:50:39 STEP 2002 H=2002:00 +CPU= 22.357
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:51:03 STEP 2003 H=2003:00 +CPU= 21.947
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:51:47 STEP 2004 H=2004:00 +CPU= 39.288
Moving to projects directory: /root/slots/6/ICMGGhq0f+002004
Moving to projects directory: /root/slots/6/ICMSHhq0f+002004
Moving to projects directory: /root/slots/6/ICMUAhq0f+002004
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:52:11 STEP 2005 H=2005:00 +CPU= 22.281
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:52:36 STEP 2006 H=2006:00 +CPU= 22.768
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:53:15 STEP 2007 H=2007:00 +CPU= 34.574
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:53:41 STEP 2008 H=2008:00 +CPU= 22.378
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:54:05 STEP 2009 H=2009:00 +CPU= 21.848
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:54:45 STEP 2010 H=2010:00 +CPU= 35.536
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:55:09 STEP 2011 H=2011:00 +CPU= 22.657
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:55:34 STEP 2012 H=2012:00 +CPU= 22.797
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:56:13 STEP 2013 H=2013:00 +CPU= 34.018
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:56:39 STEP 2014 H=2014:00 +CPU= 21.574
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:57:03 STEP 2015 H=2015:00 +CPU= 21.586
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:57:47 STEP 2016 H=2016:00 +CPU= 38.905
Moving to projects directory: /root/slots/6/ICMGGhq0f+002016
Moving to projects directory: /root/slots/6/ICMSHhq0f+002016
Moving to projects directory: /root/slots/6/ICMUAhq0f+002016
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMGGhq0f+001992
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMSHhq0f+001992
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMUAhq0f+001992
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMGGhq0f+002004
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMSHhq0f+002004
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMUAhq0f+002004
Zipping up the intermediate file: /root/projects/climateprediction.net/oifs_43r3_ps_0175_2015050100_123_984_12200819_1_r2044291994_83.zip
Uploading the intermediate file: upload_file_83.zip
  18:58:07 STEP 2017 H=2017:00 +CPU= 20.775
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:58:31 STEP 2018 H=2018:00 +CPU= 21.655
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:59:09 STEP 2019 H=2019:00 +CPU= 33.550
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:59:33 STEP 2020 H=2020:00 +CPU= 21.175
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:59:56 STEP 2021 H=2021:00 +CPU= 20.792
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:00:35 STEP 2022 H=2022:00 +CPU= 34.358
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:01:00 STEP 2023 H=2023:00 +CPU= 20.227
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:01:24 STEP 2024 H=2024:00 +CPU= 21.620
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:02:02 STEP 2025 H=2025:00 +CPU= 33.460
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:02:25 STEP 2026 H=2026:00 +CPU= 21.060
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:02:49 STEP 2027 H=2027:00 +CPU= 21.199
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:03:31 STEP 2028 H=2028:00 +CPU= 37.660
Moving to projects directory: /root/slots/6/ICMGGhq0f+002028
Moving to projects directory: /root/slots/6/ICMSHhq0f+002028
Moving to projects directory: /root/slots/6/ICMUAhq0f+002028
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:03:54 STEP 2029 H=2029:00 +CPU= 20.606
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:04:20 STEP 2030 H=2030:00 +CPU= 21.508
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:04:56 STEP 2031 H=2031:00 +CPU= 33.740
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:05:22 STEP 2032 H=2032:00 +CPU= 21.350
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:05:45 STEP 2033 H=2033:00 +CPU= 20.770
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:06:24 STEP 2034 H=2034:00 +CPU= 33.906
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:06:47 STEP 2035 H=2035:00 +CPU= 20.538
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:07:11 STEP 2036 H=2036:00 +CPU= 21.580
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:07:49 STEP 2037 H=2037:00 +CPU= 33.073
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:08:12 STEP 2038 H=2038:00 +CPU= 21.177
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:08:36 STEP 2039 H=2039:00 +CPU= 21.090
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:09:21 STEP 2040 H=2040:00 +CPU= 39.088
Moving to projects directory: /root/slots/6/ICMGGhq0f+002040
Moving to projects directory: /root/slots/6/ICMSHhq0f+002040
Moving to projects directory: /root/slots/6/ICMUAhq0f+002040
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMGGhq0f+002016
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMSHhq0f+002016
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMUAhq0f+002016
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMGGhq0f+002028
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMSHhq0f+002028
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMUAhq0f+002028
Zipping up the intermediate file: /root/projects/climateprediction.net/oifs_43r3_ps_0175_2015050100_123_984_12200819_1_r2044291994_84.zip
Uploading the intermediate file: upload_file_84.zip
  19:09:43 STEP 2041 H=2041:00 +CPU= 21.067
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:10:06 STEP 2042 H=2042:00 +CPU= 21.552
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:10:45 STEP 2043 H=2043:00 +CPU= 33.613
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:11:09 STEP 2044 H=2044:00 +CPU= 21.572
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:11:32 STEP 2045 H=2045:00 +CPU= 21.141
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:12:12 STEP 2046 H=2046:00 +CPU= 34.780
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:12:35 STEP 2047 H=2047:00 +CPU= 20.970
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:13:01 STEP 2048 H=2048:00 +CPU= 21.539
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:13:39 STEP 2049 H=2049:00 +CPU= 33.054
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:14:03 STEP 2050 H=2050:00 +CPU= 21.448
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:14:26 STEP 2051 H=2051:00 +CPU= 21.238
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:15:08 STEP 2052 H=2052:00 +CPU= 36.952
Moving to projects directory: /root/slots/6/ICMGGhq0f+002052
Moving to projects directory: /root/slots/6/ICMSHhq0f+002052
Moving to projects directory: /root/slots/6/ICMUAhq0f+002052
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:15:30 STEP 2053 H=2053:00 +CPU= 20.317
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:15:54 STEP 2054 H=2054:00 +CPU= 21.156
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:16:33 STEP 2055 H=2055:00 +CPU= 33.860
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:16:58 STEP 2056 H=2056:00 +CPU= 21.654
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:17:22 STEP 2057 H=2057:00 +CPU= 21.238
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:18:01 STEP 2058 H=2058:00 +CPU= 34.685
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:18:24 STEP 2059 H=2059:00 +CPU= 20.665
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:18:48 STEP 2060 H=2060:00 +CPU= 21.416
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:19:26 STEP 2061 H=2061:00 +CPU= 33.202
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:19:50 STEP 2062 H=2062:00 +CPU= 21.555
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:20:14 STEP 2063 H=2063:00 +CPU= 21.987
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:20:59 STEP 2064 H=2064:00 +CPU= 38.283
Moving to projects directory: /root/slots/6/ICMGGhq0f+002064
Moving to projects directory: /root/slots/6/ICMSHhq0f+002064
Moving to projects directory: /root/slots/6/ICMUAhq0f+002064
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMGGhq0f+002040
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMSHhq0f+002040
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMUAhq0f+002040
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMGGhq0f+002052
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMSHhq0f+002052
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMUAhq0f+002052
Zipping up the intermediate file: /root/projects/climateprediction.net/oifs_43r3_ps_0175_2015050100_123_984_12200819_1_r2044291994_85.zip
Uploading the intermediate file: upload_file_85.zip
  19:21:20 STEP 2065 H=2065:00 +CPU= 20.920
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:21:45 STEP 2066 H=2066:00 +CPU= 22.267
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:22:24 STEP 2067 H=2067:00 +CPU= 34.042
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:22:48 STEP 2068 H=2068:00 +CPU= 21.652
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:23:11 STEP 2069 H=2069:00 +CPU= 20.942
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:23:50 STEP 2070 H=2070:00 +CPU= 34.558
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:24:13 STEP 2071 H=2071:00 +CPU= 20.614
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:24:39 STEP 2072 H=2072:00 +CPU= 21.302
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:25:15 STEP 2073 H=2073:00 +CPU= 33.905
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:25:41 STEP 2074 H=2074:00 +CPU= 21.471
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:26:04 STEP 2075 H=2075:00 +CPU= 20.893
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:26:46 STEP 2076 H=2076:00 +CPU= 37.053
Moving to projects directory: /root/slots/6/ICMGGhq0f+002076
Moving to projects directory: /root/slots/6/ICMSHhq0f+002076
Moving to projects directory: /root/slots/6/ICMUAhq0f+002076
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:27:09 STEP 2077 H=2077:00 +CPU= 20.956
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:27:34 STEP 2078 H=2078:00 +CPU= 22.067
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:28:13 STEP 2079 H=2079:00 +CPU= 34.079
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:28:38 STEP 2080 H=2080:00 +CPU= 21.335
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:29:02 STEP 2081 H=2081:00 +CPU= 20.766
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:29:40 STEP 2082 H=2082:00 +CPU= 34.409
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:30:04 STEP 2083 H=2083:00 +CPU= 20.871
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:30:28 STEP 2084 H=2084:00 +CPU= 21.623
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:31:05 STEP 2085 H=2085:00 +CPU= 32.626
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:31:29 STEP 2086 H=2086:00 +CPU= 21.641
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:31:53 STEP 2087 H=2087:00 +CPU= 21.845
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:32:38 STEP 2088 H=2088:00 +CPU= 38.406
Moving to projects directory: /root/slots/6/ICMGGhq0f+002088
Moving to projects directory: /root/slots/6/ICMSHhq0f+002088
Moving to projects directory: /root/slots/6/ICMUAhq0f+002088
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMGGhq0f+002064
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMSHhq0f+002064
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMUAhq0f+002064
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMGGhq0f+002076
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMSHhq0f+002076
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMUAhq0f+002076
Zipping up the intermediate file: /root/projects/climateprediction.net/oifs_43r3_ps_0175_2015050100_123_984_12200819_1_r2044291994_86.zip
Uploading the intermediate file: upload_file_86.zip
  19:32:59 STEP 2089 H=2089:00 +CPU= 20.312
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:33:23 STEP 2090 H=2090:00 +CPU= 21.610
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:34:02 STEP 2091 H=2091:00 +CPU= 34.067
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:34:26 STEP 2092 H=2092:00 +CPU= 21.862
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:34:49 STEP 2093 H=2093:00 +CPU= 21.090
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:35:28 STEP 2094 H=2094:00 +CPU= 34.450
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:35:52 STEP 2095 H=2095:00 +CPU= 21.149
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:36:16 STEP 2096 H=2096:00 +CPU= 21.706
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:36:54 STEP 2097 H=2097:00 +CPU= 33.280
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:37:19 STEP 2098 H=2098:00 +CPU= 21.432
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:37:43 STEP 2099 H=2099:00 +CPU= 21.164
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:38:24 STEP 2100 H=2100:00 +CPU= 36.702
Moving to projects directory: /root/slots/6/ICMGGhq0f+002100
Moving to projects directory: /root/slots/6/ICMSHhq0f+002100
Moving to projects directory: /root/slots/6/ICMUAhq0f+002100
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:38:48 STEP 2101 H=2101:00 +CPU= 21.090
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:39:12 STEP 2102 H=2102:00 +CPU= 21.466
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:39:51 STEP 2103 H=2103:00 +CPU= 34.340
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:40:15 STEP 2104 H=2104:00 +CPU= 22.046
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:40:40 STEP 2105 H=2105:00 +CPU= 20.629
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:41:19 STEP 2106 H=2106:00 +CPU= 34.654
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:41:43 STEP 2107 H=2107:00 +CPU= 21.007
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:42:07 STEP 2108 H=2108:00 +CPU= 21.802
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:42:46 STEP 2109 H=2109:00 +CPU= 33.976
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:43:09 STEP 2110 H=2110:00 +CPU= 21.509
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:43:33 STEP 2111 H=2111:00 +CPU= 21.064
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:44:15 STEP 2112 H=2112:00 +CPU= 38.116
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /root/slots/6/ICMGGhq0f+002112
Moving to projects directory: /root/slots/6/ICMSHhq0f+002112
Moving to projects directory: /root/slots/6/ICMUAhq0f+002112
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMGGhq0f+002088
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMSHhq0f+002088
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMUAhq0f+002088
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMGGhq0f+002100
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMSHhq0f+002100
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMUAhq0f+002100
Zipping up the intermediate file: /root/projects/climateprediction.net/oifs_43r3_ps_0175_2015050100_123_984_12200819_1_r2044291994_87.zip
Uploading the intermediate file: upload_file_87.zip
  19:44:38 STEP 2113 H=2113:00 +CPU= 20.336
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:45:02 STEP 2114 H=2114:00 +CPU= 21.634
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:45:40 STEP 2115 H=2115:00 +CPU= 32.843
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:46:03 STEP 2116 H=2116:00 +CPU= 21.503
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:46:26 STEP 2117 H=2117:00 +CPU= 20.650
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:47:06 STEP 2118 H=2118:00 +CPU= 35.031
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:47:29 STEP 2119 H=2119:00 +CPU= 21.083
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:47:54 STEP 2120 H=2120:00 +CPU= 21.882
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:48:31 STEP 2121 H=2121:00 +CPU= 33.165
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:48:56 STEP 2122 H=2122:00 +CPU= 22.215
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:49:21 STEP 2123 H=2123:00 +CPU= 20.486
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:50:03 STEP 2124 H=2124:00 +CPU= 36.997
Moving to projects directory: /root/slots/6/ICMGGhq0f+002124
Moving to projects directory: /root/slots/6/ICMSHhq0f+002124
Moving to projects directory: /root/slots/6/ICMUAhq0f+002124
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:50:26 STEP 2125 H=2125:00 +CPU= 21.260
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:50:50 STEP 2126 H=2126:00 +CPU= 21.411
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:51:28 STEP 2127 H=2127:00 +CPU= 33.484
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:51:52 STEP 2128 H=2128:00 +CPU= 21.515
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:52:15 STEP 2129 H=2129:00 +CPU= 20.434
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:52:54 STEP 2130 H=2130:00 +CPU= 34.699
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:53:19 STEP 2131 H=2131:00 +CPU= 20.775
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:53:43 STEP 2132 H=2132:00 +CPU= 21.679
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:54:21 STEP 2133 H=2133:00 +CPU= 33.243
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:54:45 STEP 2134 H=2134:00 +CPU= 21.411
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:55:09 STEP 2135 H=2135:00 +CPU= 21.430
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:55:53 STEP 2136 H=2136:00 +CPU= 38.881
Moving to projects directory: /root/slots/6/ICMGGhq0f+002136
Moving to projects directory: /root/slots/6/ICMSHhq0f+002136
Moving to projects directory: /root/slots/6/ICMUAhq0f+002136
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMGGhq0f+002112
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMSHhq0f+002112
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMUAhq0f+002112
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMGGhq0f+002124
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMSHhq0f+002124
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMUAhq0f+002124
Zipping up the intermediate file: /root/projects/climateprediction.net/oifs_43r3_ps_0175_2015050100_123_984_12200819_1_r2044291994_88.zip
Uploading the intermediate file: upload_file_88.zip
  19:56:14 STEP 2137 H=2137:00 +CPU= 20.475
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:56:40 STEP 2138 H=2138:00 +CPU= 21.834
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:57:16 STEP 2139 H=2139:00 +CPU= 33.678
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:57:42 STEP 2140 H=2140:00 +CPU= 21.188
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:58:05 STEP 2141 H=2141:00 +CPU= 20.799
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:58:43 STEP 2142 H=2142:00 +CPU= 33.957
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:59:06 STEP 2143 H=2143:00 +CPU= 20.852
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:59:30 STEP 2144 H=2144:00 +CPU= 21.383
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:00:06 STEP 2145 H=2145:00 +CPU= 33.558
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:00:30 STEP 2146 H=2146:00 +CPU= 21.607
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:00:54 STEP 2147 H=2147:00 +CPU= 21.138
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:01:36 STEP 2148 H=2148:00 +CPU= 37.755
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /root/slots/6/ICMGGhq0f+002148
Moving to projects directory: /root/slots/6/ICMSHhq0f+002148
Moving to projects directory: /root/slots/6/ICMUAhq0f+002148
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:02:01 STEP 2149 H=2149:00 +CPU= 20.988
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:02:25 STEP 2150 H=2150:00 +CPU= 21.247
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:03:03 STEP 2151 H=2151:00 +CPU= 32.972
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:03:27 STEP 2152 H=2152:00 +CPU= 21.440
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:03:50 STEP 2153 H=2153:00 +CPU= 20.514
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:04:28 STEP 2154 H=2154:00 +CPU= 33.624
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:04:51 STEP 2155 H=2155:00 +CPU= 20.548
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:05:14 STEP 2156 H=2156:00 +CPU= 21.264
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:05:52 STEP 2157 H=2157:00 +CPU= 33.090
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2015050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0175
(argv4) batchid: 984
(argv5) wuid: 12200819
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /root/slots/6
Project directory is: /root/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /root/projects/climateprediction.net/oifs_43r3_ps_12200819
..mkdir for temp folder for results failed
Copying: /root/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /root/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /root/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_4af79ca87b9308916c0add839e2877a0 to: /root/slots/6/oifs_43r3_ps_0175_2015050100_123_984_12200819.zip
Unzipping the namelist zip file: /root/slots/6/oifs_43r3_ps_0175_2015050100_123_984_12200819.zip
ic_ancil_file: ic_ancil_12200819
ifsdata_file: ifsdata_12200819
climate_data_file: clim_data_12200819
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_dd854a69b0e5275f4ce0b1552bdca363 to: /root/slots/6/ic_ancil_12200819.zip
Unzipping the IC ancils zip file: /root/slots/6/ic_ancil_12200819.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_bb33a890b666b4068308ecb3ca92ada6 to: /root/slots/6/ifsdata/ifsdata_12200819.zip
Unzipping the ifsdata_zip file: /root/slots/6/ifsdata/ifsdata_12200819.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /root/slots/6/159l_2/clim_data_12200819.zip
Unzipping the climate data zip file: /root/slots/6/159l_2/clim_data_12200819.zip
Checking for progress XML file: /root/slots/6/progress_file_12200819.xml
Opened progress file ok : /root/slots/6/progress_file_12200819.xml
-- Model is restarting --
Adjusting last_iter, 2158, to previous model restart step.
Creating progress file: /root/slots/6/progress_file_12200819.xml
last_cpu_time: 63249
upload_file_number: 89
last_iter: 2135
last_upload: 7689600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0175_2015050100_123_984_12200819_1_r2044291994
The child process has been launched with process id: 6571
Executing the command: /root/slots/6/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:52-dienstlich:1:1:6571:6571] [20230217:111828:1676629108:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:19:18 STEP 2136 H=2136:00 +CPU= 39.869
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:19:44 STEP 2137 H=2137:00 +CPU= 21.879
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:20:11 STEP 2138 H=2138:00 +CPU= 22.292
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:20:52 STEP 2139 H=2139:00 +CPU= 34.528
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:21:18 STEP 2140 H=2140:00 +CPU= 22.096
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:21:44 STEP 2141 H=2141:00 +CPU= 21.850
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:22:28 STEP 2142 H=2142:00 +CPU= 35.176
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:22:54 STEP 2143 H=2143:00 +CPU= 22.445
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:23:20 STEP 2144 H=2144:00 +CPU= 22.407
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:23:59 STEP 2145 H=2145:00 +CPU= 34.269
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:24:24 STEP 2146 H=2146:00 +CPU= 21.890
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:24:50 STEP 2147 H=2147:00 +CPU= 21.503
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:25:32 STEP 2148 H=2148:00 +CPU= 37.610
Moving to projects directory: /root/slots/6/ICMGGhq0f+002148
Moving to projects directory: /root/slots/6/ICMSHhq0f+002148
Moving to projects directory: /root/slots/6/ICMUAhq0f+002148
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:25:56 STEP 2149 H=2149:00 +CPU= 20.896
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:26:20 STEP 2150 H=2150:00 +CPU= 22.176
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:27:02 STEP 2151 H=2151:00 +CPU= 34.756
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:27:31 STEP 2152 H=2152:00 +CPU= 22.365
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:27:56 STEP 2153 H=2153:00 +CPU= 21.797
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:28:36 STEP 2154 H=2154:00 +CPU= 34.703
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:28:59 STEP 2155 H=2155:00 +CPU= 20.883
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:29:24 STEP 2156 H=2156:00 +CPU= 21.830
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:30:03 STEP 2157 H=2157:00 +CPU= 33.947
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:30:29 STEP 2158 H=2158:00 +CPU= 21.774
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:30:53 STEP 2159 H=2159:00 +CPU= 21.707
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:31:37 STEP 2160 H=2160:00 +CPU= 38.575
Moving to projects directory: /root/slots/6/ICMGGhq0f+002160
Moving to projects directory: /root/slots/6/ICMSHhq0f+002160
Moving to projects directory: /root/slots/6/ICMUAhq0f+002160
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMGGhq0f+002136
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMSHhq0f+002136
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMUAhq0f+002136
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMGGhq0f+002148
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMSHhq0f+002148
Adding to the zip: /root/projects/climateprediction.net/oifs_43r3_ps_12200819/ICMUAhq0f+002148
Zipping up the intermediate file: /root/projects/climateprediction.net/oifs_43r3_ps_0175_2015050100_123_984_12200819_1_r2044291994_89.zip
Uploading the intermediate file: upload_file_89.zip
  11:31:57 STEP 2161 H=2161:00 +CPU= 20.443
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:32:21 STEP 2162 H=2162:00 +CPU= 21.622
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:32:59 STEP 2163 H=2163:00 +CPU= 33.423
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:33:23 STEP 2164 H=2164:00 +CPU= 21.234
Suspend request received from the BOINC client, suspending the child process
Abort request received from the BOINC client, ending the child process

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:51:08 1536947 22306464 oifs_43r3_ps_0175_2015050100_123_984_12200819_1 5,702,400 48,544 0.0085
09 May 2023 16:50:09 1536947 22306464 oifs_43r3_ps_0175_2015050100_123_984_12200819_1 4,579,200 39,840 0.0087
09 May 2023 16:49:49 1536947 22306464 oifs_43r3_ps_0175_2015050100_123_984_12200819_1 3,283,200 28,588 0.0087
09 May 2023 16:49:46 1536947 22306464 oifs_43r3_ps_0175_2015050100_123_984_12200819_1 2,419,200 21,322 0.0088
09 May 2023 16:49:18 1536947 22306464 oifs_43r3_ps_0175_2015050100_123_984_12200819_1 864,000 6,936 0.0080


©2024 cpdn.org