climateprediction.net home page
Task 22296793

Task 22296793

Name oifs_43r3_ps_0977_2002050100_123_971_12188621_1
Workunit 12188621
Created 10 Jan 2023, 23:45:48 UTC
Sent 11 Jan 2023, 0:31:30 UTC
Report deadline 10 Feb 2023, 0:31:30 UTC
Received 13 Jan 2023, 0:30:15 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1534673
Run time 1 days 2 hours 39 min 57 sec
CPU time 1 days 2 hours 3 min 5 sec
Validate state Invalid
Credit 10,765.44
Device peak FLOPS 4.67 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,415.39 MB
Peak swap size 4,978.08 MB
Peak disk usage 7,452.46 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
991 H=1991:00 +CPU= 33.770
  18:21:33 STEP 1992 H=1992:00 +CPU= 61.886
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+001980
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0977_2002050100_123_971_12188621_1_r1972563460_82.zip
Uploading the intermediate file: upload_file_82.zip
  18:22:08 STEP 1993 H=1993:00 +CPU= 33.093
  18:22:44 STEP 1994 H=1994:00 +CPU= 33.341
  18:23:40 STEP 1995 H=1995:00 +CPU= 52.875
  18:24:16 STEP 1996 H=1996:00 +CPU= 32.399
  18:24:51 STEP 1997 H=1997:00 +CPU= 32.972
  18:25:47 STEP 1998 H=1998:00 +CPU= 51.841
  18:26:22 STEP 1999 H=1999:00 +CPU= 32.174
  18:26:58 STEP 2000 H=2000:00 +CPU= 33.330
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:28:14 STEP 2001 H=2001:00 +CPU= 50.391
  18:28:50 STEP 2002 H=2002:00 +CPU= 33.218
  18:29:28 STEP 2003 H=2003:00 +CPU= 36.671
  18:30:33 STEP 2004 H=2004:00 +CPU= 61.205
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002004
  18:31:12 STEP 2005 H=2005:00 +CPU= 36.385
  18:31:49 STEP 2006 H=2006:00 +CPU= 33.871
  18:32:43 STEP 2007 H=2007:00 +CPU= 49.847
  18:33:18 STEP 2008 H=2008:00 +CPU= 31.598
  18:33:51 STEP 2009 H=2009:00 +CPU= 30.475
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:38:28 STEP 2010 H=2010:00 +CPU= 49.934
  18:39:01 STEP 2011 H=2011:00 +CPU= 31.018
  18:39:37 STEP 2012 H=2012:00 +CPU= 33.402
  18:40:31 STEP 2013 H=2013:00 +CPU= 50.470
  18:41:07 STEP 2014 H=2014:00 +CPU= 33.426
  18:41:46 STEP 2015 H=2015:00 +CPU= 36.833
  18:42:53 STEP 2016 H=2016:00 +CPU= 61.902
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002004
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0977_2002050100_123_971_12188621_1_r1972563460_83.zip
Uploading the intermediate file: upload_file_83.zip
  18:43:28 STEP 2017 H=2017:00 +CPU= 32.142
  18:44:03 STEP 2018 H=2018:00 +CPU= 33.219
  18:44:58 STEP 2019 H=2019:00 +CPU= 50.869
  18:45:33 STEP 2020 H=2020:00 +CPU= 32.746
  18:46:08 STEP 2021 H=2021:00 +CPU= 31.896
  18:47:03 STEP 2022 H=2022:00 +CPU= 50.852
  18:47:38 STEP 2023 H=2023:00 +CPU= 32.066
  18:48:12 STEP 2024 H=2024:00 +CPU= 31.722
  18:49:04 STEP 2025 H=2025:00 +CPU= 47.933
  18:49:38 STEP 2026 H=2026:00 +CPU= 31.991
  18:50:12 STEP 2027 H=2027:00 +CPU= 31.449
  18:51:11 STEP 2028 H=2028:00 +CPU= 54.121
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002028
  18:51:45 STEP 2029 H=2029:00 +CPU= 31.019
  18:52:20 STEP 2030 H=2030:00 +CPU= 32.325
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:54:04 STEP 2031 H=2031:00 +CPU= 48.987
  18:54:38 STEP 2032 H=2032:00 +CPU= 31.799
  18:55:11 STEP 2033 H=2033:00 +CPU= 30.884
  18:56:08 STEP 2034 H=2034:00 +CPU= 52.877
  18:56:44 STEP 2035 H=2035:00 +CPU= 34.263
  18:57:23 STEP 2036 H=2036:00 +CPU= 36.763
  18:58:19 STEP 2037 H=2037:00 +CPU= 52.099
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:59:31 STEP 2038 H=2038:00 +CPU= 37.474
  19:00:09 STEP 2039 H=2039:00 +CPU= 35.572
  19:01:13 STEP 2040 H=2040:00 +CPU= 58.937
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002028
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0977_2002050100_123_971_12188621_1_r1972563460_84.zip
Uploading the intermediate file: upload_file_84.zip
  19:01:46 STEP 2041 H=2041:00 +CPU= 30.588
  19:02:20 STEP 2042 H=2042:00 +CPU= 31.720
  19:03:16 STEP 2043 H=2043:00 +CPU= 53.562
  19:03:55 STEP 2044 H=2044:00 +CPU= 36.711
  19:04:30 STEP 2045 H=2045:00 +CPU= 32.855
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:05:54 STEP 2046 H=2046:00 +CPU= 48.927
  19:06:26 STEP 2047 H=2047:00 +CPU= 30.177
  19:07:00 STEP 2048 H=2048:00 +CPU= 31.510
  19:07:53 STEP 2049 H=2049:00 +CPU= 48.405
  19:08:28 STEP 2050 H=2050:00 +CPU= 32.197
  19:09:05 STEP 2051 H=2051:00 +CPU= 34.948
  19:10:07 STEP 2052 H=2052:00 +CPU= 58.534
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002052
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:10:52 STEP 2053 H=2053:00 +CPU= 31.699
  19:11:27 STEP 2054 H=2054:00 +CPU= 32.185
  19:12:19 STEP 2055 H=2055:00 +CPU= 48.779
  19:12:53 STEP 2056 H=2056:00 +CPU= 31.491
  19:13:26 STEP 2057 H=2057:00 +CPU= 30.509
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:14:41 STEP 2058 H=2058:00 +CPU= 49.865
  19:15:14 STEP 2059 H=2059:00 +CPU= 30.623
  19:15:47 STEP 2060 H=2060:00 +CPU= 31.398
  19:16:39 STEP 2061 H=2061:00 +CPU= 49.068
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:17:25 STEP 2062 H=2062:00 +CPU= 31.960
  19:18:00 STEP 2063 H=2063:00 +CPU= 33.322
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:19:13 STEP 2064 H=2064:00 +CPU= 57.749
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002052
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0977_2002050100_123_971_12188621_1_r1972563460_85.zip
Uploading the intermediate file: upload_file_85.zip
  19:19:46 STEP 2065 H=2065:00 +CPU= 30.897
  19:20:20 STEP 2066 H=2066:00 +CPU= 32.063
  19:21:19 STEP 2067 H=2067:00 +CPU= 56.306
  19:21:52 STEP 2068 H=2068:00 +CPU= 32.358
  19:22:26 STEP 2069 H=2069:00 +CPU= 32.143
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:23:39 STEP 2070 H=2070:00 +CPU= 49.480
  19:24:12 STEP 2071 H=2071:00 +CPU= 31.962
  19:24:45 STEP 2072 H=2072:00 +CPU= 32.021
  19:25:41 STEP 2073 H=2073:00 +CPU= 53.593
  19:26:19 STEP 2074 H=2074:00 +CPU= 35.714
  19:26:57 STEP 2075 H=2075:00 +CPU= 36.380
  19:27:58 STEP 2076 H=2076:00 +CPU= 58.406
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002076
  19:28:33 STEP 2077 H=2077:00 +CPU= 33.262
  19:29:11 STEP 2078 H=2078:00 +CPU= 35.853
  19:30:02 STEP 2079 H=2079:00 +CPU= 49.040
  19:30:35 STEP 2080 H=2080:00 +CPU= 31.948
  19:31:09 STEP 2081 H=2081:00 +CPU= 32.375
  19:32:01 STEP 2082 H=2082:00 +CPU= 49.089
  19:32:34 STEP 2083 H=2083:00 +CPU= 31.344
  19:33:07 STEP 2084 H=2084:00 +CPU= 31.406
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:34:06 STEP 2085 H=2085:00 +CPU= 46.167
  19:34:40 STEP 2086 H=2086:00 +CPU= 32.121
  19:35:17 STEP 2087 H=2087:00 +CPU= 35.837
  19:36:17 STEP 2088 H=2088:00 +CPU= 56.951
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002076
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0977_2002050100_123_971_12188621_1_r1972563460_86.zip
Uploading the intermediate file: upload_file_86.zip
  19:36:53 STEP 2089 H=2089:00 +CPU= 33.568
  19:37:26 STEP 2090 H=2090:00 +CPU= 31.884
  19:38:18 STEP 2091 H=2091:00 +CPU= 48.853
  19:38:50 STEP 2092 H=2092:00 +CPU= 30.870
  19:39:22 STEP 2093 H=2093:00 +CPU= 30.011
  19:40:14 STEP 2094 H=2094:00 +CPU= 49.843
  19:40:46 STEP 2095 H=2095:00 +CPU= 30.947
  19:41:19 STEP 2096 H=2096:00 +CPU= 31.377
  19:42:14 STEP 2097 H=2097:00 +CPU= 52.639
  19:42:51 STEP 2098 H=2098:00 +CPU= 34.505
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:44:28 STEP 2099 H=2099:00 +CPU= 33.086
  19:45:27 STEP 2100 H=2100:00 +CPU= 55.944
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002100
  19:46:01 STEP 2101 H=2101:00 +CPU= 31.885
  19:46:38 STEP 2102 H=2102:00 +CPU= 33.913
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:47:53 STEP 2103 H=2103:00 +CPU= 51.103
  19:48:29 STEP 2104 H=2104:00 +CPU= 33.726
  19:49:03 STEP 2105 H=2105:00 +CPU= 32.650
  19:49:58 STEP 2106 H=2106:00 +CPU= 51.840
  19:50:32 STEP 2107 H=2107:00 +CPU= 32.309
  19:51:06 STEP 2108 H=2108:00 +CPU= 32.800
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:52:21 STEP 2109 H=2109:00 +CPU= 51.598
  19:52:57 STEP 2110 H=2110:00 +CPU= 33.511
  19:53:32 STEP 2111 H=2111:00 +CPU= 33.579
  19:54:37 STEP 2112 H=2112:00 +CPU= 61.184
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002100
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0977_2002050100_123_971_12188621_1_r1972563460_87.zip
Uploading the intermediate file: upload_file_87.zip
  19:55:10 STEP 2113 H=2113:00 +CPU= 30.732
  19:55:46 STEP 2114 H=2114:00 +CPU= 34.811
  19:56:43 STEP 2115 H=2115:00 +CPU= 53.458
  19:57:19 STEP 2116 H=2116:00 +CPU= 33.925
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:58:06 STEP 2117 H=2117:00 +CPU= 33.110
  19:59:01 STEP 2118 H=2118:00 +CPU= 52.279
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:00:39 STEP 2119 H=2119:00 +CPU= 35.199
  20:01:16 STEP 2120 H=2120:00 +CPU= 34.990
  20:02:09 STEP 2121 H=2121:00 +CPU= 50.493
  20:02:43 STEP 2122 H=2122:00 +CPU= 32.619
  20:03:17 STEP 2123 H=2123:00 +CPU= 32.766
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:04:30 STEP 2124 H=2124:00 +CPU= 59.426
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002124
  20:05:16 STEP 2125 H=2125:00 +CPU= 32.671
  20:05:52 STEP 2126 H=2126:00 +CPU= 32.810
  20:06:48 STEP 2127 H=2127:00 +CPU= 54.280
  20:07:22 STEP 2128 H=2128:00 +CPU= 32.512
  20:07:57 STEP 2129 H=2129:00 +CPU= 33.607
  20:08:54 STEP 2130 H=2130:00 +CPU= 54.341
  20:09:32 STEP 2131 H=2131:00 +CPU= 37.165
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:11:01 STEP 2132 H=2132:00 +CPU= 36.010
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:12:21 STEP 2133 H=2133:00 +CPU= 56.246
  20:12:58 STEP 2134 H=2134:00 +CPU= 35.817
  20:13:36 STEP 2135 H=2135:00 +CPU= 36.306
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:14:55 STEP 2136 H=2136:00 +CPU= 65.135
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002124
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0977_2002050100_123_971_12188621_1_r1972563460_88.zip
Uploading the intermediate file: upload_file_88.zip
Uploading trickle at timestep: 7689600
  20:15:32 STEP 2137 H=2137:00 +CPU= 35.925
  20:16:11 STEP 2138 H=2138:00 +CPU= 36.862
  20:17:04 STEP 2139 H=2139:00 +CPU= 49.878
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:18:11 STEP 2140 H=2140:00 +CPU= 32.409
  20:18:47 STEP 2141 H=2141:00 +CPU= 35.239
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:20:04 STEP 2142 H=2142:00 +CPU= 52.472
  20:20:38 STEP 2143 H=2143:00 +CPU= 31.885
  20:21:16 STEP 2144 H=2144:00 +CPU= 35.964
  20:22:14 STEP 2145 H=2145:00 +CPU= 55.105
  20:22:51 STEP 2146 H=2146:00 +CPU= 35.448
  20:23:27 STEP 2147 H=2147:00 +CPU= 34.434
  20:24:27 STEP 2148 H=2148:00 +CPU= 55.672
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002148
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:25:22 STEP 2149 H=2149:00 +CPU= 31.838
  20:25:57 STEP 2150 H=2150:00 +CPU= 32.942
  20:26:53 STEP 2151 H=2151:00 +CPU= 52.852
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:27:40 STEP 2152 H=2152:00 +CPU= 32.842
  20:28:13 STEP 2153 H=2153:00 +CPU= 31.079
  20:29:07 STEP 2154 H=2154:00 +CPU= 50.631
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:30:02 STEP 2155 H=2155:00 +CPU= 31.003
  20:30:37 STEP 2156 H=2156:00 +CPU= 32.447
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:32:19 STEP 2157 H=2157:00 +CPU= 48.007
  20:32:52 STEP 2158 H=2158:00 +CPU= 30.444
  20:33:25 STEP 2159 H=2159:00 +CPU= 30.937
  20:34:30 STEP 2160 H=2160:00 +CPU= 60.613
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002148
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0977_2002050100_123_971_12188621_1_r1972563460_89.zip
Uploading the intermediate file: upload_file_89.zip
  20:35:04 STEP 2161 H=2161:00 +CPU= 31.289
  20:35:39 STEP 2162 H=2162:00 +CPU= 32.294
  20:36:31 STEP 2163 H=2163:00 +CPU= 48.917
  20:37:06 STEP 2164 H=2164:00 +CPU= 32.485
  20:37:42 STEP 2165 H=2165:00 +CPU= 34.034
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:39:19 STEP 2166 H=2166:00 +CPU= 52.370
  20:39:58 STEP 2167 H=2167:00 +CPU= 37.670
  20:40:35 STEP 2168 H=2168:00 +CPU= 35.595
  20:41:29 STEP 2169 H=2169:00 +CPU= 52.635
  20:42:05 STEP 2170 H=2170:00 +CPU= 35.115
  20:42:41 STEP 2171 H=2171:00 +CPU= 34.943
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:44:13 STEP 2172 H=2172:00 +CPU= 55.384
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002172
  20:44:46 STEP 2173 H=2173:00 +CPU= 30.539
  20:45:20 STEP 2174 H=2174:00 +CPU= 31.220
  20:46:12 STEP 2175 H=2175:00 +CPU= 47.777
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:47:07 STEP 2176 H=2176:00 +CPU= 31.944
  20:47:40 STEP 2177 H=2177:00 +CPU= 30.738
  20:48:39 STEP 2178 H=2178:00 +CPU= 57.519
  20:49:16 STEP 2179 H=2179:00 +CPU= 34.591
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:50:02 STEP 2180 H=2180:00 +CPU= 32.360
  20:50:56 STEP 2181 H=2181:00 +CPU= 49.171
  20:51:30 STEP 2182 H=2182:00 +CPU= 31.875
  20:52:04 STEP 2183 H=2183:00 +CPU= 31.322
  20:53:05 STEP 2184 H=2184:00 +CPU= 57.148
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002172
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0977_2002050100_123_971_12188621_1_r1972563460_90.zip
Uploading the intermediate file: upload_file_90.zip
  20:53:38 STEP 2185 H=2185:00 +CPU= 31.282
  20:54:12 STEP 2186 H=2186:00 +CPU= 31.184
  20:55:06 STEP 2187 H=2187:00 +CPU= 49.622
  20:55:43 STEP 2188 H=2188:00 +CPU= 34.786
  20:56:18 STEP 2189 H=2189:00 +CPU= 32.203
  20:57:13 STEP 2190 H=2190:00 +CPU= 51.326
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:57:58 STEP 2191 H=2191:00 +CPU= 31.841
  20:58:33 STEP 2192 H=2192:00 +CPU= 32.831
  20:59:26 STEP 2193 H=2193:00 +CPU= 48.572
  21:00:01 STEP 2194 H=2194:00 +CPU= 32.118
  21:00:35 STEP 2195 H=2195:00 +CPU= 32.363
  21:01:35 STEP 2196 H=2196:00 +CPU= 55.134
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002196
  21:02:09 STEP 2197 H=2197:00 +CPU= 31.726
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:03:20 STEP 2198 H=2198:00 +CPU= 37.024
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:05:49 STEP 2199 H=2199:00 +CPU= 54.156
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:06:57 STEP 2200 H=2200:00 +CPU= 35.915
  21:07:33 STEP 2201 H=2201:00 +CPU= 34.390
  21:08:30 STEP 2202 H=2202:00 +CPU= 55.160
  21:09:05 STEP 2203 H=2203:00 +CPU= 33.983
  21:09:41 STEP 2204 H=2204:00 +CPU= 35.227
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:11:30 STEP 2205 H=2205:00 +CPU= 54.044
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:12:58 STEP 2206 H=2206:00 +CPU= 35.632
  21:13:36 STEP 2207 H=2207:00 +CPU= 36.657
  21:14:41 STEP 2208 H=2208:00 +CPU= 62.841
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002196
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0977_2002050100_123_971_12188621_1_r1972563460_91.zip
Uploading the intermediate file: upload_file_91.zip
  21:15:16 STEP 2209 H=2209:00 +CPU= 34.159
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:16:32 STEP 2210 H=2210:00 +CPU= 34.219
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:17:51 STEP 2211 H=2211:00 +CPU= 53.695
  21:18:30 STEP 2212 H=2212:00 +CPU= 36.676
  21:19:05 STEP 2213 H=2213:00 +CPU= 33.383
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:20:44 STEP 2214 H=2214:00 +CPU= 54.751
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:22:01 STEP 2215 H=2215:00 +CPU= 33.375
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:23:09 STEP 2216 H=2216:00 +CPU= 35.540
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:25:30 STEP 2217 H=2217:00 +CPU= 55.448
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:26:19 STEP 2218 H=2218:00 +CPU= 35.318
  21:26:57 STEP 2219 H=2219:00 +CPU= 36.532
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:28:30 STEP 2220 H=2220:00 +CPU= 59.634
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002220
  21:29:07 STEP 2221 H=2221:00 +CPU= 34.368
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:30:03 STEP 2222 H=2222:00 +CPU= 33.135
  21:30:58 STEP 2223 H=2223:00 +CPU= 50.408
  21:31:32 STEP 2224 H=2224:00 +CPU= 31.792
  21:32:04 STEP 2225 H=2225:00 +CPU= 30.490
  21:32:59 STEP 2226 H=2226:00 +CPU= 51.105
  21:33:32 STEP 2227 H=2227:00 +CPU= 30.820
  21:34:05 STEP 2228 H=2228:00 +CPU= 31.421
  21:34:57 STEP 2229 H=2229:00 +CPU= 48.394
  21:35:34 STEP 2230 H=2230:00 +CPU= 34.360
  21:36:09 STEP 2231 H=2231:00 +CPU= 32.696
  21:37:11 STEP 2232 H=2232:00 +CPU= 57.950
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002220
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0977_2002050100_123_971_12188621_1_r1972563460_92.zip
Uploading the intermediate file: upload_file_92.zip
  21:37:43 STEP 2233 H=2233:00 +CPU= 30.144
  21:38:18 STEP 2234 H=2234:00 +CPU= 32.125
  21:39:11 STEP 2235 H=2235:00 +CPU= 49.849
  21:39:45 STEP 2236 H=2236:00 +CPU= 32.332
  21:40:18 STEP 2237 H=2237:00 +CPU= 30.425
  21:41:11 STEP 2238 H=2238:00 +CPU= 49.191
  21:41:44 STEP 2239 H=2239:00 +CPU= 31.269
  21:42:17 STEP 2240 H=2240:00 +CPU= 31.162
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:43:31 STEP 2241 H=2241:00 +CPU= 48.030
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:44:16 STEP 2242 H=2242:00 +CPU= 32.279
  21:44:48 STEP 2243 H=2243:00 +CPU= 29.683
  21:45:44 STEP 2244 H=2244:00 +CPU= 52.645
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002244
  21:46:17 STEP 2245 H=2245:00 +CPU= 31.202
  21:46:50 STEP 2246 H=2246:00 +CPU= 31.589
  21:47:42 STEP 2247 H=2247:00 +CPU= 49.059
  21:48:15 STEP 2248 H=2248:00 +CPU= 30.775
  21:48:47 STEP 2249 H=2249:00 +CPU= 29.557
  21:49:40 STEP 2250 H=2250:00 +CPU= 49.882
  21:50:18 STEP 2251 H=2251:00 +CPU= 36.894
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:51:08 STEP 2252 H=2252:00 +CPU= 37.287
  21:52:02 STEP 2253 H=2253:00 +CPU= 52.130
  21:52:37 STEP 2254 H=2254:00 +CPU= 33.406
  21:53:12 STEP 2255 H=2255:00 +CPU= 33.678
  21:54:17 STEP 2256 H=2256:00 +CPU= 61.939
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002244
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0977_2002050100_123_971_12188621_1_r1972563460_93.zip
Uploading the intermediate file: upload_file_93.zip
  21:54:53 STEP 2257 H=2257:00 +CPU= 34.618
  21:55:31 STEP 2258 H=2258:00 +CPU= 35.655
  21:56:27 STEP 2259 H=2259:00 +CPU= 53.785
  21:57:04 STEP 2260 H=2260:00 +CPU= 35.193
  21:57:39 STEP 2261 H=2261:00 +CPU= 33.161
  21:58:35 STEP 2262 H=2262:00 +CPU= 53.761
  21:59:12 STEP 2263 H=2263:00 +CPU= 35.326
  21:59:51 STEP 2264 H=2264:00 +CPU= 36.615
  22:00:48 STEP 2265 H=2265:00 +CPU= 54.929
  22:01:23 STEP 2266 H=2266:00 +CPU= 33.375
  22:01:59 STEP 2267 H=2267:00 +CPU= 34.264
  22:02:57 STEP 2268 H=2268:00 +CPU= 55.653
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002268
  22:03:33 STEP 2269 H=2269:00 +CPU= 33.521
  22:04:09 STEP 2270 H=2270:00 +CPU= 34.790
  22:05:06 STEP 2271 H=2271:00 +CPU= 54.313
  22:05:42 STEP 2272 H=2272:00 +CPU= 34.403
  22:06:18 STEP 2273 H=2273:00 +CPU= 34.287
  22:07:13 STEP 2274 H=2274:00 +CPU= 53.224
  22:07:48 STEP 2275 H=2275:00 +CPU= 32.842
  22:08:23 STEP 2276 H=2276:00 +CPU= 33.515
  22:09:17 STEP 2277 H=2277:00 +CPU= 51.412
  22:09:55 STEP 2278 H=2278:00 +CPU= 36.363
  22:10:31 STEP 2279 H=2279:00 +CPU= 34.084
  22:11:35 STEP 2280 H=2280:00 +CPU= 61.947
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002268
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0977_2002050100_123_971_12188621_1_r1972563460_94.zip
Uploading the intermediate file: upload_file_94.zip
  22:12:10 STEP 2281 H=2281:00 +CPU= 33.779
  22:12:46 STEP 2282 H=2282:00 +CPU= 33.855
  22:13:40 STEP 2283 H=2283:00 +CPU= 52.327
  22:14:16 STEP 2284 H=2284:00 +CPU= 34.818
  22:14:53 STEP 2285 H=2285:00 +CPU= 35.660
  22:15:51 STEP 2286 H=2286:00 +CPU= 55.882
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:16:46 STEP 2287 H=2287:00 +CPU= 32.667
  22:17:21 STEP 2288 H=2288:00 +CPU= 33.410
  22:18:14 STEP 2289 H=2289:00 +CPU= 50.476
  22:18:48 STEP 2290 H=2290:00 +CPU= 32.576
  22:19:19 STEP 2291 H=2291:00 +CPU= 29.943
  22:20:18 STEP 2292 H=2292:00 +CPU= 55.739
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002292
  22:20:51 STEP 2293 H=2293:00 +CPU= 31.437
  22:21:24 STEP 2294 H=2294:00 +CPU= 31.617
  22:22:16 STEP 2295 H=2295:00 +CPU= 48.562
  22:22:49 STEP 2296 H=2296:00 +CPU= 31.443
  22:23:21 STEP 2297 H=2297:00 +CPU= 29.943
  22:24:12 STEP 2298 H=2298:00 +CPU= 48.965
  22:24:45 STEP 2299 H=2299:00 +CPU= 30.601
  22:25:18 STEP 2300 H=2300:00 +CPU= 31.401
  22:26:09 STEP 2301 H=2301:00 +CPU= 48.574
  22:26:42 STEP 2302 H=2302:00 +CPU= 31.650
  22:27:16 STEP 2303 H=2303:00 +CPU= 32.554
  22:28:17 STEP 2304 H=2304:00 +CPU= 57.538
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002292
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0977_2002050100_123_971_12188621_1_r1972563460_95.zip
Uploading the intermediate file: upload_file_95.zip
  22:28:48 STEP 2305 H=2305:00 +CPU= 29.608
  22:29:24 STEP 2306 H=2306:00 +CPU= 35.202
  22:30:16 STEP 2307 H=2307:00 +CPU= 48.885
  22:30:50 STEP 2308 H=2308:00 +CPU= 32.590
  22:31:22 STEP 2309 H=2309:00 +CPU= 30.410
  22:32:14 STEP 2310 H=2310:00 +CPU= 49.440
  22:32:47 STEP 2311 H=2311:00 +CPU= 31.233
  22:33:19 STEP 2312 H=2312:00 +CPU= 30.694
  22:34:09 STEP 2313 H=2313:00 +CPU= 46.946
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:34:53 STEP 2314 H=2314:00 +CPU= 30.723
  22:35:25 STEP 2315 H=2315:00 +CPU= 30.631
  22:36:22 STEP 2316 H=2316:00 +CPU= 53.530
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002316
  22:36:54 STEP 2317 H=2317:00 +CPU= 30.598
  22:37:32 STEP 2318 H=2318:00 +CPU= 36.561
  22:38:28 STEP 2319 H=2319:00 +CPU= 52.644
  22:39:03 STEP 2320 H=2320:00 +CPU= 34.046
  22:39:38 STEP 2321 H=2321:00 +CPU= 33.293
  22:40:35 STEP 2322 H=2322:00 +CPU= 54.283
  22:41:10 STEP 2323 H=2323:00 +CPU= 33.494
  22:41:47 STEP 2324 H=2324:00 +CPU= 34.562
  22:42:43 STEP 2325 H=2325:00 +CPU= 54.143
  22:43:22 STEP 2326 H=2326:00 +CPU= 36.242
  22:43:57 STEP 2327 H=2327:00 +CPU= 33.869
  22:45:03 STEP 2328 H=2328:00 +CPU= 61.575
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002316
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0977_2002050100_123_971_12188621_1_r1972563460_96.zip
Uploading the intermediate file: upload_file_96.zip
  22:45:38 STEP 2329 H=2329:00 +CPU= 33.475
  22:46:13 STEP 2330 H=2330:00 +CPU= 32.523
  22:47:08 STEP 2331 H=2331:00 +CPU= 51.091
  22:47:43 STEP 2332 H=2332:00 +CPU= 33.300
  22:48:18 STEP 2333 H=2333:00 +CPU= 32.830
  22:49:14 STEP 2334 H=2334:00 +CPU= 52.185
  22:49:51 STEP 2335 H=2335:00 +CPU= 34.736
  22:50:29 STEP 2336 H=2336:00 +CPU= 36.419
  22:51:26 STEP 2337 H=2337:00 +CPU= 53.765
  22:52:03 STEP 2338 H=2338:00 +CPU= 34.389
  22:52:38 STEP 2339 H=2339:00 +CPU= 32.132
  22:53:37 STEP 2340 H=2340:00 +CPU= 55.709
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002340
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:54:23 STEP 2341 H=2341:00 +CPU= 32.795
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:55:09 STEP 2342 H=2342:00 +CPU= 32.661
  22:56:04 STEP 2343 H=2343:00 +CPU= 51.878
  22:56:40 STEP 2344 H=2344:00 +CPU= 33.540
  22:57:18 STEP 2345 H=2345:00 +CPU= 36.076
  22:58:15 STEP 2346 H=2346:00 +CPU= 54.707
  22:58:51 STEP 2347 H=2347:00 +CPU= 34.203
  22:59:28 STEP 2348 H=2348:00 +CPU= 34.046
  23:00:22 STEP 2349 H=2349:00 +CPU= 49.879
  23:00:57 STEP 2350 H=2350:00 +CPU= 32.436
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:01:44 STEP 2351 H=2351:00 +CPU= 32.655
  23:02:48 STEP 2352 H=2352:00 +CPU= 58.370
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002340
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0977_2002050100_123_971_12188621_1_r1972563460_97.zip
Uploading the intermediate file: upload_file_97.zip
  23:03:22 STEP 2353 H=2353:00 +CPU= 31.795
  23:04:01 STEP 2354 H=2354:00 +CPU= 37.119
  23:04:59 STEP 2355 H=2355:00 +CPU= 56.031
  23:05:36 STEP 2356 H=2356:00 +CPU= 35.324
  23:06:16 STEP 2357 H=2357:00 +CPU= 37.778
  23:07:13 STEP 2358 H=2358:00 +CPU= 55.693
  23:07:48 STEP 2359 H=2359:00 +CPU= 33.720
  23:08:26 STEP 2360 H=2360:00 +CPU= 35.811
  23:09:21 STEP 2361 H=2361:00 +CPU= 53.011
  23:09:58 STEP 2362 H=2362:00 +CPU= 35.743
  23:10:33 STEP 2363 H=2363:00 +CPU= 33.847
  23:11:33 STEP 2364 H=2364:00 +CPU= 58.511
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002364
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:12:19 STEP 2365 H=2365:00 +CPU= 32.902
  23:12:55 STEP 2366 H=2366:00 +CPU= 34.740
  23:13:51 STEP 2367 H=2367:00 +CPU= 54.245
  23:14:28 STEP 2368 H=2368:00 +CPU= 35.125
  23:15:03 STEP 2369 H=2369:00 +CPU= 34.225
  23:16:00 STEP 2370 H=2370:00 +CPU= 55.003
  23:16:34 STEP 2371 H=2371:00 +CPU= 31.929
  23:17:08 STEP 2372 H=2372:00 +CPU= 33.188
  23:18:05 STEP 2373 H=2373:00 +CPU= 53.597
  23:18:45 STEP 2374 H=2374:00 +CPU= 37.836
  23:19:22 STEP 2375 H=2375:00 +CPU= 35.501
  23:20:28 STEP 2376 H=2376:00 +CPU= 63.839
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002364
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0977_2002050100_123_971_12188621_1_r1972563460_98.zip
Uploading the intermediate file: upload_file_98.zip
Uploading trickle at timestep: 8553600
  23:21:04 STEP 2377 H=2377:00 +CPU= 34.530
  23:21:40 STEP 2378 H=2378:00 +CPU= 35.109
  23:22:41 STEP 2379 H=2379:00 +CPU= 58.396
  23:23:19 STEP 2380 H=2380:00 +CPU= 35.696
  23:23:53 STEP 2381 H=2381:00 +CPU= 30.815
  23:24:45 STEP 2382 H=2382:00 +CPU= 48.943
  23:25:19 STEP 2383 H=2383:00 +CPU= 30.972
  23:25:52 STEP 2384 H=2384:00 +CPU= 30.557
  23:26:43 STEP 2385 H=2385:00 +CPU= 47.508
  23:27:17 STEP 2386 H=2386:00 +CPU= 31.104
  23:27:50 STEP 2387 H=2387:00 +CPU= 30.367
  23:28:47 STEP 2388 H=2388:00 +CPU= 53.431
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002388
  23:29:19 STEP 2389 H=2389:00 +CPU= 29.801
  23:29:54 STEP 2390 H=2390:00 +CPU= 32.024
  23:30:46 STEP 2391 H=2391:00 +CPU= 48.774
  23:31:20 STEP 2392 H=2392:00 +CPU= 31.820
  23:31:54 STEP 2393 H=2393:00 +CPU= 31.625
  23:32:46 STEP 2394 H=2394:00 +CPU= 49.201
  23:33:19 STEP 2395 H=2395:00 +CPU= 30.700
  23:33:53 STEP 2396 H=2396:00 +CPU= 31.596
  23:34:46 STEP 2397 H=2397:00 +CPU= 49.948
  23:35:26 STEP 2398 H=2398:00 +CPU= 37.313
  23:36:07 STEP 2399 H=2399:00 +CPU= 39.016
  23:37:11 STEP 2400 H=2400:00 +CPU= 61.041
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002388
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0977_2002050100_123_971_12188621_1_r1972563460_99.zip
Uploading the intermediate file: upload_file_99.zip
  23:37:45 STEP 2401 H=2401:00 +CPU= 32.568
  23:38:21 STEP 2402 H=2402:00 +CPU= 34.216
  23:39:20 STEP 2403 H=2403:00 +CPU= 56.499
  23:39:56 STEP 2404 H=2404:00 +CPU= 34.163
  23:40:32 STEP 2405 H=2405:00 +CPU= 33.340
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:41:43 STEP 2406 H=2406:00 +CPU= 56.285
  23:42:17 STEP 2407 H=2407:00 +CPU= 33.083
  23:42:51 STEP 2408 H=2408:00 +CPU= 33.331
  23:43:44 STEP 2409 H=2409:00 +CPU= 50.580
  23:44:18 STEP 2410 H=2410:00 +CPU= 32.891
  23:44:52 STEP 2411 H=2411:00 +CPU= 32.735
  23:45:49 STEP 2412 H=2412:00 +CPU= 55.498
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002412
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002412
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002412
  23:46:24 STEP 2413 H=2413:00 +CPU= 32.842
  23:46:58 STEP 2414 H=2414:00 +CPU= 33.179
  23:47:51 STEP 2415 H=2415:00 +CPU= 50.821
  23:48:27 STEP 2416 H=2416:00 +CPU= 34.225
  23:49:01 STEP 2417 H=2417:00 +CPU= 32.648
  23:49:53 STEP 2418 H=2418:00 +CPU= 49.391
  23:50:27 STEP 2419 H=2419:00 +CPU= 32.158
  23:51:01 STEP 2420 H=2420:00 +CPU= 32.859
  23:51:51 STEP 2421 H=2421:00 +CPU= 48.954
  23:52:25 STEP 2422 H=2422:00 +CPU= 32.673
  23:53:01 STEP 2423 H=2423:00 +CPU= 34.168
  23:54:07 STEP 2424 H=2424:00 +CPU= 62.387
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0977_2002050100_123_971_12188621_1_r1972563460_100.zip
Uploading the intermediate file: upload_file_100.zip
  23:54:43 STEP 2425 H=2425:00 +CPU= 34.440
  23:55:21 STEP 2426 H=2426:00 +CPU= 36.173
  23:56:19 STEP 2427 H=2427:00 +CPU= 55.505
  23:56:57 STEP 2428 H=2428:00 +CPU= 35.697
  23:57:32 STEP 2429 H=2429:00 +CPU= 32.502
  23:58:27 STEP 2430 H=2430:00 +CPU= 50.969
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2002050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0977
(argv4) batchid: 971
(argv5) wuid: 12188621
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/8
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_26f91fbfc7b05a61c0984e5c455c4233 to: /var/lib/boinc-client/slots/8/oifs_43r3_ps_0977_2002050100_123_971_12188621.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/8/oifs_43r3_ps_0977_2002050100_123_971_12188621.zip
ic_ancil_file: ic_ancil_12188621
ifsdata_file: ifsdata_12188621
climate_data_file: clim_data_12188621
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_3c2009899f51468a4319f9d5d0f11919 to: /var/lib/boinc-client/slots/8/ic_ancil_12188621.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/8/ic_ancil_12188621.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_59d3405d9fde282a7c3cb1c7f1398b67 to: /var/lib/boinc-client/slots/8/ifsdata/ifsdata_12188621.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/8/ifsdata/ifsdata_12188621.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/8/159l_2/clim_data_12188621.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/8/159l_2/clim_data_12188621.zip
Checking for progress XML file: /var/lib/boinc-client/slots/8/progress_file_12188621.xml
Opened progress file ok : /var/lib/boinc-client/slots/8/progress_file_12188621.xml
-- Model is restarting --
Adjusting last_iter, 2431, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/8/progress_file_12188621.xml
last_cpu_time: 92484
upload_file_number: 101
last_iter: 2423
last_upload: 8726400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0977_2002050100_123_971_12188621_1_r1972563460
The child process has been launched with process id: 135120
Executing the command: /var/lib/boinc-client/slots/8/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:taman-jurong:1:1:135120:135120] [20230113:060005:1673560805:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  06:01:16 STEP 2424 H=2424:00 +CPU= 60.882
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:02:17 STEP 2425 H=2425:00 +CPU= 36.147
  06:02:58 STEP 2426 H=2426:00 +CPU= 39.233
  06:03:57 STEP 2427 H=2427:00 +CPU= 56.364
  06:04:36 STEP 2428 H=2428:00 +CPU= 37.225
  06:05:12 STEP 2429 H=2429:00 +CPU= 35.009
  06:06:10 STEP 2430 H=2430:00 +CPU= 55.774
  06:06:46 STEP 2431 H=2431:00 +CPU= 34.809
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:07:35 STEP 2432 H=2432:00 +CPU= 36.518
  06:08:35 STEP 2433 H=2433:00 +CPU= 57.503
  06:09:11 STEP 2434 H=2434:00 +CPU= 34.747
  06:09:46 STEP 2435 H=2435:00 +CPU= 34.237
  06:10:54 STEP 2436 H=2436:00 +CPU= 65.433
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002436
  06:11:34 STEP 2437 H=2437:00 +CPU= 38.738
  06:12:14 STEP 2438 H=2438:00 +CPU= 38.580
  06:13:13 STEP 2439 H=2439:00 +CPU= 57.607
  06:13:52 STEP 2440 H=2440:00 +CPU= 37.307
  06:14:30 STEP 2441 H=2441:00 +CPU= 36.437
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:15:41 STEP 2442 H=2442:00 +CPU= 57.219
  06:16:18 STEP 2443 H=2443:00 +CPU= 35.967
  06:16:57 STEP 2444 H=2444:00 +CPU= 36.962
  06:17:53 STEP 2445 H=2445:00 +CPU= 54.474
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:20:52 STEP 2446 H=2446:00 +CPU= 34.241
  06:21:31 STEP 2447 H=2447:00 +CPU= 37.452
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:22:59 STEP 2448 H=2448:00 +CPU= 72.101
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12188621/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0977_2002050100_123_971_12188621_1_r1972563460_101.zip
Uploading the intermediate file: upload_file_101.zip
  06:23:39 STEP 2449 H=2449:00 +CPU= 38.486
  06:24:22 STEP 2450 H=2450:00 +CPU= 40.728
  06:25:21 STEP 2451 H=2451:00 +CPU= 56.886
  06:26:02 STEP 2452 H=2452:00 +CPU= 39.720
Abort request received from BOINC client, ending the child process
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:17:22 1534673 22296793 oifs_43r3_ps_0977_2002050100_123_971_12188621_1 8,553,600 90,308 0.0106
09 May 2023 16:17:22 1534673 22296793 oifs_43r3_ps_0977_2002050100_123_971_12188621_1 7,689,600 80,697 0.0105
09 May 2023 16:16:17 1534673 22296793 oifs_43r3_ps_0977_2002050100_123_971_12188621_1 6,134,400 63,059 0.0103
09 May 2023 16:16:08 1534673 22296793 oifs_43r3_ps_0977_2002050100_123_971_12188621_1 5,270,400 54,724 0.0104
09 May 2023 16:16:05 1534673 22296793 oifs_43r3_ps_0977_2002050100_123_971_12188621_1 3,628,800 36,983 0.0102
09 May 2023 16:16:05 1534673 22296793 oifs_43r3_ps_0977_2002050100_123_971_12188621_1 2,764,800 28,782 0.0104
09 May 2023 16:16:05 1534673 22296793 oifs_43r3_ps_0977_2002050100_123_971_12188621_1 2,764,800 28,782 0.0104
09 May 2023 16:15:25 1534673 22296793 oifs_43r3_ps_0977_2002050100_123_971_12188621_1 1,900,800 19,628 0.0103
09 May 2023 16:15:21 1534673 22296793 oifs_43r3_ps_0977_2002050100_123_971_12188621_1 1,036,800 10,864 0.0105
09 May 2023 16:15:21 1534673 22296793 oifs_43r3_ps_0977_2002050100_123_971_12188621_1 1,036,800 10,864 0.0105


©2024 cpdn.org