climateprediction.net home page
Task 22250596

Task 22250596

Name oifs_43r3_ps_0958_2021050100_123_945_12164047_1
Workunit 12164047
Created 15 Dec 2022, 0:26:14 UTC
Sent 15 Dec 2022, 0:37:07 UTC
Report deadline 14 Jan 2023, 0:37:07 UTC
Received 15 Dec 2022, 14:53:43 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 148 (0x00000094) Unknown error code
Computer ID 1459508
Run time 11 hours 59 min 16 sec
CPU time 11 hours 59 min 16 sec
Validate state Invalid
Credit 8,467.20
Device peak FLOPS 4.87 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,783.13 MB
Peak swap size 4,974.11 MB
Peak disk usage 1,223.17 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 148 (0x94, -108)</message>
<stderr_txt>
zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0958_2021050100_123_945_12164047_1_r804386321_47.zip
Uploading the intermediate file: upload_file_47.zip
  03:23:04 STEP 1153 H=1153:00 +CPU= 19.064
  03:23:23 STEP 1154 H=1154:00 +CPU= 18.775
  03:23:53 STEP 1155 H=1155:00 +CPU= 30.214
  03:24:12 STEP 1156 H=1156:00 +CPU= 19.006
  03:24:30 STEP 1157 H=1157:00 +CPU= 18.112
  03:25:01 STEP 1158 H=1158:00 +CPU= 30.130
  03:25:18 STEP 1159 H=1159:00 +CPU= 17.910
  03:25:38 STEP 1160 H=1160:00 +CPU= 19.785
  03:26:09 STEP 1161 H=1161:00 +CPU= 30.312
  03:26:27 STEP 1162 H=1162:00 +CPU= 18.622
  03:26:47 STEP 1163 H=1163:00 +CPU= 19.656
  03:27:19 STEP 1164 H=1164:00 +CPU= 31.989
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001164
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001164
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001164
  03:27:37 STEP 1165 H=1165:00 +CPU= 18.205
  03:27:58 STEP 1166 H=1166:00 +CPU= 21.077
  03:28:37 STEP 1167 H=1167:00 +CPU= 39.303
  03:28:59 STEP 1168 H=1168:00 +CPU= 21.909
  03:29:18 STEP 1169 H=1169:00 +CPU= 18.395
  03:29:48 STEP 1170 H=1170:00 +CPU= 30.445
  03:30:07 STEP 1171 H=1171:00 +CPU= 18.359
  03:30:26 STEP 1172 H=1172:00 +CPU= 19.105
  03:30:56 STEP 1173 H=1173:00 +CPU= 30.382
  03:31:15 STEP 1174 H=1174:00 +CPU= 18.478
  03:31:34 STEP 1175 H=1175:00 +CPU= 19.201
  03:32:08 STEP 1176 H=1176:00 +CPU= 34.016
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001176
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001176
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001164
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0958_2021050100_123_945_12164047_1_r804386321_48.zip
Uploading the intermediate file: upload_file_48.zip
  03:32:26 STEP 1177 H=1177:00 +CPU= 18.238
  03:32:45 STEP 1178 H=1178:00 +CPU= 19.124
  03:33:18 STEP 1179 H=1179:00 +CPU= 32.536
  03:33:44 STEP 1180 H=1180:00 +CPU= 26.385
  03:34:09 STEP 1181 H=1181:00 +CPU= 25.024
  03:34:48 STEP 1182 H=1182:00 +CPU= 39.127
  03:35:13 STEP 1183 H=1183:00 +CPU= 24.954
  03:35:36 STEP 1184 H=1184:00 +CPU= 23.092
  03:36:07 STEP 1185 H=1185:00 +CPU= 30.396
  03:36:28 STEP 1186 H=1186:00 +CPU= 20.838
  03:36:48 STEP 1187 H=1187:00 +CPU= 19.972
  03:37:24 STEP 1188 H=1188:00 +CPU= 35.976
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001188
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001188
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001188
  03:37:46 STEP 1189 H=1189:00 +CPU= 22.599
  03:38:05 STEP 1190 H=1190:00 +CPU= 18.777
  03:38:41 STEP 1191 H=1191:00 +CPU= 36.461
  03:39:05 STEP 1192 H=1192:00 +CPU= 24.009
  03:39:31 STEP 1193 H=1193:00 +CPU= 25.770
  03:40:11 STEP 1194 H=1194:00 +CPU= 39.570
  03:40:35 STEP 1195 H=1195:00 +CPU= 24.159
  03:40:58 STEP 1196 H=1196:00 +CPU= 22.950
  03:41:35 STEP 1197 H=1197:00 +CPU= 36.871
  03:41:53 STEP 1198 H=1198:00 +CPU= 18.551
  03:42:12 STEP 1199 H=1199:00 +CPU= 18.578
  03:42:46 STEP 1200 H=1200:00 +CPU= 33.598
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001200
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001200
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001188
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0958_2021050100_123_945_12164047_1_r804386321_49.zip
Uploading the intermediate file: upload_file_49.zip
  03:43:09 STEP 1201 H=1201:00 +CPU= 23.156
Uploading trickle at timestep: 4320000
  03:43:33 STEP 1202 H=1202:00 +CPU= 23.762
  03:44:09 STEP 1203 H=1203:00 +CPU= 36.318
  03:44:29 STEP 1204 H=1204:00 +CPU= 19.902
  03:44:48 STEP 1205 H=1205:00 +CPU= 19.338
  03:45:26 STEP 1206 H=1206:00 +CPU= 37.960
  03:45:50 STEP 1207 H=1207:00 +CPU= 24.046
  03:46:11 STEP 1208 H=1208:00 +CPU= 21.039
  03:46:47 STEP 1209 H=1209:00 +CPU= 36.319
  03:47:13 STEP 1210 H=1210:00 +CPU= 25.158
  03:47:34 STEP 1211 H=1211:00 +CPU= 21.704
  03:48:08 STEP 1212 H=1212:00 +CPU= 33.228
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001212
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001212
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001212
  03:48:26 STEP 1213 H=1213:00 +CPU= 18.812
  03:48:45 STEP 1214 H=1214:00 +CPU= 18.760
  03:49:14 STEP 1215 H=1215:00 +CPU= 28.831
  03:49:32 STEP 1216 H=1216:00 +CPU= 18.418
  03:49:52 STEP 1217 H=1217:00 +CPU= 19.658
  03:50:22 STEP 1218 H=1218:00 +CPU= 30.391
  03:50:42 STEP 1219 H=1219:00 +CPU= 19.912
  03:51:03 STEP 1220 H=1220:00 +CPU= 20.433
  03:51:36 STEP 1221 H=1221:00 +CPU= 33.477
  03:51:56 STEP 1222 H=1222:00 +CPU= 19.628
  03:52:15 STEP 1223 H=1223:00 +CPU= 18.662
  03:52:53 STEP 1224 H=1224:00 +CPU= 38.562
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001224
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001224
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001212
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0958_2021050100_123_945_12164047_1_r804386321_50.zip
Uploading the intermediate file: upload_file_50.zip
  03:53:11 STEP 1225 H=1225:00 +CPU= 18.089
  03:53:33 STEP 1226 H=1226:00 +CPU= 21.504
  03:54:03 STEP 1227 H=1227:00 +CPU= 29.998
  03:54:21 STEP 1228 H=1228:00 +CPU= 18.685
  03:54:39 STEP 1229 H=1229:00 +CPU= 18.010
  03:55:09 STEP 1230 H=1230:00 +CPU= 29.287
  03:55:27 STEP 1231 H=1231:00 +CPU= 18.301
  03:55:46 STEP 1232 H=1232:00 +CPU= 18.672
  03:56:16 STEP 1233 H=1233:00 +CPU= 29.767
  03:56:34 STEP 1234 H=1234:00 +CPU= 18.856
  03:56:53 STEP 1235 H=1235:00 +CPU= 18.800
  03:57:27 STEP 1236 H=1236:00 +CPU= 33.376
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001236
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001236
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001236
  03:57:45 STEP 1237 H=1237:00 +CPU= 18.265
  03:58:08 STEP 1238 H=1238:00 +CPU= 22.644
  03:58:42 STEP 1239 H=1239:00 +CPU= 34.171
  03:59:06 STEP 1240 H=1240:00 +CPU= 24.624
  03:59:30 STEP 1241 H=1241:00 +CPU= 23.765
  04:00:03 STEP 1242 H=1242:00 +CPU= 32.593
  04:00:21 STEP 1243 H=1243:00 +CPU= 18.580
  04:00:40 STEP 1244 H=1244:00 +CPU= 18.933
  04:01:09 STEP 1245 H=1245:00 +CPU= 29.194
  04:01:28 STEP 1246 H=1246:00 +CPU= 18.552
  04:01:47 STEP 1247 H=1247:00 +CPU= 19.248
  04:02:28 STEP 1248 H=1248:00 +CPU= 39.115
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001248
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001248
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0958_2021050100_123_945_12164047_1_r804386321_51.zip
Uploading the intermediate file: upload_file_51.zip
  04:02:53 STEP 1249 H=1249:00 +CPU= 24.938
  04:03:13 STEP 1250 H=1250:00 +CPU= 20.228
  04:03:44 STEP 1251 H=1251:00 +CPU= 30.647
  04:04:05 STEP 1252 H=1252:00 +CPU= 20.790
  04:04:23 STEP 1253 H=1253:00 +CPU= 18.027
  04:04:54 STEP 1254 H=1254:00 +CPU= 31.877
  04:05:20 STEP 1255 H=1255:00 +CPU= 25.781
  04:05:47 STEP 1256 H=1256:00 +CPU= 26.401
  04:06:21 STEP 1257 H=1257:00 +CPU= 34.707
  04:06:40 STEP 1258 H=1258:00 +CPU= 18.562
  04:06:59 STEP 1259 H=1259:00 +CPU= 18.794
  04:07:34 STEP 1260 H=1260:00 +CPU= 35.527
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001260
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001260
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001260
  04:08:00 STEP 1261 H=1261:00 +CPU= 25.493
  04:08:27 STEP 1262 H=1262:00 +CPU= 26.999
  04:09:00 STEP 1263 H=1263:00 +CPU= 33.259
  04:09:21 STEP 1264 H=1264:00 +CPU= 20.861
  04:09:41 STEP 1265 H=1265:00 +CPU= 19.639
  04:10:13 STEP 1266 H=1266:00 +CPU= 32.470
  04:10:35 STEP 1267 H=1267:00 +CPU= 21.615
  04:11:00 STEP 1268 H=1268:00 +CPU= 25.149
  04:11:38 STEP 1269 H=1269:00 +CPU= 38.110
  04:12:04 STEP 1270 H=1270:00 +CPU= 26.438
  04:12:25 STEP 1271 H=1271:00 +CPU= 20.888
  04:13:04 STEP 1272 H=1272:00 +CPU= 38.249
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001272
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001272
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001260
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0958_2021050100_123_945_12164047_1_r804386321_52.zip
Uploading the intermediate file: upload_file_52.zip
  04:13:22 STEP 1273 H=1273:00 +CPU= 18.013
  04:13:40 STEP 1274 H=1274:00 +CPU= 18.562
  04:14:09 STEP 1275 H=1275:00 +CPU= 28.587
  04:14:27 STEP 1276 H=1276:00 +CPU= 18.587
  04:14:45 STEP 1277 H=1277:00 +CPU= 17.945
  04:15:15 STEP 1278 H=1278:00 +CPU= 29.488
  04:15:33 STEP 1279 H=1279:00 +CPU= 18.440
  04:15:52 STEP 1280 H=1280:00 +CPU= 19.136
  04:16:28 STEP 1281 H=1281:00 +CPU= 36.043
  04:16:47 STEP 1282 H=1282:00 +CPU= 18.831
  04:17:07 STEP 1283 H=1283:00 +CPU= 20.162
  04:17:41 STEP 1284 H=1284:00 +CPU= 33.715
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001284
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001284
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001284
  04:17:59 STEP 1285 H=1285:00 +CPU= 17.930
  04:18:18 STEP 1286 H=1286:00 +CPU= 18.485
  04:18:53 STEP 1287 H=1287:00 +CPU= 35.315
  04:19:12 STEP 1288 H=1288:00 +CPU= 18.945
  04:19:34 STEP 1289 H=1289:00 +CPU= 21.684
  04:20:08 STEP 1290 H=1290:00 +CPU= 34.764
  04:20:28 STEP 1291 H=1291:00 +CPU= 19.308
  04:20:48 STEP 1292 H=1292:00 +CPU= 19.922
  04:21:16 STEP 1293 H=1293:00 +CPU= 28.634
  04:21:35 STEP 1294 H=1294:00 +CPU= 18.675
  04:21:54 STEP 1295 H=1295:00 +CPU= 18.727
  04:22:37 STEP 1296 H=1296:00 +CPU= 42.946
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001296
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001296
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001284
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0958_2021050100_123_945_12164047_1_r804386321_53.zip
Uploading the intermediate file: upload_file_53.zip
  04:23:02 STEP 1297 H=1297:00 +CPU= 25.360
  04:23:29 STEP 1298 H=1298:00 +CPU= 26.747
  04:24:05 STEP 1299 H=1299:00 +CPU= 36.308
  04:24:28 STEP 1300 H=1300:00 +CPU= 22.768
  04:24:53 STEP 1301 H=1301:00 +CPU= 25.210
  04:25:28 STEP 1302 H=1302:00 +CPU= 35.274
  04:25:51 STEP 1303 H=1303:00 +CPU= 22.228
  04:26:12 STEP 1304 H=1304:00 +CPU= 21.183
  04:26:49 STEP 1305 H=1305:00 +CPU= 36.979
  04:27:12 STEP 1306 H=1306:00 +CPU= 23.320
  04:27:32 STEP 1307 H=1307:00 +CPU= 20.369
  04:28:11 STEP 1308 H=1308:00 +CPU= 38.867
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001308
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001308
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001308
  04:28:31 STEP 1309 H=1309:00 +CPU= 20.079
  04:28:50 STEP 1310 H=1310:00 +CPU= 18.719
  04:29:19 STEP 1311 H=1311:00 +CPU= 28.950
  04:29:39 STEP 1312 H=1312:00 +CPU= 20.330
  04:29:58 STEP 1313 H=1313:00 +CPU= 19.022
  04:30:34 STEP 1314 H=1314:00 +CPU= 35.961
  04:30:53 STEP 1315 H=1315:00 +CPU= 18.512
  04:31:12 STEP 1316 H=1316:00 +CPU= 18.774
  04:31:42 STEP 1317 H=1317:00 +CPU= 29.944
  04:32:03 STEP 1318 H=1318:00 +CPU= 21.332
  04:32:23 STEP 1319 H=1319:00 +CPU= 20.040
  04:33:02 STEP 1320 H=1320:00 +CPU= 38.514
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001320
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001320
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001308
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0958_2021050100_123_945_12164047_1_r804386321_54.zip
Uploading the intermediate file: upload_file_54.zip
  04:33:26 STEP 1321 H=1321:00 +CPU= 24.458
  04:33:51 STEP 1322 H=1322:00 +CPU= 25.153
  04:34:24 STEP 1323 H=1323:00 +CPU= 32.260
  04:34:42 STEP 1324 H=1324:00 +CPU= 18.562
  04:35:02 STEP 1325 H=1325:00 +CPU= 19.420
  04:35:36 STEP 1326 H=1326:00 +CPU= 34.412
  04:35:55 STEP 1327 H=1327:00 +CPU= 19.100
  04:36:20 STEP 1328 H=1328:00 +CPU= 24.987
  04:36:55 STEP 1329 H=1329:00 +CPU= 34.955
  04:37:22 STEP 1330 H=1330:00 +CPU= 26.872
  04:37:47 STEP 1331 H=1331:00 +CPU= 25.375
  04:38:29 STEP 1332 H=1332:00 +CPU= 41.467
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001332
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001332
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001332
  04:38:49 STEP 1333 H=1333:00 +CPU= 19.974
  04:39:14 STEP 1334 H=1334:00 +CPU= 25.437
  04:39:53 STEP 1335 H=1335:00 +CPU= 38.889
  04:40:14 STEP 1336 H=1336:00 +CPU= 20.562
  04:40:35 STEP 1337 H=1337:00 +CPU= 21.582
  04:41:08 STEP 1338 H=1338:00 +CPU= 32.193
  04:41:30 STEP 1339 H=1339:00 +CPU= 21.966
  04:41:49 STEP 1340 H=1340:00 +CPU= 19.220
  04:42:18 STEP 1341 H=1341:00 +CPU= 28.994
  04:42:37 STEP 1342 H=1342:00 +CPU= 19.597
  04:42:58 STEP 1343 H=1343:00 +CPU= 20.281
  04:43:36 STEP 1344 H=1344:00 +CPU= 37.639
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001344
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001344
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0958_2021050100_123_945_12164047_1_r804386321_55.zip
Uploading the intermediate file: upload_file_55.zip
  04:43:59 STEP 1345 H=1345:00 +CPU= 22.946
  04:44:26 STEP 1346 H=1346:00 +CPU= 27.234
  04:45:02 STEP 1347 H=1347:00 +CPU= 35.994
  04:45:24 STEP 1348 H=1348:00 +CPU= 21.771
  04:45:42 STEP 1349 H=1349:00 +CPU= 18.230
  04:46:15 STEP 1350 H=1350:00 +CPU= 32.772
  04:46:33 STEP 1351 H=1351:00 +CPU= 18.668
  04:46:53 STEP 1352 H=1352:00 +CPU= 20.116
  04:47:25 STEP 1353 H=1353:00 +CPU= 31.125
  04:47:44 STEP 1354 H=1354:00 +CPU= 19.172
  04:48:05 STEP 1355 H=1355:00 +CPU= 21.708
  04:48:38 STEP 1356 H=1356:00 +CPU= 32.328
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001356
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001356
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001356
  04:48:57 STEP 1357 H=1357:00 +CPU= 19.506
  04:49:21 STEP 1358 H=1358:00 +CPU= 23.229
  04:49:56 STEP 1359 H=1359:00 +CPU= 35.001
  04:50:15 STEP 1360 H=1360:00 +CPU= 19.311
  04:50:36 STEP 1361 H=1361:00 +CPU= 21.322
  04:51:08 STEP 1362 H=1362:00 +CPU= 31.410
  04:51:28 STEP 1363 H=1363:00 +CPU= 19.890
  04:51:49 STEP 1364 H=1364:00 +CPU= 21.297
  04:52:22 STEP 1365 H=1365:00 +CPU= 33.259
  04:52:48 STEP 1366 H=1366:00 +CPU= 26.268
  04:53:08 STEP 1367 H=1367:00 +CPU= 19.297
  04:53:48 STEP 1368 H=1368:00 +CPU= 39.695
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001368
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001368
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001356
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0958_2021050100_123_945_12164047_1_r804386321_56.zip
Uploading the intermediate file: upload_file_56.zip
  04:54:08 STEP 1369 H=1369:00 +CPU= 20.282
  04:54:33 STEP 1370 H=1370:00 +CPU= 24.770
  04:55:06 STEP 1371 H=1371:00 +CPU= 33.269
  04:55:26 STEP 1372 H=1372:00 +CPU= 19.523
  04:55:44 STEP 1373 H=1373:00 +CPU= 18.336
  04:56:18 STEP 1374 H=1374:00 +CPU= 34.287
  04:56:42 STEP 1375 H=1375:00 +CPU= 24.280
  04:57:05 STEP 1376 H=1376:00 +CPU= 22.522
  04:57:38 STEP 1377 H=1377:00 +CPU= 33.142
  04:58:00 STEP 1378 H=1378:00 +CPU= 21.351
  04:58:19 STEP 1379 H=1379:00 +CPU= 19.636
  04:58:59 STEP 1380 H=1380:00 +CPU= 40.014
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001380
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001380
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001380
  04:59:22 STEP 1381 H=1381:00 +CPU= 22.583
  04:59:47 STEP 1382 H=1382:00 +CPU= 24.861
  05:00:23 STEP 1383 H=1383:00 +CPU= 36.646
  05:00:51 STEP 1384 H=1384:00 +CPU= 27.273
  05:01:13 STEP 1385 H=1385:00 +CPU= 22.621
  05:01:47 STEP 1386 H=1386:00 +CPU= 33.339
  05:02:06 STEP 1387 H=1387:00 +CPU= 19.322
  05:02:25 STEP 1388 H=1388:00 +CPU= 18.788
  05:02:54 STEP 1389 H=1389:00 +CPU= 29.238
  05:03:15 STEP 1390 H=1390:00 +CPU= 21.043
  05:03:39 STEP 1391 H=1391:00 +CPU= 24.419
  05:04:13 STEP 1392 H=1392:00 +CPU= 33.937
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001392
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001392
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001380
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0958_2021050100_123_945_12164047_1_r804386321_57.zip
Uploading the intermediate file: upload_file_57.zip
  05:04:32 STEP 1393 H=1393:00 +CPU= 18.874
  05:04:51 STEP 1394 H=1394:00 +CPU= 18.784
  05:05:20 STEP 1395 H=1395:00 +CPU= 29.148
  05:05:39 STEP 1396 H=1396:00 +CPU= 18.588
  05:05:57 STEP 1397 H=1397:00 +CPU= 18.211
  05:06:27 STEP 1398 H=1398:00 +CPU= 30.581
  05:06:46 STEP 1399 H=1399:00 +CPU= 18.880
  05:07:11 STEP 1400 H=1400:00 +CPU= 24.579
  05:07:40 STEP 1401 H=1401:00 +CPU= 29.013
  05:08:07 STEP 1402 H=1402:00 +CPU= 27.278
  05:08:31 STEP 1403 H=1403:00 +CPU= 23.884
  05:09:06 STEP 1404 H=1404:00 +CPU= 34.927
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001404
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001404
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001404
  05:09:28 STEP 1405 H=1405:00 +CPU= 22.089
  05:09:53 STEP 1406 H=1406:00 +CPU= 24.688
  05:10:24 STEP 1407 H=1407:00 +CPU= 30.789
  05:10:42 STEP 1408 H=1408:00 +CPU= 18.474
  05:11:01 STEP 1409 H=1409:00 +CPU= 18.849
  05:11:34 STEP 1410 H=1410:00 +CPU= 32.506
  05:11:53 STEP 1411 H=1411:00 +CPU= 19.369
  05:12:11 STEP 1412 H=1412:00 +CPU= 18.518
  05:12:42 STEP 1413 H=1413:00 +CPU= 30.104
  05:13:07 STEP 1414 H=1414:00 +CPU= 25.519
  05:13:26 STEP 1415 H=1415:00 +CPU= 18.980
  05:14:02 STEP 1416 H=1416:00 +CPU= 35.691
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001416
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001416
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001404
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0958_2021050100_123_945_12164047_1_r804386321_58.zip
Uploading the intermediate file: upload_file_58.zip
  05:14:20 STEP 1417 H=1417:00 +CPU= 17.791
  05:14:46 STEP 1418 H=1418:00 +CPU= 26.194
  05:15:17 STEP 1419 H=1419:00 +CPU= 31.409
  05:15:36 STEP 1420 H=1420:00 +CPU= 19.264
  05:15:55 STEP 1421 H=1421:00 +CPU= 18.365
  05:16:27 STEP 1422 H=1422:00 +CPU= 32.532
  05:16:48 STEP 1423 H=1423:00 +CPU= 20.643
  05:17:10 STEP 1424 H=1424:00 +CPU= 22.469
  05:17:51 STEP 1425 H=1425:00 +CPU= 40.701
  05:18:15 STEP 1426 H=1426:00 +CPU= 23.805
  05:18:35 STEP 1427 H=1427:00 +CPU= 20.444
  05:19:10 STEP 1428 H=1428:00 +CPU= 34.210
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001428
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001428
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001428
  05:19:32 STEP 1429 H=1429:00 +CPU= 22.317
  05:20:00 STEP 1430 H=1430:00 +CPU= 27.624
  05:20:36 STEP 1431 H=1431:00 +CPU= 36.275
  05:20:59 STEP 1432 H=1432:00 +CPU= 23.343
  05:21:17 STEP 1433 H=1433:00 +CPU= 17.942
  05:21:49 STEP 1434 H=1434:00 +CPU= 31.649
  05:22:08 STEP 1435 H=1435:00 +CPU= 18.731
  05:22:29 STEP 1436 H=1436:00 +CPU= 21.406
  05:23:02 STEP 1437 H=1437:00 +CPU= 33.294
  05:23:21 STEP 1438 H=1438:00 +CPU= 18.525
  05:23:44 STEP 1439 H=1439:00 +CPU= 23.007
  05:24:22 STEP 1440 H=1440:00 +CPU= 38.127
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001440
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001440
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001428
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0958_2021050100_123_945_12164047_1_r804386321_59.zip
Uploading the intermediate file: upload_file_59.zip
  05:24:46 STEP 1441 H=1441:00 +CPU= 23.894
Uploading trickle at timestep: 5184000
  05:25:06 STEP 1442 H=1442:00 +CPU= 20.272
  05:25:36 STEP 1443 H=1443:00 +CPU= 29.603
  05:25:55 STEP 1444 H=1444:00 +CPU= 18.905
  05:26:15 STEP 1445 H=1445:00 +CPU= 19.867
  05:26:45 STEP 1446 H=1446:00 +CPU= 30.436
  05:27:06 STEP 1447 H=1447:00 +CPU= 20.634
  05:27:26 STEP 1448 H=1448:00 +CPU= 20.484
  05:28:06 STEP 1449 H=1449:00 +CPU= 39.579
  05:28:31 STEP 1450 H=1450:00 +CPU= 25.370
  05:28:57 STEP 1451 H=1451:00 +CPU= 25.565
  05:29:33 STEP 1452 H=1452:00 +CPU= 36.651
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001452
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001452
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001452
  05:29:55 STEP 1453 H=1453:00 +CPU= 21.353
  05:30:16 STEP 1454 H=1454:00 +CPU= 21.484
  05:30:46 STEP 1455 H=1455:00 +CPU= 29.921
  05:31:06 STEP 1456 H=1456:00 +CPU= 20.164
  05:31:26 STEP 1457 H=1457:00 +CPU= 20.077
  05:32:00 STEP 1458 H=1458:00 +CPU= 33.883
  05:32:26 STEP 1459 H=1459:00 +CPU= 25.815
  05:32:50 STEP 1460 H=1460:00 +CPU= 24.010
  05:33:21 STEP 1461 H=1461:00 +CPU= 30.979
  05:33:41 STEP 1462 H=1462:00 +CPU= 19.453
  05:34:03 STEP 1463 H=1463:00 +CPU= 22.579
  05:34:41 STEP 1464 H=1464:00 +CPU= 38.127
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001464
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001464
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001452
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0958_2021050100_123_945_12164047_1_r804386321_60.zip
Uploading the intermediate file: upload_file_60.zip
  05:35:03 STEP 1465 H=1465:00 +CPU= 21.734
  05:35:26 STEP 1466 H=1466:00 +CPU= 22.488
  05:36:02 STEP 1467 H=1467:00 +CPU= 36.071
  05:36:22 STEP 1468 H=1468:00 +CPU= 20.128
  05:36:41 STEP 1469 H=1469:00 +CPU= 19.251
  05:37:14 STEP 1470 H=1470:00 +CPU= 32.877
  05:37:40 STEP 1471 H=1471:00 +CPU= 25.478
  05:38:03 STEP 1472 H=1472:00 +CPU= 23.497
  05:38:38 STEP 1473 H=1473:00 +CPU= 35.252
  05:39:01 STEP 1474 H=1474:00 +CPU= 22.463
  05:39:21 STEP 1475 H=1475:00 +CPU= 19.997
  05:39:53 STEP 1476 H=1476:00 +CPU= 32.704
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001476
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001476
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001476
  05:40:16 STEP 1477 H=1477:00 +CPU= 22.798
  05:40:44 STEP 1478 H=1478:00 +CPU= 27.422
  05:41:15 STEP 1479 H=1479:00 +CPU= 31.040
  05:41:33 STEP 1480 H=1480:00 +CPU= 18.537
  05:41:52 STEP 1481 H=1481:00 +CPU= 18.288
  05:42:22 STEP 1482 H=1482:00 +CPU= 30.421
  05:42:40 STEP 1483 H=1483:00 +CPU= 17.989
  05:43:02 STEP 1484 H=1484:00 +CPU= 22.279
  05:43:41 STEP 1485 H=1485:00 +CPU= 38.199
  05:44:01 STEP 1486 H=1486:00 +CPU= 20.206
  05:44:20 STEP 1487 H=1487:00 +CPU= 19.451
  05:44:57 STEP 1488 H=1488:00 +CPU= 36.709
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001488
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001488
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001476
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0958_2021050100_123_945_12164047_1_r804386321_61.zip
Uploading the intermediate file: upload_file_61.zip
  05:45:16 STEP 1489 H=1489:00 +CPU= 18.592
  05:45:35 STEP 1490 H=1490:00 +CPU= 19.126
  05:46:05 STEP 1491 H=1491:00 +CPU= 30.522
  05:46:25 STEP 1492 H=1492:00 +CPU= 20.182
  05:46:49 STEP 1493 H=1493:00 +CPU= 23.612
  05:47:22 STEP 1494 H=1494:00 +CPU= 33.452
  05:47:41 STEP 1495 H=1495:00 +CPU= 18.755
  05:48:01 STEP 1496 H=1496:00 +CPU= 20.143
  05:48:30 STEP 1497 H=1497:00 +CPU= 28.659
  05:48:49 STEP 1498 H=1498:00 +CPU= 18.616
  05:49:09 STEP 1499 H=1499:00 +CPU= 20.455
  05:49:43 STEP 1500 H=1500:00 +CPU= 33.373
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001500
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001500
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001500
  05:50:01 STEP 1501 H=1501:00 +CPU= 18.528
  05:50:23 STEP 1502 H=1502:00 +CPU= 22.122
  05:50:55 STEP 1503 H=1503:00 +CPU= 31.529
  05:51:14 STEP 1504 H=1504:00 +CPU= 19.657
  05:51:34 STEP 1505 H=1505:00 +CPU= 19.439
  05:52:03 STEP 1506 H=1506:00 +CPU= 29.135
  05:52:21 STEP 1507 H=1507:00 +CPU= 17.973
  05:52:42 STEP 1508 H=1508:00 +CPU= 21.601
  05:53:13 STEP 1509 H=1509:00 +CPU= 30.220
  05:53:33 STEP 1510 H=1510:00 +CPU= 20.449
  05:53:53 STEP 1511 H=1511:00 +CPU= 19.505
  05:54:33 STEP 1512 H=1512:00 +CPU= 40.673
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001512
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001512
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001500
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0958_2021050100_123_945_12164047_1_r804386321_62.zip
Uploading the intermediate file: upload_file_62.zip
  05:54:56 STEP 1513 H=1513:00 +CPU= 22.808
  05:55:18 STEP 1514 H=1514:00 +CPU= 22.049
  05:55:48 STEP 1515 H=1515:00 +CPU= 29.324
  05:56:07 STEP 1516 H=1516:00 +CPU= 19.234
  05:56:33 STEP 1517 H=1517:00 +CPU= 25.815
  05:57:08 STEP 1518 H=1518:00 +CPU= 35.395
  05:57:26 STEP 1519 H=1519:00 +CPU= 18.218
  05:57:45 STEP 1520 H=1520:00 +CPU= 18.532
  05:58:17 STEP 1521 H=1521:00 +CPU= 31.922
  05:58:38 STEP 1522 H=1522:00 +CPU= 20.888
  05:59:00 STEP 1523 H=1523:00 +CPU= 22.679
  05:59:45 STEP 1524 H=1524:00 +CPU= 44.504
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001524
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001524
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001524
  06:00:04 STEP 1525 H=1525:00 +CPU= 19.317
  06:00:25 STEP 1526 H=1526:00 +CPU= 21.030
  06:00:59 STEP 1527 H=1527:00 +CPU= 34.115
  06:01:18 STEP 1528 H=1528:00 +CPU= 19.150
  06:01:43 STEP 1529 H=1529:00 +CPU= 24.399
  06:02:19 STEP 1530 H=1530:00 +CPU= 36.359
  06:02:37 STEP 1531 H=1531:00 +CPU= 18.147
  06:02:58 STEP 1532 H=1532:00 +CPU= 20.855
  06:03:35 STEP 1533 H=1533:00 +CPU= 36.574
  06:03:56 STEP 1534 H=1534:00 +CPU= 21.631
  06:04:21 STEP 1535 H=1535:00 +CPU= 24.600
  06:04:55 STEP 1536 H=1536:00 +CPU= 34.280
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001536
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001536
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001524
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0958_2021050100_123_945_12164047_1_r804386321_63.zip
Uploading the intermediate file: upload_file_63.zip
  06:05:14 STEP 1537 H=1537:00 +CPU= 19.065
  06:05:38 STEP 1538 H=1538:00 +CPU= 23.222
  06:06:14 STEP 1539 H=1539:00 +CPU= 35.978
  06:06:35 STEP 1540 H=1540:00 +CPU= 20.883
  06:06:54 STEP 1541 H=1541:00 +CPU= 19.358
  06:07:25 STEP 1542 H=1542:00 +CPU= 30.616
  06:07:43 STEP 1543 H=1543:00 +CPU= 17.967
  06:08:03 STEP 1544 H=1544:00 +CPU= 20.561
  06:08:33 STEP 1545 H=1545:00 +CPU= 30.021
  06:08:52 STEP 1546 H=1546:00 +CPU= 19.341
  06:09:11 STEP 1547 H=1547:00 +CPU= 18.221
  06:09:42 STEP 1548 H=1548:00 +CPU= 31.506
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001548
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001548
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001548
  06:10:00 STEP 1549 H=1549:00 +CPU= 18.179
  06:10:19 STEP 1550 H=1550:00 +CPU= 19.046
  06:10:53 STEP 1551 H=1551:00 +CPU= 33.328
  06:11:16 STEP 1552 H=1552:00 +CPU= 23.643
  06:11:39 STEP 1553 H=1553:00 +CPU= 22.135
  06:12:20 STEP 1554 H=1554:00 +CPU= 41.798
  06:12:44 STEP 1555 H=1555:00 +CPU= 23.634
  06:13:06 STEP 1556 H=1556:00 +CPU= 21.963
  06:13:37 STEP 1557 H=1557:00 +CPU= 30.929
  06:13:56 STEP 1558 H=1558:00 +CPU= 19.291
  06:14:15 STEP 1559 H=1559:00 +CPU= 18.357
  06:14:48 STEP 1560 H=1560:00 +CPU= 33.848
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001560
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001560
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001548
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0958_2021050100_123_945_12164047_1_r804386321_64.zip
Uploading the intermediate file: upload_file_64.zip
  06:15:09 STEP 1561 H=1561:00 +CPU= 20.476
  06:15:33 STEP 1562 H=1562:00 +CPU= 24.385
  06:16:07 STEP 1563 H=1563:00 +CPU= 34.141
  06:16:28 STEP 1564 H=1564:00 +CPU= 20.724
  06:16:46 STEP 1565 H=1565:00 +CPU= 18.069
  06:17:22 STEP 1566 H=1566:00 +CPU= 35.447
  06:17:41 STEP 1567 H=1567:00 +CPU= 19.480
  06:18:03 STEP 1568 H=1568:00 +CPU= 21.760
  06:18:32 STEP 1569 H=1569:00 +CPU= 28.580
  06:18:54 STEP 1570 H=1570:00 +CPU= 22.658
  06:19:20 STEP 1571 H=1571:00 +CPU= 25.334
  06:19:56 STEP 1572 H=1572:00 +CPU= 36.524
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001572
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001572
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001572
  06:20:22 STEP 1573 H=1573:00 +CPU= 25.580
  06:20:48 STEP 1574 H=1574:00 +CPU= 26.545
  06:21:18 STEP 1575 H=1575:00 +CPU= 29.845
  06:21:37 STEP 1576 H=1576:00 +CPU= 18.823
  06:21:56 STEP 1577 H=1577:00 +CPU= 19.314
  06:22:35 STEP 1578 H=1578:00 +CPU= 38.622
  06:22:59 STEP 1579 H=1579:00 +CPU= 23.908
  06:23:18 STEP 1580 H=1580:00 +CPU= 18.672
  06:23:47 STEP 1581 H=1581:00 +CPU= 29.405
  06:24:07 STEP 1582 H=1582:00 +CPU= 20.182
  06:24:28 STEP 1583 H=1583:00 +CPU= 20.446
  06:25:15 STEP 1584 H=1584:00 +CPU= 47.413
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001584
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001584
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001572
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0958_2021050100_123_945_12164047_1_r804386321_65.zip
Uploading the intermediate file: upload_file_65.zip
  06:25:40 STEP 1585 H=1585:00 +CPU= 24.673
  06:26:06 STEP 1586 H=1586:00 +CPU= 25.849
  06:26:40 STEP 1587 H=1587:00 +CPU= 34.632
  06:27:03 STEP 1588 H=1588:00 +CPU= 23.176
  06:27:22 STEP 1589 H=1589:00 +CPU= 19.115
  06:27:53 STEP 1590 H=1590:00 +CPU= 30.595
  06:28:15 STEP 1591 H=1591:00 +CPU= 22.334
  06:28:37 STEP 1592 H=1592:00 +CPU= 21.606
  06:29:11 STEP 1593 H=1593:00 +CPU= 34.031
  06:29:36 STEP 1594 H=1594:00 +CPU= 24.715
  06:30:00 STEP 1595 H=1595:00 +CPU= 23.787
  06:30:32 STEP 1596 H=1596:00 +CPU= 32.766
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001596
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001596
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001596
  06:30:55 STEP 1597 H=1597:00 +CPU= 22.320
  06:31:14 STEP 1598 H=1598:00 +CPU= 19.000
  06:31:44 STEP 1599 H=1599:00 +CPU= 30.148
  06:32:03 STEP 1600 H=1600:00 +CPU= 19.050
  06:32:22 STEP 1601 H=1601:00 +CPU= 18.952
  06:32:52 STEP 1602 H=1602:00 +CPU= 30.097
  06:33:18 STEP 1603 H=1603:00 +CPU= 25.907
  06:33:42 STEP 1604 H=1604:00 +CPU= 23.889
  06:34:15 STEP 1605 H=1605:00 +CPU= 33.486
  06:34:34 STEP 1606 H=1606:00 +CPU= 18.682
  06:34:53 STEP 1607 H=1607:00 +CPU= 18.855
  06:35:28 STEP 1608 H=1608:00 +CPU= 34.770
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001608
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001608
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001596
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0958_2021050100_123_945_12164047_1_r804386321_66.zip
Uploading the intermediate file: upload_file_66.zip
  06:35:48 STEP 1609 H=1609:00 +CPU= 19.641
  06:36:10 STEP 1610 H=1610:00 +CPU= 21.796
  06:36:40 STEP 1611 H=1611:00 +CPU= 30.194
  06:37:00 STEP 1612 H=1612:00 +CPU= 20.542
  06:37:24 STEP 1613 H=1613:00 +CPU= 23.218
  06:38:03 STEP 1614 H=1614:00 +CPU= 39.223
  06:38:24 STEP 1615 H=1615:00 +CPU= 21.719
  06:38:49 STEP 1616 H=1616:00 +CPU= 24.028
  06:39:25 STEP 1617 H=1617:00 +CPU= 36.175
  06:39:52 STEP 1618 H=1618:00 +CPU= 27.019
  06:40:12 STEP 1619 H=1619:00 +CPU= 20.024
  06:40:56 STEP 1620 H=1620:00 +CPU= 43.704
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001620
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001620
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001620
  06:41:22 STEP 1621 H=1621:00 +CPU= 26.031
  06:41:43 STEP 1622 H=1622:00 +CPU= 21.875
  06:42:16 STEP 1623 H=1623:00 +CPU= 32.242
  06:42:35 STEP 1624 H=1624:00 +CPU= 19.219
  06:42:54 STEP 1625 H=1625:00 +CPU= 18.949
  06:43:24 STEP 1626 H=1626:00 +CPU= 30.190
  06:43:45 STEP 1627 H=1627:00 +CPU= 21.131
  06:44:04 STEP 1628 H=1628:00 +CPU= 19.272
  06:44:35 STEP 1629 H=1629:00 +CPU= 30.165
  06:44:56 STEP 1630 H=1630:00 +CPU= 21.439
  06:45:17 STEP 1631 H=1631:00 +CPU= 20.622
  06:45:52 STEP 1632 H=1632:00 +CPU= 34.956
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001632
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001632
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001620
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0958_2021050100_123_945_12164047_1_r804386321_67.zip
Uploading the intermediate file: upload_file_67.zip
  06:46:11 STEP 1633 H=1633:00 +CPU= 19.841
  06:46:31 STEP 1634 H=1634:00 +CPU= 19.240
  06:47:00 STEP 1635 H=1635:00 +CPU= 29.586
  06:47:19 STEP 1636 H=1636:00 +CPU= 18.850
  06:47:37 STEP 1637 H=1637:00 +CPU= 18.213
  06:48:12 STEP 1638 H=1638:00 +CPU= 35.103
  06:48:33 STEP 1639 H=1639:00 +CPU= 20.946
  06:48:56 STEP 1640 H=1640:00 +CPU= 22.863
  06:49:26 STEP 1641 H=1641:00 +CPU= 29.783
  06:49:45 STEP 1642 H=1642:00 +CPU= 18.668
  06:50:03 STEP 1643 H=1643:00 +CPU= 18.429
  06:50:39 STEP 1644 H=1644:00 +CPU= 36.023
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001644
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001644
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001644
  06:51:00 STEP 1645 H=1645:00 +CPU= 21.092
  06:51:28 STEP 1646 H=1646:00 +CPU= 27.709
  06:52:07 STEP 1647 H=1647:00 +CPU= 39.053
  06:52:26 STEP 1648 H=1648:00 +CPU= 19.032
  06:52:44 STEP 1649 H=1649:00 +CPU= 18.275
  06:53:18 STEP 1650 H=1650:00 +CPU= 33.498
  06:53:39 STEP 1651 H=1651:00 +CPU= 20.951
  06:53:58 STEP 1652 H=1652:00 +CPU= 19.163
  06:54:36 STEP 1653 H=1653:00 +CPU= 37.867
  06:55:01 STEP 1654 H=1654:00 +CPU= 25.107
  06:55:25 STEP 1655 H=1655:00 +CPU= 23.480
  06:56:13 STEP 1656 H=1656:00 +CPU= 48.074
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001656
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001656
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001644
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0958_2021050100_123_945_12164047_1_r804386321_68.zip
Uploading the intermediate file: upload_file_68.zip
  06:56:39 STEP 1657 H=1657:00 +CPU= 26.471
  06:57:00 STEP 1658 H=1658:00 +CPU= 20.632
  06:57:29 STEP 1659 H=1659:00 +CPU= 28.870
  06:57:47 STEP 1660 H=1660:00 +CPU= 18.785
  06:58:09 STEP 1661 H=1661:00 +CPU= 21.003
  06:58:38 STEP 1662 H=1662:00 +CPU= 29.506
  06:58:56 STEP 1663 H=1663:00 +CPU= 18.433
  06:59:16 STEP 1664 H=1664:00 +CPU= 19.542
  06:59:45 STEP 1665 H=1665:00 +CPU= 29.111
  07:00:06 STEP 1666 H=1666:00 +CPU= 21.059
  07:00:25 STEP 1667 H=1667:00 +CPU= 18.935
  07:01:01 STEP 1668 H=1668:00 +CPU= 35.472
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001668
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001668
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001668
  07:01:22 STEP 1669 H=1669:00 +CPU= 21.642
  07:01:41 STEP 1670 H=1670:00 +CPU= 19.005
  07:02:14 STEP 1671 H=1671:00 +CPU= 33.159
  07:02:35 STEP 1672 H=1672:00 +CPU= 21.021
  07:02:59 STEP 1673 H=1673:00 +CPU= 23.011
  07:03:30 STEP 1674 H=1674:00 +CPU= 31.205
  07:03:48 STEP 1675 H=1675:00 +CPU= 17.978
  07:04:07 STEP 1676 H=1676:00 +CPU= 19.278
  07:04:39 STEP 1677 H=1677:00 +CPU= 32.259
  07:05:03 STEP 1678 H=1678:00 +CPU= 23.574
  07:05:23 STEP 1679 H=1679:00 +CPU= 20.186
  07:06:01 STEP 1680 H=1680:00 +CPU= 36.691
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhpi1+001680
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhpi1+001680
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhpi1+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMGGhpi1+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMSHhpi1+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047/ICMUAhpi1+001668
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0958_2021050100_123_945_12164047_1_r804386321_69.zip
Uploading the intermediate file: upload_file_69.zip
  07:06:22 STEP 1681 H=1681:00 +CPU= 21.381
Uploading trickle at timestep: 6048000
  07:06:43 STEP 1682 H=1682:00 +CPU= 20.992
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.900] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 3992MB (heap), 4790MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.900] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.900] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.900] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.900] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.900] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 3992 MB (maxheap), 4790 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.900] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.900] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.900] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.900] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.900] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.900] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.900] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.900] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.900] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.900] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.900] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :            EC_PHYS_DRV 
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.900] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :             >OMP-PHYSICS CLDPP T/S    (1002) 
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.900] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :              EC_PHYS 
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.900] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :               CALLPAR 
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.901] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                CONVECTION_LAYER 
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.901] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                 CUCALLN 
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.901] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                  CUMASTRN 
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070711:1671109631:43204.901] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                   CUBASEN 
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070712:1671109632:43205.903] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:boinc-02.fullford.com:1:1:61676:61676] [20221215:070712:1671109632:43205.903] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CE916B  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000081FFF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC9090  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000010E61B6  cubasen_                  392  cubasen.F90
oifs_43r3_model.e  00000000010D0551  cumastrn_                 386  cumastrn.F90
oifs_43r3_model.e  00000000010C7792  cucalln_                  352  cucalln.F90
oifs_43r3_model.e  00000000010C4C15  convection_layer_         121  convection_layer.F90
oifs_43r3_model.e  0000000000F11F5B  callpar_                 1064  callpar.F90
oifs_43r3_model.e  0000000000E4940F  ec_phys_                  670  ec_phys.F90
oifs_43r3_model.e  0000000000E3610C  ec_phys_drv_              599  ec_phys_drv.F90
oifs_43r3_model.e  0000000000BFA3D3  gp_model_                 613  gp_model.F90
oifs_43r3_model.e  00000000012E9482  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BBC1CE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  000000000057A664  stepo_                    327  stepo.F90
oifs_43r3_model.e  000000000055DEEC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2021050100
(argv2) exptid: hpi1
(argv3) unique_member_id: 0958
(argv4) batchid: 945
(argv5) wuid: 12164047
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/6
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_644f6b40883db8a08fe35f6bdc95cedf to: /var/lib/boinc-client/slots/6/oifs_43r3_ps_0958_2021050100_123_945_12164047.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/6/oifs_43r3_ps_0958_2021050100_123_945_12164047.zip
ic_ancil_file: ic_ancil_12164047
ifsdata_file: ifsdata_12164047
climate_data_file: clim_data_12164047
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_6536e9571c94503e1d63b5bf9813f917 to: /var/lib/boinc-client/slots/6/ic_ancil_12164047.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/6/ic_ancil_12164047.zip
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2021050100
(argv2) exptid: hpi1
(argv3) unique_member_id: 0958
(argv4) batchid: 945
(argv5) wuid: 12164047
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/6
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164047
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_644f6b40883db8a08fe35f6bdc95cedf to: /var/lib/boinc-client/slots/6/oifs_43r3_ps_0958_2021050100_123_945_12164047.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/6/oifs_43r3_ps_0958_2021050100_123_945_12164047.zip
ic_ancil_file: ic_ancil_12164047
ifsdata_file: ifsdata_12164047
climate_data_file: clim_data_12164047
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: *^&#228;?&#238;&#143;&#202;EC&#164;hX&#233;&#240;"m&#187;&#180;K	1&#234;=r&#133;&#186;&#208;&#189;&#240;&#255;&#221;EB&#194;E&#203;&#132;&#135;&#245;&#253;O&#177;&#232;&#159;i&#254;&#252;&#249;F&#187;&#255;&#253;&#249;&#223;&#245;&#223;_.&#164;&#201;&#215;&#222;2&#129;83&#157;&#223;&#143;&#129;&#253;v}&#254;,&#208;&#254;x&#144;&#207;&#244;&#187;&#182;O&#237;
a&#197;g&#171;&#161;N&#251;&#131;&#207;1}};\5)^&#168;6 to: /var/lib/boinc-client/slots/6/ic_ancil_12164047.zip
..Copying the IC ancils to the working directory failed

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:43:11 1459508 22250596 oifs_43r3_ps_0958_2021050100_123_945_12164047_1 6,048,000 43,090 0.0071
09 May 2023 15:43:11 1459508 22250596 oifs_43r3_ps_0958_2021050100_123_945_12164047_1 6,048,000 43,090 0.0071
09 May 2023 15:43:10 1459508 22250596 oifs_43r3_ps_0958_2021050100_123_945_12164047_1 5,184,000 36,997 0.0071
09 May 2023 15:43:08 1459508 22250596 oifs_43r3_ps_0958_2021050100_123_945_12164047_1 4,320,000 30,907 0.0072
09 May 2023 15:43:07 1459508 22250596 oifs_43r3_ps_0958_2021050100_123_945_12164047_1 3,456,000 24,839 0.0072
09 May 2023 15:43:04 1459508 22250596 oifs_43r3_ps_0958_2021050100_123_945_12164047_1 2,592,000 18,696 0.0072
09 May 2023 15:43:03 1459508 22250596 oifs_43r3_ps_0958_2021050100_123_945_12164047_1 1,728,000 12,631 0.0073
09 May 2023 15:43:01 1459508 22250596 oifs_43r3_ps_0958_2021050100_123_945_12164047_1 864,000 6,469 0.0075


©2024 climateprediction.net