climateprediction.net home page
Task 22274628

Task 22274628

Name oifs_43r3_ps_0467_2003050100_123_972_12189111_0
Workunit 12189111
Created 23 Dec 2022, 5:25:54 UTC
Sent 25 Dec 2022, 16:14:35 UTC
Report deadline 24 Jan 2023, 16:14:35 UTC
Received 25 Jan 2023, 20:54:34 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1507869
Run time 1 days 7 hours 29 min 32 sec
CPU time 19 hours 45 min 46 sec
Validate state Invalid
Credit 7,015.68
Device peak FLOPS 3.97 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,408.53 MB
Peak swap size 4,978.14 MB
Peak disk usage 7,549.36 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
f+001176
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001152
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001152
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001152
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001164
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001164
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001164
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0467_2003050100_123_972_12189111_0_r1140672417_48.zip
Uploading the intermediate file: upload_file_48.zip
  05:15:38 STEP 1177 H=1177:00 +CPU= 31.139
  05:16:21 STEP 1178 H=1178:00 +CPU= 32.135
  05:17:25 STEP 1179 H=1179:00 +CPU= 50.454
  05:18:05 STEP 1180 H=1180:00 +CPU= 32.217
  05:18:44 STEP 1181 H=1181:00 +CPU= 31.537
  05:19:49 STEP 1182 H=1182:00 +CPU= 51.679
  05:20:28 STEP 1183 H=1183:00 +CPU= 31.527
  05:21:08 STEP 1184 H=1184:00 +CPU= 32.078
  05:22:12 STEP 1185 H=1185:00 +CPU= 50.913
  05:22:54 STEP 1186 H=1186:00 +CPU= 32.608
  05:23:32 STEP 1187 H=1187:00 +CPU= 31.080
  05:24:43 STEP 1188 H=1188:00 +CPU= 56.336
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001188
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001188
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001188
  05:25:23 STEP 1189 H=1189:00 +CPU= 31.411
  05:26:04 STEP 1190 H=1190:00 +CPU= 32.365
  05:27:07 STEP 1191 H=1191:00 +CPU= 50.401
  05:27:48 STEP 1192 H=1192:00 +CPU= 32.497
  05:28:28 STEP 1193 H=1193:00 +CPU= 31.415
  05:29:34 STEP 1194 H=1194:00 +CPU= 52.180
  05:30:13 STEP 1195 H=1195:00 +CPU= 31.554
  05:30:53 STEP 1196 H=1196:00 +CPU= 32.110
  05:31:58 STEP 1197 H=1197:00 +CPU= 50.767
  05:32:39 STEP 1198 H=1198:00 +CPU= 32.088
  05:33:20 STEP 1199 H=1199:00 +CPU= 32.429
  05:34:43 STEP 1200 H=1200:00 +CPU= 59.325
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001200
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001200
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001200
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001176
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001176
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001176
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001188
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001188
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001188
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0467_2003050100_123_972_12189111_0_r1140672417_49.zip
Uploading the intermediate file: upload_file_49.zip
  05:35:23 STEP 1201 H=1201:00 +CPU= 31.225
  05:36:05 STEP 1202 H=1202:00 +CPU= 32.307
  05:37:09 STEP 1203 H=1203:00 +CPU= 50.786
  05:37:50 STEP 1204 H=1204:00 +CPU= 32.590
  05:38:29 STEP 1205 H=1205:00 +CPU= 31.364
  05:39:34 STEP 1206 H=1206:00 +CPU= 51.486
  05:40:14 STEP 1207 H=1207:00 +CPU= 31.719
  05:40:53 STEP 1208 H=1208:00 +CPU= 32.258
  05:41:58 STEP 1209 H=1209:00 +CPU= 50.896
  05:42:39 STEP 1210 H=1210:00 +CPU= 32.413
  05:43:20 STEP 1211 H=1211:00 +CPU= 31.800
  05:44:31 STEP 1212 H=1212:00 +CPU= 56.232
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001212
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001212
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001212
  05:45:11 STEP 1213 H=1213:00 +CPU= 31.776
  05:45:53 STEP 1214 H=1214:00 +CPU= 32.492
  05:46:57 STEP 1215 H=1215:00 +CPU= 50.381
  05:47:38 STEP 1216 H=1216:00 +CPU= 32.640
  05:48:17 STEP 1217 H=1217:00 +CPU= 31.328
  05:49:20 STEP 1218 H=1218:00 +CPU= 51.608
  05:49:58 STEP 1219 H=1219:00 +CPU= 31.958
  05:50:37 STEP 1220 H=1220:00 +CPU= 32.497
  05:51:39 STEP 1221 H=1221:00 +CPU= 50.922
  05:52:19 STEP 1222 H=1222:00 +CPU= 32.199
  05:53:00 STEP 1223 H=1223:00 +CPU= 32.700
  05:54:21 STEP 1224 H=1224:00 +CPU= 59.496
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001224
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001224
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001224
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001200
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001200
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001200
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001212
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001212
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001212
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0467_2003050100_123_972_12189111_0_r1140672417_50.zip
Uploading the intermediate file: upload_file_50.zip
  05:54:59 STEP 1225 H=1225:00 +CPU= 31.068
  05:55:39 STEP 1226 H=1226:00 +CPU= 32.713
  05:56:41 STEP 1227 H=1227:00 +CPU= 50.758
  05:57:21 STEP 1228 H=1228:00 +CPU= 32.837
  05:57:59 STEP 1229 H=1229:00 +CPU= 31.579
  05:59:02 STEP 1230 H=1230:00 +CPU= 51.856
  05:59:40 STEP 1231 H=1231:00 +CPU= 31.995
  06:00:20 STEP 1232 H=1232:00 +CPU= 32.700
  06:01:21 STEP 1233 H=1233:00 +CPU= 50.564
  06:02:02 STEP 1234 H=1234:00 +CPU= 32.708
  06:02:42 STEP 1235 H=1235:00 +CPU= 32.250
  06:03:51 STEP 1236 H=1236:00 +CPU= 56.084
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001236
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001236
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001236
  06:04:30 STEP 1237 H=1237:00 +CPU= 31.717
  06:05:09 STEP 1238 H=1238:00 +CPU= 32.715
  06:06:10 STEP 1239 H=1239:00 +CPU= 50.602
  06:06:50 STEP 1240 H=1240:00 +CPU= 32.729
  06:07:28 STEP 1241 H=1241:00 +CPU= 31.681
  06:08:30 STEP 1242 H=1242:00 +CPU= 51.579
  06:09:09 STEP 1243 H=1243:00 +CPU= 31.886
  06:09:48 STEP 1244 H=1244:00 +CPU= 32.718
  06:10:49 STEP 1245 H=1245:00 +CPU= 50.727
  06:11:29 STEP 1246 H=1246:00 +CPU= 32.348
  06:12:09 STEP 1247 H=1247:00 +CPU= 32.574
  06:13:34 STEP 1248 H=1248:00 +CPU= 59.792
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001248
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001248
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001248
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001224
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001224
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001224
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001236
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001236
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001236
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0467_2003050100_123_972_12189111_0_r1140672417_51.zip
Uploading the intermediate file: upload_file_51.zip
  06:14:13 STEP 1249 H=1249:00 +CPU= 31.623
  06:14:52 STEP 1250 H=1250:00 +CPU= 32.241
  06:15:55 STEP 1251 H=1251:00 +CPU= 50.432
  06:16:35 STEP 1252 H=1252:00 +CPU= 32.864
  06:17:15 STEP 1253 H=1253:00 +CPU= 31.577
  06:18:18 STEP 1254 H=1254:00 +CPU= 51.553
  06:18:56 STEP 1255 H=1255:00 +CPU= 31.854
  06:19:35 STEP 1256 H=1256:00 +CPU= 32.555
  06:20:36 STEP 1257 H=1257:00 +CPU= 50.535
  06:21:15 STEP 1258 H=1258:00 +CPU= 32.516
  06:21:53 STEP 1259 H=1259:00 +CPU= 31.514
  06:23:01 STEP 1260 H=1260:00 +CPU= 55.880
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001260
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001260
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001260
  06:23:39 STEP 1261 H=1261:00 +CPU= 31.928
  06:24:18 STEP 1262 H=1262:00 +CPU= 32.277
  06:25:19 STEP 1263 H=1263:00 +CPU= 50.422
  06:25:59 STEP 1264 H=1264:00 +CPU= 32.733
  06:26:36 STEP 1265 H=1265:00 +CPU= 31.189
  06:27:39 STEP 1266 H=1266:00 +CPU= 51.359
  06:28:19 STEP 1267 H=1267:00 +CPU= 32.004
  06:28:58 STEP 1268 H=1268:00 +CPU= 32.288
  06:29:59 STEP 1269 H=1269:00 +CPU= 50.547
  06:30:39 STEP 1270 H=1270:00 +CPU= 32.424
  06:31:18 STEP 1271 H=1271:00 +CPU= 32.235
  06:32:41 STEP 1272 H=1272:00 +CPU= 59.468
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001272
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001272
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001272
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001248
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001248
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001248
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001260
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001260
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001260
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0467_2003050100_123_972_12189111_0_r1140672417_52.zip
Uploading the intermediate file: upload_file_52.zip
  06:33:23 STEP 1273 H=1273:00 +CPU= 31.308
  06:34:03 STEP 1274 H=1274:00 +CPU= 32.558
  06:35:05 STEP 1275 H=1275:00 +CPU= 50.653
  06:35:45 STEP 1276 H=1276:00 +CPU= 32.959
  06:36:24 STEP 1277 H=1277:00 +CPU= 31.946
  06:37:26 STEP 1278 H=1278:00 +CPU= 51.459
  06:38:06 STEP 1279 H=1279:00 +CPU= 32.022
  06:38:48 STEP 1280 H=1280:00 +CPU= 32.807
  06:39:49 STEP 1281 H=1281:00 +CPU= 50.437
  06:40:28 STEP 1282 H=1282:00 +CPU= 32.899
  06:41:07 STEP 1283 H=1283:00 +CPU= 31.844
  06:42:15 STEP 1284 H=1284:00 +CPU= 55.819
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001284
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001284
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001284
  06:42:55 STEP 1285 H=1285:00 +CPU= 32.218
  06:43:36 STEP 1286 H=1286:00 +CPU= 33.012
  06:44:38 STEP 1287 H=1287:00 +CPU= 50.585
  06:45:17 STEP 1288 H=1288:00 +CPU= 32.714
  06:45:57 STEP 1289 H=1289:00 +CPU= 32.240
  06:47:02 STEP 1290 H=1290:00 +CPU= 51.730
  06:47:42 STEP 1291 H=1291:00 +CPU= 32.392
  06:48:22 STEP 1292 H=1292:00 +CPU= 32.858
  06:49:24 STEP 1293 H=1293:00 +CPU= 50.569
  06:50:04 STEP 1294 H=1294:00 +CPU= 32.831
  06:50:44 STEP 1295 H=1295:00 +CPU= 32.358
  06:52:06 STEP 1296 H=1296:00 +CPU= 59.418
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001296
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001296
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001296
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001272
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001272
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001272
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001284
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001284
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001284
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0467_2003050100_123_972_12189111_0_r1140672417_53.zip
Uploading the intermediate file: upload_file_53.zip
  06:52:46 STEP 1297 H=1297:00 +CPU= 31.782
  06:53:26 STEP 1298 H=1298:00 +CPU= 32.465
  06:54:27 STEP 1299 H=1299:00 +CPU= 50.330
  06:55:07 STEP 1300 H=1300:00 +CPU= 33.103
  06:55:45 STEP 1301 H=1301:00 +CPU= 31.696
  06:56:47 STEP 1302 H=1302:00 +CPU= 51.695
  06:57:27 STEP 1303 H=1303:00 +CPU= 32.129
  06:58:07 STEP 1304 H=1304:00 +CPU= 32.687
  06:59:06 STEP 1305 H=1305:00 +CPU= 50.741
  06:59:43 STEP 1306 H=1306:00 +CPU= 32.980
  07:00:18 STEP 1307 H=1307:00 +CPU= 31.503
  07:01:21 STEP 1308 H=1308:00 +CPU= 55.888
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001308
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001308
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001308
  07:01:57 STEP 1309 H=1309:00 +CPU= 32.240
  07:02:34 STEP 1310 H=1310:00 +CPU= 32.539
  07:03:31 STEP 1311 H=1311:00 +CPU= 50.191
  07:04:08 STEP 1312 H=1312:00 +CPU= 32.965
  07:04:43 STEP 1313 H=1313:00 +CPU= 31.591
  07:05:40 STEP 1314 H=1314:00 +CPU= 51.292
  07:06:16 STEP 1315 H=1315:00 +CPU= 31.956
  07:06:52 STEP 1316 H=1316:00 +CPU= 32.465
  07:07:48 STEP 1317 H=1317:00 +CPU= 50.250
  07:08:26 STEP 1318 H=1318:00 +CPU= 32.935
  07:09:03 STEP 1319 H=1319:00 +CPU= 32.248
  07:10:24 STEP 1320 H=1320:00 +CPU= 59.590
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001320
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001320
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001320
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001296
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001296
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001296
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001308
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001308
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001308
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0467_2003050100_123_972_12189111_0_r1140672417_54.zip
Uploading the intermediate file: upload_file_54.zip
  07:11:01 STEP 1321 H=1321:00 +CPU= 32.102
  07:11:38 STEP 1322 H=1322:00 +CPU= 32.384
  07:12:35 STEP 1323 H=1323:00 +CPU= 50.530
  07:13:12 STEP 1324 H=1324:00 +CPU= 33.135
  07:13:47 STEP 1325 H=1325:00 +CPU= 31.466
  07:14:44 STEP 1326 H=1326:00 +CPU= 51.496
  07:15:20 STEP 1327 H=1327:00 +CPU= 32.403
  07:15:57 STEP 1328 H=1328:00 +CPU= 32.520
  07:16:56 STEP 1329 H=1329:00 +CPU= 50.804
  07:17:34 STEP 1330 H=1330:00 +CPU= 33.379
  07:18:10 STEP 1331 H=1331:00 +CPU= 31.687
  07:19:13 STEP 1332 H=1332:00 +CPU= 55.652
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001332
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001332
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001332
  07:19:50 STEP 1333 H=1333:00 +CPU= 32.579
  07:20:27 STEP 1334 H=1334:00 +CPU= 32.321
  07:21:23 STEP 1335 H=1335:00 +CPU= 50.498
  07:22:01 STEP 1336 H=1336:00 +CPU= 33.300
  07:22:37 STEP 1337 H=1337:00 +CPU= 31.593
  07:23:35 STEP 1338 H=1338:00 +CPU= 51.392
  07:24:11 STEP 1339 H=1339:00 +CPU= 32.446
  07:24:48 STEP 1340 H=1340:00 +CPU= 32.409
  07:25:44 STEP 1341 H=1341:00 +CPU= 50.350
  07:26:22 STEP 1342 H=1342:00 +CPU= 33.181
  07:27:00 STEP 1343 H=1343:00 +CPU= 32.193
  07:28:18 STEP 1344 H=1344:00 +CPU= 59.408
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001344
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001344
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001344
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001320
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001320
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001320
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001332
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001332
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001332
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0467_2003050100_123_972_12189111_0_r1140672417_55.zip
Uploading the intermediate file: upload_file_55.zip
  07:28:56 STEP 1345 H=1345:00 +CPU= 32.179
  07:29:33 STEP 1346 H=1346:00 +CPU= 32.405
  07:30:29 STEP 1347 H=1347:00 +CPU= 50.096
  07:31:07 STEP 1348 H=1348:00 +CPU= 33.158
  07:31:43 STEP 1349 H=1349:00 +CPU= 31.749
  07:32:42 STEP 1350 H=1350:00 +CPU= 51.158
  07:33:18 STEP 1351 H=1351:00 +CPU= 32.167
  07:33:55 STEP 1352 H=1352:00 +CPU= 32.637
  07:34:52 STEP 1353 H=1353:00 +CPU= 50.097
  07:35:30 STEP 1354 H=1354:00 +CPU= 33.310
  07:36:06 STEP 1355 H=1355:00 +CPU= 31.840
  07:37:09 STEP 1356 H=1356:00 +CPU= 55.794
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001356
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001356
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001356
  07:37:46 STEP 1357 H=1357:00 +CPU= 32.406
  07:38:24 STEP 1358 H=1358:00 +CPU= 32.997
  07:39:22 STEP 1359 H=1359:00 +CPU= 50.245
  07:40:01 STEP 1360 H=1360:00 +CPU= 33.267
  07:40:38 STEP 1361 H=1361:00 +CPU= 31.855
  07:41:37 STEP 1362 H=1362:00 +CPU= 51.260
  07:42:14 STEP 1363 H=1363:00 +CPU= 32.165
  07:42:51 STEP 1364 H=1364:00 +CPU= 32.720
  07:43:48 STEP 1365 H=1365:00 +CPU= 50.153
  07:44:26 STEP 1366 H=1366:00 +CPU= 33.302
  07:45:05 STEP 1367 H=1367:00 +CPU= 32.692
  07:46:25 STEP 1368 H=1368:00 +CPU= 59.843
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001368
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001368
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001368
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001344
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001344
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001344
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001356
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001356
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001356
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0467_2003050100_123_972_12189111_0_r1140672417_56.zip
Uploading the intermediate file: upload_file_56.zip
  07:47:06 STEP 1369 H=1369:00 +CPU= 31.905
  07:47:44 STEP 1370 H=1370:00 +CPU= 32.826
  07:48:41 STEP 1371 H=1371:00 +CPU= 50.010
  07:49:19 STEP 1372 H=1372:00 +CPU= 33.077
  07:49:54 STEP 1373 H=1373:00 +CPU= 31.723
  07:50:53 STEP 1374 H=1374:00 +CPU= 51.287
  07:51:32 STEP 1375 H=1375:00 +CPU= 32.189
  07:52:08 STEP 1376 H=1376:00 +CPU= 32.622
  07:53:08 STEP 1377 H=1377:00 +CPU= 50.271
  07:53:46 STEP 1378 H=1378:00 +CPU= 33.182
  07:54:22 STEP 1379 H=1379:00 +CPU= 31.885
  07:55:25 STEP 1380 H=1380:00 +CPU= 55.375
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001380
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001380
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001380
  07:56:02 STEP 1381 H=1381:00 +CPU= 32.450
  07:56:39 STEP 1382 H=1382:00 +CPU= 32.690
  07:57:40 STEP 1383 H=1383:00 +CPU= 50.511
  07:58:20 STEP 1384 H=1384:00 +CPU= 33.266
  07:58:56 STEP 1385 H=1385:00 +CPU= 31.437
  07:59:54 STEP 1386 H=1386:00 +CPU= 51.191
  08:00:31 STEP 1387 H=1387:00 +CPU= 32.129
  08:01:10 STEP 1388 H=1388:00 +CPU= 33.036
  08:02:09 STEP 1389 H=1389:00 +CPU= 50.199
  08:02:51 STEP 1390 H=1390:00 +CPU= 33.659
  08:03:31 STEP 1391 H=1391:00 +CPU= 32.690
  08:04:54 STEP 1392 H=1392:00 +CPU= 59.077
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001392
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001392
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001392
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001368
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001368
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001368
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001380
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001380
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001380
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0467_2003050100_123_972_12189111_0_r1140672417_57.zip
Uploading the intermediate file: upload_file_57.zip
Uploading trickle at timestep: 5011200
  08:05:32 STEP 1393 H=1393:00 +CPU= 31.484
  08:06:10 STEP 1394 H=1394:00 +CPU= 32.764
  08:07:09 STEP 1395 H=1395:00 +CPU= 50.521
  08:07:48 STEP 1396 H=1396:00 +CPU= 33.306
  08:08:25 STEP 1397 H=1397:00 +CPU= 31.949
  08:09:35 STEP 1398 H=1398:00 +CPU= 51.433
  08:10:16 STEP 1399 H=1399:00 +CPU= 32.429
  08:10:57 STEP 1400 H=1400:00 +CPU= 32.934
  08:11:58 STEP 1401 H=1401:00 +CPU= 50.528
  08:12:38 STEP 1402 H=1402:00 +CPU= 33.239
  08:13:17 STEP 1403 H=1403:00 +CPU= 32.249
  08:14:30 STEP 1404 H=1404:00 +CPU= 56.368
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001404
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001404
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001404
  08:15:13 STEP 1405 H=1405:00 +CPU= 32.033
  08:15:50 STEP 1406 H=1406:00 +CPU= 32.747
  08:16:49 STEP 1407 H=1407:00 +CPU= 50.263
  08:17:27 STEP 1408 H=1408:00 +CPU= 33.097
  08:18:04 STEP 1409 H=1409:00 +CPU= 31.898
  08:19:03 STEP 1410 H=1410:00 +CPU= 51.121
  08:19:39 STEP 1411 H=1411:00 +CPU= 32.207
  08:20:16 STEP 1412 H=1412:00 +CPU= 32.702
  08:21:12 STEP 1413 H=1413:00 +CPU= 49.967
  08:21:50 STEP 1414 H=1414:00 +CPU= 32.976
  08:22:28 STEP 1415 H=1415:00 +CPU= 32.623
  08:23:47 STEP 1416 H=1416:00 +CPU= 59.595
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001416
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001416
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001416
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001392
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001392
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001392
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001404
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001404
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001404
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0467_2003050100_123_972_12189111_0_r1140672417_58.zip
Uploading the intermediate file: upload_file_58.zip
  08:24:25 STEP 1417 H=1417:00 +CPU= 31.569
  08:25:05 STEP 1418 H=1418:00 +CPU= 33.080
  08:26:07 STEP 1419 H=1419:00 +CPU= 50.276
  08:26:45 STEP 1420 H=1420:00 +CPU= 33.139
  08:27:23 STEP 1421 H=1421:00 +CPU= 31.839
  08:28:22 STEP 1422 H=1422:00 +CPU= 51.035
  08:28:58 STEP 1423 H=1423:00 +CPU= 32.221
  08:29:36 STEP 1424 H=1424:00 +CPU= 33.025
  08:30:33 STEP 1425 H=1425:00 +CPU= 50.073
  08:31:12 STEP 1426 H=1426:00 +CPU= 33.277
  08:31:49 STEP 1427 H=1427:00 +CPU= 31.856
  08:32:54 STEP 1428 H=1428:00 +CPU= 55.483
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001428
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001428
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001428
  08:33:32 STEP 1429 H=1429:00 +CPU= 32.494
  08:34:10 STEP 1430 H=1430:00 +CPU= 32.708
  08:35:15 STEP 1431 H=1431:00 +CPU= 49.961
  08:36:07 STEP 1432 H=1432:00 +CPU= 33.178
  08:37:00 STEP 1433 H=1433:00 +CPU= 31.691
  08:38:31 STEP 1434 H=1434:00 +CPU= 53.203
  08:39:33 STEP 1435 H=1435:00 +CPU= 36.047
  08:40:33 STEP 1436 H=1436:00 +CPU= 37.272
  08:41:53 STEP 1437 H=1437:00 +CPU= 52.717
  08:42:43 STEP 1438 H=1438:00 +CPU= 32.407
  08:43:37 STEP 1439 H=1439:00 +CPU= 33.782
  08:45:32 STEP 1440 H=1440:00 +CPU= 66.416
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001440
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001440
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001440
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001416
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001416
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001416
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001428
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001428
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001428
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0467_2003050100_123_972_12189111_0_r1140672417_59.zip
Uploading the intermediate file: upload_file_59.zip
  08:46:34 STEP 1441 H=1441:00 +CPU= 35.999
  08:47:25 STEP 1442 H=1442:00 +CPU= 32.853
  08:48:50 STEP 1443 H=1443:00 +CPU= 50.297
  08:49:55 STEP 1444 H=1444:00 +CPU= 35.701
  08:51:00 STEP 1445 H=1445:00 +CPU= 35.551
  08:52:39 STEP 1446 H=1446:00 +CPU= 56.406
  08:53:28 STEP 1447 H=1447:00 +CPU= 31.810
  08:54:20 STEP 1448 H=1448:00 +CPU= 32.642
  08:55:49 STEP 1449 H=1449:00 +CPU= 55.123
  08:56:57 STEP 1450 H=1450:00 +CPU= 37.526
  08:58:01 STEP 1451 H=1451:00 +CPU= 35.684
  08:59:26 STEP 1452 H=1452:00 +CPU= 55.041
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001452
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001452
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001452
  09:00:19 STEP 1453 H=1453:00 +CPU= 33.186
  09:01:25 STEP 1454 H=1454:00 +CPU= 36.936
  09:03:07 STEP 1455 H=1455:00 +CPU= 56.234
  09:03:59 STEP 1456 H=1456:00 +CPU= 35.934
  09:04:37 STEP 1457 H=1457:00 +CPU= 32.115
  09:05:58 STEP 1458 H=1458:00 +CPU= 52.058
  09:06:57 STEP 1459 H=1459:00 +CPU= 32.423
  09:07:55 STEP 1460 H=1460:00 +CPU= 34.477
  09:09:30 STEP 1461 H=1461:00 +CPU= 56.490
  09:10:33 STEP 1462 H=1462:00 +CPU= 37.486
  09:11:34 STEP 1463 H=1463:00 +CPU= 35.647
  09:13:20 STEP 1464 H=1464:00 +CPU= 59.386
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001464
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001464
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001464
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001440
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001440
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001440
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001452
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001452
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001452
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0467_2003050100_123_972_12189111_0_r1140672417_60.zip
Uploading the intermediate file: upload_file_60.zip
  09:14:16 STEP 1465 H=1465:00 +CPU= 34.640
  09:15:19 STEP 1466 H=1466:00 +CPU= 36.890
  09:17:00 STEP 1467 H=1467:00 +CPU= 55.735
  09:18:04 STEP 1468 H=1468:00 +CPU= 34.552
  09:19:01 STEP 1469 H=1469:00 +CPU= 31.798
  09:20:30 STEP 1470 H=1470:00 +CPU= 52.544
  09:21:36 STEP 1471 H=1471:00 +CPU= 35.651
  09:22:38 STEP 1472 H=1472:00 +CPU= 36.981
  09:24:09 STEP 1473 H=1473:00 +CPU= 54.536
  09:24:59 STEP 1474 H=1474:00 +CPU= 32.670
  09:25:50 STEP 1475 H=1475:00 +CPU= 32.097
  09:27:33 STEP 1476 H=1476:00 +CPU= 61.774
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001476
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001476
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001476
  09:28:36 STEP 1477 H=1477:00 +CPU= 36.364
  09:29:36 STEP 1478 H=1478:00 +CPU= 35.812
  09:30:57 STEP 1479 H=1479:00 +CPU= 50.624
  09:31:53 STEP 1480 H=1480:00 +CPU= 34.145
  09:32:55 STEP 1481 H=1481:00 +CPU= 35.323
  09:34:30 STEP 1482 H=1482:00 +CPU= 57.344
  09:35:25 STEP 1483 H=1483:00 +CPU= 35.062
  09:36:08 STEP 1484 H=1484:00 +CPU= 33.017
  09:37:28 STEP 1485 H=1485:00 +CPU= 50.263
  09:38:31 STEP 1486 H=1486:00 +CPU= 32.813
  09:39:24 STEP 1487 H=1487:00 +CPU= 34.053
  09:41:19 STEP 1488 H=1488:00 +CPU= 66.685
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001488
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001488
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001488
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001464
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001464
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001464
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001476
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001476
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001476
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0467_2003050100_123_972_12189111_0_r1140672417_61.zip
Uploading the intermediate file: upload_file_61.zip
  09:42:22 STEP 1489 H=1489:00 +CPU= 36.229
  09:43:14 STEP 1490 H=1490:00 +CPU= 32.531
  09:44:34 STEP 1491 H=1491:00 +CPU= 50.004
  09:45:33 STEP 1492 H=1492:00 +CPU= 36.013
  09:46:32 STEP 1493 H=1493:00 +CPU= 35.893
  09:48:04 STEP 1494 H=1494:00 +CPU= 56.688
  09:48:56 STEP 1495 H=1495:00 +CPU= 32.068
  09:49:53 STEP 1496 H=1496:00 +CPU= 32.578
  09:51:21 STEP 1497 H=1497:00 +CPU= 54.643
  09:52:23 STEP 1498 H=1498:00 +CPU= 37.808
  09:53:24 STEP 1499 H=1499:00 +CPU= 36.542
  09:54:49 STEP 1500 H=1500:00 +CPU= 55.627
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001500
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001500
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001500
  09:55:43 STEP 1501 H=1501:00 +CPU= 33.145
  09:56:41 STEP 1502 H=1502:00 +CPU= 36.709
  09:58:12 STEP 1503 H=1503:00 +CPU= 56.791
  09:59:14 STEP 1504 H=1504:00 +CPU= 35.869
  10:00:08 STEP 1505 H=1505:00 +CPU= 31.906
  10:01:34 STEP 1506 H=1506:00 +CPU= 52.614
  10:02:34 STEP 1507 H=1507:00 +CPU= 36.038
  10:03:38 STEP 1508 H=1508:00 +CPU= 37.071
  10:04:57 STEP 1509 H=1509:00 +CPU= 53.877
  10:05:38 STEP 1510 H=1510:00 +CPU= 32.986
  10:06:25 STEP 1511 H=1511:00 +CPU= 33.156
  10:08:01 STEP 1512 H=1512:00 +CPU= 58.808
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001512
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001512
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001512
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001488
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001488
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001488
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001500
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001500
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001500
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0467_2003050100_123_972_12189111_0_r1140672417_62.zip
Uploading the intermediate file: upload_file_62.zip
  10:08:57 STEP 1513 H=1513:00 +CPU= 35.403
  10:09:55 STEP 1514 H=1514:00 +CPU= 37.241
  10:11:21 STEP 1515 H=1515:00 +CPU= 55.575
  10:12:13 STEP 1516 H=1516:00 +CPU= 32.873
  10:13:01 STEP 1517 H=1517:00 +CPU= 31.645
  10:14:28 STEP 1518 H=1518:00 +CPU= 55.235
  10:15:31 STEP 1519 H=1519:00 +CPU= 36.236
  10:16:37 STEP 1520 H=1520:00 +CPU= 37.377
  10:18:01 STEP 1521 H=1521:00 +CPU= 51.277
  10:18:54 STEP 1522 H=1522:00 +CPU= 32.917
  10:19:50 STEP 1523 H=1523:00 +CPU= 35.732
  10:21:30 STEP 1524 H=1524:00 +CPU= 63.118
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001524
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001524
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001524
  10:22:27 STEP 1525 H=1525:00 +CPU= 35.474
  10:23:15 STEP 1526 H=1526:00 +CPU= 32.681
  10:24:34 STEP 1527 H=1527:00 +CPU= 51.279
  10:25:33 STEP 1528 H=1528:00 +CPU= 37.087
  10:26:32 STEP 1529 H=1529:00 +CPU= 37.617
  10:27:58 STEP 1530 H=1530:00 +CPU= 54.882
  10:28:44 STEP 1531 H=1531:00 +CPU= 31.666
  10:29:36 STEP 1532 H=1532:00 +CPU= 33.412
  10:31:11 STEP 1533 H=1533:00 +CPU= 55.695
  10:32:19 STEP 1534 H=1534:00 +CPU= 37.765
  10:33:23 STEP 1535 H=1535:00 +CPU= 35.592
  10:35:18 STEP 1536 H=1536:00 +CPU= 59.738
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001536
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001536
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001536
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001512
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001512
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001512
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001524
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001524
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001524
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0467_2003050100_123_972_12189111_0_r1140672417_63.zip
Uploading the intermediate file: upload_file_63.zip
  10:36:09 STEP 1537 H=1537:00 +CPU= 31.801
  10:37:03 STEP 1538 H=1538:00 +CPU= 32.879
  10:38:42 STEP 1539 H=1539:00 +CPU= 56.111
  10:39:46 STEP 1540 H=1540:00 +CPU= 36.707
  10:40:43 STEP 1541 H=1541:00 +CPU= 35.482
  10:42:03 STEP 1542 H=1542:00 +CPU= 50.961
  10:42:57 STEP 1543 H=1543:00 +CPU= 33.259
  10:43:57 STEP 1544 H=1544:00 +CPU= 36.138
  10:45:36 STEP 1545 H=1545:00 +CPU= 57.121
  10:46:37 STEP 1546 H=1546:00 +CPU= 35.569
  10:47:28 STEP 1547 H=1547:00 +CPU= 31.752
  10:49:03 STEP 1548 H=1548:00 +CPU= 58.241
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001548
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001548
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001548
  10:50:02 STEP 1549 H=1549:00 +CPU= 35.956
  10:51:05 STEP 1550 H=1550:00 +CPU= 37.515
  10:52:28 STEP 1551 H=1551:00 +CPU= 52.398
  10:53:20 STEP 1552 H=1552:00 +CPU= 32.601
  10:54:11 STEP 1553 H=1553:00 +CPU= 32.646
  10:55:44 STEP 1554 H=1554:00 +CPU= 57.184
  10:56:44 STEP 1555 H=1555:00 +CPU= 36.811
  10:57:41 STEP 1556 H=1556:00 +CPU= 35.290
  10:59:03 STEP 1557 H=1557:00 +CPU= 49.969
  10:59:59 STEP 1558 H=1558:00 +CPU= 35.204
  11:01:00 STEP 1559 H=1559:00 +CPU= 37.068
  11:03:01 STEP 1560 H=1560:00 +CPU= 66.247
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001560
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001560
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001560
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001536
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001536
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001536
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001548
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001548
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001548
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0467_2003050100_123_972_12189111_0_r1140672417_64.zip
Uploading the intermediate file: upload_file_64.zip
  11:03:41 STEP 1561 H=1561:00 +CPU= 31.991
  11:04:26 STEP 1562 H=1562:00 +CPU= 33.055
  11:05:47 STEP 1563 H=1563:00 +CPU= 50.240
  11:06:41 STEP 1564 H=1564:00 +CPU= 34.044
  11:07:40 STEP 1565 H=1565:00 +CPU= 35.769
  11:09:15 STEP 1566 H=1566:00 +CPU= 57.945
  11:10:12 STEP 1567 H=1567:00 +CPU= 35.008
  11:11:03 STEP 1568 H=1568:00 +CPU= 32.927
  11:12:23 STEP 1569 H=1569:00 +CPU= 51.146
  11:13:24 STEP 1570 H=1570:00 +CPU= 37.039
  11:14:23 STEP 1571 H=1571:00 +CPU= 36.190
  11:16:00 STEP 1572 H=1572:00 +CPU= 60.523
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001572
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001572
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001572
  11:16:52 STEP 1573 H=1573:00 +CPU= 32.087
  11:17:42 STEP 1574 H=1574:00 +CPU= 33.093
  11:19:15 STEP 1575 H=1575:00 +CPU= 55.862
  11:20:15 STEP 1576 H=1576:00 +CPU= 38.404
  11:21:14 STEP 1577 H=1577:00 +CPU= 35.969
  11:22:33 STEP 1578 H=1578:00 +CPU= 51.006
  11:23:25 STEP 1579 H=1579:00 +CPU= 32.975
  11:24:26 STEP 1580 H=1580:00 +CPU= 36.923
  11:25:56 STEP 1581 H=1581:00 +CPU= 56.454
  11:26:52 STEP 1582 H=1582:00 +CPU= 36.089
  11:27:43 STEP 1583 H=1583:00 +CPU= 32.880
  11:29:35 STEP 1584 H=1584:00 +CPU= 62.662
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001584
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001584
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001584
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001560
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001560
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001560
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001572
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001572
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001572
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0467_2003050100_123_972_12189111_0_r1140672417_65.zip
Uploading the intermediate file: upload_file_65.zip
  11:30:38 STEP 1585 H=1585:00 +CPU= 36.762
  11:31:44 STEP 1586 H=1586:00 +CPU= 37.488
  11:33:02 STEP 1587 H=1587:00 +CPU= 52.444
  11:33:52 STEP 1588 H=1588:00 +CPU= 33.524
  11:34:48 STEP 1589 H=1589:00 +CPU= 32.007
  11:36:16 STEP 1590 H=1590:00 +CPU= 52.635
  11:37:15 STEP 1591 H=1591:00 +CPU= 36.643
  11:38:16 STEP 1592 H=1592:00 +CPU= 37.513
  11:39:41 STEP 1593 H=1593:00 +CPU= 53.865
  11:40:28 STEP 1594 H=1594:00 +CPU= 32.586
  11:41:14 STEP 1595 H=1595:00 +CPU= 31.809
  11:42:50 STEP 1596 H=1596:00 +CPU= 62.311
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001596
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001596
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001596
  11:43:49 STEP 1597 H=1597:00 +CPU= 37.261
  11:44:43 STEP 1598 H=1598:00 +CPU= 36.188
  11:45:56 STEP 1599 H=1599:00 +CPU= 50.030
  11:46:50 STEP 1600 H=1600:00 +CPU= 34.827
  11:47:45 STEP 1601 H=1601:00 +CPU= 36.499
  11:49:17 STEP 1602 H=1602:00 +CPU= 57.306
  11:50:13 STEP 1603 H=1603:00 +CPU= 34.007
  11:51:04 STEP 1604 H=1604:00 +CPU= 32.868
  11:52:34 STEP 1605 H=1605:00 +CPU= 52.609
  11:53:35 STEP 1606 H=1606:00 +CPU= 37.388
  11:54:36 STEP 1607 H=1607:00 +CPU= 37.924
  11:56:23 STEP 1608 H=1608:00 +CPU= 61.413
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001608
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001608
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001608
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001584
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001584
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001584
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001596
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001596
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001596
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0467_2003050100_123_972_12189111_0_r1140672417_66.zip
Uploading the intermediate file: upload_file_66.zip
  11:57:12 STEP 1609 H=1609:00 +CPU= 32.324
  11:58:08 STEP 1610 H=1610:00 +CPU= 36.283
  11:59:40 STEP 1611 H=1611:00 +CPU= 57.282
  12:00:35 STEP 1612 H=1612:00 +CPU= 37.691
  12:01:14 STEP 1613 H=1613:00 +CPU= 32.156
  12:02:28 STEP 1614 H=1614:00 +CPU= 51.514
  12:03:18 STEP 1615 H=1615:00 +CPU= 32.467
  12:04:10 STEP 1616 H=1616:00 +CPU= 33.886
  12:05:47 STEP 1617 H=1617:00 +CPU= 57.093
  12:07:10 STEP 1618 H=1618:00 +CPU= 37.272
  12:08:12 STEP 1619 H=1619:00 +CPU= 34.572
  12:09:52 STEP 1620 H=1620:00 +CPU= 57.295
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001620
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001620
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001620
  12:10:58 STEP 1621 H=1621:00 +CPU= 35.147
  12:12:08 STEP 1622 H=1622:00 +CPU= 36.924
  12:14:06 STEP 1623 H=1623:00 +CPU= 59.707
  12:15:15 STEP 1624 H=1624:00 +CPU= 38.593
  12:16:14 STEP 1625 H=1625:00 +CPU= 35.384
  12:17:49 STEP 1626 H=1626:00 +CPU= 55.637
  12:18:50 STEP 1627 H=1627:00 +CPU= 35.843
  12:19:57 STEP 1628 H=1628:00 +CPU= 38.248
  12:21:41 STEP 1629 H=1629:00 +CPU= 57.886
  12:22:42 STEP 1630 H=1630:00 +CPU= 37.109
  12:23:42 STEP 1631 H=1631:00 +CPU= 36.510
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2003050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0467
(argv4) batchid: 972
(argv5) wuid: 12189111
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /mnt/Cache/Linux/boinc-client/slots/3
Project directory is: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111
..mkdir for temp folder for results failed
Copying: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /mnt/Cache/Linux/boinc-client/slots/3/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /mnt/Cache/Linux/boinc-client/slots/3/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_cb73d0f09945a92538cda2dd920a1905 to: /mnt/Cache/Linux/boinc-client/slots/3/oifs_43r3_ps_0467_2003050100_123_972_12189111.zip
Unzipping the namelist zip file: /mnt/Cache/Linux/boinc-client/slots/3/oifs_43r3_ps_0467_2003050100_123_972_12189111.zip
ic_ancil_file: ic_ancil_12189111
ifsdata_file: ifsdata_12189111
climate_data_file: clim_data_12189111
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_6128223c55f0f1325021e1c941f407c1 to: /mnt/Cache/Linux/boinc-client/slots/3/ic_ancil_12189111.zip
Unzipping the IC ancils zip file: /mnt/Cache/Linux/boinc-client/slots/3/ic_ancil_12189111.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_b9cd774cd10bd34ed5aeeb45b13d672c to: /mnt/Cache/Linux/boinc-client/slots/3/ifsdata/ifsdata_12189111.zip
Unzipping the ifsdata_zip file: /mnt/Cache/Linux/boinc-client/slots/3/ifsdata/ifsdata_12189111.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /mnt/Cache/Linux/boinc-client/slots/3/159l_2/clim_data_12189111.zip
Unzipping the climate data zip file: /mnt/Cache/Linux/boinc-client/slots/3/159l_2/clim_data_12189111.zip
Checking for progress XML file: /mnt/Cache/Linux/boinc-client/slots/3/progress_file_12189111.xml
Opened progress file ok : /mnt/Cache/Linux/boinc-client/slots/3/progress_file_12189111.xml
-- Model is restarting --
Adjusting last_iter, 1632, to previous model restart step.
Creating progress file: /mnt/Cache/Linux/boinc-client/slots/3/progress_file_12189111.xml
last_cpu_time: 67955
upload_file_number: 67
last_iter: 1631
last_upload: 5788800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0467_2003050100_123_972_12189111_0_r1140672417
The child process has been launched with process id: 346384
Executing the command: /mnt/Cache/Linux/boinc-client/slots/3/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.005] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.005] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.005] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.005] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.005] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.005] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.005] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.005] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.005] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.005] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.005] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.006] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.006] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.006] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.006] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.006] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.006] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.006] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Leo-15:1:1:346384:346384] [20230125:122907:1674671347:0.006] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  12:31:08 STEP 1632 H=1632:00 +CPU= 56.883
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001632
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001632
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001632
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001608
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001608
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001608
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001620
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001620
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001620
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0467_2003050100_123_972_12189111_0_r1140672417_67.zip
Uploading the intermediate file: upload_file_67.zip
  12:32:11 STEP 1633 H=1633:00 +CPU= 37.139
  12:33:20 STEP 1634 H=1634:00 +CPU= 41.059
  12:35:07 STEP 1635 H=1635:00 +CPU= 61.872
  12:36:06 STEP 1636 H=1636:00 +CPU= 37.144
  12:36:54 STEP 1637 H=1637:00 +CPU= 31.502
  12:38:18 STEP 1638 H=1638:00 +CPU= 54.100
  12:39:31 STEP 1639 H=1639:00 +CPU= 40.102
  12:40:46 STEP 1640 H=1640:00 +CPU= 40.983
  12:42:29 STEP 1641 H=1641:00 +CPU= 59.242
  12:43:23 STEP 1642 H=1642:00 +CPU= 33.052
  12:44:16 STEP 1643 H=1643:00 +CPU= 31.944
  12:46:01 STEP 1644 H=1644:00 +CPU= 66.249
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001644
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001644
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001644
  12:47:11 STEP 1645 H=1645:00 +CPU= 40.889
  12:48:18 STEP 1646 H=1646:00 +CPU= 41.464
  12:49:37 STEP 1647 H=1647:00 +CPU= 52.496
  12:50:31 STEP 1648 H=1648:00 +CPU= 32.732
  12:51:29 STEP 1649 H=1649:00 +CPU= 36.733
  12:53:14 STEP 1650 H=1650:00 +CPU= 63.909
  12:54:23 STEP 1651 H=1651:00 +CPU= 41.578
  12:55:20 STEP 1652 H=1652:00 +CPU= 38.023
  12:56:36 STEP 1653 H=1653:00 +CPU= 49.584
  12:57:32 STEP 1654 H=1654:00 +CPU= 36.249
  12:58:42 STEP 1655 H=1655:00 +CPU= 41.633
  13:01:13 STEP 1656 H=1656:00 +CPU= 71.368
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001656
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001656
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001656
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001632
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001632
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001632
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001644
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001644
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001644
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0467_2003050100_123_972_12189111_0_r1140672417_68.zip
Uploading the intermediate file: upload_file_68.zip
  13:01:52 STEP 1657 H=1657:00 +CPU= 32.386
  13:02:37 STEP 1658 H=1658:00 +CPU= 33.823
  13:03:59 STEP 1659 H=1659:00 +CPU= 50.714
  13:04:52 STEP 1660 H=1660:00 +CPU= 33.077
  13:05:53 STEP 1661 H=1661:00 +CPU= 38.177
  13:07:49 STEP 1662 H=1662:00 +CPU= 62.079
  13:09:17 STEP 1663 H=1663:00 +CPU= 38.573
  13:10:16 STEP 1664 H=1664:00 +CPU= 35.854
  13:11:34 STEP 1665 H=1665:00 +CPU= 49.946
  13:12:31 STEP 1666 H=1666:00 +CPU= 35.602
  13:13:37 STEP 1667 H=1667:00 +CPU= 39.242
  13:15:37 STEP 1668 H=1668:00 +CPU= 69.196
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001668
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001668
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001668
  13:16:42 STEP 1669 H=1669:00 +CPU= 38.167
  13:17:34 STEP 1670 H=1670:00 +CPU= 33.351
  13:18:55 STEP 1671 H=1671:00 +CPU= 51.377
  13:20:13 STEP 1672 H=1672:00 +CPU= 39.561
  13:21:22 STEP 1673 H=1673:00 +CPU= 40.548
  13:23:07 STEP 1674 H=1674:00 +CPU= 62.868
  13:24:02 STEP 1675 H=1675:00 +CPU= 33.397
  13:24:51 STEP 1676 H=1676:00 +CPU= 32.548
  13:26:19 STEP 1677 H=1677:00 +CPU= 55.117
  13:27:30 STEP 1678 H=1678:00 +CPU= 41.155
  13:28:46 STEP 1679 H=1679:00 +CPU= 42.485
  13:31:05 STEP 1680 H=1680:00 +CPU= 61.555
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001680
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001680
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001680
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001656
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001656
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001656
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMGGhq0f+001668
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMSHhq0f+001668
Adding to the zip: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12189111/ICMUAhq0f+001668
Zipping up the intermediate file: /mnt/Cache/Linux/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0467_2003050100_123_972_12189111_0_r1140672417_69.zip
Uploading the intermediate file: upload_file_69.zip
  13:31:58 STEP 1681 H=1681:00 +CPU= 32.381
  13:33:05 STEP 1682 H=1682:00 +CPU= 39.533
  13:34:52 STEP 1683 H=1683:00 +CPU= 61.709
  13:36:05 STEP 1684 H=1684:00 +CPU= 41.604
  13:36:50 STEP 1685 H=1685:00 +CPU= 34.318
  13:37:55 STEP 1686 H=1686:00 +CPU= 51.601
  13:38:46 STEP 1687 H=1687:00 +CPU= 31.793
  13:39:39 STEP 1688 H=1688:00 +CPU= 32.498
  13:41:11 STEP 1689 H=1689:00 +CPU= 56.589
  13:42:21 STEP 1690 H=1690:00 +CPU= 40.535
  13:43:33 STEP 1691 H=1691:00 +CPU= 40.454
  13:45:14 STEP 1692 H=1692:00 +CPU= 61.316
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMGGhq0f+001692
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMSHhq0f+001692
Moving to projects directory: /mnt/Cache/Linux/boinc-client/slots/3/ICMUAhq0f+001692
  13:46:06 STEP 1693 H=1693:00 +CPU= 31.922
  13:47:03 STEP 1694 H=1694:00 +CPU= 35.367
  13:48:50 STEP 1695 H=1695:00 +CPU= 61.162
  13:50:02 STEP 1696 H=1696:00 +CPU= 41.724
  13:51:08 STEP 1697 H=1697:00 +CPU= 39.451
  13:52:30 STEP 1698 H=1698:00 +CPU= 51.256
  13:53:22 STEP 1699 H=1699:00 +CPU= 32.497
  13:54:28 STEP 1700 H=1700:00 +CPU= 39.394
  13:56:13 STEP 1701 H=1701:00 +CPU= 62.412
  13:57:20 STEP 1702 H=1702:00 +CPU= 41.487
  13:58:15 STEP 1703 H=1703:00 +CPU= 34.867
Abort request received from BOINC client, ending the child process

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:40:53 1507869 22274628 oifs_43r3_ps_0467_2003050100_123_972_12189111_0 5,011,200 58,046 0.0116
09 May 2023 16:40:35 1507869 22274628 oifs_43r3_ps_0467_2003050100_123_972_12189111_0 4,147,200 48,689 0.0117
09 May 2023 16:40:24 1507869 22274628 oifs_43r3_ps_0467_2003050100_123_972_12189111_0 3,283,200 39,477 0.0120
09 May 2023 16:39:21 1507869 22274628 oifs_43r3_ps_0467_2003050100_123_972_12189111_0 1,900,800 22,569 0.0119
09 May 2023 16:39:00 1507869 22274628 oifs_43r3_ps_0467_2003050100_123_972_12189111_0 1,036,800 12,457 0.0120


©2024 cpdn.org