climateprediction.net home page
Task 22304934

Task 22304934

Name oifs_43r3_ps_0667_1998050100_123_967_12184311_1
Workunit 12184311
Created 31 Jan 2023, 11:35:12 UTC
Sent 31 Jan 2023, 11:35:20 UTC
Report deadline 1 Apr 2023, 11:35:20 UTC
Received 2 Feb 2023, 20:42:26 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1535036
Run time 19 hours 41 min 12 sec
CPU time 19 hours 36 min 29 sec
Validate state Valid
Credit 14,757.12
Device peak FLOPS 4.37 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,523.98 MB
Peak swap size 4,978.07 MB
Peak disk usage 2,336.47 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
327
  15:58:33 STEP 2259 H=2259:00 +CPU= 29.522
  15:58:52 STEP 2260 H=2260:00 +CPU= 19.185
  15:59:11 STEP 2261 H=2261:00 +CPU= 18.596
  15:59:41 STEP 2262 H=2262:00 +CPU= 30.234
  16:00:00 STEP 2263 H=2263:00 +CPU= 18.481
  16:00:19 STEP 2264 H=2264:00 +CPU= 19.646
  16:00:49 STEP 2265 H=2265:00 +CPU= 29.710
  16:01:08 STEP 2266 H=2266:00 +CPU= 19.381
  16:01:27 STEP 2267 H=2267:00 +CPU= 18.344
  16:02:00 STEP 2268 H=2268:00 +CPU= 32.947
Moving to projects directory: /config/slots/2/ICMGGhq0f+002268
Moving to projects directory: /config/slots/2/ICMSHhq0f+002268
Moving to projects directory: /config/slots/2/ICMUAhq0f+002268
  16:02:19 STEP 2269 H=2269:00 +CPU= 18.971
  16:02:38 STEP 2270 H=2270:00 +CPU= 18.935
  16:03:07 STEP 2271 H=2271:00 +CPU= 29.403
  16:03:26 STEP 2272 H=2272:00 +CPU= 18.751
  16:03:44 STEP 2273 H=2273:00 +CPU= 17.997
  16:04:14 STEP 2274 H=2274:00 +CPU= 30.388
  16:04:33 STEP 2275 H=2275:00 +CPU= 18.482
  16:04:52 STEP 2276 H=2276:00 +CPU= 18.828
  16:05:21 STEP 2277 H=2277:00 +CPU= 29.555
  16:05:40 STEP 2278 H=2278:00 +CPU= 18.562
  16:05:59 STEP 2279 H=2279:00 +CPU= 18.936
  16:06:35 STEP 2280 H=2280:00 +CPU= 35.851
Moving to projects directory: /config/slots/2/ICMGGhq0f+002280
Moving to projects directory: /config/slots/2/ICMSHhq0f+002280
Moving to projects directory: /config/slots/2/ICMUAhq0f+002280
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002256
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002256
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002256
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002268
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002268
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002268
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_94.zip
Uploading the intermediate file: upload_file_94.zip
  16:06:53 STEP 2281 H=2281:00 +CPU= 18.243
  16:07:12 STEP 2282 H=2282:00 +CPU= 19.138
  16:07:41 STEP 2283 H=2283:00 +CPU= 29.471
  16:08:01 STEP 2284 H=2284:00 +CPU= 19.217
  16:08:19 STEP 2285 H=2285:00 +CPU= 18.297
  16:08:49 STEP 2286 H=2286:00 +CPU= 30.107
  16:09:08 STEP 2287 H=2287:00 +CPU= 18.532
  16:09:27 STEP 2288 H=2288:00 +CPU= 19.144
  16:09:56 STEP 2289 H=2289:00 +CPU= 29.105
  16:10:15 STEP 2290 H=2290:00 +CPU= 19.160
  16:10:33 STEP 2291 H=2291:00 +CPU= 18.296
  16:11:06 STEP 2292 H=2292:00 +CPU= 32.782
Moving to projects directory: /config/slots/2/ICMGGhq0f+002292
Moving to projects directory: /config/slots/2/ICMSHhq0f+002292
Moving to projects directory: /config/slots/2/ICMUAhq0f+002292
  16:11:25 STEP 2293 H=2293:00 +CPU= 18.268
  16:11:43 STEP 2294 H=2294:00 +CPU= 18.944
  16:12:13 STEP 2295 H=2295:00 +CPU= 29.249
  16:12:32 STEP 2296 H=2296:00 +CPU= 19.359
  16:12:50 STEP 2297 H=2297:00 +CPU= 18.266
  16:13:20 STEP 2298 H=2298:00 +CPU= 29.795
  16:13:38 STEP 2299 H=2299:00 +CPU= 17.921
  16:13:57 STEP 2300 H=2300:00 +CPU= 18.618
  16:14:27 STEP 2301 H=2301:00 +CPU= 29.689
  16:14:45 STEP 2302 H=2302:00 +CPU= 18.638
  16:15:04 STEP 2303 H=2303:00 +CPU= 18.515
  16:15:39 STEP 2304 H=2304:00 +CPU= 35.226
Moving to projects directory: /config/slots/2/ICMGGhq0f+002304
Moving to projects directory: /config/slots/2/ICMSHhq0f+002304
Moving to projects directory: /config/slots/2/ICMUAhq0f+002304
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002280
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002280
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002280
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002292
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002292
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002292
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_95.zip
Uploading the intermediate file: upload_file_95.zip
  16:15:58 STEP 2305 H=2305:00 +CPU= 18.744
  16:16:17 STEP 2306 H=2306:00 +CPU= 19.312
  16:16:47 STEP 2307 H=2307:00 +CPU= 29.698
  16:17:06 STEP 2308 H=2308:00 +CPU= 19.616
  16:17:25 STEP 2309 H=2309:00 +CPU= 18.223
  16:17:54 STEP 2310 H=2310:00 +CPU= 29.781
  16:18:13 STEP 2311 H=2311:00 +CPU= 18.666
  16:18:32 STEP 2312 H=2312:00 +CPU= 18.962
  16:19:02 STEP 2313 H=2313:00 +CPU= 29.408
  16:19:21 STEP 2314 H=2314:00 +CPU= 19.291
  16:19:39 STEP 2315 H=2315:00 +CPU= 18.503
  16:20:12 STEP 2316 H=2316:00 +CPU= 32.739
Moving to projects directory: /config/slots/2/ICMGGhq0f+002316
Moving to projects directory: /config/slots/2/ICMSHhq0f+002316
Moving to projects directory: /config/slots/2/ICMUAhq0f+002316
  16:20:30 STEP 2317 H=2317:00 +CPU= 18.223
  16:20:49 STEP 2318 H=2318:00 +CPU= 18.546
  16:21:19 STEP 2319 H=2319:00 +CPU= 29.758
  16:21:38 STEP 2320 H=2320:00 +CPU= 19.317
  16:21:57 STEP 2321 H=2321:00 +CPU= 18.816
  16:22:28 STEP 2322 H=2322:00 +CPU= 30.875
  16:22:46 STEP 2323 H=2323:00 +CPU= 18.295
  16:23:06 STEP 2324 H=2324:00 +CPU= 19.627
  16:23:36 STEP 2325 H=2325:00 +CPU= 29.814
  16:23:55 STEP 2326 H=2326:00 +CPU= 19.143
  16:24:14 STEP 2327 H=2327:00 +CPU= 19.732
  16:24:50 STEP 2328 H=2328:00 +CPU= 35.425
Moving to projects directory: /config/slots/2/ICMGGhq0f+002328
Moving to projects directory: /config/slots/2/ICMSHhq0f+002328
Moving to projects directory: /config/slots/2/ICMUAhq0f+002328
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002304
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002304
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002304
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002316
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002316
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002316
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_96.zip
Uploading the intermediate file: upload_file_96.zip
  16:25:08 STEP 2329 H=2329:00 +CPU= 18.474
  16:25:27 STEP 2330 H=2330:00 +CPU= 18.980
  16:25:57 STEP 2331 H=2331:00 +CPU= 29.251
  16:26:16 STEP 2332 H=2332:00 +CPU= 19.276
  16:26:34 STEP 2333 H=2333:00 +CPU= 18.309
  16:27:04 STEP 2334 H=2334:00 +CPU= 29.511
  16:27:22 STEP 2335 H=2335:00 +CPU= 18.323
  16:27:41 STEP 2336 H=2336:00 +CPU= 19.027
  16:28:11 STEP 2337 H=2337:00 +CPU= 29.903
  16:28:30 STEP 2338 H=2338:00 +CPU= 19.162
  16:28:48 STEP 2339 H=2339:00 +CPU= 18.155
  16:29:21 STEP 2340 H=2340:00 +CPU= 32.884
Moving to projects directory: /config/slots/2/ICMGGhq0f+002340
Moving to projects directory: /config/slots/2/ICMSHhq0f+002340
Moving to projects directory: /config/slots/2/ICMUAhq0f+002340
  16:29:40 STEP 2341 H=2341:00 +CPU= 18.549
  16:29:59 STEP 2342 H=2342:00 +CPU= 19.148
  16:30:30 STEP 2343 H=2343:00 +CPU= 30.696
  16:30:49 STEP 2344 H=2344:00 +CPU= 19.101
  16:31:07 STEP 2345 H=2345:00 +CPU= 18.433
  16:31:38 STEP 2346 H=2346:00 +CPU= 30.718
  16:31:56 STEP 2347 H=2347:00 +CPU= 18.347
  16:32:16 STEP 2348 H=2348:00 +CPU= 19.213
  16:32:46 STEP 2349 H=2349:00 +CPU= 30.578
  16:33:06 STEP 2350 H=2350:00 +CPU= 19.183
  16:33:25 STEP 2351 H=2351:00 +CPU= 19.394
  16:34:00 STEP 2352 H=2352:00 +CPU= 35.128
Moving to projects directory: /config/slots/2/ICMGGhq0f+002352
Moving to projects directory: /config/slots/2/ICMSHhq0f+002352
Moving to projects directory: /config/slots/2/ICMUAhq0f+002352
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002328
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002328
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002328
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002340
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002340
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002340
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_97.zip
Uploading the intermediate file: upload_file_97.zip
  16:34:19 STEP 2353 H=2353:00 +CPU= 18.657
  16:34:38 STEP 2354 H=2354:00 +CPU= 18.977
  16:35:08 STEP 2355 H=2355:00 +CPU= 30.069
  16:35:27 STEP 2356 H=2356:00 +CPU= 19.308
  16:35:46 STEP 2357 H=2357:00 +CPU= 18.902
  16:36:17 STEP 2358 H=2358:00 +CPU= 31.166
  16:36:36 STEP 2359 H=2359:00 +CPU= 18.487
  16:36:55 STEP 2360 H=2360:00 +CPU= 18.711
  16:37:25 STEP 2361 H=2361:00 +CPU= 30.522
  16:37:44 STEP 2362 H=2362:00 +CPU= 19.126
  16:38:03 STEP 2363 H=2363:00 +CPU= 18.441
  16:38:36 STEP 2364 H=2364:00 +CPU= 33.130
Moving to projects directory: /config/slots/2/ICMGGhq0f+002364
Moving to projects directory: /config/slots/2/ICMSHhq0f+002364
Moving to projects directory: /config/slots/2/ICMUAhq0f+002364
  16:38:54 STEP 2365 H=2365:00 +CPU= 18.372
  16:39:13 STEP 2366 H=2366:00 +CPU= 18.748
  16:39:41 STEP 2367 H=2367:00 +CPU= 28.394
  16:39:59 STEP 2368 H=2368:00 +CPU= 18.067
  16:40:18 STEP 2369 H=2369:00 +CPU= 18.694
  16:40:48 STEP 2370 H=2370:00 +CPU= 29.996
  16:41:07 STEP 2371 H=2371:00 +CPU= 18.453
  16:41:25 STEP 2372 H=2372:00 +CPU= 18.736
  16:41:55 STEP 2373 H=2373:00 +CPU= 29.642
  16:42:15 STEP 2374 H=2374:00 +CPU= 19.433
  16:42:34 STEP 2375 H=2375:00 +CPU= 19.132
  16:43:10 STEP 2376 H=2376:00 +CPU= 35.830
Moving to projects directory: /config/slots/2/ICMGGhq0f+002376
Moving to projects directory: /config/slots/2/ICMSHhq0f+002376
Moving to projects directory: /config/slots/2/ICMUAhq0f+002376
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002352
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002352
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002352
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002364
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002364
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002364
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_98.zip
Uploading the intermediate file: upload_file_98.zip
  16:43:28 STEP 2377 H=2377:00 +CPU= 18.524
  16:43:48 STEP 2378 H=2378:00 +CPU= 19.469
  16:44:17 STEP 2379 H=2379:00 +CPU= 29.908
  16:44:36 STEP 2380 H=2380:00 +CPU= 18.978
  16:44:55 STEP 2381 H=2381:00 +CPU= 18.891
  16:45:26 STEP 2382 H=2382:00 +CPU= 30.654
  16:45:45 STEP 2383 H=2383:00 +CPU= 18.542
  16:46:04 STEP 2384 H=2384:00 +CPU= 18.963
  16:46:33 STEP 2385 H=2385:00 +CPU= 29.774
  16:46:52 STEP 2386 H=2386:00 +CPU= 19.046
  16:47:11 STEP 2387 H=2387:00 +CPU= 18.623
  16:47:45 STEP 2388 H=2388:00 +CPU= 33.820
Moving to projects directory: /config/slots/2/ICMGGhq0f+002388
Moving to projects directory: /config/slots/2/ICMSHhq0f+002388
Moving to projects directory: /config/slots/2/ICMUAhq0f+002388
  16:48:04 STEP 2389 H=2389:00 +CPU= 18.923
  16:48:23 STEP 2390 H=2390:00 +CPU= 19.387
  16:48:54 STEP 2391 H=2391:00 +CPU= 30.321
  16:49:13 STEP 2392 H=2392:00 +CPU= 19.255
  16:49:31 STEP 2393 H=2393:00 +CPU= 18.494
  16:50:02 STEP 2394 H=2394:00 +CPU= 30.529
  16:50:21 STEP 2395 H=2395:00 +CPU= 18.791
  16:50:40 STEP 2396 H=2396:00 +CPU= 19.215
  16:51:10 STEP 2397 H=2397:00 +CPU= 29.618
  16:51:29 STEP 2398 H=2398:00 +CPU= 19.136
  16:51:48 STEP 2399 H=2399:00 +CPU= 19.012
  16:52:24 STEP 2400 H=2400:00 +CPU= 36.515
Moving to projects directory: /config/slots/2/ICMGGhq0f+002400
Moving to projects directory: /config/slots/2/ICMSHhq0f+002400
Moving to projects directory: /config/slots/2/ICMUAhq0f+002400
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002376
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002376
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002376
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002388
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002388
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002388
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_99.zip
Uploading the intermediate file: upload_file_99.zip
  16:52:43 STEP 2401 H=2401:00 +CPU= 18.374
  16:53:01 STEP 2402 H=2402:00 +CPU= 18.393
  16:53:30 STEP 2403 H=2403:00 +CPU= 28.753
  16:53:48 STEP 2404 H=2404:00 +CPU= 18.583
  16:54:08 STEP 2405 H=2405:00 +CPU= 19.035
  16:54:38 STEP 2406 H=2406:00 +CPU= 30.772
  16:54:57 STEP 2407 H=2407:00 +CPU= 18.847
  16:55:17 STEP 2408 H=2408:00 +CPU= 20.272
  16:55:48 STEP 2409 H=2409:00 +CPU= 30.569
  16:56:08 STEP 2410 H=2410:00 +CPU= 19.633
  16:56:26 STEP 2411 H=2411:00 +CPU= 18.661
  16:56:59 STEP 2412 H=2412:00 +CPU= 32.782
Moving to projects directory: /config/slots/2/ICMGGhq0f+002412
Moving to projects directory: /config/slots/2/ICMSHhq0f+002412
Moving to projects directory: /config/slots/2/ICMUAhq0f+002412
  16:57:18 STEP 2413 H=2413:00 +CPU= 18.564
  16:57:37 STEP 2414 H=2414:00 +CPU= 19.106
  16:58:07 STEP 2415 H=2415:00 +CPU= 30.178
  16:58:27 STEP 2416 H=2416:00 +CPU= 20.015
  16:58:47 STEP 2417 H=2417:00 +CPU= 19.924
  16:59:18 STEP 2418 H=2418:00 +CPU= 30.645
  16:59:36 STEP 2419 H=2419:00 +CPU= 18.499
  16:59:55 STEP 2420 H=2420:00 +CPU= 18.804
  17:00:26 STEP 2421 H=2421:00 +CPU= 30.903
  17:00:46 STEP 2422 H=2422:00 +CPU= 20.189
  17:01:06 STEP 2423 H=2423:00 +CPU= 19.734
  17:01:42 STEP 2424 H=2424:00 +CPU= 36.293
Moving to projects directory: /config/slots/2/ICMGGhq0f+002424
Moving to projects directory: /config/slots/2/ICMSHhq0f+002424
Moving to projects directory: /config/slots/2/ICMUAhq0f+002424
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002400
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002400
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002400
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002412
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002412
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002412
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_100.zip
Uploading the intermediate file: upload_file_100.zip
  17:02:01 STEP 2425 H=2425:00 +CPU= 18.631
  17:02:21 STEP 2426 H=2426:00 +CPU= 19.659
  17:02:51 STEP 2427 H=2427:00 +CPU= 29.875
  17:03:09 STEP 2428 H=2428:00 +CPU= 18.985
  17:03:28 STEP 2429 H=2429:00 +CPU= 18.649
  17:03:59 STEP 2430 H=2430:00 +CPU= 30.681
  17:04:18 STEP 2431 H=2431:00 +CPU= 18.802
  17:04:36 STEP 2432 H=2432:00 +CPU= 18.795
  17:05:07 STEP 2433 H=2433:00 +CPU= 30.261
  17:05:26 STEP 2434 H=2434:00 +CPU= 18.899
  17:05:45 STEP 2435 H=2435:00 +CPU= 18.898
  17:06:18 STEP 2436 H=2436:00 +CPU= 33.362
Moving to projects directory: /config/slots/2/ICMGGhq0f+002436
Moving to projects directory: /config/slots/2/ICMSHhq0f+002436
Moving to projects directory: /config/slots/2/ICMUAhq0f+002436
  17:06:36 STEP 2437 H=2437:00 +CPU= 18.068
  17:06:55 STEP 2438 H=2438:00 +CPU= 18.877
  17:07:25 STEP 2439 H=2439:00 +CPU= 29.946
  17:07:44 STEP 2440 H=2440:00 +CPU= 19.055
  17:08:02 STEP 2441 H=2441:00 +CPU= 18.343
  17:08:32 STEP 2442 H=2442:00 +CPU= 29.714
  17:08:50 STEP 2443 H=2443:00 +CPU= 18.154
  17:09:10 STEP 2444 H=2444:00 +CPU= 19.392
  17:09:39 STEP 2445 H=2445:00 +CPU= 29.210
  17:09:58 STEP 2446 H=2446:00 +CPU= 18.986
  17:10:17 STEP 2447 H=2447:00 +CPU= 19.106
  17:10:52 STEP 2448 H=2448:00 +CPU= 35.227
Moving to projects directory: /config/slots/2/ICMGGhq0f+002448
Moving to projects directory: /config/slots/2/ICMSHhq0f+002448
Moving to projects directory: /config/slots/2/ICMUAhq0f+002448
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002424
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002424
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002424
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002436
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002436
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002436
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_101.zip
Uploading the intermediate file: upload_file_101.zip
  17:11:11 STEP 2449 H=2449:00 +CPU= 18.589
Uploading trickle at timestep: 8812800
  17:11:30 STEP 2450 H=2450:00 +CPU= 18.912
  17:11:59 STEP 2451 H=2451:00 +CPU= 29.640
  17:12:19 STEP 2452 H=2452:00 +CPU= 19.626
  17:12:38 STEP 2453 H=2453:00 +CPU= 18.514
  17:13:08 STEP 2454 H=2454:00 +CPU= 29.903
  17:13:26 STEP 2455 H=2455:00 +CPU= 18.127
  17:13:44 STEP 2456 H=2456:00 +CPU= 18.500
  17:14:13 STEP 2457 H=2457:00 +CPU= 28.926
  17:14:32 STEP 2458 H=2458:00 +CPU= 19.019
  17:14:50 STEP 2459 H=2459:00 +CPU= 18.187
  17:15:23 STEP 2460 H=2460:00 +CPU= 32.179
Moving to projects directory: /config/slots/2/ICMGGhq0f+002460
Moving to projects directory: /config/slots/2/ICMSHhq0f+002460
Moving to projects directory: /config/slots/2/ICMUAhq0f+002460
  17:15:41 STEP 2461 H=2461:00 +CPU= 18.518
  17:16:00 STEP 2462 H=2462:00 +CPU= 18.894
  17:16:30 STEP 2463 H=2463:00 +CPU= 29.900
  17:16:49 STEP 2464 H=2464:00 +CPU= 18.934
  17:17:07 STEP 2465 H=2465:00 +CPU= 18.331
  17:17:38 STEP 2466 H=2466:00 +CPU= 30.418
  17:17:56 STEP 2467 H=2467:00 +CPU= 18.560
  17:18:15 STEP 2468 H=2468:00 +CPU= 19.206
  17:18:45 STEP 2469 H=2469:00 +CPU= 29.394
  17:19:04 STEP 2470 H=2470:00 +CPU= 19.079
  17:19:23 STEP 2471 H=2471:00 +CPU= 18.706
  17:19:58 STEP 2472 H=2472:00 +CPU= 34.995
Moving to projects directory: /config/slots/2/ICMGGhq0f+002472
Moving to projects directory: /config/slots/2/ICMSHhq0f+002472
Moving to projects directory: /config/slots/2/ICMUAhq0f+002472
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002448
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002448
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002448
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002460
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002460
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002460
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_102.zip
Uploading the intermediate file: upload_file_102.zip
  17:20:16 STEP 2473 H=2473:00 +CPU= 18.358
  17:20:35 STEP 2474 H=2474:00 +CPU= 18.899
  17:21:04 STEP 2475 H=2475:00 +CPU= 29.496
  17:21:23 STEP 2476 H=2476:00 +CPU= 18.368
  17:21:41 STEP 2477 H=2477:00 +CPU= 18.419
  17:22:11 STEP 2478 H=2478:00 +CPU= 30.148
  17:22:30 STEP 2479 H=2479:00 +CPU= 18.489
  17:22:49 STEP 2480 H=2480:00 +CPU= 18.983
  17:23:18 STEP 2481 H=2481:00 +CPU= 29.142
  17:23:38 STEP 2482 H=2482:00 +CPU= 19.519
  17:23:55 STEP 2483 H=2483:00 +CPU= 17.665
  17:24:28 STEP 2484 H=2484:00 +CPU= 32.499
Moving to projects directory: /config/slots/2/ICMGGhq0f+002484
Moving to projects directory: /config/slots/2/ICMSHhq0f+002484
Moving to projects directory: /config/slots/2/ICMUAhq0f+002484
  17:24:46 STEP 2485 H=2485:00 +CPU= 18.249
  17:25:05 STEP 2486 H=2486:00 +CPU= 19.129
  17:25:35 STEP 2487 H=2487:00 +CPU= 29.228
  17:25:53 STEP 2488 H=2488:00 +CPU= 18.502
  17:26:11 STEP 2489 H=2489:00 +CPU= 17.979
  17:26:41 STEP 2490 H=2490:00 +CPU= 30.004
  17:27:00 STEP 2491 H=2491:00 +CPU= 18.651
  17:27:19 STEP 2492 H=2492:00 +CPU= 19.046
  17:27:48 STEP 2493 H=2493:00 +CPU= 28.987
  17:28:06 STEP 2494 H=2494:00 +CPU= 18.581
  17:28:26 STEP 2495 H=2495:00 +CPU= 19.311
  17:29:01 STEP 2496 H=2496:00 +CPU= 35.572
Moving to projects directory: /config/slots/2/ICMGGhq0f+002496
Moving to projects directory: /config/slots/2/ICMSHhq0f+002496
Moving to projects directory: /config/slots/2/ICMUAhq0f+002496
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002472
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002472
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002472
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002484
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002484
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002484
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_103.zip
Uploading the intermediate file: upload_file_103.zip
  17:29:20 STEP 2497 H=2497:00 +CPU= 18.314
  17:29:39 STEP 2498 H=2498:00 +CPU= 18.836
  17:30:08 STEP 2499 H=2499:00 +CPU= 29.087
  17:30:27 STEP 2500 H=2500:00 +CPU= 19.690
  17:30:46 STEP 2501 H=2501:00 +CPU= 18.733
  17:31:17 STEP 2502 H=2502:00 +CPU= 30.416
  17:31:35 STEP 2503 H=2503:00 +CPU= 18.822
  17:31:55 STEP 2504 H=2504:00 +CPU= 19.431
  17:32:25 STEP 2505 H=2505:00 +CPU= 29.942
  17:32:44 STEP 2506 H=2506:00 +CPU= 18.804
  17:33:03 STEP 2507 H=2507:00 +CPU= 18.972
  17:33:36 STEP 2508 H=2508:00 +CPU= 32.931
Moving to projects directory: /config/slots/2/ICMGGhq0f+002508
Moving to projects directory: /config/slots/2/ICMSHhq0f+002508
Moving to projects directory: /config/slots/2/ICMUAhq0f+002508
  17:33:54 STEP 2509 H=2509:00 +CPU= 18.406
  17:34:12 STEP 2510 H=2510:00 +CPU= 18.239
  17:34:42 STEP 2511 H=2511:00 +CPU= 30.198
  17:35:01 STEP 2512 H=2512:00 +CPU= 18.527
  17:35:19 STEP 2513 H=2513:00 +CPU= 18.043
  17:35:49 STEP 2514 H=2514:00 +CPU= 29.594
  17:36:07 STEP 2515 H=2515:00 +CPU= 18.304
  17:36:26 STEP 2516 H=2516:00 +CPU= 18.836
  17:36:55 STEP 2517 H=2517:00 +CPU= 28.864
  17:37:13 STEP 2518 H=2518:00 +CPU= 18.809
  17:37:32 STEP 2519 H=2519:00 +CPU= 18.860
  17:38:07 STEP 2520 H=2520:00 +CPU= 35.073
Moving to projects directory: /config/slots/2/ICMGGhq0f+002520
Moving to projects directory: /config/slots/2/ICMSHhq0f+002520
Moving to projects directory: /config/slots/2/ICMUAhq0f+002520
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002496
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002496
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002496
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002508
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002508
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002508
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_104.zip
Uploading the intermediate file: upload_file_104.zip
  17:38:26 STEP 2521 H=2521:00 +CPU= 18.746
  17:38:46 STEP 2522 H=2522:00 +CPU= 19.263
  17:39:15 STEP 2523 H=2523:00 +CPU= 29.800
  17:39:35 STEP 2524 H=2524:00 +CPU= 19.186
  17:39:53 STEP 2525 H=2525:00 +CPU= 18.810
  17:40:24 STEP 2526 H=2526:00 +CPU= 30.955
  17:40:43 STEP 2527 H=2527:00 +CPU= 19.098
  17:41:03 STEP 2528 H=2528:00 +CPU= 19.214
  17:41:33 STEP 2529 H=2529:00 +CPU= 30.077
  17:41:52 STEP 2530 H=2530:00 +CPU= 19.396
  17:42:11 STEP 2531 H=2531:00 +CPU= 18.544
  17:42:44 STEP 2532 H=2532:00 +CPU= 33.453
Moving to projects directory: /config/slots/2/ICMGGhq0f+002532
Moving to projects directory: /config/slots/2/ICMSHhq0f+002532
Moving to projects directory: /config/slots/2/ICMUAhq0f+002532
  17:43:03 STEP 2533 H=2533:00 +CPU= 18.633
  17:43:22 STEP 2534 H=2534:00 +CPU= 19.128
  17:43:52 STEP 2535 H=2535:00 +CPU= 30.293
  17:44:12 STEP 2536 H=2536:00 +CPU= 19.293
  17:44:30 STEP 2537 H=2537:00 +CPU= 18.901
  17:45:01 STEP 2538 H=2538:00 +CPU= 30.424
  17:45:19 STEP 2539 H=2539:00 +CPU= 18.094
  17:45:38 STEP 2540 H=2540:00 +CPU= 18.962
  17:46:08 STEP 2541 H=2541:00 +CPU= 30.105
  17:46:27 STEP 2542 H=2542:00 +CPU= 19.273
  17:46:47 STEP 2543 H=2543:00 +CPU= 19.360
  17:47:23 STEP 2544 H=2544:00 +CPU= 35.986
Moving to projects directory: /config/slots/2/ICMGGhq0f+002544
Moving to projects directory: /config/slots/2/ICMSHhq0f+002544
Moving to projects directory: /config/slots/2/ICMUAhq0f+002544
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002520
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002520
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002520
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002532
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002532
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002532
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_105.zip
Uploading the intermediate file: upload_file_105.zip
  17:47:41 STEP 2545 H=2545:00 +CPU= 18.675
  17:48:01 STEP 2546 H=2546:00 +CPU= 19.095
  17:48:30 STEP 2547 H=2547:00 +CPU= 29.339
  17:48:49 STEP 2548 H=2548:00 +CPU= 18.816
  17:49:07 STEP 2549 H=2549:00 +CPU= 18.163
  17:49:37 STEP 2550 H=2550:00 +CPU= 29.971
  17:49:55 STEP 2551 H=2551:00 +CPU= 17.817
  17:50:13 STEP 2552 H=2552:00 +CPU= 18.421
  17:50:43 STEP 2553 H=2553:00 +CPU= 29.472
  17:51:02 STEP 2554 H=2554:00 +CPU= 19.042
  17:51:20 STEP 2555 H=2555:00 +CPU= 18.243
  17:51:53 STEP 2556 H=2556:00 +CPU= 33.343
Moving to projects directory: /config/slots/2/ICMGGhq0f+002556
Moving to projects directory: /config/slots/2/ICMSHhq0f+002556
Moving to projects directory: /config/slots/2/ICMUAhq0f+002556
  17:52:12 STEP 2557 H=2557:00 +CPU= 18.726
  17:52:31 STEP 2558 H=2558:00 +CPU= 19.262
  17:53:01 STEP 2559 H=2559:00 +CPU= 29.308
  17:53:20 STEP 2560 H=2560:00 +CPU= 19.474
  17:53:38 STEP 2561 H=2561:00 +CPU= 18.060
  17:54:09 STEP 2562 H=2562:00 +CPU= 30.492
  17:54:28 STEP 2563 H=2563:00 +CPU= 18.743
  17:54:46 STEP 2564 H=2564:00 +CPU= 18.856
  17:55:16 STEP 2565 H=2565:00 +CPU= 29.686
  17:55:35 STEP 2566 H=2566:00 +CPU= 19.102
  17:55:54 STEP 2567 H=2567:00 +CPU= 19.177
  17:56:30 STEP 2568 H=2568:00 +CPU= 35.881
Moving to projects directory: /config/slots/2/ICMGGhq0f+002568
Moving to projects directory: /config/slots/2/ICMSHhq0f+002568
Moving to projects directory: /config/slots/2/ICMUAhq0f+002568
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002544
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002544
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002544
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002556
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002556
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002556
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_106.zip
Uploading the intermediate file: upload_file_106.zip
  17:56:49 STEP 2569 H=2569:00 +CPU= 18.524
  17:57:08 STEP 2570 H=2570:00 +CPU= 18.738
  17:57:37 STEP 2571 H=2571:00 +CPU= 29.242
  17:57:56 STEP 2572 H=2572:00 +CPU= 19.390
  17:58:15 STEP 2573 H=2573:00 +CPU= 18.954
  17:58:46 STEP 2574 H=2574:00 +CPU= 30.604
  17:59:04 STEP 2575 H=2575:00 +CPU= 18.251
  17:59:23 STEP 2576 H=2576:00 +CPU= 18.535
  17:59:52 STEP 2577 H=2577:00 +CPU= 29.205
  18:00:11 STEP 2578 H=2578:00 +CPU= 19.229
  18:00:30 STEP 2579 H=2579:00 +CPU= 19.100
  18:01:04 STEP 2580 H=2580:00 +CPU= 33.309
Moving to projects directory: /config/slots/2/ICMGGhq0f+002580
Moving to projects directory: /config/slots/2/ICMSHhq0f+002580
Moving to projects directory: /config/slots/2/ICMUAhq0f+002580
  18:01:22 STEP 2581 H=2581:00 +CPU= 18.644
  18:01:42 STEP 2582 H=2582:00 +CPU= 19.325
  18:02:11 STEP 2583 H=2583:00 +CPU= 29.535
  18:02:30 STEP 2584 H=2584:00 +CPU= 18.878
  18:02:49 STEP 2585 H=2585:00 +CPU= 18.533
  18:03:19 STEP 2586 H=2586:00 +CPU= 30.216
  18:03:37 STEP 2587 H=2587:00 +CPU= 18.359
  18:03:57 STEP 2588 H=2588:00 +CPU= 19.469
  18:04:27 STEP 2589 H=2589:00 +CPU= 30.010
  18:04:46 STEP 2590 H=2590:00 +CPU= 19.197
  18:05:04 STEP 2591 H=2591:00 +CPU= 18.453
  18:05:40 STEP 2592 H=2592:00 +CPU= 35.619
Moving to projects directory: /config/slots/2/ICMGGhq0f+002592
Moving to projects directory: /config/slots/2/ICMSHhq0f+002592
Moving to projects directory: /config/slots/2/ICMUAhq0f+002592
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002568
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002568
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002568
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002580
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002580
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002580
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_107.zip
Uploading the intermediate file: upload_file_107.zip
  18:05:58 STEP 2593 H=2593:00 +CPU= 18.237
  18:06:17 STEP 2594 H=2594:00 +CPU= 18.808
  18:06:47 STEP 2595 H=2595:00 +CPU= 29.581
  18:07:06 STEP 2596 H=2596:00 +CPU= 18.915
  18:07:24 STEP 2597 H=2597:00 +CPU= 18.462
  18:07:55 STEP 2598 H=2598:00 +CPU= 30.871
  18:08:14 STEP 2599 H=2599:00 +CPU= 19.002
  18:08:33 STEP 2600 H=2600:00 +CPU= 19.117
  18:09:03 STEP 2601 H=2601:00 +CPU= 29.598
  18:09:21 STEP 2602 H=2602:00 +CPU= 18.614
  18:09:40 STEP 2603 H=2603:00 +CPU= 18.644
  18:10:13 STEP 2604 H=2604:00 +CPU= 32.893
Moving to projects directory: /config/slots/2/ICMGGhq0f+002604
Moving to projects directory: /config/slots/2/ICMSHhq0f+002604
Moving to projects directory: /config/slots/2/ICMUAhq0f+002604
  18:10:32 STEP 2605 H=2605:00 +CPU= 18.927
  18:10:52 STEP 2606 H=2606:00 +CPU= 19.697
  18:11:21 STEP 2607 H=2607:00 +CPU= 29.718
  18:11:40 STEP 2608 H=2608:00 +CPU= 19.061
  18:11:59 STEP 2609 H=2609:00 +CPU= 18.701
  18:12:30 STEP 2610 H=2610:00 +CPU= 30.558
  18:12:49 STEP 2611 H=2611:00 +CPU= 18.771
  18:13:08 STEP 2612 H=2612:00 +CPU= 19.116
  18:13:37 STEP 2613 H=2613:00 +CPU= 29.675
  18:13:56 STEP 2614 H=2614:00 +CPU= 18.856
  18:14:15 STEP 2615 H=2615:00 +CPU= 18.970
  18:14:51 STEP 2616 H=2616:00 +CPU= 35.309
Moving to projects directory: /config/slots/2/ICMGGhq0f+002616
Moving to projects directory: /config/slots/2/ICMSHhq0f+002616
Moving to projects directory: /config/slots/2/ICMUAhq0f+002616
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002592
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002592
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002592
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002604
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002604
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002604
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_108.zip
Uploading the intermediate file: upload_file_108.zip
  18:15:09 STEP 2617 H=2617:00 +CPU= 18.544
  18:15:28 STEP 2618 H=2618:00 +CPU= 19.043
  18:15:58 STEP 2619 H=2619:00 +CPU= 29.839
  18:16:17 STEP 2620 H=2620:00 +CPU= 19.172
  18:16:36 STEP 2621 H=2621:00 +CPU= 18.709
  18:17:07 STEP 2622 H=2622:00 +CPU= 31.026
  18:17:26 STEP 2623 H=2623:00 +CPU= 18.919
  18:17:45 STEP 2624 H=2624:00 +CPU= 19.393
  18:18:16 STEP 2625 H=2625:00 +CPU= 30.787
  18:18:35 STEP 2626 H=2626:00 +CPU= 19.040
  18:18:54 STEP 2627 H=2627:00 +CPU= 19.074
  18:19:27 STEP 2628 H=2628:00 +CPU= 32.485
Moving to projects directory: /config/slots/2/ICMGGhq0f+002628
Moving to projects directory: /config/slots/2/ICMSHhq0f+002628
Moving to projects directory: /config/slots/2/ICMUAhq0f+002628
  18:19:46 STEP 2629 H=2629:00 +CPU= 19.041
  18:20:05 STEP 2630 H=2630:00 +CPU= 18.972
  18:20:35 STEP 2631 H=2631:00 +CPU= 30.237
  18:20:54 STEP 2632 H=2632:00 +CPU= 19.312
  18:21:13 STEP 2633 H=2633:00 +CPU= 18.398
  18:21:43 STEP 2634 H=2634:00 +CPU= 30.024
  18:22:01 STEP 2635 H=2635:00 +CPU= 18.558
  18:22:21 STEP 2636 H=2636:00 +CPU= 19.434
  18:22:51 STEP 2637 H=2637:00 +CPU= 29.974
  18:23:10 STEP 2638 H=2638:00 +CPU= 19.329
  18:23:29 STEP 2639 H=2639:00 +CPU= 19.026
  18:24:05 STEP 2640 H=2640:00 +CPU= 35.352
Moving to projects directory: /config/slots/2/ICMGGhq0f+002640
Moving to projects directory: /config/slots/2/ICMSHhq0f+002640
Moving to projects directory: /config/slots/2/ICMUAhq0f+002640
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002616
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002616
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002616
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002628
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002628
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002628
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_109.zip
Uploading the intermediate file: upload_file_109.zip
  18:24:23 STEP 2641 H=2641:00 +CPU= 18.292
  18:24:42 STEP 2642 H=2642:00 +CPU= 19.419
  18:25:13 STEP 2643 H=2643:00 +CPU= 30.328
  18:25:32 STEP 2644 H=2644:00 +CPU= 19.723
  18:25:51 STEP 2645 H=2645:00 +CPU= 18.745
  18:26:21 STEP 2646 H=2646:00 +CPU= 29.898
  18:26:40 STEP 2647 H=2647:00 +CPU= 18.637
  18:26:59 STEP 2648 H=2648:00 +CPU= 19.096
  18:27:28 STEP 2649 H=2649:00 +CPU= 29.355
  18:27:47 STEP 2650 H=2650:00 +CPU= 18.870
  18:28:06 STEP 2651 H=2651:00 +CPU= 19.082
  18:28:40 STEP 2652 H=2652:00 +CPU= 33.652
Moving to projects directory: /config/slots/2/ICMGGhq0f+002652
Moving to projects directory: /config/slots/2/ICMSHhq0f+002652
Moving to projects directory: /config/slots/2/ICMUAhq0f+002652
  18:28:58 STEP 2653 H=2653:00 +CPU= 18.492
  18:29:18 STEP 2654 H=2654:00 +CPU= 19.399
  18:29:48 STEP 2655 H=2655:00 +CPU= 29.882
  18:30:07 STEP 2656 H=2656:00 +CPU= 19.316
  18:30:25 STEP 2657 H=2657:00 +CPU= 18.331
  18:30:57 STEP 2658 H=2658:00 +CPU= 31.265
  18:31:15 STEP 2659 H=2659:00 +CPU= 18.806
  18:31:34 STEP 2660 H=2660:00 +CPU= 18.943
  18:32:05 STEP 2661 H=2661:00 +CPU= 30.142
  18:32:24 STEP 2662 H=2662:00 +CPU= 18.945
  18:32:43 STEP 2663 H=2663:00 +CPU= 19.325
  18:33:18 STEP 2664 H=2664:00 +CPU= 35.415
Moving to projects directory: /config/slots/2/ICMGGhq0f+002664
Moving to projects directory: /config/slots/2/ICMSHhq0f+002664
Moving to projects directory: /config/slots/2/ICMUAhq0f+002664
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002640
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002640
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002640
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002652
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002652
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002652
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_110.zip
Uploading the intermediate file: upload_file_110.zip
  18:33:37 STEP 2665 H=2665:00 +CPU= 18.503
  18:33:56 STEP 2666 H=2666:00 +CPU= 18.880
  18:34:25 STEP 2667 H=2667:00 +CPU= 29.577
  18:34:45 STEP 2668 H=2668:00 +CPU= 19.260
  18:35:03 STEP 2669 H=2669:00 +CPU= 18.564
  18:35:34 STEP 2670 H=2670:00 +CPU= 30.696
  18:35:52 STEP 2671 H=2671:00 +CPU= 18.516
  18:36:12 STEP 2672 H=2672:00 +CPU= 19.327
  18:36:41 STEP 2673 H=2673:00 +CPU= 29.453
  18:37:00 STEP 2674 H=2674:00 +CPU= 18.940
  18:37:19 STEP 2675 H=2675:00 +CPU= 18.338
  18:37:51 STEP 2676 H=2676:00 +CPU= 32.808
Moving to projects directory: /config/slots/2/ICMGGhq0f+002676
Moving to projects directory: /config/slots/2/ICMSHhq0f+002676
Moving to projects directory: /config/slots/2/ICMUAhq0f+002676
  18:38:10 STEP 2677 H=2677:00 +CPU= 18.165
  18:38:29 STEP 2678 H=2678:00 +CPU= 19.161
  18:38:58 STEP 2679 H=2679:00 +CPU= 29.689
  18:39:18 STEP 2680 H=2680:00 +CPU= 19.263
  18:39:36 STEP 2681 H=2681:00 +CPU= 18.552
  18:40:06 STEP 2682 H=2682:00 +CPU= 30.105
  18:40:25 STEP 2683 H=2683:00 +CPU= 18.766
  18:40:44 STEP 2684 H=2684:00 +CPU= 18.711
  18:41:13 STEP 2685 H=2685:00 +CPU= 29.350
  18:41:32 STEP 2686 H=2686:00 +CPU= 18.675
  18:41:51 STEP 2687 H=2687:00 +CPU= 18.865
  18:42:26 STEP 2688 H=2688:00 +CPU= 35.022
Moving to projects directory: /config/slots/2/ICMGGhq0f+002688
Moving to projects directory: /config/slots/2/ICMSHhq0f+002688
Moving to projects directory: /config/slots/2/ICMUAhq0f+002688
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002664
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002664
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002664
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002676
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002676
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002676
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_111.zip
Uploading the intermediate file: upload_file_111.zip
  18:42:45 STEP 2689 H=2689:00 +CPU= 18.634
Uploading trickle at timestep: 9676800
  18:43:04 STEP 2690 H=2690:00 +CPU= 19.183
  18:43:33 STEP 2691 H=2691:00 +CPU= 29.567
  18:43:53 STEP 2692 H=2692:00 +CPU= 19.249
  18:44:11 STEP 2693 H=2693:00 +CPU= 18.835
  18:44:42 STEP 2694 H=2694:00 +CPU= 30.602
  18:45:01 STEP 2695 H=2695:00 +CPU= 18.954
  18:45:20 STEP 2696 H=2696:00 +CPU= 18.843
  18:45:50 STEP 2697 H=2697:00 +CPU= 29.804
  18:46:09 STEP 2698 H=2698:00 +CPU= 19.092
  18:46:28 STEP 2699 H=2699:00 +CPU= 19.082
  18:47:00 STEP 2700 H=2700:00 +CPU= 32.523
Moving to projects directory: /config/slots/2/ICMGGhq0f+002700
Moving to projects directory: /config/slots/2/ICMSHhq0f+002700
Moving to projects directory: /config/slots/2/ICMUAhq0f+002700
  18:47:19 STEP 2701 H=2701:00 +CPU= 18.902
  18:47:39 STEP 2702 H=2702:00 +CPU= 19.306
  18:48:08 STEP 2703 H=2703:00 +CPU= 29.452
  18:48:28 STEP 2704 H=2704:00 +CPU= 19.881
  18:48:47 STEP 2705 H=2705:00 +CPU= 18.951
  18:49:18 STEP 2706 H=2706:00 +CPU= 30.887
  18:49:36 STEP 2707 H=2707:00 +CPU= 18.079
  18:49:56 STEP 2708 H=2708:00 +CPU= 19.481
  18:50:25 STEP 2709 H=2709:00 +CPU= 29.193
  18:50:44 STEP 2710 H=2710:00 +CPU= 19.534
  18:51:03 STEP 2711 H=2711:00 +CPU= 19.124
  18:51:39 STEP 2712 H=2712:00 +CPU= 35.257
Moving to projects directory: /config/slots/2/ICMGGhq0f+002712
Moving to projects directory: /config/slots/2/ICMSHhq0f+002712
Moving to projects directory: /config/slots/2/ICMUAhq0f+002712
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002688
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002688
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002688
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002700
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002700
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002700
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_112.zip
Uploading the intermediate file: upload_file_112.zip
  18:51:57 STEP 2713 H=2713:00 +CPU= 18.581
  18:52:16 STEP 2714 H=2714:00 +CPU= 18.791
  18:52:46 STEP 2715 H=2715:00 +CPU= 29.364
  18:53:05 STEP 2716 H=2716:00 +CPU= 19.128
  18:53:23 STEP 2717 H=2717:00 +CPU= 18.674
  18:53:53 STEP 2718 H=2718:00 +CPU= 29.942
  18:54:12 STEP 2719 H=2719:00 +CPU= 18.232
  18:54:30 STEP 2720 H=2720:00 +CPU= 18.576
  18:54:59 STEP 2721 H=2721:00 +CPU= 29.302
  18:55:19 STEP 2722 H=2722:00 +CPU= 19.197
  18:55:37 STEP 2723 H=2723:00 +CPU= 18.072
  18:56:09 STEP 2724 H=2724:00 +CPU= 32.596
Moving to projects directory: /config/slots/2/ICMGGhq0f+002724
Moving to projects directory: /config/slots/2/ICMSHhq0f+002724
Moving to projects directory: /config/slots/2/ICMUAhq0f+002724
  18:56:28 STEP 2725 H=2725:00 +CPU= 18.220
  18:56:46 STEP 2726 H=2726:00 +CPU= 18.766
  18:57:16 STEP 2727 H=2727:00 +CPU= 29.383
  18:57:35 STEP 2728 H=2728:00 +CPU= 19.138
  18:57:53 STEP 2729 H=2729:00 +CPU= 18.281
  18:58:23 STEP 2730 H=2730:00 +CPU= 30.115
  18:58:42 STEP 2731 H=2731:00 +CPU= 18.828
  18:59:02 STEP 2732 H=2732:00 +CPU= 19.575
  18:59:31 STEP 2733 H=2733:00 +CPU= 29.235
  18:59:50 STEP 2734 H=2734:00 +CPU= 19.249
  19:00:09 STEP 2735 H=2735:00 +CPU= 19.068
  19:00:45 STEP 2736 H=2736:00 +CPU= 35.459
Moving to projects directory: /config/slots/2/ICMGGhq0f+002736
Moving to projects directory: /config/slots/2/ICMSHhq0f+002736
Moving to projects directory: /config/slots/2/ICMUAhq0f+002736
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002712
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002712
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002712
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002724
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002724
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002724
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_113.zip
Uploading the intermediate file: upload_file_113.zip
  19:01:04 STEP 2737 H=2737:00 +CPU= 18.897
  19:01:23 STEP 2738 H=2738:00 +CPU= 18.957
  19:01:52 STEP 2739 H=2739:00 +CPU= 29.122
  19:02:11 STEP 2740 H=2740:00 +CPU= 18.629
  19:02:29 STEP 2741 H=2741:00 +CPU= 18.289
  19:02:59 STEP 2742 H=2742:00 +CPU= 30.252
  19:03:18 STEP 2743 H=2743:00 +CPU= 18.639
  19:03:37 STEP 2744 H=2744:00 +CPU= 19.287
  19:04:08 STEP 2745 H=2745:00 +CPU= 30.774
  19:04:27 STEP 2746 H=2746:00 +CPU= 18.949
  19:04:45 STEP 2747 H=2747:00 +CPU= 18.367
  19:05:18 STEP 2748 H=2748:00 +CPU= 33.063
Moving to projects directory: /config/slots/2/ICMGGhq0f+002748
Moving to projects directory: /config/slots/2/ICMSHhq0f+002748
Moving to projects directory: /config/slots/2/ICMUAhq0f+002748
  19:05:37 STEP 2749 H=2749:00 +CPU= 18.498
  19:05:56 STEP 2750 H=2750:00 +CPU= 19.409
  19:06:26 STEP 2751 H=2751:00 +CPU= 30.106
  19:06:45 STEP 2752 H=2752:00 +CPU= 19.019
  19:07:04 STEP 2753 H=2753:00 +CPU= 18.577
  19:07:35 STEP 2754 H=2754:00 +CPU= 31.041
  19:07:53 STEP 2755 H=2755:00 +CPU= 18.359
  19:08:13 STEP 2756 H=2756:00 +CPU= 19.258
  19:08:42 STEP 2757 H=2757:00 +CPU= 29.736
  19:09:01 STEP 2758 H=2758:00 +CPU= 18.833
  19:09:20 STEP 2759 H=2759:00 +CPU= 18.907
  19:09:55 STEP 2760 H=2760:00 +CPU= 34.841
Moving to projects directory: /config/slots/2/ICMGGhq0f+002760
Moving to projects directory: /config/slots/2/ICMSHhq0f+002760
Moving to projects directory: /config/slots/2/ICMUAhq0f+002760
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002736
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002736
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002736
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002748
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002748
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002748
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_114.zip
Uploading the intermediate file: upload_file_114.zip
  19:10:14 STEP 2761 H=2761:00 +CPU= 18.760
  19:10:33 STEP 2762 H=2762:00 +CPU= 18.916
  19:11:03 STEP 2763 H=2763:00 +CPU= 30.491
  19:11:22 STEP 2764 H=2764:00 +CPU= 18.898
  19:11:41 STEP 2765 H=2765:00 +CPU= 18.789
  19:12:11 STEP 2766 H=2766:00 +CPU= 30.395
  19:12:30 STEP 2767 H=2767:00 +CPU= 18.926
  19:12:50 STEP 2768 H=2768:00 +CPU= 19.588
  19:13:19 STEP 2769 H=2769:00 +CPU= 29.377
  19:13:39 STEP 2770 H=2770:00 +CPU= 19.139
  19:13:57 STEP 2771 H=2771:00 +CPU= 18.478
  19:14:30 STEP 2772 H=2772:00 +CPU= 32.986
Moving to projects directory: /config/slots/2/ICMGGhq0f+002772
Moving to projects directory: /config/slots/2/ICMSHhq0f+002772
Moving to projects directory: /config/slots/2/ICMUAhq0f+002772
  19:14:49 STEP 2773 H=2773:00 +CPU= 18.557
  19:15:08 STEP 2774 H=2774:00 +CPU= 19.311
  19:15:38 STEP 2775 H=2775:00 +CPU= 29.855
  19:15:56 STEP 2776 H=2776:00 +CPU= 18.562
  19:16:15 STEP 2777 H=2777:00 +CPU= 18.621
  19:16:45 STEP 2778 H=2778:00 +CPU= 29.978
  19:17:04 STEP 2779 H=2779:00 +CPU= 18.517
  19:17:22 STEP 2780 H=2780:00 +CPU= 18.667
  19:17:52 STEP 2781 H=2781:00 +CPU= 29.590
  19:18:11 STEP 2782 H=2782:00 +CPU= 19.018
  19:18:30 STEP 2783 H=2783:00 +CPU= 19.009
  19:19:07 STEP 2784 H=2784:00 +CPU= 36.759
Moving to projects directory: /config/slots/2/ICMGGhq0f+002784
Moving to projects directory: /config/slots/2/ICMSHhq0f+002784
Moving to projects directory: /config/slots/2/ICMUAhq0f+002784
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002760
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002760
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002760
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002772
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002772
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002772
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_115.zip
Uploading the intermediate file: upload_file_115.zip
  19:19:25 STEP 2785 H=2785:00 +CPU= 18.425
  19:19:44 STEP 2786 H=2786:00 +CPU= 19.355
  19:20:15 STEP 2787 H=2787:00 +CPU= 30.673
  19:20:34 STEP 2788 H=2788:00 +CPU= 19.069
  19:20:53 STEP 2789 H=2789:00 +CPU= 18.474
  19:21:23 STEP 2790 H=2790:00 +CPU= 30.511
  19:21:42 STEP 2791 H=2791:00 +CPU= 18.230
  19:22:00 STEP 2792 H=2792:00 +CPU= 18.588
  19:22:29 STEP 2793 H=2793:00 +CPU= 29.156
  19:22:48 STEP 2794 H=2794:00 +CPU= 18.999
  19:23:07 STEP 2795 H=2795:00 +CPU= 18.792
  19:23:39 STEP 2796 H=2796:00 +CPU= 32.248
Moving to projects directory: /config/slots/2/ICMGGhq0f+002796
Moving to projects directory: /config/slots/2/ICMSHhq0f+002796
Moving to projects directory: /config/slots/2/ICMUAhq0f+002796
  19:23:58 STEP 2797 H=2797:00 +CPU= 18.648
  19:24:17 STEP 2798 H=2798:00 +CPU= 19.060
  19:24:46 STEP 2799 H=2799:00 +CPU= 29.335
  19:25:06 STEP 2800 H=2800:00 +CPU= 19.118
  19:25:25 STEP 2801 H=2801:00 +CPU= 18.888
  19:25:55 STEP 2802 H=2802:00 +CPU= 30.797
  19:26:14 STEP 2803 H=2803:00 +CPU= 18.810
  19:26:34 STEP 2804 H=2804:00 +CPU= 19.656
  19:27:05 STEP 2805 H=2805:00 +CPU= 31.390
  19:27:25 STEP 2806 H=2806:00 +CPU= 19.373
  19:27:44 STEP 2807 H=2807:00 +CPU= 19.670
  19:28:21 STEP 2808 H=2808:00 +CPU= 36.646
Moving to projects directory: /config/slots/2/ICMGGhq0f+002808
Moving to projects directory: /config/slots/2/ICMSHhq0f+002808
Moving to projects directory: /config/slots/2/ICMUAhq0f+002808
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002784
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002784
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002784
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002796
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002796
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002796
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_116.zip
Uploading the intermediate file: upload_file_116.zip
  19:28:39 STEP 2809 H=2809:00 +CPU= 18.289
  19:28:58 STEP 2810 H=2810:00 +CPU= 19.094
  19:29:28 STEP 2811 H=2811:00 +CPU= 29.901
  19:29:48 STEP 2812 H=2812:00 +CPU= 19.593
  19:30:07 STEP 2813 H=2813:00 +CPU= 19.195
  19:30:39 STEP 2814 H=2814:00 +CPU= 31.659
  19:30:57 STEP 2815 H=2815:00 +CPU= 18.687
  19:31:17 STEP 2816 H=2816:00 +CPU= 19.693
  19:31:47 STEP 2817 H=2817:00 +CPU= 29.908
  19:32:06 STEP 2818 H=2818:00 +CPU= 19.232
  19:32:25 STEP 2819 H=2819:00 +CPU= 18.555
  19:32:57 STEP 2820 H=2820:00 +CPU= 32.429
Moving to projects directory: /config/slots/2/ICMGGhq0f+002820
Moving to projects directory: /config/slots/2/ICMSHhq0f+002820
Moving to projects directory: /config/slots/2/ICMUAhq0f+002820
  19:33:16 STEP 2821 H=2821:00 +CPU= 18.241
  19:33:34 STEP 2822 H=2822:00 +CPU= 18.838
  19:34:05 STEP 2823 H=2823:00 +CPU= 30.032
  19:34:23 STEP 2824 H=2824:00 +CPU= 18.885
  19:34:42 STEP 2825 H=2825:00 +CPU= 18.379
  19:35:12 STEP 2826 H=2826:00 +CPU= 30.546
  19:35:31 STEP 2827 H=2827:00 +CPU= 18.568
  19:35:50 STEP 2828 H=2828:00 +CPU= 19.064
  19:36:20 STEP 2829 H=2829:00 +CPU= 29.885
  19:36:39 STEP 2830 H=2830:00 +CPU= 19.076
  19:36:58 STEP 2831 H=2831:00 +CPU= 18.927
  19:37:34 STEP 2832 H=2832:00 +CPU= 35.758
Moving to projects directory: /config/slots/2/ICMGGhq0f+002832
Moving to projects directory: /config/slots/2/ICMSHhq0f+002832
Moving to projects directory: /config/slots/2/ICMUAhq0f+002832
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002808
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002808
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002808
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002820
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002820
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002820
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_117.zip
Uploading the intermediate file: upload_file_117.zip
  19:37:52 STEP 2833 H=2833:00 +CPU= 18.716
  19:38:11 STEP 2834 H=2834:00 +CPU= 18.720
  19:38:41 STEP 2835 H=2835:00 +CPU= 29.846
  19:39:00 STEP 2836 H=2836:00 +CPU= 18.639
  19:39:18 STEP 2837 H=2837:00 +CPU= 18.683
  19:39:48 STEP 2838 H=2838:00 +CPU= 29.946
  19:40:07 STEP 2839 H=2839:00 +CPU= 18.356
  19:40:26 STEP 2840 H=2840:00 +CPU= 18.988
  19:40:55 STEP 2841 H=2841:00 +CPU= 29.427
  19:41:15 STEP 2842 H=2842:00 +CPU= 19.602
  19:41:34 STEP 2843 H=2843:00 +CPU= 18.992
  19:42:07 STEP 2844 H=2844:00 +CPU= 32.888
Moving to projects directory: /config/slots/2/ICMGGhq0f+002844
Moving to projects directory: /config/slots/2/ICMSHhq0f+002844
Moving to projects directory: /config/slots/2/ICMUAhq0f+002844
  19:42:25 STEP 2845 H=2845:00 +CPU= 18.431
  19:42:44 STEP 2846 H=2846:00 +CPU= 19.109
  19:43:14 STEP 2847 H=2847:00 +CPU= 29.839
  19:43:33 STEP 2848 H=2848:00 +CPU= 18.743
  19:43:51 STEP 2849 H=2849:00 +CPU= 18.470
  19:44:22 STEP 2850 H=2850:00 +CPU= 30.471
  19:44:40 STEP 2851 H=2851:00 +CPU= 18.417
  19:44:59 STEP 2852 H=2852:00 +CPU= 18.947
  19:45:29 STEP 2853 H=2853:00 +CPU= 30.190
  19:45:48 STEP 2854 H=2854:00 +CPU= 19.037
  19:46:08 STEP 2855 H=2855:00 +CPU= 19.220
  19:46:43 STEP 2856 H=2856:00 +CPU= 34.885
Moving to projects directory: /config/slots/2/ICMGGhq0f+002856
Moving to projects directory: /config/slots/2/ICMSHhq0f+002856
Moving to projects directory: /config/slots/2/ICMUAhq0f+002856
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002832
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002832
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002832
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002844
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002844
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002844
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_118.zip
Uploading the intermediate file: upload_file_118.zip
  19:47:01 STEP 2857 H=2857:00 +CPU= 18.382
  19:47:20 STEP 2858 H=2858:00 +CPU= 19.273
  19:47:49 STEP 2859 H=2859:00 +CPU= 29.192
  19:48:08 STEP 2860 H=2860:00 +CPU= 18.712
  19:48:26 STEP 2861 H=2861:00 +CPU= 17.843
  19:48:56 STEP 2862 H=2862:00 +CPU= 29.963
  19:49:15 STEP 2863 H=2863:00 +CPU= 18.538
  19:49:33 STEP 2864 H=2864:00 +CPU= 18.847
  19:50:02 STEP 2865 H=2865:00 +CPU= 28.530
  19:50:21 STEP 2866 H=2866:00 +CPU= 18.987
  19:50:40 STEP 2867 H=2867:00 +CPU= 18.579
  19:51:13 STEP 2868 H=2868:00 +CPU= 33.761
Moving to projects directory: /config/slots/2/ICMGGhq0f+002868
Moving to projects directory: /config/slots/2/ICMSHhq0f+002868
Moving to projects directory: /config/slots/2/ICMUAhq0f+002868
  19:51:32 STEP 2869 H=2869:00 +CPU= 18.171
  19:51:51 STEP 2870 H=2870:00 +CPU= 19.347
  19:52:20 STEP 2871 H=2871:00 +CPU= 29.452
  19:52:39 STEP 2872 H=2872:00 +CPU= 19.092
  19:52:58 STEP 2873 H=2873:00 +CPU= 18.249
  19:53:28 STEP 2874 H=2874:00 +CPU= 30.647
  19:53:47 STEP 2875 H=2875:00 +CPU= 18.423
  19:54:06 STEP 2876 H=2876:00 +CPU= 18.935
  19:54:35 STEP 2877 H=2877:00 +CPU= 29.141
  19:54:54 STEP 2878 H=2878:00 +CPU= 19.060
  19:55:13 STEP 2879 H=2879:00 +CPU= 18.896
  19:55:48 STEP 2880 H=2880:00 +CPU= 35.208
Moving to projects directory: /config/slots/2/ICMGGhq0f+002880
Moving to projects directory: /config/slots/2/ICMSHhq0f+002880
Moving to projects directory: /config/slots/2/ICMUAhq0f+002880
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002856
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002856
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002856
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002868
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002868
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002868
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_119.zip
Uploading the intermediate file: upload_file_119.zip
  19:56:07 STEP 2881 H=2881:00 +CPU= 19.014
  19:56:26 STEP 2882 H=2882:00 +CPU= 18.989
  19:56:56 STEP 2883 H=2883:00 +CPU= 29.574
  19:57:15 STEP 2884 H=2884:00 +CPU= 19.333
  19:57:34 STEP 2885 H=2885:00 +CPU= 18.720
  19:58:04 STEP 2886 H=2886:00 +CPU= 30.304
  19:58:22 STEP 2887 H=2887:00 +CPU= 18.248
  19:58:41 STEP 2888 H=2888:00 +CPU= 18.772
  19:59:10 STEP 2889 H=2889:00 +CPU= 29.257
  19:59:30 STEP 2890 H=2890:00 +CPU= 19.078
  19:59:48 STEP 2891 H=2891:00 +CPU= 18.459
  20:00:21 STEP 2892 H=2892:00 +CPU= 33.310
Moving to projects directory: /config/slots/2/ICMGGhq0f+002892
Moving to projects directory: /config/slots/2/ICMSHhq0f+002892
Moving to projects directory: /config/slots/2/ICMUAhq0f+002892
  20:00:40 STEP 2893 H=2893:00 +CPU= 18.810
  20:00:59 STEP 2894 H=2894:00 +CPU= 18.767
  20:01:30 STEP 2895 H=2895:00 +CPU= 30.667
  20:01:49 STEP 2896 H=2896:00 +CPU= 19.443
  20:02:08 STEP 2897 H=2897:00 +CPU= 18.841
  20:02:38 STEP 2898 H=2898:00 +CPU= 30.041
  20:02:57 STEP 2899 H=2899:00 +CPU= 18.514
  20:03:16 STEP 2900 H=2900:00 +CPU= 19.897
  20:03:46 STEP 2901 H=2901:00 +CPU= 29.697
  20:04:05 STEP 2902 H=2902:00 +CPU= 18.695
  20:04:23 STEP 2903 H=2903:00 +CPU= 18.456
  20:05:00 STEP 2904 H=2904:00 +CPU= 36.436
Moving to projects directory: /config/slots/2/ICMGGhq0f+002904
Moving to projects directory: /config/slots/2/ICMSHhq0f+002904
Moving to projects directory: /config/slots/2/ICMUAhq0f+002904
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002880
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002880
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002880
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002892
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002892
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002892
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_120.zip
Uploading the intermediate file: upload_file_120.zip
  20:05:19 STEP 2905 H=2905:00 +CPU= 18.992
  20:05:38 STEP 2906 H=2906:00 +CPU= 18.796
  20:06:08 STEP 2907 H=2907:00 +CPU= 30.141
  20:06:27 STEP 2908 H=2908:00 +CPU= 19.009
  20:06:46 STEP 2909 H=2909:00 +CPU= 18.967
  20:07:19 STEP 2910 H=2910:00 +CPU= 32.899
  20:07:37 STEP 2911 H=2911:00 +CPU= 18.504
  20:07:57 STEP 2912 H=2912:00 +CPU= 19.556
  20:08:27 STEP 2913 H=2913:00 +CPU= 29.750
  20:08:46 STEP 2914 H=2914:00 +CPU= 19.173
  20:09:04 STEP 2915 H=2915:00 +CPU= 18.566
  20:09:37 STEP 2916 H=2916:00 +CPU= 32.906
Moving to projects directory: /config/slots/2/ICMGGhq0f+002916
Moving to projects directory: /config/slots/2/ICMSHhq0f+002916
Moving to projects directory: /config/slots/2/ICMUAhq0f+002916
  20:09:55 STEP 2917 H=2917:00 +CPU= 18.073
  20:10:15 STEP 2918 H=2918:00 +CPU= 19.463
  20:10:45 STEP 2919 H=2919:00 +CPU= 30.166
  20:11:04 STEP 2920 H=2920:00 +CPU= 19.341
  20:11:23 STEP 2921 H=2921:00 +CPU= 18.624
  20:11:54 STEP 2922 H=2922:00 +CPU= 30.739
  20:12:13 STEP 2923 H=2923:00 +CPU= 18.981
  20:12:33 STEP 2924 H=2924:00 +CPU= 19.758
  20:13:05 STEP 2925 H=2925:00 +CPU= 32.009
  20:13:24 STEP 2926 H=2926:00 +CPU= 19.064
  20:13:43 STEP 2927 H=2927:00 +CPU= 19.238
  20:14:19 STEP 2928 H=2928:00 +CPU= 36.242
Moving to projects directory: /config/slots/2/ICMGGhq0f+002928
Moving to projects directory: /config/slots/2/ICMSHhq0f+002928
Moving to projects directory: /config/slots/2/ICMUAhq0f+002928
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002904
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002904
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002904
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002916
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002916
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002916
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_121.zip
Uploading the intermediate file: upload_file_121.zip
  20:14:39 STEP 2929 H=2929:00 +CPU= 19.311
Uploading trickle at timestep: 10540800
  20:14:58 STEP 2930 H=2930:00 +CPU= 19.682
  20:15:30 STEP 2931 H=2931:00 +CPU= 31.242
  20:15:49 STEP 2932 H=2932:00 +CPU= 19.722
  20:16:08 STEP 2933 H=2933:00 +CPU= 18.866
  20:16:39 STEP 2934 H=2934:00 +CPU= 31.007
  20:16:58 STEP 2935 H=2935:00 +CPU= 18.556
  20:17:18 STEP 2936 H=2936:00 +CPU= 20.004
  20:17:48 STEP 2937 H=2937:00 +CPU= 29.987
  20:18:07 STEP 2938 H=2938:00 +CPU= 19.233
  20:18:26 STEP 2939 H=2939:00 +CPU= 18.799
  20:19:01 STEP 2940 H=2940:00 +CPU= 34.805
Moving to projects directory: /config/slots/2/ICMGGhq0f+002940
Moving to projects directory: /config/slots/2/ICMSHhq0f+002940
Moving to projects directory: /config/slots/2/ICMUAhq0f+002940
  20:19:20 STEP 2941 H=2941:00 +CPU= 19.497
  20:19:40 STEP 2942 H=2942:00 +CPU= 19.285
  20:20:11 STEP 2943 H=2943:00 +CPU= 31.521
  20:20:31 STEP 2944 H=2944:00 +CPU= 19.875
  20:20:50 STEP 2945 H=2945:00 +CPU= 19.136
  20:21:23 STEP 2946 H=2946:00 +CPU= 32.870
  20:21:42 STEP 2947 H=2947:00 +CPU= 18.903
  20:22:01 STEP 2948 H=2948:00 +CPU= 19.284
  20:22:31 STEP 2949 H=2949:00 +CPU= 30.218
  20:22:51 STEP 2950 H=2950:00 +CPU= 19.599
  20:23:10 STEP 2951 H=2951:00 +CPU= 19.233
  20:23:47 STEP 2952 H=2952:00 +CPU= 36.100
The child process terminated with status: 0
Moving to projects directory: /config/slots/2/ICMGGhq0f+002952
Moving to projects directory: /config/slots/2/ICMSHhq0f+002952
Moving to projects directory: /config/slots/2/ICMUAhq0f+002952
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002940
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002940
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002940
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002952
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002928
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002952
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMSHhq0f+002928
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMGGhq0f+002928
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12184311/ICMUAhq0f+002952
Zipping up the final file: /config/projects/climateprediction.net/oifs_43r3_ps_0667_1998050100_123_967_12184311_1_r1888180265_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
20:27:10 (466): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:47:05 1535036 22304934 oifs_43r3_ps_0667_1998050100_123_967_12184311_1 10,623,600 70,589 0.0066
09 May 2023 16:47:05 1535036 22304934 oifs_43r3_ps_0667_1998050100_123_967_12184311_1 10,540,800 70,023 0.0066
09 May 2023 16:47:04 1535036 22304934 oifs_43r3_ps_0667_1998050100_123_967_12184311_1 9,676,800 64,518 0.0067
09 May 2023 16:47:01 1535036 22304934 oifs_43r3_ps_0667_1998050100_123_967_12184311_1 8,812,800 59,024 0.0067
09 May 2023 16:47:00 1535036 22304934 oifs_43r3_ps_0667_1998050100_123_967_12184311_1 7,948,800 53,530 0.0067
09 May 2023 16:46:59 1535036 22304934 oifs_43r3_ps_0667_1998050100_123_967_12184311_1 7,084,800 48,017 0.0068
09 May 2023 16:46:57 1535036 22304934 oifs_43r3_ps_0667_1998050100_123_967_12184311_1 6,220,800 42,545 0.0068
09 May 2023 16:46:56 1535036 22304934 oifs_43r3_ps_0667_1998050100_123_967_12184311_1 5,356,800 37,064 0.0069
09 May 2023 16:46:10 1535036 22304934 oifs_43r3_ps_0667_1998050100_123_967_12184311_1 4,320,000 30,282 0.0070
09 May 2023 16:46:07 1535036 22304934 oifs_43r3_ps_0667_1998050100_123_967_12184311_1 3,456,000 24,359 0.0070
09 May 2023 16:46:04 1535036 22304934 oifs_43r3_ps_0667_1998050100_123_967_12184311_1 2,592,000 18,356 0.0071
09 May 2023 16:46:03 1535036 22304934 oifs_43r3_ps_0667_1998050100_123_967_12184311_1 1,728,000 12,334 0.0071
09 May 2023 16:46:01 1535036 22304934 oifs_43r3_ps_0667_1998050100_123_967_12184311_1 864,000 6,372 0.0074


©2024 climateprediction.net