climateprediction.net home page
Task 22294312

Task 22294312

Name oifs_43r3_ps_2232_2021050100_123_947_12165321_1
Workunit 12165321
Created 29 Dec 2022, 13:31:19 UTC
Sent 22 Jan 2023, 15:25:24 UTC
Report deadline 23 Mar 2023, 15:25:24 UTC
Received 26 Jan 2023, 23:50:53 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1538515
Run time 10 hours 59 min 36 sec
CPU time 10 hours 54 min 18 sec
Validate state Valid
Credit 14,515.20
Device peak FLOPS 9.06 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,401.29 MB
Peak swap size 4,974.26 MB
Peak disk usage 2,956.55 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
he zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002268
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_94.zip
Uploading the intermediate file: upload_file_94.zip
  01:46:18 STEP 2281 H=2281:00 +CPU= 10.824
  01:46:29 STEP 2282 H=2282:00 +CPU= 10.249
  01:46:46 STEP 2283 H=2283:00 +CPU= 17.509
  01:46:57 STEP 2284 H=2284:00 +CPU= 11.287
  01:47:07 STEP 2285 H=2285:00 +CPU=  9.991
  01:47:25 STEP 2286 H=2286:00 +CPU= 17.530
  01:47:36 STEP 2287 H=2287:00 +CPU= 10.898
  01:47:47 STEP 2288 H=2288:00 +CPU= 10.695
  01:48:04 STEP 2289 H=2289:00 +CPU= 17.341
  01:48:15 STEP 2290 H=2290:00 +CPU= 11.449
  01:48:26 STEP 2291 H=2291:00 +CPU= 10.599
  01:48:45 STEP 2292 H=2292:00 +CPU= 19.132
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002292
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002292
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002292
  01:48:56 STEP 2293 H=2293:00 +CPU= 11.140
  01:49:07 STEP 2294 H=2294:00 +CPU= 10.634
  01:49:24 STEP 2295 H=2295:00 +CPU= 17.045
  01:49:36 STEP 2296 H=2296:00 +CPU= 11.564
  01:49:46 STEP 2297 H=2297:00 +CPU= 10.735
  01:50:04 STEP 2298 H=2298:00 +CPU= 17.540
  01:50:15 STEP 2299 H=2299:00 +CPU= 11.110
  01:50:26 STEP 2300 H=2300:00 +CPU= 11.011
  01:50:43 STEP 2301 H=2301:00 +CPU= 17.093
  01:50:54 STEP 2302 H=2302:00 +CPU= 11.354
  01:51:05 STEP 2303 H=2303:00 +CPU= 10.999
  01:51:26 STEP 2304 H=2304:00 +CPU= 20.442
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002304
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002304
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002304
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002280
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002280
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002280
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002292
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002292
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002292
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_95.zip
Uploading the intermediate file: upload_file_95.zip
  01:51:37 STEP 2305 H=2305:00 +CPU= 10.870
  01:51:47 STEP 2306 H=2306:00 +CPU= 10.643
  01:52:05 STEP 2307 H=2307:00 +CPU= 17.128
  01:52:16 STEP 2308 H=2308:00 +CPU= 11.172
  01:52:26 STEP 2309 H=2309:00 +CPU= 10.586
  01:52:44 STEP 2310 H=2310:00 +CPU= 17.222
  01:52:55 STEP 2311 H=2311:00 +CPU= 11.020
  01:53:06 STEP 2312 H=2312:00 +CPU= 10.902
  01:53:23 STEP 2313 H=2313:00 +CPU= 17.004
  01:53:34 STEP 2314 H=2314:00 +CPU= 11.426
  01:53:45 STEP 2315 H=2315:00 +CPU= 10.953
  01:54:04 STEP 2316 H=2316:00 +CPU= 18.681
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002316
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002316
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002316
  01:54:15 STEP 2317 H=2317:00 +CPU= 10.799
  01:54:25 STEP 2318 H=2318:00 +CPU= 10.789
  01:54:42 STEP 2319 H=2319:00 +CPU= 17.062
  01:54:54 STEP 2320 H=2320:00 +CPU= 11.448
  01:55:05 STEP 2321 H=2321:00 +CPU= 10.644
  01:55:22 STEP 2322 H=2322:00 +CPU= 17.360
  01:55:33 STEP 2323 H=2323:00 +CPU= 11.064
  01:55:44 STEP 2324 H=2324:00 +CPU= 11.141
  01:56:01 STEP 2325 H=2325:00 +CPU= 17.003
  01:56:13 STEP 2326 H=2326:00 +CPU= 11.574
  01:56:24 STEP 2327 H=2327:00 +CPU= 11.409
  01:56:45 STEP 2328 H=2328:00 +CPU= 20.147
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002328
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002328
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002328
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002304
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002304
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002304
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002316
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002316
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002316
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_96.zip
Uploading the intermediate file: upload_file_96.zip
  01:56:56 STEP 2329 H=2329:00 +CPU= 11.053
  01:57:07 STEP 2330 H=2330:00 +CPU= 10.907
  01:57:23 STEP 2331 H=2331:00 +CPU= 16.824
  01:57:35 STEP 2332 H=2332:00 +CPU= 11.190
  01:57:45 STEP 2333 H=2333:00 +CPU= 10.658
  01:58:03 STEP 2334 H=2334:00 +CPU= 17.292
  01:58:14 STEP 2335 H=2335:00 +CPU= 10.994
  01:58:25 STEP 2336 H=2336:00 +CPU= 10.931
  01:58:42 STEP 2337 H=2337:00 +CPU= 16.914
  01:58:53 STEP 2338 H=2338:00 +CPU= 11.347
  01:59:04 STEP 2339 H=2339:00 +CPU= 10.847
  01:59:23 STEP 2340 H=2340:00 +CPU= 18.790
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002340
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002340
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002340
  01:59:34 STEP 2341 H=2341:00 +CPU= 11.289
  01:59:45 STEP 2342 H=2342:00 +CPU= 11.367
  02:00:02 STEP 2343 H=2343:00 +CPU= 17.092
  02:00:14 STEP 2344 H=2344:00 +CPU= 11.413
  02:00:25 STEP 2345 H=2345:00 +CPU= 10.956
  02:00:41 STEP 2346 H=2346:00 +CPU= 16.575
  02:00:52 STEP 2347 H=2347:00 +CPU= 11.120
  02:01:04 STEP 2348 H=2348:00 +CPU= 11.201
  02:01:21 STEP 2349 H=2349:00 +CPU= 17.002
  02:01:32 STEP 2350 H=2350:00 +CPU= 11.358
  02:01:43 STEP 2351 H=2351:00 +CPU= 11.129
  02:02:04 STEP 2352 H=2352:00 +CPU= 20.171
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002352
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002352
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002352
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002328
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002328
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002328
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002340
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002340
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002340
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_97.zip
Uploading the intermediate file: upload_file_97.zip
  02:02:15 STEP 2353 H=2353:00 +CPU= 11.015
  02:02:26 STEP 2354 H=2354:00 +CPU= 10.949
  02:02:43 STEP 2355 H=2355:00 +CPU= 16.974
  02:02:54 STEP 2356 H=2356:00 +CPU= 11.271
  02:03:05 STEP 2357 H=2357:00 +CPU= 10.728
  02:03:22 STEP 2358 H=2358:00 +CPU= 17.183
  02:03:33 STEP 2359 H=2359:00 +CPU= 11.106
  02:03:44 STEP 2360 H=2360:00 +CPU= 11.079
  02:04:01 STEP 2361 H=2361:00 +CPU= 17.174
  02:04:13 STEP 2362 H=2362:00 +CPU= 11.348
  02:04:24 STEP 2363 H=2363:00 +CPU= 10.995
  02:04:43 STEP 2364 H=2364:00 +CPU= 18.931
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002364
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002364
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002364
  02:04:54 STEP 2365 H=2365:00 +CPU= 11.026
  02:05:04 STEP 2366 H=2366:00 +CPU= 10.863
  02:05:21 STEP 2367 H=2367:00 +CPU= 16.872
  02:05:33 STEP 2368 H=2368:00 +CPU= 11.196
  02:05:44 STEP 2369 H=2369:00 +CPU= 10.965
  02:06:01 STEP 2370 H=2370:00 +CPU= 17.137
  02:06:12 STEP 2371 H=2371:00 +CPU= 11.194
  02:06:23 STEP 2372 H=2372:00 +CPU= 11.310
  02:06:41 STEP 2373 H=2373:00 +CPU= 17.261
  02:06:52 STEP 2374 H=2374:00 +CPU= 11.166
  02:07:03 STEP 2375 H=2375:00 +CPU= 11.305
  02:07:23 STEP 2376 H=2376:00 +CPU= 20.030
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002376
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002376
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002376
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002352
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002352
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002352
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002364
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002364
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002364
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_98.zip
Uploading the intermediate file: upload_file_98.zip
  02:07:34 STEP 2377 H=2377:00 +CPU= 10.894
  02:07:45 STEP 2378 H=2378:00 +CPU= 11.198
  02:08:02 STEP 2379 H=2379:00 +CPU= 17.104
  02:08:13 STEP 2380 H=2380:00 +CPU= 10.933
  02:08:24 STEP 2381 H=2381:00 +CPU= 10.920
  02:08:42 STEP 2382 H=2382:00 +CPU= 17.357
  02:08:53 STEP 2383 H=2383:00 +CPU= 11.059
  02:09:04 STEP 2384 H=2384:00 +CPU= 11.297
  02:09:21 STEP 2385 H=2385:00 +CPU= 17.251
  02:09:32 STEP 2386 H=2386:00 +CPU= 11.101
  02:09:43 STEP 2387 H=2387:00 +CPU= 10.851
  02:10:02 STEP 2388 H=2388:00 +CPU= 18.616
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002388
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002388
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002388
  02:10:13 STEP 2389 H=2389:00 +CPU= 11.038
  02:10:24 STEP 2390 H=2390:00 +CPU= 11.554
  02:10:41 STEP 2391 H=2391:00 +CPU= 17.089
  02:10:53 STEP 2392 H=2392:00 +CPU= 11.332
  02:11:04 STEP 2393 H=2393:00 +CPU= 10.925
  02:11:21 STEP 2394 H=2394:00 +CPU= 17.220
  02:11:32 STEP 2395 H=2395:00 +CPU= 11.098
  02:11:43 STEP 2396 H=2396:00 +CPU= 11.200
  02:12:00 STEP 2397 H=2397:00 +CPU= 17.017
  02:12:12 STEP 2398 H=2398:00 +CPU= 11.533
  02:12:23 STEP 2399 H=2399:00 +CPU= 11.544
  02:12:44 STEP 2400 H=2400:00 +CPU= 20.437
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002400
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002400
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002400
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002376
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002376
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002376
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002388
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002388
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002388
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_99.zip
Uploading the intermediate file: upload_file_99.zip
  02:12:55 STEP 2401 H=2401:00 +CPU= 11.059
  02:13:06 STEP 2402 H=2402:00 +CPU= 10.959
Uploading trickle at timestep: 8640000
  02:13:23 STEP 2403 H=2403:00 +CPU= 17.172
  02:13:34 STEP 2404 H=2404:00 +CPU= 11.176
  02:13:45 STEP 2405 H=2405:00 +CPU= 10.855
  02:14:03 STEP 2406 H=2406:00 +CPU= 17.408
  02:14:14 STEP 2407 H=2407:00 +CPU= 11.375
  02:14:25 STEP 2408 H=2408:00 +CPU= 11.187
  02:14:42 STEP 2409 H=2409:00 +CPU= 17.055
  02:14:54 STEP 2410 H=2410:00 +CPU= 11.374
  02:15:04 STEP 2411 H=2411:00 +CPU= 10.655
  02:15:23 STEP 2412 H=2412:00 +CPU= 18.940
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002412
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002412
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002412
  02:15:35 STEP 2413 H=2413:00 +CPU= 11.331
  02:15:46 STEP 2414 H=2414:00 +CPU= 11.320
  02:16:03 STEP 2415 H=2415:00 +CPU= 17.055
  02:16:14 STEP 2416 H=2416:00 +CPU= 11.295
  02:16:25 STEP 2417 H=2417:00 +CPU= 10.814
  02:16:43 STEP 2418 H=2418:00 +CPU= 17.433
  02:16:54 STEP 2419 H=2419:00 +CPU= 11.005
  02:17:05 STEP 2420 H=2420:00 +CPU= 11.228
  02:17:22 STEP 2421 H=2421:00 +CPU= 16.920
  02:17:33 STEP 2422 H=2422:00 +CPU= 11.317
  02:17:44 STEP 2423 H=2423:00 +CPU= 11.207
  02:18:05 STEP 2424 H=2424:00 +CPU= 20.578
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002424
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002424
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002424
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002400
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002400
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002400
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002412
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002412
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002412
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_100.zip
Uploading the intermediate file: upload_file_100.zip
  02:18:16 STEP 2425 H=2425:00 +CPU= 10.814
  02:18:27 STEP 2426 H=2426:00 +CPU= 10.818
  02:18:44 STEP 2427 H=2427:00 +CPU= 16.847
  02:18:55 STEP 2428 H=2428:00 +CPU= 11.264
  02:19:06 STEP 2429 H=2429:00 +CPU= 10.646
  02:19:23 STEP 2430 H=2430:00 +CPU= 17.207
  02:19:34 STEP 2431 H=2431:00 +CPU= 11.152
  02:19:45 STEP 2432 H=2432:00 +CPU= 11.118
  02:20:02 STEP 2433 H=2433:00 +CPU= 16.915
  02:20:14 STEP 2434 H=2434:00 +CPU= 11.542
  02:20:25 STEP 2435 H=2435:00 +CPU= 11.056
  02:20:43 STEP 2436 H=2436:00 +CPU= 18.635
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002436
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002436
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002436
  02:20:55 STEP 2437 H=2437:00 +CPU= 11.326
  02:21:06 STEP 2438 H=2438:00 +CPU= 11.175
  02:21:22 STEP 2439 H=2439:00 +CPU= 16.681
  02:21:34 STEP 2440 H=2440:00 +CPU= 11.446
  02:21:45 STEP 2441 H=2441:00 +CPU= 10.896
  02:22:02 STEP 2442 H=2442:00 +CPU= 17.143
  02:22:13 STEP 2443 H=2443:00 +CPU= 11.397
  02:22:25 STEP 2444 H=2444:00 +CPU= 11.676
  02:22:42 STEP 2445 H=2445:00 +CPU= 16.735
  02:22:53 STEP 2446 H=2446:00 +CPU= 11.551
  02:23:05 STEP 2447 H=2447:00 +CPU= 11.459
  02:23:25 STEP 2448 H=2448:00 +CPU= 20.212
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002448
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002448
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002448
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002424
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002424
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002424
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002436
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002436
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002436
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_101.zip
Uploading the intermediate file: upload_file_101.zip
  02:23:36 STEP 2449 H=2449:00 +CPU= 10.913
  02:23:47 STEP 2450 H=2450:00 +CPU= 10.922
  02:24:04 STEP 2451 H=2451:00 +CPU= 17.398
  02:24:16 STEP 2452 H=2452:00 +CPU= 11.645
  02:24:27 STEP 2453 H=2453:00 +CPU= 10.834
  02:24:45 STEP 2454 H=2454:00 +CPU= 18.004
  02:24:56 STEP 2455 H=2455:00 +CPU= 11.159
  02:25:07 STEP 2456 H=2456:00 +CPU= 11.183
  02:25:25 STEP 2457 H=2457:00 +CPU= 17.186
  02:25:36 STEP 2458 H=2458:00 +CPU= 11.591
  02:25:47 STEP 2459 H=2459:00 +CPU= 10.803
  02:26:06 STEP 2460 H=2460:00 +CPU= 18.707
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002460
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002460
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002460
  02:26:17 STEP 2461 H=2461:00 +CPU= 11.181
  02:26:28 STEP 2462 H=2462:00 +CPU= 10.673
  02:26:45 STEP 2463 H=2463:00 +CPU= 17.100
  02:26:56 STEP 2464 H=2464:00 +CPU= 11.397
  02:27:07 STEP 2465 H=2465:00 +CPU= 10.594
  02:27:24 STEP 2466 H=2466:00 +CPU= 17.073
  02:27:35 STEP 2467 H=2467:00 +CPU= 11.086
  02:27:46 STEP 2468 H=2468:00 +CPU= 11.219
  02:28:03 STEP 2469 H=2469:00 +CPU= 17.040
  02:28:15 STEP 2470 H=2470:00 +CPU= 11.431
  02:28:26 STEP 2471 H=2471:00 +CPU= 11.350
  02:28:46 STEP 2472 H=2472:00 +CPU= 20.018
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002472
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002472
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002472
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002448
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002448
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002448
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002460
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002460
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002460
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_102.zip
Uploading the intermediate file: upload_file_102.zip
  02:28:57 STEP 2473 H=2473:00 +CPU= 10.830
  02:29:08 STEP 2474 H=2474:00 +CPU= 10.976
  02:29:25 STEP 2475 H=2475:00 +CPU= 17.070
  02:29:36 STEP 2476 H=2476:00 +CPU= 11.253
  02:29:47 STEP 2477 H=2477:00 +CPU= 10.896
  02:30:04 STEP 2478 H=2478:00 +CPU= 16.979
  02:30:15 STEP 2479 H=2479:00 +CPU= 11.088
  02:30:26 STEP 2480 H=2480:00 +CPU= 11.333
  02:30:44 STEP 2481 H=2481:00 +CPU= 17.055
  02:30:55 STEP 2482 H=2482:00 +CPU= 11.322
  02:31:06 STEP 2483 H=2483:00 +CPU= 10.903
  02:31:24 STEP 2484 H=2484:00 +CPU= 18.527
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002484
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002484
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002484
  02:31:36 STEP 2485 H=2485:00 +CPU= 11.395
  02:31:47 STEP 2486 H=2486:00 +CPU= 11.161
  02:32:04 STEP 2487 H=2487:00 +CPU= 16.910
  02:32:16 STEP 2488 H=2488:00 +CPU= 11.675
  02:32:26 STEP 2489 H=2489:00 +CPU= 10.889
  02:32:44 STEP 2490 H=2490:00 +CPU= 17.167
  02:32:55 STEP 2491 H=2491:00 +CPU= 11.264
  02:33:06 STEP 2492 H=2492:00 +CPU= 11.112
  02:33:23 STEP 2493 H=2493:00 +CPU= 17.092
  02:33:35 STEP 2494 H=2494:00 +CPU= 11.648
  02:33:46 STEP 2495 H=2495:00 +CPU= 11.392
  02:34:07 STEP 2496 H=2496:00 +CPU= 20.395
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002496
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002496
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002496
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002472
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002472
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002472
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002484
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002484
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002484
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_103.zip
Uploading the intermediate file: upload_file_103.zip
  02:34:18 STEP 2497 H=2497:00 +CPU= 10.922
  02:34:29 STEP 2498 H=2498:00 +CPU= 10.782
  02:34:46 STEP 2499 H=2499:00 +CPU= 17.181
  02:34:57 STEP 2500 H=2500:00 +CPU= 11.322
  02:35:08 STEP 2501 H=2501:00 +CPU= 10.734
  02:35:26 STEP 2502 H=2502:00 +CPU= 17.328
  02:35:37 STEP 2503 H=2503:00 +CPU= 11.111
  02:35:48 STEP 2504 H=2504:00 +CPU= 10.950
  02:36:05 STEP 2505 H=2505:00 +CPU= 17.054
  02:36:17 STEP 2506 H=2506:00 +CPU= 11.504
  02:36:27 STEP 2507 H=2507:00 +CPU= 10.749
  02:36:46 STEP 2508 H=2508:00 +CPU= 18.692
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002508
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002508
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002508
  02:36:57 STEP 2509 H=2509:00 +CPU= 11.061
  02:37:08 STEP 2510 H=2510:00 +CPU= 10.865
  02:37:25 STEP 2511 H=2511:00 +CPU= 16.917
  02:37:37 STEP 2512 H=2512:00 +CPU= 11.459
  02:37:47 STEP 2513 H=2513:00 +CPU= 10.490
  02:38:04 STEP 2514 H=2514:00 +CPU= 17.149
  02:38:15 STEP 2515 H=2515:00 +CPU= 10.963
  02:38:27 STEP 2516 H=2516:00 +CPU= 11.368
  02:38:43 STEP 2517 H=2517:00 +CPU= 16.660
  02:38:55 STEP 2518 H=2518:00 +CPU= 11.545
  02:39:06 STEP 2519 H=2519:00 +CPU= 11.389
  02:39:27 STEP 2520 H=2520:00 +CPU= 20.469
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002520
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002520
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002520
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002496
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002496
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002496
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002508
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002508
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002508
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_104.zip
Uploading the intermediate file: upload_file_104.zip
  02:39:38 STEP 2521 H=2521:00 +CPU= 11.011
  02:39:49 STEP 2522 H=2522:00 +CPU= 10.655
  02:40:06 STEP 2523 H=2523:00 +CPU= 17.464
  02:40:18 STEP 2524 H=2524:00 +CPU= 11.502
  02:40:28 STEP 2525 H=2525:00 +CPU= 10.497
  02:40:45 STEP 2526 H=2526:00 +CPU= 17.284
  02:40:57 STEP 2527 H=2527:00 +CPU= 11.228
  02:41:08 STEP 2528 H=2528:00 +CPU= 11.039
  02:41:25 STEP 2529 H=2529:00 +CPU= 17.170
  02:41:36 STEP 2530 H=2530:00 +CPU= 11.448
  02:41:47 STEP 2531 H=2531:00 +CPU= 10.986
  02:42:07 STEP 2532 H=2532:00 +CPU= 19.183
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002532
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002532
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002532
  02:42:18 STEP 2533 H=2533:00 +CPU= 11.269
  02:42:29 STEP 2534 H=2534:00 +CPU= 10.853
  02:42:45 STEP 2535 H=2535:00 +CPU= 16.507
  02:42:57 STEP 2536 H=2536:00 +CPU= 11.264
  02:43:07 STEP 2537 H=2537:00 +CPU= 10.630
  02:43:24 STEP 2538 H=2538:00 +CPU= 17.261
  02:43:36 STEP 2539 H=2539:00 +CPU= 11.121
  02:43:47 STEP 2540 H=2540:00 +CPU= 11.272
  02:44:04 STEP 2541 H=2541:00 +CPU= 16.895
  02:44:16 STEP 2542 H=2542:00 +CPU= 11.553
  02:44:27 STEP 2543 H=2543:00 +CPU= 11.470
  02:44:48 STEP 2544 H=2544:00 +CPU= 20.578
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002544
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002544
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002544
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002520
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002520
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002520
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002532
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002532
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002532
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_105.zip
Uploading the intermediate file: upload_file_105.zip
  02:44:59 STEP 2545 H=2545:00 +CPU= 11.070
  02:45:10 STEP 2546 H=2546:00 +CPU= 10.871
  02:45:27 STEP 2547 H=2547:00 +CPU= 17.055
  02:45:38 STEP 2548 H=2548:00 +CPU= 11.237
  02:45:49 STEP 2549 H=2549:00 +CPU= 10.722
  02:46:06 STEP 2550 H=2550:00 +CPU= 17.365
  02:46:17 STEP 2551 H=2551:00 +CPU= 11.103
  02:46:29 STEP 2552 H=2552:00 +CPU= 11.597
  02:46:48 STEP 2553 H=2553:00 +CPU= 17.229
  02:46:59 STEP 2554 H=2554:00 +CPU= 11.150
  02:47:09 STEP 2555 H=2555:00 +CPU= 10.767
  02:47:29 STEP 2556 H=2556:00 +CPU= 18.993
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002556
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002556
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002556
  02:47:40 STEP 2557 H=2557:00 +CPU= 11.120
  02:47:50 STEP 2558 H=2558:00 +CPU= 10.699
  02:48:08 STEP 2559 H=2559:00 +CPU= 17.156
  02:48:19 STEP 2560 H=2560:00 +CPU= 11.160
  02:48:29 STEP 2561 H=2561:00 +CPU= 10.740
  02:48:47 STEP 2562 H=2562:00 +CPU= 17.489
  02:48:58 STEP 2563 H=2563:00 +CPU= 10.763
  02:49:09 STEP 2564 H=2564:00 +CPU= 10.873
  02:49:25 STEP 2565 H=2565:00 +CPU= 16.730
  02:49:37 STEP 2566 H=2566:00 +CPU= 11.389
  02:49:48 STEP 2567 H=2567:00 +CPU= 11.314
  02:50:09 STEP 2568 H=2568:00 +CPU= 20.558
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002568
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002568
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002568
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002544
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002544
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002544
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002556
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002556
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002556
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_106.zip
Uploading the intermediate file: upload_file_106.zip
  02:50:20 STEP 2569 H=2569:00 +CPU= 10.782
  02:50:31 STEP 2570 H=2570:00 +CPU= 10.820
  02:50:48 STEP 2571 H=2571:00 +CPU= 17.010
  02:50:59 STEP 2572 H=2572:00 +CPU= 11.050
  02:51:09 STEP 2573 H=2573:00 +CPU= 10.539
  02:51:26 STEP 2574 H=2574:00 +CPU= 17.176
  02:51:38 STEP 2575 H=2575:00 +CPU= 11.149
  02:51:49 STEP 2576 H=2576:00 +CPU= 11.120
  02:52:06 STEP 2577 H=2577:00 +CPU= 17.017
  02:52:17 STEP 2578 H=2578:00 +CPU= 11.516
  02:52:28 STEP 2579 H=2579:00 +CPU= 10.918
  02:52:47 STEP 2580 H=2580:00 +CPU= 18.565
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002580
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002580
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002580
  02:52:58 STEP 2581 H=2581:00 +CPU= 11.007
  02:53:09 STEP 2582 H=2582:00 +CPU= 10.965
  02:53:26 STEP 2583 H=2583:00 +CPU= 16.895
  02:53:37 STEP 2584 H=2584:00 +CPU= 11.251
  02:53:48 STEP 2585 H=2585:00 +CPU= 10.799
  02:54:05 STEP 2586 H=2586:00 +CPU= 16.989
  02:54:16 STEP 2587 H=2587:00 +CPU= 11.068
  02:54:27 STEP 2588 H=2588:00 +CPU= 11.532
  02:54:45 STEP 2589 H=2589:00 +CPU= 17.147
  02:54:56 STEP 2590 H=2590:00 +CPU= 11.541
  02:55:08 STEP 2591 H=2591:00 +CPU= 11.433
  02:55:28 STEP 2592 H=2592:00 +CPU= 20.280
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002592
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002592
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002592
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002568
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002568
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002568
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002580
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002580
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002580
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_107.zip
Uploading the intermediate file: upload_file_107.zip
  02:55:39 STEP 2593 H=2593:00 +CPU= 10.842
  02:55:50 STEP 2594 H=2594:00 +CPU= 10.734
  02:56:07 STEP 2595 H=2595:00 +CPU= 16.882
  02:56:18 STEP 2596 H=2596:00 +CPU= 11.289
  02:56:29 STEP 2597 H=2597:00 +CPU= 10.763
  02:56:46 STEP 2598 H=2598:00 +CPU= 17.340
  02:56:57 STEP 2599 H=2599:00 +CPU= 11.016
  02:57:08 STEP 2600 H=2600:00 +CPU= 10.843
  02:57:25 STEP 2601 H=2601:00 +CPU= 16.720
  02:57:36 STEP 2602 H=2602:00 +CPU= 11.484
  02:57:47 STEP 2603 H=2603:00 +CPU= 10.764
  02:58:06 STEP 2604 H=2604:00 +CPU= 19.137
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002604
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002604
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002604
  02:58:17 STEP 2605 H=2605:00 +CPU= 11.105
  02:58:28 STEP 2606 H=2606:00 +CPU= 10.725
  02:58:45 STEP 2607 H=2607:00 +CPU= 17.255
  02:58:56 STEP 2608 H=2608:00 +CPU= 11.218
  02:59:07 STEP 2609 H=2609:00 +CPU= 10.471
  02:59:24 STEP 2610 H=2610:00 +CPU= 17.277
  02:59:35 STEP 2611 H=2611:00 +CPU= 11.078
  02:59:46 STEP 2612 H=2612:00 +CPU= 11.283
  03:00:04 STEP 2613 H=2613:00 +CPU= 17.188
  03:00:15 STEP 2614 H=2614:00 +CPU= 11.121
  03:00:30 STEP 2615 H=2615:00 +CPU= 11.570
  03:00:51 STEP 2616 H=2616:00 +CPU= 20.509
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002616
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002616
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002616
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002592
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002592
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002592
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002604
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002604
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002604
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_108.zip
Uploading the intermediate file: upload_file_108.zip
  03:01:01 STEP 2617 H=2617:00 +CPU= 10.814
  03:01:12 STEP 2618 H=2618:00 +CPU= 10.362
  03:01:29 STEP 2619 H=2619:00 +CPU= 17.345
  03:01:40 STEP 2620 H=2620:00 +CPU= 10.969
  03:01:50 STEP 2621 H=2621:00 +CPU= 10.162
  03:02:08 STEP 2622 H=2622:00 +CPU= 17.520
  03:02:19 STEP 2623 H=2623:00 +CPU= 10.933
  03:02:29 STEP 2624 H=2624:00 +CPU= 10.682
  03:02:47 STEP 2625 H=2625:00 +CPU= 17.330
  03:02:58 STEP 2626 H=2626:00 +CPU= 11.537
  03:03:09 STEP 2627 H=2627:00 +CPU= 10.674
  03:03:28 STEP 2628 H=2628:00 +CPU= 18.970
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002628
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002628
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002628
  03:03:39 STEP 2629 H=2629:00 +CPU= 10.889
  03:03:50 STEP 2630 H=2630:00 +CPU= 10.669
  03:04:07 STEP 2631 H=2631:00 +CPU= 17.337
  03:04:18 STEP 2632 H=2632:00 +CPU= 11.376
  03:04:29 STEP 2633 H=2633:00 +CPU= 10.324
  03:04:46 STEP 2634 H=2634:00 +CPU= 17.152
  03:04:57 STEP 2635 H=2635:00 +CPU= 10.937
  03:05:08 STEP 2636 H=2636:00 +CPU= 10.723
  03:05:25 STEP 2637 H=2637:00 +CPU= 17.263
  03:05:36 STEP 2638 H=2638:00 +CPU= 11.392
  03:05:47 STEP 2639 H=2639:00 +CPU= 11.034
  03:06:08 STEP 2640 H=2640:00 +CPU= 20.214
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002640
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002640
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002640
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002616
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002616
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002616
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002628
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002628
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002628
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_109.zip
Uploading the intermediate file: upload_file_109.zip
  03:06:19 STEP 2641 H=2641:00 +CPU= 11.291
  03:06:30 STEP 2642 H=2642:00 +CPU= 10.580
Uploading trickle at timestep: 9504000
  03:06:47 STEP 2643 H=2643:00 +CPU= 16.999
  03:06:58 STEP 2644 H=2644:00 +CPU= 11.141
  03:07:08 STEP 2645 H=2645:00 +CPU= 10.744
  03:07:26 STEP 2646 H=2646:00 +CPU= 17.191
  03:07:37 STEP 2647 H=2647:00 +CPU= 11.237
  03:07:48 STEP 2648 H=2648:00 +CPU= 11.120
  03:08:05 STEP 2649 H=2649:00 +CPU= 16.975
  03:08:16 STEP 2650 H=2650:00 +CPU= 11.349
  03:08:27 STEP 2651 H=2651:00 +CPU= 10.903
  03:08:46 STEP 2652 H=2652:00 +CPU= 18.965
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002652
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002652
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002652
  03:08:57 STEP 2653 H=2653:00 +CPU= 11.009
  03:09:08 STEP 2654 H=2654:00 +CPU= 11.073
  03:09:25 STEP 2655 H=2655:00 +CPU= 16.908
  03:09:37 STEP 2656 H=2656:00 +CPU= 11.496
  03:09:48 STEP 2657 H=2657:00 +CPU= 10.859
  03:10:05 STEP 2658 H=2658:00 +CPU= 16.910
  03:10:16 STEP 2659 H=2659:00 +CPU= 11.109
  03:10:27 STEP 2660 H=2660:00 +CPU= 11.267
  03:10:44 STEP 2661 H=2661:00 +CPU= 16.640
  03:10:55 STEP 2662 H=2662:00 +CPU= 11.485
  03:11:06 STEP 2663 H=2663:00 +CPU= 11.221
  03:11:27 STEP 2664 H=2664:00 +CPU= 20.355
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002664
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002664
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002664
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002640
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002640
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002640
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002652
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002652
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002652
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_110.zip
Uploading the intermediate file: upload_file_110.zip
  03:11:38 STEP 2665 H=2665:00 +CPU= 10.981
  03:11:49 STEP 2666 H=2666:00 +CPU= 10.972
  03:12:06 STEP 2667 H=2667:00 +CPU= 16.943
  03:12:17 STEP 2668 H=2668:00 +CPU= 11.383
  03:12:28 STEP 2669 H=2669:00 +CPU= 10.889
  03:12:45 STEP 2670 H=2670:00 +CPU= 17.116
  03:12:56 STEP 2671 H=2671:00 +CPU= 11.329
  03:13:08 STEP 2672 H=2672:00 +CPU= 11.350
  03:13:25 STEP 2673 H=2673:00 +CPU= 16.845
  03:13:36 STEP 2674 H=2674:00 +CPU= 11.556
  03:13:47 STEP 2675 H=2675:00 +CPU= 10.932
  03:14:06 STEP 2676 H=2676:00 +CPU= 18.901
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002676
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002676
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002676
  03:14:17 STEP 2677 H=2677:00 +CPU= 10.962
  03:14:28 STEP 2678 H=2678:00 +CPU= 10.918
  03:14:45 STEP 2679 H=2679:00 +CPU= 16.727
  03:14:56 STEP 2680 H=2680:00 +CPU= 11.390
  03:15:07 STEP 2681 H=2681:00 +CPU= 10.963
  03:15:26 STEP 2682 H=2682:00 +CPU= 17.410
  03:15:37 STEP 2683 H=2683:00 +CPU= 11.446
  03:15:48 STEP 2684 H=2684:00 +CPU= 10.916
  03:16:05 STEP 2685 H=2685:00 +CPU= 16.728
  03:16:16 STEP 2686 H=2686:00 +CPU= 11.167
  03:16:28 STEP 2687 H=2687:00 +CPU= 11.361
  03:16:48 STEP 2688 H=2688:00 +CPU= 20.149
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002688
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002688
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002688
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002664
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002664
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002664
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002676
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002676
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002676
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_111.zip
Uploading the intermediate file: upload_file_111.zip
  03:16:59 STEP 2689 H=2689:00 +CPU= 10.798
  03:17:10 STEP 2690 H=2690:00 +CPU= 11.138
  03:17:27 STEP 2691 H=2691:00 +CPU= 16.786
  03:17:38 STEP 2692 H=2692:00 +CPU= 11.263
  03:17:49 STEP 2693 H=2693:00 +CPU= 10.676
  03:18:06 STEP 2694 H=2694:00 +CPU= 17.501
  03:18:17 STEP 2695 H=2695:00 +CPU= 11.308
  03:18:29 STEP 2696 H=2696:00 +CPU= 11.328
  03:18:46 STEP 2697 H=2697:00 +CPU= 17.185
  03:18:57 STEP 2698 H=2698:00 +CPU= 11.454
  03:19:08 STEP 2699 H=2699:00 +CPU= 11.014
  03:19:27 STEP 2700 H=2700:00 +CPU= 18.806
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002700
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002700
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002700
  03:19:39 STEP 2701 H=2701:00 +CPU= 11.368
  03:19:50 STEP 2702 H=2702:00 +CPU= 11.221
  03:20:07 STEP 2703 H=2703:00 +CPU= 17.052
  03:20:19 STEP 2704 H=2704:00 +CPU= 11.613
  03:20:29 STEP 2705 H=2705:00 +CPU= 10.711
  03:20:46 STEP 2706 H=2706:00 +CPU= 17.185
  03:20:58 STEP 2707 H=2707:00 +CPU= 11.343
  03:21:09 STEP 2708 H=2708:00 +CPU= 11.254
  03:21:26 STEP 2709 H=2709:00 +CPU= 17.108
  03:21:38 STEP 2710 H=2710:00 +CPU= 11.511
  03:21:49 STEP 2711 H=2711:00 +CPU= 11.273
  03:22:10 STEP 2712 H=2712:00 +CPU= 19.909
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002712
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002712
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002712
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002688
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002688
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002688
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002700
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002700
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002700
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_112.zip
Uploading the intermediate file: upload_file_112.zip
  03:22:21 STEP 2713 H=2713:00 +CPU= 10.595
  03:22:31 STEP 2714 H=2714:00 +CPU= 10.188
  03:22:48 STEP 2715 H=2715:00 +CPU= 16.551
  03:22:59 STEP 2716 H=2716:00 +CPU= 10.815
  03:23:09 STEP 2717 H=2717:00 +CPU=  9.980
  03:23:26 STEP 2718 H=2718:00 +CPU= 16.784
  03:23:36 STEP 2719 H=2719:00 +CPU= 10.562
  03:23:47 STEP 2720 H=2720:00 +CPU= 10.531
  03:24:03 STEP 2721 H=2721:00 +CPU= 16.409
  03:24:14 STEP 2722 H=2722:00 +CPU= 10.880
  03:24:24 STEP 2723 H=2723:00 +CPU= 10.357
  03:24:43 STEP 2724 H=2724:00 +CPU= 18.146
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002724
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002724
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002724
  03:24:53 STEP 2725 H=2725:00 +CPU= 10.777
  03:25:04 STEP 2726 H=2726:00 +CPU= 10.343
  03:25:20 STEP 2727 H=2727:00 +CPU= 16.234
  03:25:31 STEP 2728 H=2728:00 +CPU= 11.009
  03:25:41 STEP 2729 H=2729:00 +CPU= 10.591
  03:25:59 STEP 2730 H=2730:00 +CPU= 17.091
  03:26:10 STEP 2731 H=2731:00 +CPU= 11.147
  03:26:21 STEP 2732 H=2732:00 +CPU= 11.050
  03:26:38 STEP 2733 H=2733:00 +CPU= 16.879
  03:26:50 STEP 2734 H=2734:00 +CPU= 11.492
  03:27:01 STEP 2735 H=2735:00 +CPU= 11.203
  03:27:21 STEP 2736 H=2736:00 +CPU= 20.083
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002736
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002736
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002736
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002712
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002712
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002712
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002724
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002724
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002724
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_113.zip
Uploading the intermediate file: upload_file_113.zip
  03:27:32 STEP 2737 H=2737:00 +CPU= 10.860
  03:27:43 STEP 2738 H=2738:00 +CPU= 11.055
  03:28:00 STEP 2739 H=2739:00 +CPU= 17.086
  03:28:11 STEP 2740 H=2740:00 +CPU= 11.450
  03:28:22 STEP 2741 H=2741:00 +CPU= 10.645
  03:28:39 STEP 2742 H=2742:00 +CPU= 17.316
  03:28:51 STEP 2743 H=2743:00 +CPU= 11.121
  03:29:02 STEP 2744 H=2744:00 +CPU= 11.055
  03:29:19 STEP 2745 H=2745:00 +CPU= 17.332
  03:29:31 STEP 2746 H=2746:00 +CPU= 11.507
  03:29:41 STEP 2747 H=2747:00 +CPU= 10.920
  03:30:00 STEP 2748 H=2748:00 +CPU= 18.750
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002748
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002748
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002748
  03:30:11 STEP 2749 H=2749:00 +CPU= 11.203
  03:30:22 STEP 2750 H=2750:00 +CPU= 11.018
  03:30:40 STEP 2751 H=2751:00 +CPU= 17.044
  03:30:51 STEP 2752 H=2752:00 +CPU= 11.445
  03:31:02 STEP 2753 H=2753:00 +CPU= 10.527
  03:31:19 STEP 2754 H=2754:00 +CPU= 17.229
  03:31:30 STEP 2755 H=2755:00 +CPU= 10.896
  03:31:40 STEP 2756 H=2756:00 +CPU= 10.420
  03:31:57 STEP 2757 H=2757:00 +CPU= 16.451
  03:32:08 STEP 2758 H=2758:00 +CPU= 11.093
  03:32:18 STEP 2759 H=2759:00 +CPU= 10.656
  03:32:38 STEP 2760 H=2760:00 +CPU= 19.197
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002760
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002760
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002760
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002736
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002736
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002736
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002748
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002748
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002748
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_114.zip
Uploading the intermediate file: upload_file_114.zip
  03:32:48 STEP 2761 H=2761:00 +CPU= 10.353
  03:32:58 STEP 2762 H=2762:00 +CPU= 10.082
  03:33:14 STEP 2763 H=2763:00 +CPU= 15.666
  03:33:24 STEP 2764 H=2764:00 +CPU= 10.280
  03:33:34 STEP 2765 H=2765:00 +CPU=  9.906
  03:33:50 STEP 2766 H=2766:00 +CPU= 16.305
  03:34:01 STEP 2767 H=2767:00 +CPU= 10.357
  03:34:11 STEP 2768 H=2768:00 +CPU= 10.297
  03:34:26 STEP 2769 H=2769:00 +CPU= 15.374
  03:34:37 STEP 2770 H=2770:00 +CPU= 10.264
  03:34:47 STEP 2771 H=2771:00 +CPU=  9.869
  03:35:04 STEP 2772 H=2772:00 +CPU= 17.338
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002772
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002772
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002772
  03:35:14 STEP 2773 H=2773:00 +CPU= 10.323
  03:35:24 STEP 2774 H=2774:00 +CPU= 10.173
  03:35:40 STEP 2775 H=2775:00 +CPU= 15.699
  03:35:51 STEP 2776 H=2776:00 +CPU= 10.450
  03:36:01 STEP 2777 H=2777:00 +CPU= 10.180
  03:36:17 STEP 2778 H=2778:00 +CPU= 16.588
  03:36:28 STEP 2779 H=2779:00 +CPU= 10.494
  03:36:39 STEP 2780 H=2780:00 +CPU= 10.981
  03:36:55 STEP 2781 H=2781:00 +CPU= 15.879
  03:37:05 STEP 2782 H=2782:00 +CPU= 10.353
  03:37:16 STEP 2783 H=2783:00 +CPU= 10.375
  03:37:35 STEP 2784 H=2784:00 +CPU= 19.005
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002784
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002784
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002784
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002760
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002760
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002760
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002772
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002772
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002772
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_115.zip
Uploading the intermediate file: upload_file_115.zip
  03:37:45 STEP 2785 H=2785:00 +CPU= 10.254
  03:37:56 STEP 2786 H=2786:00 +CPU= 10.360
  03:38:12 STEP 2787 H=2787:00 +CPU= 16.042
  03:38:22 STEP 2788 H=2788:00 +CPU= 10.526
  03:38:33 STEP 2789 H=2789:00 +CPU= 10.725
  03:38:49 STEP 2790 H=2790:00 +CPU= 16.527
  03:39:00 STEP 2791 H=2791:00 +CPU= 10.304
  03:39:10 STEP 2792 H=2792:00 +CPU= 10.335
  03:39:26 STEP 2793 H=2793:00 +CPU= 15.609
  03:39:36 STEP 2794 H=2794:00 +CPU= 10.323
  03:39:46 STEP 2795 H=2795:00 +CPU= 10.284
  03:40:04 STEP 2796 H=2796:00 +CPU= 17.329
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002796
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002796
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002796
  03:40:14 STEP 2797 H=2797:00 +CPU= 10.030
  03:40:24 STEP 2798 H=2798:00 +CPU= 10.426
  03:40:41 STEP 2799 H=2799:00 +CPU= 16.465
  03:40:51 STEP 2800 H=2800:00 +CPU= 10.888
  03:41:02 STEP 2801 H=2801:00 +CPU= 10.341
  03:41:18 STEP 2802 H=2802:00 +CPU= 16.467
  03:41:29 STEP 2803 H=2803:00 +CPU= 10.671
  03:41:40 STEP 2804 H=2804:00 +CPU= 11.026
  03:41:57 STEP 2805 H=2805:00 +CPU= 16.541
  03:42:07 STEP 2806 H=2806:00 +CPU= 10.767
  03:42:18 STEP 2807 H=2807:00 +CPU= 10.815
  03:42:38 STEP 2808 H=2808:00 +CPU= 20.154
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002808
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002808
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002808
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002784
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002784
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002784
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002796
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002796
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002796
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_116.zip
Uploading the intermediate file: upload_file_116.zip
  03:42:49 STEP 2809 H=2809:00 +CPU= 11.143
  03:43:00 STEP 2810 H=2810:00 +CPU= 10.949
  03:43:17 STEP 2811 H=2811:00 +CPU= 17.022
  03:43:29 STEP 2812 H=2812:00 +CPU= 11.364
  03:43:40 STEP 2813 H=2813:00 +CPU= 10.779
  03:43:57 STEP 2814 H=2814:00 +CPU= 17.084
  03:44:08 STEP 2815 H=2815:00 +CPU= 11.009
  03:44:19 STEP 2816 H=2816:00 +CPU= 11.193
  03:44:36 STEP 2817 H=2817:00 +CPU= 16.821
  03:44:47 STEP 2818 H=2818:00 +CPU= 11.206
  03:44:58 STEP 2819 H=2819:00 +CPU= 10.849
  03:45:17 STEP 2820 H=2820:00 +CPU= 18.596
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002820
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002820
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002820
  03:45:28 STEP 2821 H=2821:00 +CPU= 10.973
  03:45:39 STEP 2822 H=2822:00 +CPU= 11.100
  03:45:55 STEP 2823 H=2823:00 +CPU= 16.690
  03:46:07 STEP 2824 H=2824:00 +CPU= 11.626
  03:46:18 STEP 2825 H=2825:00 +CPU= 10.925
  03:46:35 STEP 2826 H=2826:00 +CPU= 17.250
  03:46:46 STEP 2827 H=2827:00 +CPU= 10.986
  03:46:58 STEP 2828 H=2828:00 +CPU= 11.466
  03:47:15 STEP 2829 H=2829:00 +CPU= 17.003
  03:47:26 STEP 2830 H=2830:00 +CPU= 11.359
  03:47:38 STEP 2831 H=2831:00 +CPU= 11.532
  03:47:58 STEP 2832 H=2832:00 +CPU= 20.451
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002832
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002832
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002832
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002808
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002808
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002808
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002820
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002820
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002820
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_117.zip
Uploading the intermediate file: upload_file_117.zip
  03:48:10 STEP 2833 H=2833:00 +CPU= 11.234
  03:48:20 STEP 2834 H=2834:00 +CPU= 10.934
  03:48:37 STEP 2835 H=2835:00 +CPU= 16.982
  03:48:49 STEP 2836 H=2836:00 +CPU= 11.082
  03:48:59 STEP 2837 H=2837:00 +CPU= 10.525
  03:49:16 STEP 2838 H=2838:00 +CPU= 16.866
  03:49:27 STEP 2839 H=2839:00 +CPU= 10.861
  03:49:38 STEP 2840 H=2840:00 +CPU= 11.256
  03:49:55 STEP 2841 H=2841:00 +CPU= 17.017
  03:50:07 STEP 2842 H=2842:00 +CPU= 11.425
  03:50:17 STEP 2843 H=2843:00 +CPU= 10.698
  03:50:36 STEP 2844 H=2844:00 +CPU= 18.558
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002844
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002844
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002844
  03:50:47 STEP 2845 H=2845:00 +CPU= 11.118
  03:50:58 STEP 2846 H=2846:00 +CPU= 11.022
  03:51:15 STEP 2847 H=2847:00 +CPU= 16.759
  03:51:26 STEP 2848 H=2848:00 +CPU= 11.188
  03:51:37 STEP 2849 H=2849:00 +CPU= 10.653
  03:51:54 STEP 2850 H=2850:00 +CPU= 17.136
  03:52:05 STEP 2851 H=2851:00 +CPU= 10.869
  03:52:16 STEP 2852 H=2852:00 +CPU= 11.380
  03:52:33 STEP 2853 H=2853:00 +CPU= 17.060
  03:52:44 STEP 2854 H=2854:00 +CPU= 11.292
  03:52:56 STEP 2855 H=2855:00 +CPU= 11.387
  03:53:16 STEP 2856 H=2856:00 +CPU= 20.303
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002856
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002856
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002856
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002832
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002832
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002832
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002844
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002844
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002844
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_118.zip
Uploading the intermediate file: upload_file_118.zip
  03:53:27 STEP 2857 H=2857:00 +CPU= 11.131
  03:53:38 STEP 2858 H=2858:00 +CPU= 10.969
  03:53:57 STEP 2859 H=2859:00 +CPU= 17.176
  03:54:08 STEP 2860 H=2860:00 +CPU= 11.304
  03:54:19 STEP 2861 H=2861:00 +CPU= 10.524
  03:54:36 STEP 2862 H=2862:00 +CPU= 17.305
  03:54:47 STEP 2863 H=2863:00 +CPU= 11.124
  03:54:58 STEP 2864 H=2864:00 +CPU= 10.831
  03:55:15 STEP 2865 H=2865:00 +CPU= 16.641
  03:55:26 STEP 2866 H=2866:00 +CPU= 11.261
  03:55:37 STEP 2867 H=2867:00 +CPU= 10.914
  03:55:56 STEP 2868 H=2868:00 +CPU= 18.975
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002868
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002868
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002868
  03:56:07 STEP 2869 H=2869:00 +CPU= 11.086
  03:56:18 STEP 2870 H=2870:00 +CPU= 10.885
  03:56:35 STEP 2871 H=2871:00 +CPU= 16.799
  03:56:46 STEP 2872 H=2872:00 +CPU= 11.365
  03:56:57 STEP 2873 H=2873:00 +CPU= 10.828
  03:57:15 STEP 2874 H=2874:00 +CPU= 17.504
  03:57:26 STEP 2875 H=2875:00 +CPU= 11.202
  03:57:37 STEP 2876 H=2876:00 +CPU= 10.897
  03:57:54 STEP 2877 H=2877:00 +CPU= 17.228
  03:58:05 STEP 2878 H=2878:00 +CPU= 11.432
  03:58:17 STEP 2879 H=2879:00 +CPU= 11.096
  03:58:37 STEP 2880 H=2880:00 +CPU= 20.170
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002880
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002880
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002880
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002856
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002856
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002856
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002868
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002868
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002868
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_119.zip
Uploading the intermediate file: upload_file_119.zip
  03:58:48 STEP 2881 H=2881:00 +CPU= 11.320
  03:58:59 STEP 2882 H=2882:00 +CPU= 10.789
Uploading trickle at timestep: 10368000
  03:59:16 STEP 2883 H=2883:00 +CPU= 16.825
  03:59:27 STEP 2884 H=2884:00 +CPU= 11.253
  03:59:38 STEP 2885 H=2885:00 +CPU= 10.502
  03:59:55 STEP 2886 H=2886:00 +CPU= 17.287
  04:00:06 STEP 2887 H=2887:00 +CPU= 10.982
  04:00:17 STEP 2888 H=2888:00 +CPU= 11.131
  04:00:34 STEP 2889 H=2889:00 +CPU= 16.883
  04:00:45 STEP 2890 H=2890:00 +CPU= 11.476
  04:00:56 STEP 2891 H=2891:00 +CPU= 10.752
  04:01:15 STEP 2892 H=2892:00 +CPU= 18.592
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002892
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002892
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002892
  04:01:26 STEP 2893 H=2893:00 +CPU= 11.018
  04:01:37 STEP 2894 H=2894:00 +CPU= 10.866
  04:01:54 STEP 2895 H=2895:00 +CPU= 17.057
  04:02:05 STEP 2896 H=2896:00 +CPU= 11.341
  04:02:16 STEP 2897 H=2897:00 +CPU= 10.621
  04:02:33 STEP 2898 H=2898:00 +CPU= 17.077
  04:02:44 STEP 2899 H=2899:00 +CPU= 10.884
  04:02:55 STEP 2900 H=2900:00 +CPU= 11.164
  04:03:12 STEP 2901 H=2901:00 +CPU= 16.564
  04:03:23 STEP 2902 H=2902:00 +CPU= 11.017
  04:03:33 STEP 2903 H=2903:00 +CPU= 10.878
  04:03:53 STEP 2904 H=2904:00 +CPU= 19.421
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002904
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002904
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002904
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002880
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002880
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002880
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002892
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002892
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002892
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_120.zip
Uploading the intermediate file: upload_file_120.zip
  04:04:04 STEP 2905 H=2905:00 +CPU= 10.580
  04:04:14 STEP 2906 H=2906:00 +CPU= 10.303
  04:04:30 STEP 2907 H=2907:00 +CPU= 16.075
  04:04:41 STEP 2908 H=2908:00 +CPU= 10.586
  04:04:51 STEP 2909 H=2909:00 +CPU= 10.553
  04:05:08 STEP 2910 H=2910:00 +CPU= 16.514
  04:05:18 STEP 2911 H=2911:00 +CPU= 10.688
  04:05:29 STEP 2912 H=2912:00 +CPU= 10.753
  04:05:45 STEP 2913 H=2913:00 +CPU= 16.315
  04:05:56 STEP 2914 H=2914:00 +CPU= 10.783
  04:06:07 STEP 2915 H=2915:00 +CPU= 10.318
  04:06:25 STEP 2916 H=2916:00 +CPU= 18.232
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002916
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002916
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002916
  04:06:35 STEP 2917 H=2917:00 +CPU= 10.373
  04:06:46 STEP 2918 H=2918:00 +CPU= 11.041
  04:07:03 STEP 2919 H=2919:00 +CPU= 16.555
  04:07:14 STEP 2920 H=2920:00 +CPU= 11.319
  04:07:25 STEP 2921 H=2921:00 +CPU= 11.016
  04:07:42 STEP 2922 H=2922:00 +CPU= 17.139
  04:07:53 STEP 2923 H=2923:00 +CPU= 10.960
  04:08:05 STEP 2924 H=2924:00 +CPU= 11.401
  04:08:22 STEP 2925 H=2925:00 +CPU= 16.971
  04:08:33 STEP 2926 H=2926:00 +CPU= 11.351
  04:08:44 STEP 2927 H=2927:00 +CPU= 11.320
  04:09:05 STEP 2928 H=2928:00 +CPU= 20.457
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002928
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002928
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002928
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002904
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002904
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002904
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002916
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002916
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002916
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_121.zip
Uploading the intermediate file: upload_file_121.zip
  04:09:16 STEP 2929 H=2929:00 +CPU= 10.963
  04:09:26 STEP 2930 H=2930:00 +CPU= 10.588
  04:09:43 STEP 2931 H=2931:00 +CPU= 16.259
  04:09:54 STEP 2932 H=2932:00 +CPU= 10.793
  04:10:04 STEP 2933 H=2933:00 +CPU= 10.333
  04:10:21 STEP 2934 H=2934:00 +CPU= 16.653
  04:10:31 STEP 2935 H=2935:00 +CPU= 10.595
  04:10:42 STEP 2936 H=2936:00 +CPU= 10.868
  04:10:59 STEP 2937 H=2937:00 +CPU= 16.615
  04:11:10 STEP 2938 H=2938:00 +CPU= 10.921
  04:11:20 STEP 2939 H=2939:00 +CPU= 10.295
  04:11:38 STEP 2940 H=2940:00 +CPU= 17.953
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002940
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002940
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002940
  04:11:48 STEP 2941 H=2941:00 +CPU= 10.531
  04:11:59 STEP 2942 H=2942:00 +CPU= 10.724
  04:12:15 STEP 2943 H=2943:00 +CPU= 16.268
  04:12:26 STEP 2944 H=2944:00 +CPU= 10.703
  04:12:37 STEP 2945 H=2945:00 +CPU= 10.424
  04:12:53 STEP 2946 H=2946:00 +CPU= 16.545
  04:13:05 STEP 2947 H=2947:00 +CPU= 11.214
  04:13:16 STEP 2948 H=2948:00 +CPU= 11.588
  04:13:34 STEP 2949 H=2949:00 +CPU= 17.099
  04:13:45 STEP 2950 H=2950:00 +CPU= 11.603
  04:13:57 STEP 2951 H=2951:00 +CPU= 11.347
  04:14:16 STEP 2952 H=2952:00 +CPU= 18.524
The child process terminated with status: 0
Moving to projects directory: /home/fritzb/slots/4/ICMGGhpi1+002952
Moving to projects directory: /home/fritzb/slots/4/ICMSHhpi1+002952
Moving to projects directory: /home/fritzb/slots/4/ICMUAhpi1+002952
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002940
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002940
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002952
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002952
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002952
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002940
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMGGhpi1+002928
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMUAhpi1+002928
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12165321/ICMSHhpi1+002928
Zipping up the final file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_2232_2021050100_123_947_12165321_1_r1030157686_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
04:17:39 (6375): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:40:12 1537731 22294312 oifs_43r3_ps_2232_2021050100_123_947_12165321_1 10,623,600 39,258 0.0037
09 May 2023 16:40:12 1537731 22294312 oifs_43r3_ps_2232_2021050100_123_947_12165321_1 10,623,600 39,258 0.0037
09 May 2023 16:40:12 1537731 22294312 oifs_43r3_ps_2232_2021050100_123_947_12165321_1 10,368,000 38,329 0.0037
09 May 2023 16:40:09 1537731 22294312 oifs_43r3_ps_2232_2021050100_123_947_12165321_1 9,504,000 35,185 0.0037
09 May 2023 16:40:09 1537731 22294312 oifs_43r3_ps_2232_2021050100_123_947_12165321_1 9,504,000 35,185 0.0037
09 May 2023 16:40:06 1537731 22294312 oifs_43r3_ps_2232_2021050100_123_947_12165321_1 8,640,000 31,991 0.0037
09 May 2023 16:40:06 1537731 22294312 oifs_43r3_ps_2232_2021050100_123_947_12165321_1 8,640,000 31,991 0.0037
09 May 2023 16:40:02 1537731 22294312 oifs_43r3_ps_2232_2021050100_123_947_12165321_1 7,776,000 28,796 0.0037
09 May 2023 16:39:59 1537731 22294312 oifs_43r3_ps_2232_2021050100_123_947_12165321_1 6,912,000 25,601 0.0037
09 May 2023 16:39:59 1537731 22294312 oifs_43r3_ps_2232_2021050100_123_947_12165321_1 6,912,000 25,601 0.0037
09 May 2023 16:39:56 1537731 22294312 oifs_43r3_ps_2232_2021050100_123_947_12165321_1 6,048,000 22,414 0.0037
09 May 2023 16:39:56 1537731 22294312 oifs_43r3_ps_2232_2021050100_123_947_12165321_1 6,048,000 22,414 0.0037
09 May 2023 16:39:53 1537731 22294312 oifs_43r3_ps_2232_2021050100_123_947_12165321_1 5,184,000 19,217 0.0037
09 May 2023 16:39:52 1537731 22294312 oifs_43r3_ps_2232_2021050100_123_947_12165321_1 5,184,000 19,217 0.0037
09 May 2023 16:39:49 1537731 22294312 oifs_43r3_ps_2232_2021050100_123_947_12165321_1 4,320,000 16,012 0.0037
09 May 2023 16:39:49 1537731 22294312 oifs_43r3_ps_2232_2021050100_123_947_12165321_1 3,456,000 12,808 0.0037
09 May 2023 16:39:49 1537731 22294312 oifs_43r3_ps_2232_2021050100_123_947_12165321_1 3,456,000 12,808 0.0037
09 May 2023 16:39:46 1537731 22294312 oifs_43r3_ps_2232_2021050100_123_947_12165321_1 2,592,000 9,651 0.0037
09 May 2023 16:39:46 1537731 22294312 oifs_43r3_ps_2232_2021050100_123_947_12165321_1 2,592,000 9,651 0.0037
09 May 2023 16:39:42 1537731 22294312 oifs_43r3_ps_2232_2021050100_123_947_12165321_1 1,728,000 6,443 0.0037


©2024 climateprediction.net