climateprediction.net home page
Task 22254651

Task 22254651

Name oifs_43r3_ps_0689_1984050100_123_953_12170333_0
Workunit 12170333
Created 21 Dec 2022, 4:03:04 UTC
Sent 17 Jan 2023, 22:45:29 UTC
Report deadline 18 Mar 2023, 22:45:29 UTC
Received 26 Jan 2023, 16:53:54 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1551272
Run time 17 hours 35 min 13 sec
CPU time 17 hours 14 min 14 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 5.90 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,398.57 MB
Peak swap size 4,977.86 MB
Peak disk usage 2,049.18 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
0 +CPU= 19.695
  12:44:33 STEP 2276 H=2276:00 +CPU= 20.351
  12:45:03 STEP 2277 H=2277:00 +CPU= 29.641
  12:45:24 STEP 2278 H=2278:00 +CPU= 20.681
  12:45:48 STEP 2279 H=2279:00 +CPU= 23.351
  12:46:26 STEP 2280 H=2280:00 +CPU= 37.576
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002280
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002280
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002280
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002256
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002256
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002256
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002268
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002268
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002268
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_94.zip
Uploading the intermediate file: upload_file_94.zip
  12:46:46 STEP 2281 H=2281:00 +CPU= 19.602
  12:47:08 STEP 2282 H=2282:00 +CPU= 21.697
  12:47:58 STEP 2283 H=2283:00 +CPU= 47.799
  12:48:24 STEP 2284 H=2284:00 +CPU= 26.221
  12:48:51 STEP 2285 H=2285:00 +CPU= 26.442
  12:49:32 STEP 2286 H=2286:00 +CPU= 40.227
  12:50:00 STEP 2287 H=2287:00 +CPU= 27.173
  12:50:26 STEP 2288 H=2288:00 +CPU= 26.235
  12:51:12 STEP 2289 H=2289:00 +CPU= 45.290
  12:51:42 STEP 2290 H=2290:00 +CPU= 30.220
  12:52:39 STEP 2291 H=2291:00 +CPU= 55.099
  12:53:58 STEP 2292 H=2292:00 +CPU= 78.315
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002292
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002292
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002292
  12:54:30 STEP 2293 H=2293:00 +CPU= 31.517
  12:55:13 STEP 2294 H=2294:00 +CPU= 42.102
  12:56:42 STEP 2295 H=2295:00 +CPU= 85.900
  12:57:34 STEP 2296 H=2296:00 +CPU= 49.990
  12:58:27 STEP 2297 H=2297:00 +CPU= 51.452
  12:59:06 STEP 2298 H=2298:00 +CPU= 39.478
  12:59:22 STEP 2299 H=2299:00 +CPU= 16.118
  12:59:40 STEP 2300 H=2300:00 +CPU= 18.080
  13:00:08 STEP 2301 H=2301:00 +CPU= 27.626
  13:00:26 STEP 2302 H=2302:00 +CPU= 18.342
  13:00:45 STEP 2303 H=2303:00 +CPU= 18.249
  13:01:17 STEP 2304 H=2304:00 +CPU= 32.710
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002304
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002304
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002304
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002280
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002280
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002280
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002292
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002292
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002292
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_95.zip
Uploading the intermediate file: upload_file_95.zip
  13:01:35 STEP 2305 H=2305:00 +CPU= 17.940
  13:01:54 STEP 2306 H=2306:00 +CPU= 18.364
  13:02:22 STEP 2307 H=2307:00 +CPU= 27.964
  13:02:40 STEP 2308 H=2308:00 +CPU= 18.177
  13:02:58 STEP 2309 H=2309:00 +CPU= 18.016
  13:03:27 STEP 2310 H=2310:00 +CPU= 28.533
  13:03:45 STEP 2311 H=2311:00 +CPU= 17.906
  13:04:03 STEP 2312 H=2312:00 +CPU= 18.552
  13:04:31 STEP 2313 H=2313:00 +CPU= 27.557
  13:04:49 STEP 2314 H=2314:00 +CPU= 18.414
  13:05:08 STEP 2315 H=2315:00 +CPU= 18.306
  13:05:41 STEP 2316 H=2316:00 +CPU= 32.762
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002316
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002316
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002316
  13:05:59 STEP 2317 H=2317:00 +CPU= 18.047
  13:06:20 STEP 2318 H=2318:00 +CPU= 20.477
  13:06:49 STEP 2319 H=2319:00 +CPU= 29.128
  13:07:09 STEP 2320 H=2320:00 +CPU= 20.011
  13:07:30 STEP 2321 H=2321:00 +CPU= 20.398
  13:08:01 STEP 2322 H=2322:00 +CPU= 30.274
  13:08:20 STEP 2323 H=2323:00 +CPU= 19.391
  13:08:41 STEP 2324 H=2324:00 +CPU= 20.598
  13:09:14 STEP 2325 H=2325:00 +CPU= 31.862
  13:09:36 STEP 2326 H=2326:00 +CPU= 21.818
  13:09:59 STEP 2327 H=2327:00 +CPU= 22.452
  13:10:39 STEP 2328 H=2328:00 +CPU= 38.848
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002328
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002328
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002328
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002304
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002304
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002304
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002316
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002316
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002316
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_96.zip
Uploading the intermediate file: upload_file_96.zip
  13:10:57 STEP 2329 H=2329:00 +CPU= 18.495
  13:11:18 STEP 2330 H=2330:00 +CPU= 20.741
  13:11:49 STEP 2331 H=2331:00 +CPU= 30.130
  13:12:10 STEP 2332 H=2332:00 +CPU= 20.734
  13:12:31 STEP 2333 H=2333:00 +CPU= 20.778
  13:13:03 STEP 2334 H=2334:00 +CPU= 31.530
  13:13:25 STEP 2335 H=2335:00 +CPU= 21.101
  13:13:46 STEP 2336 H=2336:00 +CPU= 21.021
  13:14:16 STEP 2337 H=2337:00 +CPU= 29.155
  13:14:35 STEP 2338 H=2338:00 +CPU= 19.533
  13:14:55 STEP 2339 H=2339:00 +CPU= 19.676
  13:15:30 STEP 2340 H=2340:00 +CPU= 34.565
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002340
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002340
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002340
  13:15:50 STEP 2341 H=2341:00 +CPU= 19.625
  13:16:09 STEP 2342 H=2342:00 +CPU= 18.673
  13:16:39 STEP 2343 H=2343:00 +CPU= 29.489
  13:17:00 STEP 2344 H=2344:00 +CPU= 20.990
  13:17:20 STEP 2345 H=2345:00 +CPU= 19.337
  13:17:55 STEP 2346 H=2346:00 +CPU= 34.021
  13:18:15 STEP 2347 H=2347:00 +CPU= 19.699
  13:18:35 STEP 2348 H=2348:00 +CPU= 20.343
  13:19:06 STEP 2349 H=2349:00 +CPU= 30.083
  13:19:24 STEP 2350 H=2350:00 +CPU= 18.496
  13:19:43 STEP 2351 H=2351:00 +CPU= 19.063
  13:20:21 STEP 2352 H=2352:00 +CPU= 37.064
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002352
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002352
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002352
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002328
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002328
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002328
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002340
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002340
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002340
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_97.zip
Uploading the intermediate file: upload_file_97.zip
  13:20:41 STEP 2353 H=2353:00 +CPU= 19.832
  13:21:02 STEP 2354 H=2354:00 +CPU= 20.137
  13:21:33 STEP 2355 H=2355:00 +CPU= 30.605
  13:21:54 STEP 2356 H=2356:00 +CPU= 21.333
  13:22:15 STEP 2357 H=2357:00 +CPU= 20.468
  13:22:49 STEP 2358 H=2358:00 +CPU= 32.972
  13:23:08 STEP 2359 H=2359:00 +CPU= 19.319
  13:23:28 STEP 2360 H=2360:00 +CPU= 19.633
  13:23:58 STEP 2361 H=2361:00 +CPU= 29.302
  13:24:16 STEP 2362 H=2362:00 +CPU= 18.617
  13:24:35 STEP 2363 H=2363:00 +CPU= 18.473
  13:25:05 STEP 2364 H=2364:00 +CPU= 30.510
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002364
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002364
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002364
  13:25:23 STEP 2365 H=2365:00 +CPU= 17.714
  13:25:42 STEP 2366 H=2366:00 +CPU= 18.558
  13:26:09 STEP 2367 H=2367:00 +CPU= 27.332
  13:26:27 STEP 2368 H=2368:00 +CPU= 18.038
  13:26:45 STEP 2369 H=2369:00 +CPU= 18.218
  13:27:14 STEP 2370 H=2370:00 +CPU= 28.703
  13:27:32 STEP 2371 H=2371:00 +CPU= 17.874
  13:27:51 STEP 2372 H=2372:00 +CPU= 18.777
  13:28:19 STEP 2373 H=2373:00 +CPU= 27.879
  13:28:37 STEP 2374 H=2374:00 +CPU= 18.310
  13:28:56 STEP 2375 H=2375:00 +CPU= 18.659
  13:29:29 STEP 2376 H=2376:00 +CPU= 33.062
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002376
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002376
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002376
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002352
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002352
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002352
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002364
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002364
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002364
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_98.zip
Uploading the intermediate file: upload_file_98.zip
  13:29:47 STEP 2377 H=2377:00 +CPU= 17.744
  13:30:05 STEP 2378 H=2378:00 +CPU= 18.589
  13:30:35 STEP 2379 H=2379:00 +CPU= 29.062
  13:30:54 STEP 2380 H=2380:00 +CPU= 19.337
  13:31:13 STEP 2381 H=2381:00 +CPU= 18.364
  13:31:44 STEP 2382 H=2382:00 +CPU= 30.749
  13:32:02 STEP 2383 H=2383:00 +CPU= 17.922
  13:32:21 STEP 2384 H=2384:00 +CPU= 18.715
  13:32:50 STEP 2385 H=2385:00 +CPU= 29.099
  13:33:10 STEP 2386 H=2386:00 +CPU= 20.085
  13:33:29 STEP 2387 H=2387:00 +CPU= 18.720
  13:34:05 STEP 2388 H=2388:00 +CPU= 35.457
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002388
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002388
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002388
  13:34:24 STEP 2389 H=2389:00 +CPU= 18.691
  13:34:46 STEP 2390 H=2390:00 +CPU= 21.264
  13:35:20 STEP 2391 H=2391:00 +CPU= 32.899
  13:35:41 STEP 2392 H=2392:00 +CPU= 21.299
  13:36:02 STEP 2393 H=2393:00 +CPU= 20.360
  13:36:33 STEP 2394 H=2394:00 +CPU= 30.720
  13:36:55 STEP 2395 H=2395:00 +CPU= 20.833
  13:37:17 STEP 2396 H=2396:00 +CPU= 21.941
  13:37:49 STEP 2397 H=2397:00 +CPU= 31.037
  13:38:09 STEP 2398 H=2398:00 +CPU= 19.966
  13:38:30 STEP 2399 H=2399:00 +CPU= 20.754
  13:39:08 STEP 2400 H=2400:00 +CPU= 37.293
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002400
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002400
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002400
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002376
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002376
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002376
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002388
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002388
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002388
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_99.zip
Uploading the intermediate file: upload_file_99.zip
  13:39:27 STEP 2401 H=2401:00 +CPU= 18.869
  13:39:47 STEP 2402 H=2402:00 +CPU= 20.215
  13:40:18 STEP 2403 H=2403:00 +CPU= 30.661
  13:40:40 STEP 2404 H=2404:00 +CPU= 21.053
  13:41:00 STEP 2405 H=2405:00 +CPU= 20.137
  13:41:34 STEP 2406 H=2406:00 +CPU= 33.103
  13:41:55 STEP 2407 H=2407:00 +CPU= 20.208
  13:42:17 STEP 2408 H=2408:00 +CPU= 21.564
  13:42:47 STEP 2409 H=2409:00 +CPU= 30.060
  13:43:07 STEP 2410 H=2410:00 +CPU= 19.968
  13:43:28 STEP 2411 H=2411:00 +CPU= 20.464
  13:44:02 STEP 2412 H=2412:00 +CPU= 33.801
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002412
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002412
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002412
  13:44:22 STEP 2413 H=2413:00 +CPU= 19.259
  13:44:43 STEP 2414 H=2414:00 +CPU= 20.962
  13:45:15 STEP 2415 H=2415:00 +CPU= 30.896
  13:45:36 STEP 2416 H=2416:00 +CPU= 20.900
  13:45:56 STEP 2417 H=2417:00 +CPU= 20.191
  13:46:29 STEP 2418 H=2418:00 +CPU= 32.148
  13:46:48 STEP 2419 H=2419:00 +CPU= 18.948
  13:47:09 STEP 2420 H=2420:00 +CPU= 20.119
  13:47:39 STEP 2421 H=2421:00 +CPU= 30.401
  13:48:01 STEP 2422 H=2422:00 +CPU= 21.581
  13:48:24 STEP 2423 H=2423:00 +CPU= 22.127
  13:49:02 STEP 2424 H=2424:00 +CPU= 37.786
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002424
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002424
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002424
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002400
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002400
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002400
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002412
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002412
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002412
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_100.zip
Uploading the intermediate file: upload_file_100.zip
  13:49:23 STEP 2425 H=2425:00 +CPU= 20.492
  13:49:45 STEP 2426 H=2426:00 +CPU= 21.449
  13:50:18 STEP 2427 H=2427:00 +CPU= 32.234
  13:50:38 STEP 2428 H=2428:00 +CPU= 19.858
  13:50:59 STEP 2429 H=2429:00 +CPU= 20.784
  13:51:29 STEP 2430 H=2430:00 +CPU= 29.805
  13:51:50 STEP 2431 H=2431:00 +CPU= 20.489
  13:52:12 STEP 2432 H=2432:00 +CPU= 21.279
  13:52:44 STEP 2433 H=2433:00 +CPU= 31.215
  13:53:05 STEP 2434 H=2434:00 +CPU= 21.066
  13:53:25 STEP 2435 H=2435:00 +CPU= 19.589
  13:54:01 STEP 2436 H=2436:00 +CPU= 35.089
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002436
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002436
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002436
  13:54:22 STEP 2437 H=2437:00 +CPU= 21.170
  13:54:43 STEP 2438 H=2438:00 +CPU= 20.483
  13:55:15 STEP 2439 H=2439:00 +CPU= 31.667
  13:55:36 STEP 2440 H=2440:00 +CPU= 20.794
  13:55:58 STEP 2441 H=2441:00 +CPU= 21.007
  13:56:31 STEP 2442 H=2442:00 +CPU= 32.923
  13:56:51 STEP 2443 H=2443:00 +CPU= 19.872
  13:57:11 STEP 2444 H=2444:00 +CPU= 19.572
  13:57:39 STEP 2445 H=2445:00 +CPU= 28.697
  13:57:58 STEP 2446 H=2446:00 +CPU= 18.818
  13:58:19 STEP 2447 H=2447:00 +CPU= 20.940
  13:58:57 STEP 2448 H=2448:00 +CPU= 37.336
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002448
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002448
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002448
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002424
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002424
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002424
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002436
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002436
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002436
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_101.zip
Uploading the intermediate file: upload_file_101.zip
  13:59:16 STEP 2449 H=2449:00 +CPU= 19.068
Uploading trickle at timestep: 8812800
  13:59:36 STEP 2450 H=2450:00 +CPU= 19.959
  14:00:08 STEP 2451 H=2451:00 +CPU= 31.682
  14:00:31 STEP 2452 H=2452:00 +CPU= 22.212
  14:00:57 STEP 2453 H=2453:00 +CPU= 24.128
  14:01:29 STEP 2454 H=2454:00 +CPU= 31.764
  14:01:48 STEP 2455 H=2455:00 +CPU= 18.953
  14:02:09 STEP 2456 H=2456:00 +CPU= 20.254
  14:02:39 STEP 2457 H=2457:00 +CPU= 29.985
  14:03:00 STEP 2458 H=2458:00 +CPU= 20.106
  14:03:18 STEP 2459 H=2459:00 +CPU= 18.220
  14:03:50 STEP 2460 H=2460:00 +CPU= 32.055
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002460
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002460
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002460
  14:04:09 STEP 2461 H=2461:00 +CPU= 18.604
  14:04:27 STEP 2462 H=2462:00 +CPU= 18.456
  14:04:56 STEP 2463 H=2463:00 +CPU= 28.500
  14:05:16 STEP 2464 H=2464:00 +CPU= 20.150
  14:05:38 STEP 2465 H=2465:00 +CPU= 20.972
  14:06:10 STEP 2466 H=2466:00 +CPU= 32.062
  14:06:30 STEP 2467 H=2467:00 +CPU= 19.751
  14:06:51 STEP 2468 H=2468:00 +CPU= 20.159
  14:07:22 STEP 2469 H=2469:00 +CPU= 30.350
  14:07:39 STEP 2470 H=2470:00 +CPU= 17.381
  14:07:55 STEP 2471 H=2471:00 +CPU= 15.689
  14:08:26 STEP 2472 H=2472:00 +CPU= 30.399
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002472
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002472
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002472
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002448
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002448
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002448
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002460
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002460
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002460
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_102.zip
Uploading the intermediate file: upload_file_102.zip
  14:08:42 STEP 2473 H=2473:00 +CPU= 15.861
  14:08:58 STEP 2474 H=2474:00 +CPU= 15.912
  14:09:22 STEP 2475 H=2475:00 +CPU= 23.690
  14:09:37 STEP 2476 H=2476:00 +CPU= 15.414
  14:09:52 STEP 2477 H=2477:00 +CPU= 14.982
  14:10:16 STEP 2478 H=2478:00 +CPU= 23.735
  14:10:32 STEP 2479 H=2479:00 +CPU= 15.407
  14:10:47 STEP 2480 H=2480:00 +CPU= 15.886
  14:11:13 STEP 2481 H=2481:00 +CPU= 25.298
  14:11:29 STEP 2482 H=2482:00 +CPU= 16.012
  14:11:44 STEP 2483 H=2483:00 +CPU= 14.951
  14:12:10 STEP 2484 H=2484:00 +CPU= 25.295
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002484
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002484
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002484
  14:12:25 STEP 2485 H=2485:00 +CPU= 14.963
  14:12:40 STEP 2486 H=2486:00 +CPU= 15.496
  14:13:03 STEP 2487 H=2487:00 +CPU= 23.182
  14:13:19 STEP 2488 H=2488:00 +CPU= 15.560
  14:13:36 STEP 2489 H=2489:00 +CPU= 16.562
  14:14:00 STEP 2490 H=2490:00 +CPU= 24.349
  14:14:17 STEP 2491 H=2491:00 +CPU= 16.021
  14:14:35 STEP 2492 H=2492:00 +CPU= 18.361
  14:15:04 STEP 2493 H=2493:00 +CPU= 28.807
  14:15:24 STEP 2494 H=2494:00 +CPU= 20.038
  14:15:44 STEP 2495 H=2495:00 +CPU= 20.010
  14:16:18 STEP 2496 H=2496:00 +CPU= 33.615
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002496
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002496
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002496
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002472
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002472
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002472
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002484
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002484
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002484
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_103.zip
Uploading the intermediate file: upload_file_103.zip
  14:16:37 STEP 2497 H=2497:00 +CPU= 18.975
  14:16:56 STEP 2498 H=2498:00 +CPU= 18.967
  14:17:29 STEP 2499 H=2499:00 +CPU= 32.190
  14:17:49 STEP 2500 H=2500:00 +CPU= 19.763
  14:18:10 STEP 2501 H=2501:00 +CPU= 19.983
  14:18:41 STEP 2502 H=2502:00 +CPU= 31.460
  14:19:00 STEP 2503 H=2503:00 +CPU= 18.827
  14:19:20 STEP 2504 H=2504:00 +CPU= 19.639
  14:19:48 STEP 2505 H=2505:00 +CPU= 28.010
  14:20:08 STEP 2506 H=2506:00 +CPU= 19.589
  14:20:29 STEP 2507 H=2507:00 +CPU= 20.206
  14:21:06 STEP 2508 H=2508:00 +CPU= 36.536
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002508
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002508
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002508
  14:21:28 STEP 2509 H=2509:00 +CPU= 21.032
  14:21:50 STEP 2510 H=2510:00 +CPU= 21.471
  14:22:22 STEP 2511 H=2511:00 +CPU= 31.610
  14:22:41 STEP 2512 H=2512:00 +CPU= 19.305
  14:23:01 STEP 2513 H=2513:00 +CPU= 19.481
  14:23:30 STEP 2514 H=2514:00 +CPU= 29.286
  14:23:50 STEP 2515 H=2515:00 +CPU= 19.215
  14:24:12 STEP 2516 H=2516:00 +CPU= 21.228
  14:24:44 STEP 2517 H=2517:00 +CPU= 31.735
  14:25:04 STEP 2518 H=2518:00 +CPU= 19.534
  14:25:24 STEP 2519 H=2519:00 +CPU= 19.843
  14:26:01 STEP 2520 H=2520:00 +CPU= 36.694
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002520
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002520
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002520
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002496
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002496
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002496
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002508
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002508
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002508
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_104.zip
Uploading the intermediate file: upload_file_104.zip
  14:26:20 STEP 2521 H=2521:00 +CPU= 19.000
  14:26:40 STEP 2522 H=2522:00 +CPU= 19.514
  14:27:10 STEP 2523 H=2523:00 +CPU= 29.681
  14:27:29 STEP 2524 H=2524:00 +CPU= 19.322
  14:27:49 STEP 2525 H=2525:00 +CPU= 20.006
  14:28:19 STEP 2526 H=2526:00 +CPU= 29.333
  14:28:37 STEP 2527 H=2527:00 +CPU= 18.205
  14:28:56 STEP 2528 H=2528:00 +CPU= 18.279
  14:29:24 STEP 2529 H=2529:00 +CPU= 28.771
  14:29:43 STEP 2530 H=2530:00 +CPU= 18.807
  14:30:02 STEP 2531 H=2531:00 +CPU= 18.620
  14:30:38 STEP 2532 H=2532:00 +CPU= 35.339
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002532
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002532
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002532
  14:30:58 STEP 2533 H=2533:00 +CPU= 19.984
  14:31:19 STEP 2534 H=2534:00 +CPU= 20.004
  14:31:51 STEP 2535 H=2535:00 +CPU= 31.444
  14:32:12 STEP 2536 H=2536:00 +CPU= 20.824
  14:32:32 STEP 2537 H=2537:00 +CPU= 20.354
  14:33:04 STEP 2538 H=2538:00 +CPU= 31.007
  14:33:25 STEP 2539 H=2539:00 +CPU= 20.815
  14:33:47 STEP 2540 H=2540:00 +CPU= 21.102
  14:34:16 STEP 2541 H=2541:00 +CPU= 29.116
  14:34:36 STEP 2542 H=2542:00 +CPU= 20.163
  14:34:58 STEP 2543 H=2543:00 +CPU= 21.137
  14:35:35 STEP 2544 H=2544:00 +CPU= 36.909
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002544
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002544
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002544
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002520
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002520
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002520
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002532
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002532
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002532
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_105.zip
Uploading the intermediate file: upload_file_105.zip
  14:35:53 STEP 2545 H=2545:00 +CPU= 17.818
  14:36:13 STEP 2546 H=2546:00 +CPU= 19.638
  14:36:45 STEP 2547 H=2547:00 +CPU= 31.293
  14:37:06 STEP 2548 H=2548:00 +CPU= 20.415
  14:37:24 STEP 2549 H=2549:00 +CPU= 18.411
  14:37:57 STEP 2550 H=2550:00 +CPU= 32.143
  14:38:18 STEP 2551 H=2551:00 +CPU= 20.891
  14:38:39 STEP 2552 H=2552:00 +CPU= 20.810
  14:39:14 STEP 2553 H=2553:00 +CPU= 33.662
  14:39:36 STEP 2554 H=2554:00 +CPU= 21.377
  14:39:55 STEP 2555 H=2555:00 +CPU= 19.538
  14:40:28 STEP 2556 H=2556:00 +CPU= 32.679
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002556
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002556
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002556
  14:40:50 STEP 2557 H=2557:00 +CPU= 20.738
  14:41:09 STEP 2558 H=2558:00 +CPU= 18.898
  14:41:39 STEP 2559 H=2559:00 +CPU= 29.858
  14:41:59 STEP 2560 H=2560:00 +CPU= 20.078
  14:42:20 STEP 2561 H=2561:00 +CPU= 20.582
  14:42:53 STEP 2562 H=2562:00 +CPU= 31.930
  14:43:12 STEP 2563 H=2563:00 +CPU= 19.463
  14:43:33 STEP 2564 H=2564:00 +CPU= 20.317
  14:44:03 STEP 2565 H=2565:00 +CPU= 29.761
  14:44:23 STEP 2566 H=2566:00 +CPU= 20.193
  14:44:45 STEP 2567 H=2567:00 +CPU= 20.843
  14:45:23 STEP 2568 H=2568:00 +CPU= 37.844
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002568
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002568
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002568
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002544
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002544
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002544
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002556
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002556
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002556
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_106.zip
Uploading the intermediate file: upload_file_106.zip
  14:45:44 STEP 2569 H=2569:00 +CPU= 20.477
  14:46:02 STEP 2570 H=2570:00 +CPU= 17.678
  14:46:29 STEP 2571 H=2571:00 +CPU= 26.649
  14:46:48 STEP 2572 H=2572:00 +CPU= 18.377
  14:47:04 STEP 2573 H=2573:00 +CPU= 16.109
  14:47:29 STEP 2574 H=2574:00 +CPU= 24.612
  14:47:45 STEP 2575 H=2575:00 +CPU= 16.139
  14:48:01 STEP 2576 H=2576:00 +CPU= 16.043
  14:48:26 STEP 2577 H=2577:00 +CPU= 24.731
  14:48:44 STEP 2578 H=2578:00 +CPU= 18.179
  14:49:02 STEP 2579 H=2579:00 +CPU= 17.597
  14:49:31 STEP 2580 H=2580:00 +CPU= 28.420
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002580
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002580
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002580
  14:49:49 STEP 2581 H=2581:00 +CPU= 17.887
  14:50:05 STEP 2582 H=2582:00 +CPU= 16.234
  14:50:34 STEP 2583 H=2583:00 +CPU= 28.046
  14:50:53 STEP 2584 H=2584:00 +CPU= 18.228
  14:51:09 STEP 2585 H=2585:00 +CPU= 15.753
  14:51:35 STEP 2586 H=2586:00 +CPU= 26.209
  14:51:52 STEP 2587 H=2587:00 +CPU= 16.447
  14:52:08 STEP 2588 H=2588:00 +CPU= 15.871
  14:52:32 STEP 2589 H=2589:00 +CPU= 24.351
  14:52:50 STEP 2590 H=2590:00 +CPU= 17.069
  14:53:06 STEP 2591 H=2591:00 +CPU= 16.262
  14:53:38 STEP 2592 H=2592:00 +CPU= 31.179
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002592
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002592
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002592
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002568
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002568
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002568
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002580
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002580
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002580
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_107.zip
Uploading the intermediate file: upload_file_107.zip
  14:53:56 STEP 2593 H=2593:00 +CPU= 18.191
  14:54:13 STEP 2594 H=2594:00 +CPU= 16.749
  14:54:40 STEP 2595 H=2595:00 +CPU= 25.970
  14:54:57 STEP 2596 H=2596:00 +CPU= 17.501
  14:55:15 STEP 2597 H=2597:00 +CPU= 17.081
  14:55:44 STEP 2598 H=2598:00 +CPU= 28.066
  14:56:01 STEP 2599 H=2599:00 +CPU= 16.801
  14:56:18 STEP 2600 H=2600:00 +CPU= 17.006
  14:56:43 STEP 2601 H=2601:00 +CPU= 25.122
  14:56:59 STEP 2602 H=2602:00 +CPU= 15.701
  14:57:14 STEP 2603 H=2603:00 +CPU= 15.056
  14:57:40 STEP 2604 H=2604:00 +CPU= 26.086
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002604
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002604
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002604
  14:57:55 STEP 2605 H=2605:00 +CPU= 15.205
  14:58:11 STEP 2606 H=2606:00 +CPU= 15.307
  14:58:34 STEP 2607 H=2607:00 +CPU= 23.651
  14:58:50 STEP 2608 H=2608:00 +CPU= 15.770
  14:59:05 STEP 2609 H=2609:00 +CPU= 15.000
  14:59:29 STEP 2610 H=2610:00 +CPU= 24.258
  14:59:45 STEP 2611 H=2611:00 +CPU= 15.454
  15:00:00 STEP 2612 H=2612:00 +CPU= 15.507
  15:00:24 STEP 2613 H=2613:00 +CPU= 23.378
  15:00:39 STEP 2614 H=2614:00 +CPU= 15.603
  15:00:55 STEP 2615 H=2615:00 +CPU= 15.598
  15:01:23 STEP 2616 H=2616:00 +CPU= 27.809
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002616
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002616
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002616
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002592
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002592
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002592
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002604
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002604
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002604
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_108.zip
Uploading the intermediate file: upload_file_108.zip
  15:01:38 STEP 2617 H=2617:00 +CPU= 15.555
  15:01:54 STEP 2618 H=2618:00 +CPU= 15.444
  15:02:18 STEP 2619 H=2619:00 +CPU= 23.761
  15:02:33 STEP 2620 H=2620:00 +CPU= 15.751
  15:02:48 STEP 2621 H=2621:00 +CPU= 14.942
  15:03:12 STEP 2622 H=2622:00 +CPU= 24.087
  15:03:28 STEP 2623 H=2623:00 +CPU= 15.197
  15:03:43 STEP 2624 H=2624:00 +CPU= 15.591
  15:04:07 STEP 2625 H=2625:00 +CPU= 23.719
  15:04:23 STEP 2626 H=2626:00 +CPU= 15.684
  15:04:38 STEP 2627 H=2627:00 +CPU= 15.095
  15:05:04 STEP 2628 H=2628:00 +CPU= 25.953
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002628
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002628
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002628
  15:05:19 STEP 2629 H=2629:00 +CPU= 15.123
  15:05:34 STEP 2630 H=2630:00 +CPU= 15.406
  15:05:58 STEP 2631 H=2631:00 +CPU= 23.494
  15:06:13 STEP 2632 H=2632:00 +CPU= 15.530
  15:06:28 STEP 2633 H=2633:00 +CPU= 14.909
  15:06:52 STEP 2634 H=2634:00 +CPU= 23.790
  15:07:07 STEP 2635 H=2635:00 +CPU= 15.175
  15:07:23 STEP 2636 H=2636:00 +CPU= 15.320
  15:07:46 STEP 2637 H=2637:00 +CPU= 23.372
  15:08:02 STEP 2638 H=2638:00 +CPU= 15.557
  15:08:17 STEP 2639 H=2639:00 +CPU= 15.639
  15:08:45 STEP 2640 H=2640:00 +CPU= 27.923
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002640
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002640
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002640
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002616
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002616
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002616
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002628
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002628
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002628
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_109.zip
Uploading the intermediate file: upload_file_109.zip
  15:09:01 STEP 2641 H=2641:00 +CPU= 15.327
  15:09:16 STEP 2642 H=2642:00 +CPU= 15.534
  15:09:40 STEP 2643 H=2643:00 +CPU= 23.744
  15:09:56 STEP 2644 H=2644:00 +CPU= 15.692
  15:10:11 STEP 2645 H=2645:00 +CPU= 15.015
  15:10:35 STEP 2646 H=2646:00 +CPU= 24.157
  15:10:50 STEP 2647 H=2647:00 +CPU= 15.092
  15:11:05 STEP 2648 H=2648:00 +CPU= 15.662
  15:11:29 STEP 2649 H=2649:00 +CPU= 23.767
  15:11:45 STEP 2650 H=2650:00 +CPU= 15.817
  15:12:00 STEP 2651 H=2651:00 +CPU= 15.239
  15:12:27 STEP 2652 H=2652:00 +CPU= 26.201
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002652
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002652
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002652
  15:12:42 STEP 2653 H=2653:00 +CPU= 15.200
  15:12:57 STEP 2654 H=2654:00 +CPU= 15.637
  15:13:21 STEP 2655 H=2655:00 +CPU= 23.664
  15:13:37 STEP 2656 H=2656:00 +CPU= 15.818
  15:13:52 STEP 2657 H=2657:00 +CPU= 15.220
  15:14:16 STEP 2658 H=2658:00 +CPU= 24.059
  15:14:32 STEP 2659 H=2659:00 +CPU= 15.382
  15:14:47 STEP 2660 H=2660:00 +CPU= 15.502
  15:15:11 STEP 2661 H=2661:00 +CPU= 23.658
  15:15:27 STEP 2662 H=2662:00 +CPU= 15.740
  15:15:42 STEP 2663 H=2663:00 +CPU= 15.660
  15:16:10 STEP 2664 H=2664:00 +CPU= 27.818
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002664
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002664
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002664
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002640
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002640
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002640
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002652
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002652
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002652
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_110.zip
Uploading the intermediate file: upload_file_110.zip
  15:16:25 STEP 2665 H=2665:00 +CPU= 15.399
  15:16:41 STEP 2666 H=2666:00 +CPU= 15.725
  15:17:05 STEP 2667 H=2667:00 +CPU= 23.671
  15:17:21 STEP 2668 H=2668:00 +CPU= 15.617
  15:17:36 STEP 2669 H=2669:00 +CPU= 15.189
  15:18:00 STEP 2670 H=2670:00 +CPU= 24.026
  15:18:15 STEP 2671 H=2671:00 +CPU= 15.311
  15:18:31 STEP 2672 H=2672:00 +CPU= 15.724
  15:18:55 STEP 2673 H=2673:00 +CPU= 23.861
  15:19:11 STEP 2674 H=2674:00 +CPU= 15.793
  15:19:26 STEP 2675 H=2675:00 +CPU= 15.081
  15:19:51 STEP 2676 H=2676:00 +CPU= 25.841
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002676
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002676
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002676
  15:20:07 STEP 2677 H=2677:00 +CPU= 15.445
  15:20:23 STEP 2678 H=2678:00 +CPU= 15.683
  15:20:46 STEP 2679 H=2679:00 +CPU= 23.493
  15:21:02 STEP 2680 H=2680:00 +CPU= 15.824
  15:21:17 STEP 2681 H=2681:00 +CPU= 15.155
  15:21:41 STEP 2682 H=2682:00 +CPU= 24.000
  15:21:56 STEP 2683 H=2683:00 +CPU= 15.234
  15:22:12 STEP 2684 H=2684:00 +CPU= 15.347
  15:22:35 STEP 2685 H=2685:00 +CPU= 23.393
  15:22:51 STEP 2686 H=2686:00 +CPU= 15.773
  15:23:07 STEP 2687 H=2687:00 +CPU= 15.666
  15:23:35 STEP 2688 H=2688:00 +CPU= 28.341
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002688
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002688
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002688
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002664
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002664
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002664
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002676
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002676
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002676
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_111.zip
Uploading the intermediate file: upload_file_111.zip
  15:23:50 STEP 2689 H=2689:00 +CPU= 15.242
Uploading trickle at timestep: 9676800
  15:24:06 STEP 2690 H=2690:00 +CPU= 15.577
  15:24:29 STEP 2691 H=2691:00 +CPU= 23.293
  15:24:45 STEP 2692 H=2692:00 +CPU= 15.448
  15:25:00 STEP 2693 H=2693:00 +CPU= 15.144
  15:25:24 STEP 2694 H=2694:00 +CPU= 24.075
  15:25:39 STEP 2695 H=2695:00 +CPU= 15.232
  15:25:55 STEP 2696 H=2696:00 +CPU= 15.413
  15:26:18 STEP 2697 H=2697:00 +CPU= 23.880
  15:26:34 STEP 2698 H=2698:00 +CPU= 15.672
  15:26:49 STEP 2699 H=2699:00 +CPU= 15.223
  15:27:15 STEP 2700 H=2700:00 +CPU= 25.859
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002700
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002700
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002700
  15:27:30 STEP 2701 H=2701:00 +CPU= 15.011
  15:27:46 STEP 2702 H=2702:00 +CPU= 15.532
  15:28:09 STEP 2703 H=2703:00 +CPU= 23.610
  15:28:25 STEP 2704 H=2704:00 +CPU= 15.980
  15:28:41 STEP 2705 H=2705:00 +CPU= 15.542
  15:29:06 STEP 2706 H=2706:00 +CPU= 24.846
  15:29:22 STEP 2707 H=2707:00 +CPU= 15.573
  15:29:37 STEP 2708 H=2708:00 +CPU= 15.732
  15:30:01 STEP 2709 H=2709:00 +CPU= 23.627
  15:30:18 STEP 2710 H=2710:00 +CPU= 16.524
  15:30:34 STEP 2711 H=2711:00 +CPU= 16.580
  15:31:04 STEP 2712 H=2712:00 +CPU= 29.754
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002712
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002712
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002712
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002688
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002688
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002688
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002700
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002700
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002700
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_112.zip
Uploading the intermediate file: upload_file_112.zip
  15:31:21 STEP 2713 H=2713:00 +CPU= 16.769
  15:31:39 STEP 2714 H=2714:00 +CPU= 17.262
  15:32:04 STEP 2715 H=2715:00 +CPU= 24.763
  15:32:23 STEP 2716 H=2716:00 +CPU= 18.787
  15:32:39 STEP 2717 H=2717:00 +CPU= 15.638
  15:33:04 STEP 2718 H=2718:00 +CPU= 24.897
  15:33:19 STEP 2719 H=2719:00 +CPU= 15.392
  15:33:35 STEP 2720 H=2720:00 +CPU= 15.691
  15:33:59 STEP 2721 H=2721:00 +CPU= 23.657
  15:34:15 STEP 2722 H=2722:00 +CPU= 15.787
  15:34:30 STEP 2723 H=2723:00 +CPU= 15.449
  15:34:56 STEP 2724 H=2724:00 +CPU= 26.112
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002724
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002724
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002724
  15:35:11 STEP 2725 H=2725:00 +CPU= 15.204
  15:35:27 STEP 2726 H=2726:00 +CPU= 15.602
  15:35:51 STEP 2727 H=2727:00 +CPU= 23.680
  15:36:07 STEP 2728 H=2728:00 +CPU= 15.690
  15:36:22 STEP 2729 H=2729:00 +CPU= 15.313
  15:36:46 STEP 2730 H=2730:00 +CPU= 24.139
  15:37:01 STEP 2731 H=2731:00 +CPU= 15.111
  15:37:17 STEP 2732 H=2732:00 +CPU= 15.599
  15:37:41 STEP 2733 H=2733:00 +CPU= 23.607
  15:37:56 STEP 2734 H=2734:00 +CPU= 15.794
  15:38:12 STEP 2735 H=2735:00 +CPU= 15.707
  15:38:40 STEP 2736 H=2736:00 +CPU= 28.130
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002736
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002736
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002736
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002712
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002712
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002712
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002724
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002724
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002724
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_113.zip
Uploading the intermediate file: upload_file_113.zip
  15:38:56 STEP 2737 H=2737:00 +CPU= 15.669
  15:39:12 STEP 2738 H=2738:00 +CPU= 15.856
  15:39:36 STEP 2739 H=2739:00 +CPU= 23.709
  15:39:51 STEP 2740 H=2740:00 +CPU= 15.674
  15:40:06 STEP 2741 H=2741:00 +CPU= 15.071
  15:40:31 STEP 2742 H=2742:00 +CPU= 24.274
  15:40:46 STEP 2743 H=2743:00 +CPU= 15.255
  15:41:02 STEP 2744 H=2744:00 +CPU= 15.849
  15:41:26 STEP 2745 H=2745:00 +CPU= 23.908
  15:41:42 STEP 2746 H=2746:00 +CPU= 15.777
  15:41:57 STEP 2747 H=2747:00 +CPU= 15.283
  15:42:23 STEP 2748 H=2748:00 +CPU= 26.001
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002748
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002748
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002748
  15:42:39 STEP 2749 H=2749:00 +CPU= 16.022
  15:42:57 STEP 2750 H=2750:00 +CPU= 17.230
  15:43:24 STEP 2751 H=2751:00 +CPU= 26.667
  15:43:41 STEP 2752 H=2752:00 +CPU= 16.908
  15:43:57 STEP 2753 H=2753:00 +CPU= 15.899
  15:44:22 STEP 2754 H=2754:00 +CPU= 24.960
  15:44:38 STEP 2755 H=2755:00 +CPU= 15.951
  15:44:55 STEP 2756 H=2756:00 +CPU= 16.632
  15:45:20 STEP 2757 H=2757:00 +CPU= 24.371
  15:45:37 STEP 2758 H=2758:00 +CPU= 16.615
  15:45:53 STEP 2759 H=2759:00 +CPU= 16.015
  15:46:24 STEP 2760 H=2760:00 +CPU= 30.687
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002760
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002760
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002760
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002736
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002736
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002736
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002748
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002748
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002748
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_114.zip
Uploading the intermediate file: upload_file_114.zip
  15:46:41 STEP 2761 H=2761:00 +CPU= 16.261
  15:46:58 STEP 2762 H=2762:00 +CPU= 17.100
  15:47:25 STEP 2763 H=2763:00 +CPU= 26.692
  15:47:44 STEP 2764 H=2764:00 +CPU= 18.522
  15:48:01 STEP 2765 H=2765:00 +CPU= 16.545
  15:48:26 STEP 2766 H=2766:00 +CPU= 24.922
  15:48:43 STEP 2767 H=2767:00 +CPU= 16.578
  15:48:59 STEP 2768 H=2768:00 +CPU= 16.036
  15:49:23 STEP 2769 H=2769:00 +CPU= 24.161
  15:49:41 STEP 2770 H=2770:00 +CPU= 17.793
  15:49:57 STEP 2771 H=2771:00 +CPU= 15.579
  15:50:25 STEP 2772 H=2772:00 +CPU= 27.145
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002772
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002772
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002772
  15:50:41 STEP 2773 H=2773:00 +CPU= 15.973
  15:50:56 STEP 2774 H=2774:00 +CPU= 15.619
  15:51:20 STEP 2775 H=2775:00 +CPU= 23.460
  15:51:38 STEP 2776 H=2776:00 +CPU= 17.361
  15:51:54 STEP 2777 H=2777:00 +CPU= 16.224
  15:52:19 STEP 2778 H=2778:00 +CPU= 24.865
  15:52:38 STEP 2779 H=2779:00 +CPU= 18.580
  15:52:55 STEP 2780 H=2780:00 +CPU= 16.137
  15:53:19 STEP 2781 H=2781:00 +CPU= 24.551
  15:53:39 STEP 2782 H=2782:00 +CPU= 18.942
  15:53:55 STEP 2783 H=2783:00 +CPU= 16.174
  15:54:24 STEP 2784 H=2784:00 +CPU= 28.214
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002784
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002784
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002784
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002760
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002760
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002760
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002772
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002772
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002772
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_115.zip
Uploading the intermediate file: upload_file_115.zip
  15:54:40 STEP 2785 H=2785:00 +CPU= 16.043
  15:54:57 STEP 2786 H=2786:00 +CPU= 17.163
  15:55:20 STEP 2787 H=2787:00 +CPU= 23.111
  15:55:36 STEP 2788 H=2788:00 +CPU= 15.725
  15:55:51 STEP 2789 H=2789:00 +CPU= 15.345
  15:56:16 STEP 2790 H=2790:00 +CPU= 24.773
  15:56:32 STEP 2791 H=2791:00 +CPU= 15.650
  15:56:48 STEP 2792 H=2792:00 +CPU= 15.971
  15:57:13 STEP 2793 H=2793:00 +CPU= 24.641
  15:57:30 STEP 2794 H=2794:00 +CPU= 16.799
  15:57:46 STEP 2795 H=2795:00 +CPU= 16.240
  15:58:13 STEP 2796 H=2796:00 +CPU= 26.544
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002796
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002796
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002796
  15:58:30 STEP 2797 H=2797:00 +CPU= 16.553
  15:58:48 STEP 2798 H=2798:00 +CPU= 17.370
  15:59:13 STEP 2799 H=2799:00 +CPU= 24.584
  15:59:30 STEP 2800 H=2800:00 +CPU= 16.920
  15:59:46 STEP 2801 H=2801:00 +CPU= 16.357
  16:00:14 STEP 2802 H=2802:00 +CPU= 26.796
  16:00:29 STEP 2803 H=2803:00 +CPU= 15.168
  16:00:46 STEP 2804 H=2804:00 +CPU= 17.067
  16:01:12 STEP 2805 H=2805:00 +CPU= 25.805
  16:01:29 STEP 2806 H=2806:00 +CPU= 16.097
  16:01:47 STEP 2807 H=2807:00 +CPU= 17.886
  16:02:17 STEP 2808 H=2808:00 +CPU= 29.464
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002808
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002808
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002808
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002784
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002784
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002784
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002796
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002796
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002796
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_116.zip
Uploading the intermediate file: upload_file_116.zip
  16:02:33 STEP 2809 H=2809:00 +CPU= 16.481
  16:02:50 STEP 2810 H=2810:00 +CPU= 16.781
  16:03:17 STEP 2811 H=2811:00 +CPU= 25.875
  16:03:34 STEP 2812 H=2812:00 +CPU= 17.094
  16:03:51 STEP 2813 H=2813:00 +CPU= 16.824
  16:04:19 STEP 2814 H=2814:00 +CPU= 27.280
  16:04:36 STEP 2815 H=2815:00 +CPU= 16.836
  16:04:54 STEP 2816 H=2816:00 +CPU= 17.466
  16:05:20 STEP 2817 H=2817:00 +CPU= 25.438
  16:05:37 STEP 2818 H=2818:00 +CPU= 17.236
  16:05:54 STEP 2819 H=2819:00 +CPU= 16.577
  16:06:21 STEP 2820 H=2820:00 +CPU= 26.521
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002820
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002820
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002820
  16:06:38 STEP 2821 H=2821:00 +CPU= 16.647
  16:06:55 STEP 2822 H=2822:00 +CPU= 16.902
  16:07:21 STEP 2823 H=2823:00 +CPU= 26.008
  16:07:41 STEP 2824 H=2824:00 +CPU= 18.930
  16:07:57 STEP 2825 H=2825:00 +CPU= 16.470
  16:08:24 STEP 2826 H=2826:00 +CPU= 26.411
  16:08:41 STEP 2827 H=2827:00 +CPU= 17.057
  16:08:59 STEP 2828 H=2828:00 +CPU= 17.890
  16:09:26 STEP 2829 H=2829:00 +CPU= 26.168
  16:09:44 STEP 2830 H=2830:00 +CPU= 17.524
  16:10:02 STEP 2831 H=2831:00 +CPU= 18.091
  16:10:35 STEP 2832 H=2832:00 +CPU= 31.935
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002832
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002832
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002832
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002808
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002808
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002808
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002820
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002820
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002820
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_117.zip
Uploading the intermediate file: upload_file_117.zip
  16:10:53 STEP 2833 H=2833:00 +CPU= 17.568
  16:11:11 STEP 2834 H=2834:00 +CPU= 17.684
  16:11:35 STEP 2835 H=2835:00 +CPU= 24.251
  16:11:51 STEP 2836 H=2836:00 +CPU= 16.312
  16:12:09 STEP 2837 H=2837:00 +CPU= 17.066
  16:12:35 STEP 2838 H=2838:00 +CPU= 26.097
  16:12:52 STEP 2839 H=2839:00 +CPU= 16.337
  16:13:09 STEP 2840 H=2840:00 +CPU= 17.246
  16:13:35 STEP 2841 H=2841:00 +CPU= 25.298
  16:13:51 STEP 2842 H=2842:00 +CPU= 15.893
  16:14:06 STEP 2843 H=2843:00 +CPU= 15.358
  16:14:33 STEP 2844 H=2844:00 +CPU= 26.488
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002844
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002844
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002844
  16:14:49 STEP 2845 H=2845:00 +CPU= 15.667
  16:15:05 STEP 2846 H=2846:00 +CPU= 16.271
  16:15:29 STEP 2847 H=2847:00 +CPU= 23.785
  16:15:48 STEP 2848 H=2848:00 +CPU= 18.450
  16:16:08 STEP 2849 H=2849:00 +CPU= 19.418
  16:16:36 STEP 2850 H=2850:00 +CPU= 27.188
  16:16:52 STEP 2851 H=2851:00 +CPU= 16.409
  16:17:09 STEP 2852 H=2852:00 +CPU= 17.012
  16:17:35 STEP 2853 H=2853:00 +CPU= 25.655
  16:17:53 STEP 2854 H=2854:00 +CPU= 17.016
  16:18:09 STEP 2855 H=2855:00 +CPU= 15.903
  16:18:37 STEP 2856 H=2856:00 +CPU= 27.818
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002856
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002856
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002856
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002832
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002832
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002832
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002844
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002844
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002844
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_118.zip
Uploading the intermediate file: upload_file_118.zip
  16:18:52 STEP 2857 H=2857:00 +CPU= 15.225
  16:19:10 STEP 2858 H=2858:00 +CPU= 17.935
  16:19:39 STEP 2859 H=2859:00 +CPU= 28.070
  16:19:56 STEP 2860 H=2860:00 +CPU= 16.882
  16:20:14 STEP 2861 H=2861:00 +CPU= 17.955
  16:20:42 STEP 2862 H=2862:00 +CPU= 26.825
  16:21:00 STEP 2863 H=2863:00 +CPU= 18.367
  16:21:19 STEP 2864 H=2864:00 +CPU= 18.151
  16:21:44 STEP 2865 H=2865:00 +CPU= 24.938
  16:22:01 STEP 2866 H=2866:00 +CPU= 16.402
  16:22:17 STEP 2867 H=2867:00 +CPU= 16.486
  16:22:47 STEP 2868 H=2868:00 +CPU= 28.856
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002868
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002868
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002868
  16:23:05 STEP 2869 H=2869:00 +CPU= 18.045
  16:23:23 STEP 2870 H=2870:00 +CPU= 17.899
  16:23:49 STEP 2871 H=2871:00 +CPU= 25.951
  16:24:08 STEP 2872 H=2872:00 +CPU= 18.534
  16:24:27 STEP 2873 H=2873:00 +CPU= 17.942
  16:24:53 STEP 2874 H=2874:00 +CPU= 26.348
  16:25:11 STEP 2875 H=2875:00 +CPU= 17.684
  16:25:30 STEP 2876 H=2876:00 +CPU= 17.965
  16:25:56 STEP 2877 H=2877:00 +CPU= 25.858
  16:26:12 STEP 2878 H=2878:00 +CPU= 16.425
  16:26:31 STEP 2879 H=2879:00 +CPU= 18.024
  16:27:00 STEP 2880 H=2880:00 +CPU= 28.829
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002880
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002880
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002880
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002856
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002856
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002856
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002868
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002868
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002868
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_119.zip
Uploading the intermediate file: upload_file_119.zip
  16:27:17 STEP 2881 H=2881:00 +CPU= 17.327
  16:27:35 STEP 2882 H=2882:00 +CPU= 17.315
  16:28:02 STEP 2883 H=2883:00 +CPU= 26.510
  16:28:20 STEP 2884 H=2884:00 +CPU= 17.565
  16:28:38 STEP 2885 H=2885:00 +CPU= 17.694
  16:29:04 STEP 2886 H=2886:00 +CPU= 26.376
  16:29:21 STEP 2887 H=2887:00 +CPU= 16.114
  16:29:38 STEP 2888 H=2888:00 +CPU= 17.418
  16:30:04 STEP 2889 H=2889:00 +CPU= 25.291
  16:30:23 STEP 2890 H=2890:00 +CPU= 18.473
  16:30:41 STEP 2891 H=2891:00 +CPU= 18.225
  16:31:10 STEP 2892 H=2892:00 +CPU= 28.533
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002892
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002892
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002892
  16:31:27 STEP 2893 H=2893:00 +CPU= 16.532
  16:31:45 STEP 2894 H=2894:00 +CPU= 17.906
  16:32:09 STEP 2895 H=2895:00 +CPU= 23.299
  16:32:24 STEP 2896 H=2896:00 +CPU= 15.645
  16:32:40 STEP 2897 H=2897:00 +CPU= 15.358
  16:33:06 STEP 2898 H=2898:00 +CPU= 25.975
  16:33:23 STEP 2899 H=2899:00 +CPU= 16.171
  16:33:40 STEP 2900 H=2900:00 +CPU= 17.071
  16:34:06 STEP 2901 H=2901:00 +CPU= 25.964
  16:34:26 STEP 2902 H=2902:00 +CPU= 19.021
  16:34:44 STEP 2903 H=2903:00 +CPU= 18.313
  16:35:18 STEP 2904 H=2904:00 +CPU= 32.762
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002904
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002904
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002904
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002880
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002880
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002880
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002892
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002892
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002892
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_120.zip
Uploading the intermediate file: upload_file_120.zip
  16:35:35 STEP 2905 H=2905:00 +CPU= 16.974
  16:35:52 STEP 2906 H=2906:00 +CPU= 17.070
  16:36:20 STEP 2907 H=2907:00 +CPU= 26.881
  16:36:39 STEP 2908 H=2908:00 +CPU= 18.459
  16:36:54 STEP 2909 H=2909:00 +CPU= 15.825
  16:37:22 STEP 2910 H=2910:00 +CPU= 27.253
  16:37:40 STEP 2911 H=2911:00 +CPU= 17.418
  16:37:57 STEP 2912 H=2912:00 +CPU= 17.032
  16:38:21 STEP 2913 H=2913:00 +CPU= 23.957
  16:38:38 STEP 2914 H=2914:00 +CPU= 16.695
  16:38:56 STEP 2915 H=2915:00 +CPU= 17.651
  16:39:27 STEP 2916 H=2916:00 +CPU= 30.044
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002916
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002916
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002916
  16:39:43 STEP 2917 H=2917:00 +CPU= 16.333
  16:39:59 STEP 2918 H=2918:00 +CPU= 15.702
  16:40:22 STEP 2919 H=2919:00 +CPU= 22.768
  16:40:37 STEP 2920 H=2920:00 +CPU= 15.222
  16:40:52 STEP 2921 H=2921:00 +CPU= 15.327
  16:41:18 STEP 2922 H=2922:00 +CPU= 25.127
  16:41:34 STEP 2923 H=2923:00 +CPU= 16.132
  16:41:51 STEP 2924 H=2924:00 +CPU= 17.082
  16:42:19 STEP 2925 H=2925:00 +CPU= 27.179
  16:42:35 STEP 2926 H=2926:00 +CPU= 16.254
  16:42:53 STEP 2927 H=2927:00 +CPU= 17.737
  16:43:23 STEP 2928 H=2928:00 +CPU= 29.357
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002928
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002928
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002928
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002904
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002904
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002904
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002916
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002916
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002916
Zipping up the intermediate file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_121.zip
Uploading the intermediate file: upload_file_121.zip
  16:43:39 STEP 2929 H=2929:00 +CPU= 15.266
Uploading trickle at timestep: 10540800
  16:43:53 STEP 2930 H=2930:00 +CPU= 14.792
  16:44:15 STEP 2931 H=2931:00 +CPU= 21.359
  16:44:30 STEP 2932 H=2932:00 +CPU= 14.965
  16:44:44 STEP 2933 H=2933:00 +CPU= 13.521
  16:45:08 STEP 2934 H=2934:00 +CPU= 23.613
  16:45:23 STEP 2935 H=2935:00 +CPU= 15.024
  16:45:38 STEP 2936 H=2936:00 +CPU= 15.419
  16:46:00 STEP 2937 H=2937:00 +CPU= 21.574
  16:46:16 STEP 2938 H=2938:00 +CPU= 15.369
  16:46:30 STEP 2939 H=2939:00 +CPU= 14.437
  16:46:54 STEP 2940 H=2940:00 +CPU= 23.184
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002940
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002940
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002940
  16:47:06 STEP 2941 H=2941:00 +CPU= 12.750
  16:47:20 STEP 2942 H=2942:00 +CPU= 13.234
  16:47:42 STEP 2943 H=2943:00 +CPU= 21.895
  16:47:58 STEP 2944 H=2944:00 +CPU= 16.385
  16:48:13 STEP 2945 H=2945:00 +CPU= 14.694
  16:48:36 STEP 2946 H=2946:00 +CPU= 22.223
  16:48:51 STEP 2947 H=2947:00 +CPU= 15.055
  16:49:06 STEP 2948 H=2948:00 +CPU= 14.969
  16:49:28 STEP 2949 H=2949:00 +CPU= 21.998
  16:49:42 STEP 2950 H=2950:00 +CPU= 14.149
  16:49:58 STEP 2951 H=2951:00 +CPU= 15.254
  16:50:22 STEP 2952 H=2952:00 +CPU= 23.788
The child process terminated with status: 0
Moving to projects directory: /home/jpe/slots/21/ICMGGhq0f+002952
Moving to projects directory: /home/jpe/slots/21/ICMSHhq0f+002952
Moving to projects directory: /home/jpe/slots/21/ICMUAhq0f+002952
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002928
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002940
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002928
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002940
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMUAhq0f+002952
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002952
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002952
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMGGhq0f+002940
Adding to the zip: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_12170333/ICMSHhq0f+002928
Zipping up the final file: /home/jpe/projects/climateprediction.net/oifs_43r3_ps_0689_1984050100_123_953_12170333_0_r1719770570_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
16:53:45 (4894): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:42:17 1538420 22254651 oifs_43r3_ps_0689_1984050100_123_953_12170333_0 10,623,600 62,054 0.0058
09 May 2023 16:42:17 1538420 22254651 oifs_43r3_ps_0689_1984050100_123_953_12170333_0 10,540,800 61,642 0.0058
09 May 2023 16:42:13 1538420 22254651 oifs_43r3_ps_0689_1984050100_123_953_12170333_0 9,676,800 56,908 0.0059
09 May 2023 16:42:09 1538420 22254651 oifs_43r3_ps_0689_1984050100_123_953_12170333_0 8,812,800 51,876 0.0059
09 May 2023 16:42:05 1538420 22254651 oifs_43r3_ps_0689_1984050100_123_953_12170333_0 7,948,800 45,857 0.0058
09 May 2023 16:42:00 1538420 22254651 oifs_43r3_ps_0689_1984050100_123_953_12170333_0 7,084,800 40,643 0.0057
09 May 2023 16:41:56 1538420 22254651 oifs_43r3_ps_0689_1984050100_123_953_12170333_0 6,220,800 35,824 0.0058
09 May 2023 16:41:54 1538420 22254651 oifs_43r3_ps_0689_1984050100_123_953_12170333_0 5,356,800 31,470 0.0059
09 May 2023 16:41:51 1538420 22254651 oifs_43r3_ps_0689_1984050100_123_953_12170333_0 4,492,800 27,155 0.0060
09 May 2023 16:41:42 1538420 22254651 oifs_43r3_ps_0689_1984050100_123_953_12170333_0 3,628,800 22,830 0.0063
09 May 2023 16:41:38 1538420 22254651 oifs_43r3_ps_0689_1984050100_123_953_12170333_0 2,764,800 18,504 0.0067
09 May 2023 16:41:35 1538420 22254651 oifs_43r3_ps_0689_1984050100_123_953_12170333_0 1,900,800 14,179 0.0075
09 May 2023 16:41:32 1538420 22254651 oifs_43r3_ps_0689_1984050100_123_953_12170333_0 1,036,800 9,585 0.0092


©2024 climateprediction.net