climateprediction.net home page
Task 22282338

Task 22282338

Name oifs_43r3_ps_0720_2010050100_123_979_12196364_0
Workunit 12196364
Created 24 Dec 2022, 0:25:18 UTC
Sent 24 Dec 2022, 0:35:32 UTC
Report deadline 23 Jan 2023, 0:35:32 UTC
Received 24 Dec 2022, 14:02:12 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1536643
Run time 12 hours 46 min 57 sec
CPU time 12 hours 43 min
Validate state Valid
Credit 14,873.04
Device peak FLOPS 6.95 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,798.56 MB
Peak swap size 4,974.27 MB
Peak disk usage 1,504.44 MB
Stderr 
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
67:00 +CPU= 12.709
  11:21:57 STEP 2268 H=2268:00 +CPU= 22.553
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002268
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002268
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002268
  11:22:10 STEP 2269 H=2269:00 +CPU= 12.698
  11:22:23 STEP 2270 H=2270:00 +CPU= 13.110
  11:22:43 STEP 2271 H=2271:00 +CPU= 20.364
  11:22:56 STEP 2272 H=2272:00 +CPU= 13.106
  11:23:09 STEP 2273 H=2273:00 +CPU= 12.687
  11:23:30 STEP 2274 H=2274:00 +CPU= 20.815
  11:23:43 STEP 2275 H=2275:00 +CPU= 12.677
  11:23:56 STEP 2276 H=2276:00 +CPU= 13.097
  11:24:16 STEP 2277 H=2277:00 +CPU= 20.342
  11:24:29 STEP 2278 H=2278:00 +CPU= 13.091
  11:24:42 STEP 2279 H=2279:00 +CPU= 13.020
  11:25:06 STEP 2280 H=2280:00 +CPU= 23.432
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002280
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002280
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002280
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002256
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002256
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002256
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002268
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002268
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002268
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_94.zip
Uploading the intermediate file: upload_file_94.zip
  11:25:18 STEP 2281 H=2281:00 +CPU= 12.680
  11:25:31 STEP 2282 H=2282:00 +CPU= 13.095
  11:25:52 STEP 2283 H=2283:00 +CPU= 20.381
  11:26:05 STEP 2284 H=2284:00 +CPU= 13.104
  11:26:18 STEP 2285 H=2285:00 +CPU= 12.667
  11:26:38 STEP 2286 H=2286:00 +CPU= 20.878
  11:26:51 STEP 2287 H=2287:00 +CPU= 12.689
  11:27:04 STEP 2288 H=2288:00 +CPU= 13.122
  11:27:25 STEP 2289 H=2289:00 +CPU= 20.388
  11:27:38 STEP 2290 H=2290:00 +CPU= 13.107
  11:27:50 STEP 2291 H=2291:00 +CPU= 12.726
  11:28:13 STEP 2292 H=2292:00 +CPU= 22.589
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002292
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002292
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002292
  11:28:26 STEP 2293 H=2293:00 +CPU= 12.755
  11:28:39 STEP 2294 H=2294:00 +CPU= 13.150
  11:28:59 STEP 2295 H=2295:00 +CPU= 20.382
  11:29:12 STEP 2296 H=2296:00 +CPU= 13.131
  11:29:25 STEP 2297 H=2297:00 +CPU= 12.686
  11:29:46 STEP 2298 H=2298:00 +CPU= 20.876
  11:29:59 STEP 2299 H=2299:00 +CPU= 12.704
  11:30:12 STEP 2300 H=2300:00 +CPU= 13.117
  11:30:32 STEP 2301 H=2301:00 +CPU= 20.371
  11:30:45 STEP 2302 H=2302:00 +CPU= 13.094
  11:30:58 STEP 2303 H=2303:00 +CPU= 13.042
  11:31:22 STEP 2304 H=2304:00 +CPU= 23.517
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002304
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002304
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002304
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002280
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002280
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002280
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002292
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002292
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002292
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_95.zip
Uploading the intermediate file: upload_file_95.zip
  11:31:35 STEP 2305 H=2305:00 +CPU= 12.710
  11:31:48 STEP 2306 H=2306:00 +CPU= 13.086
  11:32:08 STEP 2307 H=2307:00 +CPU= 20.315
  11:32:21 STEP 2308 H=2308:00 +CPU= 13.221
  11:32:34 STEP 2309 H=2309:00 +CPU= 12.728
  11:32:55 STEP 2310 H=2310:00 +CPU= 20.809
  11:33:08 STEP 2311 H=2311:00 +CPU= 12.672
  11:33:21 STEP 2312 H=2312:00 +CPU= 13.111
  11:33:41 STEP 2313 H=2313:00 +CPU= 20.342
  11:33:54 STEP 2314 H=2314:00 +CPU= 13.106
  11:34:07 STEP 2315 H=2315:00 +CPU= 12.720
  11:34:29 STEP 2316 H=2316:00 +CPU= 22.465
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002316
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002316
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002316
  11:34:42 STEP 2317 H=2317:00 +CPU= 12.686
  11:34:55 STEP 2318 H=2318:00 +CPU= 13.096
  11:35:15 STEP 2319 H=2319:00 +CPU= 20.306
  11:35:28 STEP 2320 H=2320:00 +CPU= 13.095
  11:35:41 STEP 2321 H=2321:00 +CPU= 12.696
  11:36:02 STEP 2322 H=2322:00 +CPU= 20.781
  11:36:15 STEP 2323 H=2323:00 +CPU= 12.681
  11:36:28 STEP 2324 H=2324:00 +CPU= 13.100
  11:36:48 STEP 2325 H=2325:00 +CPU= 20.322
  11:37:01 STEP 2326 H=2326:00 +CPU= 13.063
  11:37:14 STEP 2327 H=2327:00 +CPU= 13.042
  11:37:38 STEP 2328 H=2328:00 +CPU= 23.402
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002328
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002328
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002328
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002304
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002304
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002304
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002316
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002316
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002316
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_96.zip
Uploading the intermediate file: upload_file_96.zip
  11:37:50 STEP 2329 H=2329:00 +CPU= 12.640
  11:38:03 STEP 2330 H=2330:00 +CPU= 13.081
  11:38:24 STEP 2331 H=2331:00 +CPU= 20.285
  11:38:37 STEP 2332 H=2332:00 +CPU= 13.260
  11:38:50 STEP 2333 H=2333:00 +CPU= 12.667
  11:39:10 STEP 2334 H=2334:00 +CPU= 20.777
  11:39:23 STEP 2335 H=2335:00 +CPU= 12.688
  11:39:36 STEP 2336 H=2336:00 +CPU= 13.109
  11:39:56 STEP 2337 H=2337:00 +CPU= 20.304
  11:40:09 STEP 2338 H=2338:00 +CPU= 13.092
  11:40:22 STEP 2339 H=2339:00 +CPU= 12.704
  11:40:45 STEP 2340 H=2340:00 +CPU= 22.477
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002340
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002340
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002340
  11:40:57 STEP 2341 H=2341:00 +CPU= 12.708
  11:41:10 STEP 2342 H=2342:00 +CPU= 13.108
  11:41:31 STEP 2343 H=2343:00 +CPU= 20.331
  11:41:44 STEP 2344 H=2344:00 +CPU= 13.102
  11:41:57 STEP 2345 H=2345:00 +CPU= 12.692
  11:42:17 STEP 2346 H=2346:00 +CPU= 20.746
  11:42:30 STEP 2347 H=2347:00 +CPU= 12.693
  11:42:43 STEP 2348 H=2348:00 +CPU= 13.087
  11:43:03 STEP 2349 H=2349:00 +CPU= 20.278
  11:43:16 STEP 2350 H=2350:00 +CPU= 13.062
  11:43:30 STEP 2351 H=2351:00 +CPU= 13.032
  11:43:53 STEP 2352 H=2352:00 +CPU= 23.366
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002352
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002352
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002352
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002328
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002328
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002328
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002340
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002340
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002340
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_97.zip
Uploading the intermediate file: upload_file_97.zip
  11:44:06 STEP 2353 H=2353:00 +CPU= 12.641
  11:44:19 STEP 2354 H=2354:00 +CPU= 13.039
  11:44:39 STEP 2355 H=2355:00 +CPU= 20.447
  11:44:52 STEP 2356 H=2356:00 +CPU= 13.081
  11:45:05 STEP 2357 H=2357:00 +CPU= 12.644
  11:45:25 STEP 2358 H=2358:00 +CPU= 20.724
  11:45:38 STEP 2359 H=2359:00 +CPU= 12.676
  11:45:51 STEP 2360 H=2360:00 +CPU= 13.087
  11:46:11 STEP 2361 H=2361:00 +CPU= 20.232
  11:46:25 STEP 2362 H=2362:00 +CPU= 13.095
  11:46:37 STEP 2363 H=2363:00 +CPU= 12.659
  11:47:00 STEP 2364 H=2364:00 +CPU= 22.425
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002364
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002364
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002364
  11:47:12 STEP 2365 H=2365:00 +CPU= 12.685
  11:47:25 STEP 2366 H=2366:00 +CPU= 13.126
  11:47:46 STEP 2367 H=2367:00 +CPU= 20.267
  11:47:59 STEP 2368 H=2368:00 +CPU= 13.105
  11:48:11 STEP 2369 H=2369:00 +CPU= 12.662
  11:48:32 STEP 2370 H=2370:00 +CPU= 20.707
  11:48:45 STEP 2371 H=2371:00 +CPU= 12.640
  11:48:58 STEP 2372 H=2372:00 +CPU= 13.080
  11:49:18 STEP 2373 H=2373:00 +CPU= 20.204
  11:49:31 STEP 2374 H=2374:00 +CPU= 13.098
  11:49:44 STEP 2375 H=2375:00 +CPU= 13.018
  11:50:08 STEP 2376 H=2376:00 +CPU= 23.324
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002376
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002376
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002376
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002352
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002352
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002352
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002364
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002364
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002364
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_98.zip
Uploading the intermediate file: upload_file_98.zip
  11:50:20 STEP 2377 H=2377:00 +CPU= 12.559
  11:50:33 STEP 2378 H=2378:00 +CPU= 12.997
  11:50:54 STEP 2379 H=2379:00 +CPU= 20.377
  11:51:06 STEP 2380 H=2380:00 +CPU= 12.995
  11:51:19 STEP 2381 H=2381:00 +CPU= 12.568
  11:51:40 STEP 2382 H=2382:00 +CPU= 20.654
  11:51:52 STEP 2383 H=2383:00 +CPU= 12.591
  11:52:05 STEP 2384 H=2384:00 +CPU= 13.041
  11:52:26 STEP 2385 H=2385:00 +CPU= 20.221
  11:52:39 STEP 2386 H=2386:00 +CPU= 13.075
  11:52:51 STEP 2387 H=2387:00 +CPU= 12.666
  11:53:14 STEP 2388 H=2388:00 +CPU= 22.458
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002388
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002388
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002388
  11:53:26 STEP 2389 H=2389:00 +CPU= 12.710
  11:53:40 STEP 2390 H=2390:00 +CPU= 13.114
  11:54:00 STEP 2391 H=2391:00 +CPU= 20.274
  11:54:13 STEP 2392 H=2392:00 +CPU= 13.101
  11:54:26 STEP 2393 H=2393:00 +CPU= 12.689
  11:54:46 STEP 2394 H=2394:00 +CPU= 20.727
  11:54:59 STEP 2395 H=2395:00 +CPU= 12.676
  11:55:12 STEP 2396 H=2396:00 +CPU= 13.085
  11:55:32 STEP 2397 H=2397:00 +CPU= 20.224
  11:55:45 STEP 2398 H=2398:00 +CPU= 13.082
  11:55:58 STEP 2399 H=2399:00 +CPU= 13.018
  11:56:23 STEP 2400 H=2400:00 +CPU= 23.316
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002400
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002400
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002400
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002376
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002376
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002376
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002388
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002388
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002388
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_99.zip
Uploading the intermediate file: upload_file_99.zip
  11:56:35 STEP 2401 H=2401:00 +CPU= 12.636
  11:56:49 STEP 2402 H=2402:00 +CPU= 13.047
Uploading trickle at timestep: 8640000
  11:57:09 STEP 2403 H=2403:00 +CPU= 20.448
  11:57:22 STEP 2404 H=2404:00 +CPU= 13.050
  11:57:35 STEP 2405 H=2405:00 +CPU= 12.642
  11:57:55 STEP 2406 H=2406:00 +CPU= 20.743
  11:58:08 STEP 2407 H=2407:00 +CPU= 12.657
  11:58:21 STEP 2408 H=2408:00 +CPU= 13.071
  11:58:41 STEP 2409 H=2409:00 +CPU= 20.230
  11:58:55 STEP 2410 H=2410:00 +CPU= 13.086
  11:59:07 STEP 2411 H=2411:00 +CPU= 12.649
  11:59:30 STEP 2412 H=2412:00 +CPU= 22.451
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002412
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002412
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002412
  11:59:42 STEP 2413 H=2413:00 +CPU= 12.646
  11:59:55 STEP 2414 H=2414:00 +CPU= 13.056
  12:00:16 STEP 2415 H=2415:00 +CPU= 20.253
  12:00:29 STEP 2416 H=2416:00 +CPU= 13.038
  12:00:41 STEP 2417 H=2417:00 +CPU= 12.630
  12:01:02 STEP 2418 H=2418:00 +CPU= 20.667
  12:01:15 STEP 2419 H=2419:00 +CPU= 12.612
  12:01:28 STEP 2420 H=2420:00 +CPU= 13.018
  12:01:48 STEP 2421 H=2421:00 +CPU= 20.188
  12:02:01 STEP 2422 H=2422:00 +CPU= 13.001
  12:02:14 STEP 2423 H=2423:00 +CPU= 12.956
  12:02:37 STEP 2424 H=2424:00 +CPU= 23.268
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002424
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002424
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002424
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002400
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002400
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002400
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002412
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002412
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002412
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_100.zip
Uploading the intermediate file: upload_file_100.zip
  12:02:50 STEP 2425 H=2425:00 +CPU= 12.593
  12:03:03 STEP 2426 H=2426:00 +CPU= 12.959
  12:03:23 STEP 2427 H=2427:00 +CPU= 20.211
  12:03:36 STEP 2428 H=2428:00 +CPU= 13.031
  12:03:49 STEP 2429 H=2429:00 +CPU= 12.634
  12:04:09 STEP 2430 H=2430:00 +CPU= 20.676
  12:04:22 STEP 2431 H=2431:00 +CPU= 12.624
  12:04:35 STEP 2432 H=2432:00 +CPU= 13.033
  12:04:55 STEP 2433 H=2433:00 +CPU= 20.212
  12:05:08 STEP 2434 H=2434:00 +CPU= 13.068
  12:05:21 STEP 2435 H=2435:00 +CPU= 12.624
  12:05:43 STEP 2436 H=2436:00 +CPU= 22.385
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002436
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002436
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002436
  12:05:56 STEP 2437 H=2437:00 +CPU= 12.638
  12:06:09 STEP 2438 H=2438:00 +CPU= 13.051
  12:06:29 STEP 2439 H=2439:00 +CPU= 20.168
  12:06:42 STEP 2440 H=2440:00 +CPU= 13.032
  12:06:55 STEP 2441 H=2441:00 +CPU= 12.601
  12:07:16 STEP 2442 H=2442:00 +CPU= 20.661
  12:07:28 STEP 2443 H=2443:00 +CPU= 12.589
  12:07:41 STEP 2444 H=2444:00 +CPU= 13.023
  12:08:01 STEP 2445 H=2445:00 +CPU= 20.186
  12:08:14 STEP 2446 H=2446:00 +CPU= 12.994
  12:08:27 STEP 2447 H=2447:00 +CPU= 12.927
  12:08:51 STEP 2448 H=2448:00 +CPU= 23.195
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002448
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002448
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002448
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002424
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002424
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002424
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002436
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002436
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002436
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_101.zip
Uploading the intermediate file: upload_file_101.zip
  12:09:03 STEP 2449 H=2449:00 +CPU= 12.566
  12:09:16 STEP 2450 H=2450:00 +CPU= 12.980
  12:09:36 STEP 2451 H=2451:00 +CPU= 20.113
  12:09:49 STEP 2452 H=2452:00 +CPU= 12.988
  12:10:02 STEP 2453 H=2453:00 +CPU= 12.546
  12:10:22 STEP 2454 H=2454:00 +CPU= 20.615
  12:10:35 STEP 2455 H=2455:00 +CPU= 12.568
  12:10:48 STEP 2456 H=2456:00 +CPU= 12.983
  12:11:08 STEP 2457 H=2457:00 +CPU= 20.148
  12:11:21 STEP 2458 H=2458:00 +CPU= 13.001
  12:11:34 STEP 2459 H=2459:00 +CPU= 12.569
  12:11:56 STEP 2460 H=2460:00 +CPU= 22.293
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002460
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002460
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002460
  12:12:09 STEP 2461 H=2461:00 +CPU= 12.592
  12:12:22 STEP 2462 H=2462:00 +CPU= 12.987
  12:12:42 STEP 2463 H=2463:00 +CPU= 20.215
  12:12:55 STEP 2464 H=2464:00 +CPU= 13.027
  12:13:08 STEP 2465 H=2465:00 +CPU= 12.623
  12:13:28 STEP 2466 H=2466:00 +CPU= 20.690
  12:13:41 STEP 2467 H=2467:00 +CPU= 12.624
  12:13:54 STEP 2468 H=2468:00 +CPU= 13.017
  12:14:14 STEP 2469 H=2469:00 +CPU= 20.202
  12:14:27 STEP 2470 H=2470:00 +CPU= 13.011
  12:14:40 STEP 2471 H=2471:00 +CPU= 12.956
  12:15:03 STEP 2472 H=2472:00 +CPU= 23.335
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002472
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002472
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002472
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002448
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002448
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002448
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002460
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002460
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002460
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_102.zip
Uploading the intermediate file: upload_file_102.zip
  12:15:16 STEP 2473 H=2473:00 +CPU= 12.636
  12:15:29 STEP 2474 H=2474:00 +CPU= 13.066
  12:15:49 STEP 2475 H=2475:00 +CPU= 20.272
  12:16:03 STEP 2476 H=2476:00 +CPU= 13.087
  12:16:15 STEP 2477 H=2477:00 +CPU= 12.664
  12:16:36 STEP 2478 H=2478:00 +CPU= 20.756
  12:16:49 STEP 2479 H=2479:00 +CPU= 12.662
  12:17:02 STEP 2480 H=2480:00 +CPU= 13.090
  12:17:22 STEP 2481 H=2481:00 +CPU= 20.284
  12:17:35 STEP 2482 H=2482:00 +CPU= 13.094
  12:17:48 STEP 2483 H=2483:00 +CPU= 12.664
  12:18:10 STEP 2484 H=2484:00 +CPU= 22.458
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002484
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002484
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002484
  12:18:23 STEP 2485 H=2485:00 +CPU= 12.672
  12:18:36 STEP 2486 H=2486:00 +CPU= 13.090
  12:18:56 STEP 2487 H=2487:00 +CPU= 20.281
  12:19:09 STEP 2488 H=2488:00 +CPU= 13.091
  12:19:22 STEP 2489 H=2489:00 +CPU= 12.676
  12:19:43 STEP 2490 H=2490:00 +CPU= 20.758
  12:19:55 STEP 2491 H=2491:00 +CPU= 12.658
  12:20:09 STEP 2492 H=2492:00 +CPU= 13.078
  12:20:29 STEP 2493 H=2493:00 +CPU= 20.275
  12:20:42 STEP 2494 H=2494:00 +CPU= 13.072
  12:20:55 STEP 2495 H=2495:00 +CPU= 13.024
  12:21:18 STEP 2496 H=2496:00 +CPU= 23.345
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002496
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002496
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002496
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002472
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002472
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002472
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002484
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002484
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002484
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_103.zip
Uploading the intermediate file: upload_file_103.zip
  12:21:31 STEP 2497 H=2497:00 +CPU= 12.638
  12:21:44 STEP 2498 H=2498:00 +CPU= 13.036
  12:22:04 STEP 2499 H=2499:00 +CPU= 20.250
  12:22:17 STEP 2500 H=2500:00 +CPU= 13.078
  12:22:30 STEP 2501 H=2501:00 +CPU= 12.679
  12:22:51 STEP 2502 H=2502:00 +CPU= 20.757
  12:23:04 STEP 2503 H=2503:00 +CPU= 12.710
  12:23:17 STEP 2504 H=2504:00 +CPU= 13.100
  12:23:37 STEP 2505 H=2505:00 +CPU= 20.314
  12:23:50 STEP 2506 H=2506:00 +CPU= 13.105
  12:24:03 STEP 2507 H=2507:00 +CPU= 12.674
  12:24:25 STEP 2508 H=2508:00 +CPU= 22.456
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002508
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002508
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002508
  12:24:38 STEP 2509 H=2509:00 +CPU= 12.666
  12:24:51 STEP 2510 H=2510:00 +CPU= 13.102
  12:25:11 STEP 2511 H=2511:00 +CPU= 20.283
  12:25:24 STEP 2512 H=2512:00 +CPU= 13.096
  12:25:37 STEP 2513 H=2513:00 +CPU= 12.673
  12:25:58 STEP 2514 H=2514:00 +CPU= 20.766
  12:26:11 STEP 2515 H=2515:00 +CPU= 12.667
  12:26:24 STEP 2516 H=2516:00 +CPU= 13.116
  12:26:44 STEP 2517 H=2517:00 +CPU= 20.273
  12:26:57 STEP 2518 H=2518:00 +CPU= 13.074
  12:27:10 STEP 2519 H=2519:00 +CPU= 13.019
  12:27:34 STEP 2520 H=2520:00 +CPU= 23.381
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002520
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002520
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002520
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002496
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002496
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002496
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002508
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002508
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002508
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_104.zip
Uploading the intermediate file: upload_file_104.zip
  12:27:46 STEP 2521 H=2521:00 +CPU= 12.635
  12:27:59 STEP 2522 H=2522:00 +CPU= 13.017
  12:28:20 STEP 2523 H=2523:00 +CPU= 20.227
  12:28:33 STEP 2524 H=2524:00 +CPU= 13.050
  12:28:45 STEP 2525 H=2525:00 +CPU= 12.613
  12:29:06 STEP 2526 H=2526:00 +CPU= 20.749
  12:29:19 STEP 2527 H=2527:00 +CPU= 12.662
  12:29:32 STEP 2528 H=2528:00 +CPU= 13.072
  12:29:52 STEP 2529 H=2529:00 +CPU= 20.274
  12:30:05 STEP 2530 H=2530:00 +CPU= 13.066
  12:30:18 STEP 2531 H=2531:00 +CPU= 12.701
  12:30:40 STEP 2532 H=2532:00 +CPU= 22.432
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002532
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002532
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002532
  12:30:53 STEP 2533 H=2533:00 +CPU= 12.668
  12:31:06 STEP 2534 H=2534:00 +CPU= 13.054
  12:31:26 STEP 2535 H=2535:00 +CPU= 20.241
  12:31:39 STEP 2536 H=2536:00 +CPU= 13.085
  12:31:52 STEP 2537 H=2537:00 +CPU= 12.688
  12:32:13 STEP 2538 H=2538:00 +CPU= 20.784
  12:32:26 STEP 2539 H=2539:00 +CPU= 12.662
  12:32:39 STEP 2540 H=2540:00 +CPU= 13.055
  12:32:59 STEP 2541 H=2541:00 +CPU= 20.286
  12:33:12 STEP 2542 H=2542:00 +CPU= 13.067
  12:33:25 STEP 2543 H=2543:00 +CPU= 13.029
  12:33:48 STEP 2544 H=2544:00 +CPU= 23.330
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002544
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002544
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002544
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002520
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002520
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002520
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002532
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002532
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002532
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_105.zip
Uploading the intermediate file: upload_file_105.zip
  12:34:01 STEP 2545 H=2545:00 +CPU= 12.672
  12:34:14 STEP 2546 H=2546:00 +CPU= 13.062
  12:34:35 STEP 2547 H=2547:00 +CPU= 20.316
  12:34:48 STEP 2548 H=2548:00 +CPU= 13.059
  12:35:00 STEP 2549 H=2549:00 +CPU= 12.677
  12:35:21 STEP 2550 H=2550:00 +CPU= 20.774
  12:35:34 STEP 2551 H=2551:00 +CPU= 12.681
  12:35:47 STEP 2552 H=2552:00 +CPU= 13.098
  12:36:07 STEP 2553 H=2553:00 +CPU= 20.302
  12:36:20 STEP 2554 H=2554:00 +CPU= 13.104
  12:36:33 STEP 2555 H=2555:00 +CPU= 12.669
  12:36:55 STEP 2556 H=2556:00 +CPU= 22.368
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002556
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002556
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002556
  12:37:08 STEP 2557 H=2557:00 +CPU= 12.723
  12:37:21 STEP 2558 H=2558:00 +CPU= 13.097
  12:37:42 STEP 2559 H=2559:00 +CPU= 20.286
  12:37:55 STEP 2560 H=2560:00 +CPU= 13.121
  12:38:07 STEP 2561 H=2561:00 +CPU= 12.670
  12:38:28 STEP 2562 H=2562:00 +CPU= 20.747
  12:38:41 STEP 2563 H=2563:00 +CPU= 12.659
  12:38:54 STEP 2564 H=2564:00 +CPU= 13.090
  12:39:14 STEP 2565 H=2565:00 +CPU= 20.273
  12:39:27 STEP 2566 H=2566:00 +CPU= 13.075
  12:39:40 STEP 2567 H=2567:00 +CPU= 13.040
  12:40:04 STEP 2568 H=2568:00 +CPU= 23.276
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002568
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002568
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002568
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002544
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002544
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002544
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002556
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002556
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002556
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_106.zip
Uploading the intermediate file: upload_file_106.zip
  12:40:17 STEP 2569 H=2569:00 +CPU= 12.627
  12:40:30 STEP 2570 H=2570:00 +CPU= 13.034
  12:40:50 STEP 2571 H=2571:00 +CPU= 20.263
  12:41:03 STEP 2572 H=2572:00 +CPU= 13.065
  12:41:16 STEP 2573 H=2573:00 +CPU= 12.678
  12:41:37 STEP 2574 H=2574:00 +CPU= 20.698
  12:41:49 STEP 2575 H=2575:00 +CPU= 12.641
  12:42:02 STEP 2576 H=2576:00 +CPU= 13.067
  12:42:23 STEP 2577 H=2577:00 +CPU= 20.251
  12:42:36 STEP 2578 H=2578:00 +CPU= 13.082
  12:42:48 STEP 2579 H=2579:00 +CPU= 12.677
  12:43:11 STEP 2580 H=2580:00 +CPU= 22.444
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002580
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002580
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002580
  12:43:23 STEP 2581 H=2581:00 +CPU= 12.678
  12:43:37 STEP 2582 H=2582:00 +CPU= 13.109
  12:43:57 STEP 2583 H=2583:00 +CPU= 20.291
  12:44:10 STEP 2584 H=2584:00 +CPU= 13.096
  12:44:23 STEP 2585 H=2585:00 +CPU= 12.689
  12:44:43 STEP 2586 H=2586:00 +CPU= 20.787
  12:44:56 STEP 2587 H=2587:00 +CPU= 12.664
  12:45:09 STEP 2588 H=2588:00 +CPU= 13.093
  12:45:30 STEP 2589 H=2589:00 +CPU= 20.309
  12:45:43 STEP 2590 H=2590:00 +CPU= 13.071
  12:45:56 STEP 2591 H=2591:00 +CPU= 13.039
  12:46:21 STEP 2592 H=2592:00 +CPU= 23.362
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002592
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002592
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002592
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002568
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002568
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002568
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002580
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002580
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002580
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_107.zip
Uploading the intermediate file: upload_file_107.zip
  12:46:33 STEP 2593 H=2593:00 +CPU= 12.647
  12:46:46 STEP 2594 H=2594:00 +CPU= 13.063
  12:47:07 STEP 2595 H=2595:00 +CPU= 20.296
  12:47:20 STEP 2596 H=2596:00 +CPU= 13.045
  12:47:32 STEP 2597 H=2597:00 +CPU= 12.643
  12:47:53 STEP 2598 H=2598:00 +CPU= 20.777
  12:48:06 STEP 2599 H=2599:00 +CPU= 12.679
  12:48:19 STEP 2600 H=2600:00 +CPU= 13.087
  12:48:39 STEP 2601 H=2601:00 +CPU= 20.274
  12:48:52 STEP 2602 H=2602:00 +CPU= 13.070
  12:49:05 STEP 2603 H=2603:00 +CPU= 12.670
  12:49:27 STEP 2604 H=2604:00 +CPU= 22.384
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002604
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002604
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002604
  12:49:40 STEP 2605 H=2605:00 +CPU= 12.689
  12:49:53 STEP 2606 H=2606:00 +CPU= 13.090
  12:50:13 STEP 2607 H=2607:00 +CPU= 20.275
  12:50:26 STEP 2608 H=2608:00 +CPU= 13.065
  12:50:39 STEP 2609 H=2609:00 +CPU= 12.673
  12:51:00 STEP 2610 H=2610:00 +CPU= 20.740
  12:51:12 STEP 2611 H=2611:00 +CPU= 12.674
  12:51:26 STEP 2612 H=2612:00 +CPU= 13.063
  12:51:46 STEP 2613 H=2613:00 +CPU= 20.272
  12:51:59 STEP 2614 H=2614:00 +CPU= 13.053
  12:52:12 STEP 2615 H=2615:00 +CPU= 13.025
  12:52:35 STEP 2616 H=2616:00 +CPU= 23.369
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002616
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002616
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002616
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002592
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002592
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002592
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002604
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002604
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002604
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_108.zip
Uploading the intermediate file: upload_file_108.zip
  12:52:48 STEP 2617 H=2617:00 +CPU= 12.674
  12:53:01 STEP 2618 H=2618:00 +CPU= 13.067
  12:53:21 STEP 2619 H=2619:00 +CPU= 20.329
  12:53:35 STEP 2620 H=2620:00 +CPU= 13.099
  12:53:47 STEP 2621 H=2621:00 +CPU= 12.651
  12:54:08 STEP 2622 H=2622:00 +CPU= 20.656
  12:54:20 STEP 2623 H=2623:00 +CPU= 12.624
  12:54:34 STEP 2624 H=2624:00 +CPU= 13.045
  12:54:54 STEP 2625 H=2625:00 +CPU= 20.210
  12:55:07 STEP 2626 H=2626:00 +CPU= 13.078
  12:55:20 STEP 2627 H=2627:00 +CPU= 12.650
  12:55:42 STEP 2628 H=2628:00 +CPU= 22.377
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002628
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002628
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002628
  12:55:55 STEP 2629 H=2629:00 +CPU= 12.665
  12:56:08 STEP 2630 H=2630:00 +CPU= 13.107
  12:56:28 STEP 2631 H=2631:00 +CPU= 20.240
  12:56:41 STEP 2632 H=2632:00 +CPU= 13.061
  12:56:54 STEP 2633 H=2633:00 +CPU= 12.650
  12:57:14 STEP 2634 H=2634:00 +CPU= 20.693
  12:57:27 STEP 2635 H=2635:00 +CPU= 12.660
  12:57:40 STEP 2636 H=2636:00 +CPU= 13.061
  12:58:00 STEP 2637 H=2637:00 +CPU= 20.242
  12:58:14 STEP 2638 H=2638:00 +CPU= 13.092
  12:58:27 STEP 2639 H=2639:00 +CPU= 13.009
  12:58:50 STEP 2640 H=2640:00 +CPU= 23.298
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002640
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002640
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002640
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002616
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002616
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002616
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002628
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002628
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002628
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_109.zip
Uploading the intermediate file: upload_file_109.zip
  12:59:03 STEP 2641 H=2641:00 +CPU= 12.703
  12:59:16 STEP 2642 H=2642:00 +CPU= 13.123
Uploading trickle at timestep: 9504000
  12:59:36 STEP 2643 H=2643:00 +CPU= 20.281
  12:59:49 STEP 2644 H=2644:00 +CPU= 13.121
  13:00:02 STEP 2645 H=2645:00 +CPU= 12.690
  13:00:23 STEP 2646 H=2646:00 +CPU= 20.799
  13:00:35 STEP 2647 H=2647:00 +CPU= 12.723
  13:00:49 STEP 2648 H=2648:00 +CPU= 13.130
  13:01:09 STEP 2649 H=2649:00 +CPU= 20.326
  13:01:22 STEP 2650 H=2650:00 +CPU= 13.117
  13:01:35 STEP 2651 H=2651:00 +CPU= 12.715
  13:01:57 STEP 2652 H=2652:00 +CPU= 22.386
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002652
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002652
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002652
  13:02:10 STEP 2653 H=2653:00 +CPU= 12.652
  13:02:23 STEP 2654 H=2654:00 +CPU= 13.062
  13:02:43 STEP 2655 H=2655:00 +CPU= 20.178
  13:02:56 STEP 2656 H=2656:00 +CPU= 13.038
  13:03:09 STEP 2657 H=2657:00 +CPU= 12.631
  13:03:30 STEP 2658 H=2658:00 +CPU= 20.705
  13:03:42 STEP 2659 H=2659:00 +CPU= 12.634
  13:03:55 STEP 2660 H=2660:00 +CPU= 13.045
  13:04:15 STEP 2661 H=2661:00 +CPU= 20.216
  13:04:29 STEP 2662 H=2662:00 +CPU= 13.022
  13:04:42 STEP 2663 H=2663:00 +CPU= 12.998
  13:05:05 STEP 2664 H=2664:00 +CPU= 23.307
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002664
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002664
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002664
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002640
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002640
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002640
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002652
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002652
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002652
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_110.zip
Uploading the intermediate file: upload_file_110.zip
  13:05:18 STEP 2665 H=2665:00 +CPU= 12.645
  13:05:31 STEP 2666 H=2666:00 +CPU= 13.038
  13:05:51 STEP 2667 H=2667:00 +CPU= 20.211
  13:06:04 STEP 2668 H=2668:00 +CPU= 13.069
  13:06:17 STEP 2669 H=2669:00 +CPU= 12.646
  13:06:37 STEP 2670 H=2670:00 +CPU= 20.714
  13:06:50 STEP 2671 H=2671:00 +CPU= 12.650
  13:07:03 STEP 2672 H=2672:00 +CPU= 13.065
  13:07:23 STEP 2673 H=2673:00 +CPU= 20.257
  13:07:36 STEP 2674 H=2674:00 +CPU= 13.080
  13:07:49 STEP 2675 H=2675:00 +CPU= 12.699
  13:08:12 STEP 2676 H=2676:00 +CPU= 22.403
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002676
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002676
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002676
  13:08:24 STEP 2677 H=2677:00 +CPU= 12.759
  13:08:37 STEP 2678 H=2678:00 +CPU= 13.132
  13:08:58 STEP 2679 H=2679:00 +CPU= 20.320
  13:09:11 STEP 2680 H=2680:00 +CPU= 13.137
  13:09:24 STEP 2681 H=2681:00 +CPU= 12.700
  13:09:44 STEP 2682 H=2682:00 +CPU= 20.783
  13:09:57 STEP 2683 H=2683:00 +CPU= 12.698
  13:10:10 STEP 2684 H=2684:00 +CPU= 13.153
  13:10:31 STEP 2685 H=2685:00 +CPU= 20.336
  13:10:44 STEP 2686 H=2686:00 +CPU= 13.140
  13:10:57 STEP 2687 H=2687:00 +CPU= 13.082
  13:11:20 STEP 2688 H=2688:00 +CPU= 23.281
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002688
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002688
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002688
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002664
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002664
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002664
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002676
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002676
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002676
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_111.zip
Uploading the intermediate file: upload_file_111.zip
  13:11:33 STEP 2689 H=2689:00 +CPU= 12.609
  13:11:46 STEP 2690 H=2690:00 +CPU= 12.991
  13:12:06 STEP 2691 H=2691:00 +CPU= 20.225
  13:12:19 STEP 2692 H=2692:00 +CPU= 13.037
  13:12:32 STEP 2693 H=2693:00 +CPU= 12.587
  13:12:52 STEP 2694 H=2694:00 +CPU= 20.660
  13:13:05 STEP 2695 H=2695:00 +CPU= 12.652
  13:13:18 STEP 2696 H=2696:00 +CPU= 13.042
  13:13:38 STEP 2697 H=2697:00 +CPU= 20.219
  13:13:51 STEP 2698 H=2698:00 +CPU= 13.009
  13:14:04 STEP 2699 H=2699:00 +CPU= 12.626
  13:14:27 STEP 2700 H=2700:00 +CPU= 22.414
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002700
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002700
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002700
  13:14:39 STEP 2701 H=2701:00 +CPU= 12.633
  13:14:52 STEP 2702 H=2702:00 +CPU= 13.073
  13:15:13 STEP 2703 H=2703:00 +CPU= 20.254
  13:15:26 STEP 2704 H=2704:00 +CPU= 13.059
  13:15:38 STEP 2705 H=2705:00 +CPU= 12.638
  13:15:59 STEP 2706 H=2706:00 +CPU= 20.674
  13:16:12 STEP 2707 H=2707:00 +CPU= 12.628
  13:16:25 STEP 2708 H=2708:00 +CPU= 13.027
  13:16:45 STEP 2709 H=2709:00 +CPU= 20.212
  13:16:58 STEP 2710 H=2710:00 +CPU= 13.004
  13:17:11 STEP 2711 H=2711:00 +CPU= 13.002
  13:17:34 STEP 2712 H=2712:00 +CPU= 23.400
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002712
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002712
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002712
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002688
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002688
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002688
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002700
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002700
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002700
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_112.zip
Uploading the intermediate file: upload_file_112.zip
  13:17:47 STEP 2713 H=2713:00 +CPU= 12.596
  13:18:00 STEP 2714 H=2714:00 +CPU= 13.051
  13:18:20 STEP 2715 H=2715:00 +CPU= 20.203
  13:18:33 STEP 2716 H=2716:00 +CPU= 13.008
  13:18:46 STEP 2717 H=2717:00 +CPU= 12.648
  13:19:07 STEP 2718 H=2718:00 +CPU= 20.754
  13:19:19 STEP 2719 H=2719:00 +CPU= 12.632
  13:19:32 STEP 2720 H=2720:00 +CPU= 13.098
  13:19:53 STEP 2721 H=2721:00 +CPU= 20.277
  13:20:06 STEP 2722 H=2722:00 +CPU= 13.070
  13:20:18 STEP 2723 H=2723:00 +CPU= 12.636
  13:20:41 STEP 2724 H=2724:00 +CPU= 22.406
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002724
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002724
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002724
  13:20:53 STEP 2725 H=2725:00 +CPU= 12.611
  13:21:07 STEP 2726 H=2726:00 +CPU= 13.007
  13:21:27 STEP 2727 H=2727:00 +CPU= 20.217
  13:21:40 STEP 2728 H=2728:00 +CPU= 13.023
  13:21:52 STEP 2729 H=2729:00 +CPU= 12.572
  13:22:13 STEP 2730 H=2730:00 +CPU= 20.694
  13:22:26 STEP 2731 H=2731:00 +CPU= 12.589
  13:22:39 STEP 2732 H=2732:00 +CPU= 13.002
  13:22:59 STEP 2733 H=2733:00 +CPU= 20.145
  13:23:12 STEP 2734 H=2734:00 +CPU= 12.991
  13:23:25 STEP 2735 H=2735:00 +CPU= 12.948
  13:23:48 STEP 2736 H=2736:00 +CPU= 23.354
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002736
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002736
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002736
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002712
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002712
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002712
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002724
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002724
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002724
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_113.zip
Uploading the intermediate file: upload_file_113.zip
  13:24:01 STEP 2737 H=2737:00 +CPU= 12.570
  13:24:14 STEP 2738 H=2738:00 +CPU= 12.958
  13:24:34 STEP 2739 H=2739:00 +CPU= 20.236
  13:24:47 STEP 2740 H=2740:00 +CPU= 13.100
  13:25:00 STEP 2741 H=2741:00 +CPU= 12.586
  13:25:20 STEP 2742 H=2742:00 +CPU= 20.621
  13:25:33 STEP 2743 H=2743:00 +CPU= 12.597
  13:25:46 STEP 2744 H=2744:00 +CPU= 13.017
  13:26:06 STEP 2745 H=2745:00 +CPU= 20.126
  13:26:19 STEP 2746 H=2746:00 +CPU= 12.998
  13:26:32 STEP 2747 H=2747:00 +CPU= 12.632
  13:26:54 STEP 2748 H=2748:00 +CPU= 22.360
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002748
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002748
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002748
  13:27:07 STEP 2749 H=2749:00 +CPU= 12.734
  13:27:20 STEP 2750 H=2750:00 +CPU= 13.138
  13:27:40 STEP 2751 H=2751:00 +CPU= 20.277
  13:27:53 STEP 2752 H=2752:00 +CPU= 13.119
  13:28:06 STEP 2753 H=2753:00 +CPU= 12.696
  13:28:27 STEP 2754 H=2754:00 +CPU= 20.748
  13:28:39 STEP 2755 H=2755:00 +CPU= 12.683
  13:28:53 STEP 2756 H=2756:00 +CPU= 13.108
  13:29:13 STEP 2757 H=2757:00 +CPU= 20.303
  13:29:26 STEP 2758 H=2758:00 +CPU= 13.099
  13:29:39 STEP 2759 H=2759:00 +CPU= 13.043
  13:30:03 STEP 2760 H=2760:00 +CPU= 23.327
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002760
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002760
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002760
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002736
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002736
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002736
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002748
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002748
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002748
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_114.zip
Uploading the intermediate file: upload_file_114.zip
  13:30:15 STEP 2761 H=2761:00 +CPU= 12.578
  13:30:28 STEP 2762 H=2762:00 +CPU= 13.008
  13:30:49 STEP 2763 H=2763:00 +CPU= 20.377
  13:31:02 STEP 2764 H=2764:00 +CPU= 13.005
  13:31:14 STEP 2765 H=2765:00 +CPU= 12.592
  13:31:35 STEP 2766 H=2766:00 +CPU= 20.676
  13:31:47 STEP 2767 H=2767:00 +CPU= 12.631
  13:32:01 STEP 2768 H=2768:00 +CPU= 13.074
  13:32:21 STEP 2769 H=2769:00 +CPU= 20.178
  13:32:34 STEP 2770 H=2770:00 +CPU= 13.043
  13:32:46 STEP 2771 H=2771:00 +CPU= 12.609
  13:33:09 STEP 2772 H=2772:00 +CPU= 22.406
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002772
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002772
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002772
  13:33:22 STEP 2773 H=2773:00 +CPU= 12.692
  13:33:35 STEP 2774 H=2774:00 +CPU= 13.102
  13:33:55 STEP 2775 H=2775:00 +CPU= 20.285
  13:34:08 STEP 2776 H=2776:00 +CPU= 13.070
  13:34:21 STEP 2777 H=2777:00 +CPU= 12.676
  13:34:41 STEP 2778 H=2778:00 +CPU= 20.740
  13:34:54 STEP 2779 H=2779:00 +CPU= 12.663
  13:35:07 STEP 2780 H=2780:00 +CPU= 13.112
  13:35:28 STEP 2781 H=2781:00 +CPU= 20.234
  13:35:41 STEP 2782 H=2782:00 +CPU= 13.078
  13:35:54 STEP 2783 H=2783:00 +CPU= 13.023
  13:36:17 STEP 2784 H=2784:00 +CPU= 23.320
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002784
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002784
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002784
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002760
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002760
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002760
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002772
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002772
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002772
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_115.zip
Uploading the intermediate file: upload_file_115.zip
  13:36:30 STEP 2785 H=2785:00 +CPU= 12.671
  13:36:43 STEP 2786 H=2786:00 +CPU= 13.075
  13:37:03 STEP 2787 H=2787:00 +CPU= 20.278
  13:37:16 STEP 2788 H=2788:00 +CPU= 13.084
  13:37:29 STEP 2789 H=2789:00 +CPU= 12.647
  13:37:49 STEP 2790 H=2790:00 +CPU= 20.699
  13:38:02 STEP 2791 H=2791:00 +CPU= 12.685
  13:38:15 STEP 2792 H=2792:00 +CPU= 13.126
  13:38:36 STEP 2793 H=2793:00 +CPU= 20.286
  13:38:49 STEP 2794 H=2794:00 +CPU= 13.107
  13:39:01 STEP 2795 H=2795:00 +CPU= 12.694
  13:39:24 STEP 2796 H=2796:00 +CPU= 22.423
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002796
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002796
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002796
  13:39:36 STEP 2797 H=2797:00 +CPU= 12.600
  13:39:49 STEP 2798 H=2798:00 +CPU= 12.966
  13:40:10 STEP 2799 H=2799:00 +CPU= 20.093
  13:40:23 STEP 2800 H=2800:00 +CPU= 12.958
  13:40:35 STEP 2801 H=2801:00 +CPU= 12.536
  13:40:56 STEP 2802 H=2802:00 +CPU= 20.612
  13:41:08 STEP 2803 H=2803:00 +CPU= 12.537
  13:41:21 STEP 2804 H=2804:00 +CPU= 12.988
  13:41:41 STEP 2805 H=2805:00 +CPU= 20.121
  13:41:54 STEP 2806 H=2806:00 +CPU= 12.959
  13:42:07 STEP 2807 H=2807:00 +CPU= 12.923
  13:42:31 STEP 2808 H=2808:00 +CPU= 23.306
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002808
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002808
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002808
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002784
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002784
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002784
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002796
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002796
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002796
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_116.zip
Uploading the intermediate file: upload_file_116.zip
  13:42:43 STEP 2809 H=2809:00 +CPU= 12.579
  13:42:56 STEP 2810 H=2810:00 +CPU= 12.978
  13:43:16 STEP 2811 H=2811:00 +CPU= 20.046
  13:43:29 STEP 2812 H=2812:00 +CPU= 12.974
  13:43:42 STEP 2813 H=2813:00 +CPU= 12.557
  13:44:02 STEP 2814 H=2814:00 +CPU= 20.540
  13:44:15 STEP 2815 H=2815:00 +CPU= 12.549
  13:44:28 STEP 2816 H=2816:00 +CPU= 12.936
  13:44:48 STEP 2817 H=2817:00 +CPU= 20.152
  13:45:01 STEP 2818 H=2818:00 +CPU= 13.000
  13:45:13 STEP 2819 H=2819:00 +CPU= 12.553
  13:45:36 STEP 2820 H=2820:00 +CPU= 22.379
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002820
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002820
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002820
  13:45:49 STEP 2821 H=2821:00 +CPU= 12.682
  13:46:02 STEP 2822 H=2822:00 +CPU= 13.097
  13:46:22 STEP 2823 H=2823:00 +CPU= 20.199
  13:46:35 STEP 2824 H=2824:00 +CPU= 13.066
  13:46:48 STEP 2825 H=2825:00 +CPU= 12.661
  13:47:08 STEP 2826 H=2826:00 +CPU= 20.691
  13:47:21 STEP 2827 H=2827:00 +CPU= 12.622
  13:47:34 STEP 2828 H=2828:00 +CPU= 13.077
  13:47:54 STEP 2829 H=2829:00 +CPU= 20.182
  13:48:07 STEP 2830 H=2830:00 +CPU= 13.070
  13:48:20 STEP 2831 H=2831:00 +CPU= 12.996
  13:48:44 STEP 2832 H=2832:00 +CPU= 23.232
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002832
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002832
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002832
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002808
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002808
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002808
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002820
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002820
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002820
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_117.zip
Uploading the intermediate file: upload_file_117.zip
  13:48:57 STEP 2833 H=2833:00 +CPU= 12.498
  13:49:10 STEP 2834 H=2834:00 +CPU= 12.950
  13:49:30 STEP 2835 H=2835:00 +CPU= 20.037
  13:49:43 STEP 2836 H=2836:00 +CPU= 12.937
  13:49:55 STEP 2837 H=2837:00 +CPU= 12.520
  13:50:16 STEP 2838 H=2838:00 +CPU= 20.479
  13:50:28 STEP 2839 H=2839:00 +CPU= 12.508
  13:50:41 STEP 2840 H=2840:00 +CPU= 12.906
  13:51:01 STEP 2841 H=2841:00 +CPU= 20.053
  13:51:14 STEP 2842 H=2842:00 +CPU= 12.922
  13:51:27 STEP 2843 H=2843:00 +CPU= 12.525
  13:51:49 STEP 2844 H=2844:00 +CPU= 22.146
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002844
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002844
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002844
  13:52:01 STEP 2845 H=2845:00 +CPU= 12.486
  13:52:14 STEP 2846 H=2846:00 +CPU= 12.919
  13:52:34 STEP 2847 H=2847:00 +CPU= 20.043
  13:52:47 STEP 2848 H=2848:00 +CPU= 12.904
  13:53:00 STEP 2849 H=2849:00 +CPU= 12.516
  13:53:20 STEP 2850 H=2850:00 +CPU= 20.488
  13:53:33 STEP 2851 H=2851:00 +CPU= 12.495
  13:53:46 STEP 2852 H=2852:00 +CPU= 12.940
  13:54:06 STEP 2853 H=2853:00 +CPU= 19.970
  13:54:19 STEP 2854 H=2854:00 +CPU= 12.937
  13:54:31 STEP 2855 H=2855:00 +CPU= 12.854
  13:54:55 STEP 2856 H=2856:00 +CPU= 23.047
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002856
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002856
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002856
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002832
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002832
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002832
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002844
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002844
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002844
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_118.zip
Uploading the intermediate file: upload_file_118.zip
  13:55:07 STEP 2857 H=2857:00 +CPU= 12.572
  13:55:20 STEP 2858 H=2858:00 +CPU= 12.906
  13:55:40 STEP 2859 H=2859:00 +CPU= 20.051
  13:55:53 STEP 2860 H=2860:00 +CPU= 12.936
  13:56:06 STEP 2861 H=2861:00 +CPU= 12.541
  13:56:26 STEP 2862 H=2862:00 +CPU= 20.556
  13:56:39 STEP 2863 H=2863:00 +CPU= 12.560
  13:56:52 STEP 2864 H=2864:00 +CPU= 12.913
  13:57:12 STEP 2865 H=2865:00 +CPU= 20.017
  13:57:25 STEP 2866 H=2866:00 +CPU= 12.966
  13:57:37 STEP 2867 H=2867:00 +CPU= 12.528
  13:57:59 STEP 2868 H=2868:00 +CPU= 22.161
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002868
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002868
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002868
  13:58:12 STEP 2869 H=2869:00 +CPU= 12.521
  13:58:25 STEP 2870 H=2870:00 +CPU= 12.922
  13:58:45 STEP 2871 H=2871:00 +CPU= 19.993
  13:58:58 STEP 2872 H=2872:00 +CPU= 12.921
  13:59:10 STEP 2873 H=2873:00 +CPU= 12.521
  13:59:31 STEP 2874 H=2874:00 +CPU= 20.455
  13:59:43 STEP 2875 H=2875:00 +CPU= 12.498
  13:59:56 STEP 2876 H=2876:00 +CPU= 12.902
  14:00:16 STEP 2877 H=2877:00 +CPU= 19.978
  14:00:29 STEP 2878 H=2878:00 +CPU= 12.897
  14:00:42 STEP 2879 H=2879:00 +CPU= 12.852
  14:01:05 STEP 2880 H=2880:00 +CPU= 23.012
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002880
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002880
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002880
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002856
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002856
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002856
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002868
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002868
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002868
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_119.zip
Uploading the intermediate file: upload_file_119.zip
  14:01:17 STEP 2881 H=2881:00 +CPU= 12.538
Uploading trickle at timestep: 10368000
  14:01:30 STEP 2882 H=2882:00 +CPU= 12.894
  14:01:50 STEP 2883 H=2883:00 +CPU= 20.026
  14:02:03 STEP 2884 H=2884:00 +CPU= 12.908
  14:02:16 STEP 2885 H=2885:00 +CPU= 12.497
  14:02:36 STEP 2886 H=2886:00 +CPU= 20.464
  14:02:49 STEP 2887 H=2887:00 +CPU= 12.506
  14:03:02 STEP 2888 H=2888:00 +CPU= 12.938
  14:03:22 STEP 2889 H=2889:00 +CPU= 20.006
  14:03:35 STEP 2890 H=2890:00 +CPU= 12.959
  14:03:47 STEP 2891 H=2891:00 +CPU= 12.556
  14:04:09 STEP 2892 H=2892:00 +CPU= 22.144
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002892
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002892
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002892
  14:04:22 STEP 2893 H=2893:00 +CPU= 12.539
  14:04:35 STEP 2894 H=2894:00 +CPU= 12.971
  14:04:55 STEP 2895 H=2895:00 +CPU= 19.975
  14:05:08 STEP 2896 H=2896:00 +CPU= 12.949
  14:05:20 STEP 2897 H=2897:00 +CPU= 12.479
  14:05:41 STEP 2898 H=2898:00 +CPU= 20.425
  14:05:53 STEP 2899 H=2899:00 +CPU= 12.512
  14:06:06 STEP 2900 H=2900:00 +CPU= 12.903
  14:06:26 STEP 2901 H=2901:00 +CPU= 19.980
  14:06:39 STEP 2902 H=2902:00 +CPU= 12.943
  14:06:52 STEP 2903 H=2903:00 +CPU= 12.878
  14:07:15 STEP 2904 H=2904:00 +CPU= 23.018
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002904
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002904
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002904
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002880
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002880
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002880
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002892
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002892
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002892
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_120.zip
Uploading the intermediate file: upload_file_120.zip
  14:07:27 STEP 2905 H=2905:00 +CPU= 12.543
  14:07:40 STEP 2906 H=2906:00 +CPU= 12.877
  14:08:00 STEP 2907 H=2907:00 +CPU= 20.004
  14:08:13 STEP 2908 H=2908:00 +CPU= 12.899
  14:08:26 STEP 2909 H=2909:00 +CPU= 12.485
  14:08:46 STEP 2910 H=2910:00 +CPU= 20.484
  14:08:59 STEP 2911 H=2911:00 +CPU= 12.519
  14:09:12 STEP 2912 H=2912:00 +CPU= 12.927
  14:09:32 STEP 2913 H=2913:00 +CPU= 20.008
  14:09:45 STEP 2914 H=2914:00 +CPU= 12.922
  14:09:57 STEP 2915 H=2915:00 +CPU= 12.528
  14:10:19 STEP 2916 H=2916:00 +CPU= 22.160
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002916
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002916
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002916
  14:10:32 STEP 2917 H=2917:00 +CPU= 12.564
  14:10:45 STEP 2918 H=2918:00 +CPU= 12.925
  14:11:05 STEP 2919 H=2919:00 +CPU= 20.026
  14:11:18 STEP 2920 H=2920:00 +CPU= 12.924
  14:11:30 STEP 2921 H=2921:00 +CPU= 12.498
  14:11:51 STEP 2922 H=2922:00 +CPU= 20.464
  14:12:03 STEP 2923 H=2923:00 +CPU= 12.498
  14:12:16 STEP 2924 H=2924:00 +CPU= 12.908
  14:12:36 STEP 2925 H=2925:00 +CPU= 20.022
  14:12:49 STEP 2926 H=2926:00 +CPU= 12.919
  14:13:02 STEP 2927 H=2927:00 +CPU= 12.831
  14:13:25 STEP 2928 H=2928:00 +CPU= 23.060
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002928
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002928
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002928
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002904
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002904
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002904
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002916
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002916
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002916
Zipping up the intermediate file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_121.zip
Uploading the intermediate file: upload_file_121.zip
  14:13:37 STEP 2929 H=2929:00 +CPU= 12.521
  14:13:50 STEP 2930 H=2930:00 +CPU= 12.934
  14:14:11 STEP 2931 H=2931:00 +CPU= 20.090
  14:14:23 STEP 2932 H=2932:00 +CPU= 12.914
  14:14:36 STEP 2933 H=2933:00 +CPU= 12.517
  14:14:57 STEP 2934 H=2934:00 +CPU= 20.532
  14:15:09 STEP 2935 H=2935:00 +CPU= 12.528
  14:15:22 STEP 2936 H=2936:00 +CPU= 12.944
  14:15:42 STEP 2937 H=2937:00 +CPU= 20.066
  14:15:55 STEP 2938 H=2938:00 +CPU= 12.930
  14:16:08 STEP 2939 H=2939:00 +CPU= 12.556
  14:16:30 STEP 2940 H=2940:00 +CPU= 22.205
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002940
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002940
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002940
  14:16:42 STEP 2941 H=2941:00 +CPU= 12.517
  14:16:55 STEP 2942 H=2942:00 +CPU= 12.909
  14:17:15 STEP 2943 H=2943:00 +CPU= 20.037
  14:17:28 STEP 2944 H=2944:00 +CPU= 12.910
  14:17:41 STEP 2945 H=2945:00 +CPU= 12.496
  14:18:01 STEP 2946 H=2946:00 +CPU= 20.473
  14:18:14 STEP 2947 H=2947:00 +CPU= 12.491
  14:18:27 STEP 2948 H=2948:00 +CPU= 12.897
  14:18:47 STEP 2949 H=2949:00 +CPU= 20.005
  14:18:59 STEP 2950 H=2950:00 +CPU= 12.877
  14:19:12 STEP 2951 H=2951:00 +CPU= 12.857
  14:19:35 STEP 2952 H=2952:00 +CPU= 22.317
The child process terminated with status: 0
Moving to projects directory: /home/ll/slots/4/ICMGGhq0f+002952
Moving to projects directory: /home/ll/slots/4/ICMSHhq0f+002952
Moving to projects directory: /home/ll/slots/4/ICMUAhq0f+002952
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002928
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002928
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002928
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002940
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002940
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002940
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMGGhq0f+002952
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMSHhq0f+002952
Adding to the zip: /home/ll/projects/climateprediction.net/oifs_43r3_ps_12196364/ICMUAhq0f+002952
Zipping up the final file: /home/ll/projects/climateprediction.net/oifs_43r3_ps_0720_2010050100_123_979_12196364_0_r1242848258_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
14:22:59 (5430): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:52:29 1536643 22282338 oifs_43r3_ps_0720_2010050100_123_979_12196364_0 10,623,600 45,780 0.0043
09 May 2023 15:52:23 1536643 22282338 oifs_43r3_ps_0720_2010050100_123_979_12196364_0 10,368,000 44,673 0.0043
09 May 2023 15:52:17 1536643 22282338 oifs_43r3_ps_0720_2010050100_123_979_12196364_0 9,504,000 40,947 0.0043
09 May 2023 15:52:11 1536643 22282338 oifs_43r3_ps_0720_2010050100_123_979_12196364_0 8,640,000 37,203 0.0043
09 May 2023 15:52:05 1536643 22282338 oifs_43r3_ps_0720_2010050100_123_979_12196364_0 7,776,000 33,446 0.0043
09 May 2023 15:51:59 1536643 22282338 oifs_43r3_ps_0720_2010050100_123_979_12196364_0 6,912,000 29,730 0.0043
09 May 2023 15:51:54 1536643 22282338 oifs_43r3_ps_0720_2010050100_123_979_12196364_0 6,048,000 26,013 0.0043
09 May 2023 15:51:48 1536643 22282338 oifs_43r3_ps_0720_2010050100_123_979_12196364_0 5,184,000 22,303 0.0043
09 May 2023 15:51:43 1536643 22282338 oifs_43r3_ps_0720_2010050100_123_979_12196364_0 4,320,000 18,585 0.0043
09 May 2023 15:51:37 1536643 22282338 oifs_43r3_ps_0720_2010050100_123_979_12196364_0 3,456,000 14,876 0.0043
09 May 2023 15:51:32 1536643 22282338 oifs_43r3_ps_0720_2010050100_123_979_12196364_0 2,592,000 11,159 0.0043
09 May 2023 15:51:27 1536643 22282338 oifs_43r3_ps_0720_2010050100_123_979_12196364_0 1,728,000 7,451 0.0043
09 May 2023 15:51:22 1536643 22282338 oifs_43r3_ps_0720_2010050100_123_979_12196364_0 864,000 3,744 0.0043


©2024 climateprediction.net