climateprediction.net home page
Task 22250769

Task 22250769

Name oifs_43r3_ps_2860_2021050100_123_947_12165949_1
Workunit 12165949
Created 18 Dec 2022, 2:15:28 UTC
Sent 18 Dec 2022, 2:19:41 UTC
Report deadline 17 Jan 2023, 2:19:41 UTC
Received 19 Dec 2022, 2:51:50 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1504164
Run time 22 hours 34 min 22 sec
CPU time 19 hours 29 min 59 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 1.00 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,062.96 MB
Peak swap size 4,978.07 MB
Peak disk usage 2,561.45 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
a/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002232
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002232
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002232
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002244
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002244
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002244
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_93.zip
Uploading the intermediate file: upload_file_93.zip
  20:40:38 STEP 2257 H=2257:00 +CPU= 18.762
Uploading trickle at timestep: 8121600
  20:40:58 STEP 2258 H=2258:00 +CPU= 19.108
  20:41:30 STEP 2259 H=2259:00 +CPU= 29.771
  20:41:49 STEP 2260 H=2260:00 +CPU= 18.939
  20:42:08 STEP 2261 H=2261:00 +CPU= 18.778
  20:42:39 STEP 2262 H=2262:00 +CPU= 29.698
  20:42:58 STEP 2263 H=2263:00 +CPU= 18.636
  20:43:18 STEP 2264 H=2264:00 +CPU= 19.243
  20:43:48 STEP 2265 H=2265:00 +CPU= 29.085
  20:44:07 STEP 2266 H=2266:00 +CPU= 19.074
  20:44:26 STEP 2267 H=2267:00 +CPU= 18.550
  20:45:00 STEP 2268 H=2268:00 +CPU= 32.179
Moving to projects directory: /data/slots/2/ICMGGhpi1+002268
Moving to projects directory: /data/slots/2/ICMSHhpi1+002268
Moving to projects directory: /data/slots/2/ICMUAhpi1+002268
  20:45:19 STEP 2269 H=2269:00 +CPU= 18.679
  20:45:40 STEP 2270 H=2270:00 +CPU= 19.157
  20:46:10 STEP 2271 H=2271:00 +CPU= 29.243
  20:46:29 STEP 2272 H=2272:00 +CPU= 18.959
  20:46:49 STEP 2273 H=2273:00 +CPU= 18.707
  20:47:19 STEP 2274 H=2274:00 +CPU= 29.778
  20:47:39 STEP 2275 H=2275:00 +CPU= 18.601
  20:48:00 STEP 2276 H=2276:00 +CPU= 19.241
  20:48:31 STEP 2277 H=2277:00 +CPU= 29.200
  20:48:51 STEP 2278 H=2278:00 +CPU= 19.207
  20:49:11 STEP 2279 H=2279:00 +CPU= 19.399
  20:50:06 STEP 2280 H=2280:00 +CPU= 35.044
Moving to projects directory: /data/slots/2/ICMGGhpi1+002280
Moving to projects directory: /data/slots/2/ICMSHhpi1+002280
Moving to projects directory: /data/slots/2/ICMUAhpi1+002280
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002256
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002256
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002256
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002268
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002268
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002268
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_94.zip
Uploading the intermediate file: upload_file_94.zip
  20:50:26 STEP 2281 H=2281:00 +CPU= 18.675
  20:50:47 STEP 2282 H=2282:00 +CPU= 19.200
  20:51:17 STEP 2283 H=2283:00 +CPU= 29.189
  20:51:36 STEP 2284 H=2284:00 +CPU= 19.043
  20:51:56 STEP 2285 H=2285:00 +CPU= 18.580
  20:52:26 STEP 2286 H=2286:00 +CPU= 29.747
  20:52:46 STEP 2287 H=2287:00 +CPU= 18.637
  20:53:06 STEP 2288 H=2288:00 +CPU= 19.219
  20:53:36 STEP 2289 H=2289:00 +CPU= 29.072
  20:53:57 STEP 2290 H=2290:00 +CPU= 19.274
  20:54:17 STEP 2291 H=2291:00 +CPU= 18.710
  20:54:51 STEP 2292 H=2292:00 +CPU= 32.105
Moving to projects directory: /data/slots/2/ICMGGhpi1+002292
Moving to projects directory: /data/slots/2/ICMSHhpi1+002292
Moving to projects directory: /data/slots/2/ICMUAhpi1+002292
  20:55:11 STEP 2293 H=2293:00 +CPU= 18.728
  20:55:31 STEP 2294 H=2294:00 +CPU= 19.072
  20:56:03 STEP 2295 H=2295:00 +CPU= 29.247
  20:56:23 STEP 2296 H=2296:00 +CPU= 19.089
  20:56:44 STEP 2297 H=2297:00 +CPU= 18.680
  20:57:14 STEP 2298 H=2298:00 +CPU= 29.880
  20:57:33 STEP 2299 H=2299:00 +CPU= 18.556
  20:57:54 STEP 2300 H=2300:00 +CPU= 19.158
  20:58:24 STEP 2301 H=2301:00 +CPU= 29.449
  20:58:44 STEP 2302 H=2302:00 +CPU= 19.042
  20:59:04 STEP 2303 H=2303:00 +CPU= 19.321
  20:59:46 STEP 2304 H=2304:00 +CPU= 35.057
Moving to projects directory: /data/slots/2/ICMGGhpi1+002304
Moving to projects directory: /data/slots/2/ICMSHhpi1+002304
Moving to projects directory: /data/slots/2/ICMUAhpi1+002304
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002280
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002280
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002280
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002292
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002292
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002292
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_95.zip
Uploading the intermediate file: upload_file_95.zip
  21:00:09 STEP 2305 H=2305:00 +CPU= 19.150
  21:00:45 STEP 2306 H=2306:00 +CPU= 19.752
  21:01:41 STEP 2307 H=2307:00 +CPU= 30.126
  21:02:18 STEP 2308 H=2308:00 +CPU= 19.965
  21:02:55 STEP 2309 H=2309:00 +CPU= 19.251
  21:03:54 STEP 2310 H=2310:00 +CPU= 31.623
  21:04:23 STEP 2311 H=2311:00 +CPU= 19.169
  21:04:42 STEP 2312 H=2312:00 +CPU= 19.038
  21:05:12 STEP 2313 H=2313:00 +CPU= 29.016
  21:05:32 STEP 2314 H=2314:00 +CPU= 19.078
  21:05:51 STEP 2315 H=2315:00 +CPU= 18.657
  21:06:24 STEP 2316 H=2316:00 +CPU= 32.097
Moving to projects directory: /data/slots/2/ICMGGhpi1+002316
Moving to projects directory: /data/slots/2/ICMSHhpi1+002316
Moving to projects directory: /data/slots/2/ICMUAhpi1+002316
  21:06:43 STEP 2317 H=2317:00 +CPU= 18.627
  21:07:03 STEP 2318 H=2318:00 +CPU= 18.996
  21:07:32 STEP 2319 H=2319:00 +CPU= 28.961
  21:07:51 STEP 2320 H=2320:00 +CPU= 19.121
  21:08:11 STEP 2321 H=2321:00 +CPU= 18.847
  21:08:42 STEP 2322 H=2322:00 +CPU= 29.512
  21:09:01 STEP 2323 H=2323:00 +CPU= 18.713
  21:09:21 STEP 2324 H=2324:00 +CPU= 19.134
  21:09:51 STEP 2325 H=2325:00 +CPU= 29.050
  21:10:12 STEP 2326 H=2326:00 +CPU= 19.846
  21:10:31 STEP 2327 H=2327:00 +CPU= 19.070
  21:11:13 STEP 2328 H=2328:00 +CPU= 35.314
Moving to projects directory: /data/slots/2/ICMGGhpi1+002328
Moving to projects directory: /data/slots/2/ICMSHhpi1+002328
Moving to projects directory: /data/slots/2/ICMUAhpi1+002328
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002304
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002304
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002304
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002316
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002316
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002316
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_96.zip
Uploading the intermediate file: upload_file_96.zip
  21:11:33 STEP 2329 H=2329:00 +CPU= 18.563
  21:11:52 STEP 2330 H=2330:00 +CPU= 18.862
  21:12:23 STEP 2331 H=2331:00 +CPU= 29.112
  21:12:42 STEP 2332 H=2332:00 +CPU= 18.869
  21:13:01 STEP 2333 H=2333:00 +CPU= 18.672
  21:13:32 STEP 2334 H=2334:00 +CPU= 29.779
  21:13:51 STEP 2335 H=2335:00 +CPU= 18.709
  21:14:12 STEP 2336 H=2336:00 +CPU= 19.172
  21:14:42 STEP 2337 H=2337:00 +CPU= 29.294
  21:15:02 STEP 2338 H=2338:00 +CPU= 19.013
  21:15:22 STEP 2339 H=2339:00 +CPU= 18.764
  21:15:54 STEP 2340 H=2340:00 +CPU= 31.921
Moving to projects directory: /data/slots/2/ICMGGhpi1+002340
Moving to projects directory: /data/slots/2/ICMSHhpi1+002340
Moving to projects directory: /data/slots/2/ICMUAhpi1+002340
  21:16:15 STEP 2341 H=2341:00 +CPU= 18.743
  21:16:34 STEP 2342 H=2342:00 +CPU= 19.045
  21:17:06 STEP 2343 H=2343:00 +CPU= 29.538
  21:17:27 STEP 2344 H=2344:00 +CPU= 20.020
  21:17:46 STEP 2345 H=2345:00 +CPU= 18.717
  21:18:17 STEP 2346 H=2346:00 +CPU= 29.611
  21:18:36 STEP 2347 H=2347:00 +CPU= 18.641
  21:18:55 STEP 2348 H=2348:00 +CPU= 18.956
  21:19:26 STEP 2349 H=2349:00 +CPU= 29.087
  21:19:46 STEP 2350 H=2350:00 +CPU= 19.248
  21:20:06 STEP 2351 H=2351:00 +CPU= 19.585
  21:20:47 STEP 2352 H=2352:00 +CPU= 35.088
Moving to projects directory: /data/slots/2/ICMGGhpi1+002352
Moving to projects directory: /data/slots/2/ICMSHhpi1+002352
Moving to projects directory: /data/slots/2/ICMUAhpi1+002352
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002328
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002328
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002328
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002340
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002340
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002340
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_97.zip
Uploading the intermediate file: upload_file_97.zip
  21:21:07 STEP 2353 H=2353:00 +CPU= 18.804
  21:21:27 STEP 2354 H=2354:00 +CPU= 19.088
  21:21:57 STEP 2355 H=2355:00 +CPU= 29.024
  21:22:17 STEP 2356 H=2356:00 +CPU= 19.232
  21:22:36 STEP 2357 H=2357:00 +CPU= 18.613
  21:23:06 STEP 2358 H=2358:00 +CPU= 29.738
  21:23:27 STEP 2359 H=2359:00 +CPU= 18.921
  21:23:46 STEP 2360 H=2360:00 +CPU= 19.152
  21:24:17 STEP 2361 H=2361:00 +CPU= 29.215
  21:24:37 STEP 2362 H=2362:00 +CPU= 19.115
  21:24:56 STEP 2363 H=2363:00 +CPU= 18.535
  21:25:30 STEP 2364 H=2364:00 +CPU= 32.164
Moving to projects directory: /data/slots/2/ICMGGhpi1+002364
Moving to projects directory: /data/slots/2/ICMSHhpi1+002364
Moving to projects directory: /data/slots/2/ICMUAhpi1+002364
  21:25:49 STEP 2365 H=2365:00 +CPU= 18.429
  21:26:08 STEP 2366 H=2366:00 +CPU= 19.153
  21:26:39 STEP 2367 H=2367:00 +CPU= 29.111
  21:26:58 STEP 2368 H=2368:00 +CPU= 18.953
  21:27:18 STEP 2369 H=2369:00 +CPU= 18.671
  21:27:48 STEP 2370 H=2370:00 +CPU= 29.536
  21:28:07 STEP 2371 H=2371:00 +CPU= 18.680
  21:28:28 STEP 2372 H=2372:00 +CPU= 19.349
  21:28:58 STEP 2373 H=2373:00 +CPU= 28.873
  21:29:19 STEP 2374 H=2374:00 +CPU= 19.239
  21:29:38 STEP 2375 H=2375:00 +CPU= 19.021
  21:30:31 STEP 2376 H=2376:00 +CPU= 35.477
Moving to projects directory: /data/slots/2/ICMGGhpi1+002376
Moving to projects directory: /data/slots/2/ICMSHhpi1+002376
Moving to projects directory: /data/slots/2/ICMUAhpi1+002376
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002352
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002352
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002352
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002364
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002364
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002364
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_98.zip
Uploading the intermediate file: upload_file_98.zip
  21:31:08 STEP 2377 H=2377:00 +CPU= 19.709
  21:31:45 STEP 2378 H=2378:00 +CPU= 19.867
  21:32:39 STEP 2379 H=2379:00 +CPU= 30.064
  21:33:15 STEP 2380 H=2380:00 +CPU= 20.121
  21:33:51 STEP 2381 H=2381:00 +CPU= 19.309
  21:34:35 STEP 2382 H=2382:00 +CPU= 30.332
  21:34:54 STEP 2383 H=2383:00 +CPU= 18.399
  21:35:13 STEP 2384 H=2384:00 +CPU= 19.137
  21:35:43 STEP 2385 H=2385:00 +CPU= 28.950
  21:36:03 STEP 2386 H=2386:00 +CPU= 19.093
  21:36:22 STEP 2387 H=2387:00 +CPU= 18.740
  21:36:55 STEP 2388 H=2388:00 +CPU= 31.987
Moving to projects directory: /data/slots/2/ICMGGhpi1+002388
Moving to projects directory: /data/slots/2/ICMSHhpi1+002388
Moving to projects directory: /data/slots/2/ICMUAhpi1+002388
  21:37:15 STEP 2389 H=2389:00 +CPU= 18.759
  21:37:35 STEP 2390 H=2390:00 +CPU= 19.196
  21:38:05 STEP 2391 H=2391:00 +CPU= 28.951
  21:38:26 STEP 2392 H=2392:00 +CPU= 19.211
  21:38:46 STEP 2393 H=2393:00 +CPU= 18.560
  21:39:17 STEP 2394 H=2394:00 +CPU= 29.952
  21:39:37 STEP 2395 H=2395:00 +CPU= 19.103
  21:39:56 STEP 2396 H=2396:00 +CPU= 18.904
  21:40:26 STEP 2397 H=2397:00 +CPU= 28.997
  21:40:46 STEP 2398 H=2398:00 +CPU= 19.172
  21:41:06 STEP 2399 H=2399:00 +CPU= 19.165
  21:41:47 STEP 2400 H=2400:00 +CPU= 35.188
Moving to projects directory: /data/slots/2/ICMGGhpi1+002400
Moving to projects directory: /data/slots/2/ICMSHhpi1+002400
Moving to projects directory: /data/slots/2/ICMUAhpi1+002400
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002376
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002376
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002376
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002388
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002388
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002388
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_99.zip
Uploading the intermediate file: upload_file_99.zip
  21:42:07 STEP 2401 H=2401:00 +CPU= 18.629
  21:42:27 STEP 2402 H=2402:00 +CPU= 19.113
  21:42:57 STEP 2403 H=2403:00 +CPU= 29.013
  21:43:17 STEP 2404 H=2404:00 +CPU= 19.138
  21:43:39 STEP 2405 H=2405:00 +CPU= 18.893
  21:44:09 STEP 2406 H=2406:00 +CPU= 29.625
  21:44:28 STEP 2407 H=2407:00 +CPU= 18.586
  21:44:49 STEP 2408 H=2408:00 +CPU= 19.260
  21:45:19 STEP 2409 H=2409:00 +CPU= 29.161
  21:45:39 STEP 2410 H=2410:00 +CPU= 19.041
  21:45:58 STEP 2411 H=2411:00 +CPU= 18.580
  21:46:30 STEP 2412 H=2412:00 +CPU= 32.159
Moving to projects directory: /data/slots/2/ICMGGhpi1+002412
Moving to projects directory: /data/slots/2/ICMSHhpi1+002412
Moving to projects directory: /data/slots/2/ICMUAhpi1+002412
  21:46:50 STEP 2413 H=2413:00 +CPU= 18.599
  21:47:09 STEP 2414 H=2414:00 +CPU= 19.222
  21:47:39 STEP 2415 H=2415:00 +CPU= 28.936
  21:47:59 STEP 2416 H=2416:00 +CPU= 18.872
  21:48:18 STEP 2417 H=2417:00 +CPU= 18.760
  21:48:50 STEP 2418 H=2418:00 +CPU= 29.696
  21:49:09 STEP 2419 H=2419:00 +CPU= 18.712
  21:49:29 STEP 2420 H=2420:00 +CPU= 19.154
  21:50:00 STEP 2421 H=2421:00 +CPU= 29.372
  21:50:20 STEP 2422 H=2422:00 +CPU= 19.118
  21:50:41 STEP 2423 H=2423:00 +CPU= 19.215
  21:51:18 STEP 2424 H=2424:00 +CPU= 35.073
Moving to projects directory: /data/slots/2/ICMGGhpi1+002424
Moving to projects directory: /data/slots/2/ICMSHhpi1+002424
Moving to projects directory: /data/slots/2/ICMUAhpi1+002424
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002400
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002400
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002400
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002412
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002412
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002412
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_100.zip
Uploading the intermediate file: upload_file_100.zip
  21:51:38 STEP 2425 H=2425:00 +CPU= 18.612
  21:51:58 STEP 2426 H=2426:00 +CPU= 19.289
  21:52:28 STEP 2427 H=2427:00 +CPU= 29.038
  21:52:48 STEP 2428 H=2428:00 +CPU= 19.037
  21:53:07 STEP 2429 H=2429:00 +CPU= 18.628
  21:53:36 STEP 2430 H=2430:00 +CPU= 29.529
  21:53:56 STEP 2431 H=2431:00 +CPU= 19.009
  21:54:16 STEP 2432 H=2432:00 +CPU= 19.186
  21:54:46 STEP 2433 H=2433:00 +CPU= 28.969
  21:55:06 STEP 2434 H=2434:00 +CPU= 19.089
  21:55:26 STEP 2435 H=2435:00 +CPU= 18.628
  21:55:59 STEP 2436 H=2436:00 +CPU= 31.947
Moving to projects directory: /data/slots/2/ICMGGhpi1+002436
Moving to projects directory: /data/slots/2/ICMSHhpi1+002436
Moving to projects directory: /data/slots/2/ICMUAhpi1+002436
  21:56:18 STEP 2437 H=2437:00 +CPU= 18.610
  21:56:38 STEP 2438 H=2438:00 +CPU= 19.019
  21:57:08 STEP 2439 H=2439:00 +CPU= 29.137
  21:57:28 STEP 2440 H=2440:00 +CPU= 19.036
  21:57:47 STEP 2441 H=2441:00 +CPU= 18.531
  21:58:18 STEP 2442 H=2442:00 +CPU= 29.703
  21:58:38 STEP 2443 H=2443:00 +CPU= 19.096
  21:58:58 STEP 2444 H=2444:00 +CPU= 18.996
  21:59:28 STEP 2445 H=2445:00 +CPU= 29.108
  21:59:48 STEP 2446 H=2446:00 +CPU= 19.304
  22:00:14 STEP 2447 H=2447:00 +CPU= 19.330
  22:01:26 STEP 2448 H=2448:00 +CPU= 36.309
Moving to projects directory: /data/slots/2/ICMGGhpi1+002448
Moving to projects directory: /data/slots/2/ICMSHhpi1+002448
Moving to projects directory: /data/slots/2/ICMUAhpi1+002448
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002424
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002424
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002424
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002436
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002436
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002436
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_101.zip
Uploading the intermediate file: upload_file_101.zip
  22:02:04 STEP 2449 H=2449:00 +CPU= 19.372
  22:02:39 STEP 2450 H=2450:00 +CPU= 19.927
  22:03:36 STEP 2451 H=2451:00 +CPU= 30.080
  22:04:13 STEP 2452 H=2452:00 +CPU= 19.876
  22:04:34 STEP 2453 H=2453:00 +CPU= 18.666
  22:05:05 STEP 2454 H=2454:00 +CPU= 29.744
  22:05:24 STEP 2455 H=2455:00 +CPU= 18.676
  22:05:43 STEP 2456 H=2456:00 +CPU= 19.084
  22:06:13 STEP 2457 H=2457:00 +CPU= 29.180
  22:06:33 STEP 2458 H=2458:00 +CPU= 18.978
  22:06:51 STEP 2459 H=2459:00 +CPU= 18.561
  22:07:25 STEP 2460 H=2460:00 +CPU= 32.091
Moving to projects directory: /data/slots/2/ICMGGhpi1+002460
Moving to projects directory: /data/slots/2/ICMSHhpi1+002460
Moving to projects directory: /data/slots/2/ICMUAhpi1+002460
  22:07:45 STEP 2461 H=2461:00 +CPU= 18.541
  22:08:05 STEP 2462 H=2462:00 +CPU= 19.296
  22:08:36 STEP 2463 H=2463:00 +CPU= 29.064
  22:08:55 STEP 2464 H=2464:00 +CPU= 19.038
  22:09:16 STEP 2465 H=2465:00 +CPU= 18.961
  22:09:46 STEP 2466 H=2466:00 +CPU= 29.412
  22:10:05 STEP 2467 H=2467:00 +CPU= 18.653
  22:10:25 STEP 2468 H=2468:00 +CPU= 19.048
  22:10:55 STEP 2469 H=2469:00 +CPU= 28.853
  22:11:15 STEP 2470 H=2470:00 +CPU= 19.424
  22:11:35 STEP 2471 H=2471:00 +CPU= 19.013
  22:12:17 STEP 2472 H=2472:00 +CPU= 34.960
Moving to projects directory: /data/slots/2/ICMGGhpi1+002472
Moving to projects directory: /data/slots/2/ICMSHhpi1+002472
Moving to projects directory: /data/slots/2/ICMUAhpi1+002472
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002448
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002448
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002448
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002460
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002460
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002460
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_102.zip
Uploading the intermediate file: upload_file_102.zip
  22:12:36 STEP 2473 H=2473:00 +CPU= 18.569
  22:12:56 STEP 2474 H=2474:00 +CPU= 19.067
  22:13:26 STEP 2475 H=2475:00 +CPU= 29.110
  22:13:47 STEP 2476 H=2476:00 +CPU= 19.733
  22:14:07 STEP 2477 H=2477:00 +CPU= 18.774
  22:14:37 STEP 2478 H=2478:00 +CPU= 29.491
  22:14:56 STEP 2479 H=2479:00 +CPU= 18.518
  22:15:16 STEP 2480 H=2480:00 +CPU= 19.126
  22:15:45 STEP 2481 H=2481:00 +CPU= 28.857
  22:16:05 STEP 2482 H=2482:00 +CPU= 19.403
  22:16:25 STEP 2483 H=2483:00 +CPU= 18.633
  22:16:58 STEP 2484 H=2484:00 +CPU= 32.241
Moving to projects directory: /data/slots/2/ICMGGhpi1+002484
Moving to projects directory: /data/slots/2/ICMSHhpi1+002484
Moving to projects directory: /data/slots/2/ICMUAhpi1+002484
  22:17:19 STEP 2485 H=2485:00 +CPU= 20.069
  22:17:39 STEP 2486 H=2486:00 +CPU= 18.842
  22:18:09 STEP 2487 H=2487:00 +CPU= 29.102
  22:18:28 STEP 2488 H=2488:00 +CPU= 18.893
  22:18:48 STEP 2489 H=2489:00 +CPU= 18.827
  22:19:20 STEP 2490 H=2490:00 +CPU= 29.730
  22:19:39 STEP 2491 H=2491:00 +CPU= 18.500
  22:19:58 STEP 2492 H=2492:00 +CPU= 18.990
  22:20:29 STEP 2493 H=2493:00 +CPU= 29.102
  22:20:48 STEP 2494 H=2494:00 +CPU= 18.991
  22:21:08 STEP 2495 H=2495:00 +CPU= 19.188
  22:21:50 STEP 2496 H=2496:00 +CPU= 35.093
Moving to projects directory: /data/slots/2/ICMGGhpi1+002496
Moving to projects directory: /data/slots/2/ICMSHhpi1+002496
Moving to projects directory: /data/slots/2/ICMUAhpi1+002496
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002472
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002472
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002472
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002484
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002484
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002484
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_103.zip
Uploading the intermediate file: upload_file_103.zip
  22:22:09 STEP 2497 H=2497:00 +CPU= 18.651
Uploading trickle at timestep: 8985600
  22:22:29 STEP 2498 H=2498:00 +CPU= 19.144
  22:22:59 STEP 2499 H=2499:00 +CPU= 28.827
  22:23:18 STEP 2500 H=2500:00 +CPU= 19.092
  22:23:37 STEP 2501 H=2501:00 +CPU= 18.526
  22:24:07 STEP 2502 H=2502:00 +CPU= 29.357
  22:24:27 STEP 2503 H=2503:00 +CPU= 18.636
  22:24:46 STEP 2504 H=2504:00 +CPU= 19.093
  22:25:16 STEP 2505 H=2505:00 +CPU= 28.995
  22:25:37 STEP 2506 H=2506:00 +CPU= 19.315
  22:25:56 STEP 2507 H=2507:00 +CPU= 18.520
  22:26:29 STEP 2508 H=2508:00 +CPU= 31.898
Moving to projects directory: /data/slots/2/ICMGGhpi1+002508
Moving to projects directory: /data/slots/2/ICMSHhpi1+002508
Moving to projects directory: /data/slots/2/ICMUAhpi1+002508
  22:26:48 STEP 2509 H=2509:00 +CPU= 18.714
  22:27:08 STEP 2510 H=2510:00 +CPU= 19.163
  22:27:38 STEP 2511 H=2511:00 +CPU= 28.885
  22:27:58 STEP 2512 H=2512:00 +CPU= 19.126
  22:28:17 STEP 2513 H=2513:00 +CPU= 18.579
  22:28:49 STEP 2514 H=2514:00 +CPU= 29.582
  22:29:08 STEP 2515 H=2515:00 +CPU= 18.559
  22:29:29 STEP 2516 H=2516:00 +CPU= 19.049
  22:29:59 STEP 2517 H=2517:00 +CPU= 29.007
  22:30:39 STEP 2518 H=2518:00 +CPU= 19.769
  22:31:16 STEP 2519 H=2519:00 +CPU= 20.213
  22:32:30 STEP 2520 H=2520:00 +CPU= 36.396
Moving to projects directory: /data/slots/2/ICMGGhpi1+002520
Moving to projects directory: /data/slots/2/ICMSHhpi1+002520
Moving to projects directory: /data/slots/2/ICMUAhpi1+002520
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002496
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002496
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002496
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002508
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002508
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002508
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_104.zip
Uploading the intermediate file: upload_file_104.zip
  22:33:07 STEP 2521 H=2521:00 +CPU= 19.322
  22:33:45 STEP 2522 H=2522:00 +CPU= 19.915
  22:34:28 STEP 2523 H=2523:00 +CPU= 29.670
  22:34:48 STEP 2524 H=2524:00 +CPU= 19.328
  22:35:07 STEP 2525 H=2525:00 +CPU= 18.654
  22:35:38 STEP 2526 H=2526:00 +CPU= 29.642
  22:35:57 STEP 2527 H=2527:00 +CPU= 18.582
  22:36:16 STEP 2528 H=2528:00 +CPU= 19.088
  22:36:46 STEP 2529 H=2529:00 +CPU= 29.045
  22:37:06 STEP 2530 H=2530:00 +CPU= 19.224
  22:37:25 STEP 2531 H=2531:00 +CPU= 18.638
  22:37:58 STEP 2532 H=2532:00 +CPU= 32.026
Moving to projects directory: /data/slots/2/ICMGGhpi1+002532
Moving to projects directory: /data/slots/2/ICMSHhpi1+002532
Moving to projects directory: /data/slots/2/ICMUAhpi1+002532
  22:38:17 STEP 2533 H=2533:00 +CPU= 18.669
  22:38:38 STEP 2534 H=2534:00 +CPU= 19.167
  22:39:08 STEP 2535 H=2535:00 +CPU= 29.145
  22:39:27 STEP 2536 H=2536:00 +CPU= 18.917
  22:39:46 STEP 2537 H=2537:00 +CPU= 18.544
  22:40:20 STEP 2538 H=2538:00 +CPU= 32.458
  22:40:42 STEP 2539 H=2539:00 +CPU= 20.149
  22:41:04 STEP 2540 H=2540:00 +CPU= 20.791
  22:41:36 STEP 2541 H=2541:00 +CPU= 30.361
  22:41:58 STEP 2542 H=2542:00 +CPU= 20.091
  22:42:19 STEP 2543 H=2543:00 +CPU= 20.099
  22:43:03 STEP 2544 H=2544:00 +CPU= 36.579
Moving to projects directory: /data/slots/2/ICMGGhpi1+002544
Moving to projects directory: /data/slots/2/ICMSHhpi1+002544
Moving to projects directory: /data/slots/2/ICMUAhpi1+002544
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002520
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002520
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002520
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002532
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002532
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002532
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_105.zip
Uploading the intermediate file: upload_file_105.zip
  22:43:25 STEP 2545 H=2545:00 +CPU= 20.413
  22:43:47 STEP 2546 H=2546:00 +CPU= 20.511
  22:44:19 STEP 2547 H=2547:00 +CPU= 30.401
  22:44:38 STEP 2548 H=2548:00 +CPU= 19.322
  22:44:59 STEP 2549 H=2549:00 +CPU= 18.955
  22:45:30 STEP 2550 H=2550:00 +CPU= 30.595
  22:45:50 STEP 2551 H=2551:00 +CPU= 18.962
  22:46:11 STEP 2552 H=2552:00 +CPU= 19.620
  22:46:42 STEP 2553 H=2553:00 +CPU= 29.950
  22:47:04 STEP 2554 H=2554:00 +CPU= 19.675
  22:47:24 STEP 2555 H=2555:00 +CPU= 19.023
  22:48:00 STEP 2556 H=2556:00 +CPU= 32.852
Moving to projects directory: /data/slots/2/ICMGGhpi1+002556
Moving to projects directory: /data/slots/2/ICMSHhpi1+002556
Moving to projects directory: /data/slots/2/ICMUAhpi1+002556
  22:48:20 STEP 2557 H=2557:00 +CPU= 19.193
  22:48:40 STEP 2558 H=2558:00 +CPU= 19.831
  22:49:14 STEP 2559 H=2559:00 +CPU= 29.659
  22:49:35 STEP 2560 H=2560:00 +CPU= 19.327
  22:49:56 STEP 2561 H=2561:00 +CPU= 19.075
  22:50:28 STEP 2562 H=2562:00 +CPU= 30.260
  22:50:47 STEP 2563 H=2563:00 +CPU= 19.231
  22:51:09 STEP 2564 H=2564:00 +CPU= 19.874
  22:51:40 STEP 2565 H=2565:00 +CPU= 29.594
  22:52:02 STEP 2566 H=2566:00 +CPU= 19.830
  22:52:22 STEP 2567 H=2567:00 +CPU= 20.066
  22:53:01 STEP 2568 H=2568:00 +CPU= 36.681
Moving to projects directory: /data/slots/2/ICMGGhpi1+002568
Moving to projects directory: /data/slots/2/ICMSHhpi1+002568
Moving to projects directory: /data/slots/2/ICMUAhpi1+002568
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002544
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002544
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002544
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002556
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002556
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002556
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_106.zip
Uploading the intermediate file: upload_file_106.zip
  22:53:24 STEP 2569 H=2569:00 +CPU= 20.484
  22:53:47 STEP 2570 H=2570:00 +CPU= 20.616
  22:54:19 STEP 2571 H=2571:00 +CPU= 30.588
  22:54:40 STEP 2572 H=2572:00 +CPU= 19.812
  22:55:00 STEP 2573 H=2573:00 +CPU= 19.529
  22:55:32 STEP 2574 H=2574:00 +CPU= 31.405
  22:55:52 STEP 2575 H=2575:00 +CPU= 19.534
  22:56:14 STEP 2576 H=2576:00 +CPU= 21.060
  22:56:46 STEP 2577 H=2577:00 +CPU= 30.698
  22:57:07 STEP 2578 H=2578:00 +CPU= 20.295
  22:57:27 STEP 2579 H=2579:00 +CPU= 20.016
  22:58:01 STEP 2580 H=2580:00 +CPU= 32.972
Moving to projects directory: /data/slots/2/ICMGGhpi1+002580
Moving to projects directory: /data/slots/2/ICMSHhpi1+002580
Moving to projects directory: /data/slots/2/ICMUAhpi1+002580
  22:58:21 STEP 2581 H=2581:00 +CPU= 19.425
  22:58:42 STEP 2582 H=2582:00 +CPU= 20.124
  22:59:14 STEP 2583 H=2583:00 +CPU= 30.832
  22:59:35 STEP 2584 H=2584:00 +CPU= 20.274
  22:59:55 STEP 2585 H=2585:00 +CPU= 19.820
  23:00:54 STEP 2586 H=2586:00 +CPU= 32.581
  23:01:33 STEP 2587 H=2587:00 +CPU= 20.648
  23:02:14 STEP 2588 H=2588:00 +CPU= 22.120
  23:03:16 STEP 2589 H=2589:00 +CPU= 33.212
  23:03:58 STEP 2590 H=2590:00 +CPU= 22.571
  23:04:39 STEP 2591 H=2591:00 +CPU= 22.164
  23:05:23 STEP 2592 H=2592:00 +CPU= 37.437
Moving to projects directory: /data/slots/2/ICMGGhpi1+002592
Moving to projects directory: /data/slots/2/ICMSHhpi1+002592
Moving to projects directory: /data/slots/2/ICMUAhpi1+002592
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002568
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002568
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002568
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002580
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002580
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002580
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_107.zip
Uploading the intermediate file: upload_file_107.zip
  23:05:44 STEP 2593 H=2593:00 +CPU= 20.172
  23:06:05 STEP 2594 H=2594:00 +CPU= 20.928
  23:06:38 STEP 2595 H=2595:00 +CPU= 31.827
  23:07:00 STEP 2596 H=2596:00 +CPU= 20.828
  23:07:23 STEP 2597 H=2597:00 +CPU= 22.659
  23:07:56 STEP 2598 H=2598:00 +CPU= 32.244
  23:08:18 STEP 2599 H=2599:00 +CPU= 20.754
  23:08:39 STEP 2600 H=2600:00 +CPU= 20.950
  23:09:12 STEP 2601 H=2601:00 +CPU= 32.050
  23:09:34 STEP 2602 H=2602:00 +CPU= 21.183
  23:09:55 STEP 2603 H=2603:00 +CPU= 20.346
  23:10:33 STEP 2604 H=2604:00 +CPU= 35.262
Moving to projects directory: /data/slots/2/ICMGGhpi1+002604
Moving to projects directory: /data/slots/2/ICMSHhpi1+002604
Moving to projects directory: /data/slots/2/ICMUAhpi1+002604
  23:10:55 STEP 2605 H=2605:00 +CPU= 20.516
  23:11:19 STEP 2606 H=2606:00 +CPU= 21.907
  23:11:55 STEP 2607 H=2607:00 +CPU= 33.264
  23:12:18 STEP 2608 H=2608:00 +CPU= 21.256
  23:12:41 STEP 2609 H=2609:00 +CPU= 20.835
  23:13:17 STEP 2610 H=2610:00 +CPU= 32.341
  23:13:39 STEP 2611 H=2611:00 +CPU= 20.605
  23:14:03 STEP 2612 H=2612:00 +CPU= 21.442
  23:14:37 STEP 2613 H=2613:00 +CPU= 31.755
  23:14:58 STEP 2614 H=2614:00 +CPU= 20.256
  23:15:20 STEP 2615 H=2615:00 +CPU= 20.882
  23:16:09 STEP 2616 H=2616:00 +CPU= 38.033
Moving to projects directory: /data/slots/2/ICMGGhpi1+002616
Moving to projects directory: /data/slots/2/ICMSHhpi1+002616
Moving to projects directory: /data/slots/2/ICMUAhpi1+002616
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002592
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002592
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002592
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002604
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002604
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002604
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_108.zip
Uploading the intermediate file: upload_file_108.zip
  23:16:31 STEP 2617 H=2617:00 +CPU= 20.425
  23:16:53 STEP 2618 H=2618:00 +CPU= 20.936
  23:17:28 STEP 2619 H=2619:00 +CPU= 34.796
  23:17:50 STEP 2620 H=2620:00 +CPU= 20.872
  23:18:12 STEP 2621 H=2621:00 +CPU= 21.007
  23:18:45 STEP 2622 H=2622:00 +CPU= 32.103
  23:19:06 STEP 2623 H=2623:00 +CPU= 20.279
  23:19:28 STEP 2624 H=2624:00 +CPU= 21.189
  23:20:02 STEP 2625 H=2625:00 +CPU= 31.071
  23:20:24 STEP 2626 H=2626:00 +CPU= 21.305
  23:20:45 STEP 2627 H=2627:00 +CPU= 20.464
  23:21:22 STEP 2628 H=2628:00 +CPU= 34.817
Moving to projects directory: /data/slots/2/ICMGGhpi1+002628
Moving to projects directory: /data/slots/2/ICMSHhpi1+002628
Moving to projects directory: /data/slots/2/ICMUAhpi1+002628
  23:21:44 STEP 2629 H=2629:00 +CPU= 20.682
  23:22:06 STEP 2630 H=2630:00 +CPU= 21.267
  23:22:40 STEP 2631 H=2631:00 +CPU= 31.727
  23:23:01 STEP 2632 H=2632:00 +CPU= 20.714
  23:23:23 STEP 2633 H=2633:00 +CPU= 20.567
  23:23:57 STEP 2634 H=2634:00 +CPU= 32.352
  23:24:19 STEP 2635 H=2635:00 +CPU= 20.562
  23:24:42 STEP 2636 H=2636:00 +CPU= 20.948
  23:25:15 STEP 2637 H=2637:00 +CPU= 31.976
  23:25:36 STEP 2638 H=2638:00 +CPU= 20.346
  23:25:59 STEP 2639 H=2639:00 +CPU= 20.771
  23:26:49 STEP 2640 H=2640:00 +CPU= 36.364
Moving to projects directory: /data/slots/2/ICMGGhpi1+002640
Moving to projects directory: /data/slots/2/ICMSHhpi1+002640
Moving to projects directory: /data/slots/2/ICMUAhpi1+002640
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002616
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002616
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002616
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002628
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002628
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002628
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_109.zip
Uploading the intermediate file: upload_file_109.zip
  23:27:10 STEP 2641 H=2641:00 +CPU= 20.528
  23:27:32 STEP 2642 H=2642:00 +CPU= 20.576
  23:28:04 STEP 2643 H=2643:00 +CPU= 31.572
  23:28:26 STEP 2644 H=2644:00 +CPU= 20.807
  23:28:47 STEP 2645 H=2645:00 +CPU= 20.206
  23:29:21 STEP 2646 H=2646:00 +CPU= 32.657
  23:29:41 STEP 2647 H=2647:00 +CPU= 20.463
  23:30:06 STEP 2648 H=2648:00 +CPU= 21.294
  23:31:13 STEP 2649 H=2649:00 +CPU= 32.994
  23:31:55 STEP 2650 H=2650:00 +CPU= 21.502
  23:32:34 STEP 2651 H=2651:00 +CPU= 21.482
  23:33:42 STEP 2652 H=2652:00 +CPU= 36.885
Moving to projects directory: /data/slots/2/ICMGGhpi1+002652
Moving to projects directory: /data/slots/2/ICMSHhpi1+002652
Moving to projects directory: /data/slots/2/ICMUAhpi1+002652
  23:34:24 STEP 2653 H=2653:00 +CPU= 21.758
  23:34:46 STEP 2654 H=2654:00 +CPU= 21.116
  23:35:19 STEP 2655 H=2655:00 +CPU= 31.684
  23:35:40 STEP 2656 H=2656:00 +CPU= 20.722
  23:36:02 STEP 2657 H=2657:00 +CPU= 20.648
  23:36:35 STEP 2658 H=2658:00 +CPU= 31.395
  23:36:58 STEP 2659 H=2659:00 +CPU= 20.247
  23:37:20 STEP 2660 H=2660:00 +CPU= 20.771
  23:37:52 STEP 2661 H=2661:00 +CPU= 31.226
  23:38:15 STEP 2662 H=2662:00 +CPU= 20.996
  23:38:36 STEP 2663 H=2663:00 +CPU= 20.604
  23:39:16 STEP 2664 H=2664:00 +CPU= 37.679
Moving to projects directory: /data/slots/2/ICMGGhpi1+002664
Moving to projects directory: /data/slots/2/ICMSHhpi1+002664
Moving to projects directory: /data/slots/2/ICMUAhpi1+002664
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002640
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002640
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002640
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002652
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002652
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002652
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_110.zip
Uploading the intermediate file: upload_file_110.zip
  23:39:37 STEP 2665 H=2665:00 +CPU= 20.012
  23:39:59 STEP 2666 H=2666:00 +CPU= 20.877
  23:40:32 STEP 2667 H=2667:00 +CPU= 31.924
  23:40:53 STEP 2668 H=2668:00 +CPU= 20.929
  23:41:15 STEP 2669 H=2669:00 +CPU= 20.933
  23:41:48 STEP 2670 H=2670:00 +CPU= 31.867
  23:42:09 STEP 2671 H=2671:00 +CPU= 20.514
  23:42:31 STEP 2672 H=2672:00 +CPU= 20.888
  23:43:04 STEP 2673 H=2673:00 +CPU= 31.609
  23:43:26 STEP 2674 H=2674:00 +CPU= 21.307
  23:43:47 STEP 2675 H=2675:00 +CPU= 20.400
  23:44:25 STEP 2676 H=2676:00 +CPU= 34.728
Moving to projects directory: /data/slots/2/ICMGGhpi1+002676
Moving to projects directory: /data/slots/2/ICMSHhpi1+002676
Moving to projects directory: /data/slots/2/ICMUAhpi1+002676
  23:44:46 STEP 2677 H=2677:00 +CPU= 20.358
  23:45:09 STEP 2678 H=2678:00 +CPU= 21.091
  23:45:41 STEP 2679 H=2679:00 +CPU= 31.115
  23:46:02 STEP 2680 H=2680:00 +CPU= 20.364
  23:46:24 STEP 2681 H=2681:00 +CPU= 20.520
  23:46:57 STEP 2682 H=2682:00 +CPU= 32.095
  23:47:19 STEP 2683 H=2683:00 +CPU= 20.122
  23:47:41 STEP 2684 H=2684:00 +CPU= 20.510
  23:48:15 STEP 2685 H=2685:00 +CPU= 31.445
  23:48:36 STEP 2686 H=2686:00 +CPU= 20.310
  23:48:57 STEP 2687 H=2687:00 +CPU= 20.479
  23:49:36 STEP 2688 H=2688:00 +CPU= 36.667
Moving to projects directory: /data/slots/2/ICMGGhpi1+002688
Moving to projects directory: /data/slots/2/ICMSHhpi1+002688
Moving to projects directory: /data/slots/2/ICMUAhpi1+002688
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002664
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002664
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002664
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002676
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002676
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002676
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_111.zip
Uploading the intermediate file: upload_file_111.zip
  23:49:57 STEP 2689 H=2689:00 +CPU= 20.213
  23:50:19 STEP 2690 H=2690:00 +CPU= 20.782
  23:50:52 STEP 2691 H=2691:00 +CPU= 31.601
  23:51:13 STEP 2692 H=2692:00 +CPU= 21.194
  23:51:35 STEP 2693 H=2693:00 +CPU= 20.752
  23:52:09 STEP 2694 H=2694:00 +CPU= 32.503
  23:52:31 STEP 2695 H=2695:00 +CPU= 21.278
  23:52:54 STEP 2696 H=2696:00 +CPU= 21.387
  23:53:30 STEP 2697 H=2697:00 +CPU= 32.862
  23:53:52 STEP 2698 H=2698:00 +CPU= 20.328
  23:54:15 STEP 2699 H=2699:00 +CPU= 21.483
  23:54:53 STEP 2700 H=2700:00 +CPU= 35.435
Moving to projects directory: /data/slots/2/ICMGGhpi1+002700
Moving to projects directory: /data/slots/2/ICMSHhpi1+002700
Moving to projects directory: /data/slots/2/ICMUAhpi1+002700
  23:55:16 STEP 2701 H=2701:00 +CPU= 20.709
  23:55:40 STEP 2702 H=2702:00 +CPU= 21.312
  23:56:13 STEP 2703 H=2703:00 +CPU= 31.785
  23:56:35 STEP 2704 H=2704:00 +CPU= 20.849
  23:56:56 STEP 2705 H=2705:00 +CPU= 20.505
  23:57:31 STEP 2706 H=2706:00 +CPU= 32.696
  23:57:52 STEP 2707 H=2707:00 +CPU= 20.421
  23:58:14 STEP 2708 H=2708:00 +CPU= 21.217
  23:58:48 STEP 2709 H=2709:00 +CPU= 31.997
  23:59:10 STEP 2710 H=2710:00 +CPU= 21.170
  23:59:33 STEP 2711 H=2711:00 +CPU= 20.340
  00:00:48 STEP 2712 H=2712:00 +CPU= 37.454
Moving to projects directory: /data/slots/2/ICMGGhpi1+002712
Moving to projects directory: /data/slots/2/ICMSHhpi1+002712
Moving to projects directory: /data/slots/2/ICMUAhpi1+002712
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002688
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002688
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002688
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002700
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002700
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002700
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_112.zip
Uploading the intermediate file: upload_file_112.zip
  00:01:27 STEP 2713 H=2713:00 +CPU= 20.685
  00:02:05 STEP 2714 H=2714:00 +CPU= 20.813
  00:03:02 STEP 2715 H=2715:00 +CPU= 31.543
  00:03:43 STEP 2716 H=2716:00 +CPU= 22.070
  00:04:22 STEP 2717 H=2717:00 +CPU= 21.179
  00:04:57 STEP 2718 H=2718:00 +CPU= 31.494
  00:05:18 STEP 2719 H=2719:00 +CPU= 19.981
  00:05:40 STEP 2720 H=2720:00 +CPU= 21.065
  00:06:11 STEP 2721 H=2721:00 +CPU= 30.756
  00:06:33 STEP 2722 H=2722:00 +CPU= 20.475
  00:06:55 STEP 2723 H=2723:00 +CPU= 20.177
  00:07:32 STEP 2724 H=2724:00 +CPU= 34.500
Moving to projects directory: /data/slots/2/ICMGGhpi1+002724
Moving to projects directory: /data/slots/2/ICMSHhpi1+002724
Moving to projects directory: /data/slots/2/ICMUAhpi1+002724
  00:07:53 STEP 2725 H=2725:00 +CPU= 19.620
  00:08:14 STEP 2726 H=2726:00 +CPU= 20.272
  00:08:48 STEP 2727 H=2727:00 +CPU= 31.232
  00:09:10 STEP 2728 H=2728:00 +CPU= 21.567
  00:09:34 STEP 2729 H=2729:00 +CPU= 20.781
  00:10:08 STEP 2730 H=2730:00 +CPU= 31.968
  00:10:29 STEP 2731 H=2731:00 +CPU= 20.506
  00:10:52 STEP 2732 H=2732:00 +CPU= 21.084
  00:11:25 STEP 2733 H=2733:00 +CPU= 31.526
  00:11:47 STEP 2734 H=2734:00 +CPU= 20.936
  00:12:09 STEP 2735 H=2735:00 +CPU= 21.483
  00:12:49 STEP 2736 H=2736:00 +CPU= 37.056
Moving to projects directory: /data/slots/2/ICMGGhpi1+002736
Moving to projects directory: /data/slots/2/ICMSHhpi1+002736
Moving to projects directory: /data/slots/2/ICMUAhpi1+002736
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002712
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002712
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002712
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002724
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002724
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002724
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_113.zip
Uploading the intermediate file: upload_file_113.zip
  00:13:12 STEP 2737 H=2737:00 +CPU= 20.854
Uploading trickle at timestep: 9849600
  00:13:38 STEP 2738 H=2738:00 +CPU= 21.354
  00:14:13 STEP 2739 H=2739:00 +CPU= 32.040
  00:14:33 STEP 2740 H=2740:00 +CPU= 20.202
  00:14:54 STEP 2741 H=2741:00 +CPU= 19.566
  00:15:26 STEP 2742 H=2742:00 +CPU= 31.062
  00:15:46 STEP 2743 H=2743:00 +CPU= 19.448
  00:16:08 STEP 2744 H=2744:00 +CPU= 20.548
  00:16:40 STEP 2745 H=2745:00 +CPU= 31.153
  00:17:02 STEP 2746 H=2746:00 +CPU= 20.902
  00:17:26 STEP 2747 H=2747:00 +CPU= 22.908
  00:18:02 STEP 2748 H=2748:00 +CPU= 33.621
Moving to projects directory: /data/slots/2/ICMGGhpi1+002748
Moving to projects directory: /data/slots/2/ICMSHhpi1+002748
Moving to projects directory: /data/slots/2/ICMUAhpi1+002748
  00:18:23 STEP 2749 H=2749:00 +CPU= 19.840
  00:18:44 STEP 2750 H=2750:00 +CPU= 20.534
  00:19:18 STEP 2751 H=2751:00 +CPU= 31.126
  00:19:40 STEP 2752 H=2752:00 +CPU= 20.375
  00:20:02 STEP 2753 H=2753:00 +CPU= 20.010
  00:20:35 STEP 2754 H=2754:00 +CPU= 31.630
  00:20:57 STEP 2755 H=2755:00 +CPU= 19.854
  00:21:19 STEP 2756 H=2756:00 +CPU= 20.816
  00:21:51 STEP 2757 H=2757:00 +CPU= 30.599
  00:22:14 STEP 2758 H=2758:00 +CPU= 20.721
  00:22:39 STEP 2759 H=2759:00 +CPU= 22.802
  00:23:34 STEP 2760 H=2760:00 +CPU= 49.475
Moving to projects directory: /data/slots/2/ICMGGhpi1+002760
Moving to projects directory: /data/slots/2/ICMSHhpi1+002760
Moving to projects directory: /data/slots/2/ICMUAhpi1+002760
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002736
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002736
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002736
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002748
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002748
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002748
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_114.zip
Uploading the intermediate file: upload_file_114.zip
  00:24:06 STEP 2761 H=2761:00 +CPU= 29.805
  00:24:27 STEP 2762 H=2762:00 +CPU= 20.396
  00:24:57 STEP 2763 H=2763:00 +CPU= 29.264
  00:25:17 STEP 2764 H=2764:00 +CPU= 19.336
  00:25:36 STEP 2765 H=2765:00 +CPU= 18.516
  00:26:07 STEP 2766 H=2766:00 +CPU= 29.580
  00:26:25 STEP 2767 H=2767:00 +CPU= 18.548
  00:26:45 STEP 2768 H=2768:00 +CPU= 18.857
  00:27:15 STEP 2769 H=2769:00 +CPU= 29.322
  00:27:35 STEP 2770 H=2770:00 +CPU= 19.166
  00:27:53 STEP 2771 H=2771:00 +CPU= 18.412
  00:28:27 STEP 2772 H=2772:00 +CPU= 32.125
Moving to projects directory: /data/slots/2/ICMGGhpi1+002772
Moving to projects directory: /data/slots/2/ICMSHhpi1+002772
Moving to projects directory: /data/slots/2/ICMUAhpi1+002772
  00:28:46 STEP 2773 H=2773:00 +CPU= 18.513
  00:29:09 STEP 2774 H=2774:00 +CPU= 21.784
  00:29:47 STEP 2775 H=2775:00 +CPU= 34.682
  00:30:23 STEP 2776 H=2776:00 +CPU= 23.485
  00:31:11 STEP 2777 H=2777:00 +CPU= 22.728
  00:32:19 STEP 2778 H=2778:00 +CPU= 36.653
  00:32:57 STEP 2779 H=2779:00 +CPU= 22.377
  00:33:37 STEP 2780 H=2780:00 +CPU= 21.813
  00:34:33 STEP 2781 H=2781:00 +CPU= 30.274
  00:34:56 STEP 2782 H=2782:00 +CPU= 19.362
  00:35:17 STEP 2783 H=2783:00 +CPU= 20.018
  00:35:54 STEP 2784 H=2784:00 +CPU= 34.721
Moving to projects directory: /data/slots/2/ICMGGhpi1+002784
Moving to projects directory: /data/slots/2/ICMSHhpi1+002784
Moving to projects directory: /data/slots/2/ICMUAhpi1+002784
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002760
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002760
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002760
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002772
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002772
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002772
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_115.zip
Uploading the intermediate file: upload_file_115.zip
  00:36:17 STEP 2785 H=2785:00 +CPU= 21.402
  00:36:38 STEP 2786 H=2786:00 +CPU= 20.745
  00:37:09 STEP 2787 H=2787:00 +CPU= 31.103
  00:37:31 STEP 2788 H=2788:00 +CPU= 20.245
  00:37:52 STEP 2789 H=2789:00 +CPU= 20.795
  00:38:24 STEP 2790 H=2790:00 +CPU= 31.048
  00:38:46 STEP 2791 H=2791:00 +CPU= 21.906
  00:39:09 STEP 2792 H=2792:00 +CPU= 21.831
  00:39:42 STEP 2793 H=2793:00 +CPU= 31.633
  00:40:03 STEP 2794 H=2794:00 +CPU= 21.051
  00:40:24 STEP 2795 H=2795:00 +CPU= 20.328
  00:41:00 STEP 2796 H=2796:00 +CPU= 34.781
Moving to projects directory: /data/slots/2/ICMGGhpi1+002796
Moving to projects directory: /data/slots/2/ICMSHhpi1+002796
Moving to projects directory: /data/slots/2/ICMUAhpi1+002796
  00:41:24 STEP 2797 H=2797:00 +CPU= 22.222
  00:41:46 STEP 2798 H=2798:00 +CPU= 21.643
  00:42:20 STEP 2799 H=2799:00 +CPU= 32.299
  00:42:44 STEP 2800 H=2800:00 +CPU= 22.029
  00:43:04 STEP 2801 H=2801:00 +CPU= 18.820
  00:43:36 STEP 2802 H=2802:00 +CPU= 30.604
  00:43:56 STEP 2803 H=2803:00 +CPU= 18.675
  00:44:16 STEP 2804 H=2804:00 +CPU= 19.213
  00:44:46 STEP 2805 H=2805:00 +CPU= 29.351
  00:45:07 STEP 2806 H=2806:00 +CPU= 19.889
  00:45:28 STEP 2807 H=2807:00 +CPU= 19.243
  00:46:13 STEP 2808 H=2808:00 +CPU= 35.193
Moving to projects directory: /data/slots/2/ICMGGhpi1+002808
Moving to projects directory: /data/slots/2/ICMSHhpi1+002808
Moving to projects directory: /data/slots/2/ICMUAhpi1+002808
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002784
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002784
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002784
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002796
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002796
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002796
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_116.zip
Uploading the intermediate file: upload_file_116.zip
  00:46:34 STEP 2809 H=2809:00 +CPU= 18.795
  00:46:53 STEP 2810 H=2810:00 +CPU= 19.083
  00:47:23 STEP 2811 H=2811:00 +CPU= 29.214
  00:47:43 STEP 2812 H=2812:00 +CPU= 19.212
  00:48:02 STEP 2813 H=2813:00 +CPU= 18.546
  00:48:33 STEP 2814 H=2814:00 +CPU= 29.731
  00:48:52 STEP 2815 H=2815:00 +CPU= 18.823
  00:49:12 STEP 2816 H=2816:00 +CPU= 19.375
  00:49:42 STEP 2817 H=2817:00 +CPU= 29.013
  00:50:02 STEP 2818 H=2818:00 +CPU= 19.389
  00:50:21 STEP 2819 H=2819:00 +CPU= 18.746
  00:50:54 STEP 2820 H=2820:00 +CPU= 31.966
Moving to projects directory: /data/slots/2/ICMGGhpi1+002820
Moving to projects directory: /data/slots/2/ICMSHhpi1+002820
Moving to projects directory: /data/slots/2/ICMUAhpi1+002820
  00:51:14 STEP 2821 H=2821:00 +CPU= 18.783
  00:51:34 STEP 2822 H=2822:00 +CPU= 19.159
  00:52:03 STEP 2823 H=2823:00 +CPU= 29.105
  00:52:23 STEP 2824 H=2824:00 +CPU= 19.165
  00:52:42 STEP 2825 H=2825:00 +CPU= 18.633
  00:53:13 STEP 2826 H=2826:00 +CPU= 29.934
  00:53:32 STEP 2827 H=2827:00 +CPU= 18.568
  00:53:53 STEP 2828 H=2828:00 +CPU= 19.191
  00:54:23 STEP 2829 H=2829:00 +CPU= 29.365
  00:54:44 STEP 2830 H=2830:00 +CPU= 18.971
  00:55:03 STEP 2831 H=2831:00 +CPU= 19.211
  00:55:41 STEP 2832 H=2832:00 +CPU= 34.988
Moving to projects directory: /data/slots/2/ICMGGhpi1+002832
Moving to projects directory: /data/slots/2/ICMSHhpi1+002832
Moving to projects directory: /data/slots/2/ICMUAhpi1+002832
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002808
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002808
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002808
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002820
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002820
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002820
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_117.zip
Uploading the intermediate file: upload_file_117.zip
  00:56:01 STEP 2833 H=2833:00 +CPU= 18.743
  00:56:21 STEP 2834 H=2834:00 +CPU= 19.177
  00:56:51 STEP 2835 H=2835:00 +CPU= 29.211
  00:57:10 STEP 2836 H=2836:00 +CPU= 19.203
  00:57:29 STEP 2837 H=2837:00 +CPU= 18.551
  00:58:00 STEP 2838 H=2838:00 +CPU= 29.674
  00:58:19 STEP 2839 H=2839:00 +CPU= 18.844
  00:58:39 STEP 2840 H=2840:00 +CPU= 19.249
  00:59:09 STEP 2841 H=2841:00 +CPU= 29.205
  00:59:28 STEP 2842 H=2842:00 +CPU= 19.106
  00:59:48 STEP 2843 H=2843:00 +CPU= 18.783
  01:00:44 STEP 2844 H=2844:00 +CPU= 32.995
Moving to projects directory: /data/slots/2/ICMGGhpi1+002844
Moving to projects directory: /data/slots/2/ICMSHhpi1+002844
Moving to projects directory: /data/slots/2/ICMUAhpi1+002844
  01:01:24 STEP 2845 H=2845:00 +CPU= 19.578
  01:02:04 STEP 2846 H=2846:00 +CPU= 20.043
  01:03:00 STEP 2847 H=2847:00 +CPU= 30.123
  01:03:36 STEP 2848 H=2848:00 +CPU= 19.927
  01:04:10 STEP 2849 H=2849:00 +CPU= 19.604
  01:04:41 STEP 2850 H=2850:00 +CPU= 29.722
  01:05:02 STEP 2851 H=2851:00 +CPU= 19.065
  01:05:22 STEP 2852 H=2852:00 +CPU= 19.257
  01:05:53 STEP 2853 H=2853:00 +CPU= 28.938
  01:06:13 STEP 2854 H=2854:00 +CPU= 19.031
  01:06:32 STEP 2855 H=2855:00 +CPU= 19.104
  01:07:22 STEP 2856 H=2856:00 +CPU= 34.848
Moving to projects directory: /data/slots/2/ICMGGhpi1+002856
Moving to projects directory: /data/slots/2/ICMSHhpi1+002856
Moving to projects directory: /data/slots/2/ICMUAhpi1+002856
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002832
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002832
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002832
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002844
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002844
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002844
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_118.zip
Uploading the intermediate file: upload_file_118.zip
  01:07:42 STEP 2857 H=2857:00 +CPU= 18.577
  01:08:02 STEP 2858 H=2858:00 +CPU= 19.123
  01:08:31 STEP 2859 H=2859:00 +CPU= 29.098
  01:08:51 STEP 2860 H=2860:00 +CPU= 19.028
  01:09:11 STEP 2861 H=2861:00 +CPU= 19.005
  01:09:41 STEP 2862 H=2862:00 +CPU= 29.698
  01:10:01 STEP 2863 H=2863:00 +CPU= 18.648
  01:10:20 STEP 2864 H=2864:00 +CPU= 19.326
  01:10:50 STEP 2865 H=2865:00 +CPU= 29.037
  01:11:11 STEP 2866 H=2866:00 +CPU= 19.318
  01:11:30 STEP 2867 H=2867:00 +CPU= 18.625
  01:12:04 STEP 2868 H=2868:00 +CPU= 32.163
Moving to projects directory: /data/slots/2/ICMGGhpi1+002868
Moving to projects directory: /data/slots/2/ICMSHhpi1+002868
Moving to projects directory: /data/slots/2/ICMUAhpi1+002868
  01:12:23 STEP 2869 H=2869:00 +CPU= 18.802
  01:12:43 STEP 2870 H=2870:00 +CPU= 18.972
  01:13:14 STEP 2871 H=2871:00 +CPU= 29.199
  01:13:33 STEP 2872 H=2872:00 +CPU= 19.174
  01:13:53 STEP 2873 H=2873:00 +CPU= 18.678
  01:14:24 STEP 2874 H=2874:00 +CPU= 30.141
  01:14:43 STEP 2875 H=2875:00 +CPU= 18.728
  01:15:03 STEP 2876 H=2876:00 +CPU= 19.089
  01:15:34 STEP 2877 H=2877:00 +CPU= 29.532
  01:15:54 STEP 2878 H=2878:00 +CPU= 19.479
  01:16:14 STEP 2879 H=2879:00 +CPU= 19.440
  01:16:51 STEP 2880 H=2880:00 +CPU= 34.849
Moving to projects directory: /data/slots/2/ICMGGhpi1+002880
Moving to projects directory: /data/slots/2/ICMSHhpi1+002880
Moving to projects directory: /data/slots/2/ICMUAhpi1+002880
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002856
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002856
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002856
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002868
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002868
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002868
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_119.zip
Uploading the intermediate file: upload_file_119.zip
  01:17:13 STEP 2881 H=2881:00 +CPU= 20.161
  01:17:32 STEP 2882 H=2882:00 +CPU= 19.344
  01:18:02 STEP 2883 H=2883:00 +CPU= 29.112
  01:18:23 STEP 2884 H=2884:00 +CPU= 19.444
  01:18:42 STEP 2885 H=2885:00 +CPU= 18.702
  01:19:13 STEP 2886 H=2886:00 +CPU= 29.700
  01:19:32 STEP 2887 H=2887:00 +CPU= 18.665
  01:19:52 STEP 2888 H=2888:00 +CPU= 19.016
  01:20:22 STEP 2889 H=2889:00 +CPU= 29.142
  01:20:42 STEP 2890 H=2890:00 +CPU= 19.153
  01:21:01 STEP 2891 H=2891:00 +CPU= 18.743
  01:21:35 STEP 2892 H=2892:00 +CPU= 32.074
Moving to projects directory: /data/slots/2/ICMGGhpi1+002892
Moving to projects directory: /data/slots/2/ICMSHhpi1+002892
Moving to projects directory: /data/slots/2/ICMUAhpi1+002892
  01:21:55 STEP 2893 H=2893:00 +CPU= 18.674
  01:22:15 STEP 2894 H=2894:00 +CPU= 19.214
  01:22:45 STEP 2895 H=2895:00 +CPU= 28.925
  01:23:05 STEP 2896 H=2896:00 +CPU= 19.248
  01:23:25 STEP 2897 H=2897:00 +CPU= 18.760
  01:23:56 STEP 2898 H=2898:00 +CPU= 29.583
  01:24:16 STEP 2899 H=2899:00 +CPU= 18.755
  01:24:36 STEP 2900 H=2900:00 +CPU= 19.158
  01:25:07 STEP 2901 H=2901:00 +CPU= 29.314
  01:25:28 STEP 2902 H=2902:00 +CPU= 19.131
  01:25:48 STEP 2903 H=2903:00 +CPU= 19.148
  01:26:27 STEP 2904 H=2904:00 +CPU= 35.137
Moving to projects directory: /data/slots/2/ICMGGhpi1+002904
Moving to projects directory: /data/slots/2/ICMSHhpi1+002904
Moving to projects directory: /data/slots/2/ICMUAhpi1+002904
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002880
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002880
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002880
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002892
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002892
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002892
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_120.zip
Uploading the intermediate file: upload_file_120.zip
  01:26:46 STEP 2905 H=2905:00 +CPU= 18.611
  01:27:06 STEP 2906 H=2906:00 +CPU= 19.248
  01:27:37 STEP 2907 H=2907:00 +CPU= 29.169
  01:27:56 STEP 2908 H=2908:00 +CPU= 19.015
  01:28:15 STEP 2909 H=2909:00 +CPU= 18.703
  01:28:46 STEP 2910 H=2910:00 +CPU= 29.727
  01:29:06 STEP 2911 H=2911:00 +CPU= 18.860
  01:29:26 STEP 2912 H=2912:00 +CPU= 19.130
  01:29:56 STEP 2913 H=2913:00 +CPU= 29.033
  01:30:30 STEP 2914 H=2914:00 +CPU= 19.740
  01:31:08 STEP 2915 H=2915:00 +CPU= 19.489
  01:32:14 STEP 2916 H=2916:00 +CPU= 33.507
Moving to projects directory: /data/slots/2/ICMGGhpi1+002916
Moving to projects directory: /data/slots/2/ICMSHhpi1+002916
Moving to projects directory: /data/slots/2/ICMUAhpi1+002916
  01:32:51 STEP 2917 H=2917:00 +CPU= 19.466
  01:33:28 STEP 2918 H=2918:00 +CPU= 19.930
  01:34:16 STEP 2919 H=2919:00 +CPU= 29.775
  01:34:36 STEP 2920 H=2920:00 +CPU= 19.165
  01:34:55 STEP 2921 H=2921:00 +CPU= 18.474
  01:35:26 STEP 2922 H=2922:00 +CPU= 29.928
  01:35:45 STEP 2923 H=2923:00 +CPU= 18.652
  01:36:04 STEP 2924 H=2924:00 +CPU= 19.112
  01:36:35 STEP 2925 H=2925:00 +CPU= 29.123
  01:36:54 STEP 2926 H=2926:00 +CPU= 18.980
  01:37:14 STEP 2927 H=2927:00 +CPU= 19.410
  01:38:03 STEP 2928 H=2928:00 +CPU= 35.001
Moving to projects directory: /data/slots/2/ICMGGhpi1+002928
Moving to projects directory: /data/slots/2/ICMSHhpi1+002928
Moving to projects directory: /data/slots/2/ICMUAhpi1+002928
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002904
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002904
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002904
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002916
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002916
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002916
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_121.zip
Uploading the intermediate file: upload_file_121.zip
  01:38:23 STEP 2929 H=2929:00 +CPU= 18.782
  01:38:43 STEP 2930 H=2930:00 +CPU= 19.143
  01:39:13 STEP 2931 H=2931:00 +CPU= 29.374
  01:39:33 STEP 2932 H=2932:00 +CPU= 19.105
  01:39:52 STEP 2933 H=2933:00 +CPU= 18.685
  01:40:22 STEP 2934 H=2934:00 +CPU= 29.420
  01:40:42 STEP 2935 H=2935:00 +CPU= 18.760
  01:41:02 STEP 2936 H=2936:00 +CPU= 19.218
  01:41:32 STEP 2937 H=2937:00 +CPU= 29.054
  01:41:54 STEP 2938 H=2938:00 +CPU= 19.226
  01:42:13 STEP 2939 H=2939:00 +CPU= 18.698
  01:42:48 STEP 2940 H=2940:00 +CPU= 32.011
Moving to projects directory: /data/slots/2/ICMGGhpi1+002940
Moving to projects directory: /data/slots/2/ICMSHhpi1+002940
Moving to projects directory: /data/slots/2/ICMUAhpi1+002940
  01:43:08 STEP 2941 H=2941:00 +CPU= 18.731
  01:43:29 STEP 2942 H=2942:00 +CPU= 19.253
  01:44:00 STEP 2943 H=2943:00 +CPU= 29.030
  01:44:21 STEP 2944 H=2944:00 +CPU= 19.226
  01:44:41 STEP 2945 H=2945:00 +CPU= 18.511
  01:45:13 STEP 2946 H=2946:00 +CPU= 30.094
  01:45:34 STEP 2947 H=2947:00 +CPU= 18.945
  01:45:54 STEP 2948 H=2948:00 +CPU= 19.007
  01:46:24 STEP 2949 H=2949:00 +CPU= 29.259
  01:46:45 STEP 2950 H=2950:00 +CPU= 19.016
  01:47:05 STEP 2951 H=2951:00 +CPU= 19.141
  01:47:40 STEP 2952 H=2952:00 +CPU= 33.214
The child process terminated with status: 0
Moving to projects directory: /data/slots/2/ICMGGhpi1+002952
Moving to projects directory: /data/slots/2/ICMSHhpi1+002952
Moving to projects directory: /data/slots/2/ICMUAhpi1+002952
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002940
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002928
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002940
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002952
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMSHhpi1+002952
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002952
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMUAhpi1+002928
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002928
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12165949/ICMGGhpi1+002940
Zipping up the final file: /data/projects/climateprediction.net/oifs_43r3_ps_2860_2021050100_123_947_12165949_1_r35811017_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
01:51:05 (116): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:44:34 1504164 22250769 oifs_43r3_ps_2860_2021050100_123_947_12165949_1 10,623,600 70,199 0.0066
09 May 2023 15:44:33 1504164 22250769 oifs_43r3_ps_2860_2021050100_123_947_12165949_1 9,849,600 65,135 0.0066
09 May 2023 15:44:31 1504164 22250769 oifs_43r3_ps_2860_2021050100_123_947_12165949_1 8,985,600 59,294 0.0066
09 May 2023 15:44:30 1504164 22250769 oifs_43r3_ps_2860_2021050100_123_947_12165949_1 8,121,600 53,812 0.0066
09 May 2023 15:44:26 1504164 22250769 oifs_43r3_ps_2860_2021050100_123_947_12165949_1 6,912,000 45,730 0.0066
09 May 2023 15:44:24 1504164 22250769 oifs_43r3_ps_2860_2021050100_123_947_12165949_1 6,048,000 38,894 0.0064
09 May 2023 15:44:23 1504164 22250769 oifs_43r3_ps_2860_2021050100_123_947_12165949_1 5,184,000 32,665 0.0063
09 May 2023 15:44:22 1504164 22250769 oifs_43r3_ps_2860_2021050100_123_947_12165949_1 4,320,000 27,298 0.0063
09 May 2023 15:44:20 1504164 22250769 oifs_43r3_ps_2860_2021050100_123_947_12165949_1 3,456,000 21,933 0.0063
09 May 2023 15:44:19 1504164 22250769 oifs_43r3_ps_2860_2021050100_123_947_12165949_1 2,592,000 16,518 0.0064
09 May 2023 15:44:17 1504164 22250769 oifs_43r3_ps_2860_2021050100_123_947_12165949_1 1,728,000 10,869 0.0063
09 May 2023 15:44:15 1504164 22250769 oifs_43r3_ps_2860_2021050100_123_947_12165949_1 864,000 5,439 0.0063


©2024 cpdn.org