climateprediction.net home page
Task 22268770

Task 22268770

Name oifs_43r3_ps_0358_1985050100_123_954_12171002_1
Workunit 12171002
Created 22 Dec 2022, 14:53:16 UTC
Sent 23 Jan 2023, 4:15:17 UTC
Report deadline 24 Mar 2023, 4:15:17 UTC
Received 26 Jan 2023, 1:23:28 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1517859
Run time 18 hours 22 min 25 sec
CPU time 18 hours 22 min 25 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 7.57 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,775.52 MB
Peak swap size 4,974.26 MB
Peak disk usage 2,952.15 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
he zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002268
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_94.zip
Uploading the intermediate file: upload_file_94.zip
  23:02:32 STEP 2281 H=2281:00 +CPU= 18.364
  23:02:49 STEP 2282 H=2282:00 +CPU= 17.029
  23:03:15 STEP 2283 H=2283:00 +CPU= 25.596
  23:03:33 STEP 2284 H=2284:00 +CPU= 17.618
  23:03:49 STEP 2285 H=2285:00 +CPU= 16.221
  23:04:16 STEP 2286 H=2286:00 +CPU= 26.266
  23:04:33 STEP 2287 H=2287:00 +CPU= 16.575
  23:04:50 STEP 2288 H=2288:00 +CPU= 16.912
  23:05:17 STEP 2289 H=2289:00 +CPU= 26.801
  23:05:35 STEP 2290 H=2290:00 +CPU= 17.605
  23:05:53 STEP 2291 H=2291:00 +CPU= 17.212
  23:06:25 STEP 2292 H=2292:00 +CPU= 31.586
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002292
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002292
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002292
  23:06:42 STEP 2293 H=2293:00 +CPU= 16.389
  23:07:00 STEP 2294 H=2294:00 +CPU= 18.341
  23:07:27 STEP 2295 H=2295:00 +CPU= 26.490
  23:07:45 STEP 2296 H=2296:00 +CPU= 17.247
  23:08:03 STEP 2297 H=2297:00 +CPU= 17.552
  23:08:30 STEP 2298 H=2298:00 +CPU= 27.096
  23:08:48 STEP 2299 H=2299:00 +CPU= 17.932
  23:09:16 STEP 2300 H=2300:00 +CPU= 27.326
  23:09:43 STEP 2301 H=2301:00 +CPU= 27.040
  23:10:02 STEP 2302 H=2302:00 +CPU= 17.880
  23:10:20 STEP 2303 H=2303:00 +CPU= 17.740
  23:10:51 STEP 2304 H=2304:00 +CPU= 30.590
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002304
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002304
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002304
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002280
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002280
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002280
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002292
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002292
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002292
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_95.zip
Uploading the intermediate file: upload_file_95.zip
  23:11:08 STEP 2305 H=2305:00 +CPU= 16.817
  23:11:26 STEP 2306 H=2306:00 +CPU= 17.944
  23:11:53 STEP 2307 H=2307:00 +CPU= 26.521
  23:12:11 STEP 2308 H=2308:00 +CPU= 17.202
  23:12:28 STEP 2309 H=2309:00 +CPU= 16.860
  23:12:56 STEP 2310 H=2310:00 +CPU= 28.181
  23:13:21 STEP 2311 H=2311:00 +CPU= 24.848
  23:13:39 STEP 2312 H=2312:00 +CPU= 17.488
  23:14:06 STEP 2313 H=2313:00 +CPU= 26.310
  23:14:24 STEP 2314 H=2314:00 +CPU= 17.389
  23:14:40 STEP 2315 H=2315:00 +CPU= 16.285
  23:15:10 STEP 2316 H=2316:00 +CPU= 29.134
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002316
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002316
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002316
  23:15:27 STEP 2317 H=2317:00 +CPU= 16.664
  23:15:45 STEP 2318 H=2318:00 +CPU= 17.646
  23:16:11 STEP 2319 H=2319:00 +CPU= 25.614
  23:16:27 STEP 2320 H=2320:00 +CPU= 16.588
  23:16:44 STEP 2321 H=2321:00 +CPU= 16.621
  23:17:12 STEP 2322 H=2322:00 +CPU= 26.973
  23:17:40 STEP 2323 H=2323:00 +CPU= 27.456
  23:17:58 STEP 2324 H=2324:00 +CPU= 18.069
  23:18:25 STEP 2325 H=2325:00 +CPU= 26.285
  23:18:43 STEP 2326 H=2326:00 +CPU= 17.450
  23:19:01 STEP 2327 H=2327:00 +CPU= 18.469
  23:19:33 STEP 2328 H=2328:00 +CPU= 30.889
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002328
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002328
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002328
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002304
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002304
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002304
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002316
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002316
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002316
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_96.zip
Uploading the intermediate file: upload_file_96.zip
  23:19:49 STEP 2329 H=2329:00 +CPU= 15.574
  23:20:07 STEP 2330 H=2330:00 +CPU= 18.356
  23:20:48 STEP 2331 H=2331:00 +CPU= 40.153
  23:21:05 STEP 2332 H=2332:00 +CPU= 17.021
  23:21:22 STEP 2333 H=2333:00 +CPU= 16.342
  23:21:49 STEP 2334 H=2334:00 +CPU= 26.491
  23:22:06 STEP 2335 H=2335:00 +CPU= 17.141
  23:22:25 STEP 2336 H=2336:00 +CPU= 18.109
  23:22:52 STEP 2337 H=2337:00 +CPU= 26.527
  23:23:10 STEP 2338 H=2338:00 +CPU= 17.042
  23:23:26 STEP 2339 H=2339:00 +CPU= 16.282
  23:23:56 STEP 2340 H=2340:00 +CPU= 29.421
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002340
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002340
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002340
  23:24:13 STEP 2341 H=2341:00 +CPU= 16.399
  23:24:31 STEP 2342 H=2342:00 +CPU= 18.011
  23:24:58 STEP 2343 H=2343:00 +CPU= 26.625
  23:25:16 STEP 2344 H=2344:00 +CPU= 17.500
  23:25:33 STEP 2345 H=2345:00 +CPU= 16.561
  23:26:15 STEP 2346 H=2346:00 +CPU= 41.923
  23:26:32 STEP 2347 H=2347:00 +CPU= 16.460
  23:26:49 STEP 2348 H=2348:00 +CPU= 16.722
  23:27:15 STEP 2349 H=2349:00 +CPU= 25.953
  23:27:33 STEP 2350 H=2350:00 +CPU= 17.562
  23:27:50 STEP 2351 H=2351:00 +CPU= 17.156
  23:28:24 STEP 2352 H=2352:00 +CPU= 32.503
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002352
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002352
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002352
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002328
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002328
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002328
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002340
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002340
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002340
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_97.zip
Uploading the intermediate file: upload_file_97.zip
  23:28:42 STEP 2353 H=2353:00 +CPU= 17.717
  23:29:00 STEP 2354 H=2354:00 +CPU= 17.677
  23:29:27 STEP 2355 H=2355:00 +CPU= 26.703
  23:29:45 STEP 2356 H=2356:00 +CPU= 18.316
  23:30:03 STEP 2357 H=2357:00 +CPU= 17.026
  23:30:29 STEP 2358 H=2358:00 +CPU= 26.546
  23:30:47 STEP 2359 H=2359:00 +CPU= 17.244
  23:31:06 STEP 2360 H=2360:00 +CPU= 17.992
  23:31:32 STEP 2361 H=2361:00 +CPU= 25.582
  23:31:49 STEP 2362 H=2362:00 +CPU= 17.039
  23:32:07 STEP 2363 H=2363:00 +CPU= 17.537
  23:32:37 STEP 2364 H=2364:00 +CPU= 29.167
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002364
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002364
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002364
  23:32:53 STEP 2365 H=2365:00 +CPU= 16.334
  23:33:12 STEP 2366 H=2366:00 +CPU= 18.033
  23:33:39 STEP 2367 H=2367:00 +CPU= 26.350
  23:33:56 STEP 2368 H=2368:00 +CPU= 17.394
  23:34:13 STEP 2369 H=2369:00 +CPU= 16.351
  23:34:40 STEP 2370 H=2370:00 +CPU= 26.821
  23:34:58 STEP 2371 H=2371:00 +CPU= 17.284
  23:35:15 STEP 2372 H=2372:00 +CPU= 16.930
  23:35:42 STEP 2373 H=2373:00 +CPU= 26.127
  23:35:59 STEP 2374 H=2374:00 +CPU= 17.003
  23:36:16 STEP 2375 H=2375:00 +CPU= 16.929
  23:36:48 STEP 2376 H=2376:00 +CPU= 31.605
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002376
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002376
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002376
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002352
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002352
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002352
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002364
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002364
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002364
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_98.zip
Uploading the intermediate file: upload_file_98.zip
  23:37:05 STEP 2377 H=2377:00 +CPU= 16.151
  23:37:31 STEP 2378 H=2378:00 +CPU= 25.965
  23:38:07 STEP 2379 H=2379:00 +CPU= 34.910
  23:38:25 STEP 2380 H=2380:00 +CPU= 17.746
  23:38:42 STEP 2381 H=2381:00 +CPU= 17.123
  23:39:09 STEP 2382 H=2382:00 +CPU= 26.351
  23:39:25 STEP 2383 H=2383:00 +CPU= 15.940
  23:39:44 STEP 2384 H=2384:00 +CPU= 18.366
  23:40:11 STEP 2385 H=2385:00 +CPU= 26.459
  23:40:29 STEP 2386 H=2386:00 +CPU= 17.755
  23:40:46 STEP 2387 H=2387:00 +CPU= 16.673
  23:41:16 STEP 2388 H=2388:00 +CPU= 29.041
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002388
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002388
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002388
  23:41:33 STEP 2389 H=2389:00 +CPU= 17.066
  23:41:50 STEP 2390 H=2390:00 +CPU= 17.057
  23:42:19 STEP 2391 H=2391:00 +CPU= 27.723
  23:42:36 STEP 2392 H=2392:00 +CPU= 17.382
  23:42:54 STEP 2393 H=2393:00 +CPU= 17.615
  23:43:21 STEP 2394 H=2394:00 +CPU= 26.841
  23:43:40 STEP 2395 H=2395:00 +CPU= 17.995
  23:43:58 STEP 2396 H=2396:00 +CPU= 17.668
  23:44:25 STEP 2397 H=2397:00 +CPU= 26.874
  23:44:43 STEP 2398 H=2398:00 +CPU= 17.866
  23:45:00 STEP 2399 H=2399:00 +CPU= 16.665
  23:45:32 STEP 2400 H=2400:00 +CPU= 30.971
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002400
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002400
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002400
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002376
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002376
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002376
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002388
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002388
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002388
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_99.zip
Uploading the intermediate file: upload_file_99.zip
  23:45:49 STEP 2401 H=2401:00 +CPU= 17.511
Uploading trickle at timestep: 8640000
  23:46:07 STEP 2402 H=2402:00 +CPU= 17.562
  23:46:33 STEP 2403 H=2403:00 +CPU= 25.184
  23:46:50 STEP 2404 H=2404:00 +CPU= 16.810
  23:47:06 STEP 2405 H=2405:00 +CPU= 16.001
  23:47:33 STEP 2406 H=2406:00 +CPU= 26.333
  23:47:50 STEP 2407 H=2407:00 +CPU= 17.219
  23:48:09 STEP 2408 H=2408:00 +CPU= 17.981
  23:48:35 STEP 2409 H=2409:00 +CPU= 25.952
  23:48:54 STEP 2410 H=2410:00 +CPU= 18.445
  23:49:11 STEP 2411 H=2411:00 +CPU= 16.193
  23:49:38 STEP 2412 H=2412:00 +CPU= 27.421
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002412
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002412
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002412
  23:49:56 STEP 2413 H=2413:00 +CPU= 17.696
  23:50:15 STEP 2414 H=2414:00 +CPU= 18.085
  23:50:41 STEP 2415 H=2415:00 +CPU= 25.574
  23:50:57 STEP 2416 H=2416:00 +CPU= 16.161
  23:51:14 STEP 2417 H=2417:00 +CPU= 15.906
  23:51:46 STEP 2418 H=2418:00 +CPU= 31.775
  23:52:03 STEP 2419 H=2419:00 +CPU= 16.942
  23:52:19 STEP 2420 H=2420:00 +CPU= 15.998
  23:52:45 STEP 2421 H=2421:00 +CPU= 25.421
  23:53:01 STEP 2422 H=2422:00 +CPU= 14.895
  23:53:17 STEP 2423 H=2423:00 +CPU= 15.991
  23:53:48 STEP 2424 H=2424:00 +CPU= 30.877
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002424
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002424
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002424
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002400
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002400
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002400
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002412
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002412
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002412
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_100.zip
Uploading the intermediate file: upload_file_100.zip
  23:54:05 STEP 2425 H=2425:00 +CPU= 15.732
  23:54:21 STEP 2426 H=2426:00 +CPU= 16.430
  23:54:48 STEP 2427 H=2427:00 +CPU= 25.986
  23:55:05 STEP 2428 H=2428:00 +CPU= 16.755
  23:55:21 STEP 2429 H=2429:00 +CPU= 15.960
  23:55:47 STEP 2430 H=2430:00 +CPU= 25.447
  23:56:03 STEP 2431 H=2431:00 +CPU= 16.174
  23:56:20 STEP 2432 H=2432:00 +CPU= 16.942
  23:56:47 STEP 2433 H=2433:00 +CPU= 26.002
  23:57:04 STEP 2434 H=2434:00 +CPU= 17.036
  23:57:21 STEP 2435 H=2435:00 +CPU= 16.362
  23:57:52 STEP 2436 H=2436:00 +CPU= 30.143
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002436
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002436
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002436
  23:58:09 STEP 2437 H=2437:00 +CPU= 17.253
  23:58:34 STEP 2438 H=2438:00 +CPU= 24.596
  23:59:00 STEP 2439 H=2439:00 +CPU= 26.167
  23:59:18 STEP 2440 H=2440:00 +CPU= 17.395
  23:59:35 STEP 2441 H=2441:00 +CPU= 16.794
  00:00:02 STEP 2442 H=2442:00 +CPU= 27.058
  00:00:19 STEP 2443 H=2443:00 +CPU= 15.931
  00:00:36 STEP 2444 H=2444:00 +CPU= 16.656
  00:01:03 STEP 2445 H=2445:00 +CPU= 26.697
  00:01:22 STEP 2446 H=2446:00 +CPU= 18.960
  00:01:45 STEP 2447 H=2447:00 +CPU= 22.100
  00:02:18 STEP 2448 H=2448:00 +CPU= 32.987
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002448
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002448
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002448
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002424
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002424
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002424
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002436
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002436
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002436
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_101.zip
Uploading the intermediate file: upload_file_101.zip
  00:02:35 STEP 2449 H=2449:00 +CPU= 17.036
  00:02:53 STEP 2450 H=2450:00 +CPU= 17.800
  00:03:20 STEP 2451 H=2451:00 +CPU= 26.386
  00:03:40 STEP 2452 H=2452:00 +CPU= 19.319
  00:03:57 STEP 2453 H=2453:00 +CPU= 16.677
  00:04:24 STEP 2454 H=2454:00 +CPU= 26.664
  00:04:57 STEP 2455 H=2455:00 +CPU= 33.181
  00:05:16 STEP 2456 H=2456:00 +CPU= 18.411
  00:05:44 STEP 2457 H=2457:00 +CPU= 26.942
  00:06:01 STEP 2458 H=2458:00 +CPU= 16.672
  00:06:19 STEP 2459 H=2459:00 +CPU= 17.564
  00:06:50 STEP 2460 H=2460:00 +CPU= 30.207
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002460
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002460
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002460
  00:07:07 STEP 2461 H=2461:00 +CPU= 17.247
  00:07:25 STEP 2462 H=2462:00 +CPU= 18.104
  00:07:53 STEP 2463 H=2463:00 +CPU= 27.153
  00:08:11 STEP 2464 H=2464:00 +CPU= 17.503
  00:08:29 STEP 2465 H=2465:00 +CPU= 18.090
  00:08:58 STEP 2466 H=2466:00 +CPU= 27.854
  00:09:28 STEP 2467 H=2467:00 +CPU= 30.163
  00:09:47 STEP 2468 H=2468:00 +CPU= 18.658
  00:10:17 STEP 2469 H=2469:00 +CPU= 28.949
  00:10:54 STEP 2470 H=2470:00 +CPU= 36.862
  00:11:13 STEP 2471 H=2471:00 +CPU= 18.832
  00:11:44 STEP 2472 H=2472:00 +CPU= 30.630
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002472
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002472
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002472
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002448
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002448
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002448
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002460
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002460
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002460
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_102.zip
Uploading the intermediate file: upload_file_102.zip
  00:12:03 STEP 2473 H=2473:00 +CPU= 17.752
  00:12:21 STEP 2474 H=2474:00 +CPU= 17.821
  00:12:49 STEP 2475 H=2475:00 +CPU= 28.033
  00:13:08 STEP 2476 H=2476:00 +CPU= 18.329
  00:13:26 STEP 2477 H=2477:00 +CPU= 18.076
  00:13:56 STEP 2478 H=2478:00 +CPU= 29.657
  00:14:14 STEP 2479 H=2479:00 +CPU= 17.781
  00:14:39 STEP 2480 H=2480:00 +CPU= 23.872
  00:15:05 STEP 2481 H=2481:00 +CPU= 25.669
  00:15:24 STEP 2482 H=2482:00 +CPU= 17.918
  00:16:00 STEP 2483 H=2483:00 +CPU= 35.414
  00:16:30 STEP 2484 H=2484:00 +CPU= 29.525
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002484
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002484
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002484
  00:16:46 STEP 2485 H=2485:00 +CPU= 15.883
  00:17:03 STEP 2486 H=2486:00 +CPU= 17.140
  00:17:30 STEP 2487 H=2487:00 +CPU= 26.624
  00:17:48 STEP 2488 H=2488:00 +CPU= 17.175
  00:18:05 STEP 2489 H=2489:00 +CPU= 16.804
  00:18:33 STEP 2490 H=2490:00 +CPU= 27.407
  00:18:50 STEP 2491 H=2491:00 +CPU= 16.691
  00:19:08 STEP 2492 H=2492:00 +CPU= 17.654
  00:19:35 STEP 2493 H=2493:00 +CPU= 26.397
  00:19:54 STEP 2494 H=2494:00 +CPU= 18.892
  00:20:12 STEP 2495 H=2495:00 +CPU= 17.584
  00:20:43 STEP 2496 H=2496:00 +CPU= 30.450
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002496
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002496
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002496
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002472
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002472
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002472
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002484
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002484
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002484
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_103.zip
Uploading the intermediate file: upload_file_103.zip
  00:21:00 STEP 2497 H=2497:00 +CPU= 16.531
  00:21:17 STEP 2498 H=2498:00 +CPU= 16.873
  00:21:44 STEP 2499 H=2499:00 +CPU= 26.815
  00:22:02 STEP 2500 H=2500:00 +CPU= 17.788
  00:22:19 STEP 2501 H=2501:00 +CPU= 16.515
  00:22:58 STEP 2502 H=2502:00 +CPU= 38.574
  00:23:15 STEP 2503 H=2503:00 +CPU= 16.890
  00:23:33 STEP 2504 H=2504:00 +CPU= 17.499
  00:24:01 STEP 2505 H=2505:00 +CPU= 27.227
  00:24:20 STEP 2506 H=2506:00 +CPU= 18.068
  00:24:36 STEP 2507 H=2507:00 +CPU= 16.414
  00:25:07 STEP 2508 H=2508:00 +CPU= 30.382
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002508
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002508
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002508
  00:25:24 STEP 2509 H=2509:00 +CPU= 16.664
  00:25:41 STEP 2510 H=2510:00 +CPU= 17.216
  00:26:10 STEP 2511 H=2511:00 +CPU= 27.901
  00:26:28 STEP 2512 H=2512:00 +CPU= 17.833
  00:26:44 STEP 2513 H=2513:00 +CPU= 15.686
  00:27:11 STEP 2514 H=2514:00 +CPU= 26.897
  00:27:29 STEP 2515 H=2515:00 +CPU= 17.745
  00:27:47 STEP 2516 H=2516:00 +CPU= 17.627
  00:28:14 STEP 2517 H=2517:00 +CPU= 26.420
  00:28:32 STEP 2518 H=2518:00 +CPU= 17.865
  00:28:49 STEP 2519 H=2519:00 +CPU= 16.969
  00:29:22 STEP 2520 H=2520:00 +CPU= 32.641
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002520
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002520
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002520
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002496
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002496
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002496
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002508
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002508
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002508
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_104.zip
Uploading the intermediate file: upload_file_104.zip
  00:29:41 STEP 2521 H=2521:00 +CPU= 17.711
  00:29:59 STEP 2522 H=2522:00 +CPU= 18.718
  00:30:27 STEP 2523 H=2523:00 +CPU= 26.625
  00:30:44 STEP 2524 H=2524:00 +CPU= 17.501
  00:31:04 STEP 2525 H=2525:00 +CPU= 19.145
  00:31:31 STEP 2526 H=2526:00 +CPU= 26.759
  00:31:49 STEP 2527 H=2527:00 +CPU= 17.412
  00:32:08 STEP 2528 H=2528:00 +CPU= 18.984
  00:32:36 STEP 2529 H=2529:00 +CPU= 27.573
  00:33:03 STEP 2530 H=2530:00 +CPU= 26.861
  00:33:22 STEP 2531 H=2531:00 +CPU= 18.249
  00:33:52 STEP 2532 H=2532:00 +CPU= 29.517
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002532
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002532
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002532
  00:34:10 STEP 2533 H=2533:00 +CPU= 17.907
  00:34:28 STEP 2534 H=2534:00 +CPU= 17.035
  00:35:00 STEP 2535 H=2535:00 +CPU= 31.878
  00:35:17 STEP 2536 H=2536:00 +CPU= 17.069
  00:35:35 STEP 2537 H=2537:00 +CPU= 17.209
  00:36:01 STEP 2538 H=2538:00 +CPU= 25.817
  00:36:19 STEP 2539 H=2539:00 +CPU= 18.003
  00:36:38 STEP 2540 H=2540:00 +CPU= 17.972
  00:37:05 STEP 2541 H=2541:00 +CPU= 26.599
  00:37:22 STEP 2542 H=2542:00 +CPU= 16.948
  00:37:41 STEP 2543 H=2543:00 +CPU= 18.109
  00:38:13 STEP 2544 H=2544:00 +CPU= 31.865
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002544
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002544
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002544
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002520
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002520
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002520
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002532
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002532
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002532
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_105.zip
Uploading the intermediate file: upload_file_105.zip
  00:38:31 STEP 2545 H=2545:00 +CPU= 16.886
  00:38:49 STEP 2546 H=2546:00 +CPU= 17.801
  00:39:16 STEP 2547 H=2547:00 +CPU= 26.437
  00:39:43 STEP 2548 H=2548:00 +CPU= 27.403
  00:40:01 STEP 2549 H=2549:00 +CPU= 17.623
  00:40:29 STEP 2550 H=2550:00 +CPU= 27.568
  00:40:45 STEP 2551 H=2551:00 +CPU= 15.820
  00:41:04 STEP 2552 H=2552:00 +CPU= 17.967
  00:41:34 STEP 2553 H=2553:00 +CPU= 29.865
  00:41:51 STEP 2554 H=2554:00 +CPU= 16.624
  00:42:10 STEP 2555 H=2555:00 +CPU= 17.778
  00:42:42 STEP 2556 H=2556:00 +CPU= 32.101
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002556
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002556
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002556
  00:43:01 STEP 2557 H=2557:00 +CPU= 18.128
  00:43:20 STEP 2558 H=2558:00 +CPU= 19.565
  00:43:51 STEP 2559 H=2559:00 +CPU= 29.825
  00:44:10 STEP 2560 H=2560:00 +CPU= 18.721
  00:44:27 STEP 2561 H=2561:00 +CPU= 16.498
  00:44:57 STEP 2562 H=2562:00 +CPU= 28.577
  00:45:15 STEP 2563 H=2563:00 +CPU= 17.658
  00:45:37 STEP 2564 H=2564:00 +CPU= 22.263
  00:46:21 STEP 2565 H=2565:00 +CPU= 43.180
  00:46:39 STEP 2566 H=2566:00 +CPU= 18.148
  00:46:58 STEP 2567 H=2567:00 +CPU= 17.889
  00:47:32 STEP 2568 H=2568:00 +CPU= 33.925
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002568
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002568
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002568
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002544
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002544
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002544
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002556
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002556
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002556
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_106.zip
Uploading the intermediate file: upload_file_106.zip
  00:47:49 STEP 2569 H=2569:00 +CPU= 16.885
  00:48:08 STEP 2570 H=2570:00 +CPU= 18.614
  00:48:35 STEP 2571 H=2571:00 +CPU= 26.576
  00:48:52 STEP 2572 H=2572:00 +CPU= 16.918
  00:49:09 STEP 2573 H=2573:00 +CPU= 16.698
  00:49:38 STEP 2574 H=2574:00 +CPU= 27.946
  00:49:54 STEP 2575 H=2575:00 +CPU= 16.513
  00:50:14 STEP 2576 H=2576:00 +CPU= 19.032
  00:50:41 STEP 2577 H=2577:00 +CPU= 26.283
  00:51:00 STEP 2578 H=2578:00 +CPU= 18.628
  00:51:17 STEP 2579 H=2579:00 +CPU= 16.658
  00:51:48 STEP 2580 H=2580:00 +CPU= 30.775
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002580
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002580
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002580
  00:52:06 STEP 2581 H=2581:00 +CPU= 17.317
  00:52:24 STEP 2582 H=2582:00 +CPU= 18.441
  00:52:52 STEP 2583 H=2583:00 +CPU= 27.001
  00:53:09 STEP 2584 H=2584:00 +CPU= 16.736
  00:53:26 STEP 2585 H=2585:00 +CPU= 16.852
  00:53:53 STEP 2586 H=2586:00 +CPU= 26.834
  00:54:10 STEP 2587 H=2587:00 +CPU= 16.824
  00:54:29 STEP 2588 H=2588:00 +CPU= 18.455
  00:54:54 STEP 2589 H=2589:00 +CPU= 24.729
  00:55:12 STEP 2590 H=2590:00 +CPU= 17.591
  00:55:30 STEP 2591 H=2591:00 +CPU= 17.959
  00:56:03 STEP 2592 H=2592:00 +CPU= 31.697
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002592
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002592
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002592
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002568
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002568
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002568
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002580
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002580
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002580
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_107.zip
Uploading the intermediate file: upload_file_107.zip
  00:56:20 STEP 2593 H=2593:00 +CPU= 16.630
  00:56:38 STEP 2594 H=2594:00 +CPU= 17.703
  00:57:05 STEP 2595 H=2595:00 +CPU= 27.022
  00:57:23 STEP 2596 H=2596:00 +CPU= 17.128
  00:57:46 STEP 2597 H=2597:00 +CPU= 22.679
  00:58:14 STEP 2598 H=2598:00 +CPU= 28.157
  00:58:32 STEP 2599 H=2599:00 +CPU= 17.310
  00:58:50 STEP 2600 H=2600:00 +CPU= 17.401
  00:59:16 STEP 2601 H=2601:00 +CPU= 26.036
  00:59:32 STEP 2602 H=2602:00 +CPU= 16.174
  00:59:48 STEP 2603 H=2603:00 +CPU= 15.785
  01:00:15 STEP 2604 H=2604:00 +CPU= 27.663
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002604
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002604
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002604
  01:00:33 STEP 2605 H=2605:00 +CPU= 17.058
  01:00:48 STEP 2606 H=2606:00 +CPU= 15.427
  01:01:13 STEP 2607 H=2607:00 +CPU= 24.764
  01:01:29 STEP 2608 H=2608:00 +CPU= 16.464
  01:01:44 STEP 2609 H=2609:00 +CPU= 14.693
  01:02:10 STEP 2610 H=2610:00 +CPU= 25.911
  01:02:26 STEP 2611 H=2611:00 +CPU= 16.057
  01:02:43 STEP 2612 H=2612:00 +CPU= 16.706
  01:03:07 STEP 2613 H=2613:00 +CPU= 24.133
  01:03:24 STEP 2614 H=2614:00 +CPU= 16.253
  01:03:39 STEP 2615 H=2615:00 +CPU= 15.449
  01:04:09 STEP 2616 H=2616:00 +CPU= 30.063
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002616
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002616
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002616
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002592
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002592
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002592
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002604
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002604
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002604
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_108.zip
Uploading the intermediate file: upload_file_108.zip
  01:04:25 STEP 2617 H=2617:00 +CPU= 15.593
  01:04:41 STEP 2618 H=2618:00 +CPU= 15.828
  01:05:05 STEP 2619 H=2619:00 +CPU= 24.679
  01:05:22 STEP 2620 H=2620:00 +CPU= 16.218
  01:05:37 STEP 2621 H=2621:00 +CPU= 15.829
  01:06:03 STEP 2622 H=2622:00 +CPU= 25.743
  01:06:19 STEP 2623 H=2623:00 +CPU= 16.184
  01:06:36 STEP 2624 H=2624:00 +CPU= 16.509
  01:07:00 STEP 2625 H=2625:00 +CPU= 23.848
  01:07:16 STEP 2626 H=2626:00 +CPU= 16.016
  01:07:32 STEP 2627 H=2627:00 +CPU= 16.361
  01:08:00 STEP 2628 H=2628:00 +CPU= 27.542
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002628
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002628
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002628
  01:08:15 STEP 2629 H=2629:00 +CPU= 15.407
  01:08:31 STEP 2630 H=2630:00 +CPU= 16.118
  01:08:57 STEP 2631 H=2631:00 +CPU= 25.648
  01:09:12 STEP 2632 H=2632:00 +CPU= 15.365
  01:09:29 STEP 2633 H=2633:00 +CPU= 16.837
  01:09:57 STEP 2634 H=2634:00 +CPU= 27.832
  01:10:13 STEP 2635 H=2635:00 +CPU= 15.776
  01:10:29 STEP 2636 H=2636:00 +CPU= 16.182
  01:10:54 STEP 2637 H=2637:00 +CPU= 24.829
  01:11:10 STEP 2638 H=2638:00 +CPU= 15.595
  01:11:26 STEP 2639 H=2639:00 +CPU= 16.606
  01:11:57 STEP 2640 H=2640:00 +CPU= 30.710
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002640
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002640
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002640
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002616
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002616
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002616
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002628
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002628
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002628
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_109.zip
Uploading the intermediate file: upload_file_109.zip
  01:12:13 STEP 2641 H=2641:00 +CPU= 16.345
Uploading trickle at timestep: 9504000
  01:12:30 STEP 2642 H=2642:00 +CPU= 16.769
  01:12:56 STEP 2643 H=2643:00 +CPU= 26.247
  01:13:13 STEP 2644 H=2644:00 +CPU= 16.686
  01:13:30 STEP 2645 H=2645:00 +CPU= 16.383
  01:13:56 STEP 2646 H=2646:00 +CPU= 26.587
  01:14:12 STEP 2647 H=2647:00 +CPU= 15.754
  01:14:29 STEP 2648 H=2648:00 +CPU= 16.984
  01:14:55 STEP 2649 H=2649:00 +CPU= 25.970
  01:15:11 STEP 2650 H=2650:00 +CPU= 16.262
  01:15:27 STEP 2651 H=2651:00 +CPU= 16.004
  01:15:56 STEP 2652 H=2652:00 +CPU= 28.825
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002652
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002652
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002652
  01:16:12 STEP 2653 H=2653:00 +CPU= 16.246
  01:16:28 STEP 2654 H=2654:00 +CPU= 15.694
  01:16:54 STEP 2655 H=2655:00 +CPU= 25.520
  01:17:09 STEP 2656 H=2656:00 +CPU= 15.525
  01:17:25 STEP 2657 H=2657:00 +CPU= 15.851
  01:17:52 STEP 2658 H=2658:00 +CPU= 26.397
  01:18:07 STEP 2659 H=2659:00 +CPU= 15.436
  01:18:23 STEP 2660 H=2660:00 +CPU= 16.422
  01:18:48 STEP 2661 H=2661:00 +CPU= 24.486
  01:19:04 STEP 2662 H=2662:00 +CPU= 15.734
  01:19:20 STEP 2663 H=2663:00 +CPU= 16.520
  01:19:50 STEP 2664 H=2664:00 +CPU= 29.393
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002664
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002664
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002664
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002640
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002640
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002640
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002652
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002652
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002652
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_110.zip
Uploading the intermediate file: upload_file_110.zip
  01:20:06 STEP 2665 H=2665:00 +CPU= 15.814
  01:20:21 STEP 2666 H=2666:00 +CPU= 15.869
  01:20:46 STEP 2667 H=2667:00 +CPU= 24.296
  01:21:01 STEP 2668 H=2668:00 +CPU= 15.624
  01:21:18 STEP 2669 H=2669:00 +CPU= 16.273
  01:21:43 STEP 2670 H=2670:00 +CPU= 25.784
  01:22:00 STEP 2671 H=2671:00 +CPU= 16.117
  01:22:16 STEP 2672 H=2672:00 +CPU= 16.406
  01:22:41 STEP 2673 H=2673:00 +CPU= 25.328
  01:22:58 STEP 2674 H=2674:00 +CPU= 16.637
  01:23:14 STEP 2675 H=2675:00 +CPU= 16.042
  01:23:41 STEP 2676 H=2676:00 +CPU= 27.148
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002676
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002676
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002676
  01:23:58 STEP 2677 H=2677:00 +CPU= 16.148
  01:24:14 STEP 2678 H=2678:00 +CPU= 16.351
  01:24:38 STEP 2679 H=2679:00 +CPU= 24.412
  01:24:55 STEP 2680 H=2680:00 +CPU= 16.935
  01:25:11 STEP 2681 H=2681:00 +CPU= 15.947
  01:25:36 STEP 2682 H=2682:00 +CPU= 25.158
  01:25:54 STEP 2683 H=2683:00 +CPU= 17.313
  01:26:10 STEP 2684 H=2684:00 +CPU= 15.784
  01:26:35 STEP 2685 H=2685:00 +CPU= 25.157
  01:26:51 STEP 2686 H=2686:00 +CPU= 16.465
  01:27:07 STEP 2687 H=2687:00 +CPU= 16.085
  01:27:39 STEP 2688 H=2688:00 +CPU= 31.832
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002688
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002688
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002688
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002664
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002664
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002664
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002676
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002676
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002676
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_111.zip
Uploading the intermediate file: upload_file_111.zip
  01:27:55 STEP 2689 H=2689:00 +CPU= 16.056
  01:28:14 STEP 2690 H=2690:00 +CPU= 18.133
  01:28:40 STEP 2691 H=2691:00 +CPU= 26.131
  01:28:57 STEP 2692 H=2692:00 +CPU= 17.199
  01:29:13 STEP 2693 H=2693:00 +CPU= 16.184
  01:29:39 STEP 2694 H=2694:00 +CPU= 25.400
  01:29:55 STEP 2695 H=2695:00 +CPU= 16.727
  01:30:12 STEP 2696 H=2696:00 +CPU= 16.230
  01:30:37 STEP 2697 H=2697:00 +CPU= 24.922
  01:30:53 STEP 2698 H=2698:00 +CPU= 16.369
  01:31:09 STEP 2699 H=2699:00 +CPU= 16.505
  01:31:39 STEP 2700 H=2700:00 +CPU= 29.587
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002700
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002700
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002700
  01:31:55 STEP 2701 H=2701:00 +CPU= 16.320
  01:32:12 STEP 2702 H=2702:00 +CPU= 16.669
  01:32:36 STEP 2703 H=2703:00 +CPU= 24.324
  01:32:54 STEP 2704 H=2704:00 +CPU= 17.521
  01:33:10 STEP 2705 H=2705:00 +CPU= 16.264
  01:33:38 STEP 2706 H=2706:00 +CPU= 27.931
  01:33:55 STEP 2707 H=2707:00 +CPU= 16.861
  01:34:12 STEP 2708 H=2708:00 +CPU= 16.366
  01:34:38 STEP 2709 H=2709:00 +CPU= 26.388
  01:34:55 STEP 2710 H=2710:00 +CPU= 16.995
  01:35:12 STEP 2711 H=2711:00 +CPU= 17.362
  01:35:42 STEP 2712 H=2712:00 +CPU= 29.368
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002712
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002712
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002712
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002688
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002688
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002688
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002700
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002700
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002700
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_112.zip
Uploading the intermediate file: upload_file_112.zip
  01:35:58 STEP 2713 H=2713:00 +CPU= 16.277
  01:36:15 STEP 2714 H=2714:00 +CPU= 16.580
  01:36:40 STEP 2715 H=2715:00 +CPU= 25.413
  01:36:57 STEP 2716 H=2716:00 +CPU= 16.584
  01:37:12 STEP 2717 H=2717:00 +CPU= 15.680
  01:37:39 STEP 2718 H=2718:00 +CPU= 26.284
  01:37:56 STEP 2719 H=2719:00 +CPU= 17.181
  01:38:13 STEP 2720 H=2720:00 +CPU= 16.593
  01:38:38 STEP 2721 H=2721:00 +CPU= 25.457
  01:38:55 STEP 2722 H=2722:00 +CPU= 17.267
  01:39:11 STEP 2723 H=2723:00 +CPU= 15.618
  01:39:41 STEP 2724 H=2724:00 +CPU= 29.825
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002724
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002724
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002724
  01:39:58 STEP 2725 H=2725:00 +CPU= 16.938
  01:40:14 STEP 2726 H=2726:00 +CPU= 15.922
  01:40:39 STEP 2727 H=2727:00 +CPU= 25.671
  01:40:56 STEP 2728 H=2728:00 +CPU= 16.857
  01:41:13 STEP 2729 H=2729:00 +CPU= 16.507
  01:41:40 STEP 2730 H=2730:00 +CPU= 26.788
  01:41:56 STEP 2731 H=2731:00 +CPU= 15.891
  01:42:12 STEP 2732 H=2732:00 +CPU= 16.797
  01:42:38 STEP 2733 H=2733:00 +CPU= 25.906
  01:42:56 STEP 2734 H=2734:00 +CPU= 17.104
  01:43:13 STEP 2735 H=2735:00 +CPU= 17.077
  01:43:43 STEP 2736 H=2736:00 +CPU= 30.080
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002736
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002736
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002736
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002712
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002712
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002712
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002724
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002724
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002724
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_113.zip
Uploading the intermediate file: upload_file_113.zip
  01:43:59 STEP 2737 H=2737:00 +CPU= 15.708
  01:44:15 STEP 2738 H=2738:00 +CPU= 16.027
  01:44:39 STEP 2739 H=2739:00 +CPU= 24.704
  01:44:55 STEP 2740 H=2740:00 +CPU= 15.943
  01:45:11 STEP 2741 H=2741:00 +CPU= 15.540
  01:45:36 STEP 2742 H=2742:00 +CPU= 24.859
  01:45:52 STEP 2743 H=2743:00 +CPU= 16.243
  01:46:09 STEP 2744 H=2744:00 +CPU= 17.290
  01:46:35 STEP 2745 H=2745:00 +CPU= 25.796
  01:46:51 STEP 2746 H=2746:00 +CPU= 15.955
  01:47:07 STEP 2747 H=2747:00 +CPU= 15.827
  01:47:36 STEP 2748 H=2748:00 +CPU= 28.548
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002748
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002748
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002748
  01:47:51 STEP 2749 H=2749:00 +CPU= 15.175
  01:48:07 STEP 2750 H=2750:00 +CPU= 16.565
  01:48:33 STEP 2751 H=2751:00 +CPU= 25.695
  01:48:49 STEP 2752 H=2752:00 +CPU= 16.354
  01:49:06 STEP 2753 H=2753:00 +CPU= 16.721
  01:49:32 STEP 2754 H=2754:00 +CPU= 26.239
  01:49:48 STEP 2755 H=2755:00 +CPU= 15.668
  01:50:06 STEP 2756 H=2756:00 +CPU= 17.480
  01:50:31 STEP 2757 H=2757:00 +CPU= 25.387
  01:50:47 STEP 2758 H=2758:00 +CPU= 16.185
  01:51:04 STEP 2759 H=2759:00 +CPU= 16.823
  01:51:34 STEP 2760 H=2760:00 +CPU= 30.335
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002760
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002760
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002760
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002736
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002736
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002736
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002748
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002748
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002748
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_114.zip
Uploading the intermediate file: upload_file_114.zip
  01:51:50 STEP 2761 H=2761:00 +CPU= 14.981
  01:52:05 STEP 2762 H=2762:00 +CPU= 15.372
  01:52:29 STEP 2763 H=2763:00 +CPU= 24.004
  01:52:45 STEP 2764 H=2764:00 +CPU= 15.569
  01:52:59 STEP 2765 H=2765:00 +CPU= 14.865
  01:53:24 STEP 2766 H=2766:00 +CPU= 24.428
  01:53:39 STEP 2767 H=2767:00 +CPU= 14.668
  01:53:54 STEP 2768 H=2768:00 +CPU= 15.553
  01:54:19 STEP 2769 H=2769:00 +CPU= 24.492
  01:54:34 STEP 2770 H=2770:00 +CPU= 15.474
  01:54:49 STEP 2771 H=2771:00 +CPU= 14.720
  01:55:15 STEP 2772 H=2772:00 +CPU= 26.555
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002772
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002772
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002772
  01:55:31 STEP 2773 H=2773:00 +CPU= 15.539
  01:55:47 STEP 2774 H=2774:00 +CPU= 15.449
  01:56:10 STEP 2775 H=2775:00 +CPU= 23.571
  01:56:26 STEP 2776 H=2776:00 +CPU= 15.780
  01:56:41 STEP 2777 H=2777:00 +CPU= 15.324
  01:57:06 STEP 2778 H=2778:00 +CPU= 25.138
  01:57:21 STEP 2779 H=2779:00 +CPU= 14.937
  01:57:37 STEP 2780 H=2780:00 +CPU= 16.088
  01:58:02 STEP 2781 H=2781:00 +CPU= 24.507
  01:58:18 STEP 2782 H=2782:00 +CPU= 16.298
  01:58:34 STEP 2783 H=2783:00 +CPU= 15.668
  01:59:03 STEP 2784 H=2784:00 +CPU= 28.841
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002784
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002784
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002784
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002760
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002760
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002760
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002772
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002772
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002772
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_115.zip
Uploading the intermediate file: upload_file_115.zip
  01:59:18 STEP 2785 H=2785:00 +CPU= 14.828
  01:59:34 STEP 2786 H=2786:00 +CPU= 15.736
  01:59:59 STEP 2787 H=2787:00 +CPU= 25.223
  02:00:14 STEP 2788 H=2788:00 +CPU= 15.641
  02:00:30 STEP 2789 H=2789:00 +CPU= 15.914
  02:00:57 STEP 2790 H=2790:00 +CPU= 26.106
  02:01:13 STEP 2791 H=2791:00 +CPU= 16.192
  02:01:28 STEP 2792 H=2792:00 +CPU= 15.712
  02:01:55 STEP 2793 H=2793:00 +CPU= 25.992
  02:02:12 STEP 2794 H=2794:00 +CPU= 17.251
  02:02:28 STEP 2795 H=2795:00 +CPU= 16.056
  02:02:55 STEP 2796 H=2796:00 +CPU= 27.162
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002796
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002796
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002796
  02:03:12 STEP 2797 H=2797:00 +CPU= 16.700
  02:03:29 STEP 2798 H=2798:00 +CPU= 17.023
  02:03:55 STEP 2799 H=2799:00 +CPU= 25.713
  02:04:11 STEP 2800 H=2800:00 +CPU= 16.832
  02:04:28 STEP 2801 H=2801:00 +CPU= 16.651
  02:04:54 STEP 2802 H=2802:00 +CPU= 26.185
  02:05:11 STEP 2803 H=2803:00 +CPU= 16.307
  02:05:27 STEP 2804 H=2804:00 +CPU= 16.371
  02:05:54 STEP 2805 H=2805:00 +CPU= 26.592
  02:06:10 STEP 2806 H=2806:00 +CPU= 16.683
  02:06:28 STEP 2807 H=2807:00 +CPU= 16.993
  02:06:57 STEP 2808 H=2808:00 +CPU= 29.046
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002808
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002808
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002808
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002784
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002784
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002784
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002796
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002796
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002796
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_116.zip
Uploading the intermediate file: upload_file_116.zip
  02:07:13 STEP 2809 H=2809:00 +CPU= 16.489
  02:07:30 STEP 2810 H=2810:00 +CPU= 16.724
  02:07:55 STEP 2811 H=2811:00 +CPU= 25.103
  02:08:13 STEP 2812 H=2812:00 +CPU= 18.331
  02:08:31 STEP 2813 H=2813:00 +CPU= 18.100
  02:08:58 STEP 2814 H=2814:00 +CPU= 26.471
  02:09:14 STEP 2815 H=2815:00 +CPU= 16.193
  02:09:31 STEP 2816 H=2816:00 +CPU= 16.952
  02:09:56 STEP 2817 H=2817:00 +CPU= 24.756
  02:10:13 STEP 2818 H=2818:00 +CPU= 17.236
  02:10:30 STEP 2819 H=2819:00 +CPU= 16.811
  02:10:59 STEP 2820 H=2820:00 +CPU= 29.051
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002820
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002820
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002820
  02:11:16 STEP 2821 H=2821:00 +CPU= 16.548
  02:11:33 STEP 2822 H=2822:00 +CPU= 17.090
  02:11:58 STEP 2823 H=2823:00 +CPU= 24.811
  02:12:15 STEP 2824 H=2824:00 +CPU= 17.072
  02:12:31 STEP 2825 H=2825:00 +CPU= 16.458
  02:12:58 STEP 2826 H=2826:00 +CPU= 27.123
  02:13:14 STEP 2827 H=2827:00 +CPU= 15.999
  02:13:32 STEP 2828 H=2828:00 +CPU= 17.615
  02:13:57 STEP 2829 H=2829:00 +CPU= 25.216
  02:14:14 STEP 2830 H=2830:00 +CPU= 16.510
  02:14:30 STEP 2831 H=2831:00 +CPU= 16.285
  02:15:00 STEP 2832 H=2832:00 +CPU= 29.909
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002832
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002832
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002832
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002808
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002808
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002808
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002820
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002820
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002820
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_117.zip
Uploading the intermediate file: upload_file_117.zip
  02:15:15 STEP 2833 H=2833:00 +CPU= 15.111
  02:15:30 STEP 2834 H=2834:00 +CPU= 15.218
  02:15:55 STEP 2835 H=2835:00 +CPU= 24.599
  02:16:11 STEP 2836 H=2836:00 +CPU= 16.262
  02:16:27 STEP 2837 H=2837:00 +CPU= 15.838
  02:16:53 STEP 2838 H=2838:00 +CPU= 26.121
  02:17:08 STEP 2839 H=2839:00 +CPU= 15.206
  02:17:24 STEP 2840 H=2840:00 +CPU= 15.955
  02:17:49 STEP 2841 H=2841:00 +CPU= 24.607
  02:18:06 STEP 2842 H=2842:00 +CPU= 16.619
  02:18:23 STEP 2843 H=2843:00 +CPU= 16.498
  02:18:51 STEP 2844 H=2844:00 +CPU= 28.163
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002844
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002844
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002844
  02:19:07 STEP 2845 H=2845:00 +CPU= 16.016
  02:19:24 STEP 2846 H=2846:00 +CPU= 17.520
  02:19:49 STEP 2847 H=2847:00 +CPU= 24.984
  02:20:06 STEP 2848 H=2848:00 +CPU= 16.640
  02:20:22 STEP 2849 H=2849:00 +CPU= 16.328
  02:20:47 STEP 2850 H=2850:00 +CPU= 24.873
  02:21:02 STEP 2851 H=2851:00 +CPU= 14.805
  02:21:20 STEP 2852 H=2852:00 +CPU= 17.572
  02:21:45 STEP 2853 H=2853:00 +CPU= 25.249
  02:22:02 STEP 2854 H=2854:00 +CPU= 16.662
  02:22:19 STEP 2855 H=2855:00 +CPU= 17.460
  02:22:50 STEP 2856 H=2856:00 +CPU= 30.314
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002856
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002856
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002856
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002832
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002832
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002832
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002844
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002844
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002844
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_118.zip
Uploading the intermediate file: upload_file_118.zip
  02:23:05 STEP 2857 H=2857:00 +CPU= 15.855
  02:23:22 STEP 2858 H=2858:00 +CPU= 16.426
  02:23:49 STEP 2859 H=2859:00 +CPU= 26.664
  02:24:05 STEP 2860 H=2860:00 +CPU= 16.729
  02:24:21 STEP 2861 H=2861:00 +CPU= 15.907
  02:24:48 STEP 2862 H=2862:00 +CPU= 26.587
  02:25:03 STEP 2863 H=2863:00 +CPU= 15.660
  02:25:20 STEP 2864 H=2864:00 +CPU= 16.961
  02:25:45 STEP 2865 H=2865:00 +CPU= 24.673
  02:26:02 STEP 2866 H=2866:00 +CPU= 16.486
  02:26:18 STEP 2867 H=2867:00 +CPU= 15.975
  02:26:45 STEP 2868 H=2868:00 +CPU= 27.655
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002868
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002868
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002868
  02:27:02 STEP 2869 H=2869:00 +CPU= 16.155
  02:27:20 STEP 2870 H=2870:00 +CPU= 18.163
  02:27:45 STEP 2871 H=2871:00 +CPU= 25.451
  02:28:04 STEP 2872 H=2872:00 +CPU= 18.444
  02:28:20 STEP 2873 H=2873:00 +CPU= 16.342
  02:28:46 STEP 2874 H=2874:00 +CPU= 26.215
  02:29:03 STEP 2875 H=2875:00 +CPU= 16.735
  02:29:21 STEP 2876 H=2876:00 +CPU= 17.681
  02:29:46 STEP 2877 H=2877:00 +CPU= 25.256
  02:30:03 STEP 2878 H=2878:00 +CPU= 16.604
  02:30:19 STEP 2879 H=2879:00 +CPU= 16.486
  02:30:48 STEP 2880 H=2880:00 +CPU= 28.834
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002880
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002880
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002880
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002856
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002856
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002856
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002868
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002868
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002868
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_119.zip
Uploading the intermediate file: upload_file_119.zip
  02:31:04 STEP 2881 H=2881:00 +CPU= 15.851
Uploading trickle at timestep: 10368000
  02:31:21 STEP 2882 H=2882:00 +CPU= 16.576
  02:31:46 STEP 2883 H=2883:00 +CPU= 24.986
  02:32:03 STEP 2884 H=2884:00 +CPU= 16.900
  02:32:19 STEP 2885 H=2885:00 +CPU= 16.095
  02:32:45 STEP 2886 H=2886:00 +CPU= 26.148
  02:33:01 STEP 2887 H=2887:00 +CPU= 16.300
  02:33:17 STEP 2888 H=2888:00 +CPU= 16.178
  02:33:45 STEP 2889 H=2889:00 +CPU= 27.136
  02:34:01 STEP 2890 H=2890:00 +CPU= 16.703
  02:34:17 STEP 2891 H=2891:00 +CPU= 15.361
  02:34:44 STEP 2892 H=2892:00 +CPU= 27.746
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002892
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002892
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002892
  02:35:01 STEP 2893 H=2893:00 +CPU= 16.795
  02:35:19 STEP 2894 H=2894:00 +CPU= 17.665
  02:35:44 STEP 2895 H=2895:00 +CPU= 24.851
  02:36:00 STEP 2896 H=2896:00 +CPU= 16.400
  02:36:17 STEP 2897 H=2897:00 +CPU= 17.123
  02:36:43 STEP 2898 H=2898:00 +CPU= 25.449
  02:36:59 STEP 2899 H=2899:00 +CPU= 16.022
  02:37:16 STEP 2900 H=2900:00 +CPU= 17.464
  02:37:42 STEP 2901 H=2901:00 +CPU= 25.539
  02:37:58 STEP 2902 H=2902:00 +CPU= 16.205
  02:38:15 STEP 2903 H=2903:00 +CPU= 16.604
  02:38:46 STEP 2904 H=2904:00 +CPU= 31.005
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002904
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002904
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002904
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002880
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002880
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002880
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002892
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002892
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002892
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_120.zip
Uploading the intermediate file: upload_file_120.zip
  02:39:04 STEP 2905 H=2905:00 +CPU= 17.705
  02:39:20 STEP 2906 H=2906:00 +CPU= 16.499
  02:39:47 STEP 2907 H=2907:00 +CPU= 26.788
  02:40:05 STEP 2908 H=2908:00 +CPU= 18.005
  02:40:22 STEP 2909 H=2909:00 +CPU= 16.941
  02:40:49 STEP 2910 H=2910:00 +CPU= 26.620
  02:41:04 STEP 2911 H=2911:00 +CPU= 15.381
  02:41:21 STEP 2912 H=2912:00 +CPU= 16.550
  02:41:47 STEP 2913 H=2913:00 +CPU= 26.706
  02:42:04 STEP 2914 H=2914:00 +CPU= 16.459
  02:42:21 STEP 2915 H=2915:00 +CPU= 16.572
  02:42:49 STEP 2916 H=2916:00 +CPU= 28.451
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002916
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002916
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002916
  02:43:05 STEP 2917 H=2917:00 +CPU= 16.026
  02:43:21 STEP 2918 H=2918:00 +CPU= 15.879
  02:43:48 STEP 2919 H=2919:00 +CPU= 26.602
  02:44:04 STEP 2920 H=2920:00 +CPU= 16.070
  02:44:21 STEP 2921 H=2921:00 +CPU= 16.832
  02:44:47 STEP 2922 H=2922:00 +CPU= 26.725
  02:45:04 STEP 2923 H=2923:00 +CPU= 16.851
  02:45:21 STEP 2924 H=2924:00 +CPU= 16.352
  02:45:45 STEP 2925 H=2925:00 +CPU= 24.785
  02:46:03 STEP 2926 H=2926:00 +CPU= 17.477
  02:46:20 STEP 2927 H=2927:00 +CPU= 17.274
  02:46:50 STEP 2928 H=2928:00 +CPU= 29.311
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002928
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002928
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002928
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002904
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002904
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002904
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002916
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002916
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002916
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_121.zip
Uploading the intermediate file: upload_file_121.zip
  02:47:06 STEP 2929 H=2929:00 +CPU= 16.244
  02:47:23 STEP 2930 H=2930:00 +CPU= 17.508
  02:47:48 STEP 2931 H=2931:00 +CPU= 24.853
  02:48:05 STEP 2932 H=2932:00 +CPU= 16.761
  02:48:21 STEP 2933 H=2933:00 +CPU= 15.856
  02:48:47 STEP 2934 H=2934:00 +CPU= 25.712
  02:49:03 STEP 2935 H=2935:00 +CPU= 16.016
  02:49:19 STEP 2936 H=2936:00 +CPU= 16.502
  02:49:45 STEP 2937 H=2937:00 +CPU= 25.351
  02:50:02 STEP 2938 H=2938:00 +CPU= 17.022
  02:50:18 STEP 2939 H=2939:00 +CPU= 15.924
  02:50:45 STEP 2940 H=2940:00 +CPU= 26.981
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002940
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002940
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002940
  02:51:00 STEP 2941 H=2941:00 +CPU= 15.440
  02:51:16 STEP 2942 H=2942:00 +CPU= 15.515
  02:51:40 STEP 2943 H=2943:00 +CPU= 24.499
  02:51:57 STEP 2944 H=2944:00 +CPU= 16.827
  02:52:13 STEP 2945 H=2945:00 +CPU= 15.986
  02:52:38 STEP 2946 H=2946:00 +CPU= 24.772
  02:52:54 STEP 2947 H=2947:00 +CPU= 16.057
  02:53:10 STEP 2948 H=2948:00 +CPU= 16.383
  02:53:35 STEP 2949 H=2949:00 +CPU= 24.361
  02:53:51 STEP 2950 H=2950:00 +CPU= 16.720
  02:54:08 STEP 2951 H=2951:00 +CPU= 16.605
  02:54:38 STEP 2952 H=2952:00 +CPU= 30.112
The child process terminated with status: 0
Moving to projects directory: /home/roland/slots/3/ICMGGhq0f+002952
Moving to projects directory: /home/roland/slots/3/ICMSHhq0f+002952
Moving to projects directory: /home/roland/slots/3/ICMUAhq0f+002952
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002952
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002940
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002928
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002952
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002940
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMUAhq0f+002928
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMGGhq0f+002952
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002940
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12171002/ICMSHhq0f+002928
Zipping up the final file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0358_1985050100_123_954_12171002_1_r1443497953_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
02:58:03 (1826): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:39:03 1517859 22268770 oifs_43r3_ps_0358_1985050100_123_954_12171002_1 10,623,600 66,145 0.0062
09 May 2023 16:38:59 1517859 22268770 oifs_43r3_ps_0358_1985050100_123_954_12171002_1 10,368,000 64,717 0.0062
09 May 2023 16:38:55 1517859 22268770 oifs_43r3_ps_0358_1985050100_123_954_12171002_1 9,504,000 60,000 0.0063
09 May 2023 16:38:51 1517859 22268770 oifs_43r3_ps_0358_1985050100_123_954_12171002_1 8,640,000 54,891 0.0064
09 May 2023 16:38:51 1517859 22268770 oifs_43r3_ps_0358_1985050100_123_954_12171002_1 8,640,000 54,891 0.0064
09 May 2023 16:38:43 1517859 22268770 oifs_43r3_ps_0358_1985050100_123_954_12171002_1 7,776,000 49,741 0.0064
09 May 2023 16:38:39 1517859 22268770 oifs_43r3_ps_0358_1985050100_123_954_12171002_1 6,912,000 44,649 0.0065
09 May 2023 16:38:31 1517859 22268770 oifs_43r3_ps_0358_1985050100_123_954_12171002_1 6,048,000 39,383 0.0065
09 May 2023 16:38:27 1517859 22268770 oifs_43r3_ps_0358_1985050100_123_954_12171002_1 5,184,000 34,016 0.0066
09 May 2023 16:38:27 1517859 22268770 oifs_43r3_ps_0358_1985050100_123_954_12171002_1 5,184,000 34,016 0.0066
09 May 2023 16:38:19 1517859 22268770 oifs_43r3_ps_0358_1985050100_123_954_12171002_1 4,320,000 28,456 0.0066
09 May 2023 16:38:19 1517859 22268770 oifs_43r3_ps_0358_1985050100_123_954_12171002_1 4,320,000 28,456 0.0066
09 May 2023 16:38:15 1517859 22268770 oifs_43r3_ps_0358_1985050100_123_954_12171002_1 3,456,000 22,733 0.0066
09 May 2023 16:38:06 1517859 22268770 oifs_43r3_ps_0358_1985050100_123_954_12171002_1 2,592,000 16,931 0.0065
09 May 2023 16:38:01 1517859 22268770 oifs_43r3_ps_0358_1985050100_123_954_12171002_1 1,728,000 11,537 0.0067
09 May 2023 16:38:01 1517859 22268770 oifs_43r3_ps_0358_1985050100_123_954_12171002_1 1,728,000 11,537 0.0067
09 May 2023 16:37:50 1517859 22268770 oifs_43r3_ps_0358_1985050100_123_954_12171002_1 864,000 5,855 0.0068


©2024 climateprediction.net