climateprediction.net home page
Task 22255008

Task 22255008

Name oifs_43r3_ps_0041_1985050100_123_954_12170685_0
Workunit 12170685
Created 21 Dec 2022, 4:58:29 UTC
Sent 21 Dec 2022, 5:05:20 UTC
Report deadline 20 Jan 2023, 5:05:20 UTC
Received 22 Dec 2022, 3:25:19 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1520162
Run time 19 hours 59 min 43 sec
CPU time 19 hours 35 min 14 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 6.52 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,590.19 MB
Peak swap size 4,977.93 MB
Peak disk usage 2,020.90 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
hook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:2fcf6592df3e:1:1:264:264] [20221221:164045:1671662445:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:2fcf6592df3e:1:1:264:264] [20221221:164045:1671662445:0.001] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:2fcf6592df3e:1:1:264:264] [20221221:164045:1671662445:0.001] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:2fcf6592df3e:1:1:264:264] [20221221:164045:1671662445:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:2fcf6592df3e:1:1:264:264] [20221221:164045:1671662445:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:2fcf6592df3e:1:1:264:264] [20221221:164045:1671662445:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:2fcf6592df3e:1:1:264:264] [20221221:164045:1671662445:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:2fcf6592df3e:1:1:264:264] [20221221:164045:1671662445:0.002] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:2fcf6592df3e:1:1:264:264] [20221221:164045:1671662445:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:2fcf6592df3e:1:1:264:264] [20221221:164045:1671662445:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:2fcf6592df3e:1:1:264:264] [20221221:164045:1671662445:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:2fcf6592df3e:1:1:264:264] [20221221:164045:1671662445:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:2fcf6592df3e:1:1:264:264] [20221221:164045:1671662445:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:2fcf6592df3e:1:1:264:264] [20221221:164045:1671662445:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:2fcf6592df3e:1:1:264:264] [20221221:164045:1671662445:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:2fcf6592df3e:1:1:264:264] [20221221:164045:1671662445:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:2fcf6592df3e:1:1:264:264] [20221221:164045:1671662445:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:2fcf6592df3e:1:1:264:264] [20221221:164045:1671662445:0.002] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  16:41:24 STEP 2304 H=2304:00 +CPU= 32.840
  16:41:41 STEP 2305 H=2305:00 +CPU= 15.978
  16:41:56 STEP 2306 H=2306:00 +CPU= 15.257
  16:42:19 STEP 2307 H=2307:00 +CPU= 22.613
  16:42:35 STEP 2308 H=2308:00 +CPU= 15.627
  16:42:49 STEP 2309 H=2309:00 +CPU= 13.807
  16:43:11 STEP 2310 H=2310:00 +CPU= 22.595
  16:43:25 STEP 2311 H=2311:00 +CPU= 13.882
  16:43:40 STEP 2312 H=2312:00 +CPU= 14.175
  16:44:04 STEP 2313 H=2313:00 +CPU= 23.541
  16:44:19 STEP 2314 H=2314:00 +CPU= 14.868
  16:44:34 STEP 2315 H=2315:00 +CPU= 14.581
  16:45:00 STEP 2316 H=2316:00 +CPU= 26.002
Moving to projects directory: /config/slots/3/ICMGGhq0f+002316
Moving to projects directory: /config/slots/3/ICMSHhq0f+002316
Moving to projects directory: /config/slots/3/ICMUAhq0f+002316
  16:45:18 STEP 2317 H=2317:00 +CPU= 16.345
  16:45:37 STEP 2318 H=2318:00 +CPU= 17.628
  16:46:01 STEP 2319 H=2319:00 +CPU= 23.659
  16:46:17 STEP 2320 H=2320:00 +CPU= 15.455
  16:46:32 STEP 2321 H=2321:00 +CPU= 14.994
  16:46:57 STEP 2322 H=2322:00 +CPU= 24.321
  16:47:13 STEP 2323 H=2323:00 +CPU= 15.478
  16:47:28 STEP 2324 H=2324:00 +CPU= 15.134
  16:47:56 STEP 2325 H=2325:00 +CPU= 25.656
  16:48:12 STEP 2326 H=2326:00 +CPU= 15.457
  16:48:28 STEP 2327 H=2327:00 +CPU= 15.925
  16:48:57 STEP 2328 H=2328:00 +CPU= 28.111
Moving to projects directory: /config/slots/3/ICMGGhq0f+002328
Moving to projects directory: /config/slots/3/ICMSHhq0f+002328
Moving to projects directory: /config/slots/3/ICMUAhq0f+002328
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002304
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002304
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002304
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002316
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002316
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002316
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_96.zip
Uploading the intermediate file: upload_file_96.zip
  16:49:14 STEP 2329 H=2329:00 +CPU= 16.329
  16:49:31 STEP 2330 H=2330:00 +CPU= 15.828
  16:49:56 STEP 2331 H=2331:00 +CPU= 24.651
  16:50:14 STEP 2332 H=2332:00 +CPU= 17.210
  16:50:31 STEP 2333 H=2333:00 +CPU= 16.239
  16:50:56 STEP 2334 H=2334:00 +CPU= 24.252
  16:51:12 STEP 2335 H=2335:00 +CPU= 15.742
  16:51:29 STEP 2336 H=2336:00 +CPU= 16.414
  16:51:54 STEP 2337 H=2337:00 +CPU= 24.350
  16:52:10 STEP 2338 H=2338:00 +CPU= 15.806
  16:52:25 STEP 2339 H=2339:00 +CPU= 15.021
  16:52:53 STEP 2340 H=2340:00 +CPU= 26.704
Moving to projects directory: /config/slots/3/ICMGGhq0f+002340
Moving to projects directory: /config/slots/3/ICMSHhq0f+002340
Moving to projects directory: /config/slots/3/ICMUAhq0f+002340
  16:53:09 STEP 2341 H=2341:00 +CPU= 16.237
  16:53:25 STEP 2342 H=2342:00 +CPU= 15.493
  16:53:50 STEP 2343 H=2343:00 +CPU= 24.186
  16:54:06 STEP 2344 H=2344:00 +CPU= 15.950
  16:54:22 STEP 2345 H=2345:00 +CPU= 15.569
  16:54:48 STEP 2346 H=2346:00 +CPU= 25.191
  16:55:04 STEP 2347 H=2347:00 +CPU= 15.718
  16:55:21 STEP 2348 H=2348:00 +CPU= 15.832
  16:55:47 STEP 2349 H=2349:00 +CPU= 25.009
  16:56:04 STEP 2350 H=2350:00 +CPU= 16.905
  16:56:20 STEP 2351 H=2351:00 +CPU= 15.320
  16:56:49 STEP 2352 H=2352:00 +CPU= 27.840
Moving to projects directory: /config/slots/3/ICMGGhq0f+002352
Moving to projects directory: /config/slots/3/ICMSHhq0f+002352
Moving to projects directory: /config/slots/3/ICMUAhq0f+002352
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002328
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002328
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002328
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002340
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002340
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002340
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_97.zip
Uploading the intermediate file: upload_file_97.zip
  16:57:05 STEP 2353 H=2353:00 +CPU= 15.365
  16:57:21 STEP 2354 H=2354:00 +CPU= 16.361
  16:57:47 STEP 2355 H=2355:00 +CPU= 25.245
  16:58:04 STEP 2356 H=2356:00 +CPU= 16.244
  16:58:19 STEP 2357 H=2357:00 +CPU= 15.156
  16:58:45 STEP 2358 H=2358:00 +CPU= 24.746
  16:59:02 STEP 2359 H=2359:00 +CPU= 16.680
  16:59:18 STEP 2360 H=2360:00 +CPU= 15.866
  16:59:43 STEP 2361 H=2361:00 +CPU= 24.456
  16:59:59 STEP 2362 H=2362:00 +CPU= 15.923
  17:00:18 STEP 2363 H=2363:00 +CPU= 17.590
  17:00:48 STEP 2364 H=2364:00 +CPU= 28.668
Moving to projects directory: /config/slots/3/ICMGGhq0f+002364
Moving to projects directory: /config/slots/3/ICMSHhq0f+002364
Moving to projects directory: /config/slots/3/ICMUAhq0f+002364
  17:01:04 STEP 2365 H=2365:00 +CPU= 15.420
  17:01:20 STEP 2366 H=2366:00 +CPU= 15.561
  17:01:44 STEP 2367 H=2367:00 +CPU= 23.838
  17:02:02 STEP 2368 H=2368:00 +CPU= 16.778
  17:02:17 STEP 2369 H=2369:00 +CPU= 15.297
  17:02:42 STEP 2370 H=2370:00 +CPU= 24.483
  17:02:58 STEP 2371 H=2371:00 +CPU= 15.251
  17:03:14 STEP 2372 H=2372:00 +CPU= 16.134
  17:03:40 STEP 2373 H=2373:00 +CPU= 25.129
  17:03:56 STEP 2374 H=2374:00 +CPU= 15.844
  17:04:13 STEP 2375 H=2375:00 +CPU= 15.932
  17:04:42 STEP 2376 H=2376:00 +CPU= 28.548
Moving to projects directory: /config/slots/3/ICMGGhq0f+002376
Moving to projects directory: /config/slots/3/ICMSHhq0f+002376
Moving to projects directory: /config/slots/3/ICMUAhq0f+002376
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002352
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002352
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002352
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002364
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002364
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002364
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_98.zip
Uploading the intermediate file: upload_file_98.zip
  17:04:59 STEP 2377 H=2377:00 +CPU= 16.285
  17:05:17 STEP 2378 H=2378:00 +CPU= 17.209
  17:05:44 STEP 2379 H=2379:00 +CPU= 25.708
  17:06:00 STEP 2380 H=2380:00 +CPU= 16.244
  17:06:16 STEP 2381 H=2381:00 +CPU= 15.666
  17:06:43 STEP 2382 H=2382:00 +CPU= 25.934
  17:06:59 STEP 2383 H=2383:00 +CPU= 15.588
  17:07:16 STEP 2384 H=2384:00 +CPU= 16.520
  17:07:40 STEP 2385 H=2385:00 +CPU= 24.083
  17:07:57 STEP 2386 H=2386:00 +CPU= 16.648
  17:08:14 STEP 2387 H=2387:00 +CPU= 16.009
  17:08:41 STEP 2388 H=2388:00 +CPU= 26.708
Moving to projects directory: /config/slots/3/ICMGGhq0f+002388
Moving to projects directory: /config/slots/3/ICMSHhq0f+002388
Moving to projects directory: /config/slots/3/ICMUAhq0f+002388
  17:08:57 STEP 2389 H=2389:00 +CPU= 15.155
  17:09:13 STEP 2390 H=2390:00 +CPU= 16.026
  17:09:39 STEP 2391 H=2391:00 +CPU= 25.127
  17:09:55 STEP 2392 H=2392:00 +CPU= 15.666
  17:10:12 STEP 2393 H=2393:00 +CPU= 16.394
  17:10:39 STEP 2394 H=2394:00 +CPU= 26.398
  17:10:55 STEP 2395 H=2395:00 +CPU= 15.632
  17:11:12 STEP 2396 H=2396:00 +CPU= 16.408
  17:11:37 STEP 2397 H=2397:00 +CPU= 24.113
  17:11:53 STEP 2398 H=2398:00 +CPU= 15.664
  17:12:09 STEP 2399 H=2399:00 +CPU= 15.846
  17:12:39 STEP 2400 H=2400:00 +CPU= 28.688
Moving to projects directory: /config/slots/3/ICMGGhq0f+002400
Moving to projects directory: /config/slots/3/ICMSHhq0f+002400
Moving to projects directory: /config/slots/3/ICMUAhq0f+002400
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002376
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002376
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002376
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002388
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002388
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002388
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_99.zip
Uploading the intermediate file: upload_file_99.zip
  17:12:54 STEP 2401 H=2401:00 +CPU= 15.067
  17:13:10 STEP 2402 H=2402:00 +CPU= 15.900
  17:13:35 STEP 2403 H=2403:00 +CPU= 24.409
  17:13:52 STEP 2404 H=2404:00 +CPU= 16.348
  17:14:09 STEP 2405 H=2405:00 +CPU= 16.871
  17:14:35 STEP 2406 H=2406:00 +CPU= 24.806
  17:14:51 STEP 2407 H=2407:00 +CPU= 15.594
  17:15:08 STEP 2408 H=2408:00 +CPU= 16.642
  17:15:36 STEP 2409 H=2409:00 +CPU= 26.762
  17:15:53 STEP 2410 H=2410:00 +CPU= 16.073
  17:16:08 STEP 2411 H=2411:00 +CPU= 15.493
  17:16:36 STEP 2412 H=2412:00 +CPU= 26.757
Moving to projects directory: /config/slots/3/ICMGGhq0f+002412
Moving to projects directory: /config/slots/3/ICMSHhq0f+002412
Moving to projects directory: /config/slots/3/ICMUAhq0f+002412
  17:16:51 STEP 2413 H=2413:00 +CPU= 15.189
  17:17:08 STEP 2414 H=2414:00 +CPU= 16.744
  17:17:35 STEP 2415 H=2415:00 +CPU= 25.210
  17:17:51 STEP 2416 H=2416:00 +CPU= 15.805
  17:18:07 STEP 2417 H=2417:00 +CPU= 15.403
  17:18:33 STEP 2418 H=2418:00 +CPU= 26.051
  17:18:49 STEP 2419 H=2419:00 +CPU= 15.723
  17:19:06 STEP 2420 H=2420:00 +CPU= 16.250
  17:19:31 STEP 2421 H=2421:00 +CPU= 24.294
  17:19:47 STEP 2422 H=2422:00 +CPU= 15.921
  17:20:05 STEP 2423 H=2423:00 +CPU= 17.416
  17:20:37 STEP 2424 H=2424:00 +CPU= 29.708
Moving to projects directory: /config/slots/3/ICMGGhq0f+002424
Moving to projects directory: /config/slots/3/ICMSHhq0f+002424
Moving to projects directory: /config/slots/3/ICMUAhq0f+002424
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002400
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002400
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002400
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002412
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002412
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002412
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_100.zip
Uploading the intermediate file: upload_file_100.zip
  17:20:53 STEP 2425 H=2425:00 +CPU= 15.659
  17:21:09 STEP 2426 H=2426:00 +CPU= 15.885
  17:21:35 STEP 2427 H=2427:00 +CPU= 25.195
  17:21:51 STEP 2428 H=2428:00 +CPU= 15.859
  17:22:08 STEP 2429 H=2429:00 +CPU= 16.120
  17:22:34 STEP 2430 H=2430:00 +CPU= 24.856
  17:22:49 STEP 2431 H=2431:00 +CPU= 15.420
  17:23:09 STEP 2432 H=2432:00 +CPU= 18.144
  17:23:35 STEP 2433 H=2433:00 +CPU= 25.297
  17:23:51 STEP 2434 H=2434:00 +CPU= 15.974
  17:24:07 STEP 2435 H=2435:00 +CPU= 15.355
  17:24:37 STEP 2436 H=2436:00 +CPU= 28.948
Moving to projects directory: /config/slots/3/ICMGGhq0f+002436
Moving to projects directory: /config/slots/3/ICMSHhq0f+002436
Moving to projects directory: /config/slots/3/ICMUAhq0f+002436
  17:24:53 STEP 2437 H=2437:00 +CPU= 15.805
  17:25:10 STEP 2438 H=2438:00 +CPU= 16.738
  17:25:38 STEP 2439 H=2439:00 +CPU= 25.727
  17:25:54 STEP 2440 H=2440:00 +CPU= 16.028
  17:26:11 STEP 2441 H=2441:00 +CPU= 16.362
  17:26:36 STEP 2442 H=2442:00 +CPU= 24.822
  17:26:52 STEP 2443 H=2443:00 +CPU= 15.223
  17:27:08 STEP 2444 H=2444:00 +CPU= 15.856
  17:27:34 STEP 2445 H=2445:00 +CPU= 25.270
  17:27:50 STEP 2446 H=2446:00 +CPU= 15.563
  17:28:06 STEP 2447 H=2447:00 +CPU= 15.963
  17:28:36 STEP 2448 H=2448:00 +CPU= 28.436
Moving to projects directory: /config/slots/3/ICMGGhq0f+002448
Moving to projects directory: /config/slots/3/ICMSHhq0f+002448
Moving to projects directory: /config/slots/3/ICMUAhq0f+002448
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002424
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002424
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002424
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002436
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002436
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002436
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_101.zip
Uploading the intermediate file: upload_file_101.zip
  17:28:52 STEP 2449 H=2449:00 +CPU= 15.738
  17:29:10 STEP 2450 H=2450:00 +CPU= 17.346
  17:29:36 STEP 2451 H=2451:00 +CPU= 24.903
  17:29:52 STEP 2452 H=2452:00 +CPU= 16.156
  17:30:09 STEP 2453 H=2453:00 +CPU= 16.163
  17:30:38 STEP 2454 H=2454:00 +CPU= 27.635
  17:30:54 STEP 2455 H=2455:00 +CPU= 15.769
  17:31:11 STEP 2456 H=2456:00 +CPU= 16.303
  17:31:36 STEP 2457 H=2457:00 +CPU= 24.583
  17:31:53 STEP 2458 H=2458:00 +CPU= 16.114
  17:32:10 STEP 2459 H=2459:00 +CPU= 16.602
  17:32:38 STEP 2460 H=2460:00 +CPU= 27.435
Moving to projects directory: /config/slots/3/ICMGGhq0f+002460
Moving to projects directory: /config/slots/3/ICMSHhq0f+002460
Moving to projects directory: /config/slots/3/ICMUAhq0f+002460
  17:32:54 STEP 2461 H=2461:00 +CPU= 15.559
  17:33:10 STEP 2462 H=2462:00 +CPU= 15.954
  17:33:37 STEP 2463 H=2463:00 +CPU= 25.835
  17:33:53 STEP 2464 H=2464:00 +CPU= 15.859
  17:34:09 STEP 2465 H=2465:00 +CPU= 15.726
  17:34:35 STEP 2466 H=2466:00 +CPU= 25.306
  17:34:53 STEP 2467 H=2467:00 +CPU= 16.670
  17:35:10 STEP 2468 H=2468:00 +CPU= 17.062
  17:35:37 STEP 2469 H=2469:00 +CPU= 25.295
  17:35:53 STEP 2470 H=2470:00 +CPU= 16.150
  17:36:10 STEP 2471 H=2471:00 +CPU= 16.194
  17:36:41 STEP 2472 H=2472:00 +CPU= 29.471
Moving to projects directory: /config/slots/3/ICMGGhq0f+002472
Moving to projects directory: /config/slots/3/ICMSHhq0f+002472
Moving to projects directory: /config/slots/3/ICMUAhq0f+002472
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002448
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002448
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002448
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002460
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002460
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002460
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_102.zip
Uploading the intermediate file: upload_file_102.zip
  17:36:57 STEP 2473 H=2473:00 +CPU= 15.643
  17:37:14 STEP 2474 H=2474:00 +CPU= 16.730
  17:37:40 STEP 2475 H=2475:00 +CPU= 25.032
  17:37:57 STEP 2476 H=2476:00 +CPU= 16.767
  17:38:14 STEP 2477 H=2477:00 +CPU= 16.588
  17:38:40 STEP 2478 H=2478:00 +CPU= 25.431
  17:38:56 STEP 2479 H=2479:00 +CPU= 15.852
  17:39:13 STEP 2480 H=2480:00 +CPU= 16.668
  17:39:40 STEP 2481 H=2481:00 +CPU= 26.195
  17:39:58 STEP 2482 H=2482:00 +CPU= 17.020
  17:40:16 STEP 2483 H=2483:00 +CPU= 17.104
  17:40:45 STEP 2484 H=2484:00 +CPU= 28.065
Moving to projects directory: /config/slots/3/ICMGGhq0f+002484
Moving to projects directory: /config/slots/3/ICMSHhq0f+002484
Moving to projects directory: /config/slots/3/ICMUAhq0f+002484
  17:41:03 STEP 2485 H=2485:00 +CPU= 16.452
  17:41:19 STEP 2486 H=2486:00 +CPU= 15.730
  17:41:44 STEP 2487 H=2487:00 +CPU= 24.491
  17:42:00 STEP 2488 H=2488:00 +CPU= 16.330
  17:42:16 STEP 2489 H=2489:00 +CPU= 15.880
  17:42:44 STEP 2490 H=2490:00 +CPU= 26.523
  17:43:00 STEP 2491 H=2491:00 +CPU= 15.556
  17:43:16 STEP 2492 H=2492:00 +CPU= 16.302
  17:43:42 STEP 2493 H=2493:00 +CPU= 24.817
  17:43:59 STEP 2494 H=2494:00 +CPU= 16.979
  17:44:16 STEP 2495 H=2495:00 +CPU= 16.807
  17:44:46 STEP 2496 H=2496:00 +CPU= 28.211
Moving to projects directory: /config/slots/3/ICMGGhq0f+002496
Moving to projects directory: /config/slots/3/ICMSHhq0f+002496
Moving to projects directory: /config/slots/3/ICMUAhq0f+002496
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002472
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002472
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002472
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002484
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002484
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002484
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_103.zip
Uploading the intermediate file: upload_file_103.zip
  17:45:03 STEP 2497 H=2497:00 +CPU= 16.305
  17:45:20 STEP 2498 H=2498:00 +CPU= 16.705
  17:45:48 STEP 2499 H=2499:00 +CPU= 26.408
  17:46:05 STEP 2500 H=2500:00 +CPU= 16.496
  17:46:21 STEP 2501 H=2501:00 +CPU= 15.973
  17:46:48 STEP 2502 H=2502:00 +CPU= 25.880
  17:47:06 STEP 2503 H=2503:00 +CPU= 17.232
  17:47:22 STEP 2504 H=2504:00 +CPU= 16.316
  17:47:47 STEP 2505 H=2505:00 +CPU= 24.751
  17:48:06 STEP 2506 H=2506:00 +CPU= 17.629
  17:48:24 STEP 2507 H=2507:00 +CPU= 17.052
  17:48:52 STEP 2508 H=2508:00 +CPU= 27.129
Moving to projects directory: /config/slots/3/ICMGGhq0f+002508
Moving to projects directory: /config/slots/3/ICMSHhq0f+002508
Moving to projects directory: /config/slots/3/ICMUAhq0f+002508
  17:49:08 STEP 2509 H=2509:00 +CPU= 15.421
  17:49:24 STEP 2510 H=2510:00 +CPU= 15.939
  17:49:51 STEP 2511 H=2511:00 +CPU= 25.463
  17:50:09 STEP 2512 H=2512:00 +CPU= 17.518
  17:50:25 STEP 2513 H=2513:00 +CPU= 15.749
  17:50:53 STEP 2514 H=2514:00 +CPU= 26.538
  17:51:10 STEP 2515 H=2515:00 +CPU= 16.510
  17:51:27 STEP 2516 H=2516:00 +CPU= 17.035
  17:51:54 STEP 2517 H=2517:00 +CPU= 25.519
  17:52:10 STEP 2518 H=2518:00 +CPU= 16.439
  17:52:28 STEP 2519 H=2519:00 +CPU= 16.760
  17:53:00 STEP 2520 H=2520:00 +CPU= 30.113
Moving to projects directory: /config/slots/3/ICMGGhq0f+002520
Moving to projects directory: /config/slots/3/ICMSHhq0f+002520
Moving to projects directory: /config/slots/3/ICMUAhq0f+002520
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002496
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002496
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002496
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002508
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002508
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002508
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_104.zip
Uploading the intermediate file: upload_file_104.zip
  17:53:16 STEP 2521 H=2521:00 +CPU= 15.958
  17:53:32 STEP 2522 H=2522:00 +CPU= 16.031
  17:53:57 STEP 2523 H=2523:00 +CPU= 24.102
  17:54:15 STEP 2524 H=2524:00 +CPU= 17.318
  17:54:33 STEP 2525 H=2525:00 +CPU= 17.135
  17:54:59 STEP 2526 H=2526:00 +CPU= 25.343
  17:55:16 STEP 2527 H=2527:00 +CPU= 16.559
  17:55:34 STEP 2528 H=2528:00 +CPU= 17.540
  17:56:01 STEP 2529 H=2529:00 +CPU= 26.158
  17:56:18 STEP 2530 H=2530:00 +CPU= 16.278
  17:56:34 STEP 2531 H=2531:00 +CPU= 15.604
  17:57:00 STEP 2532 H=2532:00 +CPU= 26.178
Moving to projects directory: /config/slots/3/ICMGGhq0f+002532
Moving to projects directory: /config/slots/3/ICMSHhq0f+002532
Moving to projects directory: /config/slots/3/ICMUAhq0f+002532
  17:57:17 STEP 2533 H=2533:00 +CPU= 16.000
  17:57:34 STEP 2534 H=2534:00 +CPU= 16.613
  17:57:58 STEP 2535 H=2535:00 +CPU= 23.834
  17:58:15 STEP 2536 H=2536:00 +CPU= 16.221
  17:58:31 STEP 2537 H=2537:00 +CPU= 15.641
  17:58:57 STEP 2538 H=2538:00 +CPU= 25.975
  17:59:15 STEP 2539 H=2539:00 +CPU= 16.807
  17:59:32 STEP 2540 H=2540:00 +CPU= 16.190
  17:59:57 STEP 2541 H=2541:00 +CPU= 24.475
  18:00:15 STEP 2542 H=2542:00 +CPU= 17.525
  18:00:35 STEP 2543 H=2543:00 +CPU= 18.437
  18:01:06 STEP 2544 H=2544:00 +CPU= 29.239
Moving to projects directory: /config/slots/3/ICMGGhq0f+002544
Moving to projects directory: /config/slots/3/ICMSHhq0f+002544
Moving to projects directory: /config/slots/3/ICMUAhq0f+002544
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002520
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002520
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002520
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002532
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002532
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002532
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_105.zip
Uploading the intermediate file: upload_file_105.zip
  18:01:21 STEP 2545 H=2545:00 +CPU= 15.272
Uploading trickle at timestep: 9158400
  18:01:38 STEP 2546 H=2546:00 +CPU= 16.028
  18:02:06 STEP 2547 H=2547:00 +CPU= 26.690
  18:02:23 STEP 2548 H=2548:00 +CPU= 16.466
  18:02:39 STEP 2549 H=2549:00 +CPU= 15.869
  18:03:05 STEP 2550 H=2550:00 +CPU= 25.074
  18:03:21 STEP 2551 H=2551:00 +CPU= 15.723
  18:03:39 STEP 2552 H=2552:00 +CPU= 17.548
  18:04:05 STEP 2553 H=2553:00 +CPU= 25.611
  18:04:22 STEP 2554 H=2554:00 +CPU= 16.325
  18:04:38 STEP 2555 H=2555:00 +CPU= 15.809
  18:05:07 STEP 2556 H=2556:00 +CPU= 27.804
Moving to projects directory: /config/slots/3/ICMGGhq0f+002556
Moving to projects directory: /config/slots/3/ICMSHhq0f+002556
Moving to projects directory: /config/slots/3/ICMUAhq0f+002556
  18:05:23 STEP 2557 H=2557:00 +CPU= 15.489
  18:05:41 STEP 2558 H=2558:00 +CPU= 17.232
  18:06:06 STEP 2559 H=2559:00 +CPU= 24.302
  18:06:22 STEP 2560 H=2560:00 +CPU= 16.151
  18:06:40 STEP 2561 H=2561:00 +CPU= 17.004
  18:07:08 STEP 2562 H=2562:00 +CPU= 26.441
  18:07:25 STEP 2563 H=2563:00 +CPU= 16.555
  18:07:41 STEP 2564 H=2564:00 +CPU= 16.456
  18:08:08 STEP 2565 H=2565:00 +CPU= 25.847
  18:08:25 STEP 2566 H=2566:00 +CPU= 16.248
  18:08:41 STEP 2567 H=2567:00 +CPU= 16.008
  18:09:12 STEP 2568 H=2568:00 +CPU= 29.354
Moving to projects directory: /config/slots/3/ICMGGhq0f+002568
Moving to projects directory: /config/slots/3/ICMSHhq0f+002568
Moving to projects directory: /config/slots/3/ICMUAhq0f+002568
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002544
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002544
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002544
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002556
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002556
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002556
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_106.zip
Uploading the intermediate file: upload_file_106.zip
  18:09:28 STEP 2569 H=2569:00 +CPU= 16.196
  18:09:46 STEP 2570 H=2570:00 +CPU= 16.681
  18:10:12 STEP 2571 H=2571:00 +CPU= 25.059
  18:10:29 STEP 2572 H=2572:00 +CPU= 16.508
  18:10:47 STEP 2573 H=2573:00 +CPU= 17.527
  18:11:15 STEP 2574 H=2574:00 +CPU= 27.174
  18:11:31 STEP 2575 H=2575:00 +CPU= 15.968
  18:11:48 STEP 2576 H=2576:00 +CPU= 16.321
  18:12:14 STEP 2577 H=2577:00 +CPU= 25.056
  18:12:31 STEP 2578 H=2578:00 +CPU= 17.098
  18:12:47 STEP 2579 H=2579:00 +CPU= 15.608
  18:13:14 STEP 2580 H=2580:00 +CPU= 26.776
Moving to projects directory: /config/slots/3/ICMGGhq0f+002580
Moving to projects directory: /config/slots/3/ICMSHhq0f+002580
Moving to projects directory: /config/slots/3/ICMUAhq0f+002580
  18:13:30 STEP 2581 H=2581:00 +CPU= 15.372
  18:13:46 STEP 2582 H=2582:00 +CPU= 15.809
  18:14:12 STEP 2583 H=2583:00 +CPU= 25.470
  18:14:28 STEP 2584 H=2584:00 +CPU= 15.901
  18:14:45 STEP 2585 H=2585:00 +CPU= 15.926
  18:15:11 STEP 2586 H=2586:00 +CPU= 25.338
  18:15:28 STEP 2587 H=2587:00 +CPU= 16.506
  18:15:47 STEP 2588 H=2588:00 +CPU= 17.764
  18:16:12 STEP 2589 H=2589:00 +CPU= 25.057
  18:16:29 STEP 2590 H=2590:00 +CPU= 16.386
  18:16:45 STEP 2591 H=2591:00 +CPU= 16.057
  18:17:16 STEP 2592 H=2592:00 +CPU= 29.255
Moving to projects directory: /config/slots/3/ICMGGhq0f+002592
Moving to projects directory: /config/slots/3/ICMSHhq0f+002592
Moving to projects directory: /config/slots/3/ICMUAhq0f+002592
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002568
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002568
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002568
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002580
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002580
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002580
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_107.zip
Uploading the intermediate file: upload_file_107.zip
  18:17:32 STEP 2593 H=2593:00 +CPU= 15.605
  18:17:48 STEP 2594 H=2594:00 +CPU= 15.879
  18:18:14 STEP 2595 H=2595:00 +CPU= 24.975
  18:18:31 STEP 2596 H=2596:00 +CPU= 17.137
  18:18:48 STEP 2597 H=2597:00 +CPU= 16.250
  18:19:15 STEP 2598 H=2598:00 +CPU= 26.709
  18:19:32 STEP 2599 H=2599:00 +CPU= 16.318
  18:19:49 STEP 2600 H=2600:00 +CPU= 16.673
  18:20:18 STEP 2601 H=2601:00 +CPU= 27.382
  18:20:36 STEP 2602 H=2602:00 +CPU= 17.581
  18:20:52 STEP 2603 H=2603:00 +CPU= 15.747
  18:21:21 STEP 2604 H=2604:00 +CPU= 27.858
Moving to projects directory: /config/slots/3/ICMGGhq0f+002604
Moving to projects directory: /config/slots/3/ICMSHhq0f+002604
Moving to projects directory: /config/slots/3/ICMUAhq0f+002604
  18:21:39 STEP 2605 H=2605:00 +CPU= 16.977
  18:21:54 STEP 2606 H=2606:00 +CPU= 15.555
  18:22:19 STEP 2607 H=2607:00 +CPU= 24.481
  18:22:36 STEP 2608 H=2608:00 +CPU= 15.964
  18:22:52 STEP 2609 H=2609:00 +CPU= 15.991
  18:23:20 STEP 2610 H=2610:00 +CPU= 26.792
  18:23:36 STEP 2611 H=2611:00 +CPU= 16.153
  18:23:53 STEP 2612 H=2612:00 +CPU= 16.415
  18:24:19 STEP 2613 H=2613:00 +CPU= 25.338
  18:24:40 STEP 2614 H=2614:00 +CPU= 19.163
  18:24:56 STEP 2615 H=2615:00 +CPU= 15.891
  18:25:26 STEP 2616 H=2616:00 +CPU= 28.968
Moving to projects directory: /config/slots/3/ICMGGhq0f+002616
Moving to projects directory: /config/slots/3/ICMSHhq0f+002616
Moving to projects directory: /config/slots/3/ICMUAhq0f+002616
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002592
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002592
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002592
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002604
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002604
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002604
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_108.zip
Uploading the intermediate file: upload_file_108.zip
  18:25:44 STEP 2617 H=2617:00 +CPU= 16.797
  18:26:01 STEP 2618 H=2618:00 +CPU= 16.717
  18:26:26 STEP 2619 H=2619:00 +CPU= 24.789
  18:26:43 STEP 2620 H=2620:00 +CPU= 16.073
  18:26:59 STEP 2621 H=2621:00 +CPU= 15.612
  18:27:25 STEP 2622 H=2622:00 +CPU= 25.926
  18:27:43 STEP 2623 H=2623:00 +CPU= 17.048
  18:28:00 STEP 2624 H=2624:00 +CPU= 16.503
  18:28:25 STEP 2625 H=2625:00 +CPU= 25.086
  18:28:42 STEP 2626 H=2626:00 +CPU= 16.512
  18:28:59 STEP 2627 H=2627:00 +CPU= 16.406
  18:29:27 STEP 2628 H=2628:00 +CPU= 27.691
Moving to projects directory: /config/slots/3/ICMGGhq0f+002628
Moving to projects directory: /config/slots/3/ICMSHhq0f+002628
Moving to projects directory: /config/slots/3/ICMUAhq0f+002628
  18:29:43 STEP 2629 H=2629:00 +CPU= 15.821
  18:29:59 STEP 2630 H=2630:00 +CPU= 15.953
  18:30:26 STEP 2631 H=2631:00 +CPU= 25.317
  18:30:45 STEP 2632 H=2632:00 +CPU= 17.678
  18:31:00 STEP 2633 H=2633:00 +CPU= 15.448
  18:31:26 STEP 2634 H=2634:00 +CPU= 25.633
  18:31:43 STEP 2635 H=2635:00 +CPU= 15.958
  18:32:01 STEP 2636 H=2636:00 +CPU= 17.792
  18:32:27 STEP 2637 H=2637:00 +CPU= 25.301
  18:32:44 STEP 2638 H=2638:00 +CPU= 16.632
  18:33:01 STEP 2639 H=2639:00 +CPU= 16.852
  18:33:32 STEP 2640 H=2640:00 +CPU= 29.298
Moving to projects directory: /config/slots/3/ICMGGhq0f+002640
Moving to projects directory: /config/slots/3/ICMSHhq0f+002640
Moving to projects directory: /config/slots/3/ICMUAhq0f+002640
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002616
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002616
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002616
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002628
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002628
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002628
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_109.zip
Uploading the intermediate file: upload_file_109.zip
  18:33:48 STEP 2641 H=2641:00 +CPU= 15.572
  18:34:04 STEP 2642 H=2642:00 +CPU= 15.874
  18:34:28 STEP 2643 H=2643:00 +CPU= 24.114
  18:34:45 STEP 2644 H=2644:00 +CPU= 16.262
  18:35:03 STEP 2645 H=2645:00 +CPU= 17.171
  18:35:29 STEP 2646 H=2646:00 +CPU= 25.832
  18:35:48 STEP 2647 H=2647:00 +CPU= 17.483
  18:36:05 STEP 2648 H=2648:00 +CPU= 16.815
  18:36:31 STEP 2649 H=2649:00 +CPU= 25.876
  18:36:48 STEP 2650 H=2650:00 +CPU= 16.706
  18:37:05 STEP 2651 H=2651:00 +CPU= 16.097
  18:37:32 STEP 2652 H=2652:00 +CPU= 27.044
Moving to projects directory: /config/slots/3/ICMGGhq0f+002652
Moving to projects directory: /config/slots/3/ICMSHhq0f+002652
Moving to projects directory: /config/slots/3/ICMUAhq0f+002652
  18:37:48 STEP 2653 H=2653:00 +CPU= 15.641
  18:38:06 STEP 2654 H=2654:00 +CPU= 17.187
  18:38:31 STEP 2655 H=2655:00 +CPU= 24.338
  18:38:47 STEP 2656 H=2656:00 +CPU= 15.786
  18:39:03 STEP 2657 H=2657:00 +CPU= 15.991
  18:39:30 STEP 2658 H=2658:00 +CPU= 25.914
  18:39:47 STEP 2659 H=2659:00 +CPU= 16.838
  18:40:06 STEP 2660 H=2660:00 +CPU= 17.624
  18:40:33 STEP 2661 H=2661:00 +CPU= 26.684
  18:40:51 STEP 2662 H=2662:00 +CPU= 16.894
  18:41:09 STEP 2663 H=2663:00 +CPU= 17.620
  18:41:39 STEP 2664 H=2664:00 +CPU= 28.910
Moving to projects directory: /config/slots/3/ICMGGhq0f+002664
Moving to projects directory: /config/slots/3/ICMSHhq0f+002664
Moving to projects directory: /config/slots/3/ICMUAhq0f+002664
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002640
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002640
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002640
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002652
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002652
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002652
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_110.zip
Uploading the intermediate file: upload_file_110.zip
  18:41:55 STEP 2665 H=2665:00 +CPU= 15.592
  18:42:12 STEP 2666 H=2666:00 +CPU= 16.587
  18:42:38 STEP 2667 H=2667:00 +CPU= 25.711
  18:42:55 STEP 2668 H=2668:00 +CPU= 15.925
  18:43:11 STEP 2669 H=2669:00 +CPU= 15.981
  18:43:37 STEP 2670 H=2670:00 +CPU= 25.334
  18:43:53 STEP 2671 H=2671:00 +CPU= 16.166
  18:44:11 STEP 2672 H=2672:00 +CPU= 17.602
  18:44:37 STEP 2673 H=2673:00 +CPU= 24.963
  18:44:54 STEP 2674 H=2674:00 +CPU= 16.441
  18:45:11 STEP 2675 H=2675:00 +CPU= 16.518
  18:45:41 STEP 2676 H=2676:00 +CPU= 29.114
Moving to projects directory: /config/slots/3/ICMGGhq0f+002676
Moving to projects directory: /config/slots/3/ICMSHhq0f+002676
Moving to projects directory: /config/slots/3/ICMUAhq0f+002676
  18:45:57 STEP 2677 H=2677:00 +CPU= 15.538
  18:46:14 STEP 2678 H=2678:00 +CPU= 16.199
  18:46:38 STEP 2679 H=2679:00 +CPU= 24.373
  18:46:55 STEP 2680 H=2680:00 +CPU= 16.328
  18:47:12 STEP 2681 H=2681:00 +CPU= 16.757
  18:47:39 STEP 2682 H=2682:00 +CPU= 25.843
  18:47:58 STEP 2683 H=2683:00 +CPU= 17.953
  18:48:15 STEP 2684 H=2684:00 +CPU= 16.787
  18:48:42 STEP 2685 H=2685:00 +CPU= 25.999
  18:48:59 STEP 2686 H=2686:00 +CPU= 16.376
  18:49:16 STEP 2687 H=2687:00 +CPU= 16.838
  18:49:46 STEP 2688 H=2688:00 +CPU= 28.573
Moving to projects directory: /config/slots/3/ICMGGhq0f+002688
Moving to projects directory: /config/slots/3/ICMSHhq0f+002688
Moving to projects directory: /config/slots/3/ICMUAhq0f+002688
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002664
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002664
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002664
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002676
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002676
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002676
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_111.zip
Uploading the intermediate file: upload_file_111.zip
  18:50:06 STEP 2689 H=2689:00 +CPU= 18.535
  18:50:23 STEP 2690 H=2690:00 +CPU= 16.413
  18:50:50 STEP 2691 H=2691:00 +CPU= 25.382
  18:51:07 STEP 2692 H=2692:00 +CPU= 16.602
  18:51:24 STEP 2693 H=2693:00 +CPU= 16.783
  18:51:51 STEP 2694 H=2694:00 +CPU= 26.308
  18:52:08 STEP 2695 H=2695:00 +CPU= 16.458
  18:52:24 STEP 2696 H=2696:00 +CPU= 16.537
  18:52:50 STEP 2697 H=2697:00 +CPU= 24.753
  18:53:08 STEP 2698 H=2698:00 +CPU= 17.880
  18:53:24 STEP 2699 H=2699:00 +CPU= 15.746
  18:53:52 STEP 2700 H=2700:00 +CPU= 27.450
Moving to projects directory: /config/slots/3/ICMGGhq0f+002700
Moving to projects directory: /config/slots/3/ICMSHhq0f+002700
Moving to projects directory: /config/slots/3/ICMUAhq0f+002700
  18:54:08 STEP 2701 H=2701:00 +CPU= 15.937
  18:54:25 STEP 2702 H=2702:00 +CPU= 16.205
  18:54:50 STEP 2703 H=2703:00 +CPU= 24.855
  18:55:07 STEP 2704 H=2704:00 +CPU= 16.551
  18:55:23 STEP 2705 H=2705:00 +CPU= 15.572
  18:55:51 STEP 2706 H=2706:00 +CPU= 26.645
  18:56:10 STEP 2707 H=2707:00 +CPU= 17.854
  18:56:27 STEP 2708 H=2708:00 +CPU= 16.652
  18:56:52 STEP 2709 H=2709:00 +CPU= 24.801
  18:57:09 STEP 2710 H=2710:00 +CPU= 16.997
  18:57:26 STEP 2711 H=2711:00 +CPU= 16.807
  18:57:57 STEP 2712 H=2712:00 +CPU= 29.203
Moving to projects directory: /config/slots/3/ICMGGhq0f+002712
Moving to projects directory: /config/slots/3/ICMSHhq0f+002712
Moving to projects directory: /config/slots/3/ICMUAhq0f+002712
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002688
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002688
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002688
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002700
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002700
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002700
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_112.zip
Uploading the intermediate file: upload_file_112.zip
  18:58:13 STEP 2713 H=2713:00 +CPU= 16.023
  18:58:30 STEP 2714 H=2714:00 +CPU= 16.148
  18:58:55 STEP 2715 H=2715:00 +CPU= 24.592
  18:59:13 STEP 2716 H=2716:00 +CPU= 17.725
  18:59:30 STEP 2717 H=2717:00 +CPU= 16.223
  18:59:56 STEP 2718 H=2718:00 +CPU= 25.780
  19:00:14 STEP 2719 H=2719:00 +CPU= 17.558
  19:00:33 STEP 2720 H=2720:00 +CPU= 17.869
  19:01:02 STEP 2721 H=2721:00 +CPU= 27.287
  19:01:18 STEP 2722 H=2722:00 +CPU= 16.254
  19:01:35 STEP 2723 H=2723:00 +CPU= 16.381
  19:02:04 STEP 2724 H=2724:00 +CPU= 28.386
Moving to projects directory: /config/slots/3/ICMGGhq0f+002724
Moving to projects directory: /config/slots/3/ICMSHhq0f+002724
Moving to projects directory: /config/slots/3/ICMUAhq0f+002724
  19:02:20 STEP 2725 H=2725:00 +CPU= 15.852
  19:02:37 STEP 2726 H=2726:00 +CPU= 16.278
  19:03:03 STEP 2727 H=2727:00 +CPU= 24.897
  19:03:19 STEP 2728 H=2728:00 +CPU= 16.505
  19:03:37 STEP 2729 H=2729:00 +CPU= 17.562
  19:04:04 STEP 2730 H=2730:00 +CPU= 25.859
  19:04:20 STEP 2731 H=2731:00 +CPU= 15.846
  19:04:37 STEP 2732 H=2732:00 +CPU= 16.530
  19:05:08 STEP 2733 H=2733:00 +CPU= 28.486
  19:05:25 STEP 2734 H=2734:00 +CPU= 16.457
  19:05:43 STEP 2735 H=2735:00 +CPU= 17.724
  19:06:14 STEP 2736 H=2736:00 +CPU= 29.547
Moving to projects directory: /config/slots/3/ICMGGhq0f+002736
Moving to projects directory: /config/slots/3/ICMSHhq0f+002736
Moving to projects directory: /config/slots/3/ICMUAhq0f+002736
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002712
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002712
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002712
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002724
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002724
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002724
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_113.zip
Uploading the intermediate file: upload_file_113.zip
  19:06:31 STEP 2737 H=2737:00 +CPU= 16.578
  19:06:48 STEP 2738 H=2738:00 +CPU= 16.841
  19:07:14 STEP 2739 H=2739:00 +CPU= 25.254
  19:07:31 STEP 2740 H=2740:00 +CPU= 16.409
  19:07:47 STEP 2741 H=2741:00 +CPU= 15.831
  19:08:14 STEP 2742 H=2742:00 +CPU= 26.773
  19:08:34 STEP 2743 H=2743:00 +CPU= 18.164
  19:08:51 STEP 2744 H=2744:00 +CPU= 17.080
  19:09:17 STEP 2745 H=2745:00 +CPU= 25.202
  19:09:36 STEP 2746 H=2746:00 +CPU= 17.972
  19:09:52 STEP 2747 H=2747:00 +CPU= 15.986
  19:10:22 STEP 2748 H=2748:00 +CPU= 28.726
Moving to projects directory: /config/slots/3/ICMGGhq0f+002748
Moving to projects directory: /config/slots/3/ICMSHhq0f+002748
Moving to projects directory: /config/slots/3/ICMUAhq0f+002748
  19:10:40 STEP 2749 H=2749:00 +CPU= 16.908
  19:10:57 STEP 2750 H=2750:00 +CPU= 16.715
  19:11:23 STEP 2751 H=2751:00 +CPU= 25.525
  19:11:40 STEP 2752 H=2752:00 +CPU= 16.967
  19:11:57 STEP 2753 H=2753:00 +CPU= 16.059
  19:12:23 STEP 2754 H=2754:00 +CPU= 26.164
  19:12:41 STEP 2755 H=2755:00 +CPU= 17.354
  19:12:58 STEP 2756 H=2756:00 +CPU= 16.878
  19:13:25 STEP 2757 H=2757:00 +CPU= 25.676
  19:13:42 STEP 2758 H=2758:00 +CPU= 16.834
  19:14:00 STEP 2759 H=2759:00 +CPU= 17.157
  19:14:30 STEP 2760 H=2760:00 +CPU= 29.300
Moving to projects directory: /config/slots/3/ICMGGhq0f+002760
Moving to projects directory: /config/slots/3/ICMSHhq0f+002760
Moving to projects directory: /config/slots/3/ICMUAhq0f+002760
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002736
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002736
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002736
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002748
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002748
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002748
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_114.zip
Uploading the intermediate file: upload_file_114.zip
  19:14:46 STEP 2761 H=2761:00 +CPU= 15.809
  19:15:04 STEP 2762 H=2762:00 +CPU= 17.112
  19:15:31 STEP 2763 H=2763:00 +CPU= 26.013
  19:15:50 STEP 2764 H=2764:00 +CPU= 17.851
  19:16:07 STEP 2765 H=2765:00 +CPU= 16.459
  19:16:33 STEP 2766 H=2766:00 +CPU= 25.490
  19:16:49 STEP 2767 H=2767:00 +CPU= 15.934
  19:17:07 STEP 2768 H=2768:00 +CPU= 18.011
  19:17:33 STEP 2769 H=2769:00 +CPU= 25.124
  19:17:50 STEP 2770 H=2770:00 +CPU= 16.362
  19:18:06 STEP 2771 H=2771:00 +CPU= 16.251
  19:18:35 STEP 2772 H=2772:00 +CPU= 28.391
Moving to projects directory: /config/slots/3/ICMGGhq0f+002772
Moving to projects directory: /config/slots/3/ICMSHhq0f+002772
Moving to projects directory: /config/slots/3/ICMUAhq0f+002772
  19:18:51 STEP 2773 H=2773:00 +CPU= 15.844
  19:19:09 STEP 2774 H=2774:00 +CPU= 16.946
  19:19:34 STEP 2775 H=2775:00 +CPU= 24.749
  19:19:51 STEP 2776 H=2776:00 +CPU= 16.569
  19:20:09 STEP 2777 H=2777:00 +CPU= 17.562
  19:20:36 STEP 2778 H=2778:00 +CPU= 26.074
  19:20:53 STEP 2779 H=2779:00 +CPU= 16.408
  19:21:10 STEP 2780 H=2780:00 +CPU= 16.829
  19:21:37 STEP 2781 H=2781:00 +CPU= 26.264
  19:21:55 STEP 2782 H=2782:00 +CPU= 17.202
  19:22:13 STEP 2783 H=2783:00 +CPU= 17.093
  19:22:44 STEP 2784 H=2784:00 +CPU= 29.953
Moving to projects directory: /config/slots/3/ICMGGhq0f+002784
Moving to projects directory: /config/slots/3/ICMSHhq0f+002784
Moving to projects directory: /config/slots/3/ICMUAhq0f+002784
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002760
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002760
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002760
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002772
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002772
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002772
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_115.zip
Uploading the intermediate file: upload_file_115.zip
  19:23:02 STEP 2785 H=2785:00 +CPU= 17.239
Uploading trickle at timestep: 10022400
  19:23:21 STEP 2786 H=2786:00 +CPU= 18.254
  19:23:49 STEP 2787 H=2787:00 +CPU= 26.601
  19:24:06 STEP 2788 H=2788:00 +CPU= 17.243
  19:24:23 STEP 2789 H=2789:00 +CPU= 16.433
  19:24:51 STEP 2790 H=2790:00 +CPU= 27.059
  19:25:09 STEP 2791 H=2791:00 +CPU= 16.795
  19:25:25 STEP 2792 H=2792:00 +CPU= 16.560
  19:25:53 STEP 2793 H=2793:00 +CPU= 26.664
  19:26:12 STEP 2794 H=2794:00 +CPU= 18.215
  19:26:29 STEP 2795 H=2795:00 +CPU= 16.609
  19:26:58 STEP 2796 H=2796:00 +CPU= 28.406
Moving to projects directory: /config/slots/3/ICMGGhq0f+002796
Moving to projects directory: /config/slots/3/ICMSHhq0f+002796
Moving to projects directory: /config/slots/3/ICMUAhq0f+002796
  19:27:15 STEP 2797 H=2797:00 +CPU= 16.799
  19:27:34 STEP 2798 H=2798:00 +CPU= 17.915
  19:28:00 STEP 2799 H=2799:00 +CPU= 25.270
  19:28:17 STEP 2800 H=2800:00 +CPU= 16.850
  19:28:34 STEP 2801 H=2801:00 +CPU= 16.534
  19:29:02 STEP 2802 H=2802:00 +CPU= 26.806
  19:29:19 STEP 2803 H=2803:00 +CPU= 16.562
  19:29:36 STEP 2804 H=2804:00 +CPU= 16.827
  19:30:02 STEP 2805 H=2805:00 +CPU= 25.709
  19:30:19 STEP 2806 H=2806:00 +CPU= 16.790
  19:30:40 STEP 2807 H=2807:00 +CPU= 19.026
  19:31:12 STEP 2808 H=2808:00 +CPU= 30.198
Moving to projects directory: /config/slots/3/ICMGGhq0f+002808
Moving to projects directory: /config/slots/3/ICMSHhq0f+002808
Moving to projects directory: /config/slots/3/ICMUAhq0f+002808
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002784
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002784
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002784
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002796
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002796
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002796
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_116.zip
Uploading the intermediate file: upload_file_116.zip
  19:31:28 STEP 2809 H=2809:00 +CPU= 16.508
  19:31:46 STEP 2810 H=2810:00 +CPU= 17.251
  19:32:14 STEP 2811 H=2811:00 +CPU= 27.191
  19:32:32 STEP 2812 H=2812:00 +CPU= 17.500
  19:32:49 STEP 2813 H=2813:00 +CPU= 16.481
  19:33:16 STEP 2814 H=2814:00 +CPU= 26.668
  19:33:35 STEP 2815 H=2815:00 +CPU= 17.900
  19:33:52 STEP 2816 H=2816:00 +CPU= 16.883
  19:34:19 STEP 2817 H=2817:00 +CPU= 25.888
  19:34:36 STEP 2818 H=2818:00 +CPU= 17.157
  19:34:53 STEP 2819 H=2819:00 +CPU= 16.556
  19:35:24 STEP 2820 H=2820:00 +CPU= 29.584
Moving to projects directory: /config/slots/3/ICMGGhq0f+002820
Moving to projects directory: /config/slots/3/ICMSHhq0f+002820
Moving to projects directory: /config/slots/3/ICMUAhq0f+002820
  19:35:43 STEP 2821 H=2821:00 +CPU= 17.508
  19:36:00 STEP 2822 H=2822:00 +CPU= 16.769
  19:36:27 STEP 2823 H=2823:00 +CPU= 26.108
  19:36:45 STEP 2824 H=2824:00 +CPU= 17.816
  19:37:02 STEP 2825 H=2825:00 +CPU= 16.646
  19:37:28 STEP 2826 H=2826:00 +CPU= 25.631
  19:37:45 STEP 2827 H=2827:00 +CPU= 16.671
  19:38:04 STEP 2828 H=2828:00 +CPU= 18.188
  19:38:30 STEP 2829 H=2829:00 +CPU= 25.402
  19:38:47 STEP 2830 H=2830:00 +CPU= 16.752
  19:39:05 STEP 2831 H=2831:00 +CPU= 17.239
  19:39:38 STEP 2832 H=2832:00 +CPU= 31.315
Moving to projects directory: /config/slots/3/ICMGGhq0f+002832
Moving to projects directory: /config/slots/3/ICMSHhq0f+002832
Moving to projects directory: /config/slots/3/ICMUAhq0f+002832
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002808
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002808
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002808
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002820
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002820
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002820
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_117.zip
Uploading the intermediate file: upload_file_117.zip
  19:39:55 STEP 2833 H=2833:00 +CPU= 16.767
  19:40:15 STEP 2834 H=2834:00 +CPU= 18.681
  19:40:42 STEP 2835 H=2835:00 +CPU= 26.315
  19:41:01 STEP 2836 H=2836:00 +CPU= 17.612
  19:41:18 STEP 2837 H=2837:00 +CPU= 16.863
  19:41:44 STEP 2838 H=2838:00 +CPU= 26.036
  19:42:02 STEP 2839 H=2839:00 +CPU= 17.022
  19:42:19 STEP 2840 H=2840:00 +CPU= 17.099
  19:42:47 STEP 2841 H=2841:00 +CPU= 26.798
  19:43:05 STEP 2842 H=2842:00 +CPU= 17.124
  19:43:21 STEP 2843 H=2843:00 +CPU= 16.527
  19:43:51 STEP 2844 H=2844:00 +CPU= 28.767
Moving to projects directory: /config/slots/3/ICMGGhq0f+002844
Moving to projects directory: /config/slots/3/ICMSHhq0f+002844
Moving to projects directory: /config/slots/3/ICMUAhq0f+002844
  19:44:09 STEP 2845 H=2845:00 +CPU= 17.655
  19:44:26 STEP 2846 H=2846:00 +CPU= 16.470
  19:44:52 STEP 2847 H=2847:00 +CPU= 25.293
  19:45:10 STEP 2848 H=2848:00 +CPU= 17.398
  19:45:27 STEP 2849 H=2849:00 +CPU= 16.876
  19:45:56 STEP 2850 H=2850:00 +CPU= 27.655
  19:46:14 STEP 2851 H=2851:00 +CPU= 16.788
  19:46:31 STEP 2852 H=2852:00 +CPU= 16.962
  19:46:57 STEP 2853 H=2853:00 +CPU= 25.691
  19:47:16 STEP 2854 H=2854:00 +CPU= 18.026
  19:47:33 STEP 2855 H=2855:00 +CPU= 16.870
  19:48:06 STEP 2856 H=2856:00 +CPU= 30.869
Moving to projects directory: /config/slots/3/ICMGGhq0f+002856
Moving to projects directory: /config/slots/3/ICMSHhq0f+002856
Moving to projects directory: /config/slots/3/ICMUAhq0f+002856
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002832
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002832
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002832
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002844
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002844
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002844
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_118.zip
Uploading the intermediate file: upload_file_118.zip
  19:48:26 STEP 2857 H=2857:00 +CPU= 18.935
  19:48:45 STEP 2858 H=2858:00 +CPU= 17.603
  19:49:11 STEP 2859 H=2859:00 +CPU= 25.901
  19:49:28 STEP 2860 H=2860:00 +CPU= 16.711
  19:49:46 STEP 2861 H=2861:00 +CPU= 16.865
  19:50:14 STEP 2862 H=2862:00 +CPU= 27.677
  19:50:35 STEP 2863 H=2863:00 +CPU= 18.861
  19:50:54 STEP 2864 H=2864:00 +CPU= 17.805
  19:51:20 STEP 2865 H=2865:00 +CPU= 25.387
  19:51:39 STEP 2866 H=2866:00 +CPU= 18.367
  19:51:55 STEP 2867 H=2867:00 +CPU= 16.158
  19:52:25 STEP 2868 H=2868:00 +CPU= 28.935
Moving to projects directory: /config/slots/3/ICMGGhq0f+002868
Moving to projects directory: /config/slots/3/ICMSHhq0f+002868
Moving to projects directory: /config/slots/3/ICMUAhq0f+002868
  19:52:42 STEP 2869 H=2869:00 +CPU= 16.591
  19:53:00 STEP 2870 H=2870:00 +CPU= 17.613
  19:53:27 STEP 2871 H=2871:00 +CPU= 25.944
  19:53:44 STEP 2872 H=2872:00 +CPU= 16.917
  19:54:05 STEP 2873 H=2873:00 +CPU= 18.596
  19:54:32 STEP 2874 H=2874:00 +CPU= 26.799
  19:54:49 STEP 2875 H=2875:00 +CPU= 16.633
  19:55:07 STEP 2876 H=2876:00 +CPU= 17.381
  19:55:33 STEP 2877 H=2877:00 +CPU= 25.568
  19:55:52 STEP 2878 H=2878:00 +CPU= 17.934
  19:56:12 STEP 2879 H=2879:00 +CPU= 18.356
  19:56:43 STEP 2880 H=2880:00 +CPU= 30.415
Moving to projects directory: /config/slots/3/ICMGGhq0f+002880
Moving to projects directory: /config/slots/3/ICMSHhq0f+002880
Moving to projects directory: /config/slots/3/ICMUAhq0f+002880
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002856
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002856
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002856
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002868
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002868
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002868
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_119.zip
Uploading the intermediate file: upload_file_119.zip
  19:56:59 STEP 2881 H=2881:00 +CPU= 15.970
  19:57:15 STEP 2882 H=2882:00 +CPU= 15.106
  19:57:39 STEP 2883 H=2883:00 +CPU= 23.689
  19:57:54 STEP 2884 H=2884:00 +CPU= 14.649
  19:58:09 STEP 2885 H=2885:00 +CPU= 14.630
  19:58:32 STEP 2886 H=2886:00 +CPU= 23.243
  19:58:47 STEP 2887 H=2887:00 +CPU= 14.209
  19:59:03 STEP 2888 H=2888:00 +CPU= 15.929
  19:59:26 STEP 2889 H=2889:00 +CPU= 22.830
  19:59:41 STEP 2890 H=2890:00 +CPU= 14.821
  19:59:56 STEP 2891 H=2891:00 +CPU= 14.449
  20:00:25 STEP 2892 H=2892:00 +CPU= 27.888
Moving to projects directory: /config/slots/3/ICMGGhq0f+002892
Moving to projects directory: /config/slots/3/ICMSHhq0f+002892
Moving to projects directory: /config/slots/3/ICMUAhq0f+002892
  20:00:43 STEP 2893 H=2893:00 +CPU= 16.613
  20:00:59 STEP 2894 H=2894:00 +CPU= 15.970
  20:01:25 STEP 2895 H=2895:00 +CPU= 25.208
  20:01:42 STEP 2896 H=2896:00 +CPU= 16.887
  20:02:00 STEP 2897 H=2897:00 +CPU= 17.066
  20:02:27 STEP 2898 H=2898:00 +CPU= 26.655
  20:02:44 STEP 2899 H=2899:00 +CPU= 16.363
  20:03:01 STEP 2900 H=2900:00 +CPU= 16.919
  20:03:28 STEP 2901 H=2901:00 +CPU= 25.999
  20:03:46 STEP 2902 H=2902:00 +CPU= 17.812
  20:04:04 STEP 2903 H=2903:00 +CPU= 17.060
  20:04:35 STEP 2904 H=2904:00 +CPU= 29.796
Moving to projects directory: /config/slots/3/ICMGGhq0f+002904
Moving to projects directory: /config/slots/3/ICMSHhq0f+002904
Moving to projects directory: /config/slots/3/ICMUAhq0f+002904
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002880
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002880
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002880
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002892
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002892
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002892
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_120.zip
Uploading the intermediate file: upload_file_120.zip
  20:04:52 STEP 2905 H=2905:00 +CPU= 16.255
  20:05:11 STEP 2906 H=2906:00 +CPU= 18.437
  20:05:37 STEP 2907 H=2907:00 +CPU= 25.753
  20:05:56 STEP 2908 H=2908:00 +CPU= 17.589
  20:06:13 STEP 2909 H=2909:00 +CPU= 16.831
  20:06:41 STEP 2910 H=2910:00 +CPU= 26.860
  20:06:57 STEP 2911 H=2911:00 +CPU= 16.203
  20:07:15 STEP 2912 H=2912:00 +CPU= 17.319
  20:07:41 STEP 2913 H=2913:00 +CPU= 25.338
  20:07:58 STEP 2914 H=2914:00 +CPU= 17.081
  20:08:16 STEP 2915 H=2915:00 +CPU= 17.387
  20:08:45 STEP 2916 H=2916:00 +CPU= 28.088
Moving to projects directory: /config/slots/3/ICMGGhq0f+002916
Moving to projects directory: /config/slots/3/ICMSHhq0f+002916
Moving to projects directory: /config/slots/3/ICMUAhq0f+002916
  20:09:02 STEP 2917 H=2917:00 +CPU= 16.500
  20:09:18 STEP 2918 H=2918:00 +CPU= 16.431
  20:09:46 STEP 2919 H=2919:00 +CPU= 26.235
  20:10:04 STEP 2920 H=2920:00 +CPU= 17.325
  20:10:20 STEP 2921 H=2921:00 +CPU= 16.574
  20:10:48 STEP 2922 H=2922:00 +CPU= 26.724
  20:11:07 STEP 2923 H=2923:00 +CPU= 17.394
  20:11:23 STEP 2924 H=2924:00 +CPU= 16.445
  20:11:49 STEP 2925 H=2925:00 +CPU= 25.129
  20:12:06 STEP 2926 H=2926:00 +CPU= 16.976
  20:12:24 STEP 2927 H=2927:00 +CPU= 16.950
  20:12:56 STEP 2928 H=2928:00 +CPU= 30.735
Moving to projects directory: /config/slots/3/ICMGGhq0f+002928
Moving to projects directory: /config/slots/3/ICMSHhq0f+002928
Moving to projects directory: /config/slots/3/ICMUAhq0f+002928
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002904
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002904
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002904
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002916
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002916
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002916
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_121.zip
Uploading the intermediate file: upload_file_121.zip
  20:13:13 STEP 2929 H=2929:00 +CPU= 16.786
  20:13:30 STEP 2930 H=2930:00 +CPU= 16.675
  20:13:56 STEP 2931 H=2931:00 +CPU= 25.266
  20:14:14 STEP 2932 H=2932:00 +CPU= 17.549
  20:14:31 STEP 2933 H=2933:00 +CPU= 16.139
  20:14:56 STEP 2934 H=2934:00 +CPU= 25.243
  20:15:14 STEP 2935 H=2935:00 +CPU= 16.940
  20:15:32 STEP 2936 H=2936:00 +CPU= 17.531
  20:16:00 STEP 2937 H=2937:00 +CPU= 26.911
  20:16:17 STEP 2938 H=2938:00 +CPU= 16.770
  20:16:34 STEP 2939 H=2939:00 +CPU= 16.549
  20:17:04 STEP 2940 H=2940:00 +CPU= 28.716
Moving to projects directory: /config/slots/3/ICMGGhq0f+002940
Moving to projects directory: /config/slots/3/ICMSHhq0f+002940
Moving to projects directory: /config/slots/3/ICMUAhq0f+002940
  20:17:21 STEP 2941 H=2941:00 +CPU= 16.267
  20:17:38 STEP 2942 H=2942:00 +CPU= 16.606
  20:18:03 STEP 2943 H=2943:00 +CPU= 25.347
  20:18:20 STEP 2944 H=2944:00 +CPU= 16.530
  20:18:38 STEP 2945 H=2945:00 +CPU= 17.394
  20:19:05 STEP 2946 H=2946:00 +CPU= 25.847
  20:19:21 STEP 2947 H=2947:00 +CPU= 15.948
  20:19:38 STEP 2948 H=2948:00 +CPU= 16.889
  20:20:06 STEP 2949 H=2949:00 +CPU= 26.898
  20:20:24 STEP 2950 H=2950:00 +CPU= 16.904
  20:20:42 STEP 2951 H=2951:00 +CPU= 17.539
  20:21:13 STEP 2952 H=2952:00 +CPU= 29.481
The child process terminated with status: 0
Moving to projects directory: /config/slots/3/ICMGGhq0f+002952
Moving to projects directory: /config/slots/3/ICMSHhq0f+002952
Moving to projects directory: /config/slots/3/ICMUAhq0f+002952
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002928
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002928
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002928
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002940
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002940
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002940
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMGGhq0f+002952
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMSHhq0f+002952
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_ps_12170685/ICMUAhq0f+002952
Zipping up the final file: /config/projects/climateprediction.net/oifs_43r3_ps_0041_1985050100_123_954_12170685_0_r1633724426_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
20:24:36 (255): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:47:02 1520162 22255008 oifs_43r3_ps_0041_1985050100_123_954_12170685_0 10,623,600 70,514 0.0066
09 May 2023 15:46:56 1520162 22255008 oifs_43r3_ps_0041_1985050100_123_954_12170685_0 10,022,400 67,112 0.0067
09 May 2023 15:46:49 1520162 22255008 oifs_43r3_ps_0041_1985050100_123_954_12170685_0 9,158,400 62,354 0.0068
09 May 2023 15:46:39 1520162 22255008 oifs_43r3_ps_0041_1985050100_123_954_12170685_0 7,776,000 54,181 0.0070
09 May 2023 15:46:33 1520162 22255008 oifs_43r3_ps_0041_1985050100_123_954_12170685_0 6,912,000 48,997 0.0071
09 May 2023 15:46:23 1520162 22255008 oifs_43r3_ps_0041_1985050100_123_954_12170685_0 6,048,000 43,310 0.0072
09 May 2023 15:46:14 1520162 22255008 oifs_43r3_ps_0041_1985050100_123_954_12170685_0 5,184,000 37,755 0.0073
09 May 2023 15:46:08 1520162 22255008 oifs_43r3_ps_0041_1985050100_123_954_12170685_0 4,320,000 32,589 0.0075
09 May 2023 15:45:59 1520162 22255008 oifs_43r3_ps_0041_1985050100_123_954_12170685_0 3,456,000 25,898 0.0075
09 May 2023 15:45:50 1520162 22255008 oifs_43r3_ps_0041_1985050100_123_954_12170685_0 2,592,000 18,495 0.0071
09 May 2023 15:45:42 1520162 22255008 oifs_43r3_ps_0041_1985050100_123_954_12170685_0 1,728,000 11,147 0.0065
09 May 2023 15:45:33 1520162 22255008 oifs_43r3_ps_0041_1985050100_123_954_12170685_0 864,000 5,468 0.0063


©2024 cpdn.org