climateprediction.net home page
Task 22314963

Task 22314963

Name oifs_43r3_004z_2019110100_123_993_12213617_0
Workunit 12213617
Created 24 Feb 2023, 12:06:27 UTC
Sent 24 Feb 2023, 12:11:27 UTC
Report deadline 25 Apr 2023, 12:11:27 UTC
Received 27 Feb 2023, 5:34:28 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1534903
Run time 13 hours 28 min 21 sec
CPU time 13 hours 20 min 25 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 5.25 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,412.87 MB
Peak swap size 4,974.28 MB
Peak disk usage 1,457.65 MB
Stderr
<core_client_version>7.9.3</core_client_version>
<![CDATA[
<stderr_txt>
0 +CPU= 13.624
  03:00:26 STEP 2349 H=2349:00 +CPU= 20.604
  03:00:40 STEP 2350 H=2350:00 +CPU= 13.632
  03:00:54 STEP 2351 H=2351:00 +CPU= 13.644
  03:01:18 STEP 2352 H=2352:00 +CPU= 24.136
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002352
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002352
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002352
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002328
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002328
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002328
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002340
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002340
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002340
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_97.zip
Uploading the intermediate file: upload_file_97.zip
  03:01:31 STEP 2353 H=2353:00 +CPU= 13.211
  03:01:45 STEP 2354 H=2354:00 +CPU= 13.649
  03:02:06 STEP 2355 H=2355:00 +CPU= 20.575
  03:02:20 STEP 2356 H=2356:00 +CPU= 13.603
  03:02:33 STEP 2357 H=2357:00 +CPU= 13.230
  03:02:54 STEP 2358 H=2358:00 +CPU= 21.000
  03:03:08 STEP 2359 H=2359:00 +CPU= 13.347
  03:03:22 STEP 2360 H=2360:00 +CPU= 13.659
  03:03:42 STEP 2361 H=2361:00 +CPU= 20.631
  03:03:56 STEP 2362 H=2362:00 +CPU= 13.666
  03:04:10 STEP 2363 H=2363:00 +CPU= 13.268
  03:04:32 STEP 2364 H=2364:00 +CPU= 22.524
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002364
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002364
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002364
  03:04:45 STEP 2365 H=2365:00 +CPU= 13.258
  03:04:59 STEP 2366 H=2366:00 +CPU= 13.651
  03:05:20 STEP 2367 H=2367:00 +CPU= 20.625
  03:05:34 STEP 2368 H=2368:00 +CPU= 13.705
  03:05:47 STEP 2369 H=2369:00 +CPU= 13.248
  03:06:08 STEP 2370 H=2370:00 +CPU= 20.969
  03:06:21 STEP 2371 H=2371:00 +CPU= 13.293
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           29  MAX ETADOT VERTICAL VEL.=   3.663872195046101E-007
  LON  =    32.3437500000000       degrees
  LAT  =    42.0558239509352       degrees
  03:06:35 STEP 2372 H=2372:00 +CPU= 13.637
  03:06:56 STEP 2373 H=2373:00 +CPU= 20.548
  03:07:09 STEP 2374 H=2374:00 +CPU= 13.598
  03:07:23 STEP 2375 H=2375:00 +CPU= 13.665
  03:07:48 STEP 2376 H=2376:00 +CPU= 24.170
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002376
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002376
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002376
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002352
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002352
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002352
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002364
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002364
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002364
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_98.zip
Uploading the intermediate file: upload_file_98.zip
  03:08:01 STEP 2377 H=2377:00 +CPU= 13.278
  03:08:16 STEP 2378 H=2378:00 +CPU= 13.806
  03:08:37 STEP 2379 H=2379:00 +CPU= 20.582
  03:08:51 STEP 2380 H=2380:00 +CPU= 13.625
  03:09:04 STEP 2381 H=2381:00 +CPU= 13.248
  03:09:25 STEP 2382 H=2382:00 +CPU= 21.003
  03:09:38 STEP 2383 H=2383:00 +CPU= 13.258
  03:09:52 STEP 2384 H=2384:00 +CPU= 13.647
  03:10:13 STEP 2385 H=2385:00 +CPU= 20.587
  03:10:26 STEP 2386 H=2386:00 +CPU= 13.658
  03:10:40 STEP 2387 H=2387:00 +CPU= 13.326
  03:11:02 STEP 2388 H=2388:00 +CPU= 22.587
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002388
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002388
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002388
  03:11:16 STEP 2389 H=2389:00 +CPU= 13.297
  03:11:30 STEP 2390 H=2390:00 +CPU= 13.681
  03:11:50 STEP 2391 H=2391:00 +CPU= 20.575
  03:12:04 STEP 2392 H=2392:00 +CPU= 13.606
  03:12:17 STEP 2393 H=2393:00 +CPU= 13.228
  03:12:38 STEP 2394 H=2394:00 +CPU= 20.986
  03:12:51 STEP 2395 H=2395:00 +CPU= 13.244
  03:13:05 STEP 2396 H=2396:00 +CPU= 13.634
  03:13:26 STEP 2397 H=2397:00 +CPU= 20.597
  03:13:39 STEP 2398 H=2398:00 +CPU= 13.632
  03:13:53 STEP 2399 H=2399:00 +CPU= 13.659
  03:14:17 STEP 2400 H=2400:00 +CPU= 24.180
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002400
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002400
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002400
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002376
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002376
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002376
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002388
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002388
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002388
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_99.zip
Uploading the intermediate file: upload_file_99.zip
  03:14:31 STEP 2401 H=2401:00 +CPU= 13.253
Uploading trickle at timestep: 8640000
  03:14:45 STEP 2402 H=2402:00 +CPU= 13.640
  03:15:05 STEP 2403 H=2403:00 +CPU= 20.645
  03:15:19 STEP 2404 H=2404:00 +CPU= 13.647
  03:15:32 STEP 2405 H=2405:00 +CPU= 13.273
  03:15:54 STEP 2406 H=2406:00 +CPU= 21.118
  03:16:07 STEP 2407 H=2407:00 +CPU= 13.303
  03:16:21 STEP 2408 H=2408:00 +CPU= 13.686
  03:16:41 STEP 2409 H=2409:00 +CPU= 20.655
  03:16:55 STEP 2410 H=2410:00 +CPU= 13.682
  03:17:08 STEP 2411 H=2411:00 +CPU= 13.308
  03:17:31 STEP 2412 H=2412:00 +CPU= 22.584
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002412
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002412
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002412
  03:17:44 STEP 2413 H=2413:00 +CPU= 13.291
  03:17:58 STEP 2414 H=2414:00 +CPU= 13.675
  03:18:19 STEP 2415 H=2415:00 +CPU= 20.708
  03:18:33 STEP 2416 H=2416:00 +CPU= 13.694
  03:18:46 STEP 2417 H=2417:00 +CPU= 13.316
  03:19:07 STEP 2418 H=2418:00 +CPU= 21.081
  03:19:20 STEP 2419 H=2419:00 +CPU= 13.297
  03:19:34 STEP 2420 H=2420:00 +CPU= 13.676
  03:19:55 STEP 2421 H=2421:00 +CPU= 20.652
  03:20:08 STEP 2422 H=2422:00 +CPU= 13.677
  03:20:22 STEP 2423 H=2423:00 +CPU= 13.774
  03:20:47 STEP 2424 H=2424:00 +CPU= 24.392
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002424
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002424
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002424
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002400
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002400
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002400
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002412
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002412
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002412
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_100.zip
Uploading the intermediate file: upload_file_100.zip
  03:21:00 STEP 2425 H=2425:00 +CPU= 13.314
  03:21:14 STEP 2426 H=2426:00 +CPU= 13.700
  03:21:35 STEP 2427 H=2427:00 +CPU= 20.664
  03:21:49 STEP 2428 H=2428:00 +CPU= 13.676
  03:22:02 STEP 2429 H=2429:00 +CPU= 13.305
  03:22:23 STEP 2430 H=2430:00 +CPU= 21.088
  03:22:36 STEP 2431 H=2431:00 +CPU= 13.323
  03:22:50 STEP 2432 H=2432:00 +CPU= 13.707
  03:23:12 STEP 2433 H=2433:00 +CPU= 20.934
  03:23:26 STEP 2434 H=2434:00 +CPU= 13.784
  03:23:40 STEP 2435 H=2435:00 +CPU= 13.369
  03:24:02 STEP 2436 H=2436:00 +CPU= 22.675
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002436
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002436
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002436
  03:24:16 STEP 2437 H=2437:00 +CPU= 13.369
  03:24:29 STEP 2438 H=2438:00 +CPU= 13.749
  03:24:50 STEP 2439 H=2439:00 +CPU= 20.743
  03:25:04 STEP 2440 H=2440:00 +CPU= 13.750
  03:25:17 STEP 2441 H=2441:00 +CPU= 13.370
  03:25:39 STEP 2442 H=2442:00 +CPU= 21.167
  03:25:52 STEP 2443 H=2443:00 +CPU= 13.393
  03:26:06 STEP 2444 H=2444:00 +CPU= 13.713
  03:26:27 STEP 2445 H=2445:00 +CPU= 20.670
  03:26:40 STEP 2446 H=2446:00 +CPU= 13.703
  03:26:54 STEP 2447 H=2447:00 +CPU= 13.745
  03:27:19 STEP 2448 H=2448:00 +CPU= 24.323
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002448
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002448
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002448
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002424
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002424
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002424
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002436
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002436
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002436
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_101.zip
Uploading the intermediate file: upload_file_101.zip
  03:27:32 STEP 2449 H=2449:00 +CPU= 13.348
  03:27:46 STEP 2450 H=2450:00 +CPU= 13.730
  03:28:07 STEP 2451 H=2451:00 +CPU= 20.706
  03:28:21 STEP 2452 H=2452:00 +CPU= 13.789
  03:28:34 STEP 2453 H=2453:00 +CPU= 13.371
  03:28:55 STEP 2454 H=2454:00 +CPU= 21.185
  03:29:09 STEP 2455 H=2455:00 +CPU= 13.384
  03:29:22 STEP 2456 H=2456:00 +CPU= 13.799
  03:29:43 STEP 2457 H=2457:00 +CPU= 20.834
  03:29:57 STEP 2458 H=2458:00 +CPU= 13.767
  03:30:10 STEP 2459 H=2459:00 +CPU= 13.380
  03:30:33 STEP 2460 H=2460:00 +CPU= 22.690
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002460
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002460
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002460
  03:30:47 STEP 2461 H=2461:00 +CPU= 13.386
  03:31:01 STEP 2462 H=2462:00 +CPU= 13.907
  03:31:21 STEP 2463 H=2463:00 +CPU= 20.799
  03:31:35 STEP 2464 H=2464:00 +CPU= 13.790
  03:31:49 STEP 2465 H=2465:00 +CPU= 13.414
  03:32:10 STEP 2466 H=2466:00 +CPU= 21.280
  03:32:23 STEP 2467 H=2467:00 +CPU= 13.459
  03:32:37 STEP 2468 H=2468:00 +CPU= 13.801
  03:32:58 STEP 2469 H=2469:00 +CPU= 20.775
  03:33:12 STEP 2470 H=2470:00 +CPU= 13.872
  03:33:26 STEP 2471 H=2471:00 +CPU= 13.927
  03:33:51 STEP 2472 H=2472:00 +CPU= 24.481
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002472
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002472
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002472
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002448
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002448
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002448
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002460
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002460
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002460
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_102.zip
Uploading the intermediate file: upload_file_102.zip
  03:34:04 STEP 2473 H=2473:00 +CPU= 13.416
  03:34:18 STEP 2474 H=2474:00 +CPU= 13.801
  03:34:39 STEP 2475 H=2475:00 +CPU= 20.765
  03:34:53 STEP 2476 H=2476:00 +CPU= 13.813
  03:35:07 STEP 2477 H=2477:00 +CPU= 13.461
  03:35:28 STEP 2478 H=2478:00 +CPU= 21.259
  03:35:42 STEP 2479 H=2479:00 +CPU= 13.444
  03:35:56 STEP 2480 H=2480:00 +CPU= 13.843
  03:36:17 STEP 2481 H=2481:00 +CPU= 20.794
  03:36:30 STEP 2482 H=2482:00 +CPU= 13.812
  03:36:44 STEP 2483 H=2483:00 +CPU= 13.469
  03:37:07 STEP 2484 H=2484:00 +CPU= 22.887
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002484
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002484
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002484
  03:37:20 STEP 2485 H=2485:00 +CPU= 13.469
  03:37:34 STEP 2486 H=2486:00 +CPU= 13.851
  03:37:55 STEP 2487 H=2487:00 +CPU= 20.863
  03:38:09 STEP 2488 H=2488:00 +CPU= 13.846
  03:38:23 STEP 2489 H=2489:00 +CPU= 13.521
  03:38:45 STEP 2490 H=2490:00 +CPU= 21.559
  03:38:59 STEP 2491 H=2491:00 +CPU= 13.506
  03:39:13 STEP 2492 H=2492:00 +CPU= 13.842
  03:39:34 STEP 2493 H=2493:00 +CPU= 20.862
  03:39:48 STEP 2494 H=2494:00 +CPU= 13.843
  03:40:02 STEP 2495 H=2495:00 +CPU= 13.872
  03:40:27 STEP 2496 H=2496:00 +CPU= 24.514
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002496
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002496
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002496
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002472
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002472
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002472
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002484
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002484
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002484
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_103.zip
Uploading the intermediate file: upload_file_103.zip
  03:40:41 STEP 2497 H=2497:00 +CPU= 13.486
  03:40:55 STEP 2498 H=2498:00 +CPU= 13.835
  03:41:16 STEP 2499 H=2499:00 +CPU= 21.058
  03:41:30 STEP 2500 H=2500:00 +CPU= 13.852
  03:41:43 STEP 2501 H=2501:00 +CPU= 13.468
  03:42:05 STEP 2502 H=2502:00 +CPU= 21.335
  03:42:18 STEP 2503 H=2503:00 +CPU= 13.491
  03:42:32 STEP 2504 H=2504:00 +CPU= 13.854
  03:42:53 STEP 2505 H=2505:00 +CPU= 20.895
  03:43:07 STEP 2506 H=2506:00 +CPU= 13.858
  03:43:21 STEP 2507 H=2507:00 +CPU= 13.485
  03:43:44 STEP 2508 H=2508:00 +CPU= 22.876
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002508
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002508
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002508
  03:43:57 STEP 2509 H=2509:00 +CPU= 13.479
  03:44:11 STEP 2510 H=2510:00 +CPU= 13.864
  03:44:32 STEP 2511 H=2511:00 +CPU= 20.883
  03:44:46 STEP 2512 H=2512:00 +CPU= 13.866
  03:44:59 STEP 2513 H=2513:00 +CPU= 13.476
  03:45:21 STEP 2514 H=2514:00 +CPU= 21.328
  03:45:34 STEP 2515 H=2515:00 +CPU= 13.476
  03:45:48 STEP 2516 H=2516:00 +CPU= 13.858
  03:46:09 STEP 2517 H=2517:00 +CPU= 20.933
  03:46:23 STEP 2518 H=2518:00 +CPU= 13.841
  03:46:37 STEP 2519 H=2519:00 +CPU= 13.861
  03:47:02 STEP 2520 H=2520:00 +CPU= 24.459
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002520
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002520
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002520
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002496
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002496
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002496
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002508
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002508
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002508
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_104.zip
Uploading the intermediate file: upload_file_104.zip
  03:47:15 STEP 2521 H=2521:00 +CPU= 13.457
  03:47:29 STEP 2522 H=2522:00 +CPU= 13.874
  03:47:50 STEP 2523 H=2523:00 +CPU= 20.952
  03:48:04 STEP 2524 H=2524:00 +CPU= 13.879
  03:48:18 STEP 2525 H=2525:00 +CPU= 13.499
  03:48:39 STEP 2526 H=2526:00 +CPU= 21.455
  03:48:53 STEP 2527 H=2527:00 +CPU= 13.515
  03:49:07 STEP 2528 H=2528:00 +CPU= 13.876
  03:49:28 STEP 2529 H=2529:00 +CPU= 20.908
  03:49:42 STEP 2530 H=2530:00 +CPU= 13.877
  03:49:55 STEP 2531 H=2531:00 +CPU= 13.497
  03:50:18 STEP 2532 H=2532:00 +CPU= 22.854
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002532
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002532
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002532
  03:50:32 STEP 2533 H=2533:00 +CPU= 13.486
  03:50:45 STEP 2534 H=2534:00 +CPU= 13.864
  03:51:06 STEP 2535 H=2535:00 +CPU= 20.940
  03:51:20 STEP 2536 H=2536:00 +CPU= 13.891
  03:51:34 STEP 2537 H=2537:00 +CPU= 13.521
  03:51:56 STEP 2538 H=2538:00 +CPU= 21.321
  03:52:09 STEP 2539 H=2539:00 +CPU= 13.498
  03:52:23 STEP 2540 H=2540:00 +CPU= 13.888
  03:52:44 STEP 2541 H=2541:00 +CPU= 20.901
  03:52:58 STEP 2542 H=2542:00 +CPU= 13.845
  03:53:12 STEP 2543 H=2543:00 +CPU= 13.875
  03:53:38 STEP 2544 H=2544:00 +CPU= 24.661
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002544
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002544
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002544
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002520
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002520
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002520
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002532
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002532
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002532
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_105.zip
Uploading the intermediate file: upload_file_105.zip
  03:53:52 STEP 2545 H=2545:00 +CPU= 13.592
  03:54:05 STEP 2546 H=2546:00 +CPU= 13.870
  03:54:27 STEP 2547 H=2547:00 +CPU= 20.983
  03:54:40 STEP 2548 H=2548:00 +CPU= 13.863
  03:54:54 STEP 2549 H=2549:00 +CPU= 13.494
  03:55:15 STEP 2550 H=2550:00 +CPU= 21.386
  03:55:29 STEP 2551 H=2551:00 +CPU= 13.507
  03:55:43 STEP 2552 H=2552:00 +CPU= 13.887
  03:56:04 STEP 2553 H=2553:00 +CPU= 20.967
  03:56:18 STEP 2554 H=2554:00 +CPU= 13.932
  03:56:32 STEP 2555 H=2555:00 +CPU= 13.518
  03:56:55 STEP 2556 H=2556:00 +CPU= 22.916
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002556
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002556
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002556
  03:57:08 STEP 2557 H=2557:00 +CPU= 13.505
  03:57:22 STEP 2558 H=2558:00 +CPU= 13.879
  03:57:43 STEP 2559 H=2559:00 +CPU= 20.874
  03:57:57 STEP 2560 H=2560:00 +CPU= 13.845
  03:58:10 STEP 2561 H=2561:00 +CPU= 13.513
  03:58:32 STEP 2562 H=2562:00 +CPU= 21.335
  03:58:46 STEP 2563 H=2563:00 +CPU= 13.498
  03:59:00 STEP 2564 H=2564:00 +CPU= 13.818
  03:59:21 STEP 2565 H=2565:00 +CPU= 20.847
  03:59:34 STEP 2566 H=2566:00 +CPU= 13.828
  03:59:48 STEP 2567 H=2567:00 +CPU= 13.861
  04:00:13 STEP 2568 H=2568:00 +CPU= 24.539
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002568
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002568
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002568
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002544
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002544
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002544
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002556
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002556
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002556
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_106.zip
Uploading the intermediate file: upload_file_106.zip
  04:00:27 STEP 2569 H=2569:00 +CPU= 13.469
  04:00:40 STEP 2570 H=2570:00 +CPU= 13.858
  04:01:01 STEP 2571 H=2571:00 +CPU= 20.907
  04:01:16 STEP 2572 H=2572:00 +CPU= 13.900
  04:01:29 STEP 2573 H=2573:00 +CPU= 13.501
  04:01:51 STEP 2574 H=2574:00 +CPU= 21.360
  04:02:04 STEP 2575 H=2575:00 +CPU= 13.505
  04:02:18 STEP 2576 H=2576:00 +CPU= 13.889
  04:02:39 STEP 2577 H=2577:00 +CPU= 20.864
  04:02:53 STEP 2578 H=2578:00 +CPU= 13.859
  04:03:06 STEP 2579 H=2579:00 +CPU= 13.473
  04:03:29 STEP 2580 H=2580:00 +CPU= 22.813
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002580
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002580
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002580
  04:03:43 STEP 2581 H=2581:00 +CPU= 13.463
  04:03:57 STEP 2582 H=2582:00 +CPU= 13.907
  04:04:18 STEP 2583 H=2583:00 +CPU= 20.868
  04:04:31 STEP 2584 H=2584:00 +CPU= 13.849
  04:04:45 STEP 2585 H=2585:00 +CPU= 13.464
  04:05:06 STEP 2586 H=2586:00 +CPU= 21.292
  04:05:20 STEP 2587 H=2587:00 +CPU= 13.455
  04:05:33 STEP 2588 H=2588:00 +CPU= 13.823
  04:05:54 STEP 2589 H=2589:00 +CPU= 20.846
  04:06:08 STEP 2590 H=2590:00 +CPU= 13.813
  04:06:22 STEP 2591 H=2591:00 +CPU= 13.905
  04:06:47 STEP 2592 H=2592:00 +CPU= 24.451
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002592
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002592
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002592
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002568
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002568
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002568
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002580
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002580
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002580
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_107.zip
Uploading the intermediate file: upload_file_107.zip
  04:07:00 STEP 2593 H=2593:00 +CPU= 13.441
  04:07:15 STEP 2594 H=2594:00 +CPU= 13.895
  04:07:36 STEP 2595 H=2595:00 +CPU= 20.977
  04:07:50 STEP 2596 H=2596:00 +CPU= 13.875
  04:08:03 STEP 2597 H=2597:00 +CPU= 13.478
  04:08:25 STEP 2598 H=2598:00 +CPU= 21.445
  04:08:39 STEP 2599 H=2599:00 +CPU= 13.517
  04:08:53 STEP 2600 H=2600:00 +CPU= 13.916
  04:09:14 STEP 2601 H=2601:00 +CPU= 20.878
  04:09:28 STEP 2602 H=2602:00 +CPU= 13.856
  04:09:41 STEP 2603 H=2603:00 +CPU= 13.467
  04:10:04 STEP 2604 H=2604:00 +CPU= 22.883
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002604
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002604
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002604
  04:10:18 STEP 2605 H=2605:00 +CPU= 13.463
  04:10:32 STEP 2606 H=2606:00 +CPU= 13.833
  04:10:52 STEP 2607 H=2607:00 +CPU= 20.822
  04:11:06 STEP 2608 H=2608:00 +CPU= 13.828
  04:11:20 STEP 2609 H=2609:00 +CPU= 13.471
  04:11:41 STEP 2610 H=2610:00 +CPU= 21.252
  04:11:55 STEP 2611 H=2611:00 +CPU= 13.441
  04:12:09 STEP 2612 H=2612:00 +CPU= 13.801
  04:12:30 STEP 2613 H=2613:00 +CPU= 20.845
  04:12:43 STEP 2614 H=2614:00 +CPU= 13.818
  04:12:57 STEP 2615 H=2615:00 +CPU= 13.823
  04:13:22 STEP 2616 H=2616:00 +CPU= 24.404
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002616
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002616
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002616
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002592
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002592
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002592
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002604
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002604
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002604
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_108.zip
Uploading the intermediate file: upload_file_108.zip
  04:13:35 STEP 2617 H=2617:00 +CPU= 13.407
  04:13:49 STEP 2618 H=2618:00 +CPU= 13.798
  04:14:10 STEP 2619 H=2619:00 +CPU= 20.875
  04:14:24 STEP 2620 H=2620:00 +CPU= 13.769
  04:14:38 STEP 2621 H=2621:00 +CPU= 13.439
  04:14:59 STEP 2622 H=2622:00 +CPU= 21.264
  04:15:12 STEP 2623 H=2623:00 +CPU= 13.458
  04:15:26 STEP 2624 H=2624:00 +CPU= 13.856
  04:15:47 STEP 2625 H=2625:00 +CPU= 20.902
  04:16:01 STEP 2626 H=2626:00 +CPU= 13.824
  04:16:15 STEP 2627 H=2627:00 +CPU= 13.461
  04:16:38 STEP 2628 H=2628:00 +CPU= 22.843
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002628
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002628
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002628
  04:16:51 STEP 2629 H=2629:00 +CPU= 13.487
  04:17:05 STEP 2630 H=2630:00 +CPU= 13.824
  04:17:26 STEP 2631 H=2631:00 +CPU= 20.808
  04:17:40 STEP 2632 H=2632:00 +CPU= 13.792
  04:17:53 STEP 2633 H=2633:00 +CPU= 13.417
  04:18:14 STEP 2634 H=2634:00 +CPU= 21.207
  04:18:28 STEP 2635 H=2635:00 +CPU= 13.394
  04:18:41 STEP 2636 H=2636:00 +CPU= 13.776
  04:19:03 STEP 2637 H=2637:00 +CPU= 20.791
  04:19:16 STEP 2638 H=2638:00 +CPU= 13.760
  04:19:30 STEP 2639 H=2639:00 +CPU= 13.772
  04:19:54 STEP 2640 H=2640:00 +CPU= 24.329
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002640
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002640
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002640
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002616
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002616
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002616
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002628
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002628
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002628
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_109.zip
Uploading the intermediate file: upload_file_109.zip
  04:20:08 STEP 2641 H=2641:00 +CPU= 13.375
Uploading trickle at timestep: 9504000
  04:20:22 STEP 2642 H=2642:00 +CPU= 13.752
  04:20:43 STEP 2643 H=2643:00 +CPU= 20.746
  04:20:56 STEP 2644 H=2644:00 +CPU= 13.762
  04:21:10 STEP 2645 H=2645:00 +CPU= 13.432
  04:21:31 STEP 2646 H=2646:00 +CPU= 21.273
  04:21:45 STEP 2647 H=2647:00 +CPU= 13.461
  04:21:59 STEP 2648 H=2648:00 +CPU= 13.867
  04:22:20 STEP 2649 H=2649:00 +CPU= 20.856
  04:22:34 STEP 2650 H=2650:00 +CPU= 13.876
  04:22:47 STEP 2651 H=2651:00 +CPU= 13.456
  04:23:11 STEP 2652 H=2652:00 +CPU= 22.818
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002652
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002652
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002652
  04:23:24 STEP 2653 H=2653:00 +CPU= 13.554
  04:23:38 STEP 2654 H=2654:00 +CPU= 13.762
  04:23:59 STEP 2655 H=2655:00 +CPU= 20.774
  04:24:13 STEP 2656 H=2656:00 +CPU= 13.767
  04:24:26 STEP 2657 H=2657:00 +CPU= 13.409
  04:24:48 STEP 2658 H=2658:00 +CPU= 21.176
  04:25:01 STEP 2659 H=2659:00 +CPU= 13.381
  04:25:15 STEP 2660 H=2660:00 +CPU= 13.744
  04:25:36 STEP 2661 H=2661:00 +CPU= 20.730
  04:25:49 STEP 2662 H=2662:00 +CPU= 13.780
  04:26:03 STEP 2663 H=2663:00 +CPU= 13.812
  04:26:28 STEP 2664 H=2664:00 +CPU= 24.391
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002664
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002664
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002664
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002640
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002640
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002640
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002652
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002652
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002652
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_110.zip
Uploading the intermediate file: upload_file_110.zip
  04:26:41 STEP 2665 H=2665:00 +CPU= 13.464
  04:26:55 STEP 2666 H=2666:00 +CPU= 13.741
  04:27:16 STEP 2667 H=2667:00 +CPU= 20.853
  04:27:30 STEP 2668 H=2668:00 +CPU= 13.769
  04:27:44 STEP 2669 H=2669:00 +CPU= 13.390
  04:28:05 STEP 2670 H=2670:00 +CPU= 21.134
  04:28:18 STEP 2671 H=2671:00 +CPU= 13.375
  04:28:32 STEP 2672 H=2672:00 +CPU= 13.743
  04:28:53 STEP 2673 H=2673:00 +CPU= 20.683
  04:29:07 STEP 2674 H=2674:00 +CPU= 13.799
  04:29:20 STEP 2675 H=2675:00 +CPU= 13.396
  04:29:43 STEP 2676 H=2676:00 +CPU= 22.662
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002676
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002676
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002676
  04:29:56 STEP 2677 H=2677:00 +CPU= 13.416
  04:30:10 STEP 2678 H=2678:00 +CPU= 13.827
  04:30:31 STEP 2679 H=2679:00 +CPU= 20.719
  04:30:45 STEP 2680 H=2680:00 +CPU= 13.745
  04:30:58 STEP 2681 H=2681:00 +CPU= 13.356
  04:31:19 STEP 2682 H=2682:00 +CPU= 21.145
  04:31:32 STEP 2683 H=2683:00 +CPU= 13.397
  04:31:47 STEP 2684 H=2684:00 +CPU= 13.893
  04:32:07 STEP 2685 H=2685:00 +CPU= 20.796
  04:32:21 STEP 2686 H=2686:00 +CPU= 13.794
  04:32:35 STEP 2687 H=2687:00 +CPU= 13.832
  04:33:00 STEP 2688 H=2688:00 +CPU= 24.368
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002688
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002688
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002688
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002664
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002664
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002664
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002676
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002676
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002676
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_111.zip
Uploading the intermediate file: upload_file_111.zip
  04:33:13 STEP 2689 H=2689:00 +CPU= 13.339
  04:33:27 STEP 2690 H=2690:00 +CPU= 13.698
  04:33:48 STEP 2691 H=2691:00 +CPU= 20.697
  04:34:02 STEP 2692 H=2692:00 +CPU= 13.726
  04:34:15 STEP 2693 H=2693:00 +CPU= 13.405
  04:34:37 STEP 2694 H=2694:00 +CPU= 21.232
  04:34:50 STEP 2695 H=2695:00 +CPU= 13.390
  04:35:04 STEP 2696 H=2696:00 +CPU= 13.765
  04:35:25 STEP 2697 H=2697:00 +CPU= 20.745
  04:35:39 STEP 2698 H=2698:00 +CPU= 13.773
  04:35:52 STEP 2699 H=2699:00 +CPU= 13.415
  04:36:15 STEP 2700 H=2700:00 +CPU= 22.706
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002700
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002700
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002700
  04:36:28 STEP 2701 H=2701:00 +CPU= 13.370
  04:36:42 STEP 2702 H=2702:00 +CPU= 13.776
  04:37:03 STEP 2703 H=2703:00 +CPU= 20.797
  04:37:17 STEP 2704 H=2704:00 +CPU= 13.798
  04:37:31 STEP 2705 H=2705:00 +CPU= 13.369
  04:37:52 STEP 2706 H=2706:00 +CPU= 21.224
  04:38:06 STEP 2707 H=2707:00 +CPU= 13.520
  04:38:20 STEP 2708 H=2708:00 +CPU= 13.795
  04:38:41 STEP 2709 H=2709:00 +CPU= 20.751
  04:38:55 STEP 2710 H=2710:00 +CPU= 13.706
  04:39:09 STEP 2711 H=2711:00 +CPU= 13.719
  04:39:33 STEP 2712 H=2712:00 +CPU= 24.299
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002712
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002712
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002712
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002688
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002688
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002688
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002700
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002700
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002700
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_112.zip
Uploading the intermediate file: upload_file_112.zip
  04:39:46 STEP 2713 H=2713:00 +CPU= 13.271
  04:40:00 STEP 2714 H=2714:00 +CPU= 13.652
  04:40:21 STEP 2715 H=2715:00 +CPU= 20.704
  04:40:35 STEP 2716 H=2716:00 +CPU= 13.707
  04:40:48 STEP 2717 H=2717:00 +CPU= 13.328
  04:41:09 STEP 2718 H=2718:00 +CPU= 21.146
  04:41:23 STEP 2719 H=2719:00 +CPU= 13.327
  04:41:36 STEP 2720 H=2720:00 +CPU= 13.716
  04:41:57 STEP 2721 H=2721:00 +CPU= 20.747
  04:42:11 STEP 2722 H=2722:00 +CPU= 13.715
  04:42:24 STEP 2723 H=2723:00 +CPU= 13.346
  04:42:47 STEP 2724 H=2724:00 +CPU= 22.660
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002724
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002724
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002724
  04:43:01 STEP 2725 H=2725:00 +CPU= 13.326
  04:43:14 STEP 2726 H=2726:00 +CPU= 13.720
  04:43:35 STEP 2727 H=2727:00 +CPU= 20.692
  04:43:49 STEP 2728 H=2728:00 +CPU= 13.712
  04:44:02 STEP 2729 H=2729:00 +CPU= 13.337
  04:44:24 STEP 2730 H=2730:00 +CPU= 21.158
  04:44:37 STEP 2731 H=2731:00 +CPU= 13.347
  04:44:51 STEP 2732 H=2732:00 +CPU= 13.716
  04:45:11 STEP 2733 H=2733:00 +CPU= 20.682
  04:45:25 STEP 2734 H=2734:00 +CPU= 13.647
  04:45:39 STEP 2735 H=2735:00 +CPU= 13.685
  04:46:03 STEP 2736 H=2736:00 +CPU= 24.239
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002736
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002736
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002736
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002712
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002712
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002712
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002724
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002724
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002724
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_113.zip
Uploading the intermediate file: upload_file_113.zip
  04:46:17 STEP 2737 H=2737:00 +CPU= 13.299
  04:46:30 STEP 2738 H=2738:00 +CPU= 13.662
  04:46:51 STEP 2739 H=2739:00 +CPU= 20.786
  04:47:05 STEP 2740 H=2740:00 +CPU= 13.677
  04:47:18 STEP 2741 H=2741:00 +CPU= 13.310
  04:47:39 STEP 2742 H=2742:00 +CPU= 21.056
  04:47:53 STEP 2743 H=2743:00 +CPU= 13.286
  04:48:06 STEP 2744 H=2744:00 +CPU= 13.664
  04:48:27 STEP 2745 H=2745:00 +CPU= 20.632
  04:48:41 STEP 2746 H=2746:00 +CPU= 13.664
  04:48:54 STEP 2747 H=2747:00 +CPU= 13.286
  04:49:17 STEP 2748 H=2748:00 +CPU= 22.531
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002748
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002748
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002748
  04:49:30 STEP 2749 H=2749:00 +CPU= 13.346
  04:49:44 STEP 2750 H=2750:00 +CPU= 13.662
  04:50:05 STEP 2751 H=2751:00 +CPU= 20.627
  04:50:18 STEP 2752 H=2752:00 +CPU= 13.660
  04:50:32 STEP 2753 H=2753:00 +CPU= 13.280
  04:50:53 STEP 2754 H=2754:00 +CPU= 21.022
  04:51:06 STEP 2755 H=2755:00 +CPU= 13.273
  04:51:20 STEP 2756 H=2756:00 +CPU= 13.636
  04:51:40 STEP 2757 H=2757:00 +CPU= 20.574
  04:51:54 STEP 2758 H=2758:00 +CPU= 13.684
  04:52:08 STEP 2759 H=2759:00 +CPU= 13.710
  04:52:32 STEP 2760 H=2760:00 +CPU= 24.255
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002760
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002760
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002760
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002736
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002736
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002736
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002748
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002748
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002748
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_114.zip
Uploading the intermediate file: upload_file_114.zip
  04:52:46 STEP 2761 H=2761:00 +CPU= 13.269
  04:53:00 STEP 2762 H=2762:00 +CPU= 13.630
  04:53:20 STEP 2763 H=2763:00 +CPU= 20.610
  04:53:34 STEP 2764 H=2764:00 +CPU= 13.672
  04:53:47 STEP 2765 H=2765:00 +CPU= 13.360
  04:54:10 STEP 2766 H=2766:00 +CPU= 21.308
  04:54:23 STEP 2767 H=2767:00 +CPU= 13.359
  04:54:37 STEP 2768 H=2768:00 +CPU= 13.684
  04:54:58 STEP 2769 H=2769:00 +CPU= 20.627
  04:55:12 STEP 2770 H=2770:00 +CPU= 13.671
  04:55:25 STEP 2771 H=2771:00 +CPU= 13.271
  04:55:47 STEP 2772 H=2772:00 +CPU= 22.490
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002772
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002772
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002772
  04:56:01 STEP 2773 H=2773:00 +CPU= 13.279
  04:56:15 STEP 2774 H=2774:00 +CPU= 13.638
  04:56:35 STEP 2775 H=2775:00 +CPU= 20.537
  04:56:49 STEP 2776 H=2776:00 +CPU= 13.607
  04:57:02 STEP 2777 H=2777:00 +CPU= 13.292
  04:57:23 STEP 2778 H=2778:00 +CPU= 20.979
  04:57:37 STEP 2779 H=2779:00 +CPU= 13.263
  04:57:50 STEP 2780 H=2780:00 +CPU= 13.658
  04:58:11 STEP 2781 H=2781:00 +CPU= 20.639
  04:58:25 STEP 2782 H=2782:00 +CPU= 13.628
  04:58:38 STEP 2783 H=2783:00 +CPU= 13.625
  04:59:03 STEP 2784 H=2784:00 +CPU= 24.108
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002784
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002784
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002784
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002760
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002760
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002760
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002772
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002772
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002772
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_115.zip
Uploading the intermediate file: upload_file_115.zip
  04:59:16 STEP 2785 H=2785:00 +CPU= 13.218
  04:59:30 STEP 2786 H=2786:00 +CPU= 13.658
  04:59:50 STEP 2787 H=2787:00 +CPU= 20.561
  05:00:04 STEP 2788 H=2788:00 +CPU= 13.619
  05:00:17 STEP 2789 H=2789:00 +CPU= 13.261
  05:00:38 STEP 2790 H=2790:00 +CPU= 21.019
  05:00:52 STEP 2791 H=2791:00 +CPU= 13.267
  05:01:05 STEP 2792 H=2792:00 +CPU= 13.702
  05:01:26 STEP 2793 H=2793:00 +CPU= 20.703
  05:01:40 STEP 2794 H=2794:00 +CPU= 13.678
  05:01:53 STEP 2795 H=2795:00 +CPU= 13.309
  05:02:16 STEP 2796 H=2796:00 +CPU= 22.640
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002796
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002796
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002796
  05:02:30 STEP 2797 H=2797:00 +CPU= 13.282
  05:02:43 STEP 2798 H=2798:00 +CPU= 13.688
  05:03:04 STEP 2799 H=2799:00 +CPU= 20.693
  05:03:18 STEP 2800 H=2800:00 +CPU= 13.666
  05:03:31 STEP 2801 H=2801:00 +CPU= 13.280
  05:03:52 STEP 2802 H=2802:00 +CPU= 21.052
  05:04:05 STEP 2803 H=2803:00 +CPU= 13.268
  05:04:19 STEP 2804 H=2804:00 +CPU= 13.641
  05:04:40 STEP 2805 H=2805:00 +CPU= 20.585
  05:04:54 STEP 2806 H=2806:00 +CPU= 13.607
  05:05:07 STEP 2807 H=2807:00 +CPU= 13.626
  05:05:31 STEP 2808 H=2808:00 +CPU= 24.181
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002808
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002808
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002808
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002784
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002784
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002784
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002796
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002796
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002796
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_116.zip
Uploading the intermediate file: upload_file_116.zip
  05:05:45 STEP 2809 H=2809:00 +CPU= 13.237
  05:05:59 STEP 2810 H=2810:00 +CPU= 13.607
  05:06:19 STEP 2811 H=2811:00 +CPU= 20.571
  05:06:33 STEP 2812 H=2812:00 +CPU= 13.634
  05:06:46 STEP 2813 H=2813:00 +CPU= 13.288
  05:07:08 STEP 2814 H=2814:00 +CPU= 21.072
  05:07:21 STEP 2815 H=2815:00 +CPU= 13.262
  05:07:35 STEP 2816 H=2816:00 +CPU= 13.638
  05:07:55 STEP 2817 H=2817:00 +CPU= 20.583
  05:08:09 STEP 2818 H=2818:00 +CPU= 13.726
  05:08:23 STEP 2819 H=2819:00 +CPU= 13.313
  05:08:46 STEP 2820 H=2820:00 +CPU= 22.733
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002820
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002820
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002820
  05:09:00 STEP 2821 H=2821:00 +CPU= 13.310
  05:09:13 STEP 2822 H=2822:00 +CPU= 13.639
  05:09:34 STEP 2823 H=2823:00 +CPU= 20.592
  05:09:48 STEP 2824 H=2824:00 +CPU= 13.633
  05:10:01 STEP 2825 H=2825:00 +CPU= 13.249
  05:10:22 STEP 2826 H=2826:00 +CPU= 21.049
  05:10:35 STEP 2827 H=2827:00 +CPU= 13.252
  05:10:49 STEP 2828 H=2828:00 +CPU= 13.613
  05:11:10 STEP 2829 H=2829:00 +CPU= 20.522
  05:11:23 STEP 2830 H=2830:00 +CPU= 13.603
  05:11:37 STEP 2831 H=2831:00 +CPU= 13.621
  05:12:01 STEP 2832 H=2832:00 +CPU= 24.102
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002832
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002832
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002832
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002808
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002808
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002808
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002820
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002820
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002820
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_117.zip
Uploading the intermediate file: upload_file_117.zip
  05:12:15 STEP 2833 H=2833:00 +CPU= 13.334
  05:12:29 STEP 2834 H=2834:00 +CPU= 13.614
  05:12:49 STEP 2835 H=2835:00 +CPU= 20.553
  05:13:03 STEP 2836 H=2836:00 +CPU= 13.615
  05:13:16 STEP 2837 H=2837:00 +CPU= 13.246
  05:13:37 STEP 2838 H=2838:00 +CPU= 21.000
  05:13:51 STEP 2839 H=2839:00 +CPU= 13.259
  05:14:04 STEP 2840 H=2840:00 +CPU= 13.632
  05:14:25 STEP 2841 H=2841:00 +CPU= 20.584
  05:14:39 STEP 2842 H=2842:00 +CPU= 13.695
  05:14:52 STEP 2843 H=2843:00 +CPU= 13.304
  05:15:15 STEP 2844 H=2844:00 +CPU= 22.583
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002844
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002844
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002844
  05:15:28 STEP 2845 H=2845:00 +CPU= 13.289
  05:15:42 STEP 2846 H=2846:00 +CPU= 13.681
  05:16:02 STEP 2847 H=2847:00 +CPU= 20.635
  05:16:16 STEP 2848 H=2848:00 +CPU= 13.673
  05:16:30 STEP 2849 H=2849:00 +CPU= 13.293
  05:16:51 STEP 2850 H=2850:00 +CPU= 20.997
  05:17:04 STEP 2851 H=2851:00 +CPU= 13.285
  05:17:18 STEP 2852 H=2852:00 +CPU= 13.764
  05:17:39 STEP 2853 H=2853:00 +CPU= 20.675
  05:17:53 STEP 2854 H=2854:00 +CPU= 13.682
  05:18:07 STEP 2855 H=2855:00 +CPU= 13.738
  05:18:32 STEP 2856 H=2856:00 +CPU= 24.240
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002856
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002856
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002856
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002832
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002832
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002832
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002844
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002844
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002844
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_118.zip
Uploading the intermediate file: upload_file_118.zip
  05:18:45 STEP 2857 H=2857:00 +CPU= 13.284
  05:18:59 STEP 2858 H=2858:00 +CPU= 13.676
  05:19:20 STEP 2859 H=2859:00 +CPU= 20.709
  05:19:33 STEP 2860 H=2860:00 +CPU= 13.673
  05:19:47 STEP 2861 H=2861:00 +CPU= 13.354
  05:20:08 STEP 2862 H=2862:00 +CPU= 21.079
  05:20:21 STEP 2863 H=2863:00 +CPU= 13.297
  05:20:35 STEP 2864 H=2864:00 +CPU= 13.674
  05:20:55 STEP 2865 H=2865:00 +CPU= 20.608
  05:21:09 STEP 2866 H=2866:00 +CPU= 13.670
  05:21:23 STEP 2867 H=2867:00 +CPU= 13.293
  05:21:45 STEP 2868 H=2868:00 +CPU= 22.569
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002868
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002868
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002868
  05:21:59 STEP 2869 H=2869:00 +CPU= 13.341
  05:22:13 STEP 2870 H=2870:00 +CPU= 13.692
  05:22:34 STEP 2871 H=2871:00 +CPU= 20.689
  05:22:47 STEP 2872 H=2872:00 +CPU= 13.693
  05:23:01 STEP 2873 H=2873:00 +CPU= 13.298
  05:23:22 STEP 2874 H=2874:00 +CPU= 21.083
  05:23:37 STEP 2875 H=2875:00 +CPU= 13.482
  05:23:51 STEP 2876 H=2876:00 +CPU= 13.804
  05:24:11 STEP 2877 H=2877:00 +CPU= 20.688
  05:24:25 STEP 2878 H=2878:00 +CPU= 13.684
  05:24:39 STEP 2879 H=2879:00 +CPU= 13.707
  05:25:03 STEP 2880 H=2880:00 +CPU= 24.241
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002880
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002880
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002880
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002856
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002856
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002856
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002868
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002868
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002868
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_119.zip
Uploading the intermediate file: upload_file_119.zip
  05:25:17 STEP 2881 H=2881:00 +CPU= 13.313
Uploading trickle at timestep: 10368000
  05:25:31 STEP 2882 H=2882:00 +CPU= 13.677
  05:25:51 STEP 2883 H=2883:00 +CPU= 20.619
  05:26:05 STEP 2884 H=2884:00 +CPU= 13.658
  05:26:18 STEP 2885 H=2885:00 +CPU= 13.290
  05:26:39 STEP 2886 H=2886:00 +CPU= 21.046
  05:26:53 STEP 2887 H=2887:00 +CPU= 13.297
  05:27:06 STEP 2888 H=2888:00 +CPU= 13.681
  05:27:27 STEP 2889 H=2889:00 +CPU= 20.636
  05:27:41 STEP 2890 H=2890:00 +CPU= 13.692
  05:27:54 STEP 2891 H=2891:00 +CPU= 13.314
  05:28:17 STEP 2892 H=2892:00 +CPU= 22.571
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002892
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002892
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002892
  05:28:30 STEP 2893 H=2893:00 +CPU= 13.341
  05:28:44 STEP 2894 H=2894:00 +CPU= 13.723
  05:29:05 STEP 2895 H=2895:00 +CPU= 20.623
  05:29:18 STEP 2896 H=2896:00 +CPU= 13.683
  05:29:32 STEP 2897 H=2897:00 +CPU= 13.294
  05:29:53 STEP 2898 H=2898:00 +CPU= 21.107
  05:30:07 STEP 2899 H=2899:00 +CPU= 13.332
  05:30:21 STEP 2900 H=2900:00 +CPU= 13.695
  05:30:41 STEP 2901 H=2901:00 +CPU= 20.599
  05:30:55 STEP 2902 H=2902:00 +CPU= 13.662
  05:31:09 STEP 2903 H=2903:00 +CPU= 13.686
  05:31:33 STEP 2904 H=2904:00 +CPU= 24.177
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002904
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002904
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002904
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002880
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002880
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002880
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002892
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002892
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002892
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_120.zip
Uploading the intermediate file: upload_file_120.zip
  05:31:46 STEP 2905 H=2905:00 +CPU= 13.318
  05:32:00 STEP 2906 H=2906:00 +CPU= 13.709
  05:32:21 STEP 2907 H=2907:00 +CPU= 20.771
  05:32:35 STEP 2908 H=2908:00 +CPU= 13.713
  05:32:48 STEP 2909 H=2909:00 +CPU= 13.338
  05:33:10 STEP 2910 H=2910:00 +CPU= 21.110
  05:33:23 STEP 2911 H=2911:00 +CPU= 13.364
  05:33:37 STEP 2912 H=2912:00 +CPU= 13.738
  05:33:57 STEP 2913 H=2913:00 +CPU= 20.692
  05:34:11 STEP 2914 H=2914:00 +CPU= 13.733
  05:34:25 STEP 2915 H=2915:00 +CPU= 13.359
  05:34:47 STEP 2916 H=2916:00 +CPU= 22.627
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002916
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002916
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002916
  05:35:01 STEP 2917 H=2917:00 +CPU= 13.413
  05:35:15 STEP 2918 H=2918:00 +CPU= 13.781
  05:35:36 STEP 2919 H=2919:00 +CPU= 20.727
  05:35:49 STEP 2920 H=2920:00 +CPU= 13.718
  05:36:03 STEP 2921 H=2921:00 +CPU= 13.331
  05:36:24 STEP 2922 H=2922:00 +CPU= 21.060
  05:36:37 STEP 2923 H=2923:00 +CPU= 13.324
  05:36:51 STEP 2924 H=2924:00 +CPU= 13.696
  05:37:11 STEP 2925 H=2925:00 +CPU= 20.622
  05:37:25 STEP 2926 H=2926:00 +CPU= 13.790
  05:37:39 STEP 2927 H=2927:00 +CPU= 13.766
  05:38:04 STEP 2928 H=2928:00 +CPU= 24.276
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002928
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002928
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002928
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002904
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002904
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002904
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002916
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002916
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002916
Zipping up the intermediate file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_121.zip
Uploading the intermediate file: upload_file_121.zip
  05:38:18 STEP 2929 H=2929:00 +CPU= 13.453
  05:38:32 STEP 2930 H=2930:00 +CPU= 13.711
  05:38:53 STEP 2931 H=2931:00 +CPU= 20.688
  05:39:07 STEP 2932 H=2932:00 +CPU= 13.709
  05:39:20 STEP 2933 H=2933:00 +CPU= 13.335
  05:39:41 STEP 2934 H=2934:00 +CPU= 21.082
  05:39:55 STEP 2935 H=2935:00 +CPU= 13.372
  05:40:09 STEP 2936 H=2936:00 +CPU= 13.842
  05:40:29 STEP 2937 H=2937:00 +CPU= 20.661
  05:40:43 STEP 2938 H=2938:00 +CPU= 13.698
  05:40:57 STEP 2939 H=2939:00 +CPU= 13.329
  05:41:19 STEP 2940 H=2940:00 +CPU= 22.566
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002940
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002940
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002940
  05:41:32 STEP 2941 H=2941:00 +CPU= 13.316
  05:41:46 STEP 2942 H=2942:00 +CPU= 13.704
  05:42:07 STEP 2943 H=2943:00 +CPU= 20.642
  05:42:21 STEP 2944 H=2944:00 +CPU= 13.738
  05:42:34 STEP 2945 H=2945:00 +CPU= 13.397
  05:42:56 STEP 2946 H=2946:00 +CPU= 21.122
  05:43:09 STEP 2947 H=2947:00 +CPU= 13.362
  05:43:23 STEP 2948 H=2948:00 +CPU= 13.714
  05:43:44 STEP 2949 H=2949:00 +CPU= 20.637
  05:43:57 STEP 2950 H=2950:00 +CPU= 13.699
  05:44:11 STEP 2951 H=2951:00 +CPU= 13.724
  05:44:35 STEP 2952 H=2952:00 +CPU= 23.308
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.19925486346338E-02 -1.00000000000000E+00  1.00000000000000E+00
  MAXGPFV : MAX. VALUE =    1.18310829420388     
  MAXGPFV : MAX. VALUE =   0.746105382113943     
 NSTEP =  2952 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+002952 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+002952
 MPI-TASK:   1 -    314514330 BYTES IN      8 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0068( 2.9%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302231500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302233000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302234500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200303000000  !!!!!!!!!!!! 
 05:44:35 STEP 2952 H=2952:00 +CPU= 23.308
 END CNT3
 NSTEP =  2952 CNT0   000000000  20.212  20.212  20.298   0.996               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ          654/    28953814 WRITTEN        46048/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1   1116    0      654        28275    46048 ************   137.0     0.0   137.0     0.6   217.7
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********    100.00      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 3200    1360.0    1360.0      9.01      0.00
   9 SPCM     - SPECTRAL COMP.                    2952     223.6     223.6      1.37      0.00
  10 SCAN2M - PHYSICS                             2953    6900.1    6900.1     42.19      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                247     839.9     839.9      0.43      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                126      10.1      10.1      0.00      0.00
  13 SCAN2M - RADIATION CALC.                      985    7326.8    7326.8     14.94      0.00
  14 SUINIF                                          1    1129.2    1129.2      0.00      0.00
  17 GRIDFPOS IN CNT4                              247      26.4      26.4      0.01      0.00
  18 SUSPECG                                         1     201.8     201.8      0.00      0.00
  19 SUSPEC                                          1     207.0     207.0      0.00      0.00
  24 SUGRIDU                                         1     692.0     692.0      0.00      0.00
  25 SPECRT                                          1     112.1     112.1      0.00      0.00
  26 SUGRIDF                                         1     118.1     118.1      0.00      0.00
  27 RESTART FILES - WRITING                       123    1686.5    1686.5      0.43      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               247       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                               247    1327.4    1327.4      0.68      0.00
  31 POSDDH IN STEPO                                13       0.6       0.6      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   2953    2257.2    2257.2     13.80      0.00
  38 WAM      - TOTAL COST OF WAVE MODEL          2952    1731.6    1731.6     10.58      0.00
  39 SU0YOMB                                         1     183.3     183.3      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   2953      16.4      16.4      0.10      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             2952     243.4     243.4      1.49      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             2952      40.5      40.5      0.25      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                126       0.1       0.1      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM    10094      90.5      90.5      1.89      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      6152      87.9      87.9      1.12      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       6152      36.8      36.8      0.47      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM     10094      35.1      35.1      0.73      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            2      11.8      11.8      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION          10094      13.7      13.7      0.29      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           6152      13.1      13.1      0.17      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION          10094      14.2      14.2      0.30      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           6152       9.8       9.8      0.13      0.00
 400 GSTATS                                     589499       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                564603       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    48293.4 CPU TIME   48025.4 VECTOR TIME    48025.4


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      220.1
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /scratch/BOINC/slots/4/ICMGGhnw4+002952
Moving to projects directory: /scratch/BOINC/slots/4/ICMSHhnw4+002952
Moving to projects directory: /scratch/BOINC/slots/4/ICMUAhnw4+002952
Adding to the zip: /scratch/BOINC/slots/4/NODE.001_01
Adding to the zip: /scratch/BOINC/slots/4/ifs.stat
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002940
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002940
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002952
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002928
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMUAhnw4+002928
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002952
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMSHhnw4+002952
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002940
Adding to the zip: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_12213617/ICMGGhnw4+002928
Zipping up the final file: /scratch/BOINC/projects/climateprediction.net/oifs_43r3_004z_2019110100_123_993_12213617_0_r768027937_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
05:47:57 (23161): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:54:44 1534903 22314963 oifs_43r3_004z_2019110100_123_993_12213617_0 10,623,600 48,025 0.0045
09 May 2023 16:54:43 1534903 22314963 oifs_43r3_004z_2019110100_123_993_12213617_0 10,368,000 46,860 0.0045
09 May 2023 16:54:42 1534903 22314963 oifs_43r3_004z_2019110100_123_993_12213617_0 9,504,000 42,976 0.0045
09 May 2023 16:54:41 1534903 22314963 oifs_43r3_004z_2019110100_123_993_12213617_0 8,640,000 39,059 0.0045
09 May 2023 16:54:40 1534903 22314963 oifs_43r3_004z_2019110100_123_993_12213617_0 7,776,000 35,177 0.0045
09 May 2023 16:54:40 1534903 22314963 oifs_43r3_004z_2019110100_123_993_12213617_0 6,912,000 31,298 0.0045
09 May 2023 16:54:39 1534903 22314963 oifs_43r3_004z_2019110100_123_993_12213617_0 6,048,000 27,373 0.0045
09 May 2023 16:54:38 1534903 22314963 oifs_43r3_004z_2019110100_123_993_12213617_0 5,184,000 23,497 0.0045
09 May 2023 16:54:37 1534903 22314963 oifs_43r3_004z_2019110100_123_993_12213617_0 4,320,000 19,621 0.0045
09 May 2023 16:54:36 1534903 22314963 oifs_43r3_004z_2019110100_123_993_12213617_0 3,456,000 15,717 0.0045
09 May 2023 16:54:35 1534903 22314963 oifs_43r3_004z_2019110100_123_993_12213617_0 2,592,000 11,810 0.0046
09 May 2023 16:54:33 1534903 22314963 oifs_43r3_004z_2019110100_123_993_12213617_0 1,728,000 7,872 0.0046
09 May 2023 16:54:32 1534903 22314963 oifs_43r3_004z_2019110100_123_993_12213617_0 864,000 3,974 0.0046


©2024 climateprediction.net