climateprediction.net home page
Task 22302547

Task 22302547

Name oifs_43r3_ps_0869_2018050100_123_987_12204513_1
Workunit 12204513
Created 23 Jan 2023, 21:54:21 UTC
Sent 23 Jan 2023, 21:54:38 UTC
Report deadline 24 Mar 2023, 21:54:38 UTC
Received 26 Jan 2023, 6:44:45 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 9 (0x00000009) Unknown error code
Computer ID 1535783
Run time 13 hours 46 min 44 sec
CPU time 13 hours 13 min 49 sec
Validate state Invalid
Credit 6,048.00
Device peak FLOPS 4.00 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,285.12 MB
Peak swap size 4,974.32 MB
Peak disk usage 1,984.57 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<message>
process exited with code 9 (0x9, -247)</message>
<stderr_txt>
06:13 STEP  711 H= 711:00 +CPU= 41.964
  17:06:40 STEP  712 H= 712:00 +CPU= 27.131
  17:07:07 STEP  713 H= 713:00 +CPU= 26.475
  17:07:50 STEP  714 H= 714:00 +CPU= 42.594
  17:08:17 STEP  715 H= 715:00 +CPU= 26.465
  17:08:44 STEP  716 H= 716:00 +CPU= 27.062
  17:09:27 STEP  717 H= 717:00 +CPU= 42.047
  17:09:54 STEP  718 H= 718:00 +CPU= 27.008
  17:10:21 STEP  719 H= 719:00 +CPU= 27.192
  17:11:12 STEP  720 H= 720:00 +CPU= 49.690
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000720
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000720
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000720
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000696
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000696
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000696
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000708
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000708
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000708
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_29.zip
Uploading the intermediate file: upload_file_29.zip
  17:11:39 STEP  721 H= 721:00 +CPU= 26.603
Uploading trickle at timestep: 2592000
  17:12:06 STEP  722 H= 722:00 +CPU= 27.043
  17:12:48 STEP  723 H= 723:00 +CPU= 41.808
  17:13:15 STEP  724 H= 724:00 +CPU= 26.769
  17:13:42 STEP  725 H= 725:00 +CPU= 26.364
  17:14:25 STEP  726 H= 726:00 +CPU= 42.687
  17:14:51 STEP  727 H= 727:00 +CPU= 26.245
  17:15:19 STEP  728 H= 728:00 +CPU= 27.040
  17:16:01 STEP  729 H= 729:00 +CPU= 41.782
  17:16:28 STEP  730 H= 730:00 +CPU= 26.906
  17:16:55 STEP  731 H= 731:00 +CPU= 26.284
  17:17:41 STEP  732 H= 732:00 +CPU= 46.122
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000732
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000732
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000732
  17:18:08 STEP  733 H= 733:00 +CPU= 26.617
  17:18:36 STEP  734 H= 734:00 +CPU= 27.098
  17:19:18 STEP  735 H= 735:00 +CPU= 42.018
  17:19:45 STEP  736 H= 736:00 +CPU= 26.919
  17:20:12 STEP  737 H= 737:00 +CPU= 26.396
  17:20:55 STEP  738 H= 738:00 +CPU= 42.788
  17:21:22 STEP  739 H= 739:00 +CPU= 26.346
  17:21:49 STEP  740 H= 740:00 +CPU= 26.957
  17:22:32 STEP  741 H= 741:00 +CPU= 41.921
  17:22:59 STEP  742 H= 742:00 +CPU= 26.928
  17:23:26 STEP  743 H= 743:00 +CPU= 27.024
  17:24:16 STEP  744 H= 744:00 +CPU= 49.259
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000744
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000744
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000744
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000720
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000720
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000720
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000732
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000732
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000732
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_30.zip
Uploading the intermediate file: upload_file_30.zip
  17:24:42 STEP  745 H= 745:00 +CPU= 26.272
  17:25:09 STEP  746 H= 746:00 +CPU= 26.807
  17:25:51 STEP  747 H= 747:00 +CPU= 41.508
  17:26:18 STEP  748 H= 748:00 +CPU= 26.791
  17:26:45 STEP  749 H= 749:00 +CPU= 26.160
  17:27:28 STEP  750 H= 750:00 +CPU= 42.451
  17:27:54 STEP  751 H= 751:00 +CPU= 26.018
  17:28:21 STEP  752 H= 752:00 +CPU= 26.910
  17:29:03 STEP  753 H= 753:00 +CPU= 41.795
  17:29:30 STEP  754 H= 754:00 +CPU= 26.638
  17:29:56 STEP  755 H= 755:00 +CPU= 25.944
  17:30:43 STEP  756 H= 756:00 +CPU= 46.114
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000756
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000756
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000756
  17:31:09 STEP  757 H= 757:00 +CPU= 26.362
  17:31:37 STEP  758 H= 758:00 +CPU= 26.982
  17:32:19 STEP  759 H= 759:00 +CPU= 41.881
  17:32:46 STEP  760 H= 760:00 +CPU= 26.955
  17:33:13 STEP  761 H= 761:00 +CPU= 26.131
  17:33:56 STEP  762 H= 762:00 +CPU= 42.503
  17:34:22 STEP  763 H= 763:00 +CPU= 26.235
  17:34:49 STEP  764 H= 764:00 +CPU= 26.837
  17:35:31 STEP  765 H= 765:00 +CPU= 41.832
  17:35:59 STEP  766 H= 766:00 +CPU= 26.824
  17:36:26 STEP  767 H= 767:00 +CPU= 27.003
  17:37:16 STEP  768 H= 768:00 +CPU= 49.404
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000768
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000768
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000768
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000744
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000744
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000744
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000756
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000756
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000756
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_31.zip
Uploading the intermediate file: upload_file_31.zip
  17:37:42 STEP  769 H= 769:00 +CPU= 26.463
  17:38:10 STEP  770 H= 770:00 +CPU= 26.896
  17:38:52 STEP  771 H= 771:00 +CPU= 41.815
  17:39:19 STEP  772 H= 772:00 +CPU= 27.055
  17:39:46 STEP  773 H= 773:00 +CPU= 26.419
  17:40:29 STEP  774 H= 774:00 +CPU= 42.533
  17:40:55 STEP  775 H= 775:00 +CPU= 26.471
  17:41:23 STEP  776 H= 776:00 +CPU= 27.022
  17:42:04 STEP  777 H= 777:00 +CPU= 41.497
  17:42:32 STEP  778 H= 778:00 +CPU= 27.196
  17:42:59 STEP  779 H= 779:00 +CPU= 26.590
  17:43:45 STEP  780 H= 780:00 +CPU= 46.249
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000780
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000780
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000780
  17:44:12 STEP  781 H= 781:00 +CPU= 26.641
  17:44:40 STEP  782 H= 782:00 +CPU= 27.167
  17:45:22 STEP  783 H= 783:00 +CPU= 41.992
  17:45:49 STEP  784 H= 784:00 +CPU= 27.010
  17:46:16 STEP  785 H= 785:00 +CPU= 26.317
  17:46:59 STEP  786 H= 786:00 +CPU= 42.527
  17:47:26 STEP  787 H= 787:00 +CPU= 26.225
  17:47:53 STEP  788 H= 788:00 +CPU= 27.012
  17:48:35 STEP  789 H= 789:00 +CPU= 41.937
  17:49:02 STEP  790 H= 790:00 +CPU= 26.824
  17:49:30 STEP  791 H= 791:00 +CPU= 27.140
  17:50:20 STEP  792 H= 792:00 +CPU= 49.355
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000792
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000792
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000792
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000768
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000768
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000768
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000780
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000780
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000780
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_32.zip
Uploading the intermediate file: upload_file_32.zip
  17:50:46 STEP  793 H= 793:00 +CPU= 26.508
  17:51:14 STEP  794 H= 794:00 +CPU= 27.000
  17:51:56 STEP  795 H= 795:00 +CPU= 41.643
  17:52:23 STEP  796 H= 796:00 +CPU= 26.839
  17:52:49 STEP  797 H= 797:00 +CPU= 26.261
  17:53:32 STEP  798 H= 798:00 +CPU= 42.679
  17:53:59 STEP  799 H= 799:00 +CPU= 26.536
  17:54:26 STEP  800 H= 800:00 +CPU= 27.115
  17:55:09 STEP  801 H= 801:00 +CPU= 41.855
  17:55:36 STEP  802 H= 802:00 +CPU= 26.982
  17:56:03 STEP  803 H= 803:00 +CPU= 26.387
  17:56:49 STEP  804 H= 804:00 +CPU= 46.088
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000804
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000804
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000804
  17:57:16 STEP  805 H= 805:00 +CPU= 26.462
  17:57:43 STEP  806 H= 806:00 +CPU= 26.946
  17:58:25 STEP  807 H= 807:00 +CPU= 42.038
  17:58:53 STEP  808 H= 808:00 +CPU= 26.954
  17:59:19 STEP  809 H= 809:00 +CPU= 26.481
  18:00:03 STEP  810 H= 810:00 +CPU= 42.673
  18:00:29 STEP  811 H= 811:00 +CPU= 26.220
  18:00:56 STEP  812 H= 812:00 +CPU= 26.726
  18:01:38 STEP  813 H= 813:00 +CPU= 41.413
  18:02:05 STEP  814 H= 814:00 +CPU= 26.879
  18:02:32 STEP  815 H= 815:00 +CPU= 27.083
  18:03:22 STEP  816 H= 816:00 +CPU= 49.283
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000816
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000816
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000816
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000792
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000792
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000792
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000804
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000804
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000804
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_33.zip
Uploading the intermediate file: upload_file_33.zip
  18:03:49 STEP  817 H= 817:00 +CPU= 26.393
  18:04:15 STEP  818 H= 818:00 +CPU= 26.724
  18:04:57 STEP  819 H= 819:00 +CPU= 41.628
  18:05:24 STEP  820 H= 820:00 +CPU= 26.834
  18:05:51 STEP  821 H= 821:00 +CPU= 26.112
  18:06:34 STEP  822 H= 822:00 +CPU= 42.500
  18:07:00 STEP  823 H= 823:00 +CPU= 26.311
  18:07:28 STEP  824 H= 824:00 +CPU= 27.297
  18:08:10 STEP  825 H= 825:00 +CPU= 41.715
  18:08:37 STEP  826 H= 826:00 +CPU= 27.123
  18:09:04 STEP  827 H= 827:00 +CPU= 26.275
  18:09:50 STEP  828 H= 828:00 +CPU= 45.921
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000828
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000828
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000828
  18:10:17 STEP  829 H= 829:00 +CPU= 26.540
  18:10:44 STEP  830 H= 830:00 +CPU= 27.127
  18:11:27 STEP  831 H= 831:00 +CPU= 42.176
  18:11:54 STEP  832 H= 832:00 +CPU= 26.853
  18:12:21 STEP  833 H= 833:00 +CPU= 26.448
  18:13:04 STEP  834 H= 834:00 +CPU= 42.652
  18:13:30 STEP  835 H= 835:00 +CPU= 26.481
  18:13:57 STEP  836 H= 836:00 +CPU= 26.853
  18:14:40 STEP  837 H= 837:00 +CPU= 41.700
  18:15:06 STEP  838 H= 838:00 +CPU= 26.705
  18:15:34 STEP  839 H= 839:00 +CPU= 26.957
  18:16:23 STEP  840 H= 840:00 +CPU= 49.141
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000840
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000840
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000840
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000816
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000816
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000816
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000828
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000828
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000828
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_34.zip
Uploading the intermediate file: upload_file_34.zip
  18:16:49 STEP  841 H= 841:00 +CPU= 26.032
  18:17:16 STEP  842 H= 842:00 +CPU= 26.598
  18:17:58 STEP  843 H= 843:00 +CPU= 41.367
  18:18:25 STEP  844 H= 844:00 +CPU= 26.903
  18:18:51 STEP  845 H= 845:00 +CPU= 26.074
  18:19:34 STEP  846 H= 846:00 +CPU= 42.519
  18:20:00 STEP  847 H= 847:00 +CPU= 26.131
  18:20:27 STEP  848 H= 848:00 +CPU= 26.850
  18:21:09 STEP  849 H= 849:00 +CPU= 41.672
  18:21:37 STEP  850 H= 850:00 +CPU= 26.884
  18:22:03 STEP  851 H= 851:00 +CPU= 26.284
  18:22:50 STEP  852 H= 852:00 +CPU= 45.992
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000852
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000852
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000852
  18:23:16 STEP  853 H= 853:00 +CPU= 26.521
  18:23:44 STEP  854 H= 854:00 +CPU= 26.911
  18:24:25 STEP  855 H= 855:00 +CPU= 41.609
  18:24:53 STEP  856 H= 856:00 +CPU= 26.870
  18:25:19 STEP  857 H= 857:00 +CPU= 26.092
  18:26:02 STEP  858 H= 858:00 +CPU= 42.456
  18:26:28 STEP  859 H= 859:00 +CPU= 26.173
  18:26:55 STEP  860 H= 860:00 +CPU= 26.788
  18:27:37 STEP  861 H= 861:00 +CPU= 41.807
  18:28:05 STEP  862 H= 862:00 +CPU= 26.917
  18:28:32 STEP  863 H= 863:00 +CPU= 27.037
  18:29:22 STEP  864 H= 864:00 +CPU= 49.253
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000864
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000864
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000864
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000840
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000840
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000840
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000852
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000852
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000852
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_35.zip
Uploading the intermediate file: upload_file_35.zip
  18:29:48 STEP  865 H= 865:00 +CPU= 26.429
  18:30:16 STEP  866 H= 866:00 +CPU= 27.136
  18:30:58 STEP  867 H= 867:00 +CPU= 41.758
  18:31:25 STEP  868 H= 868:00 +CPU= 26.976
  18:31:52 STEP  869 H= 869:00 +CPU= 26.259
  18:32:35 STEP  870 H= 870:00 +CPU= 42.612
  18:33:01 STEP  871 H= 871:00 +CPU= 26.464
  18:33:29 STEP  872 H= 872:00 +CPU= 27.085
  18:34:11 STEP  873 H= 873:00 +CPU= 41.690
  18:34:38 STEP  874 H= 874:00 +CPU= 26.867
  18:35:04 STEP  875 H= 875:00 +CPU= 26.384
  18:35:51 STEP  876 H= 876:00 +CPU= 46.047
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000876
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000876
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000876
  18:36:18 STEP  877 H= 877:00 +CPU= 26.527
  18:36:45 STEP  878 H= 878:00 +CPU= 27.096
  18:37:27 STEP  879 H= 879:00 +CPU= 41.909
  18:37:55 STEP  880 H= 880:00 +CPU= 27.148
  18:38:21 STEP  881 H= 881:00 +CPU= 26.262
  18:39:04 STEP  882 H= 882:00 +CPU= 42.489
  18:39:31 STEP  883 H= 883:00 +CPU= 26.449
  18:39:58 STEP  884 H= 884:00 +CPU= 26.957
  18:40:40 STEP  885 H= 885:00 +CPU= 41.683
  18:41:07 STEP  886 H= 886:00 +CPU= 27.015
  18:41:35 STEP  887 H= 887:00 +CPU= 27.195
  18:42:25 STEP  888 H= 888:00 +CPU= 49.608
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000888
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000888
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000888
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000864
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000864
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000864
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000876
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000876
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000876
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_36.zip
Uploading the intermediate file: upload_file_36.zip
  18:42:51 STEP  889 H= 889:00 +CPU= 26.489
  18:43:19 STEP  890 H= 890:00 +CPU= 27.102
  18:44:01 STEP  891 H= 891:00 +CPU= 41.886
  18:44:29 STEP  892 H= 892:00 +CPU= 27.030
  18:44:55 STEP  893 H= 893:00 +CPU= 26.227
  18:45:38 STEP  894 H= 894:00 +CPU= 42.538
  18:46:04 STEP  895 H= 895:00 +CPU= 26.302
  18:46:32 STEP  896 H= 896:00 +CPU= 27.385
  18:47:15 STEP  897 H= 897:00 +CPU= 42.088
  18:47:42 STEP  898 H= 898:00 +CPU= 27.064
  18:48:08 STEP  899 H= 899:00 +CPU= 26.407
  18:48:55 STEP  900 H= 900:00 +CPU= 46.026
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000900
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000900
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000900
  18:49:22 STEP  901 H= 901:00 +CPU= 26.495
  18:49:49 STEP  902 H= 902:00 +CPU= 27.107
  18:50:32 STEP  903 H= 903:00 +CPU= 41.953
  18:50:59 STEP  904 H= 904:00 +CPU= 26.869
  18:51:25 STEP  905 H= 905:00 +CPU= 26.445
  18:52:08 STEP  906 H= 906:00 +CPU= 42.486
  18:52:35 STEP  907 H= 907:00 +CPU= 26.535
  18:53:02 STEP  908 H= 908:00 +CPU= 26.873
  18:53:44 STEP  909 H= 909:00 +CPU= 41.890
  18:54:12 STEP  910 H= 910:00 +CPU= 27.045
  18:54:39 STEP  911 H= 911:00 +CPU= 26.944
  18:55:28 STEP  912 H= 912:00 +CPU= 49.091
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000912
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000912
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000912
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000888
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000888
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000888
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000900
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000900
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000900
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_37.zip
Uploading the intermediate file: upload_file_37.zip
  18:55:55 STEP  913 H= 913:00 +CPU= 26.469
  18:56:22 STEP  914 H= 914:00 +CPU= 27.038
  18:57:05 STEP  915 H= 915:00 +CPU= 41.906
  18:57:32 STEP  916 H= 916:00 +CPU= 27.176
  18:57:59 STEP  917 H= 917:00 +CPU= 26.400
  18:58:42 STEP  918 H= 918:00 +CPU= 42.592
  18:59:09 STEP  919 H= 919:00 +CPU= 26.700
  18:59:36 STEP  920 H= 920:00 +CPU= 27.155
  19:00:18 STEP  921 H= 921:00 +CPU= 41.897
  19:00:46 STEP  922 H= 922:00 +CPU= 27.066
  19:01:12 STEP  923 H= 923:00 +CPU= 26.403
  19:01:59 STEP  924 H= 924:00 +CPU= 46.011
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000924
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000924
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000924
  19:02:26 STEP  925 H= 925:00 +CPU= 26.524
  19:02:53 STEP  926 H= 926:00 +CPU= 27.098
  19:03:36 STEP  927 H= 927:00 +CPU= 41.981
  19:04:03 STEP  928 H= 928:00 +CPU= 26.990
  19:04:30 STEP  929 H= 929:00 +CPU= 26.425
  19:05:12 STEP  930 H= 930:00 +CPU= 42.253
  19:05:38 STEP  931 H= 931:00 +CPU= 26.147
  19:06:05 STEP  932 H= 932:00 +CPU= 26.767
  19:06:48 STEP  933 H= 933:00 +CPU= 41.945
  19:07:15 STEP  934 H= 934:00 +CPU= 27.100
  19:07:43 STEP  935 H= 935:00 +CPU= 27.212
  19:08:33 STEP  936 H= 936:00 +CPU= 49.465
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000936
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000936
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000936
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000912
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000912
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000912
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000924
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000924
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000924
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_38.zip
Uploading the intermediate file: upload_file_38.zip
  19:08:59 STEP  937 H= 937:00 +CPU= 26.262
  19:09:27 STEP  938 H= 938:00 +CPU= 27.018
  19:10:08 STEP  939 H= 939:00 +CPU= 41.597
  19:10:36 STEP  940 H= 940:00 +CPU= 26.988
  19:11:02 STEP  941 H= 941:00 +CPU= 26.285
  19:11:45 STEP  942 H= 942:00 +CPU= 42.788
  19:12:12 STEP  943 H= 943:00 +CPU= 26.434
  19:12:39 STEP  944 H= 944:00 +CPU= 27.055
  19:13:22 STEP  945 H= 945:00 +CPU= 41.918
  19:13:49 STEP  946 H= 946:00 +CPU= 26.878
  19:14:15 STEP  947 H= 947:00 +CPU= 26.283
  19:15:02 STEP  948 H= 948:00 +CPU= 46.680
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000948
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000948
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000948
  19:15:29 STEP  949 H= 949:00 +CPU= 26.298
  19:15:56 STEP  950 H= 950:00 +CPU= 26.867
  19:16:38 STEP  951 H= 951:00 +CPU= 41.574
  19:17:05 STEP  952 H= 952:00 +CPU= 26.935
  19:17:32 STEP  953 H= 953:00 +CPU= 26.400
  19:18:15 STEP  954 H= 954:00 +CPU= 42.645
  19:18:41 STEP  955 H= 955:00 +CPU= 26.311
  19:19:08 STEP  956 H= 956:00 +CPU= 26.707
  19:19:50 STEP  957 H= 957:00 +CPU= 41.669
  19:20:17 STEP  958 H= 958:00 +CPU= 26.709
  19:20:44 STEP  959 H= 959:00 +CPU= 26.898
  19:21:34 STEP  960 H= 960:00 +CPU= 49.093
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000960
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000960
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000960
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000936
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000936
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000936
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000948
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000948
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000948
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_39.zip
Uploading the intermediate file: upload_file_39.zip
  19:22:00 STEP  961 H= 961:00 +CPU= 26.190
Uploading trickle at timestep: 3456000
  19:22:27 STEP  962 H= 962:00 +CPU= 26.772
  19:23:09 STEP  963 H= 963:00 +CPU= 41.403
  19:23:36 STEP  964 H= 964:00 +CPU= 26.682
  19:24:02 STEP  965 H= 965:00 +CPU= 26.208
  19:24:45 STEP  966 H= 966:00 +CPU= 42.572
  19:25:12 STEP  967 H= 967:00 +CPU= 26.420
  19:25:40 STEP  968 H= 968:00 +CPU= 27.446
  19:26:21 STEP  969 H= 969:00 +CPU= 41.595
  19:26:49 STEP  970 H= 970:00 +CPU= 26.982
  19:27:15 STEP  971 H= 971:00 +CPU= 26.249
  19:28:02 STEP  972 H= 972:00 +CPU= 46.050
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000972
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000972
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000972
  19:28:28 STEP  973 H= 973:00 +CPU= 26.213
  19:28:55 STEP  974 H= 974:00 +CPU= 26.967
  19:29:37 STEP  975 H= 975:00 +CPU= 41.566
  19:30:04 STEP  976 H= 976:00 +CPU= 26.790
  19:30:30 STEP  977 H= 977:00 +CPU= 26.048
  19:31:14 STEP  978 H= 978:00 +CPU= 42.752
  19:31:40 STEP  979 H= 979:00 +CPU= 26.313
  19:32:07 STEP  980 H= 980:00 +CPU= 26.898
  19:32:49 STEP  981 H= 981:00 +CPU= 41.421
  19:33:16 STEP  982 H= 982:00 +CPU= 26.814
  19:33:43 STEP  983 H= 983:00 +CPU= 27.083
  19:34:34 STEP  984 H= 984:00 +CPU= 49.533
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000984
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000984
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000984
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000960
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000960
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000960
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000972
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000972
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000972
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_40.zip
Uploading the intermediate file: upload_file_40.zip
  19:35:00 STEP  985 H= 985:00 +CPU= 26.614
  19:35:27 STEP  986 H= 986:00 +CPU= 26.787
  19:36:09 STEP  987 H= 987:00 +CPU= 41.526
  19:36:36 STEP  988 H= 988:00 +CPU= 26.756
  19:37:03 STEP  989 H= 989:00 +CPU= 26.160
  19:37:45 STEP  990 H= 990:00 +CPU= 42.394
  19:38:12 STEP  991 H= 991:00 +CPU= 26.431
  19:38:39 STEP  992 H= 992:00 +CPU= 27.111
  19:39:22 STEP  993 H= 993:00 +CPU= 41.993
  19:39:49 STEP  994 H= 994:00 +CPU= 26.853
  19:40:15 STEP  995 H= 995:00 +CPU= 26.192
  19:41:01 STEP  996 H= 996:00 +CPU= 45.647
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+000996
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+000996
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+000996
  19:41:27 STEP  997 H= 997:00 +CPU= 26.121
  19:41:54 STEP  998 H= 998:00 +CPU= 26.712
  19:42:36 STEP  999 H= 999:00 +CPU= 41.317
  19:43:03 STEP 1000 H=1000:00 +CPU= 26.703
  19:43:29 STEP 1001 H=1001:00 +CPU= 26.073
  19:44:12 STEP 1002 H=1002:00 +CPU= 42.448
  19:44:39 STEP 1003 H=1003:00 +CPU= 26.335
  19:45:05 STEP 1004 H=1004:00 +CPU= 26.614
  19:45:47 STEP 1005 H=1005:00 +CPU= 41.526
  19:46:14 STEP 1006 H=1006:00 +CPU= 26.819
  19:46:41 STEP 1007 H=1007:00 +CPU= 26.951
  19:47:31 STEP 1008 H=1008:00 +CPU= 49.066
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001008
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001008
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001008
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000984
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000984
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000984
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+000996
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+000996
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+000996
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_41.zip
Uploading the intermediate file: upload_file_41.zip
  19:47:57 STEP 1009 H=1009:00 +CPU= 26.302
  19:48:24 STEP 1010 H=1010:00 +CPU= 26.734
  19:49:06 STEP 1011 H=1011:00 +CPU= 41.552
  19:49:33 STEP 1012 H=1012:00 +CPU= 26.725
  19:50:00 STEP 1013 H=1013:00 +CPU= 26.373
  19:50:43 STEP 1014 H=1014:00 +CPU= 42.867
  19:51:10 STEP 1015 H=1015:00 +CPU= 26.583
  19:51:37 STEP 1016 H=1016:00 +CPU= 26.838
  19:52:19 STEP 1017 H=1017:00 +CPU= 41.513
  19:52:46 STEP 1018 H=1018:00 +CPU= 26.768
  19:53:12 STEP 1019 H=1019:00 +CPU= 26.383
  19:53:58 STEP 1020 H=1020:00 +CPU= 45.809
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001020
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001020
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001020
  19:54:25 STEP 1021 H=1021:00 +CPU= 26.223
  19:54:52 STEP 1022 H=1022:00 +CPU= 26.764
  19:55:34 STEP 1023 H=1023:00 +CPU= 41.519
  19:56:01 STEP 1024 H=1024:00 +CPU= 26.815
  19:56:27 STEP 1025 H=1025:00 +CPU= 26.259
  19:57:10 STEP 1026 H=1026:00 +CPU= 42.406
  19:57:36 STEP 1027 H=1027:00 +CPU= 26.081
  19:58:03 STEP 1028 H=1028:00 +CPU= 26.821
  19:58:45 STEP 1029 H=1029:00 +CPU= 41.460
  19:59:12 STEP 1030 H=1030:00 +CPU= 27.036
  19:59:39 STEP 1031 H=1031:00 +CPU= 26.971
  20:00:30 STEP 1032 H=1032:00 +CPU= 49.761
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001032
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001032
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001032
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001008
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001008
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001008
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001020
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001020
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001020
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_42.zip
Uploading the intermediate file: upload_file_42.zip
  20:00:56 STEP 1033 H=1033:00 +CPU= 26.361
  20:01:23 STEP 1034 H=1034:00 +CPU= 26.920
  20:02:06 STEP 1035 H=1035:00 +CPU= 41.881
  20:02:33 STEP 1036 H=1036:00 +CPU= 26.862
  20:02:59 STEP 1037 H=1037:00 +CPU= 26.356
  20:03:42 STEP 1038 H=1038:00 +CPU= 42.643
  20:04:09 STEP 1039 H=1039:00 +CPU= 26.200
  20:04:36 STEP 1040 H=1040:00 +CPU= 26.782
  20:05:18 STEP 1041 H=1041:00 +CPU= 41.663
  20:05:45 STEP 1042 H=1042:00 +CPU= 26.761
  20:06:11 STEP 1043 H=1043:00 +CPU= 26.237
  20:06:57 STEP 1044 H=1044:00 +CPU= 45.826
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001044
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001044
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001044
  20:07:24 STEP 1045 H=1045:00 +CPU= 26.417
  20:07:51 STEP 1046 H=1046:00 +CPU= 27.029
  20:08:34 STEP 1047 H=1047:00 +CPU= 42.002
  20:09:01 STEP 1048 H=1048:00 +CPU= 26.981
  20:09:27 STEP 1049 H=1049:00 +CPU= 26.281
  20:10:10 STEP 1050 H=1050:00 +CPU= 42.621
  20:10:37 STEP 1051 H=1051:00 +CPU= 26.390
  20:11:04 STEP 1052 H=1052:00 +CPU= 27.021
  20:11:47 STEP 1053 H=1053:00 +CPU= 41.763
  20:12:14 STEP 1054 H=1054:00 +CPU= 26.911
  20:12:41 STEP 1055 H=1055:00 +CPU= 27.153
  20:13:31 STEP 1056 H=1056:00 +CPU= 49.336
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001056
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001056
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001056
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001032
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001032
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001032
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001044
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001044
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001044
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_43.zip
Uploading the intermediate file: upload_file_43.zip
  20:13:58 STEP 1057 H=1057:00 +CPU= 26.427
  20:14:25 STEP 1058 H=1058:00 +CPU= 26.965
  20:15:07 STEP 1059 H=1059:00 +CPU= 41.595
  20:15:34 STEP 1060 H=1060:00 +CPU= 26.917
  20:16:01 STEP 1061 H=1061:00 +CPU= 26.287
  20:16:43 STEP 1062 H=1062:00 +CPU= 42.238
  20:17:09 STEP 1063 H=1063:00 +CPU= 26.146
  20:17:36 STEP 1064 H=1064:00 +CPU= 26.881
  20:18:18 STEP 1065 H=1065:00 +CPU= 41.634
  20:18:46 STEP 1066 H=1066:00 +CPU= 27.035
  20:19:12 STEP 1067 H=1067:00 +CPU= 26.303
  20:19:59 STEP 1068 H=1068:00 +CPU= 46.218
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001068
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001068
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001068
  20:20:25 STEP 1069 H=1069:00 +CPU= 26.240
  20:20:53 STEP 1070 H=1070:00 +CPU= 26.983
  20:21:35 STEP 1071 H=1071:00 +CPU= 42.063
  20:22:02 STEP 1072 H=1072:00 +CPU= 26.797
  20:22:28 STEP 1073 H=1073:00 +CPU= 26.218
  20:23:11 STEP 1074 H=1074:00 +CPU= 42.379
  20:23:37 STEP 1075 H=1075:00 +CPU= 26.044
  20:24:04 STEP 1076 H=1076:00 +CPU= 26.735
  20:24:47 STEP 1077 H=1077:00 +CPU= 41.876
  20:25:14 STEP 1078 H=1078:00 +CPU= 26.818
  20:25:41 STEP 1079 H=1079:00 +CPU= 26.736
  20:26:31 STEP 1080 H=1080:00 +CPU= 49.580
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001080
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001080
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001080
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001056
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001056
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001056
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001068
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001068
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001068
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_44.zip
Uploading the intermediate file: upload_file_44.zip
  20:26:57 STEP 1081 H=1081:00 +CPU= 26.378
  20:27:25 STEP 1082 H=1082:00 +CPU= 27.024
  20:28:07 STEP 1083 H=1083:00 +CPU= 41.832
  20:28:34 STEP 1084 H=1084:00 +CPU= 26.947
  20:29:01 STEP 1085 H=1085:00 +CPU= 26.508
  20:29:44 STEP 1086 H=1086:00 +CPU= 42.836
  20:30:11 STEP 1087 H=1087:00 +CPU= 26.550
  20:30:39 STEP 1088 H=1088:00 +CPU= 27.145
  20:31:21 STEP 1089 H=1089:00 +CPU= 42.020
  20:31:48 STEP 1090 H=1090:00 +CPU= 26.973
  20:32:15 STEP 1091 H=1091:00 +CPU= 26.363
  20:33:02 STEP 1092 H=1092:00 +CPU= 46.665
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001092
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001092
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001092
  20:33:29 STEP 1093 H=1093:00 +CPU= 26.472
  20:33:56 STEP 1094 H=1094:00 +CPU= 27.056
  20:34:39 STEP 1095 H=1095:00 +CPU= 42.075
  20:35:06 STEP 1096 H=1096:00 +CPU= 27.101
  20:35:33 STEP 1097 H=1097:00 +CPU= 26.511
  20:36:16 STEP 1098 H=1098:00 +CPU= 42.546
  20:36:43 STEP 1099 H=1099:00 +CPU= 26.413
  20:37:10 STEP 1100 H=1100:00 +CPU= 27.085
  20:37:52 STEP 1101 H=1101:00 +CPU= 41.658
  20:38:19 STEP 1102 H=1102:00 +CPU= 26.877
  20:38:46 STEP 1103 H=1103:00 +CPU= 26.839
  20:39:36 STEP 1104 H=1104:00 +CPU= 49.784
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001104
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001104
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001104
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001080
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001080
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001080
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001092
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001092
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001092
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_45.zip
Uploading the intermediate file: upload_file_45.zip
  20:40:03 STEP 1105 H=1105:00 +CPU= 26.194
  20:40:30 STEP 1106 H=1106:00 +CPU= 26.944
  20:41:12 STEP 1107 H=1107:00 +CPU= 41.410
  20:41:39 STEP 1108 H=1108:00 +CPU= 26.945
  20:42:06 STEP 1109 H=1109:00 +CPU= 26.582
  20:42:49 STEP 1110 H=1110:00 +CPU= 42.686
  20:43:15 STEP 1111 H=1111:00 +CPU= 26.317
  20:43:43 STEP 1112 H=1112:00 +CPU= 26.917
  20:44:25 STEP 1113 H=1113:00 +CPU= 41.818
  20:44:52 STEP 1114 H=1114:00 +CPU= 26.953
  20:45:19 STEP 1115 H=1115:00 +CPU= 26.308
  20:46:05 STEP 1116 H=1116:00 +CPU= 46.075
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001116
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001116
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001116
  20:46:32 STEP 1117 H=1117:00 +CPU= 26.349
  20:46:59 STEP 1118 H=1118:00 +CPU= 27.053
  20:47:41 STEP 1119 H=1119:00 +CPU= 41.703
  20:48:08 STEP 1120 H=1120:00 +CPU= 26.937
  20:48:35 STEP 1121 H=1121:00 +CPU= 26.422
  20:49:18 STEP 1122 H=1122:00 +CPU= 42.563
  20:49:45 STEP 1123 H=1123:00 +CPU= 26.383
  20:50:12 STEP 1124 H=1124:00 +CPU= 27.032
  20:50:55 STEP 1125 H=1125:00 +CPU= 42.022
  20:51:22 STEP 1126 H=1126:00 +CPU= 27.112
  20:51:49 STEP 1127 H=1127:00 +CPU= 26.951
  20:52:41 STEP 1128 H=1128:00 +CPU= 50.734
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001128
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001128
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001128
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001104
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001104
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001104
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001116
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001116
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001116
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_46.zip
Uploading the intermediate file: upload_file_46.zip
  20:53:07 STEP 1129 H=1129:00 +CPU= 26.256
  20:53:34 STEP 1130 H=1130:00 +CPU= 26.826
  20:54:16 STEP 1131 H=1131:00 +CPU= 41.704
  20:54:44 STEP 1132 H=1132:00 +CPU= 27.225
  20:55:10 STEP 1133 H=1133:00 +CPU= 26.303
  20:55:53 STEP 1134 H=1134:00 +CPU= 42.700
  20:56:20 STEP 1135 H=1135:00 +CPU= 26.559
  20:56:48 STEP 1136 H=1136:00 +CPU= 27.089
  20:57:30 STEP 1137 H=1137:00 +CPU= 41.821
  20:57:57 STEP 1138 H=1138:00 +CPU= 26.833
  20:58:23 STEP 1139 H=1139:00 +CPU= 26.471
  20:59:12 STEP 1140 H=1140:00 +CPU= 47.627
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001140
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001140
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001140
  20:59:38 STEP 1141 H=1141:00 +CPU= 26.514
  21:00:06 STEP 1142 H=1142:00 +CPU= 27.090
  21:00:48 STEP 1143 H=1143:00 +CPU= 42.161
  21:01:16 STEP 1144 H=1144:00 +CPU= 27.248
  21:01:43 STEP 1145 H=1145:00 +CPU= 26.536
  21:02:26 STEP 1146 H=1146:00 +CPU= 42.825
  21:02:52 STEP 1147 H=1147:00 +CPU= 26.217
  21:03:20 STEP 1148 H=1148:00 +CPU= 27.020
  21:04:02 STEP 1149 H=1149:00 +CPU= 41.949
  21:04:29 STEP 1150 H=1150:00 +CPU= 27.024
  21:04:57 STEP 1151 H=1151:00 +CPU= 27.164
  21:05:47 STEP 1152 H=1152:00 +CPU= 49.851
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001152
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001152
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001152
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001128
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001128
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001128
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001140
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001140
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001140
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_47.zip
Uploading the intermediate file: upload_file_47.zip
  21:06:14 STEP 1153 H=1153:00 +CPU= 26.596
  21:06:41 STEP 1154 H=1154:00 +CPU= 26.949
  21:07:24 STEP 1155 H=1155:00 +CPU= 42.185
  21:07:52 STEP 1156 H=1156:00 +CPU= 27.451
  21:08:19 STEP 1157 H=1157:00 +CPU= 26.612
  21:09:02 STEP 1158 H=1158:00 +CPU= 42.998
  21:09:29 STEP 1159 H=1159:00 +CPU= 26.588
  21:09:57 STEP 1160 H=1160:00 +CPU= 27.293
  21:10:39 STEP 1161 H=1161:00 +CPU= 42.060
  21:11:07 STEP 1162 H=1162:00 +CPU= 27.200
  21:11:33 STEP 1163 H=1163:00 +CPU= 26.520
  21:12:20 STEP 1164 H=1164:00 +CPU= 46.334
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001164
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001164
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001164
  21:12:47 STEP 1165 H=1165:00 +CPU= 26.539
  21:13:15 STEP 1166 H=1166:00 +CPU= 27.289
  21:13:57 STEP 1167 H=1167:00 +CPU= 41.924
  21:14:25 STEP 1168 H=1168:00 +CPU= 27.049
  21:14:51 STEP 1169 H=1169:00 +CPU= 26.488
  21:15:35 STEP 1170 H=1170:00 +CPU= 42.855
  21:16:02 STEP 1171 H=1171:00 +CPU= 26.576
  21:16:29 STEP 1172 H=1172:00 +CPU= 26.987
  21:17:11 STEP 1173 H=1173:00 +CPU= 41.679
  21:17:38 STEP 1174 H=1174:00 +CPU= 27.097
  21:18:06 STEP 1175 H=1175:00 +CPU= 27.220
  21:18:56 STEP 1176 H=1176:00 +CPU= 49.731
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001176
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001176
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001176
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001152
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001152
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001152
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001164
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001164
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001164
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_48.zip
Uploading the intermediate file: upload_file_48.zip
  21:19:22 STEP 1177 H=1177:00 +CPU= 26.344
  21:19:50 STEP 1178 H=1178:00 +CPU= 27.005
  21:20:32 STEP 1179 H=1179:00 +CPU= 42.021
  21:21:00 STEP 1180 H=1180:00 +CPU= 27.344
  21:21:26 STEP 1181 H=1181:00 +CPU= 26.413
  21:22:09 STEP 1182 H=1182:00 +CPU= 42.730
  21:22:36 STEP 1183 H=1183:00 +CPU= 26.539
  21:23:04 STEP 1184 H=1184:00 +CPU= 27.254
  21:23:46 STEP 1185 H=1185:00 +CPU= 42.017
  21:24:14 STEP 1186 H=1186:00 +CPU= 27.231
  21:24:41 STEP 1187 H=1187:00 +CPU= 26.752
  21:25:28 STEP 1188 H=1188:00 +CPU= 46.368
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001188
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001188
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001188
  21:25:54 STEP 1189 H=1189:00 +CPU= 26.435
  21:26:22 STEP 1190 H=1190:00 +CPU= 27.184
  21:27:04 STEP 1191 H=1191:00 +CPU= 41.987
  21:27:31 STEP 1192 H=1192:00 +CPU= 27.020
  21:27:58 STEP 1193 H=1193:00 +CPU= 26.585
  21:28:41 STEP 1194 H=1194:00 +CPU= 42.477
  21:29:08 STEP 1195 H=1195:00 +CPU= 26.297
  21:29:35 STEP 1196 H=1196:00 +CPU= 27.052
  21:30:17 STEP 1197 H=1197:00 +CPU= 41.749
  21:30:44 STEP 1198 H=1198:00 +CPU= 27.105
  21:31:12 STEP 1199 H=1199:00 +CPU= 27.248
  21:32:03 STEP 1200 H=1200:00 +CPU= 49.949
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001200
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001200
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001200
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001176
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001176
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001176
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001188
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001188
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001188
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_49.zip
Uploading the intermediate file: upload_file_49.zip
  21:32:30 STEP 1201 H=1201:00 +CPU= 26.687
Uploading trickle at timestep: 4320000
  21:32:57 STEP 1202 H=1202:00 +CPU= 27.206
  21:33:40 STEP 1203 H=1203:00 +CPU= 42.040
  21:34:07 STEP 1204 H=1204:00 +CPU= 27.389
  21:34:34 STEP 1205 H=1205:00 +CPU= 26.540
  21:35:17 STEP 1206 H=1206:00 +CPU= 42.465
  21:35:43 STEP 1207 H=1207:00 +CPU= 26.407
  21:36:11 STEP 1208 H=1208:00 +CPU= 27.055
  21:36:53 STEP 1209 H=1209:00 +CPU= 41.872
  21:37:20 STEP 1210 H=1210:00 +CPU= 27.144
  21:37:47 STEP 1211 H=1211:00 +CPU= 26.543
  21:38:34 STEP 1212 H=1212:00 +CPU= 46.216
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001212
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001212
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001212
  21:39:01 STEP 1213 H=1213:00 +CPU= 26.528
  21:39:28 STEP 1214 H=1214:00 +CPU= 27.182
  21:40:11 STEP 1215 H=1215:00 +CPU= 42.345
  21:40:38 STEP 1216 H=1216:00 +CPU= 27.244
  21:41:05 STEP 1217 H=1217:00 +CPU= 26.576
  21:41:49 STEP 1218 H=1218:00 +CPU= 42.921
  21:42:15 STEP 1219 H=1219:00 +CPU= 26.544
  21:42:43 STEP 1220 H=1220:00 +CPU= 27.201
  21:43:26 STEP 1221 H=1221:00 +CPU= 42.059
  21:43:53 STEP 1222 H=1222:00 +CPU= 27.012
  21:44:20 STEP 1223 H=1223:00 +CPU= 27.216
  21:45:11 STEP 1224 H=1224:00 +CPU= 49.761
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001224
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001224
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001224
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001200
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001200
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001200
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001212
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001212
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001212
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_50.zip
Uploading the intermediate file: upload_file_50.zip
  21:45:38 STEP 1225 H=1225:00 +CPU= 26.668
  21:46:05 STEP 1226 H=1226:00 +CPU= 27.086
  21:46:48 STEP 1227 H=1227:00 +CPU= 42.430
  21:47:15 STEP 1228 H=1228:00 +CPU= 27.203
  21:47:42 STEP 1229 H=1229:00 +CPU= 26.549
  21:48:26 STEP 1230 H=1230:00 +CPU= 43.025
  21:48:53 STEP 1231 H=1231:00 +CPU= 26.625
  21:49:20 STEP 1232 H=1232:00 +CPU= 27.422
  21:50:03 STEP 1233 H=1233:00 +CPU= 42.173
  21:50:31 STEP 1234 H=1234:00 +CPU= 27.305
  21:50:57 STEP 1235 H=1235:00 +CPU= 26.580
  21:51:44 STEP 1236 H=1236:00 +CPU= 46.476
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001236
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001236
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001236
  21:52:11 STEP 1237 H=1237:00 +CPU= 26.582
  21:52:39 STEP 1238 H=1238:00 +CPU= 27.250
  21:53:21 STEP 1239 H=1239:00 +CPU= 42.156
  21:53:49 STEP 1240 H=1240:00 +CPU= 27.179
  21:54:16 STEP 1241 H=1241:00 +CPU= 26.781
  21:54:59 STEP 1242 H=1242:00 +CPU= 42.822
  21:55:26 STEP 1243 H=1243:00 +CPU= 26.534
  21:55:53 STEP 1244 H=1244:00 +CPU= 27.085
  21:56:36 STEP 1245 H=1245:00 +CPU= 42.063
  21:57:04 STEP 1246 H=1246:00 +CPU= 27.167
  21:57:31 STEP 1247 H=1247:00 +CPU= 27.264
  21:58:23 STEP 1248 H=1248:00 +CPU= 50.855
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001248
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001248
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001248
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001224
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001224
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001224
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001236
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001236
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001236
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_51.zip
Uploading the intermediate file: upload_file_51.zip
  21:58:49 STEP 1249 H=1249:00 +CPU= 26.440
  21:59:16 STEP 1250 H=1250:00 +CPU= 26.929
  21:59:59 STEP 1251 H=1251:00 +CPU= 41.968
  22:00:26 STEP 1252 H=1252:00 +CPU= 27.127
  22:00:53 STEP 1253 H=1253:00 +CPU= 26.638
  22:01:37 STEP 1254 H=1254:00 +CPU= 42.978
  22:02:03 STEP 1255 H=1255:00 +CPU= 26.529
  22:02:31 STEP 1256 H=1256:00 +CPU= 27.124
  22:03:13 STEP 1257 H=1257:00 +CPU= 42.240
  22:03:41 STEP 1258 H=1258:00 +CPU= 27.259
  22:04:08 STEP 1259 H=1259:00 +CPU= 26.556
  22:04:55 STEP 1260 H=1260:00 +CPU= 46.361
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001260
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001260
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001260
  22:05:22 STEP 1261 H=1261:00 +CPU= 26.664
  22:05:49 STEP 1262 H=1262:00 +CPU= 27.307
  22:06:32 STEP 1263 H=1263:00 +CPU= 42.165
  22:06:59 STEP 1264 H=1264:00 +CPU= 27.236
  22:07:26 STEP 1265 H=1265:00 +CPU= 26.653
  22:08:10 STEP 1266 H=1266:00 +CPU= 43.034
  22:08:37 STEP 1267 H=1267:00 +CPU= 26.650
  22:09:04 STEP 1268 H=1268:00 +CPU= 27.262
  22:09:47 STEP 1269 H=1269:00 +CPU= 42.128
  22:10:14 STEP 1270 H=1270:00 +CPU= 27.170
  22:10:42 STEP 1271 H=1271:00 +CPU= 27.305
  22:11:33 STEP 1272 H=1272:00 +CPU= 50.059
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001272
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001272
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001272
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001248
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001248
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001248
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001260
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001260
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001260
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_52.zip
Uploading the intermediate file: upload_file_52.zip
  22:12:00 STEP 1273 H=1273:00 +CPU= 26.855
  22:12:27 STEP 1274 H=1274:00 +CPU= 27.255
  22:13:10 STEP 1275 H=1275:00 +CPU= 42.129
  22:13:37 STEP 1276 H=1276:00 +CPU= 27.263
  22:14:05 STEP 1277 H=1277:00 +CPU= 27.018
  22:14:48 STEP 1278 H=1278:00 +CPU= 42.647
  22:15:14 STEP 1279 H=1279:00 +CPU= 26.548
  22:15:42 STEP 1280 H=1280:00 +CPU= 27.135
  22:16:24 STEP 1281 H=1281:00 +CPU= 42.164
  22:16:52 STEP 1282 H=1282:00 +CPU= 26.959
  22:17:18 STEP 1283 H=1283:00 +CPU= 26.320
  22:18:05 STEP 1284 H=1284:00 +CPU= 46.137
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001284
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001284
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001284
  22:18:31 STEP 1285 H=1285:00 +CPU= 26.179
  22:18:58 STEP 1286 H=1286:00 +CPU= 26.976
  22:19:41 STEP 1287 H=1287:00 +CPU= 42.013
  22:20:08 STEP 1288 H=1288:00 +CPU= 27.094
  22:20:35 STEP 1289 H=1289:00 +CPU= 26.587
  22:21:18 STEP 1290 H=1290:00 +CPU= 42.712
  22:21:45 STEP 1291 H=1291:00 +CPU= 26.582
  22:22:12 STEP 1292 H=1292:00 +CPU= 27.147
  22:22:55 STEP 1293 H=1293:00 +CPU= 41.830
  22:23:22 STEP 1294 H=1294:00 +CPU= 26.862
  22:23:49 STEP 1295 H=1295:00 +CPU= 26.821
  22:24:39 STEP 1296 H=1296:00 +CPU= 49.641
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001296
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001296
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001296
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001272
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001272
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001272
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001284
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001284
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001284
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_53.zip
Uploading the intermediate file: upload_file_53.zip
  22:25:06 STEP 1297 H=1297:00 +CPU= 26.523
  22:25:33 STEP 1298 H=1298:00 +CPU= 27.111
  22:26:15 STEP 1299 H=1299:00 +CPU= 41.928
  22:26:43 STEP 1300 H=1300:00 +CPU= 27.130
  22:27:10 STEP 1301 H=1301:00 +CPU= 26.639
  22:27:52 STEP 1302 H=1302:00 +CPU= 42.325
  22:28:19 STEP 1303 H=1303:00 +CPU= 26.206
  22:28:46 STEP 1304 H=1304:00 +CPU= 26.907
  22:29:28 STEP 1305 H=1305:00 +CPU= 41.915
  22:29:55 STEP 1306 H=1306:00 +CPU= 26.971
  22:30:22 STEP 1307 H=1307:00 +CPU= 26.462
  22:31:09 STEP 1308 H=1308:00 +CPU= 46.349
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001308
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001308
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001308
  22:31:36 STEP 1309 H=1309:00 +CPU= 26.711
  22:32:04 STEP 1310 H=1310:00 +CPU= 27.504
  22:32:46 STEP 1311 H=1311:00 +CPU= 42.274
  22:33:14 STEP 1312 H=1312:00 +CPU= 27.147
  22:33:40 STEP 1313 H=1313:00 +CPU= 26.401
  22:34:24 STEP 1314 H=1314:00 +CPU= 42.933
  22:34:51 STEP 1315 H=1315:00 +CPU= 26.486
  22:35:18 STEP 1316 H=1316:00 +CPU= 27.129
  22:36:01 STEP 1317 H=1317:00 +CPU= 42.094
  22:36:28 STEP 1318 H=1318:00 +CPU= 26.951
  22:36:55 STEP 1319 H=1319:00 +CPU= 26.984
  22:37:45 STEP 1320 H=1320:00 +CPU= 49.623
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001320
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001320
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001320
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001296
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001296
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001296
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001308
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001308
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001308
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_54.zip
Uploading the intermediate file: upload_file_54.zip
  22:38:12 STEP 1321 H=1321:00 +CPU= 26.312
  22:38:39 STEP 1322 H=1322:00 +CPU= 27.241
  22:39:22 STEP 1323 H=1323:00 +CPU= 42.169
  22:39:49 STEP 1324 H=1324:00 +CPU= 27.151
  22:40:16 STEP 1325 H=1325:00 +CPU= 26.390
  22:40:59 STEP 1326 H=1326:00 +CPU= 42.900
  22:41:26 STEP 1327 H=1327:00 +CPU= 26.462
  22:41:53 STEP 1328 H=1328:00 +CPU= 26.811
  22:42:35 STEP 1329 H=1329:00 +CPU= 41.708
  22:43:03 STEP 1330 H=1330:00 +CPU= 26.992
  22:43:29 STEP 1331 H=1331:00 +CPU= 26.369
  22:44:16 STEP 1332 H=1332:00 +CPU= 46.342
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001332
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001332
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001332
  22:44:43 STEP 1333 H=1333:00 +CPU= 26.378
  22:45:10 STEP 1334 H=1334:00 +CPU= 26.985
  22:45:52 STEP 1335 H=1335:00 +CPU= 42.098
  22:46:20 STEP 1336 H=1336:00 +CPU= 27.003
  22:46:46 STEP 1337 H=1337:00 +CPU= 26.490
  22:47:30 STEP 1338 H=1338:00 +CPU= 42.960
  22:47:57 STEP 1339 H=1339:00 +CPU= 26.589
  22:48:24 STEP 1340 H=1340:00 +CPU= 27.055
  22:49:06 STEP 1341 H=1341:00 +CPU= 41.856
  22:49:34 STEP 1342 H=1342:00 +CPU= 27.064
  22:50:01 STEP 1343 H=1343:00 +CPU= 27.222
  22:50:51 STEP 1344 H=1344:00 +CPU= 49.633
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001344
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001344
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001344
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001320
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001320
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001320
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001332
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001332
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001332
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_55.zip
Uploading the intermediate file: upload_file_55.zip
  22:51:18 STEP 1345 H=1345:00 +CPU= 26.333
  22:51:45 STEP 1346 H=1346:00 +CPU= 26.818
  22:52:27 STEP 1347 H=1347:00 +CPU= 42.158
  22:52:54 STEP 1348 H=1348:00 +CPU= 27.086
  22:53:21 STEP 1349 H=1349:00 +CPU= 26.446
  22:54:05 STEP 1350 H=1350:00 +CPU= 42.916
  22:54:31 STEP 1351 H=1351:00 +CPU= 26.541
  22:54:59 STEP 1352 H=1352:00 +CPU= 27.030
  22:55:41 STEP 1353 H=1353:00 +CPU= 42.117
  22:56:09 STEP 1354 H=1354:00 +CPU= 27.195
  22:56:36 STEP 1355 H=1355:00 +CPU= 26.583
  22:57:22 STEP 1356 H=1356:00 +CPU= 46.136
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001356
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001356
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001356
  22:57:49 STEP 1357 H=1357:00 +CPU= 26.420
  22:58:16 STEP 1358 H=1358:00 +CPU= 27.002
  22:58:58 STEP 1359 H=1359:00 +CPU= 41.996
  22:59:26 STEP 1360 H=1360:00 +CPU= 27.086
  22:59:53 STEP 1361 H=1361:00 +CPU= 26.612
  23:00:36 STEP 1362 H=1362:00 +CPU= 42.893
  23:01:03 STEP 1363 H=1363:00 +CPU= 26.587
  23:01:30 STEP 1364 H=1364:00 +CPU= 27.083
  23:02:13 STEP 1365 H=1365:00 +CPU= 41.947
  23:02:40 STEP 1366 H=1366:00 +CPU= 27.021
  23:03:07 STEP 1367 H=1367:00 +CPU= 27.078
  23:03:58 STEP 1368 H=1368:00 +CPU= 49.748
Moving to projects directory: /home/gary/boinc/slots/3/ICMGGhq0f+001368
Moving to projects directory: /home/gary/boinc/slots/3/ICMSHhq0f+001368
Moving to projects directory: /home/gary/boinc/slots/3/ICMUAhq0f+001368
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001344
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001344
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001344
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMGGhq0f+001356
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMSHhq0f+001356
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_12204513/ICMUAhq0f+001356
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_ps_0869_2018050100_123_987_12204513_1_r1519307746_56.zip
Uploading the intermediate file: upload_file_56.zip
  23:04:25 STEP 1369 H=1369:00 +CPU= 26.688
  23:04:52 STEP 1370 H=1370:00 +CPU= 27.074
  23:05:35 STEP 1371 H=1371:00 +CPU= 42.281

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:41:38 1535783 22302547 oifs_43r3_ps_0869_2018050100_123_987_12204513_1 4,320,000 42,057 0.0097
09 May 2023 16:41:31 1535783 22302547 oifs_43r3_ps_0869_2018050100_123_987_12204513_1 3,456,000 34,297 0.0099
09 May 2023 16:41:23 1535783 22302547 oifs_43r3_ps_0869_2018050100_123_987_12204513_1 2,592,000 26,548 0.0102
09 May 2023 16:41:16 1535783 22302547 oifs_43r3_ps_0869_2018050100_123_987_12204513_1 1,728,000 18,804 0.0109
09 May 2023 16:41:08 1535783 22302547 oifs_43r3_ps_0869_2018050100_123_987_12204513_1 864,000 11,050 0.0128


©2024 climateprediction.net