climateprediction.net home page
Task 22282924

Task 22282924

Name oifs_43r3_ps_0267_2011050100_123_980_12196911_0
Workunit 12196911
Created 24 Dec 2022, 1:54:46 UTC
Sent 24 Dec 2022, 2:05:28 UTC
Report deadline 23 Jan 2023, 2:05:28 UTC
Received 24 Dec 2022, 16:07:26 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1536693
Run time 13 hours 35 min 35 sec
CPU time 13 hours 33 min 36 sec
Validate state Invalid
Credit 6,048.00
Device peak FLOPS 1.00 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,415.61 MB
Peak swap size 4,974.12 MB
Peak disk usage 1,992.81 MB
Stderr 
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
 directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+000804
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0267_2011050100_123_980_12196911_0_r583038537_33.zip
Uploading the intermediate file: upload_file_33.zip
  11:20:33 STEP  817 H= 817:00 +CPU= 23.943
  11:20:58 STEP  818 H= 818:00 +CPU= 24.696
  11:21:37 STEP  819 H= 819:00 +CPU= 38.457
  11:22:01 STEP  820 H= 820:00 +CPU= 24.617
  11:22:25 STEP  821 H= 821:00 +CPU= 23.911
  11:23:05 STEP  822 H= 822:00 +CPU= 39.336
  11:23:29 STEP  823 H= 823:00 +CPU= 23.950
  11:23:53 STEP  824 H= 824:00 +CPU= 24.682
  11:24:32 STEP  825 H= 825:00 +CPU= 38.520
  11:24:56 STEP  826 H= 826:00 +CPU= 24.691
  11:25:20 STEP  827 H= 827:00 +CPU= 23.963
  11:26:03 STEP  828 H= 828:00 +CPU= 42.466
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+000828
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+000828
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+000828
  11:26:27 STEP  829 H= 829:00 +CPU= 23.946
  11:26:52 STEP  830 H= 830:00 +CPU= 24.676
  11:27:30 STEP  831 H= 831:00 +CPU= 38.490
  11:27:55 STEP  832 H= 832:00 +CPU= 24.654
  11:28:19 STEP  833 H= 833:00 +CPU= 23.913
  11:28:58 STEP  834 H= 834:00 +CPU= 39.312
  11:29:22 STEP  835 H= 835:00 +CPU= 23.918
  11:29:47 STEP  836 H= 836:00 +CPU= 24.648
  11:30:25 STEP  837 H= 837:00 +CPU= 38.508
  11:30:50 STEP  838 H= 838:00 +CPU= 24.611
  11:31:14 STEP  839 H= 839:00 +CPU= 24.617
  11:31:59 STEP  840 H= 840:00 +CPU= 44.837
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+000840
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+000840
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+000828
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0267_2011050100_123_980_12196911_0_r583038537_34.zip
Uploading the intermediate file: upload_file_34.zip
  11:32:23 STEP  841 H= 841:00 +CPU= 23.965
  11:32:48 STEP  842 H= 842:00 +CPU= 24.630
  11:33:26 STEP  843 H= 843:00 +CPU= 38.480
  11:33:51 STEP  844 H= 844:00 +CPU= 24.626
  11:34:15 STEP  845 H= 845:00 +CPU= 23.903
  11:34:54 STEP  846 H= 846:00 +CPU= 39.305
  11:35:18 STEP  847 H= 847:00 +CPU= 23.940
  11:35:43 STEP  848 H= 848:00 +CPU= 24.686
  11:36:21 STEP  849 H= 849:00 +CPU= 38.507
  11:36:46 STEP  850 H= 850:00 +CPU= 24.658
  11:37:10 STEP  851 H= 851:00 +CPU= 23.948
  11:37:52 STEP  852 H= 852:00 +CPU= 42.437
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+000852
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+000852
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+000852
  11:38:16 STEP  853 H= 853:00 +CPU= 23.970
  11:38:41 STEP  854 H= 854:00 +CPU= 24.692
  11:39:19 STEP  855 H= 855:00 +CPU= 38.457
  11:39:44 STEP  856 H= 856:00 +CPU= 24.682
  11:40:08 STEP  857 H= 857:00 +CPU= 23.953
  11:40:47 STEP  858 H= 858:00 +CPU= 39.325
  11:41:11 STEP  859 H= 859:00 +CPU= 23.917
  11:41:36 STEP  860 H= 860:00 +CPU= 24.636
  11:42:14 STEP  861 H= 861:00 +CPU= 38.396
  11:42:39 STEP  862 H= 862:00 +CPU= 24.621
  11:43:04 STEP  863 H= 863:00 +CPU= 24.608
  11:43:48 STEP  864 H= 864:00 +CPU= 44.750
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+000864
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+000864
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0267_2011050100_123_980_12196911_0_r583038537_35.zip
Uploading the intermediate file: upload_file_35.zip
  11:44:12 STEP  865 H= 865:00 +CPU= 23.947
  11:44:37 STEP  866 H= 866:00 +CPU= 24.628
  11:45:15 STEP  867 H= 867:00 +CPU= 38.419
  11:45:40 STEP  868 H= 868:00 +CPU= 24.615
  11:46:04 STEP  869 H= 869:00 +CPU= 23.912
  11:46:43 STEP  870 H= 870:00 +CPU= 39.256
  11:47:07 STEP  871 H= 871:00 +CPU= 23.947
  11:47:32 STEP  872 H= 872:00 +CPU= 24.661
  11:48:10 STEP  873 H= 873:00 +CPU= 38.504
  11:48:35 STEP  874 H= 874:00 +CPU= 24.692
  11:48:59 STEP  875 H= 875:00 +CPU= 23.975
  11:49:42 STEP  876 H= 876:00 +CPU= 42.501
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+000876
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+000876
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+000876
  11:50:06 STEP  877 H= 877:00 +CPU= 24.013
  11:50:30 STEP  878 H= 878:00 +CPU= 24.691
  11:51:09 STEP  879 H= 879:00 +CPU= 38.453
  11:51:33 STEP  880 H= 880:00 +CPU= 24.672
  11:51:57 STEP  881 H= 881:00 +CPU= 23.933
  11:52:37 STEP  882 H= 882:00 +CPU= 39.271
  11:53:01 STEP  883 H= 883:00 +CPU= 23.904
  11:53:25 STEP  884 H= 884:00 +CPU= 24.622
  11:54:04 STEP  885 H= 885:00 +CPU= 38.423
  11:54:28 STEP  886 H= 886:00 +CPU= 24.622
  11:54:53 STEP  887 H= 887:00 +CPU= 24.616
  11:55:38 STEP  888 H= 888:00 +CPU= 44.830
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+000888
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+000888
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+000876
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0267_2011050100_123_980_12196911_0_r583038537_36.zip
Uploading the intermediate file: upload_file_36.zip
  11:56:02 STEP  889 H= 889:00 +CPU= 23.941
  11:56:26 STEP  890 H= 890:00 +CPU= 24.616
  11:57:05 STEP  891 H= 891:00 +CPU= 38.425
  11:57:29 STEP  892 H= 892:00 +CPU= 24.615
  11:57:53 STEP  893 H= 893:00 +CPU= 23.911
  11:58:33 STEP  894 H= 894:00 +CPU= 39.275
  11:58:57 STEP  895 H= 895:00 +CPU= 23.951
  11:59:21 STEP  896 H= 896:00 +CPU= 24.660
  12:00:00 STEP  897 H= 897:00 +CPU= 38.520
  12:00:24 STEP  898 H= 898:00 +CPU= 24.675
  12:00:48 STEP  899 H= 899:00 +CPU= 23.965
  12:01:31 STEP  900 H= 900:00 +CPU= 42.488
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+000900
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+000900
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+000900
  12:01:55 STEP  901 H= 901:00 +CPU= 23.966
  12:02:20 STEP  902 H= 902:00 +CPU= 24.677
  12:02:58 STEP  903 H= 903:00 +CPU= 38.468
  12:03:23 STEP  904 H= 904:00 +CPU= 24.654
  12:03:47 STEP  905 H= 905:00 +CPU= 23.925
  12:04:26 STEP  906 H= 906:00 +CPU= 39.276
  12:04:50 STEP  907 H= 907:00 +CPU= 23.943
  12:05:14 STEP  908 H= 908:00 +CPU= 24.633
  12:05:53 STEP  909 H= 909:00 +CPU= 38.486
  12:06:18 STEP  910 H= 910:00 +CPU= 24.624
  12:06:42 STEP  911 H= 911:00 +CPU= 24.617
  12:07:27 STEP  912 H= 912:00 +CPU= 44.782
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+000912
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+000912
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+000900
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0267_2011050100_123_980_12196911_0_r583038537_37.zip
Uploading the intermediate file: upload_file_37.zip
  12:07:51 STEP  913 H= 913:00 +CPU= 23.934
  12:08:16 STEP  914 H= 914:00 +CPU= 24.656
  12:08:54 STEP  915 H= 915:00 +CPU= 38.432
  12:09:19 STEP  916 H= 916:00 +CPU= 24.629
  12:09:43 STEP  917 H= 917:00 +CPU= 23.934
  12:10:22 STEP  918 H= 918:00 +CPU= 39.346
  12:10:46 STEP  919 H= 919:00 +CPU= 23.941
  12:11:11 STEP  920 H= 920:00 +CPU= 24.665
  12:11:49 STEP  921 H= 921:00 +CPU= 38.488
  12:12:14 STEP  922 H= 922:00 +CPU= 24.683
  12:12:38 STEP  923 H= 923:00 +CPU= 23.956
  12:13:20 STEP  924 H= 924:00 +CPU= 42.475
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+000924
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+000924
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+000924
  12:13:44 STEP  925 H= 925:00 +CPU= 23.999
  12:14:09 STEP  926 H= 926:00 +CPU= 24.709
  12:14:48 STEP  927 H= 927:00 +CPU= 38.511
  12:15:12 STEP  928 H= 928:00 +CPU= 24.688
  12:15:36 STEP  929 H= 929:00 +CPU= 23.944
  12:16:16 STEP  930 H= 930:00 +CPU= 39.341
  12:16:39 STEP  931 H= 931:00 +CPU= 23.941
  12:17:04 STEP  932 H= 932:00 +CPU= 24.648
  12:17:43 STEP  933 H= 933:00 +CPU= 38.517
  12:18:07 STEP  934 H= 934:00 +CPU= 24.652
  12:18:32 STEP  935 H= 935:00 +CPU= 24.633
  12:19:17 STEP  936 H= 936:00 +CPU= 44.881
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+000936
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+000936
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+000924
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0267_2011050100_123_980_12196911_0_r583038537_38.zip
Uploading the intermediate file: upload_file_38.zip
  12:19:41 STEP  937 H= 937:00 +CPU= 23.955
  12:20:06 STEP  938 H= 938:00 +CPU= 24.732
  12:20:44 STEP  939 H= 939:00 +CPU= 38.487
  12:21:09 STEP  940 H= 940:00 +CPU= 24.659
  12:21:33 STEP  941 H= 941:00 +CPU= 23.947
  12:22:12 STEP  942 H= 942:00 +CPU= 39.388
  12:22:36 STEP  943 H= 943:00 +CPU= 23.956
  12:23:01 STEP  944 H= 944:00 +CPU= 24.699
  12:23:39 STEP  945 H= 945:00 +CPU= 38.567
  12:24:04 STEP  946 H= 946:00 +CPU= 24.720
  12:24:28 STEP  947 H= 947:00 +CPU= 23.970
  12:25:11 STEP  948 H= 948:00 +CPU= 42.496
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+000948
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+000948
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+000948
  12:25:35 STEP  949 H= 949:00 +CPU= 23.983
  12:25:59 STEP  950 H= 950:00 +CPU= 24.699
  12:26:38 STEP  951 H= 951:00 +CPU= 38.544
  12:27:03 STEP  952 H= 952:00 +CPU= 24.700
  12:27:26 STEP  953 H= 953:00 +CPU= 23.956
  12:28:06 STEP  954 H= 954:00 +CPU= 39.333
  12:28:30 STEP  955 H= 955:00 +CPU= 23.933
  12:28:54 STEP  956 H= 956:00 +CPU= 24.639
  12:29:33 STEP  957 H= 957:00 +CPU= 38.475
  12:29:58 STEP  958 H= 958:00 +CPU= 24.632
  12:30:22 STEP  959 H= 959:00 +CPU= 24.617
  12:31:07 STEP  960 H= 960:00 +CPU= 44.890
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+000960
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+000960
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0267_2011050100_123_980_12196911_0_r583038537_39.zip
Uploading the intermediate file: upload_file_39.zip
  12:31:31 STEP  961 H= 961:00 +CPU= 23.958
Uploading trickle at timestep: 3456000
  12:31:56 STEP  962 H= 962:00 +CPU= 24.670
  12:32:34 STEP  963 H= 963:00 +CPU= 38.503
  12:32:59 STEP  964 H= 964:00 +CPU= 24.641
  12:33:23 STEP  965 H= 965:00 +CPU= 23.921
  12:34:02 STEP  966 H= 966:00 +CPU= 39.353
  12:34:26 STEP  967 H= 967:00 +CPU= 23.967
  12:34:51 STEP  968 H= 968:00 +CPU= 24.688
  12:35:29 STEP  969 H= 969:00 +CPU= 38.546
  12:35:54 STEP  970 H= 970:00 +CPU= 24.675
  12:36:18 STEP  971 H= 971:00 +CPU= 23.958
  12:37:01 STEP  972 H= 972:00 +CPU= 42.449
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+000972
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+000972
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+000972
  12:37:25 STEP  973 H= 973:00 +CPU= 23.967
  12:37:49 STEP  974 H= 974:00 +CPU= 24.700
  12:38:28 STEP  975 H= 975:00 +CPU= 38.517
  12:38:52 STEP  976 H= 976:00 +CPU= 24.683
  12:39:16 STEP  977 H= 977:00 +CPU= 23.957
  12:39:56 STEP  978 H= 978:00 +CPU= 39.323
  12:40:20 STEP  979 H= 979:00 +CPU= 23.932
  12:40:44 STEP  980 H= 980:00 +CPU= 24.630
  12:41:23 STEP  981 H= 981:00 +CPU= 38.436
  12:41:47 STEP  982 H= 982:00 +CPU= 24.633
  12:42:12 STEP  983 H= 983:00 +CPU= 24.625
  12:42:57 STEP  984 H= 984:00 +CPU= 44.790
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+000984
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+000984
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+000972
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0267_2011050100_123_980_12196911_0_r583038537_40.zip
Uploading the intermediate file: upload_file_40.zip
  12:43:21 STEP  985 H= 985:00 +CPU= 23.944
  12:43:46 STEP  986 H= 986:00 +CPU= 24.639
  12:44:24 STEP  987 H= 987:00 +CPU= 38.487
  12:44:49 STEP  988 H= 988:00 +CPU= 24.654
  12:45:13 STEP  989 H= 989:00 +CPU= 23.924
  12:45:52 STEP  990 H= 990:00 +CPU= 39.324
  12:46:16 STEP  991 H= 991:00 +CPU= 23.948
  12:46:41 STEP  992 H= 992:00 +CPU= 24.688
  12:47:19 STEP  993 H= 993:00 +CPU= 38.469
  12:47:44 STEP  994 H= 994:00 +CPU= 24.669
  12:48:08 STEP  995 H= 995:00 +CPU= 23.950
  12:48:50 STEP  996 H= 996:00 +CPU= 42.406
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+000996
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+000996
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+000996
  12:49:14 STEP  997 H= 997:00 +CPU= 23.974
  12:49:39 STEP  998 H= 998:00 +CPU= 24.713
  12:50:17 STEP  999 H= 999:00 +CPU= 38.460
  12:50:42 STEP 1000 H=1000:00 +CPU= 24.680
  12:51:06 STEP 1001 H=1001:00 +CPU= 23.948
  12:51:45 STEP 1002 H=1002:00 +CPU= 39.290
  12:52:09 STEP 1003 H=1003:00 +CPU= 23.928
  12:52:34 STEP 1004 H=1004:00 +CPU= 24.641
  12:53:12 STEP 1005 H=1005:00 +CPU= 38.409
  12:53:37 STEP 1006 H=1006:00 +CPU= 24.644
  12:54:02 STEP 1007 H=1007:00 +CPU= 24.636
  12:54:46 STEP 1008 H=1008:00 +CPU= 44.778
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001008
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001008
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+000996
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0267_2011050100_123_980_12196911_0_r583038537_41.zip
Uploading the intermediate file: upload_file_41.zip
  12:55:10 STEP 1009 H=1009:00 +CPU= 23.995
  12:55:35 STEP 1010 H=1010:00 +CPU= 24.644
  12:56:13 STEP 1011 H=1011:00 +CPU= 38.435
  12:56:38 STEP 1012 H=1012:00 +CPU= 24.654
  12:57:02 STEP 1013 H=1013:00 +CPU= 23.929
  12:57:41 STEP 1014 H=1014:00 +CPU= 39.281
  12:58:05 STEP 1015 H=1015:00 +CPU= 23.950
  12:58:30 STEP 1016 H=1016:00 +CPU= 24.689
  12:59:09 STEP 1017 H=1017:00 +CPU= 38.473
  12:59:33 STEP 1018 H=1018:00 +CPU= 24.681
  12:59:57 STEP 1019 H=1019:00 +CPU= 23.976
  13:00:40 STEP 1020 H=1020:00 +CPU= 42.490
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001020
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001020
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001020
  13:01:04 STEP 1021 H=1021:00 +CPU= 23.985
  13:01:28 STEP 1022 H=1022:00 +CPU= 24.737
  13:02:07 STEP 1023 H=1023:00 +CPU= 38.497
  13:02:32 STEP 1024 H=1024:00 +CPU= 24.704
  13:02:56 STEP 1025 H=1025:00 +CPU= 23.967
  13:03:35 STEP 1026 H=1026:00 +CPU= 39.243
  13:03:59 STEP 1027 H=1027:00 +CPU= 23.953
  13:04:23 STEP 1028 H=1028:00 +CPU= 24.655
  13:05:02 STEP 1029 H=1029:00 +CPU= 38.445
  13:05:27 STEP 1030 H=1030:00 +CPU= 24.669
  13:05:51 STEP 1031 H=1031:00 +CPU= 24.638
  13:06:36 STEP 1032 H=1032:00 +CPU= 44.795
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001032
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001032
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001020
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0267_2011050100_123_980_12196911_0_r583038537_42.zip
Uploading the intermediate file: upload_file_42.zip
  13:07:00 STEP 1033 H=1033:00 +CPU= 23.972
  13:07:25 STEP 1034 H=1034:00 +CPU= 24.726
  13:08:03 STEP 1035 H=1035:00 +CPU= 38.399
  13:08:28 STEP 1036 H=1036:00 +CPU= 24.656
  13:08:52 STEP 1037 H=1037:00 +CPU= 23.938
  13:09:31 STEP 1038 H=1038:00 +CPU= 39.275
  13:09:55 STEP 1039 H=1039:00 +CPU= 23.949
  13:10:20 STEP 1040 H=1040:00 +CPU= 24.694
  13:10:58 STEP 1041 H=1041:00 +CPU= 38.441
  13:11:23 STEP 1042 H=1042:00 +CPU= 24.691
  13:11:47 STEP 1043 H=1043:00 +CPU= 23.975
  13:12:29 STEP 1044 H=1044:00 +CPU= 42.434
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001044
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001044
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001044
  13:12:53 STEP 1045 H=1045:00 +CPU= 23.971
  13:13:18 STEP 1046 H=1046:00 +CPU= 24.684
  13:13:56 STEP 1047 H=1047:00 +CPU= 38.412
  13:14:21 STEP 1048 H=1048:00 +CPU= 24.662
  13:14:45 STEP 1049 H=1049:00 +CPU= 23.929
  13:15:24 STEP 1050 H=1050:00 +CPU= 39.263
  13:15:48 STEP 1051 H=1051:00 +CPU= 23.905
  13:16:13 STEP 1052 H=1052:00 +CPU= 24.625
  13:16:51 STEP 1053 H=1053:00 +CPU= 38.424
  13:17:16 STEP 1054 H=1054:00 +CPU= 24.622
  13:17:41 STEP 1055 H=1055:00 +CPU= 24.592
  13:18:25 STEP 1056 H=1056:00 +CPU= 44.803
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001056
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001056
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0267_2011050100_123_980_12196911_0_r583038537_43.zip
Uploading the intermediate file: upload_file_43.zip
  13:18:49 STEP 1057 H=1057:00 +CPU= 24.068
  13:19:14 STEP 1058 H=1058:00 +CPU= 24.673
  13:19:53 STEP 1059 H=1059:00 +CPU= 38.420
  13:20:17 STEP 1060 H=1060:00 +CPU= 24.655
  13:20:41 STEP 1061 H=1061:00 +CPU= 23.930
  13:21:20 STEP 1062 H=1062:00 +CPU= 39.263
  13:21:44 STEP 1063 H=1063:00 +CPU= 23.968
  13:22:09 STEP 1064 H=1064:00 +CPU= 24.688
  13:22:48 STEP 1065 H=1065:00 +CPU= 38.484
  13:23:12 STEP 1066 H=1066:00 +CPU= 24.674
  13:23:36 STEP 1067 H=1067:00 +CPU= 23.968
  13:24:19 STEP 1068 H=1068:00 +CPU= 42.439
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001068
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001068
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001068
  13:24:43 STEP 1069 H=1069:00 +CPU= 23.948
  13:25:07 STEP 1070 H=1070:00 +CPU= 24.674
  13:25:46 STEP 1071 H=1071:00 +CPU= 38.403
  13:26:10 STEP 1072 H=1072:00 +CPU= 24.633
  13:26:34 STEP 1073 H=1073:00 +CPU= 23.920
  13:27:14 STEP 1074 H=1074:00 +CPU= 39.230
  13:27:37 STEP 1075 H=1075:00 +CPU= 23.888
  13:28:02 STEP 1076 H=1076:00 +CPU= 24.610
  13:28:40 STEP 1077 H=1077:00 +CPU= 38.404
  13:29:05 STEP 1078 H=1078:00 +CPU= 24.602
  13:29:30 STEP 1079 H=1079:00 +CPU= 24.568
  13:30:14 STEP 1080 H=1080:00 +CPU= 44.812
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001080
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001080
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001068
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0267_2011050100_123_980_12196911_0_r583038537_44.zip
Uploading the intermediate file: upload_file_44.zip
  13:30:38 STEP 1081 H=1081:00 +CPU= 23.950
  13:31:03 STEP 1082 H=1082:00 +CPU= 24.686
  13:31:42 STEP 1083 H=1083:00 +CPU= 38.440
  13:32:06 STEP 1084 H=1084:00 +CPU= 24.639
  13:32:30 STEP 1085 H=1085:00 +CPU= 23.946
  13:33:09 STEP 1086 H=1086:00 +CPU= 39.274
  13:33:33 STEP 1087 H=1087:00 +CPU= 23.960
  13:33:58 STEP 1088 H=1088:00 +CPU= 24.685
  13:34:37 STEP 1089 H=1089:00 +CPU= 38.532
  13:35:01 STEP 1090 H=1090:00 +CPU= 24.699
  13:35:25 STEP 1091 H=1091:00 +CPU= 23.977
  13:36:08 STEP 1092 H=1092:00 +CPU= 42.489
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001092
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001092
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001092
  13:36:32 STEP 1093 H=1093:00 +CPU= 23.958
  13:36:57 STEP 1094 H=1094:00 +CPU= 24.707
  13:37:35 STEP 1095 H=1095:00 +CPU= 38.464
  13:38:00 STEP 1096 H=1096:00 +CPU= 24.690
  13:38:24 STEP 1097 H=1097:00 +CPU= 23.938
  13:39:03 STEP 1098 H=1098:00 +CPU= 39.303
  13:39:27 STEP 1099 H=1099:00 +CPU= 23.925
  13:39:52 STEP 1100 H=1100:00 +CPU= 24.646
  13:40:30 STEP 1101 H=1101:00 +CPU= 38.487
  13:40:55 STEP 1102 H=1102:00 +CPU= 24.623
  13:41:19 STEP 1103 H=1103:00 +CPU= 24.627
  13:42:04 STEP 1104 H=1104:00 +CPU= 44.817
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001104
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001104
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001092
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0267_2011050100_123_980_12196911_0_r583038537_45.zip
Uploading the intermediate file: upload_file_45.zip
  13:42:28 STEP 1105 H=1105:00 +CPU= 23.952
  13:42:53 STEP 1106 H=1106:00 +CPU= 24.656
  13:43:31 STEP 1107 H=1107:00 +CPU= 38.463
  13:43:56 STEP 1108 H=1108:00 +CPU= 24.629
  13:44:20 STEP 1109 H=1109:00 +CPU= 23.911
  13:44:59 STEP 1110 H=1110:00 +CPU= 39.330
  13:45:23 STEP 1111 H=1111:00 +CPU= 23.930
  13:45:48 STEP 1112 H=1112:00 +CPU= 24.647
  13:46:26 STEP 1113 H=1113:00 +CPU= 38.421
  13:46:51 STEP 1114 H=1114:00 +CPU= 24.654
  13:47:15 STEP 1115 H=1115:00 +CPU= 23.912
  13:47:57 STEP 1116 H=1116:00 +CPU= 42.418
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001116
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001116
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001116
  13:48:21 STEP 1117 H=1117:00 +CPU= 23.941
  13:48:46 STEP 1118 H=1118:00 +CPU= 24.668
  13:49:24 STEP 1119 H=1119:00 +CPU= 38.441
  13:49:49 STEP 1120 H=1120:00 +CPU= 24.653
  13:50:13 STEP 1121 H=1121:00 +CPU= 23.922
  13:50:52 STEP 1122 H=1122:00 +CPU= 39.277
  13:51:16 STEP 1123 H=1123:00 +CPU= 23.907
  13:51:41 STEP 1124 H=1124:00 +CPU= 24.606
  13:52:19 STEP 1125 H=1125:00 +CPU= 38.444
  13:52:44 STEP 1126 H=1126:00 +CPU= 24.596
  13:53:08 STEP 1127 H=1127:00 +CPU= 24.597
  13:53:53 STEP 1128 H=1128:00 +CPU= 44.764
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001128
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001128
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001116
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0267_2011050100_123_980_12196911_0_r583038537_46.zip
Uploading the intermediate file: upload_file_46.zip
  13:54:17 STEP 1129 H=1129:00 +CPU= 23.979
  13:54:42 STEP 1130 H=1130:00 +CPU= 24.653
  13:55:20 STEP 1131 H=1131:00 +CPU= 38.499
  13:55:45 STEP 1132 H=1132:00 +CPU= 24.629
  13:56:09 STEP 1133 H=1133:00 +CPU= 23.926
  13:56:48 STEP 1134 H=1134:00 +CPU= 39.327
  13:57:12 STEP 1135 H=1135:00 +CPU= 23.940
  13:57:37 STEP 1136 H=1136:00 +CPU= 24.681
  13:58:15 STEP 1137 H=1137:00 +CPU= 38.526
  13:58:40 STEP 1138 H=1138:00 +CPU= 24.680
  13:59:04 STEP 1139 H=1139:00 +CPU= 23.951
  13:59:47 STEP 1140 H=1140:00 +CPU= 42.479
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001140
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001140
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001140
  14:00:11 STEP 1141 H=1141:00 +CPU= 23.974
  14:00:35 STEP 1142 H=1142:00 +CPU= 24.696
  14:01:14 STEP 1143 H=1143:00 +CPU= 38.499
  14:01:38 STEP 1144 H=1144:00 +CPU= 24.682
  14:02:02 STEP 1145 H=1145:00 +CPU= 23.927
  14:02:42 STEP 1146 H=1146:00 +CPU= 39.291
  14:03:06 STEP 1147 H=1147:00 +CPU= 23.924
  14:03:30 STEP 1148 H=1148:00 +CPU= 24.640
  14:04:09 STEP 1149 H=1149:00 +CPU= 38.472
  14:04:33 STEP 1150 H=1150:00 +CPU= 24.628
  14:04:58 STEP 1151 H=1151:00 +CPU= 24.617
  14:05:43 STEP 1152 H=1152:00 +CPU= 44.839
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001152
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001152
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0267_2011050100_123_980_12196911_0_r583038537_47.zip
Uploading the intermediate file: upload_file_47.zip
  14:06:07 STEP 1153 H=1153:00 +CPU= 23.965
  14:06:31 STEP 1154 H=1154:00 +CPU= 24.660
  14:07:10 STEP 1155 H=1155:00 +CPU= 38.427
  14:07:35 STEP 1156 H=1156:00 +CPU= 24.623
  14:07:58 STEP 1157 H=1157:00 +CPU= 23.932
  14:08:38 STEP 1158 H=1158:00 +CPU= 39.327
  14:09:02 STEP 1159 H=1159:00 +CPU= 23.932
  14:09:26 STEP 1160 H=1160:00 +CPU= 24.674
  14:10:05 STEP 1161 H=1161:00 +CPU= 38.476
  14:10:30 STEP 1162 H=1162:00 +CPU= 24.706
  14:10:54 STEP 1163 H=1163:00 +CPU= 23.966
  14:11:36 STEP 1164 H=1164:00 +CPU= 42.467
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001164
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001164
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001164
  14:12:00 STEP 1165 H=1165:00 +CPU= 23.964
  14:12:25 STEP 1166 H=1166:00 +CPU= 24.691
  14:13:03 STEP 1167 H=1167:00 +CPU= 38.488
  14:13:28 STEP 1168 H=1168:00 +CPU= 24.679
  14:13:52 STEP 1169 H=1169:00 +CPU= 23.940
  14:14:31 STEP 1170 H=1170:00 +CPU= 39.349
  14:14:55 STEP 1171 H=1171:00 +CPU= 23.911
  14:15:20 STEP 1172 H=1172:00 +CPU= 24.638
  14:15:58 STEP 1173 H=1173:00 +CPU= 38.471
  14:16:23 STEP 1174 H=1174:00 +CPU= 24.632
  14:16:48 STEP 1175 H=1175:00 +CPU= 24.625
  14:17:32 STEP 1176 H=1176:00 +CPU= 44.802
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001176
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001176
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001164
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0267_2011050100_123_980_12196911_0_r583038537_48.zip
Uploading the intermediate file: upload_file_48.zip
  14:17:56 STEP 1177 H=1177:00 +CPU= 23.972
  14:18:21 STEP 1178 H=1178:00 +CPU= 24.647
  14:19:00 STEP 1179 H=1179:00 +CPU= 38.599
  14:19:24 STEP 1180 H=1180:00 +CPU= 24.638
  14:19:48 STEP 1181 H=1181:00 +CPU= 23.948
  14:20:28 STEP 1182 H=1182:00 +CPU= 39.306
  14:20:52 STEP 1183 H=1183:00 +CPU= 23.955
  14:21:16 STEP 1184 H=1184:00 +CPU= 24.681
  14:21:55 STEP 1185 H=1185:00 +CPU= 38.506
  14:22:19 STEP 1186 H=1186:00 +CPU= 24.700
  14:22:43 STEP 1187 H=1187:00 +CPU= 23.957
  14:23:26 STEP 1188 H=1188:00 +CPU= 42.512
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001188
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001188
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001188
  14:23:50 STEP 1189 H=1189:00 +CPU= 23.957
  14:24:15 STEP 1190 H=1190:00 +CPU= 24.703
  14:24:53 STEP 1191 H=1191:00 +CPU= 38.485
  14:25:18 STEP 1192 H=1192:00 +CPU= 24.644
  14:25:42 STEP 1193 H=1193:00 +CPU= 23.912
  14:26:21 STEP 1194 H=1194:00 +CPU= 39.340
  14:26:45 STEP 1195 H=1195:00 +CPU= 23.917
  14:27:10 STEP 1196 H=1196:00 +CPU= 24.624
  14:27:48 STEP 1197 H=1197:00 +CPU= 38.480
  14:28:13 STEP 1198 H=1198:00 +CPU= 24.613
  14:28:37 STEP 1199 H=1199:00 +CPU= 24.607
  14:29:22 STEP 1200 H=1200:00 +CPU= 44.843
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001200
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001200
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001188
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0267_2011050100_123_980_12196911_0_r583038537_49.zip
Uploading the intermediate file: upload_file_49.zip
Uploading trickle at timestep: 4320000
  14:29:46 STEP 1201 H=1201:00 +CPU= 23.993
  14:30:11 STEP 1202 H=1202:00 +CPU= 24.674
  14:30:49 STEP 1203 H=1203:00 +CPU= 38.438
  14:31:14 STEP 1204 H=1204:00 +CPU= 24.595
  14:31:38 STEP 1205 H=1205:00 +CPU= 23.884
  14:32:17 STEP 1206 H=1206:00 +CPU= 39.280
  14:32:41 STEP 1207 H=1207:00 +CPU= 23.911
  14:33:06 STEP 1208 H=1208:00 +CPU= 24.649
  14:33:44 STEP 1209 H=1209:00 +CPU= 38.478
  14:34:09 STEP 1210 H=1210:00 +CPU= 24.653
  14:34:33 STEP 1211 H=1211:00 +CPU= 23.912
  14:35:15 STEP 1212 H=1212:00 +CPU= 42.473
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001212
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001212
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001212
  14:35:39 STEP 1213 H=1213:00 +CPU= 23.939
  14:36:04 STEP 1214 H=1214:00 +CPU= 24.672
  14:36:42 STEP 1215 H=1215:00 +CPU= 38.502
  14:37:07 STEP 1216 H=1216:00 +CPU= 24.653
  14:37:31 STEP 1217 H=1217:00 +CPU= 23.910
  14:38:10 STEP 1218 H=1218:00 +CPU= 39.355
  14:38:34 STEP 1219 H=1219:00 +CPU= 23.916
  14:38:59 STEP 1220 H=1220:00 +CPU= 24.623
  14:39:37 STEP 1221 H=1221:00 +CPU= 38.469
  14:40:02 STEP 1222 H=1222:00 +CPU= 24.633
  14:40:27 STEP 1223 H=1223:00 +CPU= 24.604
  14:41:11 STEP 1224 H=1224:00 +CPU= 44.823
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001224
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001224
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001212
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0267_2011050100_123_980_12196911_0_r583038537_50.zip
Uploading the intermediate file: upload_file_50.zip
  14:41:35 STEP 1225 H=1225:00 +CPU= 24.029
  14:42:00 STEP 1226 H=1226:00 +CPU= 24.647
  14:42:39 STEP 1227 H=1227:00 +CPU= 38.467
  14:43:03 STEP 1228 H=1228:00 +CPU= 24.629
  14:43:27 STEP 1229 H=1229:00 +CPU= 23.904
  14:44:06 STEP 1230 H=1230:00 +CPU= 39.337
  14:44:30 STEP 1231 H=1231:00 +CPU= 23.928
  14:44:55 STEP 1232 H=1232:00 +CPU= 24.649
  14:45:33 STEP 1233 H=1233:00 +CPU= 38.454
  14:45:58 STEP 1234 H=1234:00 +CPU= 24.656
  14:46:22 STEP 1235 H=1235:00 +CPU= 23.922
  14:47:04 STEP 1236 H=1236:00 +CPU= 42.436
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001236
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001236
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001236
  14:47:28 STEP 1237 H=1237:00 +CPU= 23.937
  14:47:53 STEP 1238 H=1238:00 +CPU= 24.670
  14:48:32 STEP 1239 H=1239:00 +CPU= 38.525
  14:48:56 STEP 1240 H=1240:00 +CPU= 24.655
  14:49:20 STEP 1241 H=1241:00 +CPU= 23.911
  14:50:00 STEP 1242 H=1242:00 +CPU= 39.346
  14:50:24 STEP 1243 H=1243:00 +CPU= 23.926
  14:50:48 STEP 1244 H=1244:00 +CPU= 24.628
  14:51:27 STEP 1245 H=1245:00 +CPU= 38.448
  14:51:51 STEP 1246 H=1246:00 +CPU= 24.616
  14:52:16 STEP 1247 H=1247:00 +CPU= 24.588
  14:53:01 STEP 1248 H=1248:00 +CPU= 44.800
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001248
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001248
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0267_2011050100_123_980_12196911_0_r583038537_51.zip
Uploading the intermediate file: upload_file_51.zip
  14:53:25 STEP 1249 H=1249:00 +CPU= 23.949
  14:53:49 STEP 1250 H=1250:00 +CPU= 24.665
  14:54:28 STEP 1251 H=1251:00 +CPU= 38.464
  14:54:52 STEP 1252 H=1252:00 +CPU= 24.615
  14:55:16 STEP 1253 H=1253:00 +CPU= 23.901
  14:55:56 STEP 1254 H=1254:00 +CPU= 39.336
  14:56:20 STEP 1255 H=1255:00 +CPU= 23.938
  14:56:44 STEP 1256 H=1256:00 +CPU= 24.660
  14:57:23 STEP 1257 H=1257:00 +CPU= 38.492
  14:57:47 STEP 1258 H=1258:00 +CPU= 24.671
  14:58:11 STEP 1259 H=1259:00 +CPU= 23.945
  14:58:54 STEP 1260 H=1260:00 +CPU= 42.444
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001260
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001260
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001260
  14:59:18 STEP 1261 H=1261:00 +CPU= 23.936
  14:59:42 STEP 1262 H=1262:00 +CPU= 24.673
  15:00:21 STEP 1263 H=1263:00 +CPU= 38.510
  15:00:46 STEP 1264 H=1264:00 +CPU= 24.649
  15:01:10 STEP 1265 H=1265:00 +CPU= 23.904
  15:01:49 STEP 1266 H=1266:00 +CPU= 39.318
  15:02:13 STEP 1267 H=1267:00 +CPU= 23.893
  15:02:37 STEP 1268 H=1268:00 +CPU= 24.603
  15:03:16 STEP 1269 H=1269:00 +CPU= 38.470
  15:03:40 STEP 1270 H=1270:00 +CPU= 24.602
  15:04:05 STEP 1271 H=1271:00 +CPU= 24.601
  15:04:50 STEP 1272 H=1272:00 +CPU= 44.815
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001272
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001272
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001260
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0267_2011050100_123_980_12196911_0_r583038537_52.zip
Uploading the intermediate file: upload_file_52.zip
  15:05:14 STEP 1273 H=1273:00 +CPU= 23.947
  15:05:39 STEP 1274 H=1274:00 +CPU= 24.658
  15:06:17 STEP 1275 H=1275:00 +CPU= 38.467
  15:06:42 STEP 1276 H=1276:00 +CPU= 24.617
  15:07:06 STEP 1277 H=1277:00 +CPU= 23.941
  15:07:45 STEP 1278 H=1278:00 +CPU= 39.319
  15:08:09 STEP 1279 H=1279:00 +CPU= 23.936
  15:08:33 STEP 1280 H=1280:00 +CPU= 24.658
  15:09:12 STEP 1281 H=1281:00 +CPU= 38.463
  15:09:37 STEP 1282 H=1282:00 +CPU= 24.677
  15:10:01 STEP 1283 H=1283:00 +CPU= 23.928
  15:10:43 STEP 1284 H=1284:00 +CPU= 42.487
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001284
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001284
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001284
  15:11:07 STEP 1285 H=1285:00 +CPU= 23.947
  15:11:32 STEP 1286 H=1286:00 +CPU= 24.676
  15:12:10 STEP 1287 H=1287:00 +CPU= 38.476
  15:12:35 STEP 1288 H=1288:00 +CPU= 24.628
  15:12:59 STEP 1289 H=1289:00 +CPU= 23.936
  15:13:38 STEP 1290 H=1290:00 +CPU= 39.309
  15:14:02 STEP 1291 H=1291:00 +CPU= 23.899
  15:14:27 STEP 1292 H=1292:00 +CPU= 24.616
  15:15:05 STEP 1293 H=1293:00 +CPU= 38.474
  15:15:30 STEP 1294 H=1294:00 +CPU= 24.602
  15:15:54 STEP 1295 H=1295:00 +CPU= 24.611
  15:16:39 STEP 1296 H=1296:00 +CPU= 44.817
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001296
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001296
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001284
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0267_2011050100_123_980_12196911_0_r583038537_53.zip
Uploading the intermediate file: upload_file_53.zip
  15:17:03 STEP 1297 H=1297:00 +CPU= 23.946
  15:17:28 STEP 1298 H=1298:00 +CPU= 24.607
  15:18:06 STEP 1299 H=1299:00 +CPU= 38.469
  15:18:31 STEP 1300 H=1300:00 +CPU= 24.609
  15:18:55 STEP 1301 H=1301:00 +CPU= 23.908
  15:19:34 STEP 1302 H=1302:00 +CPU= 39.317
  15:19:58 STEP 1303 H=1303:00 +CPU= 23.941
  15:20:23 STEP 1304 H=1304:00 +CPU= 24.661
  15:21:01 STEP 1305 H=1305:00 +CPU= 38.515
  15:21:26 STEP 1306 H=1306:00 +CPU= 24.653
  15:21:50 STEP 1307 H=1307:00 +CPU= 23.934
  15:22:32 STEP 1308 H=1308:00 +CPU= 42.504
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001308
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001308
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001308
  15:22:56 STEP 1309 H=1309:00 +CPU= 23.955
  15:23:21 STEP 1310 H=1310:00 +CPU= 24.687
  15:24:00 STEP 1311 H=1311:00 +CPU= 38.528
  15:24:24 STEP 1312 H=1312:00 +CPU= 24.663
  15:24:48 STEP 1313 H=1313:00 +CPU= 23.907
  15:25:27 STEP 1314 H=1314:00 +CPU= 39.300
  15:25:51 STEP 1315 H=1315:00 +CPU= 23.915
  15:26:16 STEP 1316 H=1316:00 +CPU= 24.614
  15:26:54 STEP 1317 H=1317:00 +CPU= 38.469
  15:27:19 STEP 1318 H=1318:00 +CPU= 24.602
  15:27:44 STEP 1319 H=1319:00 +CPU= 24.587
  15:28:29 STEP 1320 H=1320:00 +CPU= 44.823
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001320
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001320
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMGGhq0f+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMSHhq0f+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12196911/ICMUAhq0f+001308
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0267_2011050100_123_980_12196911_0_r583038537_54.zip
Uploading the intermediate file: upload_file_54.zip
  15:28:52 STEP 1321 H=1321:00 +CPU= 23.945
  15:29:17 STEP 1322 H=1322:00 +CPU= 24.672
  15:29:56 STEP 1323 H=1323:00 +CPU= 38.459
  15:30:20 STEP 1324 H=1324:00 +CPU= 24.627
  15:30:44 STEP 1325 H=1325:00 +CPU= 23.903
  15:31:23 STEP 1326 H=1326:00 +CPU= 39.310
  15:31:47 STEP 1327 H=1327:00 +CPU= 23.936
  15:32:12 STEP 1328 H=1328:00 +CPU= 24.669
  15:32:51 STEP 1329 H=1329:00 +CPU= 38.553
  15:33:15 STEP 1330 H=1330:00 +CPU= 24.673
  15:33:39 STEP 1331 H=1331:00 +CPU= 23.943
  15:34:22 STEP 1332 H=1332:00 +CPU= 42.491
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhq0f+001332
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhq0f+001332
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhq0f+001332
  15:34:46 STEP 1333 H=1333:00 +CPU= 23.948
  15:35:10 STEP 1334 H=1334:00 +CPU= 24.682
  15:35:49 STEP 1335 H=1335:00 +CPU= 38.507
  15:36:14 STEP 1336 H=1336:00 +CPU= 24.638
  15:36:38 STEP 1337 H=1337:00 +CPU= 23.921
  15:37:17 STEP 1338 H=1338:00 +CPU= 39.302
  15:37:41 STEP 1339 H=1339:00 +CPU= 23.883
  15:38:05 STEP 1340 H=1340:00 +CPU= 24.600
  15:38:44 STEP 1341 H=1341:00 +CPU= 38.487
  15:39:08 STEP 1342 H=1342:00 +CPU= 24.592
  15:39:33 STEP 1343 H=1343:00 +CPU= 24.580
  15:40:18 STEP 1344 H=1344:00 +CPU= 44.845
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154018:1671896418:48864.164] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#8 (SIGFPE) :: 2462MB (heap), 4415MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154018:1671896418:48864.164] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154018:1671896418:48864.164] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154018:1671896418:48864.164] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#8 was caused by floating-point overflow [memaddr=0xbe177c], nsigs = 1
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154018:1671896418:48864.164] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#8, nsigs = 1
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154018:1671896418:48864.164] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 2594 MB (maxheap), 4415 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154018:1671896418:48864.164] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154018:1671896418:48864.164] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154018:1671896418:48864.164] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154018:1671896418:48864.164] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154018:1671896418:48864.164] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154018:1671896418:48864.164] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154018:1671896418:48864.164] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        SPNORM 
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154018:1671896418:48864.164] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         SPNORMBM 
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154018:1671896418:48864.164] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          >OMP-SPNORMBM    1        (1048) 
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154018:1671896418:48864.164] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           SPNORMB 
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154019:1671896419:48865.164] [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/4/oifs_43r3_model.exe' : sigcontextptr=0x7ffe00fbf390
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154019:1671896419:48865.164] [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 15) with addr2line-cmd
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154019:1671896419:48865.164] [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/4/oifs_43r3_model.exe' 0x839273 0x839879 0x1dc9090 0xbe177c 0xbe0433 0xbd5da6 0x55d435 0x5471c9 0x546412 0x545e28 0x40708d 0x40220f 0x4021a2 0x1dca390 0x40206e
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154019:1671896419:48865.164] [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x839273] : ??() at ??:0
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154019:1671896419:48865.164] [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x839879] : ??() at ??:0
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154019:1671896419:48865.164] [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x1dc9090] : ??() at ??:0
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154019:1671896419:48865.164] [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0xbe177c] : ??() at ??:0
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154019:1671896419:48865.164] [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0xbe0433] : ??() at ??:0
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154019:1671896419:48865.164] [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0xbd5da6] : ??() at ??:0
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154019:1671896419:48865.164] [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x55d435] : ??() at ??:0
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154019:1671896419:48865.164] [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x5471c9] : ??() at ??:0
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154019:1671896419:48865.164] [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0x546412] : ??() at ??:0
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154019:1671896419:48865.164] [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0x545e28] : ??() at ??:0
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154019:1671896419:48865.164] [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0x40708d] : ??() at ??:0
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154019:1671896419:48865.164] [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x40220f] : ??() at ??:0
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154019:1671896419:48865.164] [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x4021a2] : ??() at ??:0
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154019:1671896419:48865.164] [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x1dca390] : ??() at ??:0
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154019:1671896419:48865.164] [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x40206e] : ??() at ??:0
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154019:1671896419:48865.164] [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
 Process            1  thread            1  calling linux_trbk from intel_trbk()
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/4/oifs_43r3_model.exe' : sigcontextptr=0x7ffe00fbf2a0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 16) with addr2line-cmd
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/4/oifs_43r3_model.exe' 0x839273 0x839879 0x821070 0x1dc9090 0xbe177c 0xbe0433 0xbd5da6 0x55d435 0x5471c9 0x546412 0x545e28 0x40708d 0x40220f 0x4021a2 0x1dca390 0x40206e
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x839273] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x839879] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x821070] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1dc9090] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0xbe177c] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0xbe0433] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0xbd5da6] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x55d435] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0x5471c9] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0x546412] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0x545e28] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x40708d] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x40220f] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x4021a2] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x1dca390] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x40206e] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154019:1671896419:48865.180] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#8, nsigs = 1
[EC_DRHOOK:homeserver2:1:1:7390:7390] [20221224:154019:1671896419:48865.180] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#8, nsigs = 1
forrtl: error (72): floating overflow
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CE916B  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000081FFF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC9090  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000BE177C  spnormb_                  103  spnormb.F90
oifs_43r3_model.e  0000000000BE0433  spnormbm_                  87  spnormbm.F90
oifs_43r3_model.e  0000000000BD5DA6  spnorm_                   288  spnorm.F90
oifs_43r3_model.e  000000000055D435  cnt4_                     829  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:52:35 1536693 22282924 oifs_43r3_ps_0267_2011050100_123_980_12196911_0 4,320,000 44,560 0.0103
09 May 2023 15:52:23 1536693 22282924 oifs_43r3_ps_0267_2011050100_123_980_12196911_0 3,456,000 37,473 0.0108
09 May 2023 15:52:11 1536693 22282924 oifs_43r3_ps_0267_2011050100_123_980_12196911_0 2,592,000 30,377 0.0117
09 May 2023 15:52:00 1536693 22282924 oifs_43r3_ps_0267_2011050100_123_980_12196911_0 1,728,000 22,777 0.0132
09 May 2023 15:51:41 1536693 22282924 oifs_43r3_ps_0267_2011050100_123_980_12196911_0 864,000 11,781 0.0136


©2024 climateprediction.net