Name | oifs_43r3_01fb_2019110100_123_993_12215285_0 |
Workunit | 12215285 |
Created | 24 Feb 2023, 18:02:30 UTC |
Sent | 24 Feb 2023, 22:48:14 UTC |
Report deadline | 25 Apr 2023, 22:48:14 UTC |
Received | 25 Feb 2023, 4:52:38 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 1 (0x00000001) Unknown error code |
Computer ID | 1508075 |
Run time | 5 hours 21 min 2 sec |
CPU time | 5 hours 18 min 37 sec |
Validate state | Invalid |
Credit | 4,838.40 |
Device peak FLOPS | 3.65 GFLOPS |
Application version | OpenIFS 43r3 v1.21 x86_64-pc-linux-gnu |
Peak working set size | 4,373.33 MB |
Peak swap size | 4,983.13 MB |
Peak disk usage | 1,653.53 MB |
Stderr | <core_client_version>7.23.0</core_client_version> <![CDATA[ <message> process exited with code 1 (0x1, -255)</message> <stderr_txt> EP 755 H= 755:00 +CPU= 13.397 02:22:00 STEP 756 H= 756:00 +CPU= 22.294 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+000756 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+000756 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+000756 02:22:13 STEP 757 H= 757:00 +CPU= 13.163 02:22:27 STEP 758 H= 758:00 +CPU= 13.681 02:22:47 STEP 759 H= 759:00 +CPU= 20.659 02:23:01 STEP 760 H= 760:00 +CPU= 13.802 02:23:15 STEP 761 H= 761:00 +CPU= 13.446 02:23:36 STEP 762 H= 762:00 +CPU= 21.223 02:23:50 STEP 763 H= 763:00 +CPU= 13.742 02:24:04 STEP 764 H= 764:00 +CPU= 13.791 02:24:24 STEP 765 H= 765:00 +CPU= 20.261 02:24:38 STEP 766 H= 766:00 +CPU= 13.618 02:24:52 STEP 767 H= 767:00 +CPU= 13.902 02:25:16 STEP 768 H= 768:00 +CPU= 24.368 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+000768 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+000768 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+000768 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+000744 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+000744 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+000744 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+000756 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+000756 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+000756 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01fb_2019110100_123_993_12215285_0_r2011108057_31.zip Uploading the intermediate file: upload_file_31.zip 02:25:29 STEP 769 H= 769:00 +CPU= 13.170 02:25:43 STEP 770 H= 770:00 +CPU= 13.532 02:26:03 STEP 771 H= 771:00 +CPU= 20.419 02:26:17 STEP 772 H= 772:00 +CPU= 13.702 02:26:30 STEP 773 H= 773:00 +CPU= 13.080 02:26:51 STEP 774 H= 774:00 +CPU= 21.353 02:27:05 STEP 775 H= 775:00 +CPU= 13.252 02:27:18 STEP 776 H= 776:00 +CPU= 13.591 02:27:39 STEP 777 H= 777:00 +CPU= 20.435 02:27:53 STEP 778 H= 778:00 +CPU= 13.854 02:28:06 STEP 779 H= 779:00 +CPU= 13.315 02:28:29 STEP 780 H= 780:00 +CPU= 22.744 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+000780 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+000780 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+000780 02:28:42 STEP 781 H= 781:00 +CPU= 13.245 02:28:56 STEP 782 H= 782:00 +CPU= 14.068 02:29:17 STEP 783 H= 783:00 +CPU= 20.786 02:29:31 STEP 784 H= 784:00 +CPU= 13.898 02:29:44 STEP 785 H= 785:00 +CPU= 13.377 02:30:06 STEP 786 H= 786:00 +CPU= 21.232 02:30:20 STEP 787 H= 787:00 +CPU= 13.709 02:30:34 STEP 788 H= 788:00 +CPU= 14.393 02:30:55 STEP 789 H= 789:00 +CPU= 20.710 02:31:09 STEP 790 H= 790:00 +CPU= 14.104 02:31:23 STEP 791 H= 791:00 +CPU= 13.927 02:31:47 STEP 792 H= 792:00 +CPU= 24.158 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+000792 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+000792 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+000792 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+000768 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+000768 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+000768 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+000780 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+000780 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+000780 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01fb_2019110100_123_993_12215285_0_r2011108057_32.zip Uploading the intermediate file: upload_file_32.zip 02:32:01 STEP 793 H= 793:00 +CPU= 13.457 02:32:14 STEP 794 H= 794:00 +CPU= 13.520 02:32:35 STEP 795 H= 795:00 +CPU= 20.667 02:32:49 STEP 796 H= 796:00 +CPU= 13.811 02:33:02 STEP 797 H= 797:00 +CPU= 13.162 02:33:23 STEP 798 H= 798:00 +CPU= 21.198 02:33:37 STEP 799 H= 799:00 +CPU= 13.383 02:33:51 STEP 800 H= 800:00 +CPU= 13.767 02:34:11 STEP 801 H= 801:00 +CPU= 20.457 02:34:25 STEP 802 H= 802:00 +CPU= 14.161 02:34:39 STEP 803 H= 803:00 +CPU= 13.275 02:35:01 STEP 804 H= 804:00 +CPU= 22.699 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+000804 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+000804 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+000804 02:35:15 STEP 805 H= 805:00 +CPU= 13.205 02:35:29 STEP 806 H= 806:00 +CPU= 13.824 02:35:50 STEP 807 H= 807:00 +CPU= 21.100 02:36:04 STEP 808 H= 808:00 +CPU= 13.843 02:36:18 STEP 809 H= 809:00 +CPU= 13.924 02:36:39 STEP 810 H= 810:00 +CPU= 21.112 02:36:52 STEP 811 H= 811:00 +CPU= 13.291 02:37:06 STEP 812 H= 812:00 +CPU= 13.730 02:37:27 STEP 813 H= 813:00 +CPU= 20.380 02:37:40 STEP 814 H= 814:00 +CPU= 13.601 02:37:54 STEP 815 H= 815:00 +CPU= 13.670 02:38:19 STEP 816 H= 816:00 +CPU= 24.568 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+000816 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+000816 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+000816 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+000792 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+000792 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+000792 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+000804 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+000804 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+000804 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01fb_2019110100_123_993_12215285_0_r2011108057_33.zip Uploading the intermediate file: upload_file_33.zip 02:38:32 STEP 817 H= 817:00 +CPU= 13.240 02:38:46 STEP 818 H= 818:00 +CPU= 14.026 02:39:07 STEP 819 H= 819:00 +CPU= 21.090 02:39:21 STEP 820 H= 820:00 +CPU= 14.099 02:39:35 STEP 821 H= 821:00 +CPU= 13.663 02:39:57 STEP 822 H= 822:00 +CPU= 21.438 02:40:10 STEP 823 H= 823:00 +CPU= 13.567 02:40:24 STEP 824 H= 824:00 +CPU= 13.988 02:40:45 STEP 825 H= 825:00 +CPU= 20.763 02:40:59 STEP 826 H= 826:00 +CPU= 14.052 02:41:13 STEP 827 H= 827:00 +CPU= 13.665 02:41:35 STEP 828 H= 828:00 +CPU= 22.496 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+000828 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+000828 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+000828 02:41:49 STEP 829 H= 829:00 +CPU= 13.396 02:42:03 STEP 830 H= 830:00 +CPU= 14.228 02:42:24 STEP 831 H= 831:00 +CPU= 20.672 02:42:38 STEP 832 H= 832:00 +CPU= 14.192 02:42:52 STEP 833 H= 833:00 +CPU= 13.590 02:43:13 STEP 834 H= 834:00 +CPU= 21.413 02:43:27 STEP 835 H= 835:00 +CPU= 13.520 02:43:40 STEP 836 H= 836:00 +CPU= 13.615 02:44:02 STEP 837 H= 837:00 +CPU= 21.135 02:44:15 STEP 838 H= 838:00 +CPU= 13.698 02:44:29 STEP 839 H= 839:00 +CPU= 13.990 02:44:53 STEP 840 H= 840:00 +CPU= 23.978 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+000840 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+000840 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+000840 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+000816 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+000816 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+000816 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+000828 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+000828 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+000828 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01fb_2019110100_123_993_12215285_0_r2011108057_34.zip Uploading the intermediate file: upload_file_34.zip 02:45:07 STEP 841 H= 841:00 +CPU= 13.336 02:45:20 STEP 842 H= 842:00 +CPU= 13.461 02:45:41 STEP 843 H= 843:00 +CPU= 20.388 02:45:54 STEP 844 H= 844:00 +CPU= 13.279 02:46:07 STEP 845 H= 845:00 +CPU= 13.484 02:46:29 STEP 846 H= 846:00 +CPU= 21.296 02:46:43 STEP 847 H= 847:00 +CPU= 13.853 02:46:57 STEP 848 H= 848:00 +CPU= 14.045 02:47:18 STEP 849 H= 849:00 +CPU= 20.735 02:47:31 STEP 850 H= 850:00 +CPU= 13.826 02:47:45 STEP 851 H= 851:00 +CPU= 13.458 02:48:07 STEP 852 H= 852:00 +CPU= 22.519 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+000852 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+000852 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+000852 02:48:21 STEP 853 H= 853:00 +CPU= 13.424 02:48:35 STEP 854 H= 854:00 +CPU= 13.608 02:48:56 STEP 855 H= 855:00 +CPU= 20.929 02:49:10 STEP 856 H= 856:00 +CPU= 13.928 02:49:23 STEP 857 H= 857:00 +CPU= 13.644 02:49:45 STEP 858 H= 858:00 +CPU= 21.594 02:49:59 STEP 859 H= 859:00 +CPU= 13.948 02:50:13 STEP 860 H= 860:00 +CPU= 14.256 02:50:34 STEP 861 H= 861:00 +CPU= 20.776 02:50:48 STEP 862 H= 862:00 +CPU= 13.698 02:51:02 STEP 863 H= 863:00 +CPU= 14.050 02:51:26 STEP 864 H= 864:00 +CPU= 24.082 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+000864 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+000864 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+000864 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+000840 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+000840 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+000840 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+000852 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+000852 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+000852 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01fb_2019110100_123_993_12215285_0_r2011108057_35.zip Uploading the intermediate file: upload_file_35.zip 02:51:39 STEP 865 H= 865:00 +CPU= 13.186 02:51:53 STEP 866 H= 866:00 +CPU= 13.537 02:52:13 STEP 867 H= 867:00 +CPU= 20.163 02:52:27 STEP 868 H= 868:00 +CPU= 13.929 02:52:40 STEP 869 H= 869:00 +CPU= 13.599 02:53:02 STEP 870 H= 870:00 +CPU= 21.234 02:53:15 STEP 871 H= 871:00 +CPU= 13.648 02:53:29 STEP 872 H= 872:00 +CPU= 13.799 02:53:50 STEP 873 H= 873:00 +CPU= 20.645 02:54:04 STEP 874 H= 874:00 +CPU= 13.750 02:54:17 STEP 875 H= 875:00 +CPU= 13.180 02:54:40 STEP 876 H= 876:00 +CPU= 22.554 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+000876 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+000876 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+000876 02:54:53 STEP 877 H= 877:00 +CPU= 13.668 02:55:07 STEP 878 H= 878:00 +CPU= 13.893 02:55:28 STEP 879 H= 879:00 +CPU= 20.513 02:55:41 STEP 880 H= 880:00 +CPU= 13.699 02:55:55 STEP 881 H= 881:00 +CPU= 13.315 02:56:16 STEP 882 H= 882:00 +CPU= 21.480 02:56:30 STEP 883 H= 883:00 +CPU= 13.749 02:56:44 STEP 884 H= 884:00 +CPU= 14.324 02:57:05 STEP 885 H= 885:00 +CPU= 20.834 02:57:19 STEP 886 H= 886:00 +CPU= 13.821 02:57:33 STEP 887 H= 887:00 +CPU= 13.865 02:57:57 STEP 888 H= 888:00 +CPU= 24.141 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+000888 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+000888 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+000888 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+000864 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+000864 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+000864 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+000876 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+000876 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+000876 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01fb_2019110100_123_993_12215285_0_r2011108057_36.zip Uploading the intermediate file: upload_file_36.zip 02:58:11 STEP 889 H= 889:00 +CPU= 13.247 02:58:24 STEP 890 H= 890:00 +CPU= 13.503 02:58:44 STEP 891 H= 891:00 +CPU= 20.027 02:58:58 STEP 892 H= 892:00 +CPU= 13.483 02:59:11 STEP 893 H= 893:00 +CPU= 13.210 02:59:32 STEP 894 H= 894:00 +CPU= 21.226 02:59:46 STEP 895 H= 895:00 +CPU= 13.283 03:00:00 STEP 896 H= 896:00 +CPU= 13.945 03:00:20 STEP 897 H= 897:00 +CPU= 20.596 03:00:34 STEP 898 H= 898:00 +CPU= 13.421 03:00:47 STEP 899 H= 899:00 +CPU= 12.990 03:01:10 STEP 900 H= 900:00 +CPU= 22.925 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+000900 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+000900 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+000900 03:01:24 STEP 901 H= 901:00 +CPU= 13.836 03:01:38 STEP 902 H= 902:00 +CPU= 14.131 03:01:59 STEP 903 H= 903:00 +CPU= 20.916 03:02:13 STEP 904 H= 904:00 +CPU= 13.986 03:02:26 STEP 905 H= 905:00 +CPU= 13.281 03:02:48 STEP 906 H= 906:00 +CPU= 21.650 03:03:02 STEP 907 H= 907:00 +CPU= 13.690 03:03:16 STEP 908 H= 908:00 +CPU= 14.011 03:03:36 STEP 909 H= 909:00 +CPU= 20.659 03:03:50 STEP 910 H= 910:00 +CPU= 13.707 03:04:04 STEP 911 H= 911:00 +CPU= 13.884 03:04:28 STEP 912 H= 912:00 +CPU= 24.322 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+000912 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+000912 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+000912 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+000888 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+000888 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+000888 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+000900 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+000900 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+000900 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01fb_2019110100_123_993_12215285_0_r2011108057_37.zip Uploading the intermediate file: upload_file_37.zip 03:04:42 STEP 913 H= 913:00 +CPU= 13.687 03:04:56 STEP 914 H= 914:00 +CPU= 13.658 03:05:16 STEP 915 H= 915:00 +CPU= 20.218 03:05:30 STEP 916 H= 916:00 +CPU= 13.782 03:05:43 STEP 917 H= 917:00 +CPU= 13.500 03:06:04 STEP 918 H= 918:00 +CPU= 20.899 03:06:18 STEP 919 H= 919:00 +CPU= 13.275 03:06:31 STEP 920 H= 920:00 +CPU= 13.688 03:06:52 STEP 921 H= 921:00 +CPU= 20.701 03:07:06 STEP 922 H= 922:00 +CPU= 13.910 03:07:20 STEP 923 H= 923:00 +CPU= 13.560 03:07:42 STEP 924 H= 924:00 +CPU= 22.575 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+000924 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+000924 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+000924 03:07:55 STEP 925 H= 925:00 +CPU= 13.120 03:08:09 STEP 926 H= 926:00 +CPU= 13.778 03:08:30 STEP 927 H= 927:00 +CPU= 20.376 03:08:44 STEP 928 H= 928:00 +CPU= 13.844 03:08:57 STEP 929 H= 929:00 +CPU= 13.568 03:09:19 STEP 930 H= 930:00 +CPU= 21.645 03:09:32 STEP 931 H= 931:00 +CPU= 13.625 03:09:46 STEP 932 H= 932:00 +CPU= 13.933 03:10:07 STEP 933 H= 933:00 +CPU= 20.669 03:10:21 STEP 934 H= 934:00 +CPU= 14.075 03:10:35 STEP 935 H= 935:00 +CPU= 13.843 03:10:59 STEP 936 H= 936:00 +CPU= 24.175 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+000936 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+000936 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+000936 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+000912 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+000912 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+000912 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+000924 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+000924 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+000924 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01fb_2019110100_123_993_12215285_0_r2011108057_38.zip Uploading the intermediate file: upload_file_38.zip 03:11:12 STEP 937 H= 937:00 +CPU= 13.068 03:11:26 STEP 938 H= 938:00 +CPU= 13.581 03:11:47 STEP 939 H= 939:00 +CPU= 20.779 03:12:00 STEP 940 H= 940:00 +CPU= 13.599 03:12:14 STEP 941 H= 941:00 +CPU= 13.568 03:12:35 STEP 942 H= 942:00 +CPU= 21.259 03:12:49 STEP 943 H= 943:00 +CPU= 13.827 03:13:04 STEP 944 H= 944:00 +CPU= 14.260 03:13:25 STEP 945 H= 945:00 +CPU= 20.987 03:13:38 STEP 946 H= 946:00 +CPU= 13.640 03:13:52 STEP 947 H= 947:00 +CPU= 13.279 03:14:14 STEP 948 H= 948:00 +CPU= 22.712 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+000948 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+000948 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+000948 03:14:27 STEP 949 H= 949:00 +CPU= 13.120 03:14:41 STEP 950 H= 950:00 +CPU= 13.763 03:15:02 STEP 951 H= 951:00 +CPU= 21.166 03:15:16 STEP 952 H= 952:00 +CPU= 13.919 03:15:30 STEP 953 H= 953:00 +CPU= 13.695 03:15:51 STEP 954 H= 954:00 +CPU= 21.067 03:16:05 STEP 955 H= 955:00 +CPU= 13.632 03:16:18 STEP 956 H= 956:00 +CPU= 13.542 03:16:39 STEP 957 H= 957:00 +CPU= 20.278 03:16:52 STEP 958 H= 958:00 +CPU= 13.546 03:17:06 STEP 959 H= 959:00 +CPU= 13.620 03:17:31 STEP 960 H= 960:00 +CPU= 24.770 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+000960 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+000960 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+000960 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+000936 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+000936 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+000936 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+000948 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+000948 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+000948 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01fb_2019110100_123_993_12215285_0_r2011108057_39.zip Uploading the intermediate file: upload_file_39.zip 03:17:44 STEP 961 H= 961:00 +CPU= 13.482 Uploading trickle at timestep: 3456000 03:17:58 STEP 962 H= 962:00 +CPU= 13.851 03:18:19 STEP 963 H= 963:00 +CPU= 20.952 03:18:33 STEP 964 H= 964:00 +CPU= 14.108 03:18:47 STEP 965 H= 965:00 +CPU= 13.507 03:19:08 STEP 966 H= 966:00 +CPU= 21.180 03:19:22 STEP 967 H= 967:00 +CPU= 13.600 03:19:36 STEP 968 H= 968:00 +CPU= 14.186 03:19:57 STEP 969 H= 969:00 +CPU= 20.466 03:20:10 STEP 970 H= 970:00 +CPU= 13.603 03:20:24 STEP 971 H= 971:00 +CPU= 13.432 03:20:46 STEP 972 H= 972:00 +CPU= 22.312 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+000972 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+000972 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+000972 03:20:59 STEP 973 H= 973:00 +CPU= 13.118 03:21:13 STEP 974 H= 974:00 +CPU= 13.774 03:21:33 STEP 975 H= 975:00 +CPU= 20.284 03:21:47 STEP 976 H= 976:00 +CPU= 13.562 03:22:00 STEP 977 H= 977:00 +CPU= 13.299 03:22:21 STEP 978 H= 978:00 +CPU= 20.813 03:22:34 STEP 979 H= 979:00 +CPU= 13.313 03:22:48 STEP 980 H= 980:00 +CPU= 13.712 03:23:08 STEP 981 H= 981:00 +CPU= 20.271 03:23:22 STEP 982 H= 982:00 +CPU= 13.981 03:23:36 STEP 983 H= 983:00 +CPU= 13.661 03:24:02 STEP 984 H= 984:00 +CPU= 25.398 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+000984 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+000984 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+000984 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+000960 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+000960 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+000960 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+000972 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+000972 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+000972 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01fb_2019110100_123_993_12215285_0_r2011108057_40.zip Uploading the intermediate file: upload_file_40.zip 03:24:15 STEP 985 H= 985:00 +CPU= 13.768 03:24:30 STEP 986 H= 986:00 +CPU= 14.078 03:24:50 STEP 987 H= 987:00 +CPU= 20.284 03:25:03 STEP 988 H= 988:00 +CPU= 13.447 03:25:17 STEP 989 H= 989:00 +CPU= 13.439 03:25:38 STEP 990 H= 990:00 +CPU= 21.226 03:25:52 STEP 991 H= 991:00 +CPU= 13.558 03:26:06 STEP 992 H= 992:00 +CPU= 14.109 03:26:27 STEP 993 H= 993:00 +CPU= 21.083 03:26:41 STEP 994 H= 994:00 +CPU= 13.917 03:26:55 STEP 995 H= 995:00 +CPU= 13.587 03:27:18 STEP 996 H= 996:00 +CPU= 23.220 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+000996 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+000996 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+000996 03:27:32 STEP 997 H= 997:00 +CPU= 13.847 03:27:46 STEP 998 H= 998:00 +CPU= 14.162 03:28:07 STEP 999 H= 999:00 +CPU= 20.775 03:28:21 STEP 1000 H=1000:00 +CPU= 14.333 03:28:35 STEP 1001 H=1001:00 +CPU= 13.320 03:28:56 STEP 1002 H=1002:00 +CPU= 21.363 03:29:09 STEP 1003 H=1003:00 +CPU= 13.396 03:29:24 STEP 1004 H=1004:00 +CPU= 14.068 03:29:44 STEP 1005 H=1005:00 +CPU= 20.328 03:29:58 STEP 1006 H=1006:00 +CPU= 13.652 03:30:12 STEP 1007 H=1007:00 +CPU= 14.109 03:30:36 STEP 1008 H=1008:00 +CPU= 24.502 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+001008 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+001008 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+001008 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+000984 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+000984 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+000984 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+000996 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+000996 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+000996 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01fb_2019110100_123_993_12215285_0_r2011108057_41.zip Uploading the intermediate file: upload_file_41.zip 03:30:50 STEP 1009 H=1009:00 +CPU= 13.168 03:31:03 STEP 1010 H=1010:00 +CPU= 13.300 03:31:24 STEP 1011 H=1011:00 +CPU= 20.573 03:31:37 STEP 1012 H=1012:00 +CPU= 13.700 03:31:51 STEP 1013 H=1013:00 +CPU= 13.552 03:32:12 STEP 1014 H=1014:00 +CPU= 21.180 03:32:26 STEP 1015 H=1015:00 +CPU= 13.861 03:32:40 STEP 1016 H=1016:00 +CPU= 14.007 03:33:01 STEP 1017 H=1017:00 +CPU= 21.044 03:33:15 STEP 1018 H=1018:00 +CPU= 13.656 03:33:28 STEP 1019 H=1019:00 +CPU= 13.437 03:33:51 STEP 1020 H=1020:00 +CPU= 22.259 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+001020 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+001020 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+001020 03:34:04 STEP 1021 H=1021:00 +CPU= 13.459 03:34:18 STEP 1022 H=1022:00 +CPU= 14.060 03:34:39 STEP 1023 H=1023:00 +CPU= 20.402 03:34:52 STEP 1024 H=1024:00 +CPU= 13.664 03:35:06 STEP 1025 H=1025:00 +CPU= 13.529 03:35:27 STEP 1026 H=1026:00 +CPU= 20.963 03:35:40 STEP 1027 H=1027:00 +CPU= 13.494 03:35:54 STEP 1028 H=1028:00 +CPU= 13.392 03:36:14 STEP 1029 H=1029:00 +CPU= 20.586 03:36:28 STEP 1030 H=1030:00 +CPU= 13.583 03:36:42 STEP 1031 H=1031:00 +CPU= 13.581 03:37:07 STEP 1032 H=1032:00 +CPU= 24.485 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+001032 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+001032 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+001032 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+001008 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+001008 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+001008 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+001020 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+001020 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+001020 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01fb_2019110100_123_993_12215285_0_r2011108057_42.zip Uploading the intermediate file: upload_file_42.zip 03:37:20 STEP 1033 H=1033:00 +CPU= 13.520 03:37:34 STEP 1034 H=1034:00 +CPU= 13.644 03:37:54 STEP 1035 H=1035:00 +CPU= 20.315 03:38:08 STEP 1036 H=1036:00 +CPU= 13.533 03:38:21 STEP 1037 H=1037:00 +CPU= 13.190 03:38:42 STEP 1038 H=1038:00 +CPU= 21.146 03:38:56 STEP 1039 H=1039:00 +CPU= 13.662 03:39:10 STEP 1040 H=1040:00 +CPU= 14.110 03:39:31 STEP 1041 H=1041:00 +CPU= 20.914 03:39:45 STEP 1042 H=1042:00 +CPU= 14.069 03:39:59 STEP 1043 H=1043:00 +CPU= 13.680 03:40:21 STEP 1044 H=1044:00 +CPU= 22.598 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+001044 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+001044 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+001044 03:40:35 STEP 1045 H=1045:00 +CPU= 13.277 03:40:49 STEP 1046 H=1046:00 +CPU= 13.875 03:41:10 STEP 1047 H=1047:00 +CPU= 21.077 03:41:24 STEP 1048 H=1048:00 +CPU= 13.923 03:41:37 STEP 1049 H=1049:00 +CPU= 13.257 03:41:59 STEP 1050 H=1050:00 +CPU= 21.700 03:42:13 STEP 1051 H=1051:00 +CPU= 14.031 03:42:27 STEP 1052 H=1052:00 +CPU= 14.035 03:42:48 STEP 1053 H=1053:00 +CPU= 20.809 03:43:02 STEP 1054 H=1054:00 +CPU= 14.266 03:43:16 STEP 1055 H=1055:00 +CPU= 14.000 03:43:40 STEP 1056 H=1056:00 +CPU= 23.863 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+001056 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+001056 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+001056 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+001032 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+001032 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+001032 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+001044 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+001044 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+001044 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01fb_2019110100_123_993_12215285_0_r2011108057_43.zip Uploading the intermediate file: upload_file_43.zip 03:43:53 STEP 1057 H=1057:00 +CPU= 13.303 03:44:07 STEP 1058 H=1058:00 +CPU= 13.634 03:44:27 STEP 1059 H=1059:00 +CPU= 20.167 03:44:41 STEP 1060 H=1060:00 +CPU= 13.735 03:44:55 STEP 1061 H=1061:00 +CPU= 13.436 03:45:16 STEP 1062 H=1062:00 +CPU= 20.974 03:45:29 STEP 1063 H=1063:00 +CPU= 13.627 03:45:43 STEP 1064 H=1064:00 +CPU= 13.563 03:46:04 STEP 1065 H=1065:00 +CPU= 20.574 03:46:17 STEP 1066 H=1066:00 +CPU= 13.524 03:46:30 STEP 1067 H=1067:00 +CPU= 13.196 03:46:53 STEP 1068 H=1068:00 +CPU= 22.901 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+001068 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+001068 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+001068 03:47:07 STEP 1069 H=1069:00 +CPU= 13.791 03:47:21 STEP 1070 H=1070:00 +CPU= 14.217 03:47:42 STEP 1071 H=1071:00 +CPU= 20.686 03:47:56 STEP 1072 H=1072:00 +CPU= 14.068 03:48:10 STEP 1073 H=1073:00 +CPU= 13.447 03:48:31 STEP 1074 H=1074:00 +CPU= 20.945 03:48:44 STEP 1075 H=1075:00 +CPU= 13.131 03:48:58 STEP 1076 H=1076:00 +CPU= 13.677 03:49:18 STEP 1077 H=1077:00 +CPU= 20.892 03:49:32 STEP 1078 H=1078:00 +CPU= 13.536 03:49:46 STEP 1079 H=1079:00 +CPU= 13.595 03:50:10 STEP 1080 H=1080:00 +CPU= 24.155 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+001080 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+001080 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+001080 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+001056 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+001056 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+001056 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+001068 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+001068 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+001068 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01fb_2019110100_123_993_12215285_0_r2011108057_44.zip Uploading the intermediate file: upload_file_44.zip 03:50:23 STEP 1081 H=1081:00 +CPU= 13.363 03:50:37 STEP 1082 H=1082:00 +CPU= 13.658 03:50:58 STEP 1083 H=1083:00 +CPU= 20.649 03:51:12 STEP 1084 H=1084:00 +CPU= 13.775 03:51:25 STEP 1085 H=1085:00 +CPU= 13.450 03:51:46 STEP 1086 H=1086:00 +CPU= 21.198 03:52:00 STEP 1087 H=1087:00 +CPU= 13.337 03:52:13 STEP 1088 H=1088:00 +CPU= 13.672 03:52:34 STEP 1089 H=1089:00 +CPU= 20.433 03:52:48 STEP 1090 H=1090:00 +CPU= 13.647 03:53:01 STEP 1091 H=1091:00 +CPU= 13.544 03:53:24 STEP 1092 H=1092:00 +CPU= 23.309 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+001092 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+001092 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+001092 03:53:38 STEP 1093 H=1093:00 +CPU= 13.466 03:53:52 STEP 1094 H=1094:00 +CPU= 13.575 03:54:13 STEP 1095 H=1095:00 +CPU= 21.048 03:54:26 STEP 1096 H=1096:00 +CPU= 13.653 03:54:40 STEP 1097 H=1097:00 +CPU= 13.271 03:55:01 STEP 1098 H=1098:00 +CPU= 21.066 03:55:14 STEP 1099 H=1099:00 +CPU= 13.122 03:55:28 STEP 1100 H=1100:00 +CPU= 13.788 03:55:48 STEP 1101 H=1101:00 +CPU= 20.571 03:56:02 STEP 1102 H=1102:00 +CPU= 13.940 03:56:16 STEP 1103 H=1103:00 +CPU= 13.989 03:56:42 STEP 1104 H=1104:00 +CPU= 25.376 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+001104 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+001104 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+001104 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+001080 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+001080 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+001080 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+001092 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+001092 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+001092 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01fb_2019110100_123_993_12215285_0_r2011108057_45.zip Uploading the intermediate file: upload_file_45.zip 03:56:55 STEP 1105 H=1105:00 +CPU= 13.261 03:57:09 STEP 1106 H=1106:00 +CPU= 13.440 03:57:30 STEP 1107 H=1107:00 +CPU= 21.006 03:57:44 STEP 1108 H=1108:00 +CPU= 14.307 03:57:58 STEP 1109 H=1109:00 +CPU= 13.738 03:58:19 STEP 1110 H=1110:00 +CPU= 21.078 03:58:33 STEP 1111 H=1111:00 +CPU= 13.719 03:58:47 STEP 1112 H=1112:00 +CPU= 14.217 03:59:08 STEP 1113 H=1113:00 +CPU= 20.791 03:59:22 STEP 1114 H=1114:00 +CPU= 14.182 03:59:36 STEP 1115 H=1115:00 +CPU= 13.611 03:59:58 STEP 1116 H=1116:00 +CPU= 22.503 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+001116 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+001116 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+001116 04:00:12 STEP 1117 H=1117:00 +CPU= 13.551 04:00:26 STEP 1118 H=1118:00 +CPU= 13.596 04:00:46 STEP 1119 H=1119:00 +CPU= 20.692 04:01:00 STEP 1120 H=1120:00 +CPU= 14.012 04:01:14 STEP 1121 H=1121:00 +CPU= 13.879 04:01:35 STEP 1122 H=1122:00 +CPU= 21.221 04:01:49 STEP 1123 H=1123:00 +CPU= 13.692 04:02:03 STEP 1124 H=1124:00 +CPU= 13.671 04:02:24 STEP 1125 H=1125:00 +CPU= 21.284 04:02:38 STEP 1126 H=1126:00 +CPU= 13.903 04:02:52 STEP 1127 H=1127:00 +CPU= 13.983 04:03:16 STEP 1128 H=1128:00 +CPU= 24.237 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+001128 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+001128 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+001128 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+001104 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+001104 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+001104 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+001116 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+001116 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+001116 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01fb_2019110100_123_993_12215285_0_r2011108057_46.zip Uploading the intermediate file: upload_file_46.zip 04:03:30 STEP 1129 H=1129:00 +CPU= 13.196 04:03:43 STEP 1130 H=1130:00 +CPU= 13.432 04:04:04 STEP 1131 H=1131:00 +CPU= 21.075 04:04:18 STEP 1132 H=1132:00 +CPU= 13.985 04:04:32 STEP 1133 H=1133:00 +CPU= 13.629 04:04:54 STEP 1134 H=1134:00 +CPU= 21.551 04:05:07 STEP 1135 H=1135:00 +CPU= 13.469 04:05:21 STEP 1136 H=1136:00 +CPU= 13.905 04:05:43 STEP 1137 H=1137:00 +CPU= 20.711 04:05:57 STEP 1138 H=1138:00 +CPU= 14.170 04:06:11 STEP 1139 H=1139:00 +CPU= 13.696 04:06:33 STEP 1140 H=1140:00 +CPU= 22.165 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+001140 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+001140 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+001140 04:06:47 STEP 1141 H=1141:00 +CPU= 13.523 04:07:01 STEP 1142 H=1142:00 +CPU= 13.948 04:07:21 STEP 1143 H=1143:00 +CPU= 20.759 04:07:35 STEP 1144 H=1144:00 +CPU= 13.986 04:07:49 STEP 1145 H=1145:00 +CPU= 13.744 04:08:10 STEP 1146 H=1146:00 +CPU= 21.219 04:08:24 STEP 1147 H=1147:00 +CPU= 13.257 04:08:37 STEP 1148 H=1148:00 +CPU= 13.361 04:08:58 STEP 1149 H=1149:00 +CPU= 20.922 04:09:12 STEP 1150 H=1150:00 +CPU= 13.753 04:09:25 STEP 1151 H=1151:00 +CPU= 13.618 04:09:50 STEP 1152 H=1152:00 +CPU= 24.753 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+001152 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+001152 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+001152 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+001128 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+001128 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+001128 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+001140 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+001140 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+001140 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01fb_2019110100_123_993_12215285_0_r2011108057_47.zip Uploading the intermediate file: upload_file_47.zip 04:10:04 STEP 1153 H=1153:00 +CPU= 13.576 04:10:17 STEP 1154 H=1154:00 +CPU= 13.522 04:10:38 STEP 1155 H=1155:00 +CPU= 20.136 04:10:51 STEP 1156 H=1156:00 +CPU= 13.329 04:11:04 STEP 1157 H=1157:00 +CPU= 13.356 04:11:25 STEP 1158 H=1158:00 +CPU= 21.038 04:11:39 STEP 1159 H=1159:00 +CPU= 13.462 04:11:53 STEP 1160 H=1160:00 +CPU= 13.665 04:12:13 STEP 1161 H=1161:00 +CPU= 20.730 04:12:27 STEP 1162 H=1162:00 +CPU= 13.681 04:12:41 STEP 1163 H=1163:00 +CPU= 13.527 04:13:04 STEP 1164 H=1164:00 +CPU= 23.165 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+001164 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+001164 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+001164 04:13:18 STEP 1165 H=1165:00 +CPU= 13.979 04:13:32 STEP 1166 H=1166:00 +CPU= 13.845 04:13:53 STEP 1167 H=1167:00 +CPU= 20.646 04:14:07 STEP 1168 H=1168:00 +CPU= 14.241 04:14:20 STEP 1169 H=1169:00 +CPU= 13.458 04:14:42 STEP 1170 H=1170:00 +CPU= 21.568 04:14:56 STEP 1171 H=1171:00 +CPU= 13.617 04:15:10 STEP 1172 H=1172:00 +CPU= 14.153 04:15:31 STEP 1173 H=1173:00 +CPU= 21.253 04:15:45 STEP 1174 H=1174:00 +CPU= 14.387 04:16:00 STEP 1175 H=1175:00 +CPU= 14.320 04:16:24 STEP 1176 H=1176:00 +CPU= 24.421 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhnw4+001176 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhnw4+001176 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhnw4+001176 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+001152 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+001152 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+001152 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMGGhnw4+001164 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMSHhnw4+001164 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215285/ICMUAhnw4+001164 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01fb_2019110100_123_993_12215285_0_r2011108057_48.zip Uploading the intermediate file: upload_file_48.zip 04:16:38 STEP 1177 H=1177:00 +CPU= 13.516 04:16:52 STEP 1178 H=1178:00 +CPU= 13.697 04:17:12 STEP 1179 H=1179:00 +CPU= 20.175 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041720:1677298640:19198.396] [signal_drhook@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1538] Received signal#8 (SIGFPE) :: 4001MB (heap), 4416MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041720:1677298640:19198.397] [signal_drhook@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041720:1677298640:19198.397] [signal_drhook@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x8102d0 (old at (nil)) [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041720:1677298640:19198.397] [signal_drhook@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1617] Signal#8 was caused by floating-point divide by zero [memaddr=0x11f1724], nsigs = 1 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041720:1677298640:19198.397] [signal_drhook@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#8, nsigs = 1 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041720:1677298640:19198.397] [c_drhook_print_@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:3843] 4001 MB (maxheap), 4416 MB (maxrss), 0 MB (maxstack) [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041720:1677298640:19198.397] [c_drhook_print_@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:3897] : MASTER [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041720:1677298640:19198.398] [c_drhook_print_@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:3897] : CNT0 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041720:1677298640:19198.398] [c_drhook_print_@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:3897] : CNT1 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041720:1677298640:19198.398] [c_drhook_print_@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:3897] : CNT2 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041720:1677298640:19198.398] [c_drhook_print_@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:3897] : CNT3 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041720:1677298640:19198.398] [c_drhook_print_@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:3897] : CNT4 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041720:1677298640:19198.398] [c_drhook_print_@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:3897] : STEPO [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041720:1677298640:19198.398] [c_drhook_print_@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:3897] : SCAN2M [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041720:1677298640:19198.398] [c_drhook_print_@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:3897] : GP_MODEL_HEAP [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041720:1677298640:19198.398] [c_drhook_print_@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:3897] : GP_MODEL [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041720:1677298640:19198.398] [c_drhook_print_@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:3897] : EC_PHYS_DRV [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041720:1677298640:19198.398] [c_drhook_print_@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:3897] : >OMP-PHYSICS (1001) [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041720:1677298640:19198.398] [c_drhook_print_@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:3897] : EC_PHYS [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041720:1677298640:19198.398] [c_drhook_print_@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:3897] : CALLPAR [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041720:1677298640:19198.398] [c_drhook_print_@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:3897] : CUANCAPE2 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/2/oifs_43r3_model.exe' : sigcontextptr=0x7ffe91320550 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 20) with addr2line-cmd [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/2/oifs_43r3_model.exe' 0x838003 0x838609 0x1dc8950 0x11f1724 0xf5a9e1 0xeb811f 0xea465c 0xc96183 0x138e0f2 0x139c38e 0x4d61c4 0x4339dc 0x41d979 0x41c8f2 0x407bd8 0x40734d 0x40220f 0x4021a2 0x1dc9c50 0x40206e [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x838003] : ??() at ??:0 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x838609] : ??() at ??:0 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x1dc8950] : ??() at ??:0 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x11f1724] : ??() at ??:0 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0xf5a9e1] : ??() at ??:0 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0xeb811f] : ??() at ??:0 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0xea465c] : ??() at ??:0 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0xc96183] : ??() at ??:0 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0x138e0f2] : ??() at ??:0 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0x139c38e] : ??() at ??:0 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0x4d61c4] : ??() at ??:0 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x4339dc] : ??() at ??:0 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x41d979] : ??() at ??:0 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x41c8f2] : ??() at ??:0 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x407bd8] : ??() at ??:0 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x40734d] : ??() at ??:0 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x40220f] : ??() at ??:0 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x4021a2] : ??() at ??:0 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x1dc9c50] : ??() at ??:0 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x40206e] : ??() at ??:0 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.398] [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s) Process 1 thread 1 calling linux_trbk from intel_trbk() [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/2/oifs_43r3_model.exe' : sigcontextptr=0x7ffe91320460 [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 21) with addr2line-cmd [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/2/oifs_43r3_model.exe' 0x838003 0x838609 0x811f80 0x1dc8950 0x11f1724 0xf5a9e1 0xeb811f 0xea465c 0xc96183 0x138e0f2 0x139c38e 0x4d61c4 0x4339dc 0x41d979 0x41c8f2 0x407bd8 0x40734d 0x40220f 0x4021a2 0x1dc9c50 0x40206e [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x838003] : ??() at ??:0 [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x838609] : ??() at ??:0 [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x811f80] : ??() at ??:0 [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1dc8950] : ??() at ??:0 [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x11f1724] : ??() at ??:0 [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0xf5a9e1] : ??() at ??:0 [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0xeb811f] : ??() at ??:0 [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0xea465c] : ??() at ??:0 [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0xc96183] : ??() at ??:0 [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0x138e0f2] : ??() at ??:0 [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0x139c38e] : ??() at ??:0 [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x4d61c4] : ??() at ??:0 [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x4339dc] : ??() at ??:0 [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x41d979] : ??() at ??:0 [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x41c8f2] : ??() at ??:0 [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x407bd8] : ??() at ??:0 [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x40734d] : ??() at ??:0 [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x40220f] : ??() at ??:0 [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x4021a2] : ??() at ??:0 [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x1dc9c50] : ??() at ??:0 [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x40206e] : ??() at ??:0 [LinuxTraceBack@/home/glenn/github/gc_oifs43r3/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s) [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.423] [signal_drhook@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#8, nsigs = 1 [EC_DRHOOK:swarm:1:1:16106:16106] [20230225:041721:1677298641:19199.423] [signal_drhook@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8440 for signal#8, nsigs = 1 forrtl: error (73): floating divide by zero Image PC Routine Line Source oifs_43r3_model.e 0000000001CE89FB Unknown Unknown Unknown oifs_43r3_model.e 0000000000810F01 Unknown Unknown Unknown oifs_43r3_model.e 0000000001DC8950 Unknown Unknown Unknown oifs_43r3_model.e 00000000011F1724 cuancape2_ 106 cuancape2.F90 oifs_43r3_model.e 0000000000F5A9E1 callpar_ 1102 callpar.F90 oifs_43r3_model.e 0000000000EB811F ec_phys_ 670 ec_phys.F90 oifs_43r3_model.e 0000000000EA465C ec_phys_drv_ 599 ec_phys_drv.F90 oifs_43r3_model.e 0000000000C96183 gp_model_ 613 gp_model.F90 oifs_43r3_model.e 000000000138E0F2 gp_model_heap_ 74 gp_model_heap.F90 oifs_43r3_model.e 000000000139C38E scan2m_ 535 scan2m.F90 oifs_43r3_model.e 00000000004D61C4 stepo_ 327 stepo.F90 oifs_43r3_model.e 00000000004339DC cnt4_ 1133 cnt4.F90 oifs_43r3_model.e 000000000041D979 cnt3_ 267 cnt3.F90 oifs_43r3_model.e 000000000041C8F2 cnt2_ 88 cnt2.F90 oifs_43r3_model.e 0000000000407BD8 cnt1_ 92 cnt1.F90 oifs_43r3_model.e 000000000040734D cnt0_ 146 cnt0.F90 oifs_43r3_model.e 000000000040220F MAIN__ 96 master.F90 oifs_43r3_model.e 00000000004021A2 Unknown Unknown Unknown oifs_43r3_model.e 0000000001DC9C50 Unknown Unknown Unknown oifs_43r3_model.e 000000000040206E Unknown Unknown Unknown ..The child process has been killed with signal: 6 >>> Printing last 70 lines from file: NODE.001_01 NSTEP = 1177 STEPO 0AAA00AAA SPECTRAL NORMS: Pattern 1 STEPO, YSPSDT_AR1 ( 1,...), SP NORMS 2D: 4.911067897365E-01 1.637722339533E-01 5.899818044747E-02 STEPO, YSPSDT_AR1 (SUM,...), SP NORMS 2D: 5.240800112085E-01 STEPO, YGPSDT ( 1,...), Grid Point Norms FIELD LEV AVERAGE MINIMUM MAXIMUM 101 60 -2.16625242337621E-02 -2.44401869984370E+00 1.61367391160485E+00 STEPO, YGPSDT[clipped]( 1,...), Grid Point Norms FIELD LEV AVERAGE MINIMUM MAXIMUM 101 60 -1.64212011113293E-02 -1.00000000000000E+00 1.00000000000000E+00 STEPO: evolving YSPSDT_AR1( 1) !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191220001500 !!!!!!!!!!!! !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191220003000 !!!!!!!!!!!! !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191220004500 !!!!!!!!!!!! !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191220010000 !!!!!!!!!!!! 04:16:38 STEP 1177 H=1177:00 +CPU= 13.516 NSTEP = 1178 STEPO 0AAA00AAA SPECTRAL NORMS: Pattern 1 STEPO, YSPSDT_AR1 ( 1,...), SP NORMS 2D: 4.866081355427E-01 1.675171956005E-01 5.797154585858E-02 STEPO, YSPSDT_AR1 (SUM,...), SP NORMS 2D: 5.266426360303E-01 STEPO, YGPSDT ( 1,...), Grid Point Norms FIELD LEV AVERAGE MINIMUM MAXIMUM 101 60 -2.76695520178736E-02 -2.30100724089793E+00 1.84980413305857E+00 STEPO, YGPSDT[clipped]( 1,...), Grid Point Norms FIELD LEV AVERAGE MINIMUM MAXIMUM 101 60 -2.64469651714471E-02 -1.00000000000000E+00 1.00000000000000E+00 STEPO: evolving YSPSDT_AR1( 1) !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191220011500 !!!!!!!!!!!! !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191220013000 !!!!!!!!!!!! !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191220014500 !!!!!!!!!!!! !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191220020000 !!!!!!!!!!!! 04:16:52 STEP 1178 H=1178:00 +CPU= 13.697 DATE= 2019 12 20 ISTEP= 1179: Reset RSOLINC= 1361.0304 RIP0= 1405.8607 SU_GHGCLIM, RCARDI,RCH4,RN2O,RCFC11,RCFC12,RNO2: 6.242877686081999E-004 9.622004323071002E-007 4.997313790396501E-007 9.593326011059999E-010 2.025453512012000E-009 7.940283000000001E-011 SUECAEC: GLOBAL AVERAGE VOLCANIC SULPHATE FOR (KINDAT,KMINUT) 20191101 70830 1.025977047146402E-004 SUECSO4: USE AVAILABLE FILES FOR DECADES: 2010 2020 SUBROUTINE SUECSO4:, UNWEIGHTED AVERAGE: 2.239373433433277E-003 NSTEP = 1179 STEPO 0AAA00AAA SPECTRAL NORMS: Pattern 1 STEPO, YSPSDT_AR1 ( 1,...), SP NORMS 2D: 4.938783071714E-01 1.707743500267E-01 5.774622419240E-02 STEPO, YSPSDT_AR1 (SUM,...), SP NORMS 2D: 5.324955030113E-01 STEPO, YGPSDT ( 1,...), Grid Point Norms FIELD LEV AVERAGE MINIMUM MAXIMUM 101 60 -1.84064913757332E-02 -1.93816183088966E+00 1.89175203823861E+00 STEPO, YGPSDT[clipped]( 1,...), Grid Point Norms FIELD LEV AVERAGE MINIMUM MAXIMUM 101 60 -1.65681313097246E-02 -1.00000000000000E+00 1.00000000000000E+00 STEPO: evolving YSPSDT_AR1( 1) !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191220021500 !!!!!!!!!!!! !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191220023000 !!!!!!!!!!!! !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191220024500 !!!!!!!!!!!! !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED. DATE IS: 20191220030000 !!!!!!!!!!!! 04:17:12 STEP 1179 H=1179:00 +CPU= 20.175 ISTEP= 1180 RSOLINC= 1361.0304 RI0= 1366.0000 ZI0= 1361.0304 RIP0= 1405.8694 ISTEP= 1180 ZI0= 1361.0304 ZSEASON= 1.032944890 REA=149597870000.00 RDEASO=147192890663.38 NSTEP = 1180 STEPO 0AAA00AAA SPECTRAL NORMS: Pattern 1 STEPO, YSPSDT_AR1 ( 1,...), SP NORMS 2D: 4.980801627496E-01 1.717515513820E-01 5.857145977363E-02 STEPO, YSPSDT_AR1 (SUM,...), SP NORMS 2D: 5.311419248313E-01 STEPO, YGPSDT ( 1,...), Grid Point Norms FIELD LEV AVERAGE MINIMUM MAXIMUM 101 60 -3.38152322584910E-02 -1.86707763153182E+00 1.78655582878229E+00 STEPO, YGPSDT[clipped]( 1,...), Grid Point Norms FIELD LEV AVERAGE MINIMUM MAXIMUM 101 60 -3.10362578278288E-02 -1.00000000000000E+00 1.00000000000000E+00 ------------------------------------------------ CNT0 not found; string returned was: 'STEPO' >>> Printing last 8 lines from file: ifs.stat 04:16:02 0AA000000 STEPO 1176 2.141 2.141 2.148 317:19 318:40 0.11319034869628E-04 2GB 0MB 04:16:03 FULLPOS-B DYNFPOS 1176 0.493 0.493 0.495 317:19 318:40 0.11319034869628E-04 2GB 0MB 04:16:03 0AAA00AAA STEPO 1176 0.735 0.735 0.810 317:20 318:41 0.11319034869628E-04 2GB 0MB 04:16:24 0AAA00AAA STEPO 1177 20.884 20.884 20.958 317:41 319:02 0.11319034869628E-04 2GB 0MB 04:16:38 0AAA00AAA STEPO 1178 13.516 13.516 13.573 317:55 319:16 0.11319034869628E-04 2GB 0MB 04:16:52 0AAA00AAA STEPO 1179 13.698 13.698 13.749 318:08 319:29 0.11319034869628E-04 2GB 0MB 04:17:12 0AAA00AAA STEPO 1180 20.175 20.175 20.206 318:28 319:50 0.11319034869628E-04 2GB 0MB ------------------------------------------------ >>> Printing last 11 lines from file: rcf CSTEP = " 1176", CTIME = "00490000 ", NSTEPLPP = 201, 202, 49, 228226, 228227, 5*0, IPRGPNSRES = 1, IPRGPEWRES = 1, IPRTRWRES = 1, IPRTRVRES = 1, GMASS0 = 98320.8281151068 , GMASSI = 98320.2939854183 / ------------------------------------------------ >>> Printing last 17 lines from file: waminfo PARAM=10U/10V, REPRES=GG, ANALYSIS PERIOD = 0 FORECAST PERIOD = 6397200 WIND TIME STEP IN SECONDS = 3600 ANALYSIS FROM 20191101000000 TO 20191101000000 ASSIMILATION NO NEW FORECAST NO STATUS STORM1= UNFINISHED STATUS STORM2= UNFINISHED STATUS STORM3= UNFINISHED DATE FOR OUTPUT OF BOTH RESTART FILES = 00000000000000 LAST DATE FOR SPECTRA FILE OUTPUT = 20200303000000 BEGIN DATE FOR USING SURFACE CURRENT = 20191101000000 PARALLEL RESTART = YES NUMBER OF MPI TASKS USED = 1 ------------------------------------------------ >>> Printing last 8 lines from file: /var/lib/boinc-client/slots/2/progress_file_12215285.xml <running_values> <last_cpu_time>19111.730000</last_cpu_time> <upload_file_number>49</upload_file_number> <last_iter>1180</last_iter> <last_upload>4233600</last_upload> <model_completed>0</model_completed> </running_values> ------------------------------------------------ ..Failed, model did not complete successfully </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
09 May 2023 16:53:09 | 1508075 | 22316690 | oifs_43r3_01fb_2019110100_123_993_12215285_0 | 3,456,000 | 15,538 | 0.0045 |
09 May 2023 16:53:06 | 1508075 | 22316690 | oifs_43r3_01fb_2019110100_123_993_12215285_0 | 2,592,000 | 11,639 | 0.0045 |
09 May 2023 16:53:03 | 1508075 | 22316690 | oifs_43r3_01fb_2019110100_123_993_12215285_0 | 1,728,000 | 7,741 | 0.0045 |
09 May 2023 16:53:00 | 1508075 | 22316690 | oifs_43r3_01fb_2019110100_123_993_12215285_0 | 864,000 | 3,839 | 0.0044 |
©2024 climateprediction.net