<core_client_version>7.16.17</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
d request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:17:04 STEP 1903 H=1903:00 +CPU= 45.782
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:18:19 STEP 1904 H=1904:00 +CPU= 51.029
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:19:43 STEP 1905 H=1905:00 +CPU= 73.992
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:20:45 STEP 1906 H=1906:00 +CPU= 46.581
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:21:45 STEP 1907 H=1907:00 +CPU= 43.150
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:23:15 STEP 1908 H=1908:00 +CPU= 75.744
Moving to projects directory: /var/lib/boinc/slots/8/ICMGGhq0f+001908
Moving to projects directory: /var/lib/boinc/slots/8/ICMSHhq0f+001908
Moving to projects directory: /var/lib/boinc/slots/8/ICMUAhq0f+001908
03:24:03 STEP 1909 H=1909:00 +CPU= 43.756
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:25:02 STEP 1910 H=1910:00 +CPU= 46.090
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:26:29 STEP 1911 H=1911:00 +CPU= 72.528
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:27:26 STEP 1912 H=1912:00 +CPU= 48.298
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:28:35 STEP 1913 H=1913:00 +CPU= 48.460
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:30:15 STEP 1914 H=1914:00 +CPU= 77.885
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:31:14 STEP 1915 H=1915:00 +CPU= 50.625
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:32:09 STEP 1916 H=1916:00 +CPU= 48.601
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:33:25 STEP 1917 H=1917:00 +CPU= 69.784
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:34:15 STEP 1918 H=1918:00 +CPU= 43.747
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:35:12 STEP 1919 H=1919:00 +CPU= 41.936
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:37:23 STEP 1920 H=1920:00 +CPU= 82.304
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc/slots/8/ICMGGhq0f+001920
Moving to projects directory: /var/lib/boinc/slots/8/ICMSHhq0f+001920
Moving to projects directory: /var/lib/boinc/slots/8/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMGGhq0f+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMSHhq0f+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMGGhq0f+001908
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMSHhq0f+001908
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMUAhq0f+001908
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0958_2007050100_123_976_12193602_0_r1284212300_79.zip
Uploading the intermediate file: upload_file_79.zip
Uploading trickle at timestep: 6912000
03:38:17 STEP 1921 H=1921:00 +CPU= 45.740
03:39:16 STEP 1922 H=1922:00 +CPU= 48.551
03:40:58 STEP 1923 H=1923:00 +CPU= 83.518
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:41:59 STEP 1924 H=1924:00 +CPU= 45.741
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:42:56 STEP 1925 H=1925:00 +CPU= 48.155
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:44:32 STEP 1926 H=1926:00 +CPU= 78.322
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:45:32 STEP 1927 H=1927:00 +CPU= 48.311
03:46:30 STEP 1928 H=1928:00 +CPU= 48.272
03:47:53 STEP 1929 H=1929:00 +CPU= 69.238
03:48:40 STEP 1930 H=1930:00 +CPU= 43.320
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:49:31 STEP 1931 H=1931:00 +CPU= 42.319
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:51:06 STEP 1932 H=1932:00 +CPU= 80.017
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc/slots/8/ICMGGhq0f+001932
Moving to projects directory: /var/lib/boinc/slots/8/ICMSHhq0f+001932
Moving to projects directory: /var/lib/boinc/slots/8/ICMUAhq0f+001932
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:51:58 STEP 1933 H=1933:00 +CPU= 43.842
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:52:54 STEP 1934 H=1934:00 +CPU= 46.715
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:54:27 STEP 1935 H=1935:00 +CPU= 77.397
03:55:27 STEP 1936 H=1936:00 +CPU= 52.332
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:56:28 STEP 1937 H=1937:00 +CPU= 52.594
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:58:04 STEP 1938 H=1938:00 +CPU= 75.593
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:59:02 STEP 1939 H=1939:00 +CPU= 52.848
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:00:00 STEP 1940 H=1940:00 +CPU= 47.394
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:01:33 STEP 1941 H=1941:00 +CPU= 78.276
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:02:32 STEP 1942 H=1942:00 +CPU= 47.518
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:05:13 STEP 1943 H=1943:00 +CPU= 50.184
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:09:43 STEP 1944 H=1944:00 +CPU= 82.593
Moving to projects directory: /var/lib/boinc/slots/8/ICMGGhq0f+001944
Moving to projects directory: /var/lib/boinc/slots/8/ICMSHhq0f+001944
Moving to projects directory: /var/lib/boinc/slots/8/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMGGhq0f+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMSHhq0f+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMGGhq0f+001932
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMSHhq0f+001932
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMUAhq0f+001932
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0958_2007050100_123_976_12193602_0_r1284212300_80.zip
Uploading the intermediate file: upload_file_80.zip
04:10:37 STEP 1945 H=1945:00 +CPU= 46.090
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:11:42 STEP 1946 H=1946:00 +CPU= 50.643
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:12:57 STEP 1947 H=1947:00 +CPU= 65.879
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:13:56 STEP 1948 H=1948:00 +CPU= 45.577
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:14:54 STEP 1949 H=1949:00 +CPU= 44.952
04:16:20 STEP 1950 H=1950:00 +CPU= 69.962
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:17:15 STEP 1951 H=1951:00 +CPU= 46.276
04:18:06 STEP 1952 H=1952:00 +CPU= 45.968
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:20:08 STEP 1953 H=1953:00 +CPU= 71.018
04:21:04 STEP 1954 H=1954:00 +CPU= 47.284
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:22:03 STEP 1955 H=1955:00 +CPU= 46.512
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:23:34 STEP 1956 H=1956:00 +CPU= 75.982
Moving to projects directory: /var/lib/boinc/slots/8/ICMGGhq0f+001956
Moving to projects directory: /var/lib/boinc/slots/8/ICMSHhq0f+001956
Moving to projects directory: /var/lib/boinc/slots/8/ICMUAhq0f+001956
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:24:43 STEP 1957 H=1957:00 +CPU= 43.436
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:25:49 STEP 1958 H=1958:00 +CPU= 43.781
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:27:14 STEP 1959 H=1959:00 +CPU= 72.633
04:28:03 STEP 1960 H=1960:00 +CPU= 43.209
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:29:04 STEP 1961 H=1961:00 +CPU= 45.825
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:30:36 STEP 1962 H=1962:00 +CPU= 72.357
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:31:30 STEP 1963 H=1963:00 +CPU= 44.297
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:32:32 STEP 1964 H=1964:00 +CPU= 47.481
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:34:09 STEP 1965 H=1965:00 +CPU= 71.382
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:35:01 STEP 1966 H=1966:00 +CPU= 44.732
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:35:49 STEP 1967 H=1967:00 +CPU= 43.035
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:37:19 STEP 1968 H=1968:00 +CPU= 81.107
Moving to projects directory: /var/lib/boinc/slots/8/ICMGGhq0f+001968
Moving to projects directory: /var/lib/boinc/slots/8/ICMSHhq0f+001968
Moving to projects directory: /var/lib/boinc/slots/8/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMGGhq0f+001944
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMSHhq0f+001944
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMGGhq0f+001956
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMSHhq0f+001956
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMUAhq0f+001956
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0958_2007050100_123_976_12193602_0_r1284212300_81.zip
Uploading the intermediate file: upload_file_81.zip
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:38:24 STEP 1969 H=1969:00 +CPU= 45.542
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:39:24 STEP 1970 H=1970:00 +CPU= 48.590
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:40:49 STEP 1971 H=1971:00 +CPU= 72.801
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:41:47 STEP 1972 H=1972:00 +CPU= 48.250
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:42:43 STEP 1973 H=1973:00 +CPU= 47.197
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:44:13 STEP 1974 H=1974:00 +CPU= 74.895
04:45:10 STEP 1975 H=1975:00 +CPU= 49.240
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:46:10 STEP 1976 H=1976:00 +CPU= 51.179
04:48:02 STEP 1977 H=1977:00 +CPU= 79.516
04:49:05 STEP 1978 H=1978:00 +CPU= 49.898
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:49:58 STEP 1979 H=1979:00 +CPU= 43.758
04:51:21 STEP 1980 H=1980:00 +CPU= 76.454
Moving to projects directory: /var/lib/boinc/slots/8/ICMGGhq0f+001980
Moving to projects directory: /var/lib/boinc/slots/8/ICMSHhq0f+001980
Moving to projects directory: /var/lib/boinc/slots/8/ICMUAhq0f+001980
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:52:11 STEP 1981 H=1981:00 +CPU= 44.042
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:53:00 STEP 1982 H=1982:00 +CPU= 41.603
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:54:18 STEP 1983 H=1983:00 +CPU= 68.620
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:55:25 STEP 1984 H=1984:00 +CPU= 50.193
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:56:32 STEP 1985 H=1985:00 +CPU= 49.216
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:58:03 STEP 1986 H=1986:00 +CPU= 73.510
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:58:58 STEP 1987 H=1987:00 +CPU= 47.069
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:59:58 STEP 1988 H=1988:00 +CPU= 50.041
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:01:23 STEP 1989 H=1989:00 +CPU= 70.087
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:02:13 STEP 1990 H=1990:00 +CPU= 44.313
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:03:46 STEP 1991 H=1991:00 +CPU= 45.128
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:05:43 STEP 1992 H=1992:00 +CPU= 85.058
Moving to projects directory: /var/lib/boinc/slots/8/ICMGGhq0f+001992
Moving to projects directory: /var/lib/boinc/slots/8/ICMSHhq0f+001992
Moving to projects directory: /var/lib/boinc/slots/8/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMGGhq0f+001968
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMSHhq0f+001968
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMGGhq0f+001980
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMSHhq0f+001980
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMUAhq0f+001980
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0958_2007050100_123_976_12193602_0_r1284212300_82.zip
Uploading the intermediate file: upload_file_82.zip
05:06:40 STEP 1993 H=1993:00 +CPU= 47.879
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:07:37 STEP 1994 H=1994:00 +CPU= 45.977
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:08:52 STEP 1995 H=1995:00 +CPU= 68.459
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:09:40 STEP 1996 H=1996:00 +CPU= 42.840
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:10:39 STEP 1997 H=1997:00 +CPU= 42.745
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:12:08 STEP 1998 H=1998:00 +CPU= 73.363
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:13:06 STEP 1999 H=1999:00 +CPU= 43.477
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:13:55 STEP 2000 H=2000:00 +CPU= 41.980
05:15:07 STEP 2001 H=2001:00 +CPU= 64.767
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:16:02 STEP 2002 H=2002:00 +CPU= 44.192
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:16:56 STEP 2003 H=2003:00 +CPU= 43.168
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:18:51 STEP 2004 H=2004:00 +CPU= 76.401
Moving to projects directory: /var/lib/boinc/slots/8/ICMGGhq0f+002004
Moving to projects directory: /var/lib/boinc/slots/8/ICMSHhq0f+002004
Moving to projects directory: /var/lib/boinc/slots/8/ICMUAhq0f+002004
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:19:34 STEP 2005 H=2005:00 +CPU= 39.461
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:20:17 STEP 2006 H=2006:00 +CPU= 38.009
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:22:01 STEP 2007 H=2007:00 +CPU= 65.773
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:23:00 STEP 2008 H=2008:00 +CPU= 47.245
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:23:54 STEP 2009 H=2009:00 +CPU= 46.094
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:25:12 STEP 2010 H=2010:00 +CPU= 68.563
05:26:07 STEP 2011 H=2011:00 +CPU= 48.480
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:27:15 STEP 2012 H=2012:00 +CPU= 55.357
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:28:55 STEP 2013 H=2013:00 +CPU= 82.826
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:30:28 STEP 2014 H=2014:00 +CPU= 49.548
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:32:24 STEP 2015 H=2015:00 +CPU= 50.507
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:35:04 STEP 2016 H=2016:00 +CPU= 84.759
Moving to projects directory: /var/lib/boinc/slots/8/ICMGGhq0f+002016
Moving to projects directory: /var/lib/boinc/slots/8/ICMSHhq0f+002016
Moving to projects directory: /var/lib/boinc/slots/8/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMGGhq0f+001992
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMSHhq0f+001992
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMGGhq0f+002004
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMSHhq0f+002004
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMUAhq0f+002004
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0958_2007050100_123_976_12193602_0_r1284212300_83.zip
Uploading the intermediate file: upload_file_83.zip
05:35:47 STEP 2017 H=2017:00 +CPU= 41.703
05:36:35 STEP 2018 H=2018:00 +CPU= 44.730
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:38:34 STEP 2019 H=2019:00 +CPU= 71.008
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:39:27 STEP 2020 H=2020:00 +CPU= 47.679
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:40:17 STEP 2021 H=2021:00 +CPU= 42.073
05:41:38 STEP 2022 H=2022:00 +CPU= 71.103
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:42:31 STEP 2023 H=2023:00 +CPU= 43.982
05:43:16 STEP 2024 H=2024:00 +CPU= 39.605
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:44:42 STEP 2025 H=2025:00 +CPU= 72.572
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:45:40 STEP 2026 H=2026:00 +CPU= 47.109
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:46:46 STEP 2027 H=2027:00 +CPU= 46.005
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:50:37 STEP 2028 H=2028:00 +CPU= 78.268
Moving to projects directory: /var/lib/boinc/slots/8/ICMGGhq0f+002028
Moving to projects directory: /var/lib/boinc/slots/8/ICMSHhq0f+002028
Moving to projects directory: /var/lib/boinc/slots/8/ICMUAhq0f+002028
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:51:29 STEP 2029 H=2029:00 +CPU= 44.815
05:52:25 STEP 2030 H=2030:00 +CPU= 44.227
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:53:59 STEP 2031 H=2031:00 +CPU= 74.882
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:54:50 STEP 2032 H=2032:00 +CPU= 44.088
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:56:38 STEP 2033 H=2033:00 +CPU= 42.742
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:58:25 STEP 2034 H=2034:00 +CPU= 88.861
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
05:59:16 STEP 2035 H=2035:00 +CPU= 39.771
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:00:05 STEP 2036 H=2036:00 +CPU= 42.602
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:01:33 STEP 2037 H=2037:00 +CPU= 70.859
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:02:29 STEP 2038 H=2038:00 +CPU= 46.726
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:03:42 STEP 2039 H=2039:00 +CPU= 50.050
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:05:19 STEP 2040 H=2040:00 +CPU= 83.205
Moving to projects directory: /var/lib/boinc/slots/8/ICMGGhq0f+002040
Moving to projects directory: /var/lib/boinc/slots/8/ICMSHhq0f+002040
Moving to projects directory: /var/lib/boinc/slots/8/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMGGhq0f+002016
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMSHhq0f+002016
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMGGhq0f+002028
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMSHhq0f+002028
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602/ICMUAhq0f+002028
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0958_2007050100_123_976_12193602_0_r1284212300_84.zip
Uploading the intermediate file: upload_file_84.zip
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:06:11 STEP 2041 H=2041:00 +CPU= 44.285
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:07:06 STEP 2042 H=2042:00 +CPU= 44.041
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:08:32 STEP 2043 H=2043:00 +CPU= 70.752
06:09:18 STEP 2044 H=2044:00 +CPU= 43.131
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:10:10 STEP 2045 H=2045:00 +CPU= 43.212
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:11:35 STEP 2046 H=2046:00 +CPU= 68.583
06:12:31 STEP 2047 H=2047:00 +CPU= 48.222
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:13:34 STEP 2048 H=2048:00 +CPU= 46.722
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:14:52 STEP 2049 H=2049:00 +CPU= 68.988
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:15:47 STEP 2050 H=2050:00 +CPU= 45.561
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:16:45 STEP 2051 H=2051:00 +CPU= 46.122
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:18:49 STEP 2052 H=2052:00 +CPU= 91.161
Moving to projects directory: /var/lib/boinc/slots/8/ICMGGhq0f+002052
Moving to projects directory: /var/lib/boinc/slots/8/ICMSHhq0f+002052
Moving to projects directory: /var/lib/boinc/slots/8/ICMUAhq0f+002052
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:20:13 STEP 2053 H=2053:00 +CPU= 58.738
06:21:23 STEP 2054 H=2054:00 +CPU= 60.671
06:23:27 STEP 2055 H=2055:00 +CPU=102.506
06:24:52 STEP 2056 H=2056:00 +CPU= 67.100
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:25:44 STEP 2057 H=2057:00 +CPU= 39.965
06:26:48 STEP 2058 H=2058:00 +CPU= 63.054
06:27:36 STEP 2059 H=2059:00 +CPU= 37.551
06:28:27 STEP 2060 H=2060:00 +CPU= 38.395
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:30:14 STEP 2061 H=2061:00 +CPU= 59.879
06:31:07 STEP 2062 H=2062:00 +CPU= 40.546
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:37:29 STEP 2063 H=2063:00 +CPU= 41.339
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Quit request received from the BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2007050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0958
(argv4) batchid: 976
(argv5) wuid: 12193602
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/8
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12193602
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_2b882ee76deaf7d57fd7bb4b5b9b54ee to: /var/lib/boinc/slots/8/oifs_43r3_ps_0958_2007050100_123_976_12193602.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/8/oifs_43r3_ps_0958_2007050100_123_976_12193602.zip
ic_ancil_file: ic_ancil_12193602
ifsdata_file: ifsdata_12193602
climate_data_file: clim_data_12193602
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_a5a5d30ce6e0ffcb39701426b73f86d8 to: /var/lib/boinc/slots/8/ic_ancil_12193602.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/8/ic_ancil_12193602.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_4ad3f99ef1eaf2dea923bc0f0627b01d to: /var/lib/boinc/slots/8/ifsdata/ifsdata_12193602.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/8/ifsdata/ifsdata_12193602.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/8/159l_2/clim_data_12193602.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/8/159l_2/clim_data_12193602.zip
Checking for progress XML file: /var/lib/boinc/slots/8/progress_file_12193602.xml
Opened progress file ok : /var/lib/boinc/slots/8/progress_file_12193602.xml
-- Model is restarting --
Adjusting last_iter, 2064, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/8/progress_file_12193602.xml
last_cpu_time: 106568
upload_file_number: 85
last_iter: 2063
last_upload: 7344000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0958_2007050100_123_976_12193602_0_r1284212300
The child process has been launched with process id: 110
Executing the command: /var/lib/boinc/slots/8/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.002] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.002] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.002] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.002] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.002] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.002] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.002] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.002] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.002] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.003] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.003] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.003] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.003] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.003] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.003] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.003] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.003] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.003] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220244:1674817364:0.004] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
ABORT! 1 !! *** WAVE MODEL HAS ABORTED
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220624:1674817584:219.654] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 1721 MB (maxheap), 3523 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220624:1674817584:219.655] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : MASTER
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220624:1674817584:219.659] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT0
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220624:1674817584:219.668] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT1
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220624:1674817584:219.675] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT2
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220624:1674817584:219.680] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT3
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220624:1674817584:219.684] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT4
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220624:1674817584:219.685] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : WVCOUPLE
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220624:1674817584:219.689] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : WAVEMDL
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220624:1674817584:219.691] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : INITMDL
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220624:1674817584:219.695] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : USERIN
SDL_TRACEBACK: Calling INTEL_TRBK, THRD = 1
Process 1 thread 1 calling linux_trbk from intel_trbk()
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc/slots/8/oifs_43r3_model.exe' : sigcontextptr=0x7fff599dcca0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 19) with plain hex-dump
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [0]: [0x839273] : 0x839273
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [1]: [0x839879] : 0x839879
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [2]: [0x8c2957] : 0x8c2957
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [3]: [0x81d89e] : 0x81d89e
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [4]: [0x15f8aca] : 0x15f8aca
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [5]: [0x15d51c8] : 0x15d51c8
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [6]: [0x166b07f] : 0x166b07f
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [7]: [0x15d7ff0] : 0x15d7ff0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [8]: [0x8711e0] : 0x8711e0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [9]: [0x7e0165] : 0x7e0165
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [10]: [0x55e4ad] : 0x55e4ad
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [11]: [0x5471c9] : 0x5471c9
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [12]: [0x546412] : 0x546412
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [13]: [0x545e28] : 0x545e28
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [14]: [0x40708d] : 0x40708d
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [15]: [0x40220f] : 0x40220f
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [16]: [0x4021a2] : 0x4021a2
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [17]: [0x1dca390] : 0x1dca390
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:340] [18]: [0x40206e] : 0x40206e
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
SDL_TRACEBACK: Done INTEL_TRBK, THRD = 1
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220624:1674817584:219.783] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#6 (SIGABRT) :: 1721MB (heap), 3523MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220624:1674817584:219.783] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220624:1674817584:219.783] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220624:1674817584:219.786] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#6 was caused by unrecognized si_code [memaddr=0x6e], nsigs = 1
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220624:1674817584:219.790] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#6, nsigs = 1
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220625:1674817585:220.790] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#6, nsigs = 1
[EC_DRHOOK:Tower:1:1:110:110] [20230127:220625:1674817585:220.793] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#6, nsigs = 1
forrtl: error (76): Abort trap signal
Image PC Routine Line Source
oifs_43r3_model.e 0000000001CE916B Unknown Unknown Unknown
oifs_43r3_model.e 000000000081FFF1 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DC9090 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DC903B Unknown Unknown Unknown
oifs_43r3_model.e 00000000008C2880 sdl_mod_mp_sdl_sr 100 sdl_mod.F90
oifs_43r3_model.e 000000000081D8AF abor1_ 41 abor1.F90
oifs_43r3_model.e 00000000015F8ACA mpabort_ 50 mpabort.F
oifs_43r3_model.e 00000000015D51C8 abort1_ 44 abort1.F
oifs_43r3_model.e 000000000166B07F userin_ 553 userin.F
oifs_43r3_model.e 00000000015D7FF0 initmdl_ 452 initmdl.F
oifs_43r3_model.e 00000000008711E0 wavemdl_ 393 wavemdl.F
oifs_43r3_model.e 00000000007E0165 wvcouple_ 260 wvcouple.F90
oifs_43r3_model.e 000000000055E4AD cnt4_ 1283 cnt4.F90
oifs_43r3_model.e 00000000005471C9 cnt3_ 267 cnt3.F90
oifs_43r3_model.e 0000000000546412 cnt2_ 88 cnt2.F90
oifs_43r3_model.e 0000000000545E28 cnt1_ 92 cnt1.F90
oifs_43r3_model.e 000000000040708D cnt0_ 146 cnt0.F90
oifs_43r3_model.e 000000000040220F MAIN__ 96 master.F90
oifs_43r3_model.e 00000000004021A2 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DCA390 Unknown Unknown Unknown
oifs_43r3_model.e 000000000040206E Unknown Unknown Unknown
The child process terminated with status: 0
..Failed, model did not complete successfully
</stderr_txt>
]]>
