<core_client_version>7.16.16</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
ild process
06:04:09 STEP 901 H= 901:00 +CPU= 19.104
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:04:31 STEP 902 H= 902:00 +CPU= 19.662
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:05:03 STEP 903 H= 903:00 +CPU= 30.076
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:05:25 STEP 904 H= 904:00 +CPU= 19.462
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:05:48 STEP 905 H= 905:00 +CPU= 19.062
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:06:21 STEP 906 H= 906:00 +CPU= 30.713
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:06:42 STEP 907 H= 907:00 +CPU= 19.115
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:07:04 STEP 908 H= 908:00 +CPU= 19.672
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:07:38 STEP 909 H= 909:00 +CPU= 30.132
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:08:00 STEP 910 H= 910:00 +CPU= 19.678
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:08:21 STEP 911 H= 911:00 +CPU= 19.738
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:09:02 STEP 912 H= 912:00 +CPU= 35.147
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000912
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000912
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMGGhq0f+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMSHhq0f+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMUAhq0f+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMGGhq0f+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMSHhq0f+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMUAhq0f+000900
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0444_1988050100_123_957_12174088_0_r2043041161_37.zip
Uploading the intermediate file: upload_file_37.zip
06:09:23 STEP 913 H= 913:00 +CPU= 19.092
06:09:43 STEP 914 H= 914:00 +CPU= 19.748
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:10:17 STEP 915 H= 915:00 +CPU= 30.072
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:10:38 STEP 916 H= 916:00 +CPU= 19.611
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:11:00 STEP 917 H= 917:00 +CPU= 19.065
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:11:34 STEP 918 H= 918:00 +CPU= 30.670
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:11:55 STEP 919 H= 919:00 +CPU= 19.055
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:12:17 STEP 920 H= 920:00 +CPU= 19.601
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:12:51 STEP 921 H= 921:00 +CPU= 30.033
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:13:13 STEP 922 H= 922:00 +CPU= 19.591
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:13:34 STEP 923 H= 923:00 +CPU= 19.015
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:14:09 STEP 924 H= 924:00 +CPU= 33.249
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000924
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000924
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000924
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:14:31 STEP 925 H= 925:00 +CPU= 19.103
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:14:52 STEP 926 H= 926:00 +CPU= 19.592
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:15:24 STEP 927 H= 927:00 +CPU= 30.096
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:15:48 STEP 928 H= 928:00 +CPU= 19.671
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:16:09 STEP 929 H= 929:00 +CPU= 19.089
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:16:42 STEP 930 H= 930:00 +CPU= 30.641
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:17:03 STEP 931 H= 931:00 +CPU= 19.096
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:17:27 STEP 932 H= 932:00 +CPU= 19.682
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:17:59 STEP 933 H= 933:00 +CPU= 30.015
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:18:21 STEP 934 H= 934:00 +CPU= 19.615
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:18:42 STEP 935 H= 935:00 +CPU= 19.658
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:19:22 STEP 936 H= 936:00 +CPU= 35.114
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000936
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000936
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMGGhq0f+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMSHhq0f+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMUAhq0f+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMGGhq0f+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMSHhq0f+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMUAhq0f+000924
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0444_1988050100_123_957_12174088_0_r2043041161_38.zip
Uploading the intermediate file: upload_file_38.zip
06:19:44 STEP 937 H= 937:00 +CPU= 19.159
06:20:03 STEP 938 H= 938:00 +CPU= 19.620
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:20:38 STEP 939 H= 939:00 +CPU= 30.096
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:20:59 STEP 940 H= 940:00 +CPU= 19.626
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:21:20 STEP 941 H= 941:00 +CPU= 19.085
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:21:55 STEP 942 H= 942:00 +CPU= 30.609
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:22:16 STEP 943 H= 943:00 +CPU= 19.088
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:22:38 STEP 944 H= 944:00 +CPU= 19.608
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:23:12 STEP 945 H= 945:00 +CPU= 30.023
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:23:34 STEP 946 H= 946:00 +CPU= 19.687
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:23:55 STEP 947 H= 947:00 +CPU= 19.155
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:24:32 STEP 948 H= 948:00 +CPU= 33.139
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000948
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000948
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000948
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:24:54 STEP 949 H= 949:00 +CPU= 19.127
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:25:15 STEP 950 H= 950:00 +CPU= 19.670
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:25:49 STEP 951 H= 951:00 +CPU= 30.065
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:26:11 STEP 952 H= 952:00 +CPU= 19.669
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:26:32 STEP 953 H= 953:00 +CPU= 19.135
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:27:07 STEP 954 H= 954:00 +CPU= 30.646
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:27:28 STEP 955 H= 955:00 +CPU= 19.106
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:27:50 STEP 956 H= 956:00 +CPU= 19.678
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:28:22 STEP 957 H= 957:00 +CPU= 30.023
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:28:44 STEP 958 H= 958:00 +CPU= 19.666
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:29:09 STEP 959 H= 959:00 +CPU= 20.417
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:29:48 STEP 960 H= 960:00 +CPU= 35.027
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000960
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000960
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMGGhq0f+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMSHhq0f+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMUAhq0f+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMGGhq0f+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMSHhq0f+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMUAhq0f+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0444_1988050100_123_957_12174088_0_r2043041161_39.zip
Uploading the intermediate file: upload_file_39.zip
06:30:08 STEP 961 H= 961:00 +CPU= 19.129
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:30:29 STEP 962 H= 962:00 +CPU= 19.792
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:31:02 STEP 963 H= 963:00 +CPU= 30.180
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:31:23 STEP 964 H= 964:00 +CPU= 19.602
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:31:45 STEP 965 H= 965:00 +CPU= 19.098
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:32:19 STEP 966 H= 966:00 +CPU= 30.643
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:32:40 STEP 967 H= 967:00 +CPU= 19.091
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:33:02 STEP 968 H= 968:00 +CPU= 19.718
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:33:36 STEP 969 H= 969:00 +CPU= 30.059
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:33:58 STEP 970 H= 970:00 +CPU= 19.671
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:34:19 STEP 971 H= 971:00 +CPU= 19.177
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:34:57 STEP 972 H= 972:00 +CPU= 33.154
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000972
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000972
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000972
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:35:18 STEP 973 H= 973:00 +CPU= 19.109
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:35:40 STEP 974 H= 974:00 +CPU= 19.630
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:36:14 STEP 975 H= 975:00 +CPU= 30.012
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:36:35 STEP 976 H= 976:00 +CPU= 19.621
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:36:57 STEP 977 H= 977:00 +CPU= 19.121
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:37:31 STEP 978 H= 978:00 +CPU= 30.610
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:37:52 STEP 979 H= 979:00 +CPU= 19.088
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:38:14 STEP 980 H= 980:00 +CPU= 19.664
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:38:48 STEP 981 H= 981:00 +CPU= 30.062
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:39:10 STEP 982 H= 982:00 +CPU= 19.605
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:39:32 STEP 983 H= 983:00 +CPU= 19.765
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:40:12 STEP 984 H= 984:00 +CPU= 35.082
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000984
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000984
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMGGhq0f+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMSHhq0f+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMUAhq0f+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMGGhq0f+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMSHhq0f+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMUAhq0f+000972
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0444_1988050100_123_957_12174088_0_r2043041161_40.zip
Uploading the intermediate file: upload_file_40.zip
06:40:31 STEP 985 H= 985:00 +CPU= 19.078
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:40:53 STEP 986 H= 986:00 +CPU= 19.809
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:41:27 STEP 987 H= 987:00 +CPU= 30.179
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:41:49 STEP 988 H= 988:00 +CPU= 19.604
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:42:10 STEP 989 H= 989:00 +CPU= 19.128
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:42:43 STEP 990 H= 990:00 +CPU= 30.717
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:43:04 STEP 991 H= 991:00 +CPU= 19.111
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:43:28 STEP 992 H= 992:00 +CPU= 19.698
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:44:00 STEP 993 H= 993:00 +CPU= 30.105
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:44:22 STEP 994 H= 994:00 +CPU= 19.669
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:44:43 STEP 995 H= 995:00 +CPU= 19.180
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:45:20 STEP 996 H= 996:00 +CPU= 33.216
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+000996
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+000996
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+000996
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:45:42 STEP 997 H= 997:00 +CPU= 19.135
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:46:03 STEP 998 H= 998:00 +CPU= 19.706
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:46:38 STEP 999 H= 999:00 +CPU= 30.132
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:46:59 STEP 1000 H=1000:00 +CPU= 19.652
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:47:21 STEP 1001 H=1001:00 +CPU= 19.117
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:47:55 STEP 1002 H=1002:00 +CPU= 30.714
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:48:17 STEP 1003 H=1003:00 +CPU= 19.090
06:48:36 STEP 1004 H=1004:00 +CPU= 19.648
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:49:10 STEP 1005 H=1005:00 +CPU= 30.092
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:49:32 STEP 1006 H=1006:00 +CPU= 19.658
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:49:54 STEP 1007 H=1007:00 +CPU= 19.717
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:50:34 STEP 1008 H=1008:00 +CPU= 35.109
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001008
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001008
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMGGhq0f+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMSHhq0f+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMUAhq0f+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMGGhq0f+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMSHhq0f+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMUAhq0f+000996
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0444_1988050100_123_957_12174088_0_r2043041161_41.zip
Uploading the intermediate file: upload_file_41.zip
06:50:53 STEP 1009 H=1009:00 +CPU= 19.115
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:51:15 STEP 1010 H=1010:00 +CPU= 19.643
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:51:49 STEP 1011 H=1011:00 +CPU= 30.120
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:52:11 STEP 1012 H=1012:00 +CPU= 19.669
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:52:32 STEP 1013 H=1013:00 +CPU= 19.105
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:53:07 STEP 1014 H=1014:00 +CPU= 30.813
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:53:28 STEP 1015 H=1015:00 +CPU= 19.149
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:53:50 STEP 1016 H=1016:00 +CPU= 19.655
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:54:22 STEP 1017 H=1017:00 +CPU= 30.193
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:54:44 STEP 1018 H=1018:00 +CPU= 19.735
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:55:07 STEP 1019 H=1019:00 +CPU= 19.159
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:55:42 STEP 1020 H=1020:00 +CPU= 33.264
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001020
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001020
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001020
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:56:04 STEP 1021 H=1021:00 +CPU= 19.194
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:56:27 STEP 1022 H=1022:00 +CPU= 19.702
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:57:00 STEP 1023 H=1023:00 +CPU= 30.166
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:57:21 STEP 1024 H=1024:00 +CPU= 19.712
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:57:43 STEP 1025 H=1025:00 +CPU= 19.119
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:58:17 STEP 1026 H=1026:00 +CPU= 30.729
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:58:39 STEP 1027 H=1027:00 +CPU= 19.156
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:59:00 STEP 1028 H=1028:00 +CPU= 19.653
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:59:35 STEP 1029 H=1029:00 +CPU= 30.092
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:59:56 STEP 1030 H=1030:00 +CPU= 19.679
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:00:18 STEP 1031 H=1031:00 +CPU= 19.713
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:00:56 STEP 1032 H=1032:00 +CPU= 35.116
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001032
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001032
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMGGhq0f+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMSHhq0f+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMUAhq0f+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMGGhq0f+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMSHhq0f+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMUAhq0f+001020
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0444_1988050100_123_957_12174088_0_r2043041161_42.zip
Uploading the intermediate file: upload_file_42.zip
07:01:15 STEP 1033 H=1033:00 +CPU= 19.119
07:01:35 STEP 1034 H=1034:00 +CPU= 19.773
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:02:09 STEP 1035 H=1035:00 +CPU= 30.122
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:02:31 STEP 1036 H=1036:00 +CPU= 19.633
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:02:52 STEP 1037 H=1037:00 +CPU= 19.147
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:03:25 STEP 1038 H=1038:00 +CPU= 30.705
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:03:48 STEP 1039 H=1039:00 +CPU= 19.127
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:04:10 STEP 1040 H=1040:00 +CPU= 19.716
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:04:42 STEP 1041 H=1041:00 +CPU= 30.041
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:05:04 STEP 1042 H=1042:00 +CPU= 19.665
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:05:25 STEP 1043 H=1043:00 +CPU= 19.184
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:06:02 STEP 1044 H=1044:00 +CPU= 33.102
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001044
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001044
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001044
07:06:23 STEP 1045 H=1045:00 +CPU= 19.096
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:06:47 STEP 1046 H=1046:00 +CPU= 19.696
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:07:19 STEP 1047 H=1047:00 +CPU= 30.042
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:07:41 STEP 1048 H=1048:00 +CPU= 19.671
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:08:02 STEP 1049 H=1049:00 +CPU= 19.140
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:08:37 STEP 1050 H=1050:00 +CPU= 30.662
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:08:58 STEP 1051 H=1051:00 +CPU= 19.073
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:09:20 STEP 1052 H=1052:00 +CPU= 19.640
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:09:54 STEP 1053 H=1053:00 +CPU= 30.034
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:10:16 STEP 1054 H=1054:00 +CPU= 19.610
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:10:37 STEP 1055 H=1055:00 +CPU= 19.647
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:11:18 STEP 1056 H=1056:00 +CPU= 35.042
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001056
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001056
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMGGhq0f+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMSHhq0f+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMUAhq0f+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMGGhq0f+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMSHhq0f+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMUAhq0f+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0444_1988050100_123_957_12174088_0_r2043041161_43.zip
Uploading the intermediate file: upload_file_43.zip
07:11:37 STEP 1057 H=1057:00 +CPU= 19.109
Uploading trickle at timestep: 3801600
07:11:57 STEP 1058 H=1058:00 +CPU= 19.540
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:12:31 STEP 1059 H=1059:00 +CPU= 30.204
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:12:53 STEP 1060 H=1060:00 +CPU= 19.604
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:13:14 STEP 1061 H=1061:00 +CPU= 19.092
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:13:48 STEP 1062 H=1062:00 +CPU= 30.619
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:14:10 STEP 1063 H=1063:00 +CPU= 19.111
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:14:31 STEP 1064 H=1064:00 +CPU= 19.662
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:15:04 STEP 1065 H=1065:00 +CPU= 30.055
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:15:27 STEP 1066 H=1066:00 +CPU= 19.656
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:15:48 STEP 1067 H=1067:00 +CPU= 19.105
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:16:24 STEP 1068 H=1068:00 +CPU= 33.205
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001068
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001068
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001068
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:16:47 STEP 1069 H=1069:00 +CPU= 19.093
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:17:09 STEP 1070 H=1070:00 +CPU= 19.671
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:17:41 STEP 1071 H=1071:00 +CPU= 29.891
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:18:02 STEP 1072 H=1072:00 +CPU= 19.627
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:18:24 STEP 1073 H=1073:00 +CPU= 19.066
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:18:58 STEP 1074 H=1074:00 +CPU= 30.627
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:19:19 STEP 1075 H=1075:00 +CPU= 19.043
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:19:41 STEP 1076 H=1076:00 +CPU= 19.591
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:20:15 STEP 1077 H=1077:00 +CPU= 29.990
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:20:37 STEP 1078 H=1078:00 +CPU= 19.547
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:20:58 STEP 1079 H=1079:00 +CPU= 19.599
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:21:38 STEP 1080 H=1080:00 +CPU= 35.205
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001080
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001080
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMGGhq0f+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMSHhq0f+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMUAhq0f+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMGGhq0f+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMSHhq0f+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088/ICMUAhq0f+001068
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0444_1988050100_123_957_12174088_0_r2043041161_44.zip
Uploading the intermediate file: upload_file_44.zip
07:21:57 STEP 1081 H=1081:00 +CPU= 19.062
07:22:17 STEP 1082 H=1082:00 +CPU= 19.497
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:22:51 STEP 1083 H=1083:00 +CPU= 30.270
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:23:13 STEP 1084 H=1084:00 +CPU= 19.686
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:23:34 STEP 1085 H=1085:00 +CPU= 19.147
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:24:09 STEP 1086 H=1086:00 +CPU= 30.770
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:24:30 STEP 1087 H=1087:00 +CPU= 19.164
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:24:52 STEP 1088 H=1088:00 +CPU= 19.731
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:25:24 STEP 1089 H=1089:00 +CPU= 30.176
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:25:48 STEP 1090 H=1090:00 +CPU= 19.740
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:26:09 STEP 1091 H=1091:00 +CPU= 19.198
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:26:47 STEP 1092 H=1092:00 +CPU= 33.360
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001092
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001092
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001092
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:27:08 STEP 1093 H=1093:00 +CPU= 19.224
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:27:30 STEP 1094 H=1094:00 +CPU= 19.740
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:28:02 STEP 1095 H=1095:00 +CPU= 30.202
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:28:24 STEP 1096 H=1096:00 +CPU= 19.738
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:28:47 STEP 1097 H=1097:00 +CPU= 19.187
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:29:20 STEP 1098 H=1098:00 +CPU= 30.792
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:29:42 STEP 1099 H=1099:00 +CPU= 19.165
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:30:03 STEP 1100 H=1100:00 +CPU= 19.694
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:30:38 STEP 1101 H=1101:00 +CPU= 30.234
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:30:59 STEP 1102 H=1102:00 +CPU= 19.730
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1988050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0444
(argv4) batchid: 957
(argv5) wuid: 12174088
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/2
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12174088
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_e7550df9e8427002a1bbe564f68a68dc to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0444_1988050100_123_957_12174088.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0444_1988050100_123_957_12174088.zip
ic_ancil_file: ic_ancil_12174088
ifsdata_file: ifsdata_12174088
climate_data_file: clim_data_12174088
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_688eda0d1ab188cda6720cb279175771 to: /var/lib/boinc-client/slots/2/ic_ancil_12174088.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12174088.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_704081ea22ddc0f872a4fcbc6a83716a to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12174088.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12174088.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12174088.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12174088.zip
Checking for progress XML file: /var/lib/boinc-client/slots/2/progress_file_12174088.xml
Opened progress file ok : /var/lib/boinc-client/slots/2/progress_file_12174088.xml
-- Model is restarting --
Adjusting last_iter, 1103, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/2/progress_file_12174088.xml
last_cpu_time: 25908
upload_file_number: 45
last_iter: 1079
last_upload: 3888000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0444_1988050100_123_957_12174088_0_r2043041161
The child process has been launched with process id: 752785
Executing the command: /var/lib/boinc-client/slots/2/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042236:1674267756:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
ABORT! 1 !! *** WAVE MODEL HAS ABORTED
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042320:1674267800:44.031] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 1721 MB (maxheap), 3520 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042320:1674267800:44.031] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : MASTER
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042320:1674267800:44.031] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT0
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042320:1674267800:44.031] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT1
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042320:1674267800:44.031] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT2
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042320:1674267800:44.031] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT3
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042320:1674267800:44.031] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT4
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042320:1674267800:44.032] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : WVCOUPLE
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042320:1674267800:44.032] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : WAVEMDL
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042320:1674267800:44.032] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : INITMDL
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042320:1674267800:44.032] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : GETSTRESS
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042320:1674267800:44.032] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : READSTRESS
SDL_TRACEBACK: Calling INTEL_TRBK, THRD = 1
Process 1 thread 1 calling linux_trbk from intel_trbk()
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/2/oifs_43r3_model.exe' : sigcontextptr=0x7ffea98a13a0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 20) with addr2line-cmd
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/2/oifs_43r3_model.exe' 0x839273 0x839879 0x8c2957 0x81d89e 0x15f8aca 0x15d51c8 0x19c17dd 0x16a35d1 0x15db8cd 0x8711e0 0x7e0165 0x55e4ad 0x5471c9 0x546412 0x545e28 0x40708d 0x40220f 0x4021a2 0x1dca390 0x40206e
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x839273] : ??() at ??:0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x839879] : ??() at ??:0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x8c2957] : ??() at ??:0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x81d89e] : ??() at ??:0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x15f8aca] : ??() at ??:0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x15d51c8] : ??() at ??:0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x19c17dd] : ??() at ??:0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x16a35d1] : ??() at ??:0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0x15db8cd] : ??() at ??:0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0x8711e0] : ??() at ??:0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0x7e0165] : ??() at ??:0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x55e4ad] : ??() at ??:0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x5471c9] : ??() at ??:0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x546412] : ??() at ??:0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x545e28] : ??() at ??:0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x40708d] : ??() at ??:0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x40220f] : ??() at ??:0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x4021a2] : ??() at ??:0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x1dca390] : ??() at ??:0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x40206e] : ??() at ??:0
[LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
SDL_TRACEBACK: Done INTEL_TRBK, THRD = 1
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042320:1674267800:44.223] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#6 (SIGABRT) :: 1721MB (heap), 3520MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042320:1674267800:44.223] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042320:1674267800:44.223] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042320:1674267800:44.223] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#6 was caused by unrecognized si_code [memaddr=0x76000b7c91], nsigs = 1
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042320:1674267800:44.223] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#6, nsigs = 1
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042321:1674267801:45.227] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#6, nsigs = 1
[EC_DRHOOK:charm:1:1:752785:752785] [20230121:042321:1674267801:45.227] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#6, nsigs = 1
forrtl: error (76): Abort trap signal
Image PC Routine Line Source
oifs_43r3_model.e 0000000001CE916B Unknown Unknown Unknown
oifs_43r3_model.e 000000000081FFF1 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DC9090 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DC903B Unknown Unknown Unknown
oifs_43r3_model.e 00000000008C2880 sdl_mod_mp_sdl_sr 100 sdl_mod.F90
oifs_43r3_model.e 000000000081D8AF abor1_ 41 abor1.F90
oifs_43r3_model.e 00000000015F8ACA mpabort_ 50 mpabort.F
oifs_43r3_model.e 00000000015D51C8 abort1_ 44 abort1.F
oifs_43r3_model.e 00000000019C17DD readstress_ 89 readstress.F
oifs_43r3_model.e 00000000016A35D1 getstress_ 149 getstress.F
oifs_43r3_model.e 00000000015DB8CD initmdl_ 815 initmdl.F
oifs_43r3_model.e 00000000008711E0 wavemdl_ 393 wavemdl.F
oifs_43r3_model.e 00000000007E0165 wvcouple_ 260 wvcouple.F90
oifs_43r3_model.e 000000000055E4AD cnt4_ 1283 cnt4.F90
oifs_43r3_model.e 00000000005471C9 cnt3_ 267 cnt3.F90
oifs_43r3_model.e 0000000000546412 cnt2_ 88 cnt2.F90
oifs_43r3_model.e 0000000000545E28 cnt1_ 92 cnt1.F90
oifs_43r3_model.e 000000000040708D cnt0_ 146 cnt0.F90
oifs_43r3_model.e 000000000040220F MAIN__ 96 master.F90
oifs_43r3_model.e 00000000004021A2 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DCA390 Unknown Unknown Unknown
oifs_43r3_model.e 000000000040206E Unknown Unknown Unknown
The child process terminated with status: 0
..Failed, model did not complete successfully
</stderr_txt>
]]>
