climateprediction.net home page
Task 22308995

Task 22308995

Name oifs_43r3_bl_a1kd_2016092300_15_991_12208816_0
Workunit 12208816
Created 13 Feb 2023, 15:44:51 UTC
Sent 14 Feb 2023, 1:30:40 UTC
Report deadline 15 Apr 2023, 1:30:40 UTC
Received 14 Feb 2023, 20:08:38 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1514520
Run time 17 hours 17 min 49 sec
CPU time 17 hours 17 min 49 sec
Validate state Valid
Credit 1,813.14
Device peak FLOPS 4.19 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,064.82 MB
Peak swap size 5,930.78 MB
Peak disk usage 1,385.24 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
3:30 +CPU= 36.067
  08:49:54 STEP 1015 H= 253:45 +CPU= 37.399
  08:50:31 STEP 1016 H= 254:00 +CPU= 36.706
  08:51:09 STEP 1017 H= 254:15 +CPU= 37.931
  08:51:46 STEP 1018 H= 254:30 +CPU= 36.491
  08:52:23 STEP 1019 H= 254:45 +CPU= 37.274
  08:53:09 STEP 1020 H= 255:00 +CPU= 45.439
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001020
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001020
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001020
  08:53:45 STEP 1021 H= 255:15 +CPU= 36.682
  08:54:21 STEP 1022 H= 255:30 +CPU= 35.957
  08:54:57 STEP 1023 H= 255:45 +CPU= 35.873
  08:55:34 STEP 1024 H= 256:00 +CPU= 36.838
  08:56:11 STEP 1025 H= 256:15 +CPU= 35.983
  08:56:47 STEP 1026 H= 256:30 +CPU= 36.653
  08:57:24 STEP 1027 H= 256:45 +CPU= 36.639
  08:58:00 STEP 1028 H= 257:00 +CPU= 36.263
  08:58:36 STEP 1029 H= 257:15 +CPU= 35.551
  08:59:14 STEP 1030 H= 257:30 +CPU= 37.377
  08:59:51 STEP 1031 H= 257:45 +CPU= 37.348
  09:00:35 STEP 1032 H= 258:00 +CPU= 43.938
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001032
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001032
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001032
  09:01:12 STEP 1033 H= 258:15 +CPU= 36.715
  09:01:49 STEP 1034 H= 258:30 +CPU= 37.015
  09:02:32 STEP 1035 H= 258:45 +CPU= 42.552
  09:03:10 STEP 1036 H= 259:00 +CPU= 37.848
  09:03:44 STEP 1037 H= 259:15 +CPU= 34.448
  09:04:20 STEP 1038 H= 259:30 +CPU= 35.873
  09:04:56 STEP 1039 H= 259:45 +CPU= 34.947
  09:05:32 STEP 1040 H= 260:00 +CPU= 36.860
  09:06:08 STEP 1041 H= 260:15 +CPU= 35.376
  09:06:43 STEP 1042 H= 260:30 +CPU= 34.375
  09:07:19 STEP 1043 H= 260:45 +CPU= 36.387
  09:08:04 STEP 1044 H= 261:00 +CPU= 44.719
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001044
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001044
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001044
  09:08:41 STEP 1045 H= 261:15 +CPU= 36.844
  09:09:17 STEP 1046 H= 261:30 +CPU= 36.222
  09:09:53 STEP 1047 H= 261:45 +CPU= 35.354
  09:10:30 STEP 1048 H= 262:00 +CPU= 37.401
  09:11:05 STEP 1049 H= 262:15 +CPU= 34.694
  09:11:41 STEP 1050 H= 262:30 +CPU= 35.594
  09:12:17 STEP 1051 H= 262:45 +CPU= 36.131
  09:12:53 STEP 1052 H= 263:00 +CPU= 35.810
  09:13:28 STEP 1053 H= 263:15 +CPU= 34.679
  09:14:03 STEP 1054 H= 263:30 +CPU= 35.234
  09:14:38 STEP 1055 H= 263:45 +CPU= 34.782
  09:15:26 STEP 1056 H= 264:00 +CPU= 47.845
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001056
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001056
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001056
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+000960
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+000960
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+000960
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+000972
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+000972
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+000972
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+000984
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+000984
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+000984
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+000996
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+000996
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+000996
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001008
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001008
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001008
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001020
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001020
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001020
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001032
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001032
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001032
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001044
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001044
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001044
Zipping up the intermediate file: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_a1kd_2016092300_15_991_12208816_0_r92650562_10.zip
Uploading the intermediate file: upload_file_10.zip
  09:16:02 STEP 1057 H= 264:15 +CPU= 35.967
  09:16:38 STEP 1058 H= 264:30 +CPU= 35.150
  09:17:13 STEP 1059 H= 264:45 +CPU= 35.396
  09:17:50 STEP 1060 H= 265:00 +CPU= 36.335
  09:18:26 STEP 1061 H= 265:15 +CPU= 36.173
  09:19:02 STEP 1062 H= 265:30 +CPU= 36.312
  09:19:39 STEP 1063 H= 265:45 +CPU= 36.073
  09:20:15 STEP 1064 H= 266:00 +CPU= 36.469
  09:20:52 STEP 1065 H= 266:15 +CPU= 36.479
  09:21:29 STEP 1066 H= 266:30 +CPU= 36.745
  09:22:05 STEP 1067 H= 266:45 +CPU= 36.676
  09:22:51 STEP 1068 H= 267:00 +CPU= 45.486
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001068
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001068
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001068
  09:23:29 STEP 1069 H= 267:15 +CPU= 37.322
  09:24:06 STEP 1070 H= 267:30 +CPU= 37.314
  09:24:44 STEP 1071 H= 267:45 +CPU= 37.843
  09:25:22 STEP 1072 H= 268:00 +CPU= 37.366
  09:25:58 STEP 1073 H= 268:15 +CPU= 36.499
  09:26:35 STEP 1074 H= 268:30 +CPU= 36.852
  09:27:13 STEP 1075 H= 268:45 +CPU= 37.489
  09:27:51 STEP 1076 H= 269:00 +CPU= 38.195
  09:28:27 STEP 1077 H= 269:15 +CPU= 35.800
  09:29:04 STEP 1078 H= 269:30 +CPU= 36.644
  09:29:42 STEP 1079 H= 269:45 +CPU= 37.329
  09:30:29 STEP 1080 H= 270:00 +CPU= 46.930
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001080
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001080
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001080
  09:31:06 STEP 1081 H= 270:15 +CPU= 37.452
  09:31:42 STEP 1082 H= 270:30 +CPU= 35.925
  09:32:20 STEP 1083 H= 270:45 +CPU= 37.266
  09:32:58 STEP 1084 H= 271:00 +CPU= 38.224
  09:33:36 STEP 1085 H= 271:15 +CPU= 37.343
  09:34:12 STEP 1086 H= 271:30 +CPU= 36.609
  09:34:51 STEP 1087 H= 271:45 +CPU= 38.135
  09:35:29 STEP 1088 H= 272:00 +CPU= 37.872
  09:36:05 STEP 1089 H= 272:15 +CPU= 36.658
  09:36:43 STEP 1090 H= 272:30 +CPU= 37.438
  09:37:21 STEP 1091 H= 272:45 +CPU= 37.567
  09:38:08 STEP 1092 H= 273:00 +CPU= 46.950
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001092
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001092
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001092
  09:38:46 STEP 1093 H= 273:15 +CPU= 38.076
  09:39:24 STEP 1094 H= 273:30 +CPU= 37.665
  09:40:03 STEP 1095 H= 273:45 +CPU= 38.712
  09:40:43 STEP 1096 H= 274:00 +CPU= 39.874
  09:41:21 STEP 1097 H= 274:15 +CPU= 38.505
  09:41:59 STEP 1098 H= 274:30 +CPU= 37.952
  09:42:37 STEP 1099 H= 274:45 +CPU= 37.828
  09:43:15 STEP 1100 H= 275:00 +CPU= 38.040
  09:43:53 STEP 1101 H= 275:15 +CPU= 37.565
  09:44:30 STEP 1102 H= 275:30 +CPU= 37.391
  09:45:08 STEP 1103 H= 275:45 +CPU= 37.635
  09:45:59 STEP 1104 H= 276:00 +CPU= 50.266
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001104
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001104
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001104
  09:46:37 STEP 1105 H= 276:15 +CPU= 37.874
  09:47:14 STEP 1106 H= 276:30 +CPU= 37.279
  09:47:53 STEP 1107 H= 276:45 +CPU= 38.408
  09:48:31 STEP 1108 H= 277:00 +CPU= 38.618
  09:49:09 STEP 1109 H= 277:15 +CPU= 37.962
  09:49:48 STEP 1110 H= 277:30 +CPU= 38.294
  09:50:25 STEP 1111 H= 277:45 +CPU= 36.992
  09:51:04 STEP 1112 H= 278:00 +CPU= 39.213
  09:51:43 STEP 1113 H= 278:15 +CPU= 38.421
  09:52:22 STEP 1114 H= 278:30 +CPU= 39.030
  09:53:00 STEP 1115 H= 278:45 +CPU= 38.052
  09:53:47 STEP 1116 H= 279:00 +CPU= 46.289
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001116
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001116
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001116
  09:54:25 STEP 1117 H= 279:15 +CPU= 38.117
  09:55:03 STEP 1118 H= 279:30 +CPU= 37.747
  09:55:40 STEP 1119 H= 279:45 +CPU= 37.487
  09:56:20 STEP 1120 H= 280:00 +CPU= 38.878
  09:56:58 STEP 1121 H= 280:15 +CPU= 37.830
  09:57:36 STEP 1122 H= 280:30 +CPU= 38.727
  09:58:14 STEP 1123 H= 280:45 +CPU= 37.957
  09:58:53 STEP 1124 H= 281:00 +CPU= 38.056
  09:59:31 STEP 1125 H= 281:15 +CPU= 37.728
  10:00:09 STEP 1126 H= 281:30 +CPU= 38.113
  10:00:48 STEP 1127 H= 281:45 +CPU= 39.570
  10:01:36 STEP 1128 H= 282:00 +CPU= 47.133
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001128
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001128
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001128
  10:02:15 STEP 1129 H= 282:15 +CPU= 38.918
  10:02:54 STEP 1130 H= 282:30 +CPU= 38.815
  10:03:32 STEP 1131 H= 282:45 +CPU= 38.733
  10:04:10 STEP 1132 H= 283:00 +CPU= 37.847
  10:04:49 STEP 1133 H= 283:15 +CPU= 38.419
  10:05:29 STEP 1134 H= 283:30 +CPU= 39.692
  10:06:07 STEP 1135 H= 283:45 +CPU= 38.310
  10:06:48 STEP 1136 H= 284:00 +CPU= 41.187
  10:07:28 STEP 1137 H= 284:15 +CPU= 39.225
  10:08:07 STEP 1138 H= 284:30 +CPU= 39.261
  10:08:48 STEP 1139 H= 284:45 +CPU= 40.286
  10:09:36 STEP 1140 H= 285:00 +CPU= 48.031
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001140
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001140
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001140
  10:10:15 STEP 1141 H= 285:15 +CPU= 38.988
  10:10:53 STEP 1142 H= 285:30 +CPU= 38.378
  10:11:32 STEP 1143 H= 285:45 +CPU= 38.498
  10:12:11 STEP 1144 H= 286:00 +CPU= 38.864
  10:12:51 STEP 1145 H= 286:15 +CPU= 39.506
  10:13:30 STEP 1146 H= 286:30 +CPU= 39.121
  10:14:10 STEP 1147 H= 286:45 +CPU= 39.271
  10:14:50 STEP 1148 H= 287:00 +CPU= 40.089
  10:15:29 STEP 1149 H= 287:15 +CPU= 38.603
  10:16:08 STEP 1150 H= 287:30 +CPU= 38.698
  10:16:47 STEP 1151 H= 287:45 +CPU= 39.336
  10:17:40 STEP 1152 H= 288:00 +CPU= 52.855
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001152
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001152
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001152
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001056
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001056
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001056
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001068
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001068
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001068
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001080
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001080
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001080
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001092
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001092
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001092
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001104
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001104
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001104
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001116
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001116
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001116
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001128
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001128
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001128
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001140
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001140
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001140
Zipping up the intermediate file: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_a1kd_2016092300_15_991_12208816_0_r92650562_11.zip
Uploading the intermediate file: upload_file_11.zip
  10:18:21 STEP 1153 H= 288:15 +CPU= 40.244
  10:19:00 STEP 1154 H= 288:30 +CPU= 39.096
  10:19:39 STEP 1155 H= 288:45 +CPU= 39.291
  10:20:19 STEP 1156 H= 289:00 +CPU= 39.736
  10:20:59 STEP 1157 H= 289:15 +CPU= 39.271
  10:21:37 STEP 1158 H= 289:30 +CPU= 38.430
  10:22:17 STEP 1159 H= 289:45 +CPU= 39.603
  10:22:57 STEP 1160 H= 290:00 +CPU= 39.724
  10:23:36 STEP 1161 H= 290:15 +CPU= 38.628
  10:24:14 STEP 1162 H= 290:30 +CPU= 37.839
  10:24:51 STEP 1163 H= 290:45 +CPU= 37.373
  10:25:39 STEP 1164 H= 291:00 +CPU= 47.555
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001164
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001164
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001164
  10:26:17 STEP 1165 H= 291:15 +CPU= 37.987
  10:26:56 STEP 1166 H= 291:30 +CPU= 38.686
  10:27:34 STEP 1167 H= 291:45 +CPU= 37.851
  10:28:13 STEP 1168 H= 292:00 +CPU= 39.375
  10:28:52 STEP 1169 H= 292:15 +CPU= 38.694
  10:29:31 STEP 1170 H= 292:30 +CPU= 38.620
  10:30:10 STEP 1171 H= 292:45 +CPU= 38.779
  10:30:49 STEP 1172 H= 293:00 +CPU= 38.681
  10:31:28 STEP 1173 H= 293:15 +CPU= 38.604
  10:32:06 STEP 1174 H= 293:30 +CPU= 38.261
  10:32:46 STEP 1175 H= 293:45 +CPU= 39.441
  10:33:36 STEP 1176 H= 294:00 +CPU= 50.084
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001176
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001176
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001176
  10:34:15 STEP 1177 H= 294:15 +CPU= 38.593
  10:34:55 STEP 1178 H= 294:30 +CPU= 39.872
  10:35:33 STEP 1179 H= 294:45 +CPU= 38.116
  10:36:13 STEP 1180 H= 295:00 +CPU= 40.229
  10:36:53 STEP 1181 H= 295:15 +CPU= 39.334
  10:37:33 STEP 1182 H= 295:30 +CPU= 39.948
  10:38:12 STEP 1183 H= 295:45 +CPU= 39.117
  10:38:51 STEP 1184 H= 296:00 +CPU= 38.853
  10:39:31 STEP 1185 H= 296:15 +CPU= 39.903
  10:40:09 STEP 1186 H= 296:30 +CPU= 37.967
  10:40:49 STEP 1187 H= 296:45 +CPU= 39.389
  10:41:38 STEP 1188 H= 297:00 +CPU= 49.001
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001188
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001188
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001188
  10:42:17 STEP 1189 H= 297:15 +CPU= 38.759
  10:42:56 STEP 1190 H= 297:30 +CPU= 38.858
  10:43:36 STEP 1191 H= 297:45 +CPU= 39.467
  10:44:15 STEP 1192 H= 298:00 +CPU= 39.633
  10:44:55 STEP 1193 H= 298:15 +CPU= 39.914
  10:45:34 STEP 1194 H= 298:30 +CPU= 38.751
  10:46:14 STEP 1195 H= 298:45 +CPU= 39.405
  10:46:55 STEP 1196 H= 299:00 +CPU= 40.616
  10:47:34 STEP 1197 H= 299:15 +CPU= 39.706
  10:48:14 STEP 1198 H= 299:30 +CPU= 39.216
  10:48:54 STEP 1199 H= 299:45 +CPU= 39.747
  10:49:47 STEP 1200 H= 300:00 +CPU= 53.230
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001200
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001200
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001200
  10:50:27 STEP 1201 H= 300:15 +CPU= 39.579
  10:51:08 STEP 1202 H= 300:30 +CPU= 40.547
  10:51:47 STEP 1203 H= 300:45 +CPU= 39.500
  10:52:27 STEP 1204 H= 301:00 +CPU= 39.907
  10:53:07 STEP 1205 H= 301:15 +CPU= 39.751
  10:53:46 STEP 1206 H= 301:30 +CPU= 38.284
  10:54:24 STEP 1207 H= 301:45 +CPU= 38.710
  10:55:04 STEP 1208 H= 302:00 +CPU= 39.840
  10:55:44 STEP 1209 H= 302:15 +CPU= 39.682
  10:56:23 STEP 1210 H= 302:30 +CPU= 38.398
  10:57:03 STEP 1211 H= 302:45 +CPU= 39.445
  10:57:50 STEP 1212 H= 303:00 +CPU= 47.533
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001212
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001212
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001212
  10:58:30 STEP 1213 H= 303:15 +CPU= 39.148
  10:59:09 STEP 1214 H= 303:30 +CPU= 38.857
  10:59:48 STEP 1215 H= 303:45 +CPU= 39.382
  11:00:29 STEP 1216 H= 304:00 +CPU= 40.218
  11:01:08 STEP 1217 H= 304:15 +CPU= 39.111
  11:01:47 STEP 1218 H= 304:30 +CPU= 38.929
  11:02:26 STEP 1219 H= 304:45 +CPU= 38.474
  11:03:06 STEP 1220 H= 305:00 +CPU= 40.416
  11:03:45 STEP 1221 H= 305:15 +CPU= 38.842
  11:04:24 STEP 1222 H= 305:30 +CPU= 38.959
  11:05:03 STEP 1223 H= 305:45 +CPU= 38.446
  11:05:52 STEP 1224 H= 306:00 +CPU= 48.888
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001224
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001224
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001224
  11:06:30 STEP 1225 H= 306:15 +CPU= 38.299
  11:07:10 STEP 1226 H= 306:30 +CPU= 39.194
  11:07:51 STEP 1227 H= 306:45 +CPU= 41.038
  11:08:32 STEP 1228 H= 307:00 +CPU= 40.470
  11:09:12 STEP 1229 H= 307:15 +CPU= 40.538
  11:09:53 STEP 1230 H= 307:30 +CPU= 40.750
  11:10:34 STEP 1231 H= 307:45 +CPU= 40.274
  11:11:16 STEP 1232 H= 308:00 +CPU= 42.356
Quit request received from BOINC client, ending the child process
>>> Printing last 70 lines from file: NODE.001_01

         AVE   0.239541849410444E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM RFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.843050974974544E-06 0.000000000000000E+00 0.540696594334384E-03
 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.336133584988496E-06 0.000000000000000E+00 0.280306284851333E-03
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.294310007502075E-05 0.000000000000000E+00 0.216471962927545E-02
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.127231724393864E-05 0.000000000000000E+00 0.344316095335978E-02
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.102636108352278E+00 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =  1224 STEPO   A00000000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1224 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001224 MODE=w
 IO-STREAM CLOSED - ICMGGh7zg+001224
 MPI-TASK:   1 -    321754666 BYTES IN      6 RECORDS TRANSFERRED IN    0.0006 SECONDS536257.8 Mbytes/s, TOTAL TIME=    0.0141( 4.3%)
 NSTEP =  1224 STEPO   0AA000000
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMSHh7zg+001224 MODE=a
 IO-STREAM CLOSED - ./ICMSHh7zg+001224
 MPI-TASK:   1 -    707765250 BYTES IN    202 RECORDS TRANSFERRED IN    0.0130 SECONDS 54443.5 Mbytes/s, TOTAL TIME=    0.3787( 3.4%)
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+001224 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+001224
 MPI-TASK:   1 -   5148074647 BYTES IN    125 RECORDS TRANSFERRED IN    0.0085 SECONDS605655.8 Mbytes/s, TOTAL TIME=    0.3103( 2.7%)
 STEPO_FPOS WAS : B00000F00E
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+001224 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+001224
 MPI-TASK:   1 -    313181033 BYTES IN      2 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0055( 3.6%)
 STEPO_FPOS WAS : V00000000Y
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+001224 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+001224
 MPI-TASK:   1 -    321754666 BYTES IN      4 RECORDS TRANSFERRED IN    0.0004 SECONDS804386.7 Mbytes/s, TOTAL TIME=    0.0096( 4.2%)
 STEPO_FPOS WAS : T00000000M
 NSTEP =  1224 STEPO   0AAA00AAA
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1224 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001224 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001224
 MPI-TASK:   1 -    321754657 BYTES IN      7 RECORDS TRANSFERRED IN    0.0006 SECONDS536257.8 Mbytes/s, TOTAL TIME=    0.0163( 3.7%)
 11:05:52 STEP 1224 H= 306:00 +CPU= 48.888
ISTEP=    1225 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP=    1225 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
 NSTEP =  1225 STEPO   0AAA00AAA
 11:06:30 STEP 1225 H= 306:15 +CPU= 38.299
 NSTEP =  1226 STEPO   0AAA00AAA
 11:07:10 STEP 1226 H= 306:30 +CPU= 39.194
 NSTEP =  1227 STEPO   0AAA00AAA
 11:07:51 STEP 1227 H= 306:45 +CPU= 41.038
 NSTEP =  1228 STEPO   0AAA00AAA
 11:08:32 STEP 1228 H= 307:00 +CPU= 40.470
 NSTEP =  1229 STEPO   0AAA00AAA
 11:09:12 STEP 1229 H= 307:15 +CPU= 40.538
ISTEP=    1230 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP=    1230 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
 NSTEP =  1230 STEPO   0AAA00AAA
 11:09:53 STEP 1230 H= 307:30 +CPU= 40.750
 NSTEP =  1231 STEPO   0AAA00AAA
 11:10:34 STEP 1231 H= 307:45 +CPU= 40.274
 NSTEP =  1232 STEPO   0AAA00AAA
 11:11:16 STEP 1232 H= 308:00 +CPU= 42.356
 NSTEP =  1233 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 11:07:10 0AAA00AAA STEPO     1227    39.194   39.194   39.353    203:51    204:34 0.10512009536796E-04       2GB       0MB
 11:07:51 0AAA00AAA STEPO     1228    41.039   41.039   41.247    204:32    205:15 0.10512009536796E-04       2GB       0MB
 11:08:32 0AAA00AAA STEPO     1229    40.471   40.471   40.681    205:12    205:56 0.10512009536796E-04       2GB       0MB
 11:09:12 0AAA00AAA STEPO     1230    40.538   40.538   40.713    205:53    206:37 0.10512009536796E-04       2GB       0MB
 11:09:53 0AAA00AAA STEPO     1231    40.751   40.751   40.905    206:34    207:18 0.10512009536796E-04       2GB       0MB
 11:10:34 0AAA00AAA STEPO     1232    40.274   40.274   40.414    207:14    207:58 0.10512009536796E-04       2GB       0MB
 11:11:16 0AAA00AAA STEPO     1233    42.356   42.356   42.512    207:56    208:41 0.10512009536796E-04       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "    1200",
 CTIME   = "00121200      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 2*0,        1188, 2*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =  0.000000000000000E+000,
 GMASSI  =  0.000000000000000E+000
 /
------------------------------------------------
>>> Printing last 8 lines from file: /data/boinc/data/slots/39/progress_file_12208816.xml

<running_values>
  <last_cpu_time>52956.960000</last_cpu_time>
  <upload_file_number>12</upload_file_number>
  <last_iter>1233</last_iter>
  <last_upload>1036800</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a1kd
(argv4) batchid: 991
(argv5) wuid: 12208816
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /data/boinc/data/slots/39
Project directory is: /data/boinc/data/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816
..mkdir for temp folder for results failed
Copying: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /data/boinc/data/slots/39/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /data/boinc/data/slots/39/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_d00775dda09967578aca5ff66cc570af to: /data/boinc/data/slots/39/oifs_43r3_bl_a1kd_2016092300_15_991_12208816.zip
Unzipping the namelist zip file: /data/boinc/data/slots/39/oifs_43r3_bl_a1kd_2016092300_15_991_12208816.zip
ic_ancil_file: ic_ancil_12208816
ifsdata_file: ifsdata_12208816
climate_data_file: clim_data_12208816
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /data/boinc/data/slots/39/ic_ancil_12208816.zip
Unzipping the IC ancils zip file: /data/boinc/data/slots/39/ic_ancil_12208816.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_1afe13496696da8718b7e98beb377cd1 to: /data/boinc/data/slots/39/ifsdata/ifsdata_12208816.zip
Unzipping the ifsdata_zip file: /data/boinc/data/slots/39/ifsdata/ifsdata_12208816.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /data/boinc/data/slots/39/159l_2/clim_data_12208816.zip
Unzipping the climate data zip file: /data/boinc/data/slots/39/159l_2/clim_data_12208816.zip
Checking for progress XML file: /data/boinc/data/slots/39/progress_file_12208816.xml
Opened progress file ok : /data/boinc/data/slots/39/progress_file_12208816.xml
-- Model is restarting --
Adjusting last_iter, 1233, to previous model restart step.
Creating progress file: /data/boinc/data/slots/39/progress_file_12208816.xml
last_cpu_time: 52956
upload_file_number: 12
last_iter: 1201
last_upload: 1036800
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a1kd_2016092300_15_991_12208816_0_r92650562
The child process has been launched with process id: 505000
Executing the command: /data/boinc/data/slots/39/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:oceanis:1:1:505000:505000] [20230214:111236:1676394756:0.001] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  11:13:24 STEP 1200 H= 300:00 +CPU= 42.641
  11:14:06 STEP 1201 H= 300:15 +CPU= 41.550
  11:14:46 STEP 1202 H= 300:30 +CPU= 40.279
  11:15:26 STEP 1203 H= 300:45 +CPU= 39.617
  11:16:08 STEP 1204 H= 301:00 +CPU= 42.243
  11:16:49 STEP 1205 H= 301:15 +CPU= 40.182
  11:17:30 STEP 1206 H= 301:30 +CPU= 41.022
  11:18:10 STEP 1207 H= 301:45 +CPU= 39.834
  11:18:52 STEP 1208 H= 302:00 +CPU= 42.651
  11:19:33 STEP 1209 H= 302:15 +CPU= 40.229
  11:20:13 STEP 1210 H= 302:30 +CPU= 39.751
  11:20:53 STEP 1211 H= 302:45 +CPU= 40.541
  11:21:43 STEP 1212 H= 303:00 +CPU= 49.801
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001212
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001212
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001212
  11:22:23 STEP 1213 H= 303:15 +CPU= 39.945
  11:23:03 STEP 1214 H= 303:30 +CPU= 39.812
  11:23:44 STEP 1215 H= 303:45 +CPU= 40.305
  11:24:25 STEP 1216 H= 304:00 +CPU= 41.602
  11:25:07 STEP 1217 H= 304:15 +CPU= 40.958
  11:25:46 STEP 1218 H= 304:30 +CPU= 39.593
  11:26:27 STEP 1219 H= 304:45 +CPU= 41.004
  11:27:08 STEP 1220 H= 305:00 +CPU= 39.963
  11:27:48 STEP 1221 H= 305:15 +CPU= 40.424
  11:28:29 STEP 1222 H= 305:30 +CPU= 40.276
  11:29:09 STEP 1223 H= 305:45 +CPU= 40.022
  11:29:59 STEP 1224 H= 306:00 +CPU= 49.883
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001224
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001224
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001224
  11:30:40 STEP 1225 H= 306:15 +CPU= 40.778
  11:31:21 STEP 1226 H= 306:30 +CPU= 40.652
  11:32:01 STEP 1227 H= 306:45 +CPU= 40.126
  11:32:42 STEP 1228 H= 307:00 +CPU= 41.022
  11:33:21 STEP 1229 H= 307:15 +CPU= 39.175
  11:34:02 STEP 1230 H= 307:30 +CPU= 40.833
  11:34:43 STEP 1231 H= 307:45 +CPU= 40.839
  11:35:24 STEP 1232 H= 308:00 +CPU= 40.867
  11:36:03 STEP 1233 H= 308:15 +CPU= 38.751
  11:36:44 STEP 1234 H= 308:30 +CPU= 40.049
  11:37:24 STEP 1235 H= 308:45 +CPU= 39.849
  11:38:13 STEP 1236 H= 309:00 +CPU= 49.197
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001236
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001236
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001236
  11:38:51 STEP 1237 H= 309:15 +CPU= 38.207
  11:39:31 STEP 1238 H= 309:30 +CPU= 39.196
  11:40:10 STEP 1239 H= 309:45 +CPU= 38.848
  11:40:50 STEP 1240 H= 310:00 +CPU= 40.194
  11:41:30 STEP 1241 H= 310:15 +CPU= 39.290
  11:42:08 STEP 1242 H= 310:30 +CPU= 38.190
  11:42:45 STEP 1243 H= 310:45 +CPU= 37.302
  11:43:25 STEP 1244 H= 311:00 +CPU= 39.267
  11:44:03 STEP 1245 H= 311:15 +CPU= 38.234
  11:44:41 STEP 1246 H= 311:30 +CPU= 37.863
  11:45:20 STEP 1247 H= 311:45 +CPU= 38.105
  11:46:11 STEP 1248 H= 312:00 +CPU= 50.821
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001248
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001248
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001248
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001152
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001152
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001152
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001164
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001164
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001164
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001176
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001176
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001176
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001188
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001188
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001188
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001200
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001200
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001200
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001212
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001212
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001212
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001224
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001224
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001224
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001236
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001236
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001236
Zipping up the intermediate file: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_a1kd_2016092300_15_991_12208816_0_r92650562_12.zip
Uploading the intermediate file: upload_file_12.zip
  11:46:48 STEP 1249 H= 312:15 +CPU= 36.970
  11:47:27 STEP 1250 H= 312:30 +CPU= 38.895
  11:48:07 STEP 1251 H= 312:45 +CPU= 39.569
  11:48:46 STEP 1252 H= 313:00 +CPU= 39.670
  11:49:25 STEP 1253 H= 313:15 +CPU= 38.626
  11:50:04 STEP 1254 H= 313:30 +CPU= 38.268
  11:50:42 STEP 1255 H= 313:45 +CPU= 37.809
  11:51:21 STEP 1256 H= 314:00 +CPU= 39.372
  11:51:59 STEP 1257 H= 314:15 +CPU= 38.118
  11:52:39 STEP 1258 H= 314:30 +CPU= 39.920
  11:53:18 STEP 1259 H= 314:45 +CPU= 37.933
  11:54:06 STEP 1260 H= 315:00 +CPU= 48.304
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001260
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001260
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001260
  11:54:46 STEP 1261 H= 315:15 +CPU= 39.692
  11:55:25 STEP 1262 H= 315:30 +CPU= 38.647
  11:56:04 STEP 1263 H= 315:45 +CPU= 39.235
  11:56:44 STEP 1264 H= 316:00 +CPU= 39.626
  11:57:22 STEP 1265 H= 316:15 +CPU= 37.624
  11:58:00 STEP 1266 H= 316:30 +CPU= 38.594
  11:58:38 STEP 1267 H= 316:45 +CPU= 36.970
  11:59:17 STEP 1268 H= 317:00 +CPU= 39.458
  11:59:57 STEP 1269 H= 317:15 +CPU= 39.295
  12:00:35 STEP 1270 H= 317:30 +CPU= 37.911
  12:01:13 STEP 1271 H= 317:45 +CPU= 38.059
  12:02:01 STEP 1272 H= 318:00 +CPU= 47.998
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001272
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001272
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001272
  12:02:39 STEP 1273 H= 318:15 +CPU= 38.407
  12:03:17 STEP 1274 H= 318:30 +CPU= 37.731
  12:03:56 STEP 1275 H= 318:45 +CPU= 38.923
  12:04:36 STEP 1276 H= 319:00 +CPU= 39.637
  12:05:13 STEP 1277 H= 319:15 +CPU= 36.501
  12:05:51 STEP 1278 H= 319:30 +CPU= 37.994
  12:06:29 STEP 1279 H= 319:45 +CPU= 37.826
  12:07:08 STEP 1280 H= 320:00 +CPU= 38.587
  12:07:47 STEP 1281 H= 320:15 +CPU= 39.678
  12:08:25 STEP 1282 H= 320:30 +CPU= 37.269
  12:09:03 STEP 1283 H= 320:45 +CPU= 37.961
  12:09:50 STEP 1284 H= 321:00 +CPU= 46.612
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001284
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001284
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001284
  12:10:27 STEP 1285 H= 321:15 +CPU= 37.477
  12:11:05 STEP 1286 H= 321:30 +CPU= 37.749
  12:11:43 STEP 1287 H= 321:45 +CPU= 37.918
  12:12:21 STEP 1288 H= 322:00 +CPU= 38.194
  12:13:00 STEP 1289 H= 322:15 +CPU= 38.285
  12:13:38 STEP 1290 H= 322:30 +CPU= 38.564
  12:14:15 STEP 1291 H= 322:45 +CPU= 36.826
  12:14:54 STEP 1292 H= 323:00 +CPU= 38.459
  12:15:32 STEP 1293 H= 323:15 +CPU= 37.700
  12:16:11 STEP 1294 H= 323:30 +CPU= 38.948
  12:16:49 STEP 1295 H= 323:45 +CPU= 38.099
  12:17:41 STEP 1296 H= 324:00 +CPU= 52.087
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001296
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001296
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001296
  12:18:19 STEP 1297 H= 324:15 +CPU= 37.258
  12:18:57 STEP 1298 H= 324:30 +CPU= 38.549
  12:19:35 STEP 1299 H= 324:45 +CPU= 37.665
  12:20:15 STEP 1300 H= 325:00 +CPU= 39.915
  12:20:55 STEP 1301 H= 325:15 +CPU= 39.393
  12:21:34 STEP 1302 H= 325:30 +CPU= 39.255
  12:22:13 STEP 1303 H= 325:45 +CPU= 38.348
  12:22:52 STEP 1304 H= 326:00 +CPU= 39.483
  12:23:31 STEP 1305 H= 326:15 +CPU= 38.225
  12:24:10 STEP 1306 H= 326:30 +CPU= 38.781
  12:24:49 STEP 1307 H= 326:45 +CPU= 38.882
  12:25:36 STEP 1308 H= 327:00 +CPU= 46.940
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001308
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001308
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001308
  12:26:12 STEP 1309 H= 327:15 +CPU= 36.530
  12:26:48 STEP 1310 H= 327:30 +CPU= 35.708
  12:27:25 STEP 1311 H= 327:45 +CPU= 36.642
  12:28:03 STEP 1312 H= 328:00 +CPU= 37.469
  12:28:39 STEP 1313 H= 328:15 +CPU= 36.682
  12:29:15 STEP 1314 H= 328:30 +CPU= 35.762
  12:29:52 STEP 1315 H= 328:45 +CPU= 36.159
  12:30:28 STEP 1316 H= 329:00 +CPU= 36.213
  12:31:04 STEP 1317 H= 329:15 +CPU= 36.336
  12:31:41 STEP 1318 H= 329:30 +CPU= 36.393
  12:32:17 STEP 1319 H= 329:45 +CPU= 36.114
  12:33:01 STEP 1320 H= 330:00 +CPU= 43.793
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001320
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001320
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001320
  12:33:38 STEP 1321 H= 330:15 +CPU= 36.506
  12:34:13 STEP 1322 H= 330:30 +CPU= 35.228
  12:34:48 STEP 1323 H= 330:45 +CPU= 34.878
  12:35:25 STEP 1324 H= 331:00 +CPU= 37.162
  12:36:01 STEP 1325 H= 331:15 +CPU= 35.631
  12:36:35 STEP 1326 H= 331:30 +CPU= 33.970
  12:37:09 STEP 1327 H= 331:45 +CPU= 34.283
  12:37:45 STEP 1328 H= 332:00 +CPU= 36.004
  12:38:21 STEP 1329 H= 332:15 +CPU= 35.234
  12:38:57 STEP 1330 H= 332:30 +CPU= 36.417
  12:39:32 STEP 1331 H= 332:45 +CPU= 35.071
  12:40:15 STEP 1332 H= 333:00 +CPU= 42.225
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001332
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001332
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001332
  12:40:50 STEP 1333 H= 333:15 +CPU= 35.306
  12:41:26 STEP 1334 H= 333:30 +CPU= 35.976
  12:42:00 STEP 1335 H= 333:45 +CPU= 33.562
  12:42:34 STEP 1336 H= 334:00 +CPU= 34.194
  12:43:07 STEP 1337 H= 334:15 +CPU= 33.046
  12:43:43 STEP 1338 H= 334:30 +CPU= 35.420
  12:44:18 STEP 1339 H= 334:45 +CPU= 35.554
  12:44:55 STEP 1340 H= 335:00 +CPU= 36.275
  12:45:29 STEP 1341 H= 335:15 +CPU= 33.754
  12:46:02 STEP 1342 H= 335:30 +CPU= 33.693
  12:46:38 STEP 1343 H= 335:45 +CPU= 35.201
  12:47:27 STEP 1344 H= 336:00 +CPU= 48.222
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001344
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001344
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001344
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001248
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001248
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001248
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001260
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001260
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001260
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001272
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001272
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001272
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001284
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001284
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001284
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001296
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001296
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001296
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001308
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001308
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001308
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001320
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001320
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001320
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001332
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001332
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001332
Zipping up the intermediate file: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_a1kd_2016092300_15_991_12208816_0_r92650562_13.zip
Uploading the intermediate file: upload_file_13.zip
  12:48:02 STEP 1345 H= 336:15 +CPU= 35.794
  12:48:37 STEP 1346 H= 336:30 +CPU= 34.597
  12:49:11 STEP 1347 H= 336:45 +CPU= 33.619
  12:49:47 STEP 1348 H= 337:00 +CPU= 35.705
  12:50:22 STEP 1349 H= 337:15 +CPU= 34.732
  12:50:56 STEP 1350 H= 337:30 +CPU= 33.938
  12:51:30 STEP 1351 H= 337:45 +CPU= 33.965
  12:52:05 STEP 1352 H= 338:00 +CPU= 35.015
  12:52:40 STEP 1353 H= 338:15 +CPU= 35.068
  12:53:15 STEP 1354 H= 338:30 +CPU= 34.866
  12:53:50 STEP 1355 H= 338:45 +CPU= 34.965
  12:54:33 STEP 1356 H= 339:00 +CPU= 42.951
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001356
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001356
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001356
  12:55:08 STEP 1357 H= 339:15 +CPU= 34.830
  12:55:43 STEP 1358 H= 339:30 +CPU= 34.618
  12:56:18 STEP 1359 H= 339:45 +CPU= 34.745
  12:56:54 STEP 1360 H= 340:00 +CPU= 36.555
  12:57:30 STEP 1361 H= 340:15 +CPU= 35.667
  12:58:06 STEP 1362 H= 340:30 +CPU= 36.245
  12:58:43 STEP 1363 H= 340:45 +CPU= 36.238
  12:59:21 STEP 1364 H= 341:00 +CPU= 37.956
  12:59:58 STEP 1365 H= 341:15 +CPU= 37.066
  13:00:37 STEP 1366 H= 341:30 +CPU= 38.299
  13:01:15 STEP 1367 H= 341:45 +CPU= 38.071
  13:02:00 STEP 1368 H= 342:00 +CPU= 44.978
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001368
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001368
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001368
  13:02:38 STEP 1369 H= 342:15 +CPU= 37.581
  13:03:15 STEP 1370 H= 342:30 +CPU= 36.971
  13:03:52 STEP 1371 H= 342:45 +CPU= 36.894
  13:04:30 STEP 1372 H= 343:00 +CPU= 38.113
  13:05:06 STEP 1373 H= 343:15 +CPU= 35.896
  13:05:44 STEP 1374 H= 343:30 +CPU= 37.322
  13:06:22 STEP 1375 H= 343:45 +CPU= 37.935
  13:07:00 STEP 1376 H= 344:00 +CPU= 38.287
  13:07:38 STEP 1377 H= 344:15 +CPU= 37.627
  13:08:16 STEP 1378 H= 344:30 +CPU= 37.857
  13:08:55 STEP 1379 H= 344:45 +CPU= 38.436
  13:09:41 STEP 1380 H= 345:00 +CPU= 45.884
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001380
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001380
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001380
  13:10:18 STEP 1381 H= 345:15 +CPU= 36.747
  13:10:56 STEP 1382 H= 345:30 +CPU= 38.149
  13:11:35 STEP 1383 H= 345:45 +CPU= 39.455
  13:12:14 STEP 1384 H= 346:00 +CPU= 37.930
  13:12:51 STEP 1385 H= 346:15 +CPU= 37.312
  13:13:28 STEP 1386 H= 346:30 +CPU= 36.994
  13:14:06 STEP 1387 H= 346:45 +CPU= 37.214
  13:14:44 STEP 1388 H= 347:00 +CPU= 37.825
  13:15:22 STEP 1389 H= 347:15 +CPU= 38.671
  13:15:59 STEP 1390 H= 347:30 +CPU= 37.080
  13:16:38 STEP 1391 H= 347:45 +CPU= 38.705
  13:17:30 STEP 1392 H= 348:00 +CPU= 51.457
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001392
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001392
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001392
  13:18:07 STEP 1393 H= 348:15 +CPU= 37.242
  13:18:46 STEP 1394 H= 348:30 +CPU= 38.458
  13:19:24 STEP 1395 H= 348:45 +CPU= 38.086
  13:20:02 STEP 1396 H= 349:00 +CPU= 37.977
  13:20:40 STEP 1397 H= 349:15 +CPU= 37.477
  13:21:17 STEP 1398 H= 349:30 +CPU= 37.054
  13:21:54 STEP 1399 H= 349:45 +CPU= 36.915
  13:22:32 STEP 1400 H= 350:00 +CPU= 37.660
  13:23:10 STEP 1401 H= 350:15 +CPU= 38.228
  13:23:48 STEP 1402 H= 350:30 +CPU= 37.654
  13:24:27 STEP 1403 H= 350:45 +CPU= 38.570
  13:25:16 STEP 1404 H= 351:00 +CPU= 48.953
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001404
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001404
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001404
  13:25:56 STEP 1405 H= 351:15 +CPU= 40.520
  13:26:34 STEP 1406 H= 351:30 +CPU= 37.331
  13:27:12 STEP 1407 H= 351:45 +CPU= 38.277
  13:27:50 STEP 1408 H= 352:00 +CPU= 37.996
  13:28:31 STEP 1409 H= 352:15 +CPU= 40.203
  13:29:09 STEP 1410 H= 352:30 +CPU= 38.098
  13:29:48 STEP 1411 H= 352:45 +CPU= 39.305
  13:30:28 STEP 1412 H= 353:00 +CPU= 39.778
  13:31:06 STEP 1413 H= 353:15 +CPU= 38.113
  13:31:45 STEP 1414 H= 353:30 +CPU= 38.276
  13:32:24 STEP 1415 H= 353:45 +CPU= 39.128
  13:33:11 STEP 1416 H= 354:00 +CPU= 47.428
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001416
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001416
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001416
  13:33:50 STEP 1417 H= 354:15 +CPU= 39.158
  13:34:28 STEP 1418 H= 354:30 +CPU= 37.527
  13:35:06 STEP 1419 H= 354:45 +CPU= 38.010
  13:35:45 STEP 1420 H= 355:00 +CPU= 38.328
  13:36:23 STEP 1421 H= 355:15 +CPU= 38.459
  13:37:00 STEP 1422 H= 355:30 +CPU= 37.300
  13:37:39 STEP 1423 H= 355:45 +CPU= 38.446
  13:38:16 STEP 1424 H= 356:00 +CPU= 37.473
  13:38:54 STEP 1425 H= 356:15 +CPU= 37.514
  13:39:31 STEP 1426 H= 356:30 +CPU= 37.115
  13:40:08 STEP 1427 H= 356:45 +CPU= 37.062
  13:40:53 STEP 1428 H= 357:00 +CPU= 43.993
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001428
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001428
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001428
  13:41:30 STEP 1429 H= 357:15 +CPU= 37.043
  13:42:05 STEP 1430 H= 357:30 +CPU= 35.357
  13:42:42 STEP 1431 H= 357:45 +CPU= 36.376
  13:43:17 STEP 1432 H= 358:00 +CPU= 35.470
  13:43:53 STEP 1433 H= 358:15 +CPU= 35.594
  13:44:29 STEP 1434 H= 358:30 +CPU= 36.518
  13:45:03 STEP 1435 H= 358:45 +CPU= 33.242
  13:45:41 STEP 1436 H= 359:00 +CPU= 38.659
  13:46:19 STEP 1437 H= 359:15 +CPU= 37.374
  13:46:55 STEP 1438 H= 359:30 +CPU= 36.212
  13:47:32 STEP 1439 H= 359:45 +CPU= 36.775
  13:48:21 STEP 1440 H= 360:00 +CPU= 48.582
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.3942035442E-21      I       0.1062348598E-04      I
ICloud fractionI      0.0000000000E+00      I       0.9650252862E-01      I
I  Relat. Hum. I      0.1488440741E+00      I       0.4566851186E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.1255179847E+04      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    323092225 BYTES IN      7 RECORDS TRANSFERRED IN    0.0006 SECONDS538487.0 Mbytes/s, TOTAL TIME=    0.0147( 4.1%)
 13:48:21 STEP 1440 H= 360:00 +CPU= 48.582
 END CNT3
 NSTEP =  1440 CNT0   000000000  35.938  35.938  36.028   0.998               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           34/  1069125708 WRITTEN         7090/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    128    0       34      1044068     7090 ************    19.2     2.1    17.1     3.2    35.0
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 9344697.6 9344697.6    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 9339648.0 9339648.0     99.95      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  261    5339.5    5339.5     14.91      0.00
   9 SPCM     - SPECTRAL COMP.                     240     995.1     995.1      2.56      0.00
  10 SCAN2M - PHYSICS                              241   20357.2   20357.2     52.50      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 20    1148.1    1148.1      0.25      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 11      51.4      51.4      0.01      0.00
  17 GRIDFPOS IN CNT4                               20      41.4      41.4      0.01      0.00
  27 RESTART FILES - WRITING                         5    4592.2    4592.2      0.25      0.00
  28 RESTART FILES - READING                         1    4266.5    4266.5      0.05      0.00
  29 SU4FPOS IN CNT4                                20       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                                20    7674.7    7674.7      1.64      0.00
  31 POSDDH IN STEPO                                 2       1.6       1.6      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    241    7222.1    7222.1     18.63      0.00
  39 SU0YOMB                                         1     520.7     520.7      0.01      0.00
  51 SCAN2M   - SL COMM. PART 1                    241      43.1      43.1      0.11      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              240     342.7     342.7      0.88      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              240      79.1      79.1      0.20      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 11       0.4       0.4      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      524     630.0     630.0      3.53      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       500     347.9     347.9      1.86      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        500     117.4     117.4      0.63      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       524     189.3     189.3      1.06      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      67.9      67.9      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            524      59.8      59.8      0.34      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            500      34.7      34.7      0.19      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            524     101.6     101.6      0.57      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            500      63.5      63.5      0.34      0.00
 400 GSTATS                                      28768       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 26718       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME     9344.7 CPU TIME    9313.3 VECTOR TIME     9313.3


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      138.8
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /data/boinc/data/slots/39/ICMGGh7zg+001440
Moving to projects directory: /data/boinc/data/slots/39/ICMSHh7zg+001440
Moving to projects directory: /data/boinc/data/slots/39/ICMUAh7zg+001440
Adding to the zip: /data/boinc/data/slots/39/NODE.001_01
Adding to the zip: /data/boinc/data/slots/39/ifs.stat
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001356
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001428
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001356
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001380
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001440
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001368
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001356
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001392
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001440
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001404
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001404
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001416
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001344
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001380
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001428
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001392
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001344
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001368
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001416
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001440
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001368
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001392
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMUAh7zg+001428
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001380
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001344
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMSHh7zg+001416
Adding to the zip: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_12208816/ICMGGh7zg+001404
Zipping up the final file: /data/boinc/data/projects/climateprediction.net/oifs_43r3_bl_a1kd_2016092300_15_991_12208816_0_r92650562_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
13:51:59 (504997): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:51:23 1514520 22308995 oifs_43r3_bl_a1kd_2016092300_15_991_12208816_0 1,295,100 62,269 0.0481


©2024 cpdn.org