climateprediction.net home page
Task 22269870

Task 22269870

Name oifs_43r3_ps_0965_1998050100_123_967_12184609_0
Workunit 12184609
Created 22 Dec 2022, 17:34:35 UTC
Sent 3 Jan 2023, 12:36:19 UTC
Report deadline 2 Feb 2023, 12:36:19 UTC
Received 4 Jan 2023, 16:28:50 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 9 (0x00000009) Unknown error code
Computer ID 1526610
Run time 23 hours 43 min 16 sec
CPU time 23 hours 36 min 38 sec
Validate state Invalid
Credit 6,048.00
Device peak FLOPS 1.61 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,412.09 MB
Peak swap size 4,977.89 MB
Peak disk usage 3,189.86 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<message>
process exited with code 9 (0x9, -247)</message>
<stderr_txt>
on.net/oifs_43r3_ps_12184609/ICMGGhq0f+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001068
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0965_1998050100_123_967_12184609_0_r1066025543_44.zip
Uploading the intermediate file: upload_file_44.zip
  03:29:25 STEP 1081 H=1081:00 +CPU= 45.265
  03:30:11 STEP 1082 H=1082:00 +CPU= 45.058
  03:31:22 STEP 1083 H=1083:00 +CPU= 71.503
  03:32:09 STEP 1084 H=1084:00 +CPU= 46.288
  03:32:54 STEP 1085 H=1085:00 +CPU= 44.805
  03:34:05 STEP 1086 H=1086:00 +CPU= 70.806
  03:34:50 STEP 1087 H=1087:00 +CPU= 45.154
  03:35:36 STEP 1088 H=1088:00 +CPU= 46.482
  03:36:48 STEP 1089 H=1089:00 +CPU= 71.620
  03:37:36 STEP 1090 H=1090:00 +CPU= 47.318
  03:38:21 STEP 1091 H=1091:00 +CPU= 45.108
  03:39:41 STEP 1092 H=1092:00 +CPU= 79.928
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001092
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001092
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001092
  03:40:27 STEP 1093 H=1093:00 +CPU= 45.143
  03:41:12 STEP 1094 H=1094:00 +CPU= 45.444
  03:42:22 STEP 1095 H=1095:00 +CPU= 69.707
  03:43:08 STEP 1096 H=1096:00 +CPU= 46.056
  03:43:53 STEP 1097 H=1097:00 +CPU= 44.342
  03:45:07 STEP 1098 H=1098:00 +CPU= 73.717
  03:45:52 STEP 1099 H=1099:00 +CPU= 45.015
  03:46:38 STEP 1100 H=1100:00 +CPU= 45.566
  03:47:51 STEP 1101 H=1101:00 +CPU= 72.559
  03:48:38 STEP 1102 H=1102:00 +CPU= 47.103
  03:49:25 STEP 1103 H=1103:00 +CPU= 47.018
  03:50:49 STEP 1104 H=1104:00 +CPU= 83.640
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001104
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001104
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001092
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0965_1998050100_123_967_12184609_0_r1066025543_45.zip
Uploading the intermediate file: upload_file_45.zip
  03:51:34 STEP 1105 H=1105:00 +CPU= 45.194
  03:52:22 STEP 1106 H=1106:00 +CPU= 46.598
  03:53:34 STEP 1107 H=1107:00 +CPU= 71.460
  03:54:20 STEP 1108 H=1108:00 +CPU= 46.284
  03:55:05 STEP 1109 H=1109:00 +CPU= 44.813
  03:56:19 STEP 1110 H=1110:00 +CPU= 73.162
  03:57:03 STEP 1111 H=1111:00 +CPU= 44.346
  03:57:50 STEP 1112 H=1112:00 +CPU= 45.696
  03:59:02 STEP 1113 H=1113:00 +CPU= 71.794
  03:59:49 STEP 1114 H=1114:00 +CPU= 46.633
  04:00:35 STEP 1115 H=1115:00 +CPU= 45.643
  04:01:55 STEP 1116 H=1116:00 +CPU= 79.260
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001116
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001116
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001116
  04:02:42 STEP 1117 H=1117:00 +CPU= 46.529
  04:03:30 STEP 1118 H=1118:00 +CPU= 46.529
  04:04:42 STEP 1119 H=1119:00 +CPU= 71.910
  04:05:29 STEP 1120 H=1120:00 +CPU= 46.971
  04:06:13 STEP 1121 H=1121:00 +CPU= 44.236
  04:07:26 STEP 1122 H=1122:00 +CPU= 72.179
  04:08:11 STEP 1123 H=1123:00 +CPU= 45.439
  04:08:57 STEP 1124 H=1124:00 +CPU= 46.031
  04:10:08 STEP 1125 H=1125:00 +CPU= 70.741
  04:10:54 STEP 1126 H=1126:00 +CPU= 46.015
  04:11:40 STEP 1127 H=1127:00 +CPU= 45.509
  04:13:05 STEP 1128 H=1128:00 +CPU= 84.272
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001128
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001128
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001116
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0965_1998050100_123_967_12184609_0_r1066025543_46.zip
Uploading the intermediate file: upload_file_46.zip
  04:13:49 STEP 1129 H=1129:00 +CPU= 44.313
  04:14:37 STEP 1130 H=1130:00 +CPU= 47.508
  04:15:48 STEP 1131 H=1131:00 +CPU= 70.959
  04:16:35 STEP 1132 H=1132:00 +CPU= 46.457
  04:17:20 STEP 1133 H=1133:00 +CPU= 45.308
  04:18:32 STEP 1134 H=1134:00 +CPU= 71.720
  04:19:17 STEP 1135 H=1135:00 +CPU= 44.809
  04:20:03 STEP 1136 H=1136:00 +CPU= 45.686
  04:21:14 STEP 1137 H=1137:00 +CPU= 70.643
  04:22:00 STEP 1138 H=1138:00 +CPU= 46.592
  04:22:45 STEP 1139 H=1139:00 +CPU= 44.129
  04:24:04 STEP 1140 H=1140:00 +CPU= 78.660
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001140
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001140
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001140
  04:24:49 STEP 1141 H=1141:00 +CPU= 45.769
  04:25:35 STEP 1142 H=1142:00 +CPU= 45.356
  04:26:46 STEP 1143 H=1143:00 +CPU= 71.081
  04:27:33 STEP 1144 H=1144:00 +CPU= 46.041
  04:28:18 STEP 1145 H=1145:00 +CPU= 45.228
  04:29:29 STEP 1146 H=1146:00 +CPU= 70.937
  04:30:13 STEP 1147 H=1147:00 +CPU= 44.344
  04:30:59 STEP 1148 H=1148:00 +CPU= 45.790
  04:32:11 STEP 1149 H=1149:00 +CPU= 71.035
  04:32:56 STEP 1150 H=1150:00 +CPU= 45.595
  04:33:43 STEP 1151 H=1151:00 +CPU= 46.141
  04:35:08 STEP 1152 H=1152:00 +CPU= 84.809
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001152
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001152
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0965_1998050100_123_967_12184609_0_r1066025543_47.zip
Uploading the intermediate file: upload_file_47.zip
  04:35:53 STEP 1153 H=1153:00 +CPU= 44.630
  04:36:39 STEP 1154 H=1154:00 +CPU= 46.147
  04:37:50 STEP 1155 H=1155:00 +CPU= 70.747
  04:38:36 STEP 1156 H=1156:00 +CPU= 45.604
  04:39:21 STEP 1157 H=1157:00 +CPU= 45.248
  04:40:32 STEP 1158 H=1158:00 +CPU= 70.404
  04:41:14 STEP 1159 H=1159:00 +CPU= 42.438
  04:42:01 STEP 1160 H=1160:00 +CPU= 46.867
  04:43:12 STEP 1161 H=1161:00 +CPU= 70.373
  04:43:58 STEP 1162 H=1162:00 +CPU= 45.898
  04:44:42 STEP 1163 H=1163:00 +CPU= 43.846
  04:46:01 STEP 1164 H=1164:00 +CPU= 78.852
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001164
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001164
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001164
  04:46:47 STEP 1165 H=1165:00 +CPU= 45.551
  04:47:34 STEP 1166 H=1166:00 +CPU= 46.989
  04:48:46 STEP 1167 H=1167:00 +CPU= 71.855
  04:49:33 STEP 1168 H=1168:00 +CPU= 46.496
  04:50:18 STEP 1169 H=1169:00 +CPU= 45.392
  04:51:31 STEP 1170 H=1170:00 +CPU= 72.491
  04:52:17 STEP 1171 H=1171:00 +CPU= 45.508
  04:53:05 STEP 1172 H=1172:00 +CPU= 47.886
  04:54:25 STEP 1173 H=1173:00 +CPU= 69.849
  04:55:09 STEP 1174 H=1174:00 +CPU= 44.060
  04:55:49 STEP 1175 H=1175:00 +CPU= 39.637
  04:57:11 STEP 1176 H=1176:00 +CPU= 82.116
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001176
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001176
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001164
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0965_1998050100_123_967_12184609_0_r1066025543_48.zip
Uploading the intermediate file: upload_file_48.zip
  04:57:53 STEP 1177 H=1177:00 +CPU= 42.144
  04:58:38 STEP 1178 H=1178:00 +CPU= 44.333
  04:59:44 STEP 1179 H=1179:00 +CPU= 66.750
  05:00:28 STEP 1180 H=1180:00 +CPU= 43.471
  05:01:11 STEP 1181 H=1181:00 +CPU= 42.859
  05:02:20 STEP 1182 H=1182:00 +CPU= 68.972
  05:03:03 STEP 1183 H=1183:00 +CPU= 43.138
  05:03:49 STEP 1184 H=1184:00 +CPU= 45.235
  05:05:00 STEP 1185 H=1185:00 +CPU= 70.584
  05:05:47 STEP 1186 H=1186:00 +CPU= 46.757
  05:06:30 STEP 1187 H=1187:00 +CPU= 43.217
  05:07:32 STEP 1188 H=1188:00 +CPU= 61.477
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001188
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001188
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001188
  05:08:18 STEP 1189 H=1189:00 +CPU= 45.427
  05:09:11 STEP 1190 H=1190:00 +CPU= 49.226
  05:10:20 STEP 1191 H=1191:00 +CPU= 67.972
  05:11:07 STEP 1192 H=1192:00 +CPU= 47.316
  05:11:54 STEP 1193 H=1193:00 +CPU= 46.811
  05:13:02 STEP 1194 H=1194:00 +CPU= 67.427
  05:13:48 STEP 1195 H=1195:00 +CPU= 45.775
  05:14:35 STEP 1196 H=1196:00 +CPU= 47.179
  05:15:42 STEP 1197 H=1197:00 +CPU= 65.397
  05:16:29 STEP 1198 H=1198:00 +CPU= 47.171
  05:17:16 STEP 1199 H=1199:00 +CPU= 46.600
  05:18:33 STEP 1200 H=1200:00 +CPU= 76.510
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001200
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001200
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001188
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0965_1998050100_123_967_12184609_0_r1066025543_49.zip
Uploading the intermediate file: upload_file_49.zip
Uploading trickle at timestep: 4320000
  05:19:19 STEP 1201 H=1201:00 +CPU= 45.655
  05:20:06 STEP 1202 H=1202:00 +CPU= 47.433
  05:21:10 STEP 1203 H=1203:00 +CPU= 63.748
  05:22:00 STEP 1204 H=1204:00 +CPU= 49.172
  05:22:46 STEP 1205 H=1205:00 +CPU= 45.864
  05:23:53 STEP 1206 H=1206:00 +CPU= 67.622
  05:24:39 STEP 1207 H=1207:00 +CPU= 45.405
  05:25:26 STEP 1208 H=1208:00 +CPU= 47.124
  05:26:24 STEP 1209 H=1209:00 +CPU= 57.685
  05:27:12 STEP 1210 H=1210:00 +CPU= 47.881
  05:27:58 STEP 1211 H=1211:00 +CPU= 45.641
  05:29:14 STEP 1212 H=1212:00 +CPU= 76.155
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001212
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001212
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001212
  05:29:59 STEP 1213 H=1213:00 +CPU= 45.501
  05:30:48 STEP 1214 H=1214:00 +CPU= 48.699
  05:31:47 STEP 1215 H=1215:00 +CPU= 58.354
  05:32:18 STEP 1216 H=1216:00 +CPU= 31.191
  05:32:48 STEP 1217 H=1217:00 +CPU= 30.341
  05:33:49 STEP 1218 H=1218:00 +CPU= 60.838
  05:34:35 STEP 1219 H=1219:00 +CPU= 45.283
  05:35:21 STEP 1220 H=1220:00 +CPU= 46.430
  05:36:16 STEP 1221 H=1221:00 +CPU= 54.592
  05:36:47 STEP 1222 H=1222:00 +CPU= 31.373
  05:37:19 STEP 1223 H=1223:00 +CPU= 31.338
  05:38:17 STEP 1224 H=1224:00 +CPU= 58.684
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001224
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001224
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001212
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0965_1998050100_123_967_12184609_0_r1066025543_50.zip
Uploading the intermediate file: upload_file_50.zip
  05:38:48 STEP 1225 H=1225:00 +CPU= 30.407
  05:39:27 STEP 1226 H=1226:00 +CPU= 39.527
  05:40:33 STEP 1227 H=1227:00 +CPU= 64.673
  05:41:15 STEP 1228 H=1228:00 +CPU= 42.561
  05:41:57 STEP 1229 H=1229:00 +CPU= 41.119
  05:43:04 STEP 1230 H=1230:00 +CPU= 67.113
  05:43:46 STEP 1231 H=1231:00 +CPU= 41.746
  05:44:30 STEP 1232 H=1232:00 +CPU= 43.624
  05:45:36 STEP 1233 H=1233:00 +CPU= 65.702
  05:46:20 STEP 1234 H=1234:00 +CPU= 43.262
  05:47:02 STEP 1235 H=1235:00 +CPU= 41.918
  05:48:17 STEP 1236 H=1236:00 +CPU= 74.597
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001236
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001236
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001236
  05:48:59 STEP 1237 H=1237:00 +CPU= 41.727
  05:49:32 STEP 1238 H=1238:00 +CPU= 33.527
  05:50:22 STEP 1239 H=1239:00 +CPU= 49.604
  05:50:53 STEP 1240 H=1240:00 +CPU= 31.185
  05:51:31 STEP 1241 H=1241:00 +CPU= 37.542
  05:52:44 STEP 1242 H=1242:00 +CPU= 72.825
  05:53:29 STEP 1243 H=1243:00 +CPU= 44.731
  05:54:15 STEP 1244 H=1244:00 +CPU= 45.932
  05:55:26 STEP 1245 H=1245:00 +CPU= 71.142
  05:56:12 STEP 1246 H=1246:00 +CPU= 45.854
  05:56:59 STEP 1247 H=1247:00 +CPU= 46.084
  05:58:25 STEP 1248 H=1248:00 +CPU= 85.749
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001248
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001248
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0965_1998050100_123_967_12184609_0_r1066025543_51.zip
Uploading the intermediate file: upload_file_51.zip
  05:59:11 STEP 1249 H=1249:00 +CPU= 46.116
  05:59:58 STEP 1250 H=1250:00 +CPU= 46.923
  06:01:09 STEP 1251 H=1251:00 +CPU= 71.168
  06:01:57 STEP 1252 H=1252:00 +CPU= 47.874
  06:02:43 STEP 1253 H=1253:00 +CPU= 45.730
  06:03:55 STEP 1254 H=1254:00 +CPU= 72.102
  06:04:40 STEP 1255 H=1255:00 +CPU= 44.649
  06:05:27 STEP 1256 H=1256:00 +CPU= 47.049
  06:06:40 STEP 1257 H=1257:00 +CPU= 72.006
  06:07:27 STEP 1258 H=1258:00 +CPU= 47.554
  06:08:12 STEP 1259 H=1259:00 +CPU= 44.628
  06:09:31 STEP 1260 H=1260:00 +CPU= 79.185
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001260
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001260
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001260
  06:10:16 STEP 1261 H=1261:00 +CPU= 44.616
  06:11:03 STEP 1262 H=1262:00 +CPU= 46.949
  06:12:16 STEP 1263 H=1263:00 +CPU= 72.572
  06:13:03 STEP 1264 H=1264:00 +CPU= 46.623
  06:13:47 STEP 1265 H=1265:00 +CPU= 44.040
  06:14:59 STEP 1266 H=1266:00 +CPU= 72.052
  06:15:45 STEP 1267 H=1267:00 +CPU= 45.770
  06:16:39 STEP 1268 H=1268:00 +CPU= 46.582
  06:17:51 STEP 1269 H=1269:00 +CPU= 71.833
  06:18:39 STEP 1270 H=1270:00 +CPU= 47.242
  06:19:28 STEP 1271 H=1271:00 +CPU= 48.073
  06:21:04 STEP 1272 H=1272:00 +CPU= 85.642
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001272
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001272
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001260
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0965_1998050100_123_967_12184609_0_r1066025543_52.zip
Uploading the intermediate file: upload_file_52.zip
  06:21:48 STEP 1273 H=1273:00 +CPU= 43.395
  06:22:29 STEP 1274 H=1274:00 +CPU= 40.906
  06:23:34 STEP 1275 H=1275:00 +CPU= 65.389
  06:24:18 STEP 1276 H=1276:00 +CPU= 43.956
  06:25:02 STEP 1277 H=1277:00 +CPU= 43.087
  06:26:12 STEP 1278 H=1278:00 +CPU= 69.229
  06:26:55 STEP 1279 H=1279:00 +CPU= 43.069
  06:27:39 STEP 1280 H=1280:00 +CPU= 43.761
  06:28:49 STEP 1281 H=1281:00 +CPU= 69.239
  06:29:32 STEP 1282 H=1282:00 +CPU= 43.446
  06:30:15 STEP 1283 H=1283:00 +CPU= 42.171
  06:31:31 STEP 1284 H=1284:00 +CPU= 75.814
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001284
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001284
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001284
  06:32:15 STEP 1285 H=1285:00 +CPU= 44.202
  06:33:01 STEP 1286 H=1286:00 +CPU= 45.603
  06:34:10 STEP 1287 H=1287:00 +CPU= 69.280
  06:34:47 STEP 1288 H=1288:00 +CPU= 37.330
  06:35:18 STEP 1289 H=1289:00 +CPU= 30.638
  06:36:23 STEP 1290 H=1290:00 +CPU= 65.202
  06:37:09 STEP 1291 H=1291:00 +CPU= 45.343
  06:37:55 STEP 1292 H=1292:00 +CPU= 46.277
  06:39:03 STEP 1293 H=1293:00 +CPU= 67.546
  06:39:49 STEP 1294 H=1294:00 +CPU= 46.503
  06:40:37 STEP 1295 H=1295:00 +CPU= 47.901
  06:41:57 STEP 1296 H=1296:00 +CPU= 79.291
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001296
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001296
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001284
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0965_1998050100_123_967_12184609_0_r1066025543_53.zip
Uploading the intermediate file: upload_file_53.zip
  06:42:43 STEP 1297 H=1297:00 +CPU= 46.158
  06:43:31 STEP 1298 H=1298:00 +CPU= 47.292
  06:44:36 STEP 1299 H=1299:00 +CPU= 65.261
  06:45:23 STEP 1300 H=1300:00 +CPU= 47.236
  06:46:10 STEP 1301 H=1301:00 +CPU= 46.152
  06:47:13 STEP 1302 H=1302:00 +CPU= 63.562
  06:47:59 STEP 1303 H=1303:00 +CPU= 45.240
  06:48:46 STEP 1304 H=1304:00 +CPU= 47.388
  06:49:54 STEP 1305 H=1305:00 +CPU= 67.464
  06:50:42 STEP 1306 H=1306:00 +CPU= 47.976
  06:51:28 STEP 1307 H=1307:00 +CPU= 46.110
  06:52:42 STEP 1308 H=1308:00 +CPU= 73.647
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001308
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001308
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001308
  06:53:28 STEP 1309 H=1309:00 +CPU= 45.971
  06:54:15 STEP 1310 H=1310:00 +CPU= 46.789
  06:55:24 STEP 1311 H=1311:00 +CPU= 69.580
  06:56:05 STEP 1312 H=1312:00 +CPU= 40.475
  06:56:51 STEP 1313 H=1313:00 +CPU= 45.670
  06:58:04 STEP 1314 H=1314:00 +CPU= 73.117
  06:58:44 STEP 1315 H=1315:00 +CPU= 40.204
  06:59:32 STEP 1316 H=1316:00 +CPU= 47.136
  07:00:44 STEP 1317 H=1317:00 +CPU= 71.809
  07:01:24 STEP 1318 H=1318:00 +CPU= 40.213
  07:01:55 STEP 1319 H=1319:00 +CPU= 31.052
  07:02:53 STEP 1320 H=1320:00 +CPU= 57.767
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001320
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001320
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001308
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0965_1998050100_123_967_12184609_0_r1066025543_54.zip
Uploading the intermediate file: upload_file_54.zip
  07:03:30 STEP 1321 H=1321:00 +CPU= 37.545
  07:04:19 STEP 1322 H=1322:00 +CPU= 48.914
  07:05:32 STEP 1323 H=1323:00 +CPU= 72.317
  07:06:08 STEP 1324 H=1324:00 +CPU= 36.135
  07:06:39 STEP 1325 H=1325:00 +CPU= 30.442
  07:07:29 STEP 1326 H=1326:00 +CPU= 50.163
  07:08:04 STEP 1327 H=1327:00 +CPU= 35.378
  07:08:52 STEP 1328 H=1328:00 +CPU= 47.205
  07:10:04 STEP 1329 H=1329:00 +CPU= 71.607
  07:10:46 STEP 1330 H=1330:00 +CPU= 42.184
  07:11:16 STEP 1331 H=1331:00 +CPU= 30.551
  07:12:11 STEP 1332 H=1332:00 +CPU= 54.406
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001332
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001332
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001332
  07:12:41 STEP 1333 H=1333:00 +CPU= 30.146
  07:13:12 STEP 1334 H=1334:00 +CPU= 31.042
  07:14:10 STEP 1335 H=1335:00 +CPU= 57.660
  07:14:54 STEP 1336 H=1336:00 +CPU= 44.046
  07:15:38 STEP 1337 H=1337:00 +CPU= 42.981
  07:16:48 STEP 1338 H=1338:00 +CPU= 69.506
  07:17:31 STEP 1339 H=1339:00 +CPU= 43.163
  07:18:17 STEP 1340 H=1340:00 +CPU= 45.606
  07:19:28 STEP 1341 H=1341:00 +CPU= 70.697
  07:20:15 STEP 1342 H=1342:00 +CPU= 46.273
  07:21:00 STEP 1343 H=1343:00 +CPU= 45.323
  07:22:22 STEP 1344 H=1344:00 +CPU= 81.438
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001344
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001344
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0965_1998050100_123_967_12184609_0_r1066025543_55.zip
Uploading the intermediate file: upload_file_55.zip
  07:22:56 STEP 1345 H=1345:00 +CPU= 33.023
  07:23:27 STEP 1346 H=1346:00 +CPU= 31.294
  07:24:17 STEP 1347 H=1347:00 +CPU= 49.771
  07:24:48 STEP 1348 H=1348:00 +CPU= 30.928
  07:25:18 STEP 1349 H=1349:00 +CPU= 30.354
  07:26:08 STEP 1350 H=1350:00 +CPU= 50.287
  07:26:38 STEP 1351 H=1351:00 +CPU= 30.024
  07:27:10 STEP 1352 H=1352:00 +CPU= 31.334
  07:28:00 STEP 1353 H=1353:00 +CPU= 49.620
  07:28:31 STEP 1354 H=1354:00 +CPU= 31.909
  07:29:02 STEP 1355 H=1355:00 +CPU= 30.885
  07:29:58 STEP 1356 H=1356:00 +CPU= 55.943
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001356
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001356
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001356
  07:30:29 STEP 1357 H=1357:00 +CPU= 30.365
  07:31:00 STEP 1358 H=1358:00 +CPU= 31.330
  07:31:50 STEP 1359 H=1359:00 +CPU= 49.885
  07:32:22 STEP 1360 H=1360:00 +CPU= 31.798
  07:32:53 STEP 1361 H=1361:00 +CPU= 30.632
  07:33:49 STEP 1362 H=1362:00 +CPU= 56.716
  07:34:37 STEP 1363 H=1363:00 +CPU= 46.853
  07:35:25 STEP 1364 H=1364:00 +CPU= 47.320
  07:36:38 STEP 1365 H=1365:00 +CPU= 72.485
  07:37:27 STEP 1366 H=1366:00 +CPU= 47.225
  07:38:14 STEP 1367 H=1367:00 +CPU= 46.454
  07:39:42 STEP 1368 H=1368:00 +CPU= 85.870
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001368
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001368
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001356
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0965_1998050100_123_967_12184609_0_r1066025543_56.zip
Uploading the intermediate file: upload_file_56.zip
  07:40:29 STEP 1369 H=1369:00 +CPU= 46.046
  07:41:17 STEP 1370 H=1370:00 +CPU= 46.879
  07:42:30 STEP 1371 H=1371:00 +CPU= 72.320
  07:43:17 STEP 1372 H=1372:00 +CPU= 46.837
  07:44:02 STEP 1373 H=1373:00 +CPU= 44.793
  07:45:24 STEP 1374 H=1374:00 +CPU= 74.501
  07:46:11 STEP 1375 H=1375:00 +CPU= 46.181
  07:46:59 STEP 1376 H=1376:00 +CPU= 47.511
  07:48:13 STEP 1377 H=1377:00 +CPU= 72.094
  07:49:00 STEP 1378 H=1378:00 +CPU= 46.939
  07:49:47 STEP 1379 H=1379:00 +CPU= 46.413
  07:51:07 STEP 1380 H=1380:00 +CPU= 78.867
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001380
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001380
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001380
  07:51:54 STEP 1381 H=1381:00 +CPU= 45.523
  07:52:41 STEP 1382 H=1382:00 +CPU= 46.218
  07:53:53 STEP 1383 H=1383:00 +CPU= 71.145
  07:54:40 STEP 1384 H=1384:00 +CPU= 46.408
  07:55:26 STEP 1385 H=1385:00 +CPU= 45.385
  07:56:39 STEP 1386 H=1386:00 +CPU= 73.144
  07:57:25 STEP 1387 H=1387:00 +CPU= 45.823
  07:58:11 STEP 1388 H=1388:00 +CPU= 45.724
  07:59:22 STEP 1389 H=1389:00 +CPU= 70.723
  08:00:09 STEP 1390 H=1390:00 +CPU= 47.302
  08:00:57 STEP 1391 H=1391:00 +CPU= 47.251
  08:02:29 STEP 1392 H=1392:00 +CPU= 90.653
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001392
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001392
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001380
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0965_1998050100_123_967_12184609_0_r1066025543_57.zip
Uploading the intermediate file: upload_file_57.zip
  08:03:15 STEP 1393 H=1393:00 +CPU= 46.540
  08:04:04 STEP 1394 H=1394:00 +CPU= 48.029
  08:05:14 STEP 1395 H=1395:00 +CPU= 69.275
  08:06:00 STEP 1396 H=1396:00 +CPU= 46.247
  08:06:49 STEP 1397 H=1397:00 +CPU= 49.060
  08:08:04 STEP 1398 H=1398:00 +CPU= 74.574
  08:08:50 STEP 1399 H=1399:00 +CPU= 45.449
  08:09:36 STEP 1400 H=1400:00 +CPU= 46.129
  08:10:47 STEP 1401 H=1401:00 +CPU= 70.071
  08:11:33 STEP 1402 H=1402:00 +CPU= 45.968
  08:12:16 STEP 1403 H=1403:00 +CPU= 43.425
  08:13:36 STEP 1404 H=1404:00 +CPU= 79.014
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001404
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001404
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001404
  08:14:20 STEP 1405 H=1405:00 +CPU= 43.753
  08:15:07 STEP 1406 H=1406:00 +CPU= 46.779
  08:16:18 STEP 1407 H=1407:00 +CPU= 71.420
  08:17:06 STEP 1408 H=1408:00 +CPU= 47.905
  08:17:52 STEP 1409 H=1409:00 +CPU= 45.608
  08:19:04 STEP 1410 H=1410:00 +CPU= 71.628
  08:19:48 STEP 1411 H=1411:00 +CPU= 43.900
  08:20:34 STEP 1412 H=1412:00 +CPU= 46.178
  08:21:47 STEP 1413 H=1413:00 +CPU= 72.237
  08:22:34 STEP 1414 H=1414:00 +CPU= 47.025
  08:23:22 STEP 1415 H=1415:00 +CPU= 46.416
  08:24:47 STEP 1416 H=1416:00 +CPU= 85.009
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001416
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001416
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001404
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0965_1998050100_123_967_12184609_0_r1066025543_58.zip
Uploading the intermediate file: upload_file_58.zip
  08:25:34 STEP 1417 H=1417:00 +CPU= 46.265
  08:26:24 STEP 1418 H=1418:00 +CPU= 47.805
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78345.959] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 4031MB (heap), 4415MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78346.002] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78346.002] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78346.002] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78346.002] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78346.002] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 4031 MB (maxheap), 4415 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78346.002] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78346.002] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78346.002] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78346.002] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78346.002] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78346.002] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78346.002] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78346.002] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78346.002] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78346.002] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78346.002] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :            RADDRV 
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78346.002] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :             RADINTG 
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78346.002] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :              >OMP-RADINTG-RADLSW       (1210) 
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78346.002] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :               RADIATION_SCHEME 
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78346.002] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                radiation_interface:radiation 
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78346.002] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                 radiation_mcica_lw:solver_mcica_lw 
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78346.002] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                  radiation_cloud_generator:cloud_generator 
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082643:1672842403:78346.002] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                   RANDOM_NUMBERS_MIX:INITIALIZE_RANDOM_NUMBERS 
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082644:1672842404:78347.003] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:Joesserv1:1:1:4061123:4061123] [20230104:082644:1672842404:78347.003] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CE916B  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000081FFF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC9090  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000008F151E  random_numbers_mi         177  random_numbers_mix.F90
oifs_43r3_model.e  000000000196F0E6  radiation_cloud_g         176  radiation_cloud_generator.F90
oifs_43r3_model.e  0000000001972EE7  radiation_mcica_l         179  radiation_mcica_lw.F90
oifs_43r3_model.e  0000000001862B6D  radiation_interfa         387  radiation_interface.F90
oifs_43r3_model.e  00000000012D30E5  radiation_scheme_         484  radiation_scheme.F90
oifs_43r3_model.e  000000000129A415  radintg_                 1455  radintg.F90
oifs_43r3_model.e  0000000001270124  raddrv_                   537  raddrv.F90
oifs_43r3_model.e  0000000000BFD839  gp_model_                 482  gp_model.F90
oifs_43r3_model.e  00000000012E9482  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BBC1CE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  000000000057A664  stepo_                    327  stepo.F90
oifs_43r3_model.e  000000000055DEEC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1998050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0965
(argv4) batchid: 967
(argv5) wuid: 12184609
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/17
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/17/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/17/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_672a8ec8566a256876feb4dc035d9967 to: /var/lib/boinc-client/slots/17/oifs_43r3_ps_0965_1998050100_123_967_12184609.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/17/oifs_43r3_ps_0965_1998050100_123_967_12184609.zip
ic_ancil_file: ic_ancil_12184609
ifsdata_file: ifsdata_12184609
climate_data_file: clim_data_12184609
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_7d11cedb94db46f5f760a2297b54237f to: /var/lib/boinc-client/slots/17/ic_ancil_12184609.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/17/ic_ancil_12184609.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_42b7526bc177db75b4dbf39f0be58973 to: /var/lib/boinc-client/slots/17/ifsdata/ifsdata_12184609.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/17/ifsdata/ifsdata_12184609.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/17/159l_2/clim_data_12184609.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/17/159l_2/clim_data_12184609.zip
Checking for progress XML file: /var/lib/boinc-client/slots/17/progress_file_12184609.xml
Opened progress file ok : /var/lib/boinc-client/slots/17/progress_file_12184609.xml
-- Model is restarting --
Adjusting last_iter, 1419, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/17/progress_file_12184609.xml
last_cpu_time: 77994
upload_file_number: 59
last_iter: 1415
last_upload: 5097600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0965_1998050100_123_967_12184609_0_r1066025543
The child process has been launched with process id: 48131
Executing the command: /var/lib/boinc-client/slots/17/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Joesserv1:1:1:48131:48131] [20230104:082728:1672842448:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  08:28:50 STEP 1416 H=1416:00 +CPU= 75.863
  08:29:32 STEP 1417 H=1417:00 +CPU= 42.436
  08:30:15 STEP 1418 H=1418:00 +CPU= 41.892
  08:31:20 STEP 1419 H=1419:00 +CPU= 62.798
  08:32:05 STEP 1420 H=1420:00 +CPU= 45.630
  08:32:46 STEP 1421 H=1421:00 +CPU= 40.979
  08:33:55 STEP 1422 H=1422:00 +CPU= 68.235
  08:34:37 STEP 1423 H=1423:00 +CPU= 41.546
  08:35:21 STEP 1424 H=1424:00 +CPU= 44.214
  08:36:31 STEP 1425 H=1425:00 +CPU= 69.888
  08:37:15 STEP 1426 H=1426:00 +CPU= 44.240
  08:38:01 STEP 1427 H=1427:00 +CPU= 45.274
  08:39:21 STEP 1428 H=1428:00 +CPU= 78.847
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001428
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001428
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001428
  08:40:05 STEP 1429 H=1429:00 +CPU= 44.398
  08:40:51 STEP 1430 H=1430:00 +CPU= 45.062
  08:42:01 STEP 1431 H=1431:00 +CPU= 70.531
  08:42:44 STEP 1432 H=1432:00 +CPU= 42.930
  08:43:27 STEP 1433 H=1433:00 +CPU= 43.026
  08:44:38 STEP 1434 H=1434:00 +CPU= 70.609
  08:45:23 STEP 1435 H=1435:00 +CPU= 44.556
  08:46:10 STEP 1436 H=1436:00 +CPU= 46.702
  08:47:19 STEP 1437 H=1437:00 +CPU= 69.091
  08:48:03 STEP 1438 H=1438:00 +CPU= 43.964
  08:48:46 STEP 1439 H=1439:00 +CPU= 43.463
  08:50:09 STEP 1440 H=1440:00 +CPU= 82.012
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001440
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001440
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001428
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0965_1998050100_123_967_12184609_0_r1066025543_59.zip
Uploading the intermediate file: upload_file_59.zip
  08:50:53 STEP 1441 H=1441:00 +CPU= 43.875
  08:51:35 STEP 1442 H=1442:00 +CPU= 42.784
  08:52:41 STEP 1443 H=1443:00 +CPU= 65.751
  08:53:26 STEP 1444 H=1444:00 +CPU= 44.693
  08:54:07 STEP 1445 H=1445:00 +CPU= 41.273
  08:55:17 STEP 1446 H=1446:00 +CPU= 69.596
  08:56:01 STEP 1447 H=1447:00 +CPU= 43.679
  08:56:44 STEP 1448 H=1448:00 +CPU= 43.443
  08:57:50 STEP 1449 H=1449:00 +CPU= 65.145
  08:58:35 STEP 1450 H=1450:00 +CPU= 45.538
  08:59:18 STEP 1451 H=1451:00 +CPU= 42.736
  09:00:33 STEP 1452 H=1452:00 +CPU= 74.263
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001452
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001452
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001452
  09:01:17 STEP 1453 H=1453:00 +CPU= 43.817
  09:02:01 STEP 1454 H=1454:00 +CPU= 44.309
  09:03:10 STEP 1455 H=1455:00 +CPU= 68.515
  09:03:54 STEP 1456 H=1456:00 +CPU= 44.818
  09:04:36 STEP 1457 H=1457:00 +CPU= 41.179
  09:05:44 STEP 1458 H=1458:00 +CPU= 67.846
  09:06:24 STEP 1459 H=1459:00 +CPU= 39.991
  09:07:08 STEP 1460 H=1460:00 +CPU= 43.846
  09:08:13 STEP 1461 H=1461:00 +CPU= 65.056
  09:08:58 STEP 1462 H=1462:00 +CPU= 44.521
  09:09:44 STEP 1463 H=1463:00 +CPU= 45.957
  09:11:02 STEP 1464 H=1464:00 +CPU= 78.081
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001464
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001464
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001452
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0965_1998050100_123_967_12184609_0_r1066025543_60.zip
Uploading the intermediate file: upload_file_60.zip
  09:11:45 STEP 1465 H=1465:00 +CPU= 42.085
  09:12:27 STEP 1466 H=1466:00 +CPU= 42.358
  09:13:33 STEP 1467 H=1467:00 +CPU= 65.950
  09:14:16 STEP 1468 H=1468:00 +CPU= 42.275
  09:14:58 STEP 1469 H=1469:00 +CPU= 41.900
  09:16:08 STEP 1470 H=1470:00 +CPU= 69.887
  09:16:51 STEP 1471 H=1471:00 +CPU= 43.248
  09:17:35 STEP 1472 H=1472:00 +CPU= 43.954
  09:18:43 STEP 1473 H=1473:00 +CPU= 67.848
  09:19:29 STEP 1474 H=1474:00 +CPU= 45.581
  09:20:12 STEP 1475 H=1475:00 +CPU= 43.057
  09:21:30 STEP 1476 H=1476:00 +CPU= 78.117
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001476
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001476
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001476
  09:22:13 STEP 1477 H=1477:00 +CPU= 42.734
  09:23:00 STEP 1478 H=1478:00 +CPU= 46.895
  09:24:10 STEP 1479 H=1479:00 +CPU= 69.422
  09:24:54 STEP 1480 H=1480:00 +CPU= 44.046
  09:25:37 STEP 1481 H=1481:00 +CPU= 43.213
  09:26:51 STEP 1482 H=1482:00 +CPU= 73.908
  09:27:35 STEP 1483 H=1483:00 +CPU= 43.450
  09:28:19 STEP 1484 H=1484:00 +CPU= 43.870
  09:29:24 STEP 1485 H=1485:00 +CPU= 64.986
  09:30:09 STEP 1486 H=1486:00 +CPU= 44.566
  09:30:53 STEP 1487 H=1487:00 +CPU= 44.129
  09:32:15 STEP 1488 H=1488:00 +CPU= 81.616
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001488
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001488
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001476
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0965_1998050100_123_967_12184609_0_r1066025543_61.zip
Uploading the intermediate file: upload_file_61.zip
  09:32:56 STEP 1489 H=1489:00 +CPU= 40.916
  09:33:40 STEP 1490 H=1490:00 +CPU= 44.580
  09:34:50 STEP 1491 H=1491:00 +CPU= 69.522
  09:35:34 STEP 1492 H=1492:00 +CPU= 44.012
  09:36:18 STEP 1493 H=1493:00 +CPU= 43.717
  09:37:27 STEP 1494 H=1494:00 +CPU= 68.864
  09:38:09 STEP 1495 H=1495:00 +CPU= 41.859
  09:38:55 STEP 1496 H=1496:00 +CPU= 45.576
  09:40:03 STEP 1497 H=1497:00 +CPU= 67.412
  09:40:46 STEP 1498 H=1498:00 +CPU= 43.540
  09:41:29 STEP 1499 H=1499:00 +CPU= 42.690
  09:42:49 STEP 1500 H=1500:00 +CPU= 75.133
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001500
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001500
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001500
  09:43:33 STEP 1501 H=1501:00 +CPU= 42.006
  09:44:15 STEP 1502 H=1502:00 +CPU= 41.761
  09:45:21 STEP 1503 H=1503:00 +CPU= 64.984
  09:46:02 STEP 1504 H=1504:00 +CPU= 41.426
  09:46:44 STEP 1505 H=1505:00 +CPU= 41.075
  09:47:54 STEP 1506 H=1506:00 +CPU= 68.719
  09:48:37 STEP 1507 H=1507:00 +CPU= 42.868
  09:49:21 STEP 1508 H=1508:00 +CPU= 43.875
  09:50:29 STEP 1509 H=1509:00 +CPU= 67.086
  09:51:12 STEP 1510 H=1510:00 +CPU= 41.982
  09:51:54 STEP 1511 H=1511:00 +CPU= 41.851
  09:53:11 STEP 1512 H=1512:00 +CPU= 77.521
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001512
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001512
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001500
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0965_1998050100_123_967_12184609_0_r1066025543_62.zip
Uploading the intermediate file: upload_file_62.zip
  09:53:51 STEP 1513 H=1513:00 +CPU= 39.397
  09:54:33 STEP 1514 H=1514:00 +CPU= 42.273
  09:55:38 STEP 1515 H=1515:00 +CPU= 64.987
  09:56:21 STEP 1516 H=1516:00 +CPU= 42.557
  09:57:02 STEP 1517 H=1517:00 +CPU= 40.987
  09:58:10 STEP 1518 H=1518:00 +CPU= 68.072
  09:58:51 STEP 1519 H=1519:00 +CPU= 40.348
  09:59:32 STEP 1520 H=1520:00 +CPU= 41.624
  10:00:38 STEP 1521 H=1521:00 +CPU= 65.309
  10:01:20 STEP 1522 H=1522:00 +CPU= 42.371
  10:02:02 STEP 1523 H=1523:00 +CPU= 41.504
  10:03:18 STEP 1524 H=1524:00 +CPU= 75.688
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001524
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001524
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001524
  10:03:59 STEP 1525 H=1525:00 +CPU= 41.300
  10:04:42 STEP 1526 H=1526:00 +CPU= 42.408
  10:05:49 STEP 1527 H=1527:00 +CPU= 67.032
  10:06:33 STEP 1528 H=1528:00 +CPU= 43.439
  10:07:14 STEP 1529 H=1529:00 +CPU= 41.104
  10:08:20 STEP 1530 H=1530:00 +CPU= 65.759
  10:09:01 STEP 1531 H=1531:00 +CPU= 41.151
  10:09:44 STEP 1532 H=1532:00 +CPU= 42.818
  10:10:49 STEP 1533 H=1533:00 +CPU= 65.193
  10:11:32 STEP 1534 H=1534:00 +CPU= 42.314
  10:12:14 STEP 1535 H=1535:00 +CPU= 42.463
  10:13:33 STEP 1536 H=1536:00 +CPU= 78.080
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001536
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001536
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMGGhq0f+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMSHhq0f+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12184609/ICMUAhq0f+001524
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0965_1998050100_123_967_12184609_0_r1066025543_63.zip
Uploading the intermediate file: upload_file_63.zip
  10:14:13 STEP 1537 H=1537:00 +CPU= 40.083
  10:14:56 STEP 1538 H=1538:00 +CPU= 42.456
  10:16:00 STEP 1539 H=1539:00 +CPU= 64.275
  10:16:43 STEP 1540 H=1540:00 +CPU= 42.972
  10:17:25 STEP 1541 H=1541:00 +CPU= 41.901
  10:18:34 STEP 1542 H=1542:00 +CPU= 68.774
  10:19:18 STEP 1543 H=1543:00 +CPU= 43.557
  10:20:01 STEP 1544 H=1544:00 +CPU= 42.592
  10:21:08 STEP 1545 H=1545:00 +CPU= 67.104
  10:21:52 STEP 1546 H=1546:00 +CPU= 43.605
  10:22:34 STEP 1547 H=1547:00 +CPU= 42.775
  10:23:47 STEP 1548 H=1548:00 +CPU= 72.980
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMGGhq0f+001548
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMSHhq0f+001548
Moving to projects directory: /var/lib/boinc-client/slots/17/ICMUAhq0f+001548
  10:24:29 STEP 1549 H=1549:00 +CPU= 41.534
double free or corruption (out)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:07:47 1526610 22269870 oifs_43r3_ps_0965_1998050100_123_967_12184609_0 4,320,000 66,795 0.0155
09 May 2023 16:07:38 1526610 22269870 oifs_43r3_ps_0965_1998050100_123_967_12184609_0 3,456,000 53,483 0.0155
09 May 2023 16:07:32 1526610 22269870 oifs_43r3_ps_0965_1998050100_123_967_12184609_0 2,592,000 40,106 0.0155
09 May 2023 16:07:22 1526610 22269870 oifs_43r3_ps_0965_1998050100_123_967_12184609_0 1,728,000 26,626 0.0154
09 May 2023 16:07:14 1526610 22269870 oifs_43r3_ps_0965_1998050100_123_967_12184609_0 864,000 13,388 0.0155


©2024 climateprediction.net