Name | oifs_43r3_bl_a42j_2016092300_20_1017_12287102_0 |
Workunit | 12287102 |
Created | 7 Jun 2024, 18:28:16 UTC |
Sent | 7 Jun 2024, 18:36:33 UTC |
Report deadline | 6 Aug 2024, 18:36:33 UTC |
Received | 8 Jun 2024, 5:34:17 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 0 (0x00000000) |
Computer ID | 1499708 |
Run time | 7 hours 46 min |
CPU time | 7 hours 42 min 46 sec |
Validate state | Invalid |
Credit | 1,976.32 |
Device peak FLOPS | 6.71 GFLOPS |
Application version | OpenIFS 43r3 Baroclinic Lifecycle v1.13 x86_64-pc-linux-gnu |
Peak working set size | 5,360.88 MB |
Peak swap size | 5,980.80 MB |
Peak disk usage | 1,346.18 MB |
Stderr | <core_client_version>7.24.1</core_client_version> <![CDATA[ <stderr_txt> H= 265:45 +CPU= 17.404 03:57:51 STEP 1064 H= 266:00 +CPU= 17.810 03:58:08 STEP 1065 H= 266:15 +CPU= 17.078 03:58:26 STEP 1066 H= 266:30 +CPU= 17.248 03:58:45 STEP 1067 H= 266:45 +CPU= 17.446 03:59:08 STEP 1068 H= 267:00 +CPU= 22.261 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001068 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001068 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001068 03:59:26 STEP 1069 H= 267:15 +CPU= 16.979 03:59:44 STEP 1070 H= 267:30 +CPU= 17.055 04:00:02 STEP 1071 H= 267:45 +CPU= 17.339 04:00:21 STEP 1072 H= 268:00 +CPU= 18.107 04:00:40 STEP 1073 H= 268:15 +CPU= 17.298 04:00:58 STEP 1074 H= 268:30 +CPU= 17.259 04:01:17 STEP 1075 H= 268:45 +CPU= 17.631 04:01:36 STEP 1076 H= 269:00 +CPU= 18.330 04:01:55 STEP 1077 H= 269:15 +CPU= 17.384 04:02:13 STEP 1078 H= 269:30 +CPU= 17.185 04:02:31 STEP 1079 H= 269:45 +CPU= 17.117 04:02:54 STEP 1080 H= 270:00 +CPU= 22.158 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001080 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001080 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001080 04:03:12 STEP 1081 H= 270:15 +CPU= 17.382 04:03:31 STEP 1082 H= 270:30 +CPU= 17.397 04:03:49 STEP 1083 H= 270:45 +CPU= 17.545 04:04:08 STEP 1084 H= 271:00 +CPU= 17.714 04:04:26 STEP 1085 H= 271:15 +CPU= 17.414 04:04:44 STEP 1086 H= 271:30 +CPU= 17.200 04:05:02 STEP 1087 H= 271:45 +CPU= 16.938 04:05:20 STEP 1088 H= 272:00 +CPU= 17.606 04:05:39 STEP 1089 H= 272:15 +CPU= 17.239 04:05:57 STEP 1090 H= 272:30 +CPU= 17.453 04:06:16 STEP 1091 H= 272:45 +CPU= 17.536 04:06:39 STEP 1092 H= 273:00 +CPU= 22.028 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001092 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001092 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001092 04:06:57 STEP 1093 H= 273:15 +CPU= 16.975 04:07:15 STEP 1094 H= 273:30 +CPU= 17.069 04:07:32 STEP 1095 H= 273:45 +CPU= 17.280 04:07:51 STEP 1096 H= 274:00 +CPU= 17.424 04:08:08 STEP 1097 H= 274:15 +CPU= 17.036 04:08:27 STEP 1098 H= 274:30 +CPU= 16.944 04:08:45 STEP 1099 H= 274:45 +CPU= 17.215 04:09:03 STEP 1100 H= 275:00 +CPU= 17.707 04:09:22 STEP 1101 H= 275:15 +CPU= 17.403 04:09:40 STEP 1102 H= 275:30 +CPU= 17.199 04:09:58 STEP 1103 H= 275:45 +CPU= 17.347 04:10:24 STEP 1104 H= 276:00 +CPU= 24.339 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001104 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001104 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001104 04:10:42 STEP 1105 H= 276:15 +CPU= 17.337 04:11:01 STEP 1106 H= 276:30 +CPU= 17.485 04:11:19 STEP 1107 H= 276:45 +CPU= 16.923 04:11:37 STEP 1108 H= 277:00 +CPU= 17.589 04:11:55 STEP 1109 H= 277:15 +CPU= 17.380 04:12:13 STEP 1110 H= 277:30 +CPU= 17.410 04:12:31 STEP 1111 H= 277:45 +CPU= 16.965 04:12:49 STEP 1112 H= 278:00 +CPU= 17.528 04:13:07 STEP 1113 H= 278:15 +CPU= 17.249 04:13:26 STEP 1114 H= 278:30 +CPU= 17.365 04:13:44 STEP 1115 H= 278:45 +CPU= 17.304 04:14:08 STEP 1116 H= 279:00 +CPU= 22.296 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001116 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001116 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001116 04:14:28 STEP 1117 H= 279:15 +CPU= 17.706 04:14:46 STEP 1118 H= 279:30 +CPU= 17.566 04:15:04 STEP 1119 H= 279:45 +CPU= 16.936 04:15:23 STEP 1120 H= 280:00 +CPU= 17.673 04:15:41 STEP 1121 H= 280:15 +CPU= 17.220 Suspend request received from the BOINC client, suspending the child process Resuming the child process 04:16:19 STEP 1122 H= 280:30 +CPU= 16.895 04:16:37 STEP 1123 H= 280:45 +CPU= 17.108 04:16:56 STEP 1124 H= 281:00 +CPU= 17.580 04:17:15 STEP 1125 H= 281:15 +CPU= 17.515 04:17:33 STEP 1126 H= 281:30 +CPU= 17.646 04:17:51 STEP 1127 H= 281:45 +CPU= 17.189 04:18:14 STEP 1128 H= 282:00 +CPU= 21.925 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001128 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001128 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001128 04:18:32 STEP 1129 H= 282:15 +CPU= 16.897 04:18:50 STEP 1130 H= 282:30 +CPU= 16.999 04:19:08 STEP 1131 H= 282:45 +CPU= 17.751 04:19:27 STEP 1132 H= 283:00 +CPU= 17.586 04:19:45 STEP 1133 H= 283:15 +CPU= 17.375 04:20:03 STEP 1134 H= 283:30 +CPU= 17.198 Suspend request received from the BOINC client, suspending the child process Resuming the child process 04:20:41 STEP 1135 H= 283:45 +CPU= 16.705 04:21:00 STEP 1136 H= 284:00 +CPU= 17.394 04:21:18 STEP 1137 H= 284:15 +CPU= 17.709 04:21:36 STEP 1138 H= 284:30 +CPU= 17.150 04:21:54 STEP 1139 H= 284:45 +CPU= 17.263 04:22:18 STEP 1140 H= 285:00 +CPU= 21.992 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001140 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001140 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001140 04:22:36 STEP 1141 H= 285:15 +CPU= 17.064 04:22:54 STEP 1142 H= 285:30 +CPU= 17.058 04:23:12 STEP 1143 H= 285:45 +CPU= 17.397 04:23:31 STEP 1144 H= 286:00 +CPU= 17.736 04:23:49 STEP 1145 H= 286:15 +CPU= 17.180 04:24:07 STEP 1146 H= 286:30 +CPU= 17.491 04:24:25 STEP 1147 H= 286:45 +CPU= 16.834 04:24:44 STEP 1148 H= 287:00 +CPU= 17.697 04:25:02 STEP 1149 H= 287:15 +CPU= 17.055 04:25:21 STEP 1150 H= 287:30 +CPU= 17.164 04:25:40 STEP 1151 H= 287:45 +CPU= 17.013 04:26:06 STEP 1152 H= 288:00 +CPU= 24.359 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001152 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001152 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001152 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001056 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001056 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001056 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001068 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001068 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001068 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001080 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001080 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001080 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001092 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001092 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001092 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001104 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001104 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001104 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001116 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001116 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001116 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001128 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001128 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001128 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001140 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001140 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001140 Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a42j_2016092300_20_1017_12287102_0_r2102166819_11.zip Uploading the intermediate file: upload_file_11.zip 04:26:25 STEP 1153 H= 288:15 +CPU= 17.710 04:26:44 STEP 1154 H= 288:30 +CPU= 17.754 04:27:02 STEP 1155 H= 288:45 +CPU= 17.312 04:27:20 STEP 1156 H= 289:00 +CPU= 17.593 04:27:38 STEP 1157 H= 289:15 +CPU= 17.282 04:27:56 STEP 1158 H= 289:30 +CPU= 16.931 04:28:15 STEP 1159 H= 289:45 +CPU= 17.584 04:28:33 STEP 1160 H= 290:00 +CPU= 17.638 04:28:52 STEP 1161 H= 290:15 +CPU= 17.187 04:29:09 STEP 1162 H= 290:30 +CPU= 17.007 04:29:28 STEP 1163 H= 290:45 +CPU= 17.386 04:29:51 STEP 1164 H= 291:00 +CPU= 21.800 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001164 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001164 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001164 04:30:10 STEP 1165 H= 291:15 +CPU= 17.458 04:30:28 STEP 1166 H= 291:30 +CPU= 17.538 04:30:46 STEP 1167 H= 291:45 +CPU= 17.025 Suspend request received from the BOINC client, suspending the child process Resuming the child process 04:31:25 STEP 1168 H= 292:00 +CPU= 17.338 04:31:43 STEP 1169 H= 292:15 +CPU= 17.063 04:32:01 STEP 1170 H= 292:30 +CPU= 17.269 04:32:20 STEP 1171 H= 292:45 +CPU= 17.712 04:32:39 STEP 1172 H= 293:00 +CPU= 17.801 04:32:58 STEP 1173 H= 293:15 +CPU= 17.294 04:33:16 STEP 1174 H= 293:30 +CPU= 17.098 04:33:34 STEP 1175 H= 293:45 +CPU= 17.215 04:33:57 STEP 1176 H= 294:00 +CPU= 22.137 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001176 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001176 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001176 04:34:16 STEP 1177 H= 294:15 +CPU= 17.350 04:34:34 STEP 1178 H= 294:30 +CPU= 17.300 Suspend request received from the BOINC client, suspending the child process Resuming the child process 04:35:13 STEP 1179 H= 294:45 +CPU= 17.213 04:35:32 STEP 1180 H= 295:00 +CPU= 17.718 04:35:50 STEP 1181 H= 295:15 +CPU= 17.287 04:36:09 STEP 1182 H= 295:30 +CPU= 17.147 04:36:27 STEP 1183 H= 295:45 +CPU= 17.351 04:36:46 STEP 1184 H= 296:00 +CPU= 17.665 04:37:05 STEP 1185 H= 296:15 +CPU= 17.866 04:37:23 STEP 1186 H= 296:30 +CPU= 17.449 04:37:41 STEP 1187 H= 296:45 +CPU= 17.379 04:38:04 STEP 1188 H= 297:00 +CPU= 22.030 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001188 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001188 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001188 04:38:22 STEP 1189 H= 297:15 +CPU= 17.081 04:38:41 STEP 1190 H= 297:30 +CPU= 17.511 04:38:59 STEP 1191 H= 297:45 +CPU= 17.007 04:39:18 STEP 1192 H= 298:00 +CPU= 18.032 04:39:36 STEP 1193 H= 298:15 +CPU= 17.396 04:39:54 STEP 1194 H= 298:30 +CPU= 17.275 04:40:13 STEP 1195 H= 298:45 +CPU= 17.568 04:40:32 STEP 1196 H= 299:00 +CPU= 18.341 04:40:51 STEP 1197 H= 299:15 +CPU= 17.575 04:41:09 STEP 1198 H= 299:30 +CPU= 17.371 04:41:28 STEP 1199 H= 299:45 +CPU= 17.516 04:41:53 STEP 1200 H= 300:00 +CPU= 24.596 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001200 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001200 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001200 04:42:12 STEP 1201 H= 300:15 +CPU= 17.607 04:42:30 STEP 1202 H= 300:30 +CPU= 17.246 Suspend request received from the BOINC client, suspending the child process Resuming the child process 04:43:11 STEP 1203 H= 300:45 +CPU= 17.730 04:43:30 STEP 1204 H= 301:00 +CPU= 17.729 04:43:48 STEP 1205 H= 301:15 +CPU= 17.135 04:44:06 STEP 1206 H= 301:30 +CPU= 17.222 04:44:24 STEP 1207 H= 301:45 +CPU= 17.343 04:44:42 STEP 1208 H= 302:00 +CPU= 17.167 04:45:00 STEP 1209 H= 302:15 +CPU= 17.104 04:45:18 STEP 1210 H= 302:30 +CPU= 16.922 Suspend request received from the BOINC client, suspending the child process Resuming the child process 04:45:56 STEP 1211 H= 302:45 +CPU= 16.762 04:46:20 STEP 1212 H= 303:00 +CPU= 22.146 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001212 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001212 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001212 04:46:38 STEP 1213 H= 303:15 +CPU= 17.602 04:46:56 STEP 1214 H= 303:30 +CPU= 17.103 04:47:14 STEP 1215 H= 303:45 +CPU= 17.091 04:47:34 STEP 1216 H= 304:00 +CPU= 18.269 04:47:52 STEP 1217 H= 304:15 +CPU= 17.348 04:48:11 STEP 1218 H= 304:30 +CPU= 17.319 04:48:29 STEP 1219 H= 304:45 +CPU= 17.246 04:48:47 STEP 1220 H= 305:00 +CPU= 17.421 04:49:05 STEP 1221 H= 305:15 +CPU= 16.987 04:49:23 STEP 1222 H= 305:30 +CPU= 16.739 04:49:41 STEP 1223 H= 305:45 +CPU= 17.358 04:50:04 STEP 1224 H= 306:00 +CPU= 22.034 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001224 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001224 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001224 04:50:22 STEP 1225 H= 306:15 +CPU= 16.917 04:50:40 STEP 1226 H= 306:30 +CPU= 17.060 04:50:58 STEP 1227 H= 306:45 +CPU= 17.163 04:51:17 STEP 1228 H= 307:00 +CPU= 17.758 04:51:35 STEP 1229 H= 307:15 +CPU= 17.259 04:51:53 STEP 1230 H= 307:30 +CPU= 17.226 04:52:11 STEP 1231 H= 307:45 +CPU= 17.390 04:52:29 STEP 1232 H= 308:00 +CPU= 17.668 04:52:48 STEP 1233 H= 308:15 +CPU= 16.944 04:53:05 STEP 1234 H= 308:30 +CPU= 16.955 04:53:23 STEP 1235 H= 308:45 +CPU= 17.084 04:53:47 STEP 1236 H= 309:00 +CPU= 22.543 Quit request received from BOINC client, ending the child process >>> Printing last 70 lines from file: NODE.001_01 UPDT RAESHDU = 2000.0 SUECAEC: GLOBAL AVERAGE VOLCANIC SULPHATE FOR (KINDAT,KMINUT) 20160923 1350 9.999999999999998E-005 GPNORM HUMIDITY AVERAGE MINIMUM MAXIMUM AVE 0.414869884524315E-03 0.100000000000000E-07 0.806783543931441E-02 GPNORM LIQUID WATER AVERAGE MINIMUM MAXIMUM AVE 0.112729208553077E-09 0.000000000000000E+00 0.236972297090365E-05 GPNORM ICE WATER AVERAGE MINIMUM MAXIMUM AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00 GPNORM SNOW AVERAGE MINIMUM MAXIMUM AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00 GPNORM RAIN AVERAGE MINIMUM MAXIMUM AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00 GPNORM CLOUD FRACTION AVERAGE MINIMUM MAXIMUM AVE 0.193630184117439E-05 0.000000000000000E+00 0.640927235761519E-01 GPNORM CLW AVERAGE MINIMUM MAXIMUM AVE 0.107208554194127E-09 0.000000000000000E+00 0.268613804126997E-05 GPNORM CIW AVERAGE MINIMUM MAXIMUM AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00 GPNORM CC AVERAGE MINIMUM MAXIMUM AVE 0.193228411779945E-05 0.000000000000000E+00 0.678618325539042E-01 GPNORM RFL AVERAGE MINIMUM MAXIMUM AVE 0.184962139204180E-13 0.000000000000000E+00 0.242660300030703E-08 GPNORM SFL AVERAGE MINIMUM MAXIMUM AVE 0.572868905221956E-13 0.000000000000000E+00 0.213745710735356E-11 GPNORM CRFL AVERAGE MINIMUM MAXIMUM AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00 GPNORM CSFL AVERAGE MINIMUM MAXIMUM AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00 GPNORM PFRC AVERAGE MINIMUM MAXIMUM AVE 0.219780219780221E-02 0.000000000000000E+00 0.100000000000000E+00 NSTEP = 1236 STEPO A00000000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 NSTEP = 1236 SCAN2M_HPOS P IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ICMGGh7zg+001236 MODE=w IO-STREAM CLOSED - ICMGGh7zg+001236 MPI-TASK: 1 - 443425780 BYTES IN 6 RECORDS TRANSFERRED IN 0.0002 SECONDS******** Mbytes/s, TOTAL TIME= 0.0065( 3.1%) NSTEP = 1236 STEPO 0AA000000 IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMSHh7zg+001236 MODE=w IO-STREAM CLOSED - ./ICMSHh7zg+001236 MPI-TASK: 1 - 707399250 BYTES IN 202 RECORDS TRANSFERRED IN 0.0072 SECONDS 98249.9 Mbytes/s, TOTAL TIME= 0.1955( 3.7%) IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+001236 MODE=w IO-STREAM CLOSED - ./ICMUAh7zg+001236 MPI-TASK: 1 - 7094812480 BYTES IN 125 RECORDS TRANSFERRED IN 0.0031 SECONDS******** Mbytes/s, TOTAL TIME= 0.1160( 2.7%) STEPO_FPOS WAS : B00000F00E IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+001236 MODE=a IO-STREAM CLOSED - ./ICMUAh7zg+001236 MPI-TASK: 1 - 10 BYTES IN 2 RECORDS TRANSFERRED IN 0.0001 SECONDS 0.1 Mbytes/s, TOTAL TIME= 0.0033( 3.0%) STEPO_FPOS WAS : V00000000Y IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+001236 MODE=a IO-STREAM CLOSED - ./ICMUAh7zg+001236 MPI-TASK: 1 - 434846051 BYTES IN 4 RECORDS TRANSFERRED IN 0.0002 SECONDS******** Mbytes/s, TOTAL TIME= 0.0046( 4.3%) STEPO_FPOS WAS : T00000000M NSTEP = 1236 STEPO 0AAA00AAA MAXGPFV : MAX. VALUE = 0.000000000000000E+000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 NSTEP = 1236 SCAN2M_HPOS P IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ICMGGh7zg+001236 MODE=a IO-STREAM CLOSED - ICMGGh7zg+001236 MPI-TASK: 1 - 443425780 BYTES IN 7 RECORDS TRANSFERRED IN 0.0004 SECONDS******** Mbytes/s, TOTAL TIME= 0.0081( 4.9%) 04:53:47 STEP 1236 H= 309:00 +CPU= 22.543 NSTEP = 1237 STEPO 0AAA00AAA ------------------------------------------------ CNT0 not found; string returned was: 'STEPO' >>> Printing last 8 lines from file: ifs.stat 04:53:23 A00000000 STEPO 1236 17.165 17.165 18.170 95:32 117:55 0.21868325880962E-07 2GB 0MB 04:53:23 0AA000000 STEPO 1236 0.019 0.019 0.019 95:32 117:55 0.21868325880962E-07 2GB 0MB 04:53:25 FULLPOS-B DYNFPOS 1236 1.007 1.007 1.119 95:33 117:56 0.21868325880962E-07 2GB 0MB 04:53:27 FULLPOS-V DYNFPOS 1236 2.291 2.291 2.359 95:35 117:59 0.21868325880962E-07 2GB 0MB 04:53:27 FULLPOS-T DYNFPOS 1236 0.452 0.452 0.496 95:35 117:59 0.21868325880962E-07 2GB 0MB 04:53:28 0AAA00AAA STEPO 1236 0.448 0.448 0.456 95:36 118:00 0.21868325880962E-07 2GB 0MB 04:53:47 0AAA00AAA STEPO 1237 18.245 18.245 19.045 95:54 118:19 0.21868325880962E-07 2GB 0MB ------------------------------------------------ >>> Printing last 11 lines from file: rcf CSTEP = " 1200", CTIME = "00121200 ", NSTEPLPP = 201, 202, 49, 228226, 228227, 2*0, 1188, 2*0, IPRGPNSRES = 1, IPRGPEWRES = 1, IPRTRWRES = 1, IPRTRVRES = 1, GMASS0 = 0.000000000000000E+000, GMASSI = 0.000000000000000E+000 / ------------------------------------------------ >>> Printing last 8 lines from file: /var/lib/boinc/slots/11/progress_file_12287102.xml <running_values> <last_cpu_time>23275.600000</last_cpu_time> <upload_file_number>12</upload_file_number> <last_iter>1236</last_iter> <last_upload>1036800</last_upload> <model_completed>0</model_completed> </running_values> ------------------------------------------------ ..Failed, model did not complete successfully (argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu (argv1) start_date: 2016092300 (argv2) exptid: h7zg (argv3) unique_member_id: a42j (argv4) batchid: 1017 (argv5) wuid: 12287102 (argv6) fclen: 20 (argv7) app_name: oifs_43r3_bl (argv8) nthreads: 1 Working directory is: /var/lib/boinc/slots/11 Project directory is: /var/lib/boinc/projects/climateprediction.net/ app name: oifs_43r3_bl version: 1.13 Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102 ..mkdir for temp folder for results failed Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/11/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc/slots/11/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_7614a5fb62294bb1333bb64f06aeaf80 to: /var/lib/boinc/slots/11/oifs_43r3_bl_a42j_2016092300_20_1017_12287102.zip Unzipping the namelist zip file: /var/lib/boinc/slots/11/oifs_43r3_bl_a42j_2016092300_20_1017_12287102.zip ic_ancil_file: ic_ancil_12287102 ifsdata_file: ifsdata_12287102 climate_data_file: clim_data_12287102 horiz_resolution: 159 vert_resolution: 91 grid_type: l_2 upload_interval: 96 utstep: 900 nfrres: restart dump frequency (steps) 48 Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc/slots/11/ic_ancil_12287102.zip Unzipping the IC ancils zip file: /var/lib/boinc/slots/11/ic_ancil_12287102.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_ebbe5ddfdecae6e11b10441d1351a441 to: /var/lib/boinc/slots/11/ifsdata/ifsdata_12287102.zip Unzipping the ifsdata_zip file: /var/lib/boinc/slots/11/ifsdata/ifsdata_12287102.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/11/159l_2/clim_data_12287102.zip Unzipping the climate data zip file: /var/lib/boinc/slots/11/159l_2/clim_data_12287102.zip Checking for progress XML file: /var/lib/boinc/slots/11/progress_file_12287102.xml Opened progress file ok : /var/lib/boinc/slots/11/progress_file_12287102.xml -- Model is restarting -- Adjusting last_iter, 1236, to previous model restart step. Creating progress file: /var/lib/boinc/slots/11/progress_file_12287102.xml last_cpu_time: 23275 upload_file_number: 12 last_iter: 1201 last_upload: 1036800 model_completed: 0 total_length_of_simulation: 1728000 result_base_name: oifs_43r3_bl_a42j_2016092300_20_1017_12287102_0_r2102166819 The child process has been launched with process id: 30423 Executing the command: /var/lib/boinc/slots/11/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440 [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil)) [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil)) [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil)) [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil)) [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil)) [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil)) [EC_DRHOOK:etam-komp:1:1:30423:30423] [20240608:045452:1717815292:0.001] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 04:56:15 STEP 1200 H= 300:00 +CPU= 18.987 Suspend request received from the BOINC client, suspending the child process Resuming the child process 04:56:53 STEP 1201 H= 300:15 +CPU= 16.824 Suspend request received from the BOINC client, suspending the child process Resuming the child process 04:57:30 STEP 1202 H= 300:30 +CPU= 16.524 04:57:50 STEP 1203 H= 300:45 +CPU= 18.897 04:58:10 STEP 1204 H= 301:00 +CPU= 19.141 04:58:31 STEP 1205 H= 301:15 +CPU= 19.316 Suspend request received from the BOINC client, suspending the child process Resuming the child process 04:59:11 STEP 1206 H= 301:30 +CPU= 19.003 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:00:13 STEP 1207 H= 301:45 +CPU= 18.470 05:00:32 STEP 1208 H= 302:00 +CPU= 18.509 05:00:50 STEP 1209 H= 302:15 +CPU= 17.547 05:01:09 STEP 1210 H= 302:30 +CPU= 17.835 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:01:48 STEP 1211 H= 302:45 +CPU= 17.514 05:02:12 STEP 1212 H= 303:00 +CPU= 22.403 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001212 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001212 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001212 05:02:30 STEP 1213 H= 303:15 +CPU= 18.155 05:02:49 STEP 1214 H= 303:30 +CPU= 17.667 05:03:08 STEP 1215 H= 303:45 +CPU= 18.038 05:03:28 STEP 1216 H= 304:00 +CPU= 18.482 05:03:46 STEP 1217 H= 304:15 +CPU= 17.400 05:04:04 STEP 1218 H= 304:30 +CPU= 17.865 05:04:23 STEP 1219 H= 304:45 +CPU= 18.050 05:04:42 STEP 1220 H= 305:00 +CPU= 18.428 05:05:01 STEP 1221 H= 305:15 +CPU= 17.465 05:05:19 STEP 1222 H= 305:30 +CPU= 17.647 05:05:37 STEP 1223 H= 305:45 +CPU= 17.645 05:06:01 STEP 1224 H= 306:00 +CPU= 22.385 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001224 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001224 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001224 05:06:20 STEP 1225 H= 306:15 +CPU= 17.897 05:06:39 STEP 1226 H= 306:30 +CPU= 18.154 05:06:58 STEP 1227 H= 306:45 +CPU= 18.108 05:07:17 STEP 1228 H= 307:00 +CPU= 18.183 05:07:36 STEP 1229 H= 307:15 +CPU= 17.773 05:07:55 STEP 1230 H= 307:30 +CPU= 17.722 05:08:13 STEP 1231 H= 307:45 +CPU= 17.773 05:08:33 STEP 1232 H= 308:00 +CPU= 18.295 05:08:52 STEP 1233 H= 308:15 +CPU= 17.488 05:09:10 STEP 1234 H= 308:30 +CPU= 17.578 05:09:29 STEP 1235 H= 308:45 +CPU= 17.945 05:09:53 STEP 1236 H= 309:00 +CPU= 23.251 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001236 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001236 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001236 05:10:12 STEP 1237 H= 309:15 +CPU= 17.816 05:10:31 STEP 1238 H= 309:30 +CPU= 17.667 05:10:49 STEP 1239 H= 309:45 +CPU= 17.607 05:11:08 STEP 1240 H= 310:00 +CPU= 18.102 05:11:27 STEP 1241 H= 310:15 +CPU= 17.689 05:11:46 STEP 1242 H= 310:30 +CPU= 17.844 05:12:04 STEP 1243 H= 310:45 +CPU= 17.740 05:12:24 STEP 1244 H= 311:00 +CPU= 18.242 05:12:42 STEP 1245 H= 311:15 +CPU= 17.587 05:13:02 STEP 1246 H= 311:30 +CPU= 18.363 05:13:21 STEP 1247 H= 311:45 +CPU= 17.906 05:13:47 STEP 1248 H= 312:00 +CPU= 24.982 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001248 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001248 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001248 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001152 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001152 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001152 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001164 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001164 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001164 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001176 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001176 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001176 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001188 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001188 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001188 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001200 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001200 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001200 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001212 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001212 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001212 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001224 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001224 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001224 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001236 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001236 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001236 Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a42j_2016092300_20_1017_12287102_0_r2102166819_12.zip Uploading the intermediate file: upload_file_12.zip 05:14:07 STEP 1249 H= 312:15 +CPU= 17.670 05:14:27 STEP 1250 H= 312:30 +CPU= 18.247 05:14:45 STEP 1251 H= 312:45 +CPU= 17.630 05:15:04 STEP 1252 H= 313:00 +CPU= 17.994 05:15:23 STEP 1253 H= 313:15 +CPU= 17.384 05:15:41 STEP 1254 H= 313:30 +CPU= 18.060 05:16:00 STEP 1255 H= 313:45 +CPU= 17.980 05:16:19 STEP 1256 H= 314:00 +CPU= 18.320 05:16:38 STEP 1257 H= 314:15 +CPU= 17.658 05:16:57 STEP 1258 H= 314:30 +CPU= 17.635 05:17:15 STEP 1259 H= 314:45 +CPU= 17.646 05:17:39 STEP 1260 H= 315:00 +CPU= 22.388 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001260 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001260 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001260 05:17:57 STEP 1261 H= 315:15 +CPU= 17.887 05:18:16 STEP 1262 H= 315:30 +CPU= 17.655 05:18:34 STEP 1263 H= 315:45 +CPU= 17.668 05:18:53 STEP 1264 H= 316:00 +CPU= 18.117 05:19:12 STEP 1265 H= 316:15 +CPU= 17.680 05:19:31 STEP 1266 H= 316:30 +CPU= 17.910 05:19:50 STEP 1267 H= 316:45 +CPU= 17.671 05:20:09 STEP 1268 H= 317:00 +CPU= 17.952 05:20:27 STEP 1269 H= 317:15 +CPU= 17.669 05:20:46 STEP 1270 H= 317:30 +CPU= 17.827 05:21:05 STEP 1271 H= 317:45 +CPU= 17.903 05:21:29 STEP 1272 H= 318:00 +CPU= 22.809 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001272 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001272 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001272 05:21:47 STEP 1273 H= 318:15 +CPU= 17.736 05:22:06 STEP 1274 H= 318:30 +CPU= 18.195 05:22:24 STEP 1275 H= 318:45 +CPU= 17.200 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:23:04 STEP 1276 H= 319:00 +CPU= 18.104 05:23:24 STEP 1277 H= 319:15 +CPU= 18.254 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:24:03 STEP 1278 H= 319:30 +CPU= 17.663 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:24:43 STEP 1279 H= 319:45 +CPU= 17.830 05:25:04 STEP 1280 H= 320:00 +CPU= 19.772 05:25:23 STEP 1281 H= 320:15 +CPU= 18.868 05:25:42 STEP 1282 H= 320:30 +CPU= 18.689 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:26:21 STEP 1283 H= 320:45 +CPU= 18.061 05:26:45 STEP 1284 H= 321:00 +CPU= 23.029 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001284 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001284 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001284 05:27:03 STEP 1285 H= 321:15 +CPU= 18.136 05:27:22 STEP 1286 H= 321:30 +CPU= 18.202 05:27:42 STEP 1287 H= 321:45 +CPU= 19.365 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:28:41 STEP 1288 H= 322:00 +CPU= 16.270 05:29:00 STEP 1289 H= 322:15 +CPU= 18.115 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:29:58 STEP 1290 H= 322:30 +CPU= 16.083 05:30:17 STEP 1291 H= 322:45 +CPU= 18.399 05:30:37 STEP 1292 H= 323:00 +CPU= 19.675 05:30:57 STEP 1293 H= 323:15 +CPU= 19.409 05:31:17 STEP 1294 H= 323:30 +CPU= 18.998 05:31:37 STEP 1295 H= 323:45 +CPU= 18.520 05:32:04 STEP 1296 H= 324:00 +CPU= 26.276 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001296 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001296 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001296 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:32:44 STEP 1297 H= 324:15 +CPU= 17.883 05:33:04 STEP 1298 H= 324:30 +CPU= 18.493 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:33:44 STEP 1299 H= 324:45 +CPU= 18.582 05:34:03 STEP 1300 H= 325:00 +CPU= 18.882 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:34:42 STEP 1301 H= 325:15 +CPU= 16.729 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:35:41 STEP 1302 H= 325:30 +CPU= 18.286 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:36:21 STEP 1303 H= 325:45 +CPU= 17.982 05:36:42 STEP 1304 H= 326:00 +CPU= 20.034 05:37:03 STEP 1305 H= 326:15 +CPU= 19.751 05:37:21 STEP 1306 H= 326:30 +CPU= 18.004 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:38:00 STEP 1307 H= 326:45 +CPU= 17.557 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:39:07 STEP 1308 H= 327:00 +CPU= 22.282 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001308 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001308 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001308 05:39:27 STEP 1309 H= 327:15 +CPU= 19.120 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:40:07 STEP 1310 H= 327:30 +CPU= 18.583 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:40:47 STEP 1311 H= 327:45 +CPU= 18.053 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:41:27 STEP 1312 H= 328:00 +CPU= 18.257 05:41:46 STEP 1313 H= 328:15 +CPU= 18.423 05:42:06 STEP 1314 H= 328:30 +CPU= 19.321 05:42:27 STEP 1315 H= 328:45 +CPU= 19.449 05:42:47 STEP 1316 H= 329:00 +CPU= 19.685 05:43:07 STEP 1317 H= 329:15 +CPU= 19.024 05:43:27 STEP 1318 H= 329:30 +CPU= 18.519 05:43:47 STEP 1319 H= 329:45 +CPU= 19.055 05:44:13 STEP 1320 H= 330:00 +CPU= 24.162 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001320 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001320 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001320 05:44:33 STEP 1321 H= 330:15 +CPU= 18.851 05:44:53 STEP 1322 H= 330:30 +CPU= 18.685 05:45:12 STEP 1323 H= 330:45 +CPU= 18.947 05:45:34 STEP 1324 H= 331:00 +CPU= 19.668 05:45:54 STEP 1325 H= 331:15 +CPU= 18.799 05:46:14 STEP 1326 H= 331:30 +CPU= 19.349 05:46:35 STEP 1327 H= 331:45 +CPU= 19.548 05:46:56 STEP 1328 H= 332:00 +CPU= 19.834 05:47:16 STEP 1329 H= 332:15 +CPU= 18.919 05:47:36 STEP 1330 H= 332:30 +CPU= 19.057 05:47:56 STEP 1331 H= 332:45 +CPU= 18.937 05:48:21 STEP 1332 H= 333:00 +CPU= 23.533 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001332 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001332 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001332 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:49:01 STEP 1333 H= 333:15 +CPU= 18.936 05:49:20 STEP 1334 H= 333:30 +CPU= 18.377 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:49:57 STEP 1335 H= 333:45 +CPU= 15.837 05:50:18 STEP 1336 H= 334:00 +CPU= 19.351 05:50:38 STEP 1337 H= 334:15 +CPU= 19.275 05:50:58 STEP 1338 H= 334:30 +CPU= 19.287 05:51:19 STEP 1339 H= 334:45 +CPU= 19.491 05:51:40 STEP 1340 H= 335:00 +CPU= 20.192 05:52:00 STEP 1341 H= 335:15 +CPU= 18.920 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:52:42 STEP 1342 H= 335:30 +CPU= 19.507 05:53:02 STEP 1343 H= 335:45 +CPU= 19.436 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:53:49 STEP 1344 H= 336:00 +CPU= 24.635 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001344 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001344 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001344 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001248 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001248 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001248 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001260 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001260 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001260 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001272 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001272 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001272 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001284 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001284 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001284 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001296 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001296 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001296 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001308 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001308 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001308 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001320 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001320 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001320 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001332 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001332 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001332 Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a42j_2016092300_20_1017_12287102_0_r2102166819_13.zip Uploading the intermediate file: upload_file_13.zip 05:54:09 STEP 1345 H= 336:15 +CPU= 18.481 05:54:29 STEP 1346 H= 336:30 +CPU= 19.202 05:54:49 STEP 1347 H= 336:45 +CPU= 18.485 05:55:09 STEP 1348 H= 337:00 +CPU= 19.241 05:55:29 STEP 1349 H= 337:15 +CPU= 18.850 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:56:10 STEP 1350 H= 337:30 +CPU= 18.534 05:56:30 STEP 1351 H= 337:45 +CPU= 18.839 05:56:51 STEP 1352 H= 338:00 +CPU= 19.709 05:57:11 STEP 1353 H= 338:15 +CPU= 18.746 Suspend request received from the BOINC client, suspending the child process Resuming the child process 05:57:51 STEP 1354 H= 338:30 +CPU= 18.959 05:58:12 STEP 1355 H= 338:45 +CPU= 19.242 05:58:37 STEP 1356 H= 339:00 +CPU= 23.998 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001356 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001356 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001356 05:58:56 STEP 1357 H= 339:15 +CPU= 18.768 05:59:17 STEP 1358 H= 339:30 +CPU= 18.965 05:59:36 STEP 1359 H= 339:45 +CPU= 18.613 05:59:57 STEP 1360 H= 340:00 +CPU= 19.182 06:00:16 STEP 1361 H= 340:15 +CPU= 18.138 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:00:56 STEP 1362 H= 340:30 +CPU= 17.901 06:01:15 STEP 1363 H= 340:45 +CPU= 18.436 06:01:35 STEP 1364 H= 341:00 +CPU= 19.480 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:02:36 STEP 1365 H= 341:15 +CPU= 17.856 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:03:13 STEP 1366 H= 341:30 +CPU= 15.827 06:03:29 STEP 1367 H= 341:45 +CPU= 15.454 06:03:48 STEP 1368 H= 342:00 +CPU= 19.635 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001368 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001368 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001368 06:04:04 STEP 1369 H= 342:15 +CPU= 15.140 06:04:20 STEP 1370 H= 342:30 +CPU= 15.742 06:04:38 STEP 1371 H= 342:45 +CPU= 18.044 06:04:57 STEP 1372 H= 343:00 +CPU= 18.312 06:05:14 STEP 1373 H= 343:15 +CPU= 17.052 06:05:32 STEP 1374 H= 343:30 +CPU= 17.154 06:05:49 STEP 1375 H= 343:45 +CPU= 17.254 06:06:09 STEP 1376 H= 344:00 +CPU= 18.960 06:06:27 STEP 1377 H= 344:15 +CPU= 17.829 06:06:46 STEP 1378 H= 344:30 +CPU= 18.275 06:07:05 STEP 1379 H= 344:45 +CPU= 18.865 06:07:31 STEP 1380 H= 345:00 +CPU= 24.102 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001380 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001380 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001380 06:07:51 STEP 1381 H= 345:15 +CPU= 18.456 06:08:10 STEP 1382 H= 345:30 +CPU= 18.447 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:08:49 STEP 1383 H= 345:45 +CPU= 17.126 06:09:09 STEP 1384 H= 346:00 +CPU= 19.461 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:09:49 STEP 1385 H= 346:15 +CPU= 17.655 06:10:09 STEP 1386 H= 346:30 +CPU= 19.257 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:10:50 STEP 1387 H= 346:45 +CPU= 18.814 06:11:08 STEP 1388 H= 347:00 +CPU= 17.780 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:11:47 STEP 1389 H= 347:15 +CPU= 17.644 06:12:06 STEP 1390 H= 347:30 +CPU= 18.877 06:12:25 STEP 1391 H= 347:45 +CPU= 18.296 06:12:52 STEP 1392 H= 348:00 +CPU= 25.520 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001392 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001392 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001392 06:13:11 STEP 1393 H= 348:15 +CPU= 18.118 06:13:30 STEP 1394 H= 348:30 +CPU= 18.600 06:13:50 STEP 1395 H= 348:45 +CPU= 18.478 06:14:10 STEP 1396 H= 349:00 +CPU= 18.969 06:14:29 STEP 1397 H= 349:15 +CPU= 18.262 06:14:51 STEP 1398 H= 349:30 +CPU= 19.536 06:15:10 STEP 1399 H= 349:45 +CPU= 18.674 06:15:32 STEP 1400 H= 350:00 +CPU= 20.272 06:15:51 STEP 1401 H= 350:15 +CPU= 18.927 06:16:10 STEP 1402 H= 350:30 +CPU= 18.312 06:16:29 STEP 1403 H= 350:45 +CPU= 17.926 06:16:53 STEP 1404 H= 351:00 +CPU= 22.438 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001404 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001404 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001404 06:17:11 STEP 1405 H= 351:15 +CPU= 17.328 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:17:51 STEP 1406 H= 351:30 +CPU= 17.301 06:18:09 STEP 1407 H= 351:45 +CPU= 17.560 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:18:49 STEP 1408 H= 352:00 +CPU= 18.280 06:19:09 STEP 1409 H= 352:15 +CPU= 18.629 06:19:28 STEP 1410 H= 352:30 +CPU= 17.699 06:19:46 STEP 1411 H= 352:45 +CPU= 17.398 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:20:26 STEP 1412 H= 353:00 +CPU= 17.933 06:20:44 STEP 1413 H= 353:15 +CPU= 17.557 06:21:03 STEP 1414 H= 353:30 +CPU= 17.958 06:21:22 STEP 1415 H= 353:45 +CPU= 17.685 06:21:45 STEP 1416 H= 354:00 +CPU= 22.510 Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001416 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001416 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001416 06:22:03 STEP 1417 H= 354:15 +CPU= 17.396 06:22:22 STEP 1418 H= 354:30 +CPU= 17.741 06:22:40 STEP 1419 H= 354:45 +CPU= 17.609 06:23:00 STEP 1420 H= 355:00 +CPU= 18.205 06:23:18 STEP 1421 H= 355:15 +CPU= 17.519 06:23:36 STEP 1422 H= 355:30 +CPU= 17.633 06:23:55 STEP 1423 H= 355:45 +CPU= 17.909 06:24:14 STEP 1424 H= 356:00 +CPU= 18.184 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:24:55 STEP 1425 H= 356:15 +CPU= 18.044 06:25:14 STEP 1426 H= 356:30 +CPU= 17.871 06:25:33 STEP 1427 H= 356:45 +CPU= 17.615 06:25:56 STEP 1428 H= 357:00 +CPU= 22.663 Suspend request received from the BOINC client, suspending the child process Resuming the child process Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001428 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001428 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001428 06:26:35 STEP 1429 H= 357:15 +CPU= 17.308 06:26:54 STEP 1430 H= 357:30 +CPU= 17.461 06:27:12 STEP 1431 H= 357:45 +CPU= 17.312 06:27:30 STEP 1432 H= 358:00 +CPU= 17.850 06:27:49 STEP 1433 H= 358:15 +CPU= 17.835 06:28:08 STEP 1434 H= 358:30 +CPU= 17.420 06:28:26 STEP 1435 H= 358:45 +CPU= 17.651 06:28:45 STEP 1436 H= 359:00 +CPU= 18.069 06:29:04 STEP 1437 H= 359:15 +CPU= 17.677 06:29:22 STEP 1438 H= 359:30 +CPU= 17.671 06:29:41 STEP 1439 H= 359:45 +CPU= 17.433 06:30:05 STEP 1440 H= 360:00 +CPU= 23.417 ..The child process terminated with status: 0 >>> Printing last 70 lines from file: NODE.001_01 DDH------------------------------------------------------------------------ I I I TIME = 360.000H DDH * Diagnostic Var., AREA GLOBAL I I I I-------------------------------------------------------------------------I I VARIABLE I Initial value I Current value I I-------------------------------------------------------------------------I I OMEGA (P/S) I 0.4999435430E-21 I 0.6723800142E-08 I ICloud fractionI 0.0000000000E+00 I 0.4132390433E-05 I I Relat. Hum. I 0.9009081145E-01 I 0.1106655445E+00 I I PASS 01 I 0.0000000000E+00 I 0.1229248656E+01 I DDH------------------------------------------------------------------------ MAXGPFV : MAX. VALUE = 0.000000000000000E+000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 NSTEP = 1440 SCAN2M_HPOS P IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ICMGGh7zg+001440 MODE=a IO-STREAM CLOSED - ICMGGh7zg+001440 MPI-TASK: 1 - 961669572 BYTES IN 7 RECORDS TRANSFERRED IN 0.0004 SECONDS******** Mbytes/s, TOTAL TIME= 0.0090( 4.4%) 06:30:05 STEP 1440 H= 360:00 +CPU= 23.417 END CNT3 NSTEP = 1440 CNT0 000000000 16.984 16.984 17.705 0.959 0 0 0 0 0 IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ 46/ 1069125708 WRITTEN 7150/************ -TASK-OPENED-OPEN-RECS IN -KBYTE IN -RECS OUT-KBYTE OUT-WALL -WALL IN-WALL OU-TOT IN -TOT OUT 1 128 0 46 1044068 7150 ************ 8.1 0.8 7.3 20.2 15.5 ===-=== START OF TIMING STATISTICS ===-=== STATS FOR ALL TASKS NUM ROUTINE CALLS MEAN(ms) MAX(ms) FRAC(%) UNBAL(%) 0 CNT0 - COMPLETE EXECUTION 1 5713561.5 5713561.5 100.00 0.00 1 CNT4 - FORWARD INTEGRATION 1 5692621.2 5692621.2 99.63 0.00 8 SCAN2M - GRID-POINT DYNAMICS 261 3430.5 3430.5 15.67 0.00 9 SPCM - SPECTRAL COMP. 240 674.9 674.9 2.84 0.00 10 SCAN2M - PHYSICS 241 11638.4 11638.4 49.09 0.00 11 IOPACK - OUTPUT P.P. RESULTS 20 519.8 519.8 0.18 0.00 12 SPNORM - SPECTRAL NORM COMP. 11 29.8 29.8 0.01 0.00 17 GRIDFPOS IN CNT4 20 1073.0 1073.0 0.38 0.00 27 RESTART FILES - WRITING 5 2079.3 2079.3 0.18 0.00 28 RESTART FILES - READING 1 20695.5 20695.5 0.36 0.00 29 SU4FPOS IN CNT4 20 0.0 0.0 0.00 0.00 30 DYNFPOS IN CNT4 20 5500.9 5500.9 1.93 0.00 31 POSDDH IN STEPO 2 1.1 1.1 0.00 0.00 37 CPGLAG - SL COMPUTATIONS 241 4607.1 4607.1 19.43 0.00 39 SU0YOMB 1 164.7 164.7 0.00 0.00 51 SCAN2M - SL COMM. PART 1 241 15.9 15.9 0.07 0.00 54 SPCM - M TO S/S TO M TRANSP. 240 417.4 417.4 1.75 0.00 55 SPCIMPF - S TO M/M TO S TRANSP. 240 37.9 37.9 0.16 0.00 56 SPNORM - SPECTRAL NORM COMM. 11 0.2 0.2 0.00 0.00 102 LTINV_CTL - INVERSE LEGENDRE TRANSFORM 524 360.8 360.8 3.31 0.00 103 LTDIR_CTL - DIRECT LEGENDRE TRANSFORM 500 264.9 264.9 2.32 0.00 106 FTDIR_CTL - DIRECT FOURIER TRANSFORM 500 62.1 62.1 0.54 0.00 107 FTINV_CTL - INVERSE FOURIER TRANSFORM 524 106.0 106.0 0.97 0.00 140 SULEG - COMP. OF LEGENDRE POL. 1 19.6 19.6 0.00 0.00 152 LTINV_CTL - M TO L TRANSPOSITION 524 24.8 24.8 0.23 0.00 153 LTDIR_CTL - L TO M TRANSPOSITION 500 14.9 14.9 0.13 0.00 157 FTINV_CTL - L TO G TRANSPOSITION 524 62.3 62.3 0.57 0.00 158 FTDIR_CTL - G TO L TRANSPOSITION 500 32.3 32.3 0.28 0.00 400 GSTATS 28864 0.0 0.0 0.00 0.00 401 GSTATS HOOK 26802 0.0 0.0 0.00 0.00 TOTAL MEASURED IMBALANCE = 0.0 SECONDS, 0.0 PERCENT TOTAL WALLCLOCK TIME 5713.6 CPU TIME 4491.9 VECTOR TIME 4491.9 ===-=== END OF TIMING STATISTICS ===-=== FORECAST DAYS PER DAY 227.7 *** END CNT0 *** ------------------------------------------------ Moving to projects directory: /var/lib/boinc/slots/11/ICMGGh7zg+001440 Moving to projects directory: /var/lib/boinc/slots/11/ICMSHh7zg+001440 Moving to projects directory: /var/lib/boinc/slots/11/ICMUAh7zg+001440 Adding to the zip: /var/lib/boinc/slots/11/NODE.001_01 Adding to the zip: /var/lib/boinc/slots/11/ifs.stat Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001344 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001344 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001344 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001356 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001356 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001356 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001368 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001368 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001368 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001380 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001380 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001380 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001392 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001392 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001392 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001404 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001404 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001404 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001416 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001416 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001416 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001428 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001428 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001428 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMGGh7zg+001440 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMSHh7zg+001440 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12287102/ICMUAh7zg+001440 Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a42j_2016092300_20_1017_12287102_0_r2102166819_14.zip Uploading the final file: upload_file_14.zip Uploading trickle at timestep: 1295100 06:33:34 (30410): called boinc_finish(0) </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>oifs_43r3_bl_a42j_2016092300_20_1017_12287102_0_r2102166819_15.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>oifs_43r3_bl_a42j_2016092300_20_1017_12287102_0_r2102166819_16.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>oifs_43r3_bl_a42j_2016092300_20_1017_12287102_0_r2102166819_17.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>oifs_43r3_bl_a42j_2016092300_20_1017_12287102_0_r2102166819_18.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>oifs_43r3_bl_a42j_2016092300_20_1017_12287102_0_r2102166819_19.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]] |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
08 Jun 2024 04:32:10 | 1499708 | 22438730 | oifs_43r3_bl_a42j_2016092300_20_1017_12287102_0 | 1,295,100 | 27,766 | 0.0214 |
©2024 cpdn.org