climateprediction.net home page
Task 22284586

Task 22284586

Name oifs_43r3_ps_0838_2012050100_123_981_12198482_0
Workunit 12198482
Created 24 Dec 2022, 6:00:11 UTC
Sent 16 Jan 2023, 11:35:09 UTC
Report deadline 15 Feb 2023, 11:35:09 UTC
Received 17 Jan 2023, 21:31:51 UTC
Server state Over
Outcome Computation error
Client state Aborted by user
Exit status 203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID 1536630
Run time 10 hours 23 min 34 sec
CPU time 10 hours 22 min 29 sec
Validate state Invalid
Credit 12,096.00
Device peak FLOPS 6.81 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,414.72 MB
Peak swap size 4,978.06 MB
Peak disk usage 2,010.95 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<message>
aborted by user</message>
<stderr_txt>
nc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002196
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0838_2012050100_123_981_12198482_0_r862757208_91.zip
Uploading the intermediate file: upload_file_91.zip
  12:10:46 STEP 2209 H=2209:00 +CPU= 11.210
  12:10:57 STEP 2210 H=2210:00 +CPU= 11.678
  12:11:15 STEP 2211 H=2211:00 +CPU= 17.747
  12:11:27 STEP 2212 H=2212:00 +CPU= 11.558
  12:11:38 STEP 2213 H=2213:00 +CPU= 11.167
  12:11:56 STEP 2214 H=2214:00 +CPU= 18.345
  12:12:08 STEP 2215 H=2215:00 +CPU= 11.535
  12:12:20 STEP 2216 H=2216:00 +CPU= 11.797
  12:12:38 STEP 2217 H=2217:00 +CPU= 18.059
  12:12:49 STEP 2218 H=2218:00 +CPU= 11.826
  12:13:01 STEP 2219 H=2219:00 +CPU= 11.475
  12:13:21 STEP 2220 H=2220:00 +CPU= 19.892
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002220
  12:13:32 STEP 2221 H=2221:00 +CPU= 11.446
  12:13:44 STEP 2222 H=2222:00 +CPU= 11.774
  12:14:02 STEP 2223 H=2223:00 +CPU= 17.946
  12:14:14 STEP 2224 H=2224:00 +CPU= 11.771
  12:14:25 STEP 2225 H=2225:00 +CPU= 11.578
  12:14:44 STEP 2226 H=2226:00 +CPU= 18.015
  12:14:55 STEP 2227 H=2227:00 +CPU= 11.361
  12:15:07 STEP 2228 H=2228:00 +CPU= 11.916
  12:15:25 STEP 2229 H=2229:00 +CPU= 18.025
  12:15:37 STEP 2230 H=2230:00 +CPU= 11.775
  12:15:48 STEP 2231 H=2231:00 +CPU= 11.746
  12:16:10 STEP 2232 H=2232:00 +CPU= 21.291
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002220
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0838_2012050100_123_981_12198482_0_r862757208_92.zip
Uploading the intermediate file: upload_file_92.zip
  12:16:21 STEP 2233 H=2233:00 +CPU= 11.118
  12:16:32 STEP 2234 H=2234:00 +CPU= 11.440
  12:16:50 STEP 2235 H=2235:00 +CPU= 17.852
  12:17:02 STEP 2236 H=2236:00 +CPU= 11.605
  12:17:13 STEP 2237 H=2237:00 +CPU= 11.193
  12:17:31 STEP 2238 H=2238:00 +CPU= 18.349
  12:17:43 STEP 2239 H=2239:00 +CPU= 11.434
  12:17:55 STEP 2240 H=2240:00 +CPU= 11.854
  12:18:13 STEP 2241 H=2241:00 +CPU= 17.825
  12:18:25 STEP 2242 H=2242:00 +CPU= 11.893
  12:18:36 STEP 2243 H=2243:00 +CPU= 11.358
  12:18:56 STEP 2244 H=2244:00 +CPU= 20.087
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002244
  12:19:08 STEP 2245 H=2245:00 +CPU= 11.508
  12:19:19 STEP 2246 H=2246:00 +CPU= 11.704
  12:19:37 STEP 2247 H=2247:00 +CPU= 18.028
  12:19:49 STEP 2248 H=2248:00 +CPU= 11.732
  12:20:00 STEP 2249 H=2249:00 +CPU= 11.291
  12:20:18 STEP 2250 H=2250:00 +CPU= 17.914
  12:20:30 STEP 2251 H=2251:00 +CPU= 11.601
  12:20:42 STEP 2252 H=2252:00 +CPU= 11.691
  12:20:59 STEP 2253 H=2253:00 +CPU= 17.609
  12:21:11 STEP 2254 H=2254:00 +CPU= 11.683
  12:21:23 STEP 2255 H=2255:00 +CPU= 11.646
  12:21:44 STEP 2256 H=2256:00 +CPU= 21.323
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002244
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0838_2012050100_123_981_12198482_0_r862757208_93.zip
Uploading the intermediate file: upload_file_93.zip
  12:21:55 STEP 2257 H=2257:00 +CPU= 11.200
  12:22:07 STEP 2258 H=2258:00 +CPU= 11.678
  12:22:24 STEP 2259 H=2259:00 +CPU= 17.565
  12:22:36 STEP 2260 H=2260:00 +CPU= 11.591
  12:22:47 STEP 2261 H=2261:00 +CPU= 11.249
  12:23:06 STEP 2262 H=2262:00 +CPU= 18.811
  12:23:18 STEP 2263 H=2263:00 +CPU= 11.399
  12:23:29 STEP 2264 H=2264:00 +CPU= 11.309
  12:23:47 STEP 2265 H=2265:00 +CPU= 17.943
  12:23:59 STEP 2266 H=2266:00 +CPU= 11.600
  12:24:10 STEP 2267 H=2267:00 +CPU= 11.434
  12:24:30 STEP 2268 H=2268:00 +CPU= 19.905
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002268
  12:24:41 STEP 2269 H=2269:00 +CPU= 11.421
  12:24:53 STEP 2270 H=2270:00 +CPU= 11.569
  12:25:11 STEP 2271 H=2271:00 +CPU= 17.824
  12:25:23 STEP 2272 H=2272:00 +CPU= 11.737
  12:25:34 STEP 2273 H=2273:00 +CPU= 11.179
  12:25:52 STEP 2274 H=2274:00 +CPU= 18.531
  12:26:04 STEP 2275 H=2275:00 +CPU= 11.215
  12:26:15 STEP 2276 H=2276:00 +CPU= 11.701
  12:26:33 STEP 2277 H=2277:00 +CPU= 17.736
  12:26:45 STEP 2278 H=2278:00 +CPU= 11.591
  12:26:56 STEP 2279 H=2279:00 +CPU= 11.596
  12:27:18 STEP 2280 H=2280:00 +CPU= 21.523
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002268
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0838_2012050100_123_981_12198482_0_r862757208_94.zip
Uploading the intermediate file: upload_file_94.zip
  12:27:29 STEP 2281 H=2281:00 +CPU= 11.324
  12:27:40 STEP 2282 H=2282:00 +CPU= 11.325
  12:27:58 STEP 2283 H=2283:00 +CPU= 17.874
  12:28:10 STEP 2284 H=2284:00 +CPU= 11.584
  12:28:21 STEP 2285 H=2285:00 +CPU= 11.173
  12:28:40 STEP 2286 H=2286:00 +CPU= 18.472
  12:28:51 STEP 2287 H=2287:00 +CPU= 11.524
  12:29:03 STEP 2288 H=2288:00 +CPU= 11.482
  12:29:21 STEP 2289 H=2289:00 +CPU= 18.023
  12:29:32 STEP 2290 H=2290:00 +CPU= 11.428
  12:29:44 STEP 2291 H=2291:00 +CPU= 11.496
  12:30:04 STEP 2292 H=2292:00 +CPU= 20.247
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002292
  12:30:15 STEP 2293 H=2293:00 +CPU= 11.424
  12:30:27 STEP 2294 H=2294:00 +CPU= 11.600
  12:30:45 STEP 2295 H=2295:00 +CPU= 18.083
  12:30:57 STEP 2296 H=2296:00 +CPU= 11.729
  12:31:08 STEP 2297 H=2297:00 +CPU= 11.258
  12:31:27 STEP 2298 H=2298:00 +CPU= 18.668
  12:31:38 STEP 2299 H=2299:00 +CPU= 11.419
  12:31:50 STEP 2300 H=2300:00 +CPU= 11.352
  12:32:08 STEP 2301 H=2301:00 +CPU= 17.922
  12:32:19 STEP 2302 H=2302:00 +CPU= 11.808
  12:32:31 STEP 2303 H=2303:00 +CPU= 11.547
  12:32:52 STEP 2304 H=2304:00 +CPU= 21.382
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002292
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0838_2012050100_123_981_12198482_0_r862757208_95.zip
Uploading the intermediate file: upload_file_95.zip
  12:33:04 STEP 2305 H=2305:00 +CPU= 11.321
  12:33:15 STEP 2306 H=2306:00 +CPU= 11.304
  12:33:33 STEP 2307 H=2307:00 +CPU= 17.712
  12:33:44 STEP 2308 H=2308:00 +CPU= 11.634
  12:33:56 STEP 2309 H=2309:00 +CPU= 11.205
  12:34:14 STEP 2310 H=2310:00 +CPU= 18.437
  12:34:25 STEP 2311 H=2311:00 +CPU= 11.029
  12:34:37 STEP 2312 H=2312:00 +CPU= 11.544
  12:34:55 STEP 2313 H=2313:00 +CPU= 18.158
  12:35:07 STEP 2314 H=2314:00 +CPU= 11.709
  12:35:18 STEP 2315 H=2315:00 +CPU= 11.292
  12:35:38 STEP 2316 H=2316:00 +CPU= 20.001
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002316
  12:35:49 STEP 2317 H=2317:00 +CPU= 11.150
  12:36:01 STEP 2318 H=2318:00 +CPU= 11.510
  12:36:19 STEP 2319 H=2319:00 +CPU= 18.005
  12:36:30 STEP 2320 H=2320:00 +CPU= 11.673
  12:36:41 STEP 2321 H=2321:00 +CPU= 11.052
  12:37:00 STEP 2322 H=2322:00 +CPU= 18.188
  12:37:11 STEP 2323 H=2323:00 +CPU= 11.262
  12:37:22 STEP 2324 H=2324:00 +CPU= 11.397
  12:37:40 STEP 2325 H=2325:00 +CPU= 17.827
  12:37:52 STEP 2326 H=2326:00 +CPU= 11.681
  12:38:04 STEP 2327 H=2327:00 +CPU= 11.694
  12:38:25 STEP 2328 H=2328:00 +CPU= 21.603
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002316
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0838_2012050100_123_981_12198482_0_r862757208_96.zip
Uploading the intermediate file: upload_file_96.zip
  12:38:36 STEP 2329 H=2329:00 +CPU= 11.234
  12:38:48 STEP 2330 H=2330:00 +CPU= 11.397
  12:39:06 STEP 2331 H=2331:00 +CPU= 17.776
  12:39:18 STEP 2332 H=2332:00 +CPU= 11.797
  12:39:29 STEP 2333 H=2333:00 +CPU= 11.527
  12:39:48 STEP 2334 H=2334:00 +CPU= 18.449
  12:39:59 STEP 2335 H=2335:00 +CPU= 11.513
  12:40:11 STEP 2336 H=2336:00 +CPU= 11.572
  12:40:29 STEP 2337 H=2337:00 +CPU= 18.030
  12:40:40 STEP 2338 H=2338:00 +CPU= 11.769
  12:40:52 STEP 2339 H=2339:00 +CPU= 11.327
  12:41:12 STEP 2340 H=2340:00 +CPU= 19.970
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002340
  12:41:23 STEP 2341 H=2341:00 +CPU= 11.128
  12:41:35 STEP 2342 H=2342:00 +CPU= 11.558
  12:41:52 STEP 2343 H=2343:00 +CPU= 17.851
  12:42:04 STEP 2344 H=2344:00 +CPU= 11.620
  12:42:15 STEP 2345 H=2345:00 +CPU= 11.377
  12:42:34 STEP 2346 H=2346:00 +CPU= 18.395
  12:42:45 STEP 2347 H=2347:00 +CPU= 11.223
  12:42:57 STEP 2348 H=2348:00 +CPU= 11.854
  12:43:15 STEP 2349 H=2349:00 +CPU= 17.815
  12:43:26 STEP 2350 H=2350:00 +CPU= 11.549
  12:43:38 STEP 2351 H=2351:00 +CPU= 11.631
  12:44:00 STEP 2352 H=2352:00 +CPU= 21.604
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002340
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0838_2012050100_123_981_12198482_0_r862757208_97.zip
Uploading the intermediate file: upload_file_97.zip
  12:44:11 STEP 2353 H=2353:00 +CPU= 11.290
  12:44:23 STEP 2354 H=2354:00 +CPU= 11.697
  12:44:41 STEP 2355 H=2355:00 +CPU= 18.248
  12:44:53 STEP 2356 H=2356:00 +CPU= 11.811
  12:45:04 STEP 2357 H=2357:00 +CPU= 11.247
  12:45:23 STEP 2358 H=2358:00 +CPU= 18.442
  12:45:34 STEP 2359 H=2359:00 +CPU= 11.346
  12:45:46 STEP 2360 H=2360:00 +CPU= 11.658
  12:46:03 STEP 2361 H=2361:00 +CPU= 17.780
  12:46:15 STEP 2362 H=2362:00 +CPU= 11.605
  12:46:26 STEP 2363 H=2363:00 +CPU= 11.296
  12:46:46 STEP 2364 H=2364:00 +CPU= 19.911
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002364
  12:46:58 STEP 2365 H=2365:00 +CPU= 11.344
  12:47:09 STEP 2366 H=2366:00 +CPU= 11.654
  12:47:28 STEP 2367 H=2367:00 +CPU= 18.241
  12:47:39 STEP 2368 H=2368:00 +CPU= 11.806
  12:47:51 STEP 2369 H=2369:00 +CPU= 11.192
  12:48:09 STEP 2370 H=2370:00 +CPU= 18.450
  12:48:20 STEP 2371 H=2371:00 +CPU= 11.344
  12:48:32 STEP 2372 H=2372:00 +CPU= 11.564
  12:48:49 STEP 2373 H=2373:00 +CPU= 17.514
  12:49:01 STEP 2374 H=2374:00 +CPU= 11.715
  12:49:13 STEP 2375 H=2375:00 +CPU= 11.558
  12:49:34 STEP 2376 H=2376:00 +CPU= 21.260
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002364
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0838_2012050100_123_981_12198482_0_r862757208_98.zip
Uploading the intermediate file: upload_file_98.zip
  12:49:45 STEP 2377 H=2377:00 +CPU= 11.178
  12:49:57 STEP 2378 H=2378:00 +CPU= 11.497
  12:50:15 STEP 2379 H=2379:00 +CPU= 18.095
  12:50:26 STEP 2380 H=2380:00 +CPU= 11.433
  12:50:38 STEP 2381 H=2381:00 +CPU= 11.326
  12:50:56 STEP 2382 H=2382:00 +CPU= 18.251
  12:51:08 STEP 2383 H=2383:00 +CPU= 11.547
  12:51:19 STEP 2384 H=2384:00 +CPU= 11.835
  12:51:37 STEP 2385 H=2385:00 +CPU= 18.000
  12:51:49 STEP 2386 H=2386:00 +CPU= 11.806
  12:52:01 STEP 2387 H=2387:00 +CPU= 11.593
  12:52:21 STEP 2388 H=2388:00 +CPU= 19.963
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002388
  12:52:32 STEP 2389 H=2389:00 +CPU= 11.302
  12:52:44 STEP 2390 H=2390:00 +CPU= 11.657
  12:53:02 STEP 2391 H=2391:00 +CPU= 17.904
  12:53:13 STEP 2392 H=2392:00 +CPU= 11.408
  12:53:25 STEP 2393 H=2393:00 +CPU= 11.497
  12:53:43 STEP 2394 H=2394:00 +CPU= 18.306
  12:53:54 STEP 2395 H=2395:00 +CPU= 11.203
  12:54:06 STEP 2396 H=2396:00 +CPU= 11.560
  12:54:24 STEP 2397 H=2397:00 +CPU= 17.795
  12:54:35 STEP 2398 H=2398:00 +CPU= 11.526
  12:54:47 STEP 2399 H=2399:00 +CPU= 11.522
  12:55:08 STEP 2400 H=2400:00 +CPU= 21.129
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002388
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0838_2012050100_123_981_12198482_0_r862757208_99.zip
Uploading the intermediate file: upload_file_99.zip
  12:55:19 STEP 2401 H=2401:00 +CPU= 11.149
  12:55:31 STEP 2402 H=2402:00 +CPU= 11.662
Uploading trickle at timestep: 8640000
  12:55:48 STEP 2403 H=2403:00 +CPU= 17.637
  12:56:00 STEP 2404 H=2404:00 +CPU= 11.379
  12:56:11 STEP 2405 H=2405:00 +CPU= 10.882
  12:56:29 STEP 2406 H=2406:00 +CPU= 17.856
  12:56:40 STEP 2407 H=2407:00 +CPU= 11.073
  12:56:51 STEP 2408 H=2408:00 +CPU= 11.376
  12:57:09 STEP 2409 H=2409:00 +CPU= 17.621
  12:57:20 STEP 2410 H=2410:00 +CPU= 11.598
  12:57:32 STEP 2411 H=2411:00 +CPU= 11.236
  12:57:52 STEP 2412 H=2412:00 +CPU= 20.039
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002412
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002412
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002412
  12:58:03 STEP 2413 H=2413:00 +CPU= 11.279
  12:58:15 STEP 2414 H=2414:00 +CPU= 11.959
  12:58:33 STEP 2415 H=2415:00 +CPU= 18.146
  12:58:45 STEP 2416 H=2416:00 +CPU= 11.686
  12:58:56 STEP 2417 H=2417:00 +CPU= 10.978
  12:59:14 STEP 2418 H=2418:00 +CPU= 17.928
  12:59:25 STEP 2419 H=2419:00 +CPU= 11.125
  12:59:37 STEP 2420 H=2420:00 +CPU= 11.638
  12:59:55 STEP 2421 H=2421:00 +CPU= 18.089
  13:00:06 STEP 2422 H=2422:00 +CPU= 11.580
  13:00:18 STEP 2423 H=2423:00 +CPU= 11.672
  13:00:40 STEP 2424 H=2424:00 +CPU= 21.587
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0838_2012050100_123_981_12198482_0_r862757208_100.zip
Uploading the intermediate file: upload_file_100.zip
  13:00:51 STEP 2425 H=2425:00 +CPU= 11.139
  13:01:03 STEP 2426 H=2426:00 +CPU= 12.020
  13:01:21 STEP 2427 H=2427:00 +CPU= 17.931
  13:01:32 STEP 2428 H=2428:00 +CPU= 11.619
  13:01:44 STEP 2429 H=2429:00 +CPU= 11.457
  13:02:02 STEP 2430 H=2430:00 +CPU= 18.193
  13:02:13 STEP 2431 H=2431:00 +CPU= 11.348
  13:02:25 STEP 2432 H=2432:00 +CPU= 11.666
  13:02:43 STEP 2433 H=2433:00 +CPU= 17.925
  13:02:55 STEP 2434 H=2434:00 +CPU= 11.930
  13:03:06 STEP 2435 H=2435:00 +CPU= 11.060
  13:03:26 STEP 2436 H=2436:00 +CPU= 20.115
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002436
  13:03:38 STEP 2437 H=2437:00 +CPU= 11.579
  13:03:49 STEP 2438 H=2438:00 +CPU= 11.533
  13:04:07 STEP 2439 H=2439:00 +CPU= 17.860
  13:04:19 STEP 2440 H=2440:00 +CPU= 11.723
  13:04:30 STEP 2441 H=2441:00 +CPU= 11.251
  13:04:49 STEP 2442 H=2442:00 +CPU= 18.181
  13:05:00 STEP 2443 H=2443:00 +CPU= 11.354
  13:05:11 STEP 2444 H=2444:00 +CPU= 11.612
  13:05:30 STEP 2445 H=2445:00 +CPU= 18.153
  13:05:41 STEP 2446 H=2446:00 +CPU= 11.803
  13:05:53 STEP 2447 H=2447:00 +CPU= 11.252
  13:06:14 STEP 2448 H=2448:00 +CPU= 21.591
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0838_2012050100_123_981_12198482_0_r862757208_101.zip
Uploading the intermediate file: upload_file_101.zip
  13:06:26 STEP 2449 H=2449:00 +CPU= 11.390
  13:06:38 STEP 2450 H=2450:00 +CPU= 11.846
  13:06:56 STEP 2451 H=2451:00 +CPU= 17.914
  13:07:07 STEP 2452 H=2452:00 +CPU= 11.464
  13:07:18 STEP 2453 H=2453:00 +CPU= 11.149
  13:07:36 STEP 2454 H=2454:00 +CPU= 17.785
  13:07:47 STEP 2455 H=2455:00 +CPU= 11.164
  13:07:59 STEP 2456 H=2456:00 +CPU= 11.615
  13:08:17 STEP 2457 H=2457:00 +CPU= 18.039
  13:08:29 STEP 2458 H=2458:00 +CPU= 11.606
  13:08:40 STEP 2459 H=2459:00 +CPU= 11.149
  13:09:00 STEP 2460 H=2460:00 +CPU= 19.995
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002460
  13:09:11 STEP 2461 H=2461:00 +CPU= 11.590
  13:09:23 STEP 2462 H=2462:00 +CPU= 11.773
  13:09:41 STEP 2463 H=2463:00 +CPU= 18.035
  13:09:53 STEP 2464 H=2464:00 +CPU= 11.739
  13:10:04 STEP 2465 H=2465:00 +CPU= 11.193
  13:10:22 STEP 2466 H=2466:00 +CPU= 18.103
  13:10:33 STEP 2467 H=2467:00 +CPU= 11.206
  13:10:45 STEP 2468 H=2468:00 +CPU= 11.865
  13:11:03 STEP 2469 H=2469:00 +CPU= 17.800
  13:11:15 STEP 2470 H=2470:00 +CPU= 11.576
  13:11:26 STEP 2471 H=2471:00 +CPU= 11.662
  13:11:48 STEP 2472 H=2472:00 +CPU= 21.395
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0838_2012050100_123_981_12198482_0_r862757208_102.zip
Uploading the intermediate file: upload_file_102.zip
  13:12:00 STEP 2473 H=2473:00 +CPU= 11.648
  13:12:11 STEP 2474 H=2474:00 +CPU= 11.738
  13:12:29 STEP 2475 H=2475:00 +CPU= 17.963
  13:12:41 STEP 2476 H=2476:00 +CPU= 11.606
  13:12:52 STEP 2477 H=2477:00 +CPU= 11.359
  13:13:11 STEP 2478 H=2478:00 +CPU= 18.198
  13:13:22 STEP 2479 H=2479:00 +CPU= 11.286
  13:13:34 STEP 2480 H=2480:00 +CPU= 11.789
  13:13:52 STEP 2481 H=2481:00 +CPU= 18.091
  13:14:03 STEP 2482 H=2482:00 +CPU= 11.706
  13:14:15 STEP 2483 H=2483:00 +CPU= 11.319
  13:14:34 STEP 2484 H=2484:00 +CPU= 19.493
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002484
  13:14:46 STEP 2485 H=2485:00 +CPU= 11.670
  13:14:58 STEP 2486 H=2486:00 +CPU= 11.828
  13:15:16 STEP 2487 H=2487:00 +CPU= 17.994
  13:15:27 STEP 2488 H=2488:00 +CPU= 11.487
  13:15:39 STEP 2489 H=2489:00 +CPU= 11.316
  13:15:57 STEP 2490 H=2490:00 +CPU= 18.381
  13:16:09 STEP 2491 H=2491:00 +CPU= 11.343
  13:16:20 STEP 2492 H=2492:00 +CPU= 11.669
  13:16:38 STEP 2493 H=2493:00 +CPU= 17.990
  13:16:50 STEP 2494 H=2494:00 +CPU= 11.507
  13:17:01 STEP 2495 H=2495:00 +CPU= 11.671
  13:17:23 STEP 2496 H=2496:00 +CPU= 21.518
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0838_2012050100_123_981_12198482_0_r862757208_103.zip
Uploading the intermediate file: upload_file_103.zip
  13:17:35 STEP 2497 H=2497:00 +CPU= 11.680
  13:17:46 STEP 2498 H=2498:00 +CPU= 11.662
  13:18:04 STEP 2499 H=2499:00 +CPU= 17.994
  13:18:16 STEP 2500 H=2500:00 +CPU= 11.756
  13:18:28 STEP 2501 H=2501:00 +CPU= 11.387
  13:18:46 STEP 2502 H=2502:00 +CPU= 18.515
  13:18:58 STEP 2503 H=2503:00 +CPU= 11.428
  13:19:09 STEP 2504 H=2504:00 +CPU= 11.560
  13:19:27 STEP 2505 H=2505:00 +CPU= 17.954
  13:19:39 STEP 2506 H=2506:00 +CPU= 11.670
  13:19:50 STEP 2507 H=2507:00 +CPU= 11.384
  13:20:11 STEP 2508 H=2508:00 +CPU= 20.578
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002508
  13:20:22 STEP 2509 H=2509:00 +CPU= 11.425
  13:20:34 STEP 2510 H=2510:00 +CPU= 11.869
  13:20:52 STEP 2511 H=2511:00 +CPU= 18.039
  13:21:04 STEP 2512 H=2512:00 +CPU= 11.310
  13:21:15 STEP 2513 H=2513:00 +CPU= 11.407
  13:21:33 STEP 2514 H=2514:00 +CPU= 18.259
  13:21:45 STEP 2515 H=2515:00 +CPU= 11.335
  13:21:56 STEP 2516 H=2516:00 +CPU= 11.686
  13:22:14 STEP 2517 H=2517:00 +CPU= 17.977
  13:22:26 STEP 2518 H=2518:00 +CPU= 11.743
  13:22:38 STEP 2519 H=2519:00 +CPU= 11.674
  13:23:00 STEP 2520 H=2520:00 +CPU= 22.005
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0838_2012050100_123_981_12198482_0_r862757208_104.zip
Uploading the intermediate file: upload_file_104.zip
  13:23:11 STEP 2521 H=2521:00 +CPU= 10.821
  13:23:22 STEP 2522 H=2522:00 +CPU= 11.554
  13:23:40 STEP 2523 H=2523:00 +CPU= 17.826
  13:23:51 STEP 2524 H=2524:00 +CPU= 11.372
  13:24:03 STEP 2525 H=2525:00 +CPU= 11.058
  13:24:20 STEP 2526 H=2526:00 +CPU= 17.821
  13:24:31 STEP 2527 H=2527:00 +CPU= 11.027
  13:24:43 STEP 2528 H=2528:00 +CPU= 11.471
  13:25:00 STEP 2529 H=2529:00 +CPU= 17.493
  13:25:12 STEP 2530 H=2530:00 +CPU= 11.583
  13:25:23 STEP 2531 H=2531:00 +CPU= 11.014
  13:25:43 STEP 2532 H=2532:00 +CPU= 19.940
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002532
  13:25:54 STEP 2533 H=2533:00 +CPU= 11.032
  13:26:05 STEP 2534 H=2534:00 +CPU= 11.297
  13:26:23 STEP 2535 H=2535:00 +CPU= 17.379
  13:26:34 STEP 2536 H=2536:00 +CPU= 11.552
  13:26:46 STEP 2537 H=2537:00 +CPU= 11.203
  13:27:04 STEP 2538 H=2538:00 +CPU= 18.383
  13:27:15 STEP 2539 H=2539:00 +CPU= 11.335
  13:27:27 STEP 2540 H=2540:00 +CPU= 11.673
  13:27:45 STEP 2541 H=2541:00 +CPU= 17.852
  13:27:56 STEP 2542 H=2542:00 +CPU= 11.433
  13:28:08 STEP 2543 H=2543:00 +CPU= 11.563
  13:28:30 STEP 2544 H=2544:00 +CPU= 21.565
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0838_2012050100_123_981_12198482_0_r862757208_105.zip
Uploading the intermediate file: upload_file_105.zip
  13:28:41 STEP 2545 H=2545:00 +CPU= 11.567
  13:28:53 STEP 2546 H=2546:00 +CPU= 11.407
  13:29:11 STEP 2547 H=2547:00 +CPU= 18.010
  13:29:22 STEP 2548 H=2548:00 +CPU= 11.664
  13:29:33 STEP 2549 H=2549:00 +CPU= 11.130
  13:29:52 STEP 2550 H=2550:00 +CPU= 18.409
  13:30:03 STEP 2551 H=2551:00 +CPU= 11.308
  13:30:15 STEP 2552 H=2552:00 +CPU= 11.479
  13:30:33 STEP 2553 H=2553:00 +CPU= 18.038
  13:30:45 STEP 2554 H=2554:00 +CPU= 11.911
  13:30:56 STEP 2555 H=2555:00 +CPU= 11.276
  13:31:16 STEP 2556 H=2556:00 +CPU= 20.391
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002556
  13:31:28 STEP 2557 H=2557:00 +CPU= 11.294
  13:31:39 STEP 2558 H=2558:00 +CPU= 11.631
  13:31:57 STEP 2559 H=2559:00 +CPU= 18.082
  13:32:09 STEP 2560 H=2560:00 +CPU= 11.730
  13:32:20 STEP 2561 H=2561:00 +CPU= 11.232
  13:32:39 STEP 2562 H=2562:00 +CPU= 18.431
  13:32:50 STEP 2563 H=2563:00 +CPU= 11.138
  13:33:01 STEP 2564 H=2564:00 +CPU= 11.371
  13:33:19 STEP 2565 H=2565:00 +CPU= 17.729
  13:33:31 STEP 2566 H=2566:00 +CPU= 11.527
  13:33:42 STEP 2567 H=2567:00 +CPU= 11.454
  13:34:04 STEP 2568 H=2568:00 +CPU= 21.315
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0838_2012050100_123_981_12198482_0_r862757208_106.zip
Uploading the intermediate file: upload_file_106.zip
  13:34:15 STEP 2569 H=2569:00 +CPU= 11.549
  13:34:27 STEP 2570 H=2570:00 +CPU= 11.446
  13:34:44 STEP 2571 H=2571:00 +CPU= 17.698
  13:34:56 STEP 2572 H=2572:00 +CPU= 11.715
  13:35:07 STEP 2573 H=2573:00 +CPU= 10.981
  13:35:25 STEP 2574 H=2574:00 +CPU= 18.265
  13:35:37 STEP 2575 H=2575:00 +CPU= 11.206
  13:35:48 STEP 2576 H=2576:00 +CPU= 11.600
  13:36:06 STEP 2577 H=2577:00 +CPU= 17.997
  13:36:18 STEP 2578 H=2578:00 +CPU= 11.659
  13:36:29 STEP 2579 H=2579:00 +CPU= 11.369
  13:36:49 STEP 2580 H=2580:00 +CPU= 20.052
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002580
  13:37:01 STEP 2581 H=2581:00 +CPU= 11.267
  13:37:13 STEP 2582 H=2582:00 +CPU= 12.099
  13:37:31 STEP 2583 H=2583:00 +CPU= 17.954
  13:37:42 STEP 2584 H=2584:00 +CPU= 11.680
  13:37:54 STEP 2585 H=2585:00 +CPU= 11.260
  13:38:12 STEP 2586 H=2586:00 +CPU= 18.369
  13:38:23 STEP 2587 H=2587:00 +CPU= 11.065
  13:38:35 STEP 2588 H=2588:00 +CPU= 11.545
  13:38:53 STEP 2589 H=2589:00 +CPU= 17.961
  13:39:04 STEP 2590 H=2590:00 +CPU= 11.264
  13:39:15 STEP 2591 H=2591:00 +CPU= 11.403
  13:39:37 STEP 2592 H=2592:00 +CPU= 21.386
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0838_2012050100_123_981_12198482_0_r862757208_107.zip
Uploading the intermediate file: upload_file_107.zip
  13:39:48 STEP 2593 H=2593:00 +CPU= 11.278
  13:40:00 STEP 2594 H=2594:00 +CPU= 11.931
  13:40:18 STEP 2595 H=2595:00 +CPU= 17.729
  13:40:30 STEP 2596 H=2596:00 +CPU= 11.655
  13:40:41 STEP 2597 H=2597:00 +CPU= 11.143
  13:40:59 STEP 2598 H=2598:00 +CPU= 18.425
  13:41:11 STEP 2599 H=2599:00 +CPU= 11.294
  13:41:22 STEP 2600 H=2600:00 +CPU= 11.512
  13:41:40 STEP 2601 H=2601:00 +CPU= 17.893
  13:41:52 STEP 2602 H=2602:00 +CPU= 11.818
  13:42:03 STEP 2603 H=2603:00 +CPU= 11.132
  13:42:23 STEP 2604 H=2604:00 +CPU= 20.147
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002604
  13:42:34 STEP 2605 H=2605:00 +CPU= 11.241
  13:42:46 STEP 2606 H=2606:00 +CPU= 11.717
  13:43:05 STEP 2607 H=2607:00 +CPU= 18.475
  13:43:16 STEP 2608 H=2608:00 +CPU= 11.587
  13:43:28 STEP 2609 H=2609:00 +CPU= 11.461
  13:43:46 STEP 2610 H=2610:00 +CPU= 18.371
  13:43:57 STEP 2611 H=2611:00 +CPU= 11.197
  13:44:09 STEP 2612 H=2612:00 +CPU= 11.781
  13:44:27 STEP 2613 H=2613:00 +CPU= 18.352
  13:44:39 STEP 2614 H=2614:00 +CPU= 11.625
  13:44:51 STEP 2615 H=2615:00 +CPU= 11.827
  13:45:13 STEP 2616 H=2616:00 +CPU= 21.870
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0838_2012050100_123_981_12198482_0_r862757208_108.zip
Uploading the intermediate file: upload_file_108.zip
  13:45:25 STEP 2617 H=2617:00 +CPU= 11.727
  13:45:37 STEP 2618 H=2618:00 +CPU= 11.983
  13:46:00 STEP 2619 H=2619:00 +CPU= 22.829
  13:46:15 STEP 2620 H=2620:00 +CPU= 14.789
  13:46:29 STEP 2621 H=2621:00 +CPU= 14.301
  13:46:48 STEP 2622 H=2622:00 +CPU= 19.270
  13:47:00 STEP 2623 H=2623:00 +CPU= 11.945
  13:47:12 STEP 2624 H=2624:00 +CPU= 12.199
  13:47:31 STEP 2625 H=2625:00 +CPU= 18.271
  13:47:42 STEP 2626 H=2626:00 +CPU= 11.791
  13:47:54 STEP 2627 H=2627:00 +CPU= 11.588
Suspend request received from the BOINC client, suspending the child process
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134828:1673981308:36482.465] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 3992MB (heap), 4415MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134828:1673981308:36482.465] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134828:1673981308:36482.465] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134828:1673981308:36482.465] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134828:1673981308:36482.465] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134828:1673981308:36482.465] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 3992 MB (maxheap), 4415 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134828:1673981308:36482.465] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134828:1673981308:36482.465] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134828:1673981308:36482.465] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134828:1673981308:36482.465] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134828:1673981308:36482.465] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134828:1673981308:36482.465] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134828:1673981308:36482.465] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134828:1673981308:36482.465] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134828:1673981308:36482.465] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134828:1673981308:36482.465] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134828:1673981308:36482.465] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :            EC_PHYS_DRV 
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134828:1673981308:36482.465] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :             >OMP-PHYSICS CLDPP T/S    (1002) 
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134828:1673981308:36482.465] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :              EC_PHYS 
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134828:1673981308:36482.465] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :               CALLPAR 
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134828:1673981308:36482.465] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                SLTEND_LAYER 
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134828:1673981308:36482.465] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                 SLTEND 
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134828:1673981308:36482.465] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                  CUADJTQ 
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134829:1673981309:36483.466] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:x32-linux2:1:1:125482:125482] [20230117:134829:1673981309:36483.466] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CE916B  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000081FFF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC9090  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001CCAC2E  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000FBC897  cuadjtq_                  292  cuadjtq.F90
oifs_43r3_model.e  000000000103E530  sltend_                   298  sltend.F90
oifs_43r3_model.e  000000000103CDC0  sltend_layer_              99  sltend_layer.F90
oifs_43r3_model.e  0000000000F410DA  callpar_                 1613  callpar.F90
oifs_43r3_model.e  0000000000E4940F  ec_phys_                  670  ec_phys.F90
oifs_43r3_model.e  0000000000E3610C  ec_phys_drv_              599  ec_phys_drv.F90
oifs_43r3_model.e  0000000000BFA3D3  gp_model_                 613  gp_model.F90
oifs_43r3_model.e  00000000012E9482  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BBC1CE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  000000000057A664  stepo_                    327  stepo.F90
oifs_43r3_model.e  000000000055DEEC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2012050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0838
(argv4) batchid: 981
(argv5) wuid: 12198482
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/5
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_47b3240a3a258f18a3d40aae18369bef to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0838_2012050100_123_981_12198482.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0838_2012050100_123_981_12198482.zip
ic_ancil_file: ic_ancil_12198482
ifsdata_file: ifsdata_12198482
climate_data_file: clim_data_12198482
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_0970a6044543214cd6261a908e685140 to: /var/lib/boinc-client/slots/5/ic_ancil_12198482.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12198482.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_530b13c932b5a189347d6303b3bb2654 to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12198482.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12198482.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12198482.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12198482.zip
Checking for progress XML file: /var/lib/boinc-client/slots/5/progress_file_12198482.xml
Opened progress file ok : /var/lib/boinc-client/slots/5/progress_file_12198482.xml
-- Model is restarting --
Adjusting last_iter, 2628, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/5/progress_file_12198482.xml
last_cpu_time: 36404
upload_file_number: 109
last_iter: 2615
last_upload: 9417600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0838_2012050100_123_981_12198482_0_r862757208
The child process has been launched with process id: 3264
Executing the command: /var/lib/boinc-client/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:x32-linux2:1:1:3264:3264] [20230117:161203:1673989923:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  16:12:25 STEP 2616 H=2616:00 +CPU= 19.137
  16:12:35 STEP 2617 H=2617:00 +CPU= 10.551
  16:12:46 STEP 2618 H=2618:00 +CPU= 10.964
  16:13:04 STEP 2619 H=2619:00 +CPU= 17.412
  16:13:15 STEP 2620 H=2620:00 +CPU= 11.352
  16:13:26 STEP 2621 H=2621:00 +CPU= 11.018
  16:13:44 STEP 2622 H=2622:00 +CPU= 17.788
  16:13:55 STEP 2623 H=2623:00 +CPU= 11.041
  16:14:06 STEP 2624 H=2624:00 +CPU= 11.397
  16:14:23 STEP 2625 H=2625:00 +CPU= 17.287
  16:14:35 STEP 2626 H=2626:00 +CPU= 11.313
  16:14:45 STEP 2627 H=2627:00 +CPU= 10.727
  16:15:04 STEP 2628 H=2628:00 +CPU= 18.774
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002628
  16:15:15 STEP 2629 H=2629:00 +CPU= 10.841
  16:15:26 STEP 2630 H=2630:00 +CPU= 11.239
  16:15:44 STEP 2631 H=2631:00 +CPU= 17.279
  16:15:55 STEP 2632 H=2632:00 +CPU= 11.038
  16:16:06 STEP 2633 H=2633:00 +CPU= 11.325
  16:16:25 STEP 2634 H=2634:00 +CPU= 18.803
  16:16:36 STEP 2635 H=2635:00 +CPU= 11.305
  16:16:48 STEP 2636 H=2636:00 +CPU= 11.555
  16:17:05 STEP 2637 H=2637:00 +CPU= 17.352
  16:17:17 STEP 2638 H=2638:00 +CPU= 11.476
  16:17:28 STEP 2639 H=2639:00 +CPU= 11.467
  16:17:49 STEP 2640 H=2640:00 +CPU= 20.733
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0838_2012050100_123_981_12198482_0_r862757208_109.zip
Uploading the intermediate file: upload_file_109.zip
  16:18:00 STEP 2641 H=2641:00 +CPU= 10.799
  16:18:11 STEP 2642 H=2642:00 +CPU= 11.170
  16:18:28 STEP 2643 H=2643:00 +CPU= 17.289
  16:18:39 STEP 2644 H=2644:00 +CPU= 10.839
  16:18:50 STEP 2645 H=2645:00 +CPU= 10.866
  16:19:07 STEP 2646 H=2646:00 +CPU= 17.440
  16:19:18 STEP 2647 H=2647:00 +CPU= 11.015
  16:19:30 STEP 2648 H=2648:00 +CPU= 11.376
  16:19:47 STEP 2649 H=2649:00 +CPU= 17.209
  16:19:58 STEP 2650 H=2650:00 +CPU= 11.311
  16:20:09 STEP 2651 H=2651:00 +CPU= 10.990
  16:20:29 STEP 2652 H=2652:00 +CPU= 19.435
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002652
  16:20:39 STEP 2653 H=2653:00 +CPU= 10.591
  16:20:50 STEP 2654 H=2654:00 +CPU= 11.080
  16:21:07 STEP 2655 H=2655:00 +CPU= 16.886
  16:21:18 STEP 2656 H=2656:00 +CPU= 10.849
  16:21:29 STEP 2657 H=2657:00 +CPU= 10.810
  16:21:46 STEP 2658 H=2658:00 +CPU= 17.238
  16:21:57 STEP 2659 H=2659:00 +CPU= 10.692
  16:22:08 STEP 2660 H=2660:00 +CPU= 11.410
  16:22:25 STEP 2661 H=2661:00 +CPU= 17.224
  16:22:37 STEP 2662 H=2662:00 +CPU= 11.266
  16:22:48 STEP 2663 H=2663:00 +CPU= 11.295
  16:23:09 STEP 2664 H=2664:00 +CPU= 20.906
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198482/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0838_2012050100_123_981_12198482_0_r862757208_110.zip
Uploading the intermediate file: upload_file_110.zip
  16:23:20 STEP 2665 H=2665:00 +CPU= 10.973
  16:23:31 STEP 2666 H=2666:00 +CPU= 10.922
  16:23:48 STEP 2667 H=2667:00 +CPU= 17.516
  16:23:59 STEP 2668 H=2668:00 +CPU= 11.043
  16:24:10 STEP 2669 H=2669:00 +CPU= 10.726
  16:24:28 STEP 2670 H=2670:00 +CPU= 17.485
  16:24:38 STEP 2671 H=2671:00 +CPU= 10.817
  16:24:50 STEP 2672 H=2672:00 +CPU= 11.281
  16:25:07 STEP 2673 H=2673:00 +CPU= 17.466
  16:25:20 STEP 2674 H=2674:00 +CPU= 12.379
  16:25:30 STEP 2675 H=2675:00 +CPU= 10.959
  16:25:50 STEP 2676 H=2676:00 +CPU= 19.465
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002676
  16:26:01 STEP 2677 H=2677:00 +CPU= 11.118
  16:26:12 STEP 2678 H=2678:00 +CPU= 11.095
  16:26:29 STEP 2679 H=2679:00 +CPU= 17.150
  16:26:40 STEP 2680 H=2680:00 +CPU= 11.025
  16:26:51 STEP 2681 H=2681:00 +CPU= 11.143
  16:27:09 STEP 2682 H=2682:00 +CPU= 17.668
  16:27:20 STEP 2683 H=2683:00 +CPU= 10.589
  16:27:31 STEP 2684 H=2684:00 +CPU= 11.266
  16:27:48 STEP 2685 H=2685:00 +CPU= 17.341
Abort request received from BOINC client, ending the child process

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:24:38 1536630 22284586 oifs_43r3_ps_0838_2012050100_123_981_12198482_0 8,640,000 33,239 0.0038
09 May 2023 16:24:38 1536630 22284586 oifs_43r3_ps_0838_2012050100_123_981_12198482_0 7,776,000 29,903 0.0038
09 May 2023 16:24:33 1536630 22284586 oifs_43r3_ps_0838_2012050100_123_981_12198482_0 6,912,000 26,577 0.0038
09 May 2023 16:24:28 1536630 22284586 oifs_43r3_ps_0838_2012050100_123_981_12198482_0 6,048,000 23,252 0.0038
09 May 2023 16:24:22 1536630 22284586 oifs_43r3_ps_0838_2012050100_123_981_12198482_0 5,184,000 19,917 0.0038
09 May 2023 16:24:18 1536630 22284586 oifs_43r3_ps_0838_2012050100_123_981_12198482_0 4,320,000 16,603 0.0038
09 May 2023 16:24:12 1536630 22284586 oifs_43r3_ps_0838_2012050100_123_981_12198482_0 3,456,000 13,278 0.0038
09 May 2023 16:24:08 1536630 22284586 oifs_43r3_ps_0838_2012050100_123_981_12198482_0 2,592,000 9,963 0.0038
09 May 2023 16:24:03 1536630 22284586 oifs_43r3_ps_0838_2012050100_123_981_12198482_0 1,728,000 6,648 0.0038
09 May 2023 16:23:58 1536630 22284586 oifs_43r3_ps_0838_2012050100_123_981_12198482_0 864,000 3,342 0.0039


©2024 climateprediction.net