climateprediction.net home page
Task 22261428

Task 22261428

Name oifs_43r3_ps_0134_1990050100_123_959_12175778_1
Workunit 12175778
Created 21 Dec 2022, 20:43:16 UTC
Sent 21 Dec 2022, 20:48:34 UTC
Report deadline 20 Jan 2023, 20:48:34 UTC
Received 26 Dec 2022, 14:28:21 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 148 (0x00000094) Unknown error code
Computer ID 1534746
Run time 14 hours 23 min 40 sec
CPU time 14 hours 23 min 40 sec
Validate state Invalid
Credit 12,096.00
Device peak FLOPS 5.61 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,796.59 MB
Peak swap size 4,974.14 MB
Peak disk usage 1,501.52 MB
Stderr 
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<message>
process exited with code 148 (0x94, -108)</message>
<stderr_txt>
e file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0134_1990050100_123_959_12175778_1_r916160370_96.zip
Uploading the intermediate file: upload_file_96.zip
  16:29:41 STEP 2329 H=2329:00 +CPU= 17.328
  16:29:59 STEP 2330 H=2330:00 +CPU= 17.891
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:30:28 STEP 2331 H=2331:00 +CPU= 26.979
  16:30:45 STEP 2332 H=2332:00 +CPU= 16.305
  16:31:03 STEP 2333 H=2333:00 +CPU= 17.981
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:31:33 STEP 2334 H=2334:00 +CPU= 28.303
  16:31:50 STEP 2335 H=2335:00 +CPU= 16.966
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:32:10 STEP 2336 H=2336:00 +CPU= 17.743
  16:32:40 STEP 2337 H=2337:00 +CPU= 29.573
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:32:59 STEP 2338 H=2338:00 +CPU= 17.450
  16:33:15 STEP 2339 H=2339:00 +CPU= 16.072
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:33:49 STEP 2340 H=2340:00 +CPU= 31.472
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002340
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002340
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002340
  16:34:06 STEP 2341 H=2341:00 +CPU= 16.664
  16:34:23 STEP 2342 H=2342:00 +CPU= 17.387
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:34:53 STEP 2343 H=2343:00 +CPU= 27.023
  16:35:09 STEP 2344 H=2344:00 +CPU= 16.254
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:35:28 STEP 2345 H=2345:00 +CPU= 16.908
  16:35:57 STEP 2346 H=2346:00 +CPU= 29.451
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:36:16 STEP 2347 H=2347:00 +CPU= 16.258
  16:36:34 STEP 2348 H=2348:00 +CPU= 17.878
  16:37:01 STEP 2349 H=2349:00 +CPU= 27.315
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:37:20 STEP 2350 H=2350:00 +CPU= 16.877
  16:37:37 STEP 2351 H=2351:00 +CPU= 17.110
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:38:12 STEP 2352 H=2352:00 +CPU= 31.926
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002352
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002352
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMGGhq0f+002328
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMSHhq0f+002328
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMGGhq0f+002340
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMSHhq0f+002340
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMUAhq0f+002340
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0134_1990050100_123_959_12175778_1_r916160370_97.zip
Uploading the intermediate file: upload_file_97.zip
  16:38:28 STEP 2353 H=2353:00 +CPU= 16.361
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:38:47 STEP 2354 H=2354:00 +CPU= 17.160
  16:39:15 STEP 2355 H=2355:00 +CPU= 27.048
  16:39:32 STEP 2356 H=2356:00 +CPU= 17.332
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:39:52 STEP 2357 H=2357:00 +CPU= 17.626
  16:40:21 STEP 2358 H=2358:00 +CPU= 28.704
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:40:40 STEP 2359 H=2359:00 +CPU= 17.308
  16:40:58 STEP 2360 H=2360:00 +CPU= 17.739
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:41:28 STEP 2361 H=2361:00 +CPU= 27.804
  16:41:44 STEP 2362 H=2362:00 +CPU= 16.695
  16:42:02 STEP 2363 H=2363:00 +CPU= 17.413
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:42:34 STEP 2364 H=2364:00 +CPU= 30.007
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002364
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002364
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002364
  16:42:51 STEP 2365 H=2365:00 +CPU= 16.769
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:43:12 STEP 2366 H=2366:00 +CPU= 18.519
  16:43:38 STEP 2367 H=2367:00 +CPU= 26.720
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:43:59 STEP 2368 H=2368:00 +CPU= 18.395
  16:44:15 STEP 2369 H=2369:00 +CPU= 15.988
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:44:46 STEP 2370 H=2370:00 +CPU= 29.201
  16:45:03 STEP 2371 H=2371:00 +CPU= 16.547
  16:45:20 STEP 2372 H=2372:00 +CPU= 16.926
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:45:49 STEP 2373 H=2373:00 +CPU= 27.186
  16:46:06 STEP 2374 H=2374:00 +CPU= 16.769
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:46:27 STEP 2375 H=2375:00 +CPU= 18.472
  16:46:57 STEP 2376 H=2376:00 +CPU= 30.145
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002376
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002376
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMGGhq0f+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMSHhq0f+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMGGhq0f+002364
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMSHhq0f+002364
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMUAhq0f+002364
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0134_1990050100_123_959_12175778_1_r916160370_98.zip
Uploading the intermediate file: upload_file_98.zip
  16:47:13 STEP 2377 H=2377:00 +CPU= 16.373
  16:47:31 STEP 2378 H=2378:00 +CPU= 17.908
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:48:02 STEP 2379 H=2379:00 +CPU= 28.515
  16:48:19 STEP 2380 H=2380:00 +CPU= 16.682
  16:48:37 STEP 2381 H=2381:00 +CPU= 17.776
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:49:08 STEP 2382 H=2382:00 +CPU= 28.704
  16:49:24 STEP 2383 H=2383:00 +CPU= 15.908
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:49:42 STEP 2384 H=2384:00 +CPU= 16.527
  16:50:10 STEP 2385 H=2385:00 +CPU= 27.149
  16:50:27 STEP 2386 H=2386:00 +CPU= 16.830
  16:50:43 STEP 2387 H=2387:00 +CPU= 16.217
  16:51:12 STEP 2388 H=2388:00 +CPU= 29.549
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002388
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002388
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002388
  16:51:33 STEP 2389 H=2389:00 +CPU= 18.536
  16:51:49 STEP 2390 H=2390:00 +CPU= 16.193
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:52:19 STEP 2391 H=2391:00 +CPU= 27.636
  16:52:38 STEP 2392 H=2392:00 +CPU= 16.935
  16:52:54 STEP 2393 H=2393:00 +CPU= 16.109
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:53:27 STEP 2394 H=2394:00 +CPU= 30.034
  16:53:43 STEP 2395 H=2395:00 +CPU= 16.223
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:54:03 STEP 2396 H=2396:00 +CPU= 18.066
  16:54:30 STEP 2397 H=2397:00 +CPU= 26.932
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:54:49 STEP 2398 H=2398:00 +CPU= 16.728
  16:55:08 STEP 2399 H=2399:00 +CPU= 18.233
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:55:46 STEP 2400 H=2400:00 +CPU= 31.673
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002400
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002400
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMGGhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMSHhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMGGhq0f+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMSHhq0f+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMUAhq0f+002388
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0134_1990050100_123_959_12175778_1_r916160370_99.zip
Uploading the intermediate file: upload_file_99.zip
  16:56:01 STEP 2401 H=2401:00 +CPU= 15.465
Uploading trickle at timestep: 8640000
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:56:20 STEP 2402 H=2402:00 +CPU= 17.164
  16:56:49 STEP 2403 H=2403:00 +CPU= 28.192
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:57:08 STEP 2404 H=2404:00 +CPU= 17.211
  16:57:25 STEP 2405 H=2405:00 +CPU= 16.819
  16:57:52 STEP 2406 H=2406:00 +CPU= 26.468
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:58:11 STEP 2407 H=2407:00 +CPU= 17.698
  16:58:28 STEP 2408 H=2408:00 +CPU= 16.430
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:58:58 STEP 2409 H=2409:00 +CPU= 27.925
  16:59:14 STEP 2410 H=2410:00 +CPU= 16.073
  16:59:32 STEP 2411 H=2411:00 +CPU= 17.399
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:00:05 STEP 2412 H=2412:00 +CPU= 31.068
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002412
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002412
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002412
  17:00:21 STEP 2413 H=2413:00 +CPU= 16.084
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:00:41 STEP 2414 H=2414:00 +CPU= 17.446
  17:01:09 STEP 2415 H=2415:00 +CPU= 27.781
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:01:29 STEP 2416 H=2416:00 +CPU= 17.838
  17:01:44 STEP 2417 H=2417:00 +CPU= 15.160
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:02:14 STEP 2418 H=2418:00 +CPU= 28.043
  17:02:31 STEP 2419 H=2419:00 +CPU= 17.118
  17:02:49 STEP 2420 H=2420:00 +CPU= 17.422
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:03:18 STEP 2421 H=2421:00 +CPU= 27.393
  17:03:35 STEP 2422 H=2422:00 +CPU= 16.842
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:03:56 STEP 2423 H=2423:00 +CPU= 19.002
  17:04:28 STEP 2424 H=2424:00 +CPU= 31.179
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0134_1990050100_123_959_12175778_1_r916160370_100.zip
Uploading the intermediate file: upload_file_100.zip
  17:04:47 STEP 2425 H=2425:00 +CPU= 16.574
  17:05:04 STEP 2426 H=2426:00 +CPU= 17.177
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:05:34 STEP 2427 H=2427:00 +CPU= 27.877
  17:05:51 STEP 2428 H=2428:00 +CPU= 17.025
  17:06:08 STEP 2429 H=2429:00 +CPU= 16.895
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:06:38 STEP 2430 H=2430:00 +CPU= 27.794
  17:06:54 STEP 2431 H=2431:00 +CPU= 16.023
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:07:15 STEP 2432 H=2432:00 +CPU= 18.533
  17:07:41 STEP 2433 H=2433:00 +CPU= 26.200
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:08:01 STEP 2434 H=2434:00 +CPU= 18.342
  17:08:18 STEP 2435 H=2435:00 +CPU= 16.433
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:08:50 STEP 2436 H=2436:00 +CPU= 29.862
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002436
  17:09:08 STEP 2437 H=2437:00 +CPU= 17.445
  17:09:25 STEP 2438 H=2438:00 +CPU= 17.264
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:09:56 STEP 2439 H=2439:00 +CPU= 28.491
  17:10:12 STEP 2440 H=2440:00 +CPU= 16.591
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:10:32 STEP 2441 H=2441:00 +CPU= 17.513
  17:10:59 STEP 2442 H=2442:00 +CPU= 27.173
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:11:18 STEP 2443 H=2443:00 +CPU= 16.189
  17:11:36 STEP 2444 H=2444:00 +CPU= 17.821
  17:12:02 STEP 2445 H=2445:00 +CPU= 26.047
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:12:21 STEP 2446 H=2446:00 +CPU= 17.540
  17:12:39 STEP 2447 H=2447:00 +CPU= 17.756
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:13:13 STEP 2448 H=2448:00 +CPU= 31.280
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0134_1990050100_123_959_12175778_1_r916160370_101.zip
  17:13:30 STEP 2449 H=2449:00 +CPU= 17.077
Uploading the intermediate file: upload_file_101.zip
  17:13:47 STEP 2450 H=2450:00 +CPU= 17.345
  17:14:14 STEP 2451 H=2451:00 +CPU= 26.427
  17:14:32 STEP 2452 H=2452:00 +CPU= 17.862
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:14:51 STEP 2453 H=2453:00 +CPU= 16.846
  17:15:19 STEP 2454 H=2454:00 +CPU= 28.045
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:15:39 STEP 2455 H=2455:00 +CPU= 17.575
  17:15:57 STEP 2456 H=2456:00 +CPU= 17.944
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:16:27 STEP 2457 H=2457:00 +CPU= 28.056
  17:16:44 STEP 2458 H=2458:00 +CPU= 17.127
  17:17:02 STEP 2459 H=2459:00 +CPU= 18.008
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:17:35 STEP 2460 H=2460:00 +CPU= 30.527
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002460
  17:17:52 STEP 2461 H=2461:00 +CPU= 16.431
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:18:12 STEP 2462 H=2462:00 +CPU= 18.830
  17:18:40 STEP 2463 H=2463:00 +CPU= 26.882
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:18:59 STEP 2464 H=2464:00 +CPU= 17.171
  17:19:15 STEP 2465 H=2465:00 +CPU= 16.141
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:19:46 STEP 2466 H=2466:00 +CPU= 28.432
  17:20:03 STEP 2467 H=2467:00 +CPU= 17.095
  17:20:24 STEP 2468 H=2468:00 +CPU= 18.505
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:20:57 STEP 2469 H=2469:00 +CPU= 28.241
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:21:18 STEP 2470 H=2470:00 +CPU= 17.711
  17:21:37 STEP 2471 H=2471:00 +CPU= 18.068
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:22:11 STEP 2472 H=2472:00 +CPU= 32.312
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0134_1990050100_123_959_12175778_1_r916160370_102.zip
Uploading the intermediate file: upload_file_102.zip
  17:22:30 STEP 2473 H=2473:00 +CPU= 18.054
  17:22:48 STEP 2474 H=2474:00 +CPU= 17.522
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:23:19 STEP 2475 H=2475:00 +CPU= 29.515
  17:23:37 STEP 2476 H=2476:00 +CPU= 17.614
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:23:57 STEP 2477 H=2477:00 +CPU= 18.187
  17:24:26 STEP 2478 H=2478:00 +CPU= 28.298
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:24:46 STEP 2479 H=2479:00 +CPU= 18.400
  17:25:04 STEP 2480 H=2480:00 +CPU= 18.360
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:25:36 STEP 2481 H=2481:00 +CPU= 27.482
  17:25:52 STEP 2482 H=2482:00 +CPU= 16.390
  17:26:10 STEP 2483 H=2483:00 +CPU= 18.126
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:26:45 STEP 2484 H=2484:00 +CPU= 31.975
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002484
  17:27:03 STEP 2485 H=2485:00 +CPU= 18.144
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:27:25 STEP 2486 H=2486:00 +CPU= 20.285
  17:27:55 STEP 2487 H=2487:00 +CPU= 28.893
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:28:16 STEP 2488 H=2488:00 +CPU= 19.371
  17:28:35 STEP 2489 H=2489:00 +CPU= 18.993
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:29:09 STEP 2490 H=2490:00 +CPU= 31.723
  17:29:28 STEP 2491 H=2491:00 +CPU= 18.719
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:29:51 STEP 2492 H=2492:00 +CPU= 20.204
  17:30:20 STEP 2493 H=2493:00 +CPU= 29.038
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:30:42 STEP 2494 H=2494:00 +CPU= 19.437
  17:31:01 STEP 2495 H=2495:00 +CPU= 19.462
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:31:39 STEP 2496 H=2496:00 +CPU= 35.544
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0134_1990050100_123_959_12175778_1_r916160370_103.zip
Uploading the intermediate file: upload_file_103.zip
  17:31:58 STEP 2497 H=2497:00 +CPU= 18.586
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:32:19 STEP 2498 H=2498:00 +CPU= 19.156
  17:32:49 STEP 2499 H=2499:00 +CPU= 29.406
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:33:10 STEP 2500 H=2500:00 +CPU= 18.830
  17:33:29 STEP 2501 H=2501:00 +CPU= 19.422
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:34:03 STEP 2502 H=2502:00 +CPU= 31.139
  17:34:21 STEP 2503 H=2503:00 +CPU= 18.038
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:34:44 STEP 2504 H=2504:00 +CPU= 20.529
  17:35:15 STEP 2505 H=2505:00 +CPU= 31.050
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:35:36 STEP 2506 H=2506:00 +CPU= 19.417
  17:35:56 STEP 2507 H=2507:00 +CPU= 19.270
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:36:30 STEP 2508 H=2508:00 +CPU= 32.317
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002508
  17:36:48 STEP 2509 H=2509:00 +CPU= 17.547
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:37:09 STEP 2510 H=2510:00 +CPU= 19.448
  17:37:39 STEP 2511 H=2511:00 +CPU= 30.054
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:38:01 STEP 2512 H=2512:00 +CPU= 19.477
  17:38:20 STEP 2513 H=2513:00 +CPU= 18.445
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:38:52 STEP 2514 H=2514:00 +CPU= 30.072
  17:39:12 STEP 2515 H=2515:00 +CPU= 19.453
  17:39:33 STEP 2516 H=2516:00 +CPU= 20.855
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:40:06 STEP 2517 H=2517:00 +CPU= 30.358
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:40:28 STEP 2518 H=2518:00 +CPU= 19.662
  17:40:48 STEP 2519 H=2519:00 +CPU= 20.091
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:41:28 STEP 2520 H=2520:00 +CPU= 37.329
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0134_1990050100_123_959_12175778_1_r916160370_104.zip
Uploading the intermediate file: upload_file_104.zip
  17:41:45 STEP 2521 H=2521:00 +CPU= 17.157
  17:42:05 STEP 2522 H=2522:00 +CPU= 20.143
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:42:37 STEP 2523 H=2523:00 +CPU= 29.309
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:43:00 STEP 2524 H=2524:00 +CPU= 20.357
  17:43:19 STEP 2525 H=2525:00 +CPU= 19.065
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:43:53 STEP 2526 H=2526:00 +CPU= 30.609
  17:44:11 STEP 2527 H=2527:00 +CPU= 17.549
  17:44:30 STEP 2528 H=2528:00 +CPU= 19.138
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:45:03 STEP 2529 H=2529:00 +CPU= 30.235
  17:45:23 STEP 2530 H=2530:00 +CPU= 20.262
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:45:45 STEP 2531 H=2531:00 +CPU= 19.824
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:46:20 STEP 2532 H=2532:00 +CPU= 33.048
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002532
  17:46:40 STEP 2533 H=2533:00 +CPU= 19.973
  17:46:59 STEP 2534 H=2534:00 +CPU= 19.047
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:47:31 STEP 2535 H=2535:00 +CPU= 29.552
  17:47:49 STEP 2536 H=2536:00 +CPU= 18.107
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:48:11 STEP 2537 H=2537:00 +CPU= 19.988
  17:48:41 STEP 2538 H=2538:00 +CPU= 29.978
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:49:01 STEP 2539 H=2539:00 +CPU= 17.885
  17:49:20 STEP 2540 H=2540:00 +CPU= 18.331
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:49:51 STEP 2541 H=2541:00 +CPU= 28.950
  17:50:11 STEP 2542 H=2542:00 +CPU= 20.252
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:50:34 STEP 2543 H=2543:00 +CPU= 21.008
  17:51:09 STEP 2544 H=2544:00 +CPU= 34.854
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0134_1990050100_123_959_12175778_1_r916160370_105.zip
Uploading the intermediate file: upload_file_105.zip
  17:51:28 STEP 2545 H=2545:00 +CPU= 19.420
  17:51:47 STEP 2546 H=2546:00 +CPU= 18.593
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:52:22 STEP 2547 H=2547:00 +CPU= 32.696
  17:52:40 STEP 2548 H=2548:00 +CPU= 18.409
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:53:03 STEP 2549 H=2549:00 +CPU= 20.340
  17:53:34 STEP 2550 H=2550:00 +CPU= 31.640
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:53:56 STEP 2551 H=2551:00 +CPU= 19.286
  17:54:14 STEP 2552 H=2552:00 +CPU= 18.953
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:54:48 STEP 2553 H=2553:00 +CPU= 31.472
  17:55:08 STEP 2554 H=2554:00 +CPU= 20.318
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:55:30 STEP 2555 H=2555:00 +CPU= 19.671
  17:56:03 STEP 2556 H=2556:00 +CPU= 32.458
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002556
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:56:25 STEP 2557 H=2557:00 +CPU= 20.226
  17:56:45 STEP 2558 H=2558:00 +CPU= 20.112
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:57:18 STEP 2559 H=2559:00 +CPU= 30.568
  17:57:37 STEP 2560 H=2560:00 +CPU= 19.389
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:57:59 STEP 2561 H=2561:00 +CPU= 19.200
  17:58:30 STEP 2562 H=2562:00 +CPU= 31.534
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:58:52 STEP 2563 H=2563:00 +CPU= 19.127
  17:59:11 STEP 2564 H=2564:00 +CPU= 19.843
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:59:45 STEP 2565 H=2565:00 +CPU= 31.054
  18:00:04 STEP 2566 H=2566:00 +CPU= 19.431
  18:00:22 STEP 2567 H=2567:00 +CPU= 18.390
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:01:12 STEP 2568 H=2568:00 +CPU= 35.728
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0134_1990050100_123_959_12175778_1_r916160370_106.zip
Uploading the intermediate file: upload_file_106.zip
  18:01:34 STEP 2569 H=2569:00 +CPU= 19.937
  18:01:54 STEP 2570 H=2570:00 +CPU= 19.827
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:07:50 STEP 2571 H=2571:00 +CPU= 36.679
  18:08:12 STEP 2572 H=2572:00 +CPU= 20.627
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:08:35 STEP 2573 H=2573:00 +CPU= 21.015
  18:09:06 STEP 2574 H=2574:00 +CPU= 30.941
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:12:58 STEP 2575 H=2575:00 +CPU= 24.476
  18:13:18 STEP 2576 H=2576:00 +CPU= 19.408
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:13:51 STEP 2577 H=2577:00 +CPU= 30.761
  18:14:11 STEP 2578 H=2578:00 +CPU= 19.070
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1990050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0134
(argv4) batchid: 959
(argv5) wuid: 12175778
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/0
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
  18:46:19 STEP 2579 H=2579:00 +CPU= 26.971
Copying the namelist files from: ../../projects/climateprediction.net/jf_4552b752369b3ba19bfe3e68fb0839a8 to: /var/lib/boinc/slots/0/oifs_43r3_ps_0134_1990050100_123_959_12175778.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/0/oifs_43r3_ps_0134_1990050100_123_959_12175778.zip
ic_ancil_file: ic_ancil_12175778
ifsdata_file: ifsdata_12175778
climate_data_file: clim_data_12175778
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_f41c89047982cfd5f446c5448fdd83ad to: /var/lib/boinc/slots/0/ic_ancil_12175778.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/0/ic_ancil_12175778.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_e1ad889a722a507fd9fdd118432beb10 to: /var/lib/boinc/slots/0/ifsdata/ifsdata_12175778.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/0/ifsdata/ifsdata_12175778.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/0/159l_2/clim_data_12175778.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/0/159l_2/clim_data_12175778.zip
Checking for progress XML file: /var/lib/boinc/slots/0/progress_file_12175778.xml
Opened progress file ok : /var/lib/boinc/slots/0/progress_file_12175778.xml
-- Model is restarting --
Adjusting last_iter, 2579, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/0/progress_file_12175778.xml
last_cpu_time: 49141
upload_file_number: 107
last_iter: 2567
last_upload: 9244800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0134_1990050100_123_959_12175778_1_r916160370
The child process has been launched with process id: 14901
Executing the command: /var/lib/boinc/slots/0/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.140] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.140] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.140] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.140] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.140] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.140] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.140] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.140] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.140] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.140] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.140] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.140] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.140] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.140] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.140] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.140] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.140] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.140] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.140] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.140] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.140] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.141] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.141] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.141] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.141] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.141] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.141] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.141] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.141] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:14901:14901] [20221222:184656:1671709616:0.141] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  18:47:01 STEP 2580 H=2580:00 +CPU= 36.255
Suspend request received from the BOINC client, suspending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1990050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0134
(argv4) batchid: 959
(argv5) wuid: 12175778
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/0
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1990050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0134
(argv4) batchid: 959
(argv5) wuid: 12175778
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/0
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1990050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0134
(argv4) batchid: 959
(argv5) wuid: 12175778
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/0
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1990050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0134
(argv4) batchid: 959
(argv5) wuid: 12175778
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/0
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
  08:45:39 STEP 2581 H=2581:00 +CPU=*******
Copying the namelist files from: ../../projects/climateprediction.net/jf_4552b752369b3ba19bfe3e68fb0839a8 to: /var/lib/boinc/slots/0/oifs_43r3_ps_0134_1990050100_123_959_12175778.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/0/oifs_43r3_ps_0134_1990050100_123_959_12175778.zip
ic_ancil_file: ic_ancil_12175778
ifsdata_file: ifsdata_12175778
climate_data_file: clim_data_12175778
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_f41c89047982cfd5f446c5448fdd83ad to: /var/lib/boinc/slots/0/ic_ancil_12175778.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/0/ic_ancil_12175778.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_e1ad889a722a507fd9fdd118432beb10 to: /var/lib/boinc/slots/0/ifsdata/ifsdata_12175778.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/0/ifsdata/ifsdata_12175778.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/0/159l_2/clim_data_12175778.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/0/159l_2/clim_data_12175778.zip
Checking for progress XML file: /var/lib/boinc/slots/0/progress_file_12175778.xml
Opened progress file ok : /var/lib/boinc/slots/0/progress_file_12175778.xml
-- Model is restarting --
Adjusting last_iter, 0, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/0/progress_file_12175778.xml
last_cpu_time: 51798
upload_file_number: 107
last_iter: -1
last_upload: 9244800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0134_1990050100_123_959_12175778_1_r916160370
The child process has been launched with process id: 20026
Executing the command: /var/lib/boinc/slots/0/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.041] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.041] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.051] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.051] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.051] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.051] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.051] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.051] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.051] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.051] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.051] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.051] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.051] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.051] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.051] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.051] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.051] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.051] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.051] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.051] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.051] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.051] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.053] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.053] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.053] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.053] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.053] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.053] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.053] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:20026:20026] [20221225:142436:1671953076:0.053] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Invalid characters in stoi string: STEPO
Unable to update iter, resetting to last_iter.
ifs_line = 
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1990050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0134
(argv4) batchid: 959
(argv5) wuid: 12175778
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/0
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1990050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0134
(argv4) batchid: 959
(argv5) wuid: 12175778
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/0
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
  05:15:01 STEP 2568 H=2568:00 +CPU=934.685
Unzipping the app zip file: /var/lib/boinc/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_4552b752369b3ba19bfe3e68fb0839a8 to: /var/lib/boinc/slots/0/oifs_43r3_ps_0134_1990050100_123_959_12175778.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/0/oifs_43r3_ps_0134_1990050100_123_959_12175778.zip
ic_ancil_file: ic_ancil_12175778
ifsdata_file: ifsdata_12175778
climate_data_file: clim_data_12175778
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_f41c89047982cfd5f446c5448fdd83ad to: /var/lib/boinc/slots/0/ic_ancil_12175778.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/0/ic_ancil_12175778.zip
  05:15:29 STEP 2569 H=2569:00 +CPU= 24.348
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_e1ad889a722a507fd9fdd118432beb10 to: /var/lib/boinc/slots/0/ifsdata/ifsdata_12175778.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/0/ifsdata/ifsdata_12175778.zip
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1990050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0134
(argv4) batchid: 959
(argv5) wuid: 12175778
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/0
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
  07:20:37 STEP 2570 H=2570:00 +CPU=460.816
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1990050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0134
(argv4) batchid: 959
(argv5) wuid: 12175778
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/0
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
  07:36:01 STEP 2571 H=2571:00 +CPU=288.718
Copying the namelist files from: ../../projects/climateprediction.net/jf_4552b752369b3ba19bfe3e68fb0839a8 to: /var/lib/boinc/slots/0/oifs_43r3_ps_0134_1990050100_123_959_12175778.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/0/oifs_43r3_ps_0134_1990050100_123_959_12175778.zip
ic_ancil_file: ic_ancil_12175778
ifsdata_file: ifsdata_12175778
climate_data_file: clim_data_12175778
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_f41c89047982cfd5f446c5448fdd83ad to: /var/lib/boinc/slots/0/ic_ancil_12175778.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/0/ic_ancil_12175778.zip
16:13:11 (22675): No heartbeat from client for 30 sec - exiting
16:14:26 (22675): timer handler: client dead, exiting
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1990050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0134
(argv4) batchid: 959
(argv5) wuid: 12175778
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/0
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12175778
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_4552b752369b3ba19bfe3e68fb0839a8 to: /var/lib/boinc/slots/0/oifs_43r3_ps_0134_1990050100_123_959_12175778.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/0/oifs_43r3_ps_0134_1990050100_123_959_12175778.zip
ic_ancil_file: ic_ancil_12175778
ifsdata_file: ifsdata_12175778
climate_data_file: clim_data_12175778
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: &#142;&#135;s!&#139;&#211;&#198;Y&#184;pq&#247;&#203;&#137;&#219;&#242;_&#224;&#226;&#253;&#247;&#184;x&#251;oT&#137;&#251;&#223;&#232;&#252;E&#223;&#255;&#141;	&#255;&#199;&#255;&#243;&#156;&#255;&#251;
&#254;&#247;&#221;&#254;&#231;M&#255;{&#231;&#255;y&#251;&#243;&#248;7&#159;&#255;&#201;&#236;&#223;]&#255;&#229;&#171;&#229;2&#255;7W&#137;&#181;\E&#230;&#253;W&#155;	\&#149;&#134;s&#213;&#234;&#201;U&#173;
W&#189;&#184;&#170;u&#171;&#199;&#255;&#182;&#168;j&#165;&#157;&#171;&#234;&#253;&#202;&#252;&#175;i&#255;o&#226;&r&#157;&#152;&#212;f&#179;q&#146;&#196;&#189;|&#210;&#254;&#164;&#206;&#147;k&#146;&#187;&uz&gMv&&#160;&#147;w&#253;&#204;&#152;&#252;tn&#167;)&#141;&#158;O to: /var/lib/boinc/slots/0/ic_ancil_12175778.zip
..Copying the IC ancils to the working directory failed

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:47:44 1534746 22261428 oifs_43r3_ps_0134_1990050100_123_959_12175778_1 8,640,000 45,164 0.0052
09 May 2023 15:47:38 1534746 22261428 oifs_43r3_ps_0134_1990050100_123_959_12175778_1 7,776,000 40,127 0.0052
09 May 2023 15:47:33 1534746 22261428 oifs_43r3_ps_0134_1990050100_123_959_12175778_1 6,912,000 35,441 0.0051
09 May 2023 15:47:22 1534746 22261428 oifs_43r3_ps_0134_1990050100_123_959_12175778_1 6,048,000 30,856 0.0051
09 May 2023 15:47:16 1534746 22261428 oifs_43r3_ps_0134_1990050100_123_959_12175778_1 5,184,000 26,290 0.0051
09 May 2023 15:47:11 1534746 22261428 oifs_43r3_ps_0134_1990050100_123_959_12175778_1 4,320,000 21,747 0.0050
09 May 2023 15:46:59 1534746 22261428 oifs_43r3_ps_0134_1990050100_123_959_12175778_1 3,456,000 17,162 0.0050
09 May 2023 15:46:54 1534746 22261428 oifs_43r3_ps_0134_1990050100_123_959_12175778_1 2,592,000 12,806 0.0049
09 May 2023 15:46:48 1534746 22261428 oifs_43r3_ps_0134_1990050100_123_959_12175778_1 1,728,000 8,547 0.0049
09 May 2023 15:46:43 1534746 22261428 oifs_43r3_ps_0134_1990050100_123_959_12175778_1 864,000 4,294 0.0050


©2024 cpdn.org