climateprediction.net home page
Task 22276410

Task 22276410

Name oifs_43r3_ps_0115_2005050100_123_974_12190759_0
Workunit 12190759
Created 23 Dec 2022, 9:43:42 UTC
Sent 23 Dec 2022, 10:01:56 UTC
Report deadline 22 Jan 2023, 10:01:56 UTC
Received 12 Mar 2023, 9:49:59 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1524986
Run time 16 hours 49 min 28 sec
CPU time 17 hours 12 min 41 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 6.76 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,499.36 MB
Peak swap size 4,978.05 MB
Peak disk usage 2,623.03 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
424
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793_100.zip
Uploading the intermediate file: upload_file_100.zip
  21:47:30 STEP 2425 H=2425:00 +CPU= 15.771
  21:47:47 STEP 2426 H=2426:00 +CPU= 16.498
  21:48:13 STEP 2427 H=2427:00 +CPU= 26.509
  21:48:31 STEP 2428 H=2428:00 +CPU= 17.245
  21:48:48 STEP 2429 H=2429:00 +CPU= 16.759
  21:49:14 STEP 2430 H=2430:00 +CPU= 26.701
  21:49:54 STEP 2431 H=2431:00 +CPU= 39.583
  21:50:11 STEP 2432 H=2432:00 +CPU= 17.505
  21:50:38 STEP 2433 H=2433:00 +CPU= 27.063
  21:50:56 STEP 2434 H=2434:00 +CPU= 17.886
  21:51:13 STEP 2435 H=2435:00 +CPU= 16.848
  21:51:51 STEP 2436 H=2436:00 +CPU= 28.882
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002436
  21:52:08 STEP 2437 H=2437:00 +CPU= 17.905
  21:52:27 STEP 2438 H=2438:00 +CPU= 18.299
  21:52:54 STEP 2439 H=2439:00 +CPU= 26.801
  21:53:12 STEP 2440 H=2440:00 +CPU= 17.943
  21:53:29 STEP 2441 H=2441:00 +CPU= 17.448
  21:53:56 STEP 2442 H=2442:00 +CPU= 27.169
  21:54:14 STEP 2443 H=2443:00 +CPU= 17.162
  21:54:31 STEP 2444 H=2444:00 +CPU= 17.609
  21:54:59 STEP 2445 H=2445:00 +CPU= 27.501
  21:55:17 STEP 2446 H=2446:00 +CPU= 17.818
  21:55:34 STEP 2447 H=2447:00 +CPU= 17.245
  21:56:10 STEP 2448 H=2448:00 +CPU= 30.759
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793_101.zip
Uploading the intermediate file: upload_file_101.zip
  21:56:31 STEP 2449 H=2449:00 +CPU= 16.795
  21:56:55 STEP 2450 H=2450:00 +CPU= 17.355
  21:57:25 STEP 2451 H=2451:00 +CPU= 30.189
  21:57:55 STEP 2452 H=2452:00 +CPU= 30.521
  21:58:12 STEP 2453 H=2453:00 +CPU= 17.137
  21:58:54 STEP 2454 H=2454:00 +CPU= 28.417
  21:59:11 STEP 2455 H=2455:00 +CPU= 16.881
  21:59:44 STEP 2456 H=2456:00 +CPU= 16.741
  22:00:36 STEP 2457 H=2457:00 +CPU= 26.574
  22:00:53 STEP 2458 H=2458:00 +CPU= 16.644
  22:01:10 STEP 2459 H=2459:00 +CPU= 17.326
  22:01:40 STEP 2460 H=2460:00 +CPU= 30.262
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002460
  22:01:57 STEP 2461 H=2461:00 +CPU= 16.861
  22:02:15 STEP 2462 H=2462:00 +CPU= 17.467
  22:02:42 STEP 2463 H=2463:00 +CPU= 27.274
  22:02:59 STEP 2464 H=2464:00 +CPU= 17.128
  22:03:16 STEP 2465 H=2465:00 +CPU= 17.070
  22:03:44 STEP 2466 H=2466:00 +CPU= 27.820
  22:04:00 STEP 2467 H=2467:00 +CPU= 16.370
  22:04:18 STEP 2468 H=2468:00 +CPU= 17.691
  22:04:45 STEP 2469 H=2469:00 +CPU= 26.552
  22:05:01 STEP 2470 H=2470:00 +CPU= 15.949
  22:05:20 STEP 2471 H=2471:00 +CPU= 16.500
  22:05:53 STEP 2472 H=2472:00 +CPU= 31.649
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793_102.zip
Uploading the intermediate file: upload_file_102.zip
  22:06:10 STEP 2473 H=2473:00 +CPU= 17.082
  22:06:28 STEP 2474 H=2474:00 +CPU= 17.493
  22:06:52 STEP 2475 H=2475:00 +CPU= 24.887
  22:07:09 STEP 2476 H=2476:00 +CPU= 15.972
  22:07:26 STEP 2477 H=2477:00 +CPU= 16.920
  22:07:53 STEP 2478 H=2478:00 +CPU= 27.599
  22:08:12 STEP 2479 H=2479:00 +CPU= 17.318
  22:08:26 STEP 2480 H=2480:00 +CPU= 14.885
  22:09:33 STEP 2481 H=2481:00 +CPU= 26.117
  22:11:05 STEP 2482 H=2482:00 +CPU= 20.216
  22:11:22 STEP 2483 H=2483:00 +CPU= 17.416
  22:11:52 STEP 2484 H=2484:00 +CPU= 29.552
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002484
  22:12:22 STEP 2485 H=2485:00 +CPU= 30.081
  22:12:40 STEP 2486 H=2486:00 +CPU= 17.945
  22:13:06 STEP 2487 H=2487:00 +CPU= 26.198
  22:13:24 STEP 2488 H=2488:00 +CPU= 17.996
  22:13:41 STEP 2489 H=2489:00 +CPU= 17.265
  22:14:09 STEP 2490 H=2490:00 +CPU= 27.258
  22:14:26 STEP 2491 H=2491:00 +CPU= 17.244
  22:14:43 STEP 2492 H=2492:00 +CPU= 17.081
  22:15:10 STEP 2493 H=2493:00 +CPU= 27.086
  22:15:28 STEP 2494 H=2494:00 +CPU= 18.333
  22:15:47 STEP 2495 H=2495:00 +CPU= 18.340
  22:16:30 STEP 2496 H=2496:00 +CPU= 38.696
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793_103.zip
Uploading the intermediate file: upload_file_103.zip
  22:16:47 STEP 2497 H=2497:00 +CPU= 17.209
  22:17:05 STEP 2498 H=2498:00 +CPU= 17.870
  22:17:32 STEP 2499 H=2499:00 +CPU= 26.988
  22:17:50 STEP 2500 H=2500:00 +CPU= 17.756
  22:18:06 STEP 2501 H=2501:00 +CPU= 16.075
  22:18:51 STEP 2502 H=2502:00 +CPU= 25.408
  22:19:47 STEP 2503 H=2503:00 +CPU= 18.115
  22:20:03 STEP 2504 H=2504:00 +CPU= 14.978
  22:20:58 STEP 2505 H=2505:00 +CPU= 24.635
  22:21:17 STEP 2506 H=2506:00 +CPU= 17.583
  22:21:34 STEP 2507 H=2507:00 +CPU= 17.261
  22:22:04 STEP 2508 H=2508:00 +CPU= 29.994
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002508
  22:22:21 STEP 2509 H=2509:00 +CPU= 16.908
  22:22:39 STEP 2510 H=2510:00 +CPU= 18.027
  22:23:05 STEP 2511 H=2511:00 +CPU= 26.199
  22:23:22 STEP 2512 H=2512:00 +CPU= 17.344
  22:23:39 STEP 2513 H=2513:00 +CPU= 17.000
  22:24:06 STEP 2514 H=2514:00 +CPU= 26.775
  22:24:23 STEP 2515 H=2515:00 +CPU= 17.194
  22:24:41 STEP 2516 H=2516:00 +CPU= 17.499
  22:25:07 STEP 2517 H=2517:00 +CPU= 26.508
  22:25:25 STEP 2518 H=2518:00 +CPU= 17.077
  22:25:42 STEP 2519 H=2519:00 +CPU= 17.660
  22:26:25 STEP 2520 H=2520:00 +CPU= 29.016
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793_104.zip
Uploading the intermediate file: upload_file_104.zip
  22:27:00 STEP 2521 H=2521:00 +CPU= 18.750
  22:27:17 STEP 2522 H=2522:00 +CPU= 17.022
  22:27:50 STEP 2523 H=2523:00 +CPU= 26.451
  22:28:02 STEP 2524 H=2524:00 +CPU= 11.872
  22:28:34 STEP 2525 H=2525:00 +CPU= 14.829
  22:29:50 STEP 2526 H=2526:00 +CPU= 25.811
  22:30:07 STEP 2527 H=2527:00 +CPU= 16.714
  22:30:26 STEP 2528 H=2528:00 +CPU= 18.348
  22:30:54 STEP 2529 H=2529:00 +CPU= 28.100
  22:31:13 STEP 2530 H=2530:00 +CPU= 19.119
  22:31:30 STEP 2531 H=2531:00 +CPU= 16.854
  22:32:00 STEP 2532 H=2532:00 +CPU= 29.372
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002532
  22:32:17 STEP 2533 H=2533:00 +CPU= 16.565
  22:32:34 STEP 2534 H=2534:00 +CPU= 17.564
  22:33:01 STEP 2535 H=2535:00 +CPU= 26.483
  22:33:18 STEP 2536 H=2536:00 +CPU= 17.535
  22:33:36 STEP 2537 H=2537:00 +CPU= 17.569
  22:34:03 STEP 2538 H=2538:00 +CPU= 27.356
  22:34:20 STEP 2539 H=2539:00 +CPU= 16.740
  22:34:38 STEP 2540 H=2540:00 +CPU= 17.785
  22:35:04 STEP 2541 H=2541:00 +CPU= 26.534
  22:35:22 STEP 2542 H=2542:00 +CPU= 17.610
  22:35:40 STEP 2543 H=2543:00 +CPU= 18.185
  22:36:21 STEP 2544 H=2544:00 +CPU= 30.093
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793_105.zip
Uploading the intermediate file: upload_file_105.zip
  22:36:38 STEP 2545 H=2545:00 +CPU= 17.094
  22:36:55 STEP 2546 H=2546:00 +CPU= 17.736
  22:37:23 STEP 2547 H=2547:00 +CPU= 27.311
  22:37:41 STEP 2548 H=2548:00 +CPU= 18.406
  22:37:58 STEP 2549 H=2549:00 +CPU= 16.415
  22:38:24 STEP 2550 H=2550:00 +CPU= 25.451
  22:38:49 STEP 2551 H=2551:00 +CPU= 15.578
  22:39:18 STEP 2552 H=2552:00 +CPU= 17.147
  22:39:53 STEP 2553 H=2553:00 +CPU= 25.796
  22:40:22 STEP 2554 H=2554:00 +CPU= 17.749
  22:40:39 STEP 2555 H=2555:00 +CPU= 16.855
  22:41:08 STEP 2556 H=2556:00 +CPU= 29.453
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002556
  22:41:25 STEP 2557 H=2557:00 +CPU= 17.087
  22:41:42 STEP 2558 H=2558:00 +CPU= 17.162
  22:42:09 STEP 2559 H=2559:00 +CPU= 26.729
  22:42:27 STEP 2560 H=2560:00 +CPU= 17.840
  22:42:44 STEP 2561 H=2561:00 +CPU= 16.698
  22:43:11 STEP 2562 H=2562:00 +CPU= 27.902
  22:43:28 STEP 2563 H=2563:00 +CPU= 16.908
  22:43:46 STEP 2564 H=2564:00 +CPU= 17.503
  22:44:13 STEP 2565 H=2565:00 +CPU= 26.882
  22:44:30 STEP 2566 H=2566:00 +CPU= 17.539
  22:44:48 STEP 2567 H=2567:00 +CPU= 17.535
  22:45:22 STEP 2568 H=2568:00 +CPU= 29.955
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793_106.zip
Uploading the intermediate file: upload_file_106.zip
  22:45:39 STEP 2569 H=2569:00 +CPU= 16.573
  22:45:56 STEP 2570 H=2570:00 +CPU= 17.304
  22:46:23 STEP 2571 H=2571:00 +CPU= 26.972
  22:46:41 STEP 2572 H=2572:00 +CPU= 17.679
  22:46:58 STEP 2573 H=2573:00 +CPU= 16.949
  22:47:25 STEP 2574 H=2574:00 +CPU= 25.646
  22:47:42 STEP 2575 H=2575:00 +CPU= 17.244
  22:48:06 STEP 2576 H=2576:00 +CPU= 24.255
  22:48:35 STEP 2577 H=2577:00 +CPU= 27.077
  22:48:52 STEP 2578 H=2578:00 +CPU= 17.180
  22:49:09 STEP 2579 H=2579:00 +CPU= 16.431
  22:49:40 STEP 2580 H=2580:00 +CPU= 31.060
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002580
  22:49:58 STEP 2581 H=2581:00 +CPU= 17.249
  22:50:15 STEP 2582 H=2582:00 +CPU= 17.735
  22:50:42 STEP 2583 H=2583:00 +CPU= 26.801
  22:51:00 STEP 2584 H=2584:00 +CPU= 17.845
  22:51:17 STEP 2585 H=2585:00 +CPU= 16.688
  22:51:44 STEP 2586 H=2586:00 +CPU= 27.566
  22:52:01 STEP 2587 H=2587:00 +CPU= 16.865
  22:52:19 STEP 2588 H=2588:00 +CPU= 17.492
  22:52:46 STEP 2589 H=2589:00 +CPU= 27.052
  22:53:03 STEP 2590 H=2590:00 +CPU= 17.364
  22:53:20 STEP 2591 H=2591:00 +CPU= 17.428
  22:53:57 STEP 2592 H=2592:00 +CPU= 30.071
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793_107.zip
Uploading the intermediate file: upload_file_107.zip
  22:54:14 STEP 2593 H=2593:00 +CPU= 16.616
  22:54:30 STEP 2594 H=2594:00 +CPU= 16.798
  22:54:56 STEP 2595 H=2595:00 +CPU= 25.805
  22:55:16 STEP 2596 H=2596:00 +CPU= 16.412
  22:55:33 STEP 2597 H=2597:00 +CPU= 17.037
  22:56:00 STEP 2598 H=2598:00 +CPU= 26.925
  22:56:17 STEP 2599 H=2599:00 +CPU= 16.810
  22:56:37 STEP 2600 H=2600:00 +CPU= 16.914
  22:57:03 STEP 2601 H=2601:00 +CPU= 25.923
  22:57:21 STEP 2602 H=2602:00 +CPU= 17.159
  22:57:37 STEP 2603 H=2603:00 +CPU= 16.580
  22:58:07 STEP 2604 H=2604:00 +CPU= 29.671
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002604
  22:58:24 STEP 2605 H=2605:00 +CPU= 16.650
  22:58:41 STEP 2606 H=2606:00 +CPU= 17.205
  22:59:08 STEP 2607 H=2607:00 +CPU= 26.789
  22:59:25 STEP 2608 H=2608:00 +CPU= 17.138
  22:59:42 STEP 2609 H=2609:00 +CPU= 17.692
  23:00:10 STEP 2610 H=2610:00 +CPU= 27.619
  23:00:27 STEP 2611 H=2611:00 +CPU= 16.717
  23:00:44 STEP 2612 H=2612:00 +CPU= 17.260
  23:01:11 STEP 2613 H=2613:00 +CPU= 26.930
  23:01:28 STEP 2614 H=2614:00 +CPU= 17.301
  23:01:45 STEP 2615 H=2615:00 +CPU= 17.196
  23:02:29 STEP 2616 H=2616:00 +CPU= 29.768
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793_108.zip
Uploading the intermediate file: upload_file_108.zip
  23:02:46 STEP 2617 H=2617:00 +CPU= 17.162
  23:03:02 STEP 2618 H=2618:00 +CPU= 15.682
  23:03:29 STEP 2619 H=2619:00 +CPU= 27.308
  23:03:50 STEP 2620 H=2620:00 +CPU= 20.282
  23:04:07 STEP 2621 H=2621:00 +CPU= 17.431
  23:04:35 STEP 2622 H=2622:00 +CPU= 28.004
  23:04:53 STEP 2623 H=2623:00 +CPU= 17.494
  23:05:10 STEP 2624 H=2624:00 +CPU= 17.559
  23:05:37 STEP 2625 H=2625:00 +CPU= 26.384
  23:06:10 STEP 2626 H=2626:00 +CPU= 15.401
  23:06:58 STEP 2627 H=2627:00 +CPU= 19.109
  23:07:29 STEP 2628 H=2628:00 +CPU= 29.599
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002628
  23:07:47 STEP 2629 H=2629:00 +CPU= 17.457
  23:08:05 STEP 2630 H=2630:00 +CPU= 18.070
  23:08:31 STEP 2631 H=2631:00 +CPU= 25.618
  23:08:48 STEP 2632 H=2632:00 +CPU= 17.029
  23:09:05 STEP 2633 H=2633:00 +CPU= 17.022
  23:09:32 STEP 2634 H=2634:00 +CPU= 27.656
  23:09:49 STEP 2635 H=2635:00 +CPU= 16.957
  23:10:07 STEP 2636 H=2636:00 +CPU= 17.395
  23:10:34 STEP 2637 H=2637:00 +CPU= 27.485
  23:10:52 STEP 2638 H=2638:00 +CPU= 17.606
  23:11:10 STEP 2639 H=2639:00 +CPU= 18.218
  23:11:49 STEP 2640 H=2640:00 +CPU= 31.207
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793_109.zip
Uploading the intermediate file: upload_file_109.zip
  23:12:06 STEP 2641 H=2641:00 +CPU= 16.113
Uploading trickle at timestep: 9504000
  23:12:24 STEP 2642 H=2642:00 +CPU= 17.415
  23:12:51 STEP 2643 H=2643:00 +CPU= 27.220
  23:13:09 STEP 2644 H=2644:00 +CPU= 18.073
  23:13:41 STEP 2645 H=2645:00 +CPU= 16.274
  23:14:22 STEP 2646 H=2646:00 +CPU= 28.621
  23:14:38 STEP 2647 H=2647:00 +CPU= 16.529
  23:14:56 STEP 2648 H=2648:00 +CPU= 17.455
  23:16:17 STEP 2649 H=2649:00 +CPU= 26.455
  23:16:34 STEP 2650 H=2650:00 +CPU= 15.593
  23:16:51 STEP 2651 H=2651:00 +CPU= 16.913
  23:17:23 STEP 2652 H=2652:00 +CPU= 29.987
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002652
  23:17:41 STEP 2653 H=2653:00 +CPU= 17.236
  23:17:57 STEP 2654 H=2654:00 +CPU= 16.857
  23:18:25 STEP 2655 H=2655:00 +CPU= 27.147
  23:18:43 STEP 2656 H=2656:00 +CPU= 18.200
  23:19:02 STEP 2657 H=2657:00 +CPU= 18.748
  23:19:29 STEP 2658 H=2658:00 +CPU= 27.401
  23:19:56 STEP 2659 H=2659:00 +CPU= 26.776
  23:20:13 STEP 2660 H=2660:00 +CPU= 16.859
  23:20:36 STEP 2661 H=2661:00 +CPU= 20.567
  23:20:51 STEP 2662 H=2662:00 +CPU= 14.974
  23:21:08 STEP 2663 H=2663:00 +CPU= 17.051
  23:21:42 STEP 2664 H=2664:00 +CPU= 31.131
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793_110.zip
Uploading the intermediate file: upload_file_110.zip
  23:21:59 STEP 2665 H=2665:00 +CPU= 16.977
  23:22:28 STEP 2666 H=2666:00 +CPU= 16.439
  23:22:53 STEP 2667 H=2667:00 +CPU= 25.017
  23:23:18 STEP 2668 H=2668:00 +CPU= 16.904
  23:24:08 STEP 2669 H=2669:00 +CPU= 18.518
  23:24:38 STEP 2670 H=2670:00 +CPU= 26.441
  23:24:51 STEP 2671 H=2671:00 +CPU= 13.540
  23:25:09 STEP 2672 H=2672:00 +CPU= 17.288
  23:25:36 STEP 2673 H=2673:00 +CPU= 27.671
  23:25:54 STEP 2674 H=2674:00 +CPU= 17.555
  23:26:27 STEP 2675 H=2675:00 +CPU= 15.228
  23:27:00 STEP 2676 H=2676:00 +CPU= 30.107
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002676
  23:27:17 STEP 2677 H=2677:00 +CPU= 17.317
  23:27:35 STEP 2678 H=2678:00 +CPU= 18.159
  23:28:02 STEP 2679 H=2679:00 +CPU= 27.033
  23:28:20 STEP 2680 H=2680:00 +CPU= 17.424
  23:28:37 STEP 2681 H=2681:00 +CPU= 16.902
  23:29:04 STEP 2682 H=2682:00 +CPU= 27.747
  23:29:21 STEP 2683 H=2683:00 +CPU= 16.419
  23:29:38 STEP 2684 H=2684:00 +CPU= 17.057
  23:30:05 STEP 2685 H=2685:00 +CPU= 27.487
  23:30:23 STEP 2686 H=2686:00 +CPU= 17.816
  23:30:40 STEP 2687 H=2687:00 +CPU= 16.765
  23:31:30 STEP 2688 H=2688:00 +CPU= 31.625
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793_111.zip
Uploading the intermediate file: upload_file_111.zip
  23:31:47 STEP 2689 H=2689:00 +CPU= 16.890
  23:32:04 STEP 2690 H=2690:00 +CPU= 17.297
  23:32:39 STEP 2691 H=2691:00 +CPU= 25.888
  23:33:03 STEP 2692 H=2692:00 +CPU= 17.242
  23:33:34 STEP 2693 H=2693:00 +CPU= 14.462
  23:34:12 STEP 2694 H=2694:00 +CPU= 27.782
  23:34:30 STEP 2695 H=2695:00 +CPU= 17.462
  23:34:48 STEP 2696 H=2696:00 +CPU= 18.309
  23:35:15 STEP 2697 H=2697:00 +CPU= 27.394
  23:35:33 STEP 2698 H=2698:00 +CPU= 17.673
  23:35:51 STEP 2699 H=2699:00 +CPU= 18.150
  23:36:22 STEP 2700 H=2700:00 +CPU= 29.846
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002700
  23:36:40 STEP 2701 H=2701:00 +CPU= 17.364
  23:36:58 STEP 2702 H=2702:00 +CPU= 18.108
  23:37:25 STEP 2703 H=2703:00 +CPU= 27.157
  23:37:43 STEP 2704 H=2704:00 +CPU= 18.337
  23:38:01 STEP 2705 H=2705:00 +CPU= 17.282
  23:38:29 STEP 2706 H=2706:00 +CPU= 27.981
  23:38:46 STEP 2707 H=2707:00 +CPU= 17.692
  23:39:04 STEP 2708 H=2708:00 +CPU= 17.584
  23:39:31 STEP 2709 H=2709:00 +CPU= 27.041
  23:39:49 STEP 2710 H=2710:00 +CPU= 17.702
  23:40:08 STEP 2711 H=2711:00 +CPU= 18.277
  23:40:44 STEP 2712 H=2712:00 +CPU= 31.841
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793_112.zip
Uploading the intermediate file: upload_file_112.zip
  23:41:01 STEP 2713 H=2713:00 +CPU= 17.151
  23:41:19 STEP 2714 H=2714:00 +CPU= 17.319
  23:42:00 STEP 2715 H=2715:00 +CPU= 26.633
  23:43:11 STEP 2716 H=2716:00 +CPU= 17.591
  23:43:28 STEP 2717 H=2717:00 +CPU= 16.456
  23:44:08 STEP 2718 H=2718:00 +CPU= 27.570
  23:44:25 STEP 2719 H=2719:00 +CPU= 17.128
  23:44:42 STEP 2720 H=2720:00 +CPU= 17.784
  23:45:09 STEP 2721 H=2721:00 +CPU= 26.807
  23:45:27 STEP 2722 H=2722:00 +CPU= 17.658
  23:45:44 STEP 2723 H=2723:00 +CPU= 16.604
  23:46:18 STEP 2724 H=2724:00 +CPU= 27.328
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002724
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2005050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0115
(argv4) batchid: 974
(argv5) wuid: 12190759
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/8
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_8d9bbf12bcf63082184e79a06223f660 to: /var/lib/boinc-client/slots/8/oifs_43r3_ps_0115_2005050100_123_974_12190759.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/8/oifs_43r3_ps_0115_2005050100_123_974_12190759.zip
ic_ancil_file: ic_ancil_12190759
ifsdata_file: ifsdata_12190759
climate_data_file: clim_data_12190759
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_1fdc3ea5585f5cec333f756df4ed3036 to: /var/lib/boinc-client/slots/8/ic_ancil_12190759.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/8/ic_ancil_12190759.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_291cd3c3f652ea7e0e97b84eaffdb3bc to: /var/lib/boinc-client/slots/8/ifsdata/ifsdata_12190759.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/8/ifsdata/ifsdata_12190759.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/8/159l_2/clim_data_12190759.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/8/159l_2/clim_data_12190759.zip
Checking for progress XML file: /var/lib/boinc-client/slots/8/progress_file_12190759.xml
Opened progress file ok : /var/lib/boinc-client/slots/8/progress_file_12190759.xml
-- Model is restarting --
Adjusting last_iter, 2725, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/8/progress_file_12190759.xml
last_cpu_time: 56957
upload_file_number: 113
last_iter: 2711
last_upload: 9763200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793
The child process has been launched with process id: 30217
Executing the command: /var/lib/boinc-client/slots/8/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:X3900:1:1:30217:30217] [20221224:235357:1671922437:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  23:54:50 STEP 2712 H=2712:00 +CPU= 30.154
  23:55:07 STEP 2713 H=2713:00 +CPU= 16.214
  23:55:23 STEP 2714 H=2714:00 +CPU= 15.751
  23:56:02 STEP 2715 H=2715:00 +CPU= 23.492
  23:56:20 STEP 2716 H=2716:00 +CPU= 17.764
  23:56:37 STEP 2717 H=2717:00 +CPU= 16.947
  23:57:03 STEP 2718 H=2718:00 +CPU= 25.912
  23:57:15 STEP 2719 H=2719:00 +CPU= 12.185
  23:57:31 STEP 2720 H=2720:00 +CPU= 15.649
  23:57:59 STEP 2721 H=2721:00 +CPU= 27.896
  23:58:16 STEP 2722 H=2722:00 +CPU= 17.220
  23:58:33 STEP 2723 H=2723:00 +CPU= 17.139
  23:59:03 STEP 2724 H=2724:00 +CPU= 29.799
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002724
  23:59:20 STEP 2725 H=2725:00 +CPU= 16.741
  23:59:56 STEP 2726 H=2726:00 +CPU= 16.011
  00:01:20 STEP 2727 H=2727:00 +CPU= 28.678
  00:01:38 STEP 2728 H=2728:00 +CPU= 17.962
  00:01:54 STEP 2729 H=2729:00 +CPU= 16.726
  00:02:22 STEP 2730 H=2730:00 +CPU= 27.547
  00:02:48 STEP 2731 H=2731:00 +CPU= 14.660
  00:03:07 STEP 2732 H=2732:00 +CPU= 15.782
  00:03:49 STEP 2733 H=2733:00 +CPU= 24.342
  00:04:12 STEP 2734 H=2734:00 +CPU= 18.108
  00:04:30 STEP 2735 H=2735:00 +CPU= 15.694
  00:05:06 STEP 2736 H=2736:00 +CPU= 31.951
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793_113.zip
Uploading the intermediate file: upload_file_113.zip
  00:05:23 STEP 2737 H=2737:00 +CPU= 17.046
  00:05:56 STEP 2738 H=2738:00 +CPU= 17.246
  00:06:20 STEP 2739 H=2739:00 +CPU= 24.508
  00:06:38 STEP 2740 H=2740:00 +CPU= 17.805
  00:06:56 STEP 2741 H=2741:00 +CPU= 17.429
  00:07:24 STEP 2742 H=2742:00 +CPU= 28.014
  00:07:41 STEP 2743 H=2743:00 +CPU= 17.291
  00:07:58 STEP 2744 H=2744:00 +CPU= 17.443
  00:08:26 STEP 2745 H=2745:00 +CPU= 27.274
  00:08:44 STEP 2746 H=2746:00 +CPU= 18.040
  00:09:01 STEP 2747 H=2747:00 +CPU= 17.238
  00:09:31 STEP 2748 H=2748:00 +CPU= 29.914
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002748
  00:09:48 STEP 2749 H=2749:00 +CPU= 16.808
  00:10:06 STEP 2750 H=2750:00 +CPU= 17.604
  00:10:33 STEP 2751 H=2751:00 +CPU= 26.878
  00:10:51 STEP 2752 H=2752:00 +CPU= 17.786
  00:11:08 STEP 2753 H=2753:00 +CPU= 17.097
  00:11:36 STEP 2754 H=2754:00 +CPU= 27.683
  00:11:54 STEP 2755 H=2755:00 +CPU= 17.689
  00:12:13 STEP 2756 H=2756:00 +CPU= 17.957
  00:12:40 STEP 2757 H=2757:00 +CPU= 26.900
  00:12:58 STEP 2758 H=2758:00 +CPU= 18.090
  00:13:16 STEP 2759 H=2759:00 +CPU= 17.368
  00:13:49 STEP 2760 H=2760:00 +CPU= 30.249
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793_114.zip
  00:14:18 STEP 2761 H=2761:00 +CPU= 16.224
Uploading the intermediate file: upload_file_114.zip
  00:14:34 STEP 2762 H=2762:00 +CPU= 15.697
  00:15:01 STEP 2763 H=2763:00 +CPU= 26.879
  00:15:19 STEP 2764 H=2764:00 +CPU= 17.756
  00:15:35 STEP 2765 H=2765:00 +CPU= 16.620
  00:16:04 STEP 2766 H=2766:00 +CPU= 28.482
  00:16:21 STEP 2767 H=2767:00 +CPU= 17.001
  00:16:38 STEP 2768 H=2768:00 +CPU= 17.328
  00:17:05 STEP 2769 H=2769:00 +CPU= 27.122
  00:17:23 STEP 2770 H=2770:00 +CPU= 17.560
  00:17:40 STEP 2771 H=2771:00 +CPU= 17.210
  00:18:09 STEP 2772 H=2772:00 +CPU= 29.432
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002772
  00:18:34 STEP 2773 H=2773:00 +CPU= 12.998
  00:19:00 STEP 2774 H=2774:00 +CPU= 26.480
  00:19:27 STEP 2775 H=2775:00 +CPU= 27.093
  00:19:45 STEP 2776 H=2776:00 +CPU= 17.701
  00:20:03 STEP 2777 H=2777:00 +CPU= 17.539
  00:20:30 STEP 2778 H=2778:00 +CPU= 26.947
  00:20:48 STEP 2779 H=2779:00 +CPU= 18.052
  00:21:03 STEP 2780 H=2780:00 +CPU= 15.849
  00:21:53 STEP 2781 H=2781:00 +CPU= 25.173
  00:22:13 STEP 2782 H=2782:00 +CPU= 17.563
  00:22:31 STEP 2783 H=2783:00 +CPU= 17.644
  00:23:03 STEP 2784 H=2784:00 +CPU= 31.421
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793_115.zip
Uploading the intermediate file: upload_file_115.zip
  00:23:20 STEP 2785 H=2785:00 +CPU= 17.144
  00:23:38 STEP 2786 H=2786:00 +CPU= 18.084
  00:24:05 STEP 2787 H=2787:00 +CPU= 27.030
  00:24:23 STEP 2788 H=2788:00 +CPU= 17.659
  00:24:40 STEP 2789 H=2789:00 +CPU= 17.030
  00:25:08 STEP 2790 H=2790:00 +CPU= 27.856
  00:25:26 STEP 2791 H=2791:00 +CPU= 17.216
  00:25:43 STEP 2792 H=2792:00 +CPU= 16.979
  00:26:10 STEP 2793 H=2793:00 +CPU= 27.168
  00:26:27 STEP 2794 H=2794:00 +CPU= 17.254
  00:26:44 STEP 2795 H=2795:00 +CPU= 17.136
  00:27:13 STEP 2796 H=2796:00 +CPU= 29.123
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002796
  00:27:30 STEP 2797 H=2797:00 +CPU= 17.232
  00:27:49 STEP 2798 H=2798:00 +CPU= 18.095
  00:28:16 STEP 2799 H=2799:00 +CPU= 27.442
  00:28:34 STEP 2800 H=2800:00 +CPU= 17.912
  00:28:51 STEP 2801 H=2801:00 +CPU= 17.010
  00:29:19 STEP 2802 H=2802:00 +CPU= 27.193
  00:29:36 STEP 2803 H=2803:00 +CPU= 16.814
  00:29:54 STEP 2804 H=2804:00 +CPU= 18.192
  00:30:18 STEP 2805 H=2805:00 +CPU= 22.736
  00:30:35 STEP 2806 H=2806:00 +CPU= 17.481
  00:30:53 STEP 2807 H=2807:00 +CPU= 17.902
  00:31:25 STEP 2808 H=2808:00 +CPU= 31.075
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793_116.zip
Uploading the intermediate file: upload_file_116.zip
  00:31:42 STEP 2809 H=2809:00 +CPU= 17.030
  00:32:04 STEP 2810 H=2810:00 +CPU= 17.045
  00:32:32 STEP 2811 H=2811:00 +CPU= 27.934
  00:32:50 STEP 2812 H=2812:00 +CPU= 17.868
  00:33:08 STEP 2813 H=2813:00 +CPU= 17.884
  00:33:36 STEP 2814 H=2814:00 +CPU= 27.721
  00:33:53 STEP 2815 H=2815:00 +CPU= 16.945
  00:34:10 STEP 2816 H=2816:00 +CPU= 17.508
  00:34:37 STEP 2817 H=2817:00 +CPU= 27.154
  00:34:55 STEP 2818 H=2818:00 +CPU= 17.251
  00:35:12 STEP 2819 H=2819:00 +CPU= 16.997
  00:35:41 STEP 2820 H=2820:00 +CPU= 29.762
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002820
  00:35:59 STEP 2821 H=2821:00 +CPU= 17.323
  00:36:17 STEP 2822 H=2822:00 +CPU= 18.037
  00:36:41 STEP 2823 H=2823:00 +CPU= 24.164
  00:36:59 STEP 2824 H=2824:00 +CPU= 17.574
  00:37:16 STEP 2825 H=2825:00 +CPU= 17.424
  00:37:44 STEP 2826 H=2826:00 +CPU= 27.375
  00:38:01 STEP 2827 H=2827:00 +CPU= 17.139
  00:38:19 STEP 2828 H=2828:00 +CPU= 17.732
  00:38:53 STEP 2829 H=2829:00 +CPU= 23.005
  00:39:11 STEP 2830 H=2830:00 +CPU= 17.837
  00:39:29 STEP 2831 H=2831:00 +CPU= 17.019
  00:40:03 STEP 2832 H=2832:00 +CPU= 30.445
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793_117.zip
Uploading the intermediate file: upload_file_117.zip
  00:40:19 STEP 2833 H=2833:00 +CPU= 16.800
  00:40:37 STEP 2834 H=2834:00 +CPU= 17.507
  00:41:05 STEP 2835 H=2835:00 +CPU= 27.182
  00:41:22 STEP 2836 H=2836:00 +CPU= 16.474
  00:41:40 STEP 2837 H=2837:00 +CPU= 17.315
  00:42:07 STEP 2838 H=2838:00 +CPU= 27.731
  00:42:25 STEP 2839 H=2839:00 +CPU= 17.249
  00:42:42 STEP 2840 H=2840:00 +CPU= 17.523
  00:43:13 STEP 2841 H=2841:00 +CPU= 30.508
  00:43:31 STEP 2842 H=2842:00 +CPU= 17.990
  00:43:48 STEP 2843 H=2843:00 +CPU= 17.685
  00:44:31 STEP 2844 H=2844:00 +CPU= 30.136
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002844
  00:44:47 STEP 2845 H=2845:00 +CPU= 16.320
  00:45:05 STEP 2846 H=2846:00 +CPU= 17.324
  00:45:32 STEP 2847 H=2847:00 +CPU= 27.476
  00:45:50 STEP 2848 H=2848:00 +CPU= 17.799
  00:46:07 STEP 2849 H=2849:00 +CPU= 16.968
  00:46:35 STEP 2850 H=2850:00 +CPU= 27.719
  00:46:52 STEP 2851 H=2851:00 +CPU= 17.615
  00:47:10 STEP 2852 H=2852:00 +CPU= 17.566
  00:47:36 STEP 2853 H=2853:00 +CPU= 24.990
  00:47:55 STEP 2854 H=2854:00 +CPU= 17.835
  00:48:15 STEP 2855 H=2855:00 +CPU= 17.419
  00:48:53 STEP 2856 H=2856:00 +CPU= 30.265
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793_118.zip
Uploading the intermediate file: upload_file_118.zip
  00:49:11 STEP 2857 H=2857:00 +CPU= 17.568
  00:49:28 STEP 2858 H=2858:00 +CPU= 17.321
  00:49:55 STEP 2859 H=2859:00 +CPU= 26.773
  00:50:13 STEP 2860 H=2860:00 +CPU= 17.505
  00:50:30 STEP 2861 H=2861:00 +CPU= 17.006
  00:50:58 STEP 2862 H=2862:00 +CPU= 28.377
  00:51:15 STEP 2863 H=2863:00 +CPU= 17.220
  00:51:33 STEP 2864 H=2864:00 +CPU= 17.970
  00:52:01 STEP 2865 H=2865:00 +CPU= 28.021
  00:52:19 STEP 2866 H=2866:00 +CPU= 17.963
  00:52:38 STEP 2867 H=2867:00 +CPU= 16.718
  00:53:07 STEP 2868 H=2868:00 +CPU= 29.578
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002868
  00:53:24 STEP 2869 H=2869:00 +CPU= 16.579
  00:53:42 STEP 2870 H=2870:00 +CPU= 17.763
  00:54:09 STEP 2871 H=2871:00 +CPU= 27.055
  00:54:26 STEP 2872 H=2872:00 +CPU= 17.772
  00:54:44 STEP 2873 H=2873:00 +CPU= 17.212
  00:55:12 STEP 2874 H=2874:00 +CPU= 28.329
  00:55:28 STEP 2875 H=2875:00 +CPU= 16.557
  00:55:46 STEP 2876 H=2876:00 +CPU= 17.842
  00:56:09 STEP 2877 H=2877:00 +CPU= 21.588
  00:56:33 STEP 2878 H=2878:00 +CPU= 17.867
  00:56:51 STEP 2879 H=2879:00 +CPU= 17.732
  00:57:22 STEP 2880 H=2880:00 +CPU= 31.567
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793_119.zip
Uploading the intermediate file: upload_file_119.zip
  00:57:40 STEP 2881 H=2881:00 +CPU= 17.955
  00:57:58 STEP 2882 H=2882:00 +CPU= 17.380
  00:58:22 STEP 2883 H=2883:00 +CPU= 24.217
  00:58:41 STEP 2884 H=2884:00 +CPU= 17.185
  00:58:59 STEP 2885 H=2885:00 +CPU= 16.798
  00:59:27 STEP 2886 H=2886:00 +CPU= 28.309
  00:59:45 STEP 2887 H=2887:00 +CPU= 17.447
  01:00:03 STEP 2888 H=2888:00 +CPU= 17.726
  01:00:30 STEP 2889 H=2889:00 +CPU= 27.616
  01:00:48 STEP 2890 H=2890:00 +CPU= 17.850
  01:01:05 STEP 2891 H=2891:00 +CPU= 16.885
  01:01:34 STEP 2892 H=2892:00 +CPU= 28.727
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002892
  01:01:52 STEP 2893 H=2893:00 +CPU= 17.887
  01:02:10 STEP 2894 H=2894:00 +CPU= 17.865
  01:02:38 STEP 2895 H=2895:00 +CPU= 27.910
  01:02:55 STEP 2896 H=2896:00 +CPU= 17.123
  01:03:13 STEP 2897 H=2897:00 +CPU= 18.107
  01:03:41 STEP 2898 H=2898:00 +CPU= 27.612
  01:03:58 STEP 2899 H=2899:00 +CPU= 16.874
  01:04:15 STEP 2900 H=2900:00 +CPU= 17.648
  01:04:42 STEP 2901 H=2901:00 +CPU= 27.008
  01:05:00 STEP 2902 H=2902:00 +CPU= 17.511
  01:05:18 STEP 2903 H=2903:00 +CPU= 18.008
  01:05:51 STEP 2904 H=2904:00 +CPU= 31.835
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793_120.zip
Uploading the intermediate file: upload_file_120.zip
  01:06:08 STEP 2905 H=2905:00 +CPU= 17.113
  01:06:25 STEP 2906 H=2906:00 +CPU= 17.557
  01:06:52 STEP 2907 H=2907:00 +CPU= 26.780
  01:07:22 STEP 2908 H=2908:00 +CPU= 16.142
  01:07:41 STEP 2909 H=2909:00 +CPU= 14.644
  01:08:11 STEP 2910 H=2910:00 +CPU= 24.247
  01:08:27 STEP 2911 H=2911:00 +CPU= 16.276
  01:08:45 STEP 2912 H=2912:00 +CPU= 17.658
  01:09:11 STEP 2913 H=2913:00 +CPU= 26.259
  01:09:29 STEP 2914 H=2914:00 +CPU= 17.371
  01:09:47 STEP 2915 H=2915:00 +CPU= 18.288
  01:10:17 STEP 2916 H=2916:00 +CPU= 29.673
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002916
  01:10:34 STEP 2917 H=2917:00 +CPU= 17.200
  01:10:51 STEP 2918 H=2918:00 +CPU= 17.287
  01:11:15 STEP 2919 H=2919:00 +CPU= 23.800
  01:11:33 STEP 2920 H=2920:00 +CPU= 17.769
  01:11:50 STEP 2921 H=2921:00 +CPU= 16.799
  01:12:17 STEP 2922 H=2922:00 +CPU= 27.520
  01:12:35 STEP 2923 H=2923:00 +CPU= 16.440
  01:12:53 STEP 2924 H=2924:00 +CPU= 17.909
  01:13:20 STEP 2925 H=2925:00 +CPU= 26.931
  01:13:36 STEP 2926 H=2926:00 +CPU= 16.478
  01:13:54 STEP 2927 H=2927:00 +CPU= 17.507
  01:14:29 STEP 2928 H=2928:00 +CPU= 31.755
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793_121.zip
Uploading the intermediate file: upload_file_121.zip
  01:14:45 STEP 2929 H=2929:00 +CPU= 16.938
  01:15:04 STEP 2930 H=2930:00 +CPU= 18.184
  01:15:31 STEP 2931 H=2931:00 +CPU= 27.295
  01:15:53 STEP 2932 H=2932:00 +CPU= 17.381
  01:16:10 STEP 2933 H=2933:00 +CPU= 16.483
  01:16:44 STEP 2934 H=2934:00 +CPU= 27.488
  01:17:01 STEP 2935 H=2935:00 +CPU= 17.029
  01:17:19 STEP 2936 H=2936:00 +CPU= 17.940
  01:17:47 STEP 2937 H=2937:00 +CPU= 27.267
  01:18:04 STEP 2938 H=2938:00 +CPU= 17.459
  01:18:21 STEP 2939 H=2939:00 +CPU= 16.410
  01:18:51 STEP 2940 H=2940:00 +CPU= 29.919
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002940
  01:19:08 STEP 2941 H=2941:00 +CPU= 17.004
  01:19:26 STEP 2942 H=2942:00 +CPU= 18.284
  01:19:53 STEP 2943 H=2943:00 +CPU= 27.257
  01:20:11 STEP 2944 H=2944:00 +CPU= 17.425
  01:20:29 STEP 2945 H=2945:00 +CPU= 17.421
  01:20:56 STEP 2946 H=2946:00 +CPU= 26.812
  01:21:12 STEP 2947 H=2947:00 +CPU= 15.459
  01:21:29 STEP 2948 H=2948:00 +CPU= 17.113
  01:21:57 STEP 2949 H=2949:00 +CPU= 27.387
  01:22:15 STEP 2950 H=2950:00 +CPU= 17.930
  01:22:32 STEP 2951 H=2951:00 +CPU= 17.103
  01:23:10 STEP 2952 H=2952:00 +CPU= 28.452
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190759/ICMSHhq0f+002928
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0115_2005050100_123_974_12190759_0_r638340793_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
01:26:34 (30208): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:53:38 1524986 22276410 oifs_43r3_ps_0115_2005050100_123_974_12190759_0 10,623,600 61,961 0.0058
09 May 2023 15:53:24 1524986 22276410 oifs_43r3_ps_0115_2005050100_123_974_12190759_0 9,504,000 55,214 0.0058
09 May 2023 15:53:17 1524986 22276410 oifs_43r3_ps_0115_2005050100_123_974_12190759_0 8,640,000 50,097 0.0058
09 May 2023 15:53:03 1524986 22276410 oifs_43r3_ps_0115_2005050100_123_974_12190759_0 7,776,000 44,994 0.0058
09 May 2023 15:52:56 1524986 22276410 oifs_43r3_ps_0115_2005050100_123_974_12190759_0 6,912,000 39,976 0.0058
09 May 2023 15:52:44 1524986 22276410 oifs_43r3_ps_0115_2005050100_123_974_12190759_0 6,048,000 34,922 0.0058
09 May 2023 15:52:32 1524986 22276410 oifs_43r3_ps_0115_2005050100_123_974_12190759_0 5,184,000 29,767 0.0057
09 May 2023 15:52:26 1524986 22276410 oifs_43r3_ps_0115_2005050100_123_974_12190759_0 4,320,000 24,777 0.0057
09 May 2023 15:52:13 1524986 22276410 oifs_43r3_ps_0115_2005050100_123_974_12190759_0 3,456,000 19,654 0.0057
09 May 2023 15:52:08 1524986 22276410 oifs_43r3_ps_0115_2005050100_123_974_12190759_0 2,592,000 14,610 0.0056
09 May 2023 15:51:56 1524986 22276410 oifs_43r3_ps_0115_2005050100_123_974_12190759_0 1,728,000 9,543 0.0055
09 May 2023 15:51:51 1524986 22276410 oifs_43r3_ps_0115_2005050100_123_974_12190759_0 864,000 4,742 0.0055


©2024 climateprediction.net