climateprediction.net home page
Task 22294332

Task 22294332

Name oifs_43r3_ps_0690_2004050100_123_973_12190334_1
Workunit 12190334
Created 29 Dec 2022, 16:11:49 UTC
Sent 29 Dec 2022, 16:24:10 UTC
Report deadline 28 Jan 2023, 16:24:10 UTC
Received 16 Jan 2023, 21:47:17 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1491072
Run time 1 days 7 hours 31 min 3 sec
CPU time 1 days 7 hours 7 min 56 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 4.70 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,546.05 MB
Peak swap size 4,977.99 MB
Peak disk usage 3,762.97 MB
Stderr
<core_client_version>7.16.16</core_client_version>
<![CDATA[
<stderr_txt>
_r181576556_104.zip
Uploading the intermediate file: upload_file_104.zip
  19:07:40 STEP 2521 H=2521:00 +CPU= 30.718
  19:08:12 STEP 2522 H=2522:00 +CPU= 31.780
  19:09:00 STEP 2523 H=2523:00 +CPU= 47.422
  19:09:32 STEP 2524 H=2524:00 +CPU= 31.806
  19:10:03 STEP 2525 H=2525:00 +CPU= 30.839
  19:10:52 STEP 2526 H=2526:00 +CPU= 48.525
  19:11:23 STEP 2527 H=2527:00 +CPU= 30.956
  19:11:56 STEP 2528 H=2528:00 +CPU= 31.928
  19:12:44 STEP 2529 H=2529:00 +CPU= 47.640
  19:13:16 STEP 2530 H=2530:00 +CPU= 31.893
  19:13:47 STEP 2531 H=2531:00 +CPU= 30.741
  19:14:40 STEP 2532 H=2532:00 +CPU= 52.818
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002532
  19:15:12 STEP 2533 H=2533:00 +CPU= 31.275
  19:15:44 STEP 2534 H=2534:00 +CPU= 31.712
  19:16:32 STEP 2535 H=2535:00 +CPU= 48.011
  19:17:05 STEP 2536 H=2536:00 +CPU= 31.876
  19:17:37 STEP 2537 H=2537:00 +CPU= 31.512
  19:18:24 STEP 2538 H=2538:00 +CPU= 47.401
  19:18:51 STEP 2539 H=2539:00 +CPU= 26.737
  19:19:20 STEP 2540 H=2540:00 +CPU= 28.238
  19:20:02 STEP 2541 H=2541:00 +CPU= 42.233
  19:20:30 STEP 2542 H=2542:00 +CPU= 27.713
  19:20:58 STEP 2543 H=2543:00 +CPU= 27.649
  19:21:47 STEP 2544 H=2544:00 +CPU= 49.050
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0690_2004050100_123_973_12190334_1_r181576556_105.zip
Uploading the intermediate file: upload_file_105.zip
  19:22:17 STEP 2545 H=2545:00 +CPU= 29.484
  19:22:53 STEP 2546 H=2546:00 +CPU= 35.291
  19:23:47 STEP 2547 H=2547:00 +CPU= 53.738
  19:24:21 STEP 2548 H=2548:00 +CPU= 33.679
  19:24:57 STEP 2549 H=2549:00 +CPU= 34.850
  19:25:53 STEP 2550 H=2550:00 +CPU= 55.569
  19:26:28 STEP 2551 H=2551:00 +CPU= 35.287
  19:27:04 STEP 2552 H=2552:00 +CPU= 34.968
  19:27:59 STEP 2553 H=2553:00 +CPU= 54.730
  19:28:35 STEP 2554 H=2554:00 +CPU= 35.483
  19:29:09 STEP 2555 H=2555:00 +CPU= 33.058
  19:30:07 STEP 2556 H=2556:00 +CPU= 58.005
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002556
  19:30:39 STEP 2557 H=2557:00 +CPU= 31.716
  19:31:16 STEP 2558 H=2558:00 +CPU= 36.521
  19:32:12 STEP 2559 H=2559:00 +CPU= 54.755
  19:32:49 STEP 2560 H=2560:00 +CPU= 36.493
  19:33:23 STEP 2561 H=2561:00 +CPU= 33.586
  19:34:19 STEP 2562 H=2562:00 +CPU= 55.336
  19:34:50 STEP 2563 H=2563:00 +CPU= 31.154
  19:35:23 STEP 2564 H=2564:00 +CPU= 32.237
  19:36:12 STEP 2565 H=2565:00 +CPU= 49.314
  19:36:45 STEP 2566 H=2566:00 +CPU= 32.237
  19:37:21 STEP 2567 H=2567:00 +CPU= 35.132
  19:38:20 STEP 2568 H=2568:00 +CPU= 58.370
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0690_2004050100_123_973_12190334_1_r181576556_106.zip
Uploading the intermediate file: upload_file_106.zip
  19:38:50 STEP 2569 H=2569:00 +CPU= 30.311
  19:39:23 STEP 2570 H=2570:00 +CPU= 31.895
  19:40:12 STEP 2571 H=2571:00 +CPU= 49.059
  19:40:48 STEP 2572 H=2572:00 +CPU= 35.347
  19:41:24 STEP 2573 H=2573:00 +CPU= 35.546
  19:42:20 STEP 2574 H=2574:00 +CPU= 55.480
  19:42:56 STEP 2575 H=2575:00 +CPU= 35.802
  19:43:32 STEP 2576 H=2576:00 +CPU= 35.724
  19:44:24 STEP 2577 H=2577:00 +CPU= 51.407
  19:45:01 STEP 2578 H=2578:00 +CPU= 36.501
  19:45:36 STEP 2579 H=2579:00 +CPU= 34.938
  19:46:39 STEP 2580 H=2580:00 +CPU= 61.635
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002580
  19:47:15 STEP 2581 H=2581:00 +CPU= 35.389
  19:47:51 STEP 2582 H=2582:00 +CPU= 36.193
  19:48:43 STEP 2583 H=2583:00 +CPU= 51.567
  19:49:15 STEP 2584 H=2584:00 +CPU= 31.646
  19:49:47 STEP 2585 H=2585:00 +CPU= 31.176
  19:50:40 STEP 2586 H=2586:00 +CPU= 52.937
  19:51:15 STEP 2587 H=2587:00 +CPU= 34.509
  19:51:48 STEP 2588 H=2588:00 +CPU= 32.060
  19:52:37 STEP 2589 H=2589:00 +CPU= 48.511
  19:53:08 STEP 2590 H=2590:00 +CPU= 30.836
  19:53:40 STEP 2591 H=2591:00 +CPU= 31.605
  19:54:36 STEP 2592 H=2592:00 +CPU= 55.396
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0690_2004050100_123_973_12190334_1_r181576556_107.zip
Uploading the intermediate file: upload_file_107.zip
  19:55:07 STEP 2593 H=2593:00 +CPU= 30.653
  19:55:39 STEP 2594 H=2594:00 +CPU= 31.353
  19:56:27 STEP 2595 H=2595:00 +CPU= 48.355
  19:57:00 STEP 2596 H=2596:00 +CPU= 31.708
  19:57:34 STEP 2597 H=2597:00 +CPU= 34.539
  19:58:34 STEP 2598 H=2598:00 +CPU= 59.249
  19:59:10 STEP 2599 H=2599:00 +CPU= 35.575
  19:59:49 STEP 2600 H=2600:00 +CPU= 37.737
  20:00:47 STEP 2601 H=2601:00 +CPU= 57.623
  20:01:23 STEP 2602 H=2602:00 +CPU= 35.994
  20:01:56 STEP 2603 H=2603:00 +CPU= 32.296
  20:02:56 STEP 2604 H=2604:00 +CPU= 59.540
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002604
  20:03:30 STEP 2605 H=2605:00 +CPU= 33.471
  20:04:04 STEP 2606 H=2606:00 +CPU= 33.743
  20:04:57 STEP 2607 H=2607:00 +CPU= 51.807
  20:05:30 STEP 2608 H=2608:00 +CPU= 32.568
  20:06:04 STEP 2609 H=2609:00 +CPU= 34.162
  20:07:00 STEP 2610 H=2610:00 +CPU= 54.956
  20:07:35 STEP 2611 H=2611:00 +CPU= 34.392
  20:08:10 STEP 2612 H=2612:00 +CPU= 35.353
  20:09:02 STEP 2613 H=2613:00 +CPU= 51.547
  20:09:35 STEP 2614 H=2614:00 +CPU= 32.121
  20:10:07 STEP 2615 H=2615:00 +CPU= 31.768
  20:11:03 STEP 2616 H=2616:00 +CPU= 55.918
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0690_2004050100_123_973_12190334_1_r181576556_108.zip
Uploading the intermediate file: upload_file_108.zip
  20:11:35 STEP 2617 H=2617:00 +CPU= 30.829
  20:12:09 STEP 2618 H=2618:00 +CPU= 33.721
  20:12:58 STEP 2619 H=2619:00 +CPU= 49.031
  20:13:30 STEP 2620 H=2620:00 +CPU= 31.674
  20:14:01 STEP 2621 H=2621:00 +CPU= 29.978
  20:14:52 STEP 2622 H=2622:00 +CPU= 50.854
  20:15:27 STEP 2623 H=2623:00 +CPU= 34.834
  20:16:04 STEP 2624 H=2624:00 +CPU= 36.662
  20:16:59 STEP 2625 H=2625:00 +CPU= 54.058
  20:17:36 STEP 2626 H=2626:00 +CPU= 36.558
  20:18:09 STEP 2627 H=2627:00 +CPU= 32.352
  20:19:08 STEP 2628 H=2628:00 +CPU= 58.472
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002628
  20:19:42 STEP 2629 H=2629:00 +CPU= 34.051
  20:20:18 STEP 2630 H=2630:00 +CPU= 35.463
  20:21:13 STEP 2631 H=2631:00 +CPU= 54.044
  20:21:49 STEP 2632 H=2632:00 +CPU= 35.250
  20:22:23 STEP 2633 H=2633:00 +CPU= 34.141
  20:23:14 STEP 2634 H=2634:00 +CPU= 50.192
  20:23:45 STEP 2635 H=2635:00 +CPU= 30.884
  20:24:19 STEP 2636 H=2636:00 +CPU= 33.156
  20:25:11 STEP 2637 H=2637:00 +CPU= 51.884
  20:25:45 STEP 2638 H=2638:00 +CPU= 33.501
  20:26:17 STEP 2639 H=2639:00 +CPU= 31.602
  20:27:12 STEP 2640 H=2640:00 +CPU= 54.557
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0690_2004050100_123_973_12190334_1_r181576556_109.zip
Uploading the intermediate file: upload_file_109.zip
Uploading trickle at timestep: 9504000
  20:27:43 STEP 2641 H=2641:00 +CPU= 30.091
  20:28:13 STEP 2642 H=2642:00 +CPU= 30.219
  20:29:01 STEP 2643 H=2643:00 +CPU= 47.544
  20:29:32 STEP 2644 H=2644:00 +CPU= 30.386
  20:30:03 STEP 2645 H=2645:00 +CPU= 30.490
  20:30:51 STEP 2646 H=2646:00 +CPU= 48.192
  20:31:21 STEP 2647 H=2647:00 +CPU= 29.884
  20:31:53 STEP 2648 H=2648:00 +CPU= 30.840
  20:32:41 STEP 2649 H=2649:00 +CPU= 47.572
  20:33:13 STEP 2650 H=2650:00 +CPU= 31.999
  20:33:43 STEP 2651 H=2651:00 +CPU= 29.319
  20:34:35 STEP 2652 H=2652:00 +CPU= 52.017
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002652
  20:35:05 STEP 2653 H=2653:00 +CPU= 29.346
  20:35:34 STEP 2654 H=2654:00 +CPU= 28.990
  20:36:19 STEP 2655 H=2655:00 +CPU= 44.463
  20:36:48 STEP 2656 H=2656:00 +CPU= 28.735
  20:37:16 STEP 2657 H=2657:00 +CPU= 28.024
  20:38:02 STEP 2658 H=2658:00 +CPU= 45.257
  20:38:30 STEP 2659 H=2659:00 +CPU= 27.922
  20:39:00 STEP 2660 H=2660:00 +CPU= 29.187
  20:39:44 STEP 2661 H=2661:00 +CPU= 44.092
  20:40:13 STEP 2662 H=2662:00 +CPU= 29.191
  20:40:43 STEP 2663 H=2663:00 +CPU= 29.202
  20:41:35 STEP 2664 H=2664:00 +CPU= 51.309
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0690_2004050100_123_973_12190334_1_r181576556_110.zip
Uploading the intermediate file: upload_file_110.zip
  20:42:03 STEP 2665 H=2665:00 +CPU= 28.062
  20:42:32 STEP 2666 H=2666:00 +CPU= 29.104
  20:43:17 STEP 2667 H=2667:00 +CPU= 44.109
  20:43:46 STEP 2668 H=2668:00 +CPU= 29.101
  20:44:15 STEP 2669 H=2669:00 +CPU= 28.098
  20:45:00 STEP 2670 H=2670:00 +CPU= 45.093
  20:45:28 STEP 2671 H=2671:00 +CPU= 27.941
  20:45:58 STEP 2672 H=2672:00 +CPU= 29.088
  20:46:43 STEP 2673 H=2673:00 +CPU= 44.481
  20:47:12 STEP 2674 H=2674:00 +CPU= 29.079
  20:47:40 STEP 2675 H=2675:00 +CPU= 28.023
  20:48:29 STEP 2676 H=2676:00 +CPU= 48.833
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002676
  20:48:58 STEP 2677 H=2677:00 +CPU= 28.483
  20:49:28 STEP 2678 H=2678:00 +CPU= 29.199
  20:50:12 STEP 2679 H=2679:00 +CPU= 44.042
  20:50:41 STEP 2680 H=2680:00 +CPU= 28.835
  20:51:09 STEP 2681 H=2681:00 +CPU= 27.982
  20:51:55 STEP 2682 H=2682:00 +CPU= 45.287
  20:52:24 STEP 2683 H=2683:00 +CPU= 28.087
  20:52:53 STEP 2684 H=2684:00 +CPU= 28.763
  20:53:37 STEP 2685 H=2685:00 +CPU= 44.161
  20:54:06 STEP 2686 H=2686:00 +CPU= 29.011
  20:54:36 STEP 2687 H=2687:00 +CPU= 29.284
  20:55:28 STEP 2688 H=2688:00 +CPU= 51.674
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0690_2004050100_123_973_12190334_1_r181576556_111.zip
Uploading the intermediate file: upload_file_111.zip
  20:55:57 STEP 2689 H=2689:00 +CPU= 27.970
  20:56:26 STEP 2690 H=2690:00 +CPU= 28.867
  20:57:10 STEP 2691 H=2691:00 +CPU= 44.195
  20:57:40 STEP 2692 H=2692:00 +CPU= 29.041
  20:58:08 STEP 2693 H=2693:00 +CPU= 27.960
  20:58:54 STEP 2694 H=2694:00 +CPU= 45.446
  20:59:22 STEP 2695 H=2695:00 +CPU= 28.218
  20:59:51 STEP 2696 H=2696:00 +CPU= 28.903
  21:00:35 STEP 2697 H=2697:00 +CPU= 43.818
  21:01:05 STEP 2698 H=2698:00 +CPU= 28.959
  21:01:33 STEP 2699 H=2699:00 +CPU= 28.025
  21:02:22 STEP 2700 H=2700:00 +CPU= 49.304
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002700
  21:02:51 STEP 2701 H=2701:00 +CPU= 28.135
  21:03:20 STEP 2702 H=2702:00 +CPU= 29.031
  21:04:05 STEP 2703 H=2703:00 +CPU= 44.073
  21:04:34 STEP 2704 H=2704:00 +CPU= 29.093
  21:05:02 STEP 2705 H=2705:00 +CPU= 27.997
  21:05:48 STEP 2706 H=2706:00 +CPU= 45.378
  21:06:16 STEP 2707 H=2707:00 +CPU= 28.317
  21:06:46 STEP 2708 H=2708:00 +CPU= 29.139
  21:07:30 STEP 2709 H=2709:00 +CPU= 43.917
  21:07:59 STEP 2710 H=2710:00 +CPU= 28.629
  21:08:28 STEP 2711 H=2711:00 +CPU= 29.172
  21:09:20 STEP 2712 H=2712:00 +CPU= 51.335
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0690_2004050100_123_973_12190334_1_r181576556_112.zip
Uploading the intermediate file: upload_file_112.zip
  21:09:49 STEP 2713 H=2713:00 +CPU= 28.226
  21:10:18 STEP 2714 H=2714:00 +CPU= 29.033
  21:11:03 STEP 2715 H=2715:00 +CPU= 43.969
  21:11:32 STEP 2716 H=2716:00 +CPU= 29.094
  21:12:00 STEP 2717 H=2717:00 +CPU= 28.140
  21:12:46 STEP 2718 H=2718:00 +CPU= 45.463
  21:13:15 STEP 2719 H=2719:00 +CPU= 28.217
  21:13:44 STEP 2720 H=2720:00 +CPU= 29.071
  21:14:29 STEP 2721 H=2721:00 +CPU= 44.148
  21:14:58 STEP 2722 H=2722:00 +CPU= 28.962
  21:15:26 STEP 2723 H=2723:00 +CPU= 28.193
  21:16:16 STEP 2724 H=2724:00 +CPU= 49.142
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002724
  21:16:45 STEP 2725 H=2725:00 +CPU= 28.561
  21:17:14 STEP 2726 H=2726:00 +CPU= 28.884
  21:17:58 STEP 2727 H=2727:00 +CPU= 44.028
  21:18:27 STEP 2728 H=2728:00 +CPU= 28.881
  21:18:56 STEP 2729 H=2729:00 +CPU= 28.090
  21:19:41 STEP 2730 H=2730:00 +CPU= 45.251
  21:20:10 STEP 2731 H=2731:00 +CPU= 28.188
  21:20:39 STEP 2732 H=2732:00 +CPU= 28.999
  21:21:23 STEP 2733 H=2733:00 +CPU= 43.794
  21:21:53 STEP 2734 H=2734:00 +CPU= 28.913
  21:22:22 STEP 2735 H=2735:00 +CPU= 28.961
  21:23:14 STEP 2736 H=2736:00 +CPU= 51.491
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0690_2004050100_123_973_12190334_1_r181576556_113.zip
Uploading the intermediate file: upload_file_113.zip
  21:23:42 STEP 2737 H=2737:00 +CPU= 28.233
  21:24:12 STEP 2738 H=2738:00 +CPU= 29.119
  21:24:56 STEP 2739 H=2739:00 +CPU= 44.303
  21:25:26 STEP 2740 H=2740:00 +CPU= 29.016
  21:25:54 STEP 2741 H=2741:00 +CPU= 27.770
  21:26:40 STEP 2742 H=2742:00 +CPU= 45.453
  21:27:08 STEP 2743 H=2743:00 +CPU= 28.236
  21:27:38 STEP 2744 H=2744:00 +CPU= 29.238
  21:28:22 STEP 2745 H=2745:00 +CPU= 44.273
  21:28:52 STEP 2746 H=2746:00 +CPU= 29.120
  21:29:20 STEP 2747 H=2747:00 +CPU= 28.190
  21:30:09 STEP 2748 H=2748:00 +CPU= 48.910
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002748
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2004050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0690
(argv4) batchid: 973
(argv5) wuid: 12190334
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/0
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_8dd7b8b135f9c649d96db7cbdddd1639 to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0690_2004050100_123_973_12190334.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0690_2004050100_123_973_12190334.zip
ic_ancil_file: ic_ancil_12190334
ifsdata_file: ifsdata_12190334
climate_data_file: clim_data_12190334
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_557342088a27623ee9e1d9410da8f36b to: /var/lib/boinc-client/slots/0/ic_ancil_12190334.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/0/ic_ancil_12190334.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_2f758c22942951443d3e8cd929186acb to: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12190334.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12190334.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/0/159l_2/clim_data_12190334.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/0/159l_2/clim_data_12190334.zip
Checking for progress XML file: /var/lib/boinc-client/slots/0/progress_file_12190334.xml
Opened progress file ok : /var/lib/boinc-client/slots/0/progress_file_12190334.xml
-- Model is restarting --
Adjusting last_iter, 2749, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/0/progress_file_12190334.xml
last_cpu_time: 103668
upload_file_number: 114
last_iter: 2735
last_upload: 9849600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0690_2004050100_123_973_12190334_1_r181576556
The child process has been launched with process id: 186089
Executing the command: /var/lib/boinc-client/slots/0/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian17:1:1:186089:186089] [20221230:235644:1672444604:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2004050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0690
(argv4) batchid: 973
(argv5) wuid: 12190334
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/0
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_8dd7b8b135f9c649d96db7cbdddd1639 to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0690_2004050100_123_973_12190334.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0690_2004050100_123_973_12190334.zip
ic_ancil_file: ic_ancil_12190334
ifsdata_file: ifsdata_12190334
climate_data_file: clim_data_12190334
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_557342088a27623ee9e1d9410da8f36b to: /var/lib/boinc-client/slots/0/ic_ancil_12190334.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/0/ic_ancil_12190334.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_2f758c22942951443d3e8cd929186acb to: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12190334.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12190334.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/0/159l_2/clim_data_12190334.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/0/159l_2/clim_data_12190334.zip
Checking for progress XML file: /var/lib/boinc-client/slots/0/progress_file_12190334.xml
Opened progress file ok : /var/lib/boinc-client/slots/0/progress_file_12190334.xml
-- Model is restarting --
Adjusting last_iter, 2736, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/0/progress_file_12190334.xml
last_cpu_time: 103674
upload_file_number: 114
last_iter: 2735
last_upload: 9849600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0690_2004050100_123_973_12190334_1_r181576556
The child process has been launched with process id: 202669
Executing the command: /var/lib/boinc-client/slots/0/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian17:1:1:202669:202669] [20230104:100933:1672826973:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  10:10:33 STEP 2736 H=2736:00 +CPU= 55.919
  10:11:06 STEP 2737 H=2737:00 +CPU= 32.172
  10:11:40 STEP 2738 H=2738:00 +CPU= 33.766
  10:12:30 STEP 2739 H=2739:00 +CPU= 50.014
  10:13:04 STEP 2740 H=2740:00 +CPU= 33.684
  10:13:36 STEP 2741 H=2741:00 +CPU= 32.253
  10:14:28 STEP 2742 H=2742:00 +CPU= 50.972
  10:15:00 STEP 2743 H=2743:00 +CPU= 32.162
  10:15:34 STEP 2744 H=2744:00 +CPU= 33.440
  10:16:24 STEP 2745 H=2745:00 +CPU= 50.204
  10:16:58 STEP 2746 H=2746:00 +CPU= 33.439
  10:17:31 STEP 2747 H=2747:00 +CPU= 32.927
  10:18:27 STEP 2748 H=2748:00 +CPU= 55.979
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002748
  10:19:00 STEP 2749 H=2749:00 +CPU= 32.673
  10:19:34 STEP 2750 H=2750:00 +CPU= 33.525
  10:20:24 STEP 2751 H=2751:00 +CPU= 49.928
  10:20:58 STEP 2752 H=2752:00 +CPU= 33.469
  10:21:31 STEP 2753 H=2753:00 +CPU= 32.735
  10:22:22 STEP 2754 H=2754:00 +CPU= 51.253
  10:22:55 STEP 2755 H=2755:00 +CPU= 32.443
  10:23:28 STEP 2756 H=2756:00 +CPU= 33.372
  10:24:19 STEP 2757 H=2757:00 +CPU= 49.963
  10:24:53 STEP 2758 H=2758:00 +CPU= 33.660
  10:25:26 STEP 2759 H=2759:00 +CPU= 33.340
  10:26:25 STEP 2760 H=2760:00 +CPU= 58.124
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0690_2004050100_123_973_12190334_1_r181576556_114.zip
Uploading the intermediate file: upload_file_114.zip
  10:26:57 STEP 2761 H=2761:00 +CPU= 32.055
  10:27:31 STEP 2762 H=2762:00 +CPU= 33.286
  10:28:20 STEP 2763 H=2763:00 +CPU= 49.204
  10:28:53 STEP 2764 H=2764:00 +CPU= 32.962
  10:29:25 STEP 2765 H=2765:00 +CPU= 31.679
  10:30:16 STEP 2766 H=2766:00 +CPU= 50.468
  10:30:48 STEP 2767 H=2767:00 +CPU= 32.135
  10:31:22 STEP 2768 H=2768:00 +CPU= 33.399
  10:32:11 STEP 2769 H=2769:00 +CPU= 49.330
  10:32:45 STEP 2770 H=2770:00 +CPU= 33.449
  10:33:17 STEP 2771 H=2771:00 +CPU= 31.916
  10:34:13 STEP 2772 H=2772:00 +CPU= 55.183
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002772
  10:34:45 STEP 2773 H=2773:00 +CPU= 31.738
  10:35:18 STEP 2774 H=2774:00 +CPU= 32.928
  10:36:07 STEP 2775 H=2775:00 +CPU= 49.322
  10:36:41 STEP 2776 H=2776:00 +CPU= 33.070
  10:37:13 STEP 2777 H=2777:00 +CPU= 32.035
  10:38:04 STEP 2778 H=2778:00 +CPU= 51.090
  10:38:36 STEP 2779 H=2779:00 +CPU= 31.961
  10:39:09 STEP 2780 H=2780:00 +CPU= 32.945
  10:40:00 STEP 2781 H=2781:00 +CPU= 50.117
  10:40:33 STEP 2782 H=2782:00 +CPU= 33.041
  10:41:06 STEP 2783 H=2783:00 +CPU= 32.857
  10:42:04 STEP 2784 H=2784:00 +CPU= 57.743
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0690_2004050100_123_973_12190334_1_r181576556_115.zip
Uploading the intermediate file: upload_file_115.zip
  10:42:37 STEP 2785 H=2785:00 +CPU= 32.119
  10:43:10 STEP 2786 H=2786:00 +CPU= 32.782
  10:44:00 STEP 2787 H=2787:00 +CPU= 49.652
  10:44:33 STEP 2788 H=2788:00 +CPU= 33.007
  10:45:05 STEP 2789 H=2789:00 +CPU= 32.045
  10:45:57 STEP 2790 H=2790:00 +CPU= 51.258
  10:46:28 STEP 2791 H=2791:00 +CPU= 31.571
  10:47:01 STEP 2792 H=2792:00 +CPU= 32.811
  10:47:52 STEP 2793 H=2793:00 +CPU= 50.149
  10:48:25 STEP 2794 H=2794:00 +CPU= 32.892
  10:48:57 STEP 2795 H=2795:00 +CPU= 31.976
  10:49:52 STEP 2796 H=2796:00 +CPU= 54.725
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002796
  10:50:25 STEP 2797 H=2797:00 +CPU= 32.264
  10:50:58 STEP 2798 H=2798:00 +CPU= 32.766
  10:51:48 STEP 2799 H=2799:00 +CPU= 49.711
  10:52:21 STEP 2800 H=2800:00 +CPU= 32.921
  10:52:53 STEP 2801 H=2801:00 +CPU= 32.312
  10:53:44 STEP 2802 H=2802:00 +CPU= 50.763
  10:54:17 STEP 2803 H=2803:00 +CPU= 32.163
  10:54:50 STEP 2804 H=2804:00 +CPU= 32.986
  10:55:39 STEP 2805 H=2805:00 +CPU= 49.293
  10:56:13 STEP 2806 H=2806:00 +CPU= 32.980
  10:56:46 STEP 2807 H=2807:00 +CPU= 33.012
  10:57:44 STEP 2808 H=2808:00 +CPU= 57.729
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0690_2004050100_123_973_12190334_1_r181576556_116.zip
Uploading the intermediate file: upload_file_116.zip
  10:58:16 STEP 2809 H=2809:00 +CPU= 31.728
  10:58:49 STEP 2810 H=2810:00 +CPU= 32.837
  10:59:38 STEP 2811 H=2811:00 +CPU= 49.189
  11:00:12 STEP 2812 H=2812:00 +CPU= 33.044
  11:00:43 STEP 2813 H=2813:00 +CPU= 31.596
  11:01:34 STEP 2814 H=2814:00 +CPU= 50.128
  11:02:06 STEP 2815 H=2815:00 +CPU= 31.989
  11:02:39 STEP 2816 H=2816:00 +CPU= 32.714
  11:03:28 STEP 2817 H=2817:00 +CPU= 49.152
  11:04:02 STEP 2818 H=2818:00 +CPU= 33.033
  11:04:34 STEP 2819 H=2819:00 +CPU= 31.798
  11:05:29 STEP 2820 H=2820:00 +CPU= 54.732
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002820
  11:06:01 STEP 2821 H=2821:00 +CPU= 31.829
  11:06:33 STEP 2822 H=2822:00 +CPU= 32.720
  11:07:22 STEP 2823 H=2823:00 +CPU= 48.767
  11:07:56 STEP 2824 H=2824:00 +CPU= 32.857
  11:08:27 STEP 2825 H=2825:00 +CPU= 31.530
  11:09:18 STEP 2826 H=2826:00 +CPU= 50.313
  11:09:50 STEP 2827 H=2827:00 +CPU= 31.893
  11:10:23 STEP 2828 H=2828:00 +CPU= 32.905
  11:11:13 STEP 2829 H=2829:00 +CPU= 49.453
  11:11:46 STEP 2830 H=2830:00 +CPU= 32.992
  11:12:19 STEP 2831 H=2831:00 +CPU= 32.871
  11:13:17 STEP 2832 H=2832:00 +CPU= 57.692
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0690_2004050100_123_973_12190334_1_r181576556_117.zip
Uploading the intermediate file: upload_file_117.zip
  11:13:49 STEP 2833 H=2833:00 +CPU= 31.951
  11:14:22 STEP 2834 H=2834:00 +CPU= 32.958
  11:15:12 STEP 2835 H=2835:00 +CPU= 49.027
  11:15:45 STEP 2836 H=2836:00 +CPU= 32.832
  11:16:17 STEP 2837 H=2837:00 +CPU= 31.930
  11:17:07 STEP 2838 H=2838:00 +CPU= 50.261
  11:17:39 STEP 2839 H=2839:00 +CPU= 31.867
  11:18:13 STEP 2840 H=2840:00 +CPU= 33.174
  11:19:02 STEP 2841 H=2841:00 +CPU= 49.382
  11:19:35 STEP 2842 H=2842:00 +CPU= 32.834
  11:20:07 STEP 2843 H=2843:00 +CPU= 31.517
  11:21:02 STEP 2844 H=2844:00 +CPU= 54.376
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002844
  11:21:33 STEP 2845 H=2845:00 +CPU= 31.484
  11:22:06 STEP 2846 H=2846:00 +CPU= 32.711
  11:22:56 STEP 2847 H=2847:00 +CPU= 49.271
  11:23:29 STEP 2848 H=2848:00 +CPU= 32.438
  11:24:01 STEP 2849 H=2849:00 +CPU= 32.001
  11:24:51 STEP 2850 H=2850:00 +CPU= 49.785
  11:25:23 STEP 2851 H=2851:00 +CPU= 31.520
  11:25:55 STEP 2852 H=2852:00 +CPU= 32.367
  11:26:44 STEP 2853 H=2853:00 +CPU= 48.674
  11:27:17 STEP 2854 H=2854:00 +CPU= 32.514
  11:27:50 STEP 2855 H=2855:00 +CPU= 32.588
  11:28:47 STEP 2856 H=2856:00 +CPU= 57.258
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0690_2004050100_123_973_12190334_1_r181576556_118.zip
Uploading the intermediate file: upload_file_118.zip
  11:29:19 STEP 2857 H=2857:00 +CPU= 31.445
  11:29:52 STEP 2858 H=2858:00 +CPU= 32.708
  11:30:41 STEP 2859 H=2859:00 +CPU= 48.892
  11:31:14 STEP 2860 H=2860:00 +CPU= 32.327
  11:31:45 STEP 2861 H=2861:00 +CPU= 31.644
  11:32:36 STEP 2862 H=2862:00 +CPU= 49.958
  11:33:08 STEP 2863 H=2863:00 +CPU= 31.842
  11:33:41 STEP 2864 H=2864:00 +CPU= 32.710
  11:34:30 STEP 2865 H=2865:00 +CPU= 48.737
  11:35:02 STEP 2866 H=2866:00 +CPU= 32.612
  11:35:34 STEP 2867 H=2867:00 +CPU= 31.642
  11:36:29 STEP 2868 H=2868:00 +CPU= 54.397
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002868
  11:37:01 STEP 2869 H=2869:00 +CPU= 31.552
  11:37:33 STEP 2870 H=2870:00 +CPU= 32.261
  11:38:22 STEP 2871 H=2871:00 +CPU= 48.887
  11:38:55 STEP 2872 H=2872:00 +CPU= 32.525
  11:39:26 STEP 2873 H=2873:00 +CPU= 31.345
  11:40:17 STEP 2874 H=2874:00 +CPU= 49.895
  11:40:48 STEP 2875 H=2875:00 +CPU= 31.442
  11:41:21 STEP 2876 H=2876:00 +CPU= 32.100
  11:42:09 STEP 2877 H=2877:00 +CPU= 48.617
  11:42:42 STEP 2878 H=2878:00 +CPU= 32.530
  11:43:15 STEP 2879 H=2879:00 +CPU= 32.757
  11:44:12 STEP 2880 H=2880:00 +CPU= 56.897
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0690_2004050100_123_973_12190334_1_r181576556_119.zip
Uploading the intermediate file: upload_file_119.zip
  11:44:44 STEP 2881 H=2881:00 +CPU= 31.289
  11:45:17 STEP 2882 H=2882:00 +CPU= 32.591
  11:46:06 STEP 2883 H=2883:00 +CPU= 48.873
  11:46:39 STEP 2884 H=2884:00 +CPU= 32.575
  11:47:10 STEP 2885 H=2885:00 +CPU= 31.304
  11:48:01 STEP 2886 H=2886:00 +CPU= 50.247
  11:48:33 STEP 2887 H=2887:00 +CPU= 31.917
  11:49:06 STEP 2888 H=2888:00 +CPU= 32.708
  11:49:55 STEP 2889 H=2889:00 +CPU= 49.238
  11:50:28 STEP 2890 H=2890:00 +CPU= 32.459
  11:51:00 STEP 2891 H=2891:00 +CPU= 31.603
  11:51:54 STEP 2892 H=2892:00 +CPU= 53.916
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002892
  11:52:26 STEP 2893 H=2893:00 +CPU= 31.765
  11:52:59 STEP 2894 H=2894:00 +CPU= 32.649
  11:53:49 STEP 2895 H=2895:00 +CPU= 49.143
  11:54:21 STEP 2896 H=2896:00 +CPU= 32.397
  11:54:53 STEP 2897 H=2897:00 +CPU= 31.777
  11:55:44 STEP 2898 H=2898:00 +CPU= 50.229
  11:56:15 STEP 2899 H=2899:00 +CPU= 31.586
  11:56:48 STEP 2900 H=2900:00 +CPU= 32.784
  11:57:38 STEP 2901 H=2901:00 +CPU= 49.273
  11:58:11 STEP 2902 H=2902:00 +CPU= 32.700
  11:58:44 STEP 2903 H=2903:00 +CPU= 32.752
  11:59:41 STEP 2904 H=2904:00 +CPU= 57.252
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0690_2004050100_123_973_12190334_1_r181576556_120.zip
Uploading the intermediate file: upload_file_120.zip
  12:00:13 STEP 2905 H=2905:00 +CPU= 31.506
  12:00:46 STEP 2906 H=2906:00 +CPU= 32.312
  12:01:35 STEP 2907 H=2907:00 +CPU= 48.488
  12:02:07 STEP 2908 H=2908:00 +CPU= 32.511
  12:02:39 STEP 2909 H=2909:00 +CPU= 31.422
  12:03:29 STEP 2910 H=2910:00 +CPU= 50.221
  12:04:01 STEP 2911 H=2911:00 +CPU= 31.315
  12:04:34 STEP 2912 H=2912:00 +CPU= 32.562
  12:05:23 STEP 2913 H=2913:00 +CPU= 49.229
  12:05:56 STEP 2914 H=2914:00 +CPU= 32.731
  12:06:28 STEP 2915 H=2915:00 +CPU= 31.469
  12:07:23 STEP 2916 H=2916:00 +CPU= 54.540
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002916
  12:07:54 STEP 2917 H=2917:00 +CPU= 31.644
  12:08:27 STEP 2918 H=2918:00 +CPU= 32.301
  12:09:16 STEP 2919 H=2919:00 +CPU= 48.571
  12:09:48 STEP 2920 H=2920:00 +CPU= 32.489
  12:10:20 STEP 2921 H=2921:00 +CPU= 31.399
  12:11:11 STEP 2922 H=2922:00 +CPU= 50.292
  12:11:42 STEP 2923 H=2923:00 +CPU= 31.659
  12:12:15 STEP 2924 H=2924:00 +CPU= 32.382
  12:13:04 STEP 2925 H=2925:00 +CPU= 48.590
  12:13:37 STEP 2926 H=2926:00 +CPU= 32.525
  12:14:09 STEP 2927 H=2927:00 +CPU= 32.583
  12:15:06 STEP 2928 H=2928:00 +CPU= 56.640
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0690_2004050100_123_973_12190334_1_r181576556_121.zip
Uploading the intermediate file: upload_file_121.zip
  12:15:38 STEP 2929 H=2929:00 +CPU= 31.254
  12:16:10 STEP 2930 H=2930:00 +CPU= 32.273
  12:16:59 STEP 2931 H=2931:00 +CPU= 48.764
  12:17:32 STEP 2932 H=2932:00 +CPU= 32.542
  12:18:04 STEP 2933 H=2933:00 +CPU= 31.575
  12:18:54 STEP 2934 H=2934:00 +CPU= 49.757
  12:19:26 STEP 2935 H=2935:00 +CPU= 31.426
  12:19:58 STEP 2936 H=2936:00 +CPU= 32.394
  12:20:47 STEP 2937 H=2937:00 +CPU= 48.799
  12:21:20 STEP 2938 H=2938:00 +CPU= 32.564
  12:21:52 STEP 2939 H=2939:00 +CPU= 31.741
  12:22:47 STEP 2940 H=2940:00 +CPU= 54.021
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002940
  12:23:18 STEP 2941 H=2941:00 +CPU= 31.592
  12:23:51 STEP 2942 H=2942:00 +CPU= 32.723
  12:24:40 STEP 2943 H=2943:00 +CPU= 48.877
  12:25:13 STEP 2944 H=2944:00 +CPU= 32.417
  12:25:44 STEP 2945 H=2945:00 +CPU= 31.281
  12:26:34 STEP 2946 H=2946:00 +CPU= 49.268
  12:27:05 STEP 2947 H=2947:00 +CPU= 31.427
  12:27:38 STEP 2948 H=2948:00 +CPU= 32.409
  12:28:27 STEP 2949 H=2949:00 +CPU= 48.581
  12:28:59 STEP 2950 H=2950:00 +CPU= 32.415
  12:29:32 STEP 2951 H=2951:00 +CPU= 32.312
  12:30:27 STEP 2952 H=2952:00 +CPU= 54.888
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12190334/ICMSHhq0f+002928
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0690_2004050100_123_973_12190334_1_r181576556_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
12:33:50 (202664): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:07:49 1491072 22294332 oifs_43r3_ps_0690_2004050100_123_973_12190334_1 10,623,600 112,076 0.0105
09 May 2023 16:03:19 1491072 22294332 oifs_43r3_ps_0690_2004050100_123_973_12190334_1 9,504,000 99,912 0.0105
09 May 2023 16:03:10 1491072 22294332 oifs_43r3_ps_0690_2004050100_123_973_12190334_1 8,640,000 90,583 0.0105
09 May 2023 16:03:03 1491072 22294332 oifs_43r3_ps_0690_2004050100_123_973_12190334_1 7,776,000 81,847 0.0105
09 May 2023 16:02:55 1491072 22294332 oifs_43r3_ps_0690_2004050100_123_973_12190334_1 6,912,000 72,660 0.0105
09 May 2023 16:02:46 1491072 22294332 oifs_43r3_ps_0690_2004050100_123_973_12190334_1 6,048,000 63,923 0.0106
09 May 2023 16:02:38 1491072 22294332 oifs_43r3_ps_0690_2004050100_123_973_12190334_1 5,184,000 55,432 0.0107
09 May 2023 16:02:30 1491072 22294332 oifs_43r3_ps_0690_2004050100_123_973_12190334_1 4,320,000 46,550 0.0108
09 May 2023 16:02:23 1491072 22294332 oifs_43r3_ps_0690_2004050100_123_973_12190334_1 3,456,000 37,806 0.0109
09 May 2023 16:02:16 1491072 22294332 oifs_43r3_ps_0690_2004050100_123_973_12190334_1 2,592,000 28,541 0.0110
09 May 2023 16:02:07 1491072 22294332 oifs_43r3_ps_0690_2004050100_123_973_12190334_1 1,728,000 19,040 0.0110
09 May 2023 16:01:58 1491072 22294332 oifs_43r3_ps_0690_2004050100_123_973_12190334_1 864,000 9,696 0.0112


©2024 climateprediction.net