climateprediction.net home page
Task 22266285

Task 22266285

Name oifs_43r3_ps_0618_1995050100_123_964_12181262_0
Workunit 12181262
Created 22 Dec 2022, 8:49:45 UTC
Sent 21 Jan 2023, 18:46:59 UTC
Report deadline 22 Mar 2023, 18:46:59 UTC
Received 4 Feb 2023, 15:59:12 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1489681
Run time 18 hours 32 min 28 sec
CPU time 17 hours 32 min 49 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 6.59 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,787.22 MB
Peak swap size 4,978.07 MB
Peak disk usage 5,244.82 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
Hhq0f+002712
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAhq0f+002712
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMGGhq0f+002688
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMSHhq0f+002688
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMUAhq0f+002688
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMGGhq0f+002700
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMSHhq0f+002700
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMUAhq0f+002700
Zipping up the intermediate file: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_0618_1995050100_123_964_12181262_0_r617790585_112.zip
Uploading the intermediate file: upload_file_112.zip
  14:06:25 STEP 2713 H=2713:00 +CPU= 16.778
  14:06:43 STEP 2714 H=2714:00 +CPU= 17.305
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:07:14 STEP 2715 H=2715:00 +CPU= 27.116
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:07:33 STEP 2716 H=2716:00 +CPU= 17.324
  14:07:50 STEP 2717 H=2717:00 +CPU= 16.836
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:08:22 STEP 2718 H=2718:00 +CPU= 27.676
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:08:41 STEP 2719 H=2719:00 +CPU= 16.881
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:09:00 STEP 2720 H=2720:00 +CPU= 17.349
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:09:29 STEP 2721 H=2721:00 +CPU= 27.293
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:09:49 STEP 2722 H=2722:00 +CPU= 17.383
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:10:08 STEP 2723 H=2723:00 +CPU= 16.908
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:10:42 STEP 2724 H=2724:00 +CPU= 30.386
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGhq0f+002724
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHhq0f+002724
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAhq0f+002724
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:11:01 STEP 2725 H=2725:00 +CPU= 16.762
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:11:20 STEP 2726 H=2726:00 +CPU= 17.215
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:11:49 STEP 2727 H=2727:00 +CPU= 27.060
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:12:08 STEP 2728 H=2728:00 +CPU= 17.302
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:12:27 STEP 2729 H=2729:00 +CPU= 16.821
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:12:59 STEP 2730 H=2730:00 +CPU= 27.810
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:13:18 STEP 2731 H=2731:00 +CPU= 16.842
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:13:37 STEP 2732 H=2732:00 +CPU= 17.252
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:14:07 STEP 2733 H=2733:00 +CPU= 27.219
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:14:26 STEP 2734 H=2734:00 +CPU= 17.131
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:14:45 STEP 2735 H=2735:00 +CPU= 17.142
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:15:20 STEP 2736 H=2736:00 +CPU= 31.470
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGhq0f+002736
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHhq0f+002736
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAhq0f+002736
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMGGhq0f+002712
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMSHhq0f+002712
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMUAhq0f+002712
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMGGhq0f+002724
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMSHhq0f+002724
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMUAhq0f+002724
Zipping up the intermediate file: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_0618_1995050100_123_964_12181262_0_r617790585_113.zip
Uploading the intermediate file: upload_file_113.zip
  14:15:37 STEP 2737 H=2737:00 +CPU= 16.747
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:15:57 STEP 2738 H=2738:00 +CPU= 17.237
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:16:26 STEP 2739 H=2739:00 +CPU= 27.178
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:16:45 STEP 2740 H=2740:00 +CPU= 17.251
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:17:04 STEP 2741 H=2741:00 +CPU= 16.787
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:17:35 STEP 2742 H=2742:00 +CPU= 27.640
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:17:54 STEP 2743 H=2743:00 +CPU= 16.713
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:18:13 STEP 2744 H=2744:00 +CPU= 17.193
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:18:43 STEP 2745 H=2745:00 +CPU= 27.214
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:19:02 STEP 2746 H=2746:00 +CPU= 17.314
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:19:21 STEP 2747 H=2747:00 +CPU= 16.817
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:19:55 STEP 2748 H=2748:00 +CPU= 30.299
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGhq0f+002748
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHhq0f+002748
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAhq0f+002748
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:20:14 STEP 2749 H=2749:00 +CPU= 16.819
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:20:33 STEP 2750 H=2750:00 +CPU= 17.275
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:21:02 STEP 2751 H=2751:00 +CPU= 26.917
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:21:21 STEP 2752 H=2752:00 +CPU= 17.175
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:21:40 STEP 2753 H=2753:00 +CPU= 16.794
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:22:10 STEP 2754 H=2754:00 +CPU= 27.684
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:22:29 STEP 2755 H=2755:00 +CPU= 16.766
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:22:48 STEP 2756 H=2756:00 +CPU= 17.262
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:23:19 STEP 2757 H=2757:00 +CPU= 27.147
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:23:38 STEP 2758 H=2758:00 +CPU= 17.260
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:23:58 STEP 2759 H=2759:00 +CPU= 17.179
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:24:33 STEP 2760 H=2760:00 +CPU= 31.238
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGhq0f+002760
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHhq0f+002760
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAhq0f+002760
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMGGhq0f+002736
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMSHhq0f+002736
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMUAhq0f+002736
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMGGhq0f+002748
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMSHhq0f+002748
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMUAhq0f+002748
Zipping up the intermediate file: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_0618_1995050100_123_964_12181262_0_r617790585_114.zip
Uploading the intermediate file: upload_file_114.zip
  14:24:50 STEP 2761 H=2761:00 +CPU= 16.716
  14:25:07 STEP 2762 H=2762:00 +CPU= 17.254
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:25:38 STEP 2763 H=2763:00 +CPU= 27.204
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:25:57 STEP 2764 H=2764:00 +CPU= 17.283
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:26:16 STEP 2765 H=2765:00 +CPU= 16.780
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:26:46 STEP 2766 H=2766:00 +CPU= 27.783
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:27:05 STEP 2767 H=2767:00 +CPU= 16.792
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:27:24 STEP 2768 H=2768:00 +CPU= 17.191
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:27:55 STEP 2769 H=2769:00 +CPU= 27.021
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:28:14 STEP 2770 H=2770:00 +CPU= 17.314
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:28:33 STEP 2771 H=2771:00 +CPU= 16.841
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:29:06 STEP 2772 H=2772:00 +CPU= 30.365
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGhq0f+002772
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHhq0f+002772
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAhq0f+002772
  14:29:25 STEP 2773 H=2773:00 +CPU= 16.859
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:29:44 STEP 2774 H=2774:00 +CPU= 17.376
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:30:15 STEP 2775 H=2775:00 +CPU= 27.186
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:30:34 STEP 2776 H=2776:00 +CPU= 17.180
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:30:53 STEP 2777 H=2777:00 +CPU= 16.691
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:31:23 STEP 2778 H=2778:00 +CPU= 27.567
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:31:41 STEP 2779 H=2779:00 +CPU= 16.816
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:32:01 STEP 2780 H=2780:00 +CPU= 17.302
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:32:30 STEP 2781 H=2781:00 +CPU= 27.197
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:32:49 STEP 2782 H=2782:00 +CPU= 17.238
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:33:09 STEP 2783 H=2783:00 +CPU= 17.286
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:33:44 STEP 2784 H=2784:00 +CPU= 31.402
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGhq0f+002784
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHhq0f+002784
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAhq0f+002784
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMGGhq0f+002760
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMSHhq0f+002760
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMUAhq0f+002760
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMGGhq0f+002772
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMSHhq0f+002772
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMUAhq0f+002772
Zipping up the intermediate file: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_0618_1995050100_123_964_12181262_0_r617790585_115.zip
Uploading the intermediate file: upload_file_115.zip
  14:34:01 STEP 2785 H=2785:00 +CPU= 16.647
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:34:20 STEP 2786 H=2786:00 +CPU= 17.170
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:34:49 STEP 2787 H=2787:00 +CPU= 27.053
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:35:08 STEP 2788 H=2788:00 +CPU= 16.709
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:35:27 STEP 2789 H=2789:00 +CPU= 16.784
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:35:58 STEP 2790 H=2790:00 +CPU= 27.755
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:36:17 STEP 2791 H=2791:00 +CPU= 16.855
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:36:37 STEP 2792 H=2792:00 +CPU= 17.336
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:37:06 STEP 2793 H=2793:00 +CPU= 27.098
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:37:25 STEP 2794 H=2794:00 +CPU= 17.195
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:37:44 STEP 2795 H=2795:00 +CPU= 16.811
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:38:18 STEP 2796 H=2796:00 +CPU= 30.369
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGhq0f+002796
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHhq0f+002796
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAhq0f+002796
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:38:37 STEP 2797 H=2797:00 +CPU= 16.868
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:38:57 STEP 2798 H=2798:00 +CPU= 17.367
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:39:26 STEP 2799 H=2799:00 +CPU= 27.332
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:39:45 STEP 2800 H=2800:00 +CPU= 17.323
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:40:04 STEP 2801 H=2801:00 +CPU= 16.772
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:40:36 STEP 2802 H=2802:00 +CPU= 27.528
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:40:55 STEP 2803 H=2803:00 +CPU= 16.689
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:41:14 STEP 2804 H=2804:00 +CPU= 17.273
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:41:43 STEP 2805 H=2805:00 +CPU= 27.478
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:42:03 STEP 2806 H=2806:00 +CPU= 17.721
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:42:23 STEP 2807 H=2807:00 +CPU= 17.759
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:42:59 STEP 2808 H=2808:00 +CPU= 32.237
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGhq0f+002808
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHhq0f+002808
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAhq0f+002808
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMGGhq0f+002784
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMSHhq0f+002784
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMUAhq0f+002784
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMGGhq0f+002796
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMSHhq0f+002796
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMUAhq0f+002796
Zipping up the intermediate file: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_0618_1995050100_123_964_12181262_0_r617790585_116.zip
Uploading the intermediate file: upload_file_116.zip
  14:43:17 STEP 2809 H=2809:00 +CPU= 17.286
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:43:37 STEP 2810 H=2810:00 +CPU= 17.681
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1995050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0618
(argv4) batchid: 964
(argv5) wuid: 12181262
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /mnt/nvme/scratch1/boinc/slots/2
Project directory is: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262
..mkdir for temp folder for results failed
Copying: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /mnt/nvme/scratch1/boinc/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /mnt/nvme/scratch1/boinc/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_9f77e84fe6136d553892f6d785f3dc46 to: /mnt/nvme/scratch1/boinc/slots/2/oifs_43r3_ps_0618_1995050100_123_964_12181262.zip
Unzipping the namelist zip file: /mnt/nvme/scratch1/boinc/slots/2/oifs_43r3_ps_0618_1995050100_123_964_12181262.zip
ic_ancil_file: ic_ancil_12181262
ifsdata_file: ifsdata_12181262
climate_data_file: clim_data_12181262
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_d41518b7b4ce3d48f2742dcd021e75e7 to: /mnt/nvme/scratch1/boinc/slots/2/ic_ancil_12181262.zip
Unzipping the IC ancils zip file: /mnt/nvme/scratch1/boinc/slots/2/ic_ancil_12181262.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_1e2d99fcc16ee6e99cec1be29806d9b0 to: /mnt/nvme/scratch1/boinc/slots/2/ifsdata/ifsdata_12181262.zip
Unzipping the ifsdata_zip file: /mnt/nvme/scratch1/boinc/slots/2/ifsdata/ifsdata_12181262.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /mnt/nvme/scratch1/boinc/slots/2/159l_2/clim_data_12181262.zip
Unzipping the climate data zip file: /mnt/nvme/scratch1/boinc/slots/2/159l_2/clim_data_12181262.zip
Checking for progress XML file: /mnt/nvme/scratch1/boinc/slots/2/progress_file_12181262.xml
Opened progress file ok : /mnt/nvme/scratch1/boinc/slots/2/progress_file_12181262.xml
-- Model is restarting --
Adjusting last_iter, 2811, to previous model restart step.
Creating progress file: /mnt/nvme/scratch1/boinc/slots/2/progress_file_12181262.xml
last_cpu_time: 60067
upload_file_number: 117
last_iter: 2807
last_upload: 10108800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0618_1995050100_123_964_12181262_0_r617790585
The child process has been launched with process id: 29548
Executing the command: /mnt/nvme/scratch1/boinc/slots/2/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ormal.auroraborealis:1:1:29548:29548] [20230204:145939:1675519179:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:00:16 STEP 2808 H=2808:00 +CPU= 31.130
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:00:36 STEP 2809 H=2809:00 +CPU= 17.417
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:00:56 STEP 2810 H=2810:00 +CPU= 17.765
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:01:26 STEP 2811 H=2811:00 +CPU= 27.834
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:01:46 STEP 2812 H=2812:00 +CPU= 17.744
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:02:05 STEP 2813 H=2813:00 +CPU= 17.321
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:02:37 STEP 2814 H=2814:00 +CPU= 28.181
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:02:57 STEP 2815 H=2815:00 +CPU= 17.332
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:03:16 STEP 2816 H=2816:00 +CPU= 17.754
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:03:46 STEP 2817 H=2817:00 +CPU= 27.808
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:04:06 STEP 2818 H=2818:00 +CPU= 17.739
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:04:25 STEP 2819 H=2819:00 +CPU= 17.231
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:05:00 STEP 2820 H=2820:00 +CPU= 30.877
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGhq0f+002820
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHhq0f+002820
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAhq0f+002820
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:05:19 STEP 2821 H=2821:00 +CPU= 17.268
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:05:39 STEP 2822 H=2822:00 +CPU= 17.724
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:06:09 STEP 2823 H=2823:00 +CPU= 27.665
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:06:29 STEP 2824 H=2824:00 +CPU= 17.604
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:06:48 STEP 2825 H=2825:00 +CPU= 17.179
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:07:20 STEP 2826 H=2826:00 +CPU= 28.204
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:07:39 STEP 2827 H=2827:00 +CPU= 17.099
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:07:59 STEP 2828 H=2828:00 +CPU= 17.650
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:08:29 STEP 2829 H=2829:00 +CPU= 27.781
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:08:48 STEP 2830 H=2830:00 +CPU= 17.653
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:09:08 STEP 2831 H=2831:00 +CPU= 17.653
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:09:44 STEP 2832 H=2832:00 +CPU= 31.646
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGhq0f+002832
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHhq0f+002832
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAhq0f+002832
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMGGhq0f+002808
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMSHhq0f+002808
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMUAhq0f+002808
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMGGhq0f+002820
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMSHhq0f+002820
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMUAhq0f+002820
Zipping up the intermediate file: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_0618_1995050100_123_964_12181262_0_r617790585_117.zip
Uploading the intermediate file: upload_file_117.zip
  15:10:03 STEP 2833 H=2833:00 +CPU= 17.142
  15:10:21 STEP 2834 H=2834:00 +CPU= 17.648
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:10:53 STEP 2835 H=2835:00 +CPU= 27.553
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:11:12 STEP 2836 H=2836:00 +CPU= 17.595
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:11:31 STEP 2837 H=2837:00 +CPU= 17.143
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:12:02 STEP 2838 H=2838:00 +CPU= 28.252
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:12:21 STEP 2839 H=2839:00 +CPU= 17.250
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:12:41 STEP 2840 H=2840:00 +CPU= 17.721
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:13:12 STEP 2841 H=2841:00 +CPU= 27.711
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:13:32 STEP 2842 H=2842:00 +CPU= 17.617
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:13:51 STEP 2843 H=2843:00 +CPU= 17.239
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:14:24 STEP 2844 H=2844:00 +CPU= 30.855
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGhq0f+002844
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHhq0f+002844
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAhq0f+002844
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:14:44 STEP 2845 H=2845:00 +CPU= 17.175
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:15:03 STEP 2846 H=2846:00 +CPU= 17.636
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:15:35 STEP 2847 H=2847:00 +CPU= 27.759
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:15:55 STEP 2848 H=2848:00 +CPU= 17.619
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:16:14 STEP 2849 H=2849:00 +CPU= 17.120
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:16:44 STEP 2850 H=2850:00 +CPU= 28.250
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:17:03 STEP 2851 H=2851:00 +CPU= 17.218
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:17:23 STEP 2852 H=2852:00 +CPU= 17.626
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:17:54 STEP 2853 H=2853:00 +CPU= 27.644
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:18:14 STEP 2854 H=2854:00 +CPU= 17.654
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:18:34 STEP 2855 H=2855:00 +CPU= 17.659
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:19:08 STEP 2856 H=2856:00 +CPU= 32.041
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGhq0f+002856
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHhq0f+002856
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAhq0f+002856
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMGGhq0f+002832
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMSHhq0f+002832
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMUAhq0f+002832
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMGGhq0f+002844
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMSHhq0f+002844
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMUAhq0f+002844
Zipping up the intermediate file: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_0618_1995050100_123_964_12181262_0_r617790585_118.zip
Uploading the intermediate file: upload_file_118.zip
  15:19:27 STEP 2857 H=2857:00 +CPU= 17.093
  15:19:45 STEP 2858 H=2858:00 +CPU= 17.606
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:20:17 STEP 2859 H=2859:00 +CPU= 27.662
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:20:36 STEP 2860 H=2860:00 +CPU= 17.679
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:20:56 STEP 2861 H=2861:00 +CPU= 17.241
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:21:26 STEP 2862 H=2862:00 +CPU= 28.283
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:21:45 STEP 2863 H=2863:00 +CPU= 17.237
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:22:05 STEP 2864 H=2864:00 +CPU= 17.773
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:22:37 STEP 2865 H=2865:00 +CPU= 27.856
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:22:57 STEP 2866 H=2866:00 +CPU= 17.763
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:23:16 STEP 2867 H=2867:00 +CPU= 17.277
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:23:51 STEP 2868 H=2868:00 +CPU= 30.771
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGhq0f+002868
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHhq0f+002868
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAhq0f+002868
  15:24:08 STEP 2869 H=2869:00 +CPU= 17.272
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:24:28 STEP 2870 H=2870:00 +CPU= 17.700
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:25:00 STEP 2871 H=2871:00 +CPU= 27.781
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:25:19 STEP 2872 H=2872:00 +CPU= 17.785
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:25:39 STEP 2873 H=2873:00 +CPU= 17.254
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:26:11 STEP 2874 H=2874:00 +CPU= 28.371
  15:26:28 STEP 2875 H=2875:00 +CPU= 17.271
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:26:48 STEP 2876 H=2876:00 +CPU= 17.692
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:27:20 STEP 2877 H=2877:00 +CPU= 27.799
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:27:40 STEP 2878 H=2878:00 +CPU= 17.678
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:27:59 STEP 2879 H=2879:00 +CPU= 17.700
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:28:36 STEP 2880 H=2880:00 +CPU= 32.133
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGhq0f+002880
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHhq0f+002880
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAhq0f+002880
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMGGhq0f+002856
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMSHhq0f+002856
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMUAhq0f+002856
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMGGhq0f+002868
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMSHhq0f+002868
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMUAhq0f+002868
Zipping up the intermediate file: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_0618_1995050100_123_964_12181262_0_r617790585_119.zip
Uploading the intermediate file: upload_file_119.zip
  15:28:53 STEP 2881 H=2881:00 +CPU= 17.204
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:29:13 STEP 2882 H=2882:00 +CPU= 17.659
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:29:43 STEP 2883 H=2883:00 +CPU= 27.819
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:30:03 STEP 2884 H=2884:00 +CPU= 17.685
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:30:22 STEP 2885 H=2885:00 +CPU= 17.196
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:30:55 STEP 2886 H=2886:00 +CPU= 28.696
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:31:14 STEP 2887 H=2887:00 +CPU= 17.497
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:31:34 STEP 2888 H=2888:00 +CPU= 17.920
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:32:04 STEP 2889 H=2889:00 +CPU= 28.146
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:32:24 STEP 2890 H=2890:00 +CPU= 18.009
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:32:44 STEP 2891 H=2891:00 +CPU= 17.420
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:33:18 STEP 2892 H=2892:00 +CPU= 30.383
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGhq0f+002892
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHhq0f+002892
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAhq0f+002892
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:33:37 STEP 2893 H=2893:00 +CPU= 16.869
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:33:57 STEP 2894 H=2894:00 +CPU= 17.793
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:34:27 STEP 2895 H=2895:00 +CPU= 28.060
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:34:47 STEP 2896 H=2896:00 +CPU= 17.936
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:35:06 STEP 2897 H=2897:00 +CPU= 17.387
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:35:39 STEP 2898 H=2898:00 +CPU= 28.620
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:35:59 STEP 2899 H=2899:00 +CPU= 17.451
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:36:18 STEP 2900 H=2900:00 +CPU= 17.369
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:36:47 STEP 2901 H=2901:00 +CPU= 27.188
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:37:07 STEP 2902 H=2902:00 +CPU= 17.770
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:37:27 STEP 2903 H=2903:00 +CPU= 17.800
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:38:04 STEP 2904 H=2904:00 +CPU= 33.005
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGhq0f+002904
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHhq0f+002904
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAhq0f+002904
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMGGhq0f+002880
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMSHhq0f+002880
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMUAhq0f+002880
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMGGhq0f+002892
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMSHhq0f+002892
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMUAhq0f+002892
Zipping up the intermediate file: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_0618_1995050100_123_964_12181262_0_r617790585_120.zip
Uploading the intermediate file: upload_file_120.zip
  15:38:24 STEP 2905 H=2905:00 +CPU= 17.567
  15:38:42 STEP 2906 H=2906:00 +CPU= 18.120
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:39:15 STEP 2907 H=2907:00 +CPU= 28.275
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:39:34 STEP 2908 H=2908:00 +CPU= 17.412
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:39:53 STEP 2909 H=2909:00 +CPU= 17.168
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:40:24 STEP 2910 H=2910:00 +CPU= 28.728
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:40:44 STEP 2911 H=2911:00 +CPU= 17.423
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:41:04 STEP 2912 H=2912:00 +CPU= 18.055
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:41:36 STEP 2913 H=2913:00 +CPU= 28.157
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:41:56 STEP 2914 H=2914:00 +CPU= 17.872
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:42:15 STEP 2915 H=2915:00 +CPU= 17.526
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:42:50 STEP 2916 H=2916:00 +CPU= 30.853
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGhq0f+002916
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHhq0f+002916
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAhq0f+002916
  15:43:07 STEP 2917 H=2917:00 +CPU= 17.226
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:43:27 STEP 2918 H=2918:00 +CPU= 17.844
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:44:00 STEP 2919 H=2919:00 +CPU= 28.303
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:44:20 STEP 2920 H=2920:00 +CPU= 18.227
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:44:40 STEP 2921 H=2921:00 +CPU= 17.655
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:45:13 STEP 2922 H=2922:00 +CPU= 28.984
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:45:32 STEP 2923 H=2923:00 +CPU= 17.492
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:45:52 STEP 2924 H=2924:00 +CPU= 17.801
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:46:22 STEP 2925 H=2925:00 +CPU= 27.523
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:46:41 STEP 2926 H=2926:00 +CPU= 17.598
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:47:01 STEP 2927 H=2927:00 +CPU= 17.834
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:47:38 STEP 2928 H=2928:00 +CPU= 32.362
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGhq0f+002928
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHhq0f+002928
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAhq0f+002928
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMGGhq0f+002904
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMSHhq0f+002904
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMUAhq0f+002904
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMGGhq0f+002916
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMSHhq0f+002916
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMUAhq0f+002916
Zipping up the intermediate file: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_0618_1995050100_123_964_12181262_0_r617790585_121.zip
Uploading the intermediate file: upload_file_121.zip
  15:47:56 STEP 2929 H=2929:00 +CPU= 17.341
  15:48:13 STEP 2930 H=2930:00 +CPU= 17.755
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:48:43 STEP 2931 H=2931:00 +CPU= 27.956
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:49:03 STEP 2932 H=2932:00 +CPU= 17.616
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:49:22 STEP 2933 H=2933:00 +CPU= 17.065
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:49:54 STEP 2934 H=2934:00 +CPU= 28.230
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:50:14 STEP 2935 H=2935:00 +CPU= 17.473
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:50:34 STEP 2936 H=2936:00 +CPU= 17.797
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:51:04 STEP 2937 H=2937:00 +CPU= 28.071
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:51:24 STEP 2938 H=2938:00 +CPU= 17.810
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:51:43 STEP 2939 H=2939:00 +CPU= 17.334
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:52:18 STEP 2940 H=2940:00 +CPU= 30.674
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGhq0f+002940
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHhq0f+002940
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAhq0f+002940
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:52:37 STEP 2941 H=2941:00 +CPU= 17.040
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:52:57 STEP 2942 H=2942:00 +CPU= 17.663
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:53:27 STEP 2943 H=2943:00 +CPU= 27.884
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:53:46 STEP 2944 H=2944:00 +CPU= 17.726
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:54:06 STEP 2945 H=2945:00 +CPU= 17.352
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:54:38 STEP 2946 H=2946:00 +CPU= 28.575
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:54:58 STEP 2947 H=2947:00 +CPU= 17.274
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:55:17 STEP 2948 H=2948:00 +CPU= 17.711
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:55:47 STEP 2949 H=2949:00 +CPU= 27.646
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:56:07 STEP 2950 H=2950:00 +CPU= 17.783
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:56:27 STEP 2951 H=2951:00 +CPU= 17.818
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:57:02 STEP 2952 H=2952:00 +CPU= 31.435
The child process terminated with status: 0
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMGGhq0f+002952
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMSHhq0f+002952
Moving to projects directory: /mnt/nvme/scratch1/boinc/slots/2/ICMUAhq0f+002952
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMSHhq0f+002928
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMUAhq0f+002928
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMSHhq0f+002952
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMUAhq0f+002952
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMGGhq0f+002928
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMGGhq0f+002940
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMSHhq0f+002940
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMUAhq0f+002940
Adding to the zip: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_12181262/ICMGGhq0f+002952
Zipping up the final file: /mnt/nvme/scratch1/boinc/projects/climateprediction.net/oifs_43r3_ps_0618_1995050100_123_964_12181262_0_r617790585_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
16:00:26 (29501): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:47:45 1489681 22266285 oifs_43r3_ps_0618_1995050100_123_964_12181262_0 10,623,600 63,169 0.0059
09 May 2023 16:47:40 1489681 22266285 oifs_43r3_ps_0618_1995050100_123_964_12181262_0 9,072,000 53,721 0.0059
09 May 2023 16:47:36 1489681 22266285 oifs_43r3_ps_0618_1995050100_123_964_12181262_0 7,776,000 45,798 0.0059
09 May 2023 16:47:34 1489681 22266285 oifs_43r3_ps_0618_1995050100_123_964_12181262_0 6,912,000 40,701 0.0059
09 May 2023 16:47:32 1489681 22266285 oifs_43r3_ps_0618_1995050100_123_964_12181262_0 6,048,000 35,611 0.0059
09 May 2023 16:47:30 1489681 22266285 oifs_43r3_ps_0618_1995050100_123_964_12181262_0 5,184,000 30,543 0.0059
09 May 2023 16:47:24 1489681 22266285 oifs_43r3_ps_0618_1995050100_123_964_12181262_0 3,974,400 23,343 0.0059
09 May 2023 16:47:23 1489681 22266285 oifs_43r3_ps_0618_1995050100_123_964_12181262_0 3,110,400 18,312 0.0059
09 May 2023 16:47:21 1489681 22266285 oifs_43r3_ps_0618_1995050100_123_964_12181262_0 2,246,400 13,360 0.0059
09 May 2023 16:47:20 1489681 22266285 oifs_43r3_ps_0618_1995050100_123_964_12181262_0 1,382,400 8,358 0.0060


©2024 climateprediction.net