climateprediction.net home page
Task 22312755

Task 22312755

Name oifs_43r3_bl_a4ef_2016092300_15_991_12212490_0
Workunit 12212490
Created 13 Feb 2023, 22:30:21 UTC
Sent 13 Feb 2023, 22:36:39 UTC
Report deadline 14 Apr 2023, 22:36:39 UTC
Received 28 Feb 2023, 9:20:10 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1535783
Run time 12 hours 22 min 29 sec
CPU time 12 hours 22 min 29 sec
Validate state Valid
Credit 1,813.14
Device peak FLOPS 4.01 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,070.59 MB
Peak swap size 5,930.79 MB
Peak disk usage 1,359.01 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
c/slots/2/ICMUAh7zg+000804
  20:29:33 STEP  805 H= 201:15 +CPU= 29.854
  20:30:03 STEP  806 H= 201:30 +CPU= 29.578
  20:30:33 STEP  807 H= 201:45 +CPU= 29.682
  20:31:03 STEP  808 H= 202:00 +CPU= 30.037
  20:31:33 STEP  809 H= 202:15 +CPU= 29.354
  20:32:02 STEP  810 H= 202:30 +CPU= 29.324
  20:32:32 STEP  811 H= 202:45 +CPU= 29.210
  20:33:02 STEP  812 H= 203:00 +CPU= 29.940
  20:33:32 STEP  813 H= 203:15 +CPU= 29.785
  20:34:02 STEP  814 H= 203:30 +CPU= 29.330
  20:34:31 STEP  815 H= 203:45 +CPU= 29.589
  20:35:13 STEP  816 H= 204:00 +CPU= 41.379
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+000816
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+000816
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+000816
  20:35:43 STEP  817 H= 204:15 +CPU= 29.397
  20:36:13 STEP  818 H= 204:30 +CPU= 29.488
  20:36:43 STEP  819 H= 204:45 +CPU= 29.610
  20:37:13 STEP  820 H= 205:00 +CPU= 30.143
  20:37:43 STEP  821 H= 205:15 +CPU= 29.438
  20:38:13 STEP  822 H= 205:30 +CPU= 29.641
  20:38:43 STEP  823 H= 205:45 +CPU= 29.778
  20:39:13 STEP  824 H= 206:00 +CPU= 30.247
  20:39:43 STEP  825 H= 206:15 +CPU= 29.811
  20:40:13 STEP  826 H= 206:30 +CPU= 29.414
  20:40:43 STEP  827 H= 206:45 +CPU= 29.412
  20:41:20 STEP  828 H= 207:00 +CPU= 37.144
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+000828
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+000828
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+000828
  20:41:50 STEP  829 H= 207:15 +CPU= 29.728
  20:42:20 STEP  830 H= 207:30 +CPU= 29.573
  20:42:50 STEP  831 H= 207:45 +CPU= 29.312
  20:43:20 STEP  832 H= 208:00 +CPU= 30.048
  20:43:50 STEP  833 H= 208:15 +CPU= 29.526
  20:44:20 STEP  834 H= 208:30 +CPU= 29.596
  20:44:50 STEP  835 H= 208:45 +CPU= 29.556
  20:45:20 STEP  836 H= 209:00 +CPU= 30.190
  20:45:50 STEP  837 H= 209:15 +CPU= 29.467
  20:46:20 STEP  838 H= 209:30 +CPU= 29.798
  20:46:50 STEP  839 H= 209:45 +CPU= 29.663
  20:47:27 STEP  840 H= 210:00 +CPU= 37.215
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+000840
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+000840
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+000840
  20:47:57 STEP  841 H= 210:15 +CPU= 29.710
  20:48:27 STEP  842 H= 210:30 +CPU= 29.533
  20:48:57 STEP  843 H= 210:45 +CPU= 29.504
  20:49:27 STEP  844 H= 211:00 +CPU= 30.106
  20:49:58 STEP  845 H= 211:15 +CPU= 29.767
  20:50:28 STEP  846 H= 211:30 +CPU= 29.727
  20:50:57 STEP  847 H= 211:45 +CPU= 29.492
  20:51:28 STEP  848 H= 212:00 +CPU= 30.380
  20:51:58 STEP  849 H= 212:15 +CPU= 29.599
  20:52:28 STEP  850 H= 212:30 +CPU= 29.315
  20:52:57 STEP  851 H= 212:45 +CPU= 29.141
  20:53:34 STEP  852 H= 213:00 +CPU= 37.076
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+000852
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+000852
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+000852
  20:54:04 STEP  853 H= 213:15 +CPU= 29.660
  20:54:34 STEP  854 H= 213:30 +CPU= 29.636
  20:55:04 STEP  855 H= 213:45 +CPU= 29.529
  20:55:35 STEP  856 H= 214:00 +CPU= 30.215
  20:56:04 STEP  857 H= 214:15 +CPU= 29.391
  20:56:35 STEP  858 H= 214:30 +CPU= 29.926
  20:57:05 STEP  859 H= 214:45 +CPU= 29.869
  20:57:35 STEP  860 H= 215:00 +CPU= 30.367
  20:58:05 STEP  861 H= 215:15 +CPU= 29.570
  20:58:35 STEP  862 H= 215:30 +CPU= 29.586
  20:59:05 STEP  863 H= 215:45 +CPU= 29.680
  20:59:47 STEP  864 H= 216:00 +CPU= 41.943
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+000864
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+000864
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+000864
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+000768
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+000768
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+000768
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+000780
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+000780
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+000780
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+000792
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+000792
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+000792
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+000804
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+000804
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+000804
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+000816
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+000816
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+000816
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+000828
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+000828
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+000828
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+000840
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+000840
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+000840
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+000852
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+000852
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+000852
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_a4ef_2016092300_15_991_12212490_0_r1135422882_8.zip
Uploading the intermediate file: upload_file_8.zip
  21:00:18 STEP  865 H= 216:15 +CPU= 30.447
  21:00:49 STEP  866 H= 216:30 +CPU= 30.191
  21:01:20 STEP  867 H= 216:45 +CPU= 30.408
  21:01:51 STEP  868 H= 217:00 +CPU= 30.941
  21:02:21 STEP  869 H= 217:15 +CPU= 29.763
  21:02:51 STEP  870 H= 217:30 +CPU= 29.630
  21:03:21 STEP  871 H= 217:45 +CPU= 29.676
  21:03:51 STEP  872 H= 218:00 +CPU= 30.152
  21:04:21 STEP  873 H= 218:15 +CPU= 29.509
  21:04:51 STEP  874 H= 218:30 +CPU= 29.376
  21:05:20 STEP  875 H= 218:45 +CPU= 29.526
  21:05:58 STEP  876 H= 219:00 +CPU= 37.200
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+000876
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+000876
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+000876
  21:06:28 STEP  877 H= 219:15 +CPU= 29.643
  21:06:58 STEP  878 H= 219:30 +CPU= 29.434
  21:07:28 STEP  879 H= 219:45 +CPU= 29.619
  21:07:58 STEP  880 H= 220:00 +CPU= 30.368
  21:08:28 STEP  881 H= 220:15 +CPU= 29.431
  21:08:58 STEP  882 H= 220:30 +CPU= 29.799
  21:09:28 STEP  883 H= 220:45 +CPU= 29.460
  21:09:59 STEP  884 H= 221:00 +CPU= 31.187
  21:10:30 STEP  885 H= 221:15 +CPU= 30.465
  21:11:01 STEP  886 H= 221:30 +CPU= 30.334
  21:11:31 STEP  887 H= 221:45 +CPU= 30.381
  21:12:09 STEP  888 H= 222:00 +CPU= 37.370
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+000888
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+000888
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+000888
  21:12:39 STEP  889 H= 222:15 +CPU= 29.676
  21:13:09 STEP  890 H= 222:30 +CPU= 29.641
  21:13:39 STEP  891 H= 222:45 +CPU= 29.578
  21:14:10 STEP  892 H= 223:00 +CPU= 30.611
  21:14:40 STEP  893 H= 223:15 +CPU= 29.949
  21:15:11 STEP  894 H= 223:30 +CPU= 30.315
  21:15:41 STEP  895 H= 223:45 +CPU= 29.564
  21:16:11 STEP  896 H= 224:00 +CPU= 30.171
  21:16:41 STEP  897 H= 224:15 +CPU= 29.727
  21:17:11 STEP  898 H= 224:30 +CPU= 29.670
  21:17:41 STEP  899 H= 224:45 +CPU= 29.646
  21:18:19 STEP  900 H= 225:00 +CPU= 37.322
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+000900
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+000900
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+000900
  21:18:49 STEP  901 H= 225:15 +CPU= 29.884
  21:19:19 STEP  902 H= 225:30 +CPU= 29.768
  21:19:49 STEP  903 H= 225:45 +CPU= 29.897
  21:20:20 STEP  904 H= 226:00 +CPU= 30.331
  21:20:50 STEP  905 H= 226:15 +CPU= 29.416
  21:21:20 STEP  906 H= 226:30 +CPU= 29.740
  21:21:50 STEP  907 H= 226:45 +CPU= 29.798
  21:22:20 STEP  908 H= 227:00 +CPU= 30.469
  21:22:51 STEP  909 H= 227:15 +CPU= 29.888
  21:23:21 STEP  910 H= 227:30 +CPU= 29.811
  21:23:51 STEP  911 H= 227:45 +CPU= 29.994
  21:24:33 STEP  912 H= 228:00 +CPU= 41.804
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+000912
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+000912
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+000912
  21:25:03 STEP  913 H= 228:15 +CPU= 29.428
  21:25:33 STEP  914 H= 228:30 +CPU= 29.566
  21:26:03 STEP  915 H= 228:45 +CPU= 29.528
  21:26:33 STEP  916 H= 229:00 +CPU= 30.141
  21:27:02 STEP  917 H= 229:15 +CPU= 29.386
  21:27:32 STEP  918 H= 229:30 +CPU= 29.693
  21:28:03 STEP  919 H= 229:45 +CPU= 29.889
  21:28:33 STEP  920 H= 230:00 +CPU= 30.512
  21:29:03 STEP  921 H= 230:15 +CPU= 29.602
  21:29:33 STEP  922 H= 230:30 +CPU= 29.782
  21:30:03 STEP  923 H= 230:45 +CPU= 29.716
  21:30:41 STEP  924 H= 231:00 +CPU= 37.451
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+000924
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+000924
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+000924
  21:31:11 STEP  925 H= 231:15 +CPU= 29.635
  21:31:41 STEP  926 H= 231:30 +CPU= 29.551
  21:32:11 STEP  927 H= 231:45 +CPU= 29.501
  21:32:41 STEP  928 H= 232:00 +CPU= 30.131
  21:33:11 STEP  929 H= 232:15 +CPU= 29.510
  21:33:41 STEP  930 H= 232:30 +CPU= 29.848
  21:34:11 STEP  931 H= 232:45 +CPU= 30.021
  21:34:42 STEP  932 H= 233:00 +CPU= 30.616
  21:35:12 STEP  933 H= 233:15 +CPU= 29.771
  21:35:42 STEP  934 H= 233:30 +CPU= 29.744
  21:36:12 STEP  935 H= 233:45 +CPU= 29.751
  21:36:50 STEP  936 H= 234:00 +CPU= 37.445
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+000936
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+000936
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+000936
  21:37:21 STEP  937 H= 234:15 +CPU= 30.565
  21:37:51 STEP  938 H= 234:30 +CPU= 30.011
  21:38:22 STEP  939 H= 234:45 +CPU= 29.912
  21:38:52 STEP  940 H= 235:00 +CPU= 30.327
  21:39:22 STEP  941 H= 235:15 +CPU= 29.754
  21:39:52 STEP  942 H= 235:30 +CPU= 29.923
  21:40:23 STEP  943 H= 235:45 +CPU= 29.886
  21:40:53 STEP  944 H= 236:00 +CPU= 30.305
  21:41:23 STEP  945 H= 236:15 +CPU= 29.753
  21:41:53 STEP  946 H= 236:30 +CPU= 29.703
  21:42:23 STEP  947 H= 236:45 +CPU= 29.744
  21:43:01 STEP  948 H= 237:00 +CPU= 37.037
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+000948
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+000948
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+000948
  21:43:30 STEP  949 H= 237:15 +CPU= 29.568
  21:44:01 STEP  950 H= 237:30 +CPU= 29.759
  21:44:31 STEP  951 H= 237:45 +CPU= 29.732
  21:45:01 STEP  952 H= 238:00 +CPU= 30.185
  21:45:31 STEP  953 H= 238:15 +CPU= 29.674
  21:46:01 STEP  954 H= 238:30 +CPU= 29.984
  21:46:31 STEP  955 H= 238:45 +CPU= 29.932
  21:47:02 STEP  956 H= 239:00 +CPU= 30.482
  21:47:33 STEP  957 H= 239:15 +CPU= 29.932
  21:48:03 STEP  958 H= 239:30 +CPU= 30.412
  21:48:34 STEP  959 H= 239:45 +CPU= 30.143
  21:49:16 STEP  960 H= 240:00 +CPU= 41.985
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+000960
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+000960
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+000960
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+000864
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+000864
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+000864
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+000876
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+000876
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+000876
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+000888
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+000888
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+000888
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+000900
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+000900
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+000900
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+000912
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+000912
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+000912
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+000924
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+000924
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+000924
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+000936
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+000936
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+000936
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+000948
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+000948
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+000948
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_a4ef_2016092300_15_991_12212490_0_r1135422882_9.zip
Uploading the intermediate file: upload_file_9.zip
  21:49:47 STEP  961 H= 240:15 +CPU= 30.358
  21:50:18 STEP  962 H= 240:30 +CPU= 30.332
  21:50:49 STEP  963 H= 240:45 +CPU= 30.869
  21:51:20 STEP  964 H= 241:00 +CPU= 30.907
  21:51:50 STEP  965 H= 241:15 +CPU= 29.795
  21:52:20 STEP  966 H= 241:30 +CPU= 29.866
  21:52:51 STEP  967 H= 241:45 +CPU= 29.894
  21:53:21 STEP  968 H= 242:00 +CPU= 30.212
  21:53:51 STEP  969 H= 242:15 +CPU= 29.804
  21:54:22 STEP  970 H= 242:30 +CPU= 29.941
  21:54:52 STEP  971 H= 242:45 +CPU= 29.916
  21:55:30 STEP  972 H= 243:00 +CPU= 37.615
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+000972
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+000972
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+000972
  21:56:00 STEP  973 H= 243:15 +CPU= 30.349
  21:56:31 STEP  974 H= 243:30 +CPU= 30.211
  21:57:02 STEP  975 H= 243:45 +CPU= 30.294
  21:57:33 STEP  976 H= 244:00 +CPU= 30.917
  21:58:03 STEP  977 H= 244:15 +CPU= 30.101
  21:58:34 STEP  978 H= 244:30 +CPU= 30.128
  21:59:04 STEP  979 H= 244:45 +CPU= 29.942
  21:59:35 STEP  980 H= 245:00 +CPU= 30.380
  22:00:05 STEP  981 H= 245:15 +CPU= 30.004
  22:00:36 STEP  982 H= 245:30 +CPU= 30.617
  22:01:06 STEP  983 H= 245:45 +CPU= 29.957
  22:01:45 STEP  984 H= 246:00 +CPU= 38.189
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+000984
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+000984
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+000984
  22:02:15 STEP  985 H= 246:15 +CPU= 30.229
  22:02:46 STEP  986 H= 246:30 +CPU= 30.086
  22:03:15 STEP  987 H= 246:45 +CPU= 29.513
  22:03:46 STEP  988 H= 247:00 +CPU= 30.391
  22:04:16 STEP  989 H= 247:15 +CPU= 29.681
  22:04:46 STEP  990 H= 247:30 +CPU= 29.799
  22:05:16 STEP  991 H= 247:45 +CPU= 29.899
  22:05:47 STEP  992 H= 248:00 +CPU= 30.467
  22:06:17 STEP  993 H= 248:15 +CPU= 29.665
  22:06:48 STEP  994 H= 248:30 +CPU= 30.027
  22:07:18 STEP  995 H= 248:45 +CPU= 29.973
  22:07:55 STEP  996 H= 249:00 +CPU= 37.174
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+000996
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+000996
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+000996
  22:08:25 STEP  997 H= 249:15 +CPU= 29.779
  22:08:55 STEP  998 H= 249:30 +CPU= 29.738
  22:09:26 STEP  999 H= 249:45 +CPU= 30.143
  22:09:57 STEP 1000 H= 250:00 +CPU= 30.790
  22:10:28 STEP 1001 H= 250:15 +CPU= 30.068
  22:10:58 STEP 1002 H= 250:30 +CPU= 29.998
  22:11:29 STEP 1003 H= 250:45 +CPU= 30.349
  22:11:59 STEP 1004 H= 251:00 +CPU= 30.506
  22:12:29 STEP 1005 H= 251:15 +CPU= 29.894
  22:12:59 STEP 1006 H= 251:30 +CPU= 29.733
  22:13:29 STEP 1007 H= 251:45 +CPU= 29.756
  22:14:12 STEP 1008 H= 252:00 +CPU= 41.823
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001008
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001008
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001008
  22:14:42 STEP 1009 H= 252:15 +CPU= 30.225
  22:15:13 STEP 1010 H= 252:30 +CPU= 30.189
  22:15:43 STEP 1011 H= 252:45 +CPU= 30.219
  22:16:14 STEP 1012 H= 253:00 +CPU= 30.448
  22:16:44 STEP 1013 H= 253:15 +CPU= 29.959
  22:17:15 STEP 1014 H= 253:30 +CPU= 30.020
  22:17:45 STEP 1015 H= 253:45 +CPU= 29.807
  22:18:15 STEP 1016 H= 254:00 +CPU= 30.428
  22:18:46 STEP 1017 H= 254:15 +CPU= 29.788
  22:19:16 STEP 1018 H= 254:30 +CPU= 29.801
  22:19:46 STEP 1019 H= 254:45 +CPU= 29.819
  22:20:24 STEP 1020 H= 255:00 +CPU= 37.465
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001020
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001020
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001020
  22:20:54 STEP 1021 H= 255:15 +CPU= 29.974
  22:21:24 STEP 1022 H= 255:30 +CPU= 29.912
  22:21:54 STEP 1023 H= 255:45 +CPU= 29.719
  22:22:25 STEP 1024 H= 256:00 +CPU= 30.445
  22:22:55 STEP 1025 H= 256:15 +CPU= 29.837
  22:23:25 STEP 1026 H= 256:30 +CPU= 29.673
  22:23:55 STEP 1027 H= 256:45 +CPU= 29.583
  22:24:25 STEP 1028 H= 257:00 +CPU= 30.216
  22:24:55 STEP 1029 H= 257:15 +CPU= 29.692
  22:25:25 STEP 1030 H= 257:30 +CPU= 29.619
  22:25:56 STEP 1031 H= 257:45 +CPU= 30.244
  22:26:33 STEP 1032 H= 258:00 +CPU= 37.375
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001032
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001032
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001032
  22:27:04 STEP 1033 H= 258:15 +CPU= 29.961
  22:27:34 STEP 1034 H= 258:30 +CPU= 30.071
  22:28:04 STEP 1035 H= 258:45 +CPU= 30.002
  22:28:35 STEP 1036 H= 259:00 +CPU= 30.718
  22:29:06 STEP 1037 H= 259:15 +CPU= 30.274
  22:29:36 STEP 1038 H= 259:30 +CPU= 30.022
  22:30:07 STEP 1039 H= 259:45 +CPU= 29.977
  22:30:37 STEP 1040 H= 260:00 +CPU= 30.300
  22:31:07 STEP 1041 H= 260:15 +CPU= 29.668
  22:31:37 STEP 1042 H= 260:30 +CPU= 29.546
  22:32:06 STEP 1043 H= 260:45 +CPU= 29.611
  22:32:44 STEP 1044 H= 261:00 +CPU= 36.985
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001044
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001044
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001044
  22:33:14 STEP 1045 H= 261:15 +CPU= 29.989
  22:33:44 STEP 1046 H= 261:30 +CPU= 29.909
  22:34:14 STEP 1047 H= 261:45 +CPU= 29.938
  22:34:45 STEP 1048 H= 262:00 +CPU= 30.505
  22:35:15 STEP 1049 H= 262:15 +CPU= 29.762
  22:35:45 STEP 1050 H= 262:30 +CPU= 29.855
  22:36:15 STEP 1051 H= 262:45 +CPU= 29.611
  22:36:46 STEP 1052 H= 263:00 +CPU= 30.249
  22:37:16 STEP 1053 H= 263:15 +CPU= 29.743
  22:37:46 STEP 1054 H= 263:30 +CPU= 29.650
  22:38:16 STEP 1055 H= 263:45 +CPU= 29.672
  22:38:58 STEP 1056 H= 264:00 +CPU= 41.619
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001056
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001056
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001056
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+000960
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+000960
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+000960
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+000972
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+000972
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+000972
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+000984
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+000984
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+000984
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+000996
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+000996
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+000996
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001008
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001008
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001008
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001020
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001020
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001020
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001032
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001032
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001032
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001044
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001044
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001044
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_a4ef_2016092300_15_991_12212490_0_r1135422882_10.zip
Uploading the intermediate file: upload_file_10.zip
  22:39:28 STEP 1057 H= 264:15 +CPU= 30.161
  22:39:59 STEP 1058 H= 264:30 +CPU= 30.360
  22:40:30 STEP 1059 H= 264:45 +CPU= 30.393
  22:41:01 STEP 1060 H= 265:00 +CPU= 31.028
  22:41:31 STEP 1061 H= 265:15 +CPU= 29.688
  22:42:01 STEP 1062 H= 265:30 +CPU= 30.021
  22:42:31 STEP 1063 H= 265:45 +CPU= 29.979
  22:43:02 STEP 1064 H= 266:00 +CPU= 30.471
  22:43:32 STEP 1065 H= 266:15 +CPU= 29.907
  22:44:03 STEP 1066 H= 266:30 +CPU= 29.790
  22:44:33 STEP 1067 H= 266:45 +CPU= 29.910
  22:45:10 STEP 1068 H= 267:00 +CPU= 36.772
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001068
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001068
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001068
  22:45:40 STEP 1069 H= 267:15 +CPU= 29.556
  22:46:09 STEP 1070 H= 267:30 +CPU= 29.495
  22:46:39 STEP 1071 H= 267:45 +CPU= 29.634
  22:47:09 STEP 1072 H= 268:00 +CPU= 30.022
  22:47:39 STEP 1073 H= 268:15 +CPU= 29.616
  22:48:09 STEP 1074 H= 268:30 +CPU= 29.705
  22:48:39 STEP 1075 H= 268:45 +CPU= 29.593
  22:49:09 STEP 1076 H= 269:00 +CPU= 30.330
  22:49:40 STEP 1077 H= 269:15 +CPU= 29.858
  22:50:10 STEP 1078 H= 269:30 +CPU= 29.928
  22:50:40 STEP 1079 H= 269:45 +CPU= 30.280
  22:51:18 STEP 1080 H= 270:00 +CPU= 37.105
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001080
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001080
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001080
  22:51:48 STEP 1081 H= 270:15 +CPU= 30.597
  22:52:19 STEP 1082 H= 270:30 +CPU= 29.828
  22:52:49 STEP 1083 H= 270:45 +CPU= 29.976
  22:53:20 STEP 1084 H= 271:00 +CPU= 30.870
  22:53:50 STEP 1085 H= 271:15 +CPU= 30.204
  22:54:21 STEP 1086 H= 271:30 +CPU= 29.979
  22:54:51 STEP 1087 H= 271:45 +CPU= 29.651
  22:55:21 STEP 1088 H= 272:00 +CPU= 30.130
  22:55:51 STEP 1089 H= 272:15 +CPU= 29.868
  22:56:21 STEP 1090 H= 272:30 +CPU= 29.628
  22:56:51 STEP 1091 H= 272:45 +CPU= 29.808
  22:57:29 STEP 1092 H= 273:00 +CPU= 37.409
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001092
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001092
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001092
  22:57:59 STEP 1093 H= 273:15 +CPU= 29.893
  22:58:29 STEP 1094 H= 273:30 +CPU= 29.967
  22:58:59 STEP 1095 H= 273:45 +CPU= 29.704
  22:59:30 STEP 1096 H= 274:00 +CPU= 30.546
  23:00:00 STEP 1097 H= 274:15 +CPU= 29.969
  23:00:31 STEP 1098 H= 274:30 +CPU= 29.949
  23:01:00 STEP 1099 H= 274:45 +CPU= 29.503
  23:01:31 STEP 1100 H= 275:00 +CPU= 30.066
  23:02:00 STEP 1101 H= 275:15 +CPU= 29.600
  23:02:30 STEP 1102 H= 275:30 +CPU= 29.641
  23:03:00 STEP 1103 H= 275:45 +CPU= 29.908
  23:03:43 STEP 1104 H= 276:00 +CPU= 42.003
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001104
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001104
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001104
  23:04:13 STEP 1105 H= 276:15 +CPU= 29.993
  23:04:43 STEP 1106 H= 276:30 +CPU= 29.759
  23:05:14 STEP 1107 H= 276:45 +CPU= 29.833
  23:05:45 STEP 1108 H= 277:00 +CPU= 30.696
  23:06:15 STEP 1109 H= 277:15 +CPU= 29.952
  23:06:45 STEP 1110 H= 277:30 +CPU= 29.759
  23:07:15 STEP 1111 H= 277:45 +CPU= 29.766
  23:07:46 STEP 1112 H= 278:00 +CPU= 30.503
  23:08:16 STEP 1113 H= 278:15 +CPU= 29.702
  23:08:46 STEP 1114 H= 278:30 +CPU= 29.916
  23:09:17 STEP 1115 H= 278:45 +CPU= 30.219
  23:09:54 STEP 1116 H= 279:00 +CPU= 36.968
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001116
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001116
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001116
  23:10:24 STEP 1117 H= 279:15 +CPU= 30.307
  23:10:55 STEP 1118 H= 279:30 +CPU= 30.264
  23:11:25 STEP 1119 H= 279:45 +CPU= 29.999
  23:11:56 STEP 1120 H= 280:00 +CPU= 30.632
  23:12:27 STEP 1121 H= 280:15 +CPU= 30.224
  23:12:57 STEP 1122 H= 280:30 +CPU= 29.942
  23:13:27 STEP 1123 H= 280:45 +CPU= 30.133
  23:13:58 STEP 1124 H= 281:00 +CPU= 30.379
  23:14:28 STEP 1125 H= 281:15 +CPU= 29.781
  23:14:58 STEP 1126 H= 281:30 +CPU= 29.664
  23:15:28 STEP 1127 H= 281:45 +CPU= 29.555
  23:16:05 STEP 1128 H= 282:00 +CPU= 37.163
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001128
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001128
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001128
  23:16:36 STEP 1129 H= 282:15 +CPU= 29.987
  23:17:05 STEP 1130 H= 282:30 +CPU= 29.540
  23:17:35 STEP 1131 H= 282:45 +CPU= 29.568
  23:18:06 STEP 1132 H= 283:00 +CPU= 30.511
  23:18:36 STEP 1133 H= 283:15 +CPU= 29.616
  23:19:06 STEP 1134 H= 283:30 +CPU= 29.681
  23:19:36 STEP 1135 H= 283:45 +CPU= 29.846
  23:20:07 STEP 1136 H= 284:00 +CPU= 30.656
  23:20:37 STEP 1137 H= 284:15 +CPU= 29.684
  23:21:06 STEP 1138 H= 284:30 +CPU= 29.612
  23:21:36 STEP 1139 H= 284:45 +CPU= 29.712
  23:22:14 STEP 1140 H= 285:00 +CPU= 36.993
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001140
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001140
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001140
  23:22:43 STEP 1141 H= 285:15 +CPU= 29.536
  23:23:13 STEP 1142 H= 285:30 +CPU= 29.371
  23:23:43 STEP 1143 H= 285:45 +CPU= 29.572
  23:24:13 STEP 1144 H= 286:00 +CPU= 30.358
  23:24:44 STEP 1145 H= 286:15 +CPU= 30.166
  23:25:14 STEP 1146 H= 286:30 +CPU= 30.205
  23:25:45 STEP 1147 H= 286:45 +CPU= 30.253
  23:26:16 STEP 1148 H= 287:00 +CPU= 30.839
  23:26:47 STEP 1149 H= 287:15 +CPU= 30.133
  23:27:17 STEP 1150 H= 287:30 +CPU= 30.110
  23:27:47 STEP 1151 H= 287:45 +CPU= 30.170
  23:28:30 STEP 1152 H= 288:00 +CPU= 42.100
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001152
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001152
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001152
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001056
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001056
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001056
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001068
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001068
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001068
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001080
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001080
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001080
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001092
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001092
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001092
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001104
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001104
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001104
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001116
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001116
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001116
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001128
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001128
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001128
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001140
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001140
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001140
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_a4ef_2016092300_15_991_12212490_0_r1135422882_11.zip
Uploading the intermediate file: upload_file_11.zip
  23:29:00 STEP 1153 H= 288:15 +CPU= 30.087
  23:29:31 STEP 1154 H= 288:30 +CPU= 30.239
  23:30:02 STEP 1155 H= 288:45 +CPU= 30.573
  23:30:33 STEP 1156 H= 289:00 +CPU= 30.919
  23:31:03 STEP 1157 H= 289:15 +CPU= 29.972
  23:31:33 STEP 1158 H= 289:30 +CPU= 29.785
  23:32:03 STEP 1159 H= 289:45 +CPU= 30.119
  23:32:34 STEP 1160 H= 290:00 +CPU= 30.311
  23:33:04 STEP 1161 H= 290:15 +CPU= 29.781
  23:33:35 STEP 1162 H= 290:30 +CPU= 30.252
  23:34:05 STEP 1163 H= 290:45 +CPU= 30.005
  23:34:43 STEP 1164 H= 291:00 +CPU= 37.675
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001164
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001164
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001164
  23:35:13 STEP 1165 H= 291:15 +CPU= 30.183
  23:35:43 STEP 1166 H= 291:30 +CPU= 29.759
  23:36:13 STEP 1167 H= 291:45 +CPU= 29.538
  23:36:44 STEP 1168 H= 292:00 +CPU= 30.332
  23:37:14 STEP 1169 H= 292:15 +CPU= 29.696
  23:37:44 STEP 1170 H= 292:30 +CPU= 29.733
  23:38:13 STEP 1171 H= 292:45 +CPU= 29.590
  23:38:44 STEP 1172 H= 293:00 +CPU= 30.251
  23:39:14 STEP 1173 H= 293:15 +CPU= 29.689
  23:39:44 STEP 1174 H= 293:30 +CPU= 30.013
  23:40:14 STEP 1175 H= 293:45 +CPU= 29.781
  23:40:52 STEP 1176 H= 294:00 +CPU= 37.157
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001176
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001176
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001176
  23:41:22 STEP 1177 H= 294:15 +CPU= 29.775
  23:41:52 STEP 1178 H= 294:30 +CPU= 30.286
  23:42:23 STEP 1179 H= 294:45 +CPU= 30.312
  23:42:54 STEP 1180 H= 295:00 +CPU= 30.942
  23:43:25 STEP 1181 H= 295:15 +CPU= 30.617
  23:43:56 STEP 1182 H= 295:30 +CPU= 30.278
  23:44:27 STEP 1183 H= 295:45 +CPU= 30.659
  23:44:58 STEP 1184 H= 296:00 +CPU= 30.685
  23:45:28 STEP 1185 H= 296:15 +CPU= 29.822
  23:45:58 STEP 1186 H= 296:30 +CPU= 30.302
  23:46:29 STEP 1187 H= 296:45 +CPU= 30.012
  23:47:06 STEP 1188 H= 297:00 +CPU= 37.302
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001188
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001188
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001188
  23:47:36 STEP 1189 H= 297:15 +CPU= 29.921
  23:48:06 STEP 1190 H= 297:30 +CPU= 29.504
  23:48:36 STEP 1191 H= 297:45 +CPU= 29.542
  23:49:07 STEP 1192 H= 298:00 +CPU= 30.544
  23:49:37 STEP 1193 H= 298:15 +CPU= 30.208
  23:50:08 STEP 1194 H= 298:30 +CPU= 29.960
  23:50:38 STEP 1195 H= 298:45 +CPU= 30.034
  23:51:09 STEP 1196 H= 299:00 +CPU= 30.519
  23:51:39 STEP 1197 H= 299:15 +CPU= 29.976
  23:52:09 STEP 1198 H= 299:30 +CPU= 29.871
  23:52:40 STEP 1199 H= 299:45 +CPU= 30.133
  23:53:22 STEP 1200 H= 300:00 +CPU= 42.221
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001200
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001200
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001200
  23:53:53 STEP 1201 H= 300:15 +CPU= 30.107
  23:54:23 STEP 1202 H= 300:30 +CPU= 30.330
  23:54:53 STEP 1203 H= 300:45 +CPU= 29.805
  23:55:24 STEP 1204 H= 301:00 +CPU= 30.580
  23:55:54 STEP 1205 H= 301:15 +CPU= 29.770
  23:56:25 STEP 1206 H= 301:30 +CPU= 30.095
  23:56:55 STEP 1207 H= 301:45 +CPU= 29.966
  23:57:26 STEP 1208 H= 302:00 +CPU= 30.337
  23:57:56 STEP 1209 H= 302:15 +CPU= 30.128
  23:58:26 STEP 1210 H= 302:30 +CPU= 29.970
  23:58:56 STEP 1211 H= 302:45 +CPU= 29.724
  23:59:34 STEP 1212 H= 303:00 +CPU= 37.475
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001212
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001212
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001212
  00:00:05 STEP 1213 H= 303:15 +CPU= 30.131
  00:00:35 STEP 1214 H= 303:30 +CPU= 30.105
  00:01:05 STEP 1215 H= 303:45 +CPU= 30.054
  00:01:36 STEP 1216 H= 304:00 +CPU= 30.439
  00:02:07 STEP 1217 H= 304:15 +CPU= 30.053
  00:02:37 STEP 1218 H= 304:30 +CPU= 29.940
  00:03:07 STEP 1219 H= 304:45 +CPU= 29.993
  00:03:38 STEP 1220 H= 305:00 +CPU= 30.611
  00:04:08 STEP 1221 H= 305:15 +CPU= 30.150
  00:04:39 STEP 1222 H= 305:30 +CPU= 30.037
  00:05:09 STEP 1223 H= 305:45 +CPU= 30.036
  00:05:47 STEP 1224 H= 306:00 +CPU= 37.321
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001224
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001224
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001224
  00:06:17 STEP 1225 H= 306:15 +CPU= 29.752
  00:06:47 STEP 1226 H= 306:30 +CPU= 29.844
  00:07:17 STEP 1227 H= 306:45 +CPU= 29.772
  00:07:48 STEP 1228 H= 307:00 +CPU= 30.956
  00:08:18 STEP 1229 H= 307:15 +CPU= 30.020
  00:08:49 STEP 1230 H= 307:30 +CPU= 30.240
  00:09:20 STEP 1231 H= 307:45 +CPU= 30.145
  00:09:50 STEP 1232 H= 308:00 +CPU= 30.613
  00:10:21 STEP 1233 H= 308:15 +CPU= 30.241
  00:10:51 STEP 1234 H= 308:30 +CPU= 30.102
  00:11:22 STEP 1235 H= 308:45 +CPU= 30.087
  00:12:00 STEP 1236 H= 309:00 +CPU= 37.825
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001236
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001236
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001236
  00:12:31 STEP 1237 H= 309:15 +CPU= 30.378
  00:13:01 STEP 1238 H= 309:30 +CPU= 30.282
  00:13:31 STEP 1239 H= 309:45 +CPU= 29.306
  00:14:01 STEP 1240 H= 310:00 +CPU= 30.080
  00:14:31 STEP 1241 H= 310:15 +CPU= 29.391
  00:15:01 STEP 1242 H= 310:30 +CPU= 29.390
  00:15:30 STEP 1243 H= 310:45 +CPU= 29.494
  00:16:01 STEP 1244 H= 311:00 +CPU= 30.090
  00:16:30 STEP 1245 H= 311:15 +CPU= 29.292
  00:17:00 STEP 1246 H= 311:30 +CPU= 29.339
  00:17:30 STEP 1247 H= 311:45 +CPU= 29.429
  00:18:11 STEP 1248 H= 312:00 +CPU= 41.162
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001248
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001248
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001248
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001152
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001152
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001152
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001164
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001164
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001164
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001176
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001176
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001176
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001188
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001188
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001188
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001200
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001200
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001200
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001212
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001212
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001212
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001224
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001224
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001224
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001236
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001236
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001236
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_a4ef_2016092300_15_991_12212490_0_r1135422882_12.zip
Uploading the intermediate file: upload_file_12.zip
  00:18:42 STEP 1249 H= 312:15 +CPU= 29.866
Uploading trickle at timestep: 1123200
  00:19:12 STEP 1250 H= 312:30 +CPU= 29.884
  00:19:42 STEP 1251 H= 312:45 +CPU= 29.915
  00:20:12 STEP 1252 H= 313:00 +CPU= 30.249
  00:20:42 STEP 1253 H= 313:15 +CPU= 29.417
  00:21:12 STEP 1254 H= 313:30 +CPU= 29.207
  00:21:41 STEP 1255 H= 313:45 +CPU= 29.390
  00:22:11 STEP 1256 H= 314:00 +CPU= 29.943
  00:22:41 STEP 1257 H= 314:15 +CPU= 29.151
  00:23:10 STEP 1258 H= 314:30 +CPU= 29.310
  00:23:40 STEP 1259 H= 314:45 +CPU= 29.231
  00:24:17 STEP 1260 H= 315:00 +CPU= 36.564
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001260
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001260
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001260
  00:24:46 STEP 1261 H= 315:15 +CPU= 29.490
  00:25:16 STEP 1262 H= 315:30 +CPU= 29.383
  00:25:46 STEP 1263 H= 315:45 +CPU= 29.476
  00:26:16 STEP 1264 H= 316:00 +CPU= 29.958
  00:26:46 STEP 1265 H= 316:15 +CPU= 29.369
  00:27:16 STEP 1266 H= 316:30 +CPU= 29.424
  00:27:45 STEP 1267 H= 316:45 +CPU= 29.455
  00:28:16 STEP 1268 H= 317:00 +CPU= 30.064
  00:28:45 STEP 1269 H= 317:15 +CPU= 29.435
  00:29:15 STEP 1270 H= 317:30 +CPU= 29.674
  00:29:46 STEP 1271 H= 317:45 +CPU= 29.844
  00:30:23 STEP 1272 H= 318:00 +CPU= 36.872
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001272
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001272
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001272
  00:30:52 STEP 1273 H= 318:15 +CPU= 29.186
  00:31:22 STEP 1274 H= 318:30 +CPU= 29.423
  00:31:51 STEP 1275 H= 318:45 +CPU= 29.127
  00:32:22 STEP 1276 H= 319:00 +CPU= 30.032
  00:32:51 STEP 1277 H= 319:15 +CPU= 29.143
  00:33:21 STEP 1278 H= 319:30 +CPU= 29.915
  00:33:51 STEP 1279 H= 319:45 +CPU= 29.738
  00:34:22 STEP 1280 H= 320:00 +CPU= 30.561
  00:34:52 STEP 1281 H= 320:15 +CPU= 29.838
  00:35:22 STEP 1282 H= 320:30 +CPU= 29.736
  00:35:52 STEP 1283 H= 320:45 +CPU= 29.395
  00:36:29 STEP 1284 H= 321:00 +CPU= 36.730
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001284
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001284
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001284
  00:36:59 STEP 1285 H= 321:15 +CPU= 29.285
  00:37:28 STEP 1286 H= 321:30 +CPU= 29.235
  00:37:58 STEP 1287 H= 321:45 +CPU= 29.309
  00:38:28 STEP 1288 H= 322:00 +CPU= 30.013
  00:38:58 STEP 1289 H= 322:15 +CPU= 29.433
  00:39:27 STEP 1290 H= 322:30 +CPU= 29.356
  00:39:57 STEP 1291 H= 322:45 +CPU= 29.431
  00:40:28 STEP 1292 H= 323:00 +CPU= 30.187
  00:40:58 STEP 1293 H= 323:15 +CPU= 29.553
  00:41:27 STEP 1294 H= 323:30 +CPU= 29.524
  00:41:57 STEP 1295 H= 323:45 +CPU= 29.492
  00:42:39 STEP 1296 H= 324:00 +CPU= 41.014
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001296
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001296
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001296
  00:43:08 STEP 1297 H= 324:15 +CPU= 29.432
  00:43:38 STEP 1298 H= 324:30 +CPU= 29.404
  00:44:08 STEP 1299 H= 324:45 +CPU= 29.426
  00:44:39 STEP 1300 H= 325:00 +CPU= 30.535
  00:45:08 STEP 1301 H= 325:15 +CPU= 29.537
  00:45:38 STEP 1302 H= 325:30 +CPU= 29.556
  00:46:08 STEP 1303 H= 325:45 +CPU= 29.535
  00:46:38 STEP 1304 H= 326:00 +CPU= 29.875
  00:47:08 STEP 1305 H= 326:15 +CPU= 29.315
  00:47:38 STEP 1306 H= 326:30 +CPU= 29.455
  00:48:08 STEP 1307 H= 326:45 +CPU= 29.584
  00:48:45 STEP 1308 H= 327:00 +CPU= 36.803
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001308
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001308
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001308
  00:49:15 STEP 1309 H= 327:15 +CPU= 29.432
  00:49:44 STEP 1310 H= 327:30 +CPU= 29.250
  00:50:14 STEP 1311 H= 327:45 +CPU= 29.284
  00:50:44 STEP 1312 H= 328:00 +CPU= 29.940
  00:51:14 STEP 1313 H= 328:15 +CPU= 29.339
  00:51:43 STEP 1314 H= 328:30 +CPU= 29.235
  00:52:13 STEP 1315 H= 328:45 +CPU= 29.563
  00:52:43 STEP 1316 H= 329:00 +CPU= 30.110
  00:53:13 STEP 1317 H= 329:15 +CPU= 29.581
  00:53:43 STEP 1318 H= 329:30 +CPU= 29.507
  00:54:13 STEP 1319 H= 329:45 +CPU= 29.484
  00:54:50 STEP 1320 H= 330:00 +CPU= 36.923
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001320
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001320
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001320
  00:55:20 STEP 1321 H= 330:15 +CPU= 29.561
  00:55:50 STEP 1322 H= 330:30 +CPU= 29.530
  00:56:20 STEP 1323 H= 330:45 +CPU= 29.614
  00:56:50 STEP 1324 H= 331:00 +CPU= 30.159
  00:57:20 STEP 1325 H= 331:15 +CPU= 29.380
  00:57:50 STEP 1326 H= 331:30 +CPU= 29.578
  00:58:20 STEP 1327 H= 331:45 +CPU= 29.367
  00:58:50 STEP 1328 H= 332:00 +CPU= 30.093
  00:59:20 STEP 1329 H= 332:15 +CPU= 29.398
  00:59:49 STEP 1330 H= 332:30 +CPU= 29.097
  01:00:18 STEP 1331 H= 332:45 +CPU= 29.233
  01:00:55 STEP 1332 H= 333:00 +CPU= 36.534
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001332
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001332
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001332
  01:01:25 STEP 1333 H= 333:15 +CPU= 29.472
  01:01:55 STEP 1334 H= 333:30 +CPU= 29.377
  01:02:24 STEP 1335 H= 333:45 +CPU= 29.389
  01:02:55 STEP 1336 H= 334:00 +CPU= 29.983
  01:03:24 STEP 1337 H= 334:15 +CPU= 29.373
  01:03:54 STEP 1338 H= 334:30 +CPU= 29.342
  01:04:24 STEP 1339 H= 334:45 +CPU= 29.324
  01:04:54 STEP 1340 H= 335:00 +CPU= 30.109
  01:05:24 STEP 1341 H= 335:15 +CPU= 29.577
  01:05:54 STEP 1342 H= 335:30 +CPU= 29.689
  01:06:24 STEP 1343 H= 335:45 +CPU= 29.536
  01:07:05 STEP 1344 H= 336:00 +CPU= 41.315
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001344
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001344
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001344
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001248
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001248
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001248
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001260
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001260
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001260
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001272
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001272
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001272
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001284
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001284
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001284
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001296
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001296
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001296
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001308
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001308
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001308
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001320
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001320
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001320
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001332
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001332
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001332
Zipping up the intermediate file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_a4ef_2016092300_15_991_12212490_0_r1135422882_13.zip
Uploading the intermediate file: upload_file_13.zip
  01:07:36 STEP 1345 H= 336:15 +CPU= 29.879
  01:08:06 STEP 1346 H= 336:30 +CPU= 29.864
  01:08:36 STEP 1347 H= 336:45 +CPU= 29.944
  01:09:07 STEP 1348 H= 337:00 +CPU= 30.262
  01:09:36 STEP 1349 H= 337:15 +CPU= 29.341
  01:10:06 STEP 1350 H= 337:30 +CPU= 29.180
  01:10:35 STEP 1351 H= 337:45 +CPU= 29.358
  01:11:06 STEP 1352 H= 338:00 +CPU= 30.213
  01:11:36 STEP 1353 H= 338:15 +CPU= 29.624
  01:12:05 STEP 1354 H= 338:30 +CPU= 29.423
  01:12:35 STEP 1355 H= 338:45 +CPU= 29.557
  01:13:13 STEP 1356 H= 339:00 +CPU= 36.997
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001356
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001356
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001356
  01:13:42 STEP 1357 H= 339:15 +CPU= 29.541
  01:14:12 STEP 1358 H= 339:30 +CPU= 29.667
  01:14:42 STEP 1359 H= 339:45 +CPU= 29.538
  01:15:13 STEP 1360 H= 340:00 +CPU= 30.180
  01:15:43 STEP 1361 H= 340:15 +CPU= 29.567
  01:16:12 STEP 1362 H= 340:30 +CPU= 29.472
  01:16:42 STEP 1363 H= 340:45 +CPU= 29.570
  01:17:13 STEP 1364 H= 341:00 +CPU= 30.090
  01:17:42 STEP 1365 H= 341:15 +CPU= 29.461
  01:18:12 STEP 1366 H= 341:30 +CPU= 29.431
  01:18:42 STEP 1367 H= 341:45 +CPU= 29.487
  01:19:19 STEP 1368 H= 342:00 +CPU= 36.809
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001368
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001368
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001368
  01:19:49 STEP 1369 H= 342:15 +CPU= 29.442
  01:20:19 STEP 1370 H= 342:30 +CPU= 29.419
  01:20:48 STEP 1371 H= 342:45 +CPU= 29.297
  01:21:18 STEP 1372 H= 343:00 +CPU= 30.067
  01:21:48 STEP 1373 H= 343:15 +CPU= 29.361
  01:22:18 STEP 1374 H= 343:30 +CPU= 29.282
  01:22:47 STEP 1375 H= 343:45 +CPU= 29.635
  01:23:17 STEP 1376 H= 344:00 +CPU= 29.148
  01:23:43 STEP 1377 H= 344:15 +CPU= 26.371
  01:24:10 STEP 1378 H= 344:30 +CPU= 26.355
  01:24:37 STEP 1379 H= 344:45 +CPU= 26.998
  01:25:11 STEP 1380 H= 345:00 +CPU= 33.687
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001380
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001380
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001380
  01:25:38 STEP 1381 H= 345:15 +CPU= 27.244
  01:26:06 STEP 1382 H= 345:30 +CPU= 27.471
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:27:02 STEP 1383 H= 345:45 +CPU= 27.632
  01:27:31 STEP 1384 H= 346:00 +CPU= 28.457
  01:27:59 STEP 1385 H= 346:15 +CPU= 27.848
  01:28:27 STEP 1386 H= 346:30 +CPU= 27.838
  01:28:55 STEP 1387 H= 346:45 +CPU= 27.842
  01:29:23 STEP 1388 H= 347:00 +CPU= 28.459
  01:29:51 STEP 1389 H= 347:15 +CPU= 27.818
  01:30:19 STEP 1390 H= 347:30 +CPU= 27.865
  01:30:47 STEP 1391 H= 347:45 +CPU= 27.876
  01:31:27 STEP 1392 H= 348:00 +CPU= 39.305
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001392
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001392
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001392
  01:31:55 STEP 1393 H= 348:15 +CPU= 27.864
  01:32:23 STEP 1394 H= 348:30 +CPU= 27.853
  01:32:51 STEP 1395 H= 348:45 +CPU= 27.810
  01:33:20 STEP 1396 H= 349:00 +CPU= 28.520
  01:33:48 STEP 1397 H= 349:15 +CPU= 27.828
  01:34:16 STEP 1398 H= 349:30 +CPU= 27.857
  01:34:44 STEP 1399 H= 349:45 +CPU= 27.870
  01:35:12 STEP 1400 H= 350:00 +CPU= 28.429
  01:35:40 STEP 1401 H= 350:15 +CPU= 27.859
  01:36:08 STEP 1402 H= 350:30 +CPU= 27.885
  01:36:36 STEP 1403 H= 350:45 +CPU= 27.825
  01:37:12 STEP 1404 H= 351:00 +CPU= 34.956
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001404
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001404
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001404
  01:37:40 STEP 1405 H= 351:15 +CPU= 27.845
  01:38:08 STEP 1406 H= 351:30 +CPU= 27.907
  01:38:36 STEP 1407 H= 351:45 +CPU= 27.879
  01:39:04 STEP 1408 H= 352:00 +CPU= 28.521
  01:39:33 STEP 1409 H= 352:15 +CPU= 28.073
  01:40:01 STEP 1410 H= 352:30 +CPU= 28.064
  01:40:29 STEP 1411 H= 352:45 +CPU= 28.075
  01:40:59 STEP 1412 H= 353:00 +CPU= 28.859
  01:41:27 STEP 1413 H= 353:15 +CPU= 28.272
  01:41:56 STEP 1414 H= 353:30 +CPU= 28.233
  01:42:24 STEP 1415 H= 353:45 +CPU= 28.177
  01:43:00 STEP 1416 H= 354:00 +CPU= 35.393
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001416
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001416
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001416
  01:43:29 STEP 1417 H= 354:15 +CPU= 28.288
  01:43:57 STEP 1418 H= 354:30 +CPU= 28.180
  01:44:26 STEP 1419 H= 354:45 +CPU= 28.180
  01:44:55 STEP 1420 H= 355:00 +CPU= 28.973
  01:45:24 STEP 1421 H= 355:15 +CPU= 28.298
  01:45:52 STEP 1422 H= 355:30 +CPU= 28.250
  01:46:21 STEP 1423 H= 355:45 +CPU= 28.139
  01:46:50 STEP 1424 H= 356:00 +CPU= 28.837
  01:47:18 STEP 1425 H= 356:15 +CPU= 28.248
  01:47:47 STEP 1426 H= 356:30 +CPU= 28.101
  01:48:15 STEP 1427 H= 356:45 +CPU= 28.213
  01:48:51 STEP 1428 H= 357:00 +CPU= 35.478
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001428
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001428
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001428
  01:49:20 STEP 1429 H= 357:15 +CPU= 28.145
  01:49:48 STEP 1430 H= 357:30 +CPU= 28.122
  01:50:16 STEP 1431 H= 357:45 +CPU= 28.051
  01:50:45 STEP 1432 H= 358:00 +CPU= 28.667
  01:51:13 STEP 1433 H= 358:15 +CPU= 27.852
  01:51:41 STEP 1434 H= 358:30 +CPU= 27.976
  01:52:10 STEP 1435 H= 358:45 +CPU= 28.008
  01:52:38 STEP 1436 H= 359:00 +CPU= 28.445
  01:53:06 STEP 1437 H= 359:15 +CPU= 27.873
  01:53:35 STEP 1438 H= 359:30 +CPU= 28.157
  01:54:03 STEP 1439 H= 359:45 +CPU= 28.043
  01:54:40 STEP 1440 H= 360:00 +CPU= 36.798
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.5727207223E-21      I       0.1137404532E-07      I
ICloud fractionI      0.0000000000E+00      I       0.1747682488E-01      I
I  Relat. Hum. I      0.1647275750E+00      I       0.2372703412E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.6669500699E+02      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    301435121 BYTES IN      7 RECORDS TRANSFERRED IN    0.0007 SECONDS430621.6 Mbytes/s, TOTAL TIME=    0.0102( 6.9%)
 01:54:40 STEP 1440 H= 360:00 +CPU= 36.798
 END CNT3
 NSTEP =  1440 CNT0   000000000  26.352  26.352  26.545   0.993               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           34/  1069125708 WRITTEN        34032/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    603    0       34      1044068    34032 ************    89.3    17.9    71.4    19.0   138.8
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.94      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1249    5159.2    5159.2     18.20      0.00
   9 SPCM     - SPECTRAL COMP.                    1152    1081.2    1081.2      3.52      0.00
  10 SCAN2M - PHYSICS                             1153   15067.3   15067.3     49.08      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 96    1090.7    1090.7      0.30      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 49      52.0      52.0      0.01      0.00
  17 GRIDFPOS IN CNT4                               96      28.6      28.6      0.01      0.00
  27 RESTART FILES - WRITING                        24    4363.0    4363.0      0.30      0.00
  28 RESTART FILES - READING                         1   20056.7   20056.7      0.06      0.00
  29 SU4FPOS IN CNT4                                96       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                                96    6609.8    6609.8      1.79      0.00
  31 POSDDH IN STEPO                                 5       1.3       1.3      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1153    5537.5    5537.5     18.04      0.00
  39 SU0YOMB                                         1     435.0     435.0      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1153      25.5      25.5      0.08      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1152     329.3     329.3      1.07      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1152      80.4      80.4      0.26      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 49       0.4       0.4      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     2500     424.4     424.4      3.00      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      2400     260.2     260.2      1.76      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       2400      89.6      89.6      0.61      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      2500     136.3     136.3      0.96      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      49.3      49.3      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           2500      73.1      73.1      0.52      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           2400      39.7      39.7      0.27      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           2500      77.3      77.3      0.55      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           2400      32.6      32.6      0.22      0.00
 400 GSTATS                                     133967       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                124583       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    35396.2 CPU TIME   35014.8 VECTOR TIME    35014.8


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       36.6
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /home/gary/boinc/slots/2/ICMGGh7zg+001440
Moving to projects directory: /home/gary/boinc/slots/2/ICMSHh7zg+001440
Moving to projects directory: /home/gary/boinc/slots/2/ICMUAh7zg+001440
Adding to the zip: /home/gary/boinc/slots/2/NODE.001_01
Adding to the zip: /home/gary/boinc/slots/2/ifs.stat
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001368
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001404
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001392
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001416
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001428
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001428
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001404
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001356
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001356
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001356
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001428
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001380
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001392
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001440
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001344
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001440
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001380
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001368
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001380
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001440
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001344
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001416
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMSHh7zg+001416
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001404
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001344
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMGGh7zg+001368
Adding to the zip: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_12212490/ICMUAh7zg+001392
Zipping up the final file: /home/gary/boinc/projects/climateprediction.net/oifs_43r3_bl_a4ef_2016092300_15_991_12212490_0_r1135422882_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
01:58:09 (1664): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:54:57 1535783 22312755 oifs_43r3_bl_a4ef_2016092300_15_991_12212490_0 1,295,100 44,549 0.0344
09 May 2023 16:54:57 1535783 22312755 oifs_43r3_bl_a4ef_2016092300_15_991_12212490_0 1,123,200 38,845 0.0346


©2024 climateprediction.net