climateprediction.net home page
Task 22440004

Task 22440004

Name oifs_43r3_bl_a2at_2016092300_20_1017_12284808_1
Workunit 12284808
Created 7 Jun 2024, 20:21:03 UTC
Sent 8 Jun 2024, 1:21:01 UTC
Report deadline 7 Aug 2024, 1:21:01 UTC
Received 8 Jun 2024, 18:39:32 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1532374
Run time 16 hours 18 min 43 sec
CPU time 15 hours 15 min 29 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 5.37 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,009.95 MB
Peak swap size 5,980.80 MB
Peak disk usage 1,354.60 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
9 H= 199:45 +CPU= 37.446
  09:06:53 STEP  800 H= 200:00 +CPU= 36.427
  09:07:31 STEP  801 H= 200:15 +CPU= 36.067
  09:08:09 STEP  802 H= 200:30 +CPU= 35.488
  09:08:48 STEP  803 H= 200:45 +CPU= 36.106
  09:09:36 STEP  804 H= 201:00 +CPU= 45.706
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+000804
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+000804
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+000804
  09:10:13 STEP  805 H= 201:15 +CPU= 34.454
  09:10:51 STEP  806 H= 201:30 +CPU= 35.964
  09:11:29 STEP  807 H= 201:45 +CPU= 35.044
  09:12:08 STEP  808 H= 202:00 +CPU= 36.695
  09:12:47 STEP  809 H= 202:15 +CPU= 36.896
  09:13:26 STEP  810 H= 202:30 +CPU= 36.410
  09:14:04 STEP  811 H= 202:45 +CPU= 35.705
  09:14:43 STEP  812 H= 203:00 +CPU= 37.154
  09:15:22 STEP  813 H= 203:15 +CPU= 36.264
  09:16:01 STEP  814 H= 203:30 +CPU= 36.414
  09:16:40 STEP  815 H= 203:45 +CPU= 37.077
  09:17:34 STEP  816 H= 204:00 +CPU= 50.999
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+000816
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+000816
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+000816
  09:18:14 STEP  817 H= 204:15 +CPU= 36.715
  09:18:52 STEP  818 H= 204:30 +CPU= 35.707
  09:19:31 STEP  819 H= 204:45 +CPU= 36.575
  09:20:11 STEP  820 H= 205:00 +CPU= 38.054
  09:20:49 STEP  821 H= 205:15 +CPU= 35.684
  09:21:27 STEP  822 H= 205:30 +CPU= 35.993
  09:22:06 STEP  823 H= 205:45 +CPU= 36.373
  09:22:46 STEP  824 H= 206:00 +CPU= 38.286
  09:23:24 STEP  825 H= 206:15 +CPU= 35.254
  09:24:02 STEP  826 H= 206:30 +CPU= 36.407
  09:24:39 STEP  827 H= 206:45 +CPU= 34.678
  09:25:24 STEP  828 H= 207:00 +CPU= 42.959
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+000828
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+000828
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+000828
  09:26:02 STEP  829 H= 207:15 +CPU= 35.131
  09:26:39 STEP  830 H= 207:30 +CPU= 35.422
  09:27:17 STEP  831 H= 207:45 +CPU= 36.866
  09:27:57 STEP  832 H= 208:00 +CPU= 37.549
  09:28:35 STEP  833 H= 208:15 +CPU= 36.344
  09:29:16 STEP  834 H= 208:30 +CPU= 37.559
  09:29:54 STEP  835 H= 208:45 +CPU= 36.859
  09:30:35 STEP  836 H= 209:00 +CPU= 37.939
  09:31:14 STEP  837 H= 209:15 +CPU= 36.847
  09:31:54 STEP  838 H= 209:30 +CPU= 37.493
  09:32:33 STEP  839 H= 209:45 +CPU= 36.991
  09:33:19 STEP  840 H= 210:00 +CPU= 44.135
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+000840
  09:33:56 STEP  841 H= 210:15 +CPU= 35.319
  09:34:35 STEP  842 H= 210:30 +CPU= 36.012
  09:35:14 STEP  843 H= 210:45 +CPU= 36.876
  09:35:55 STEP  844 H= 211:00 +CPU= 38.094
  09:36:32 STEP  845 H= 211:15 +CPU= 35.004
  09:37:09 STEP  846 H= 211:30 +CPU= 35.592
  09:37:48 STEP  847 H= 211:45 +CPU= 37.412
  09:38:28 STEP  848 H= 212:00 +CPU= 37.768
  09:39:08 STEP  849 H= 212:15 +CPU= 37.436
  09:39:47 STEP  850 H= 212:30 +CPU= 36.298
  09:40:25 STEP  851 H= 212:45 +CPU= 36.312
  09:41:15 STEP  852 H= 213:00 +CPU= 46.009
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+000852
  09:41:55 STEP  853 H= 213:15 +CPU= 37.261
  09:42:37 STEP  854 H= 213:30 +CPU= 39.009
  09:43:22 STEP  855 H= 213:45 +CPU= 41.883
  09:44:08 STEP  856 H= 214:00 +CPU= 43.011
  09:44:55 STEP  857 H= 214:15 +CPU= 44.107
  09:45:41 STEP  858 H= 214:30 +CPU= 42.797
  09:46:24 STEP  859 H= 214:45 +CPU= 41.359
  09:47:13 STEP  860 H= 215:00 +CPU= 45.174
  09:47:58 STEP  861 H= 215:15 +CPU= 42.709
  09:48:43 STEP  862 H= 215:30 +CPU= 41.405
  09:49:28 STEP  863 H= 215:45 +CPU= 42.372
  09:50:31 STEP  864 H= 216:00 +CPU= 58.009
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2at_2016092300_20_1017_12284808_1_r806671331_8.zip
Uploading the intermediate file: upload_file_8.zip
  09:51:15 STEP  865 H= 216:15 +CPU= 40.375
  09:52:03 STEP  866 H= 216:30 +CPU= 44.046
  09:52:46 STEP  867 H= 216:45 +CPU= 40.716
  09:53:33 STEP  868 H= 217:00 +CPU= 43.788
  09:54:19 STEP  869 H= 217:15 +CPU= 43.192
  09:55:04 STEP  870 H= 217:30 +CPU= 41.902
  09:55:50 STEP  871 H= 217:45 +CPU= 42.439
  09:56:36 STEP  872 H= 218:00 +CPU= 43.404
  09:57:20 STEP  873 H= 218:15 +CPU= 41.053
  09:58:05 STEP  874 H= 218:30 +CPU= 41.636
  09:58:49 STEP  875 H= 218:45 +CPU= 41.275
  09:59:43 STEP  876 H= 219:00 +CPU= 50.881
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+000876
  10:00:27 STEP  877 H= 219:15 +CPU= 41.448
  10:01:13 STEP  878 H= 219:30 +CPU= 41.728
  10:01:59 STEP  879 H= 219:45 +CPU= 42.486
  10:02:44 STEP  880 H= 220:00 +CPU= 42.575
  10:03:29 STEP  881 H= 220:15 +CPU= 41.396
  10:04:12 STEP  882 H= 220:30 +CPU= 41.081
  10:04:56 STEP  883 H= 220:45 +CPU= 41.457
  10:05:41 STEP  884 H= 221:00 +CPU= 41.825
  10:06:26 STEP  885 H= 221:15 +CPU= 41.516
  10:07:09 STEP  886 H= 221:30 +CPU= 40.321
  10:07:54 STEP  887 H= 221:45 +CPU= 41.967
  10:08:49 STEP  888 H= 222:00 +CPU= 52.044
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+000888
  10:09:35 STEP  889 H= 222:15 +CPU= 42.355
  10:10:18 STEP  890 H= 222:30 +CPU= 39.591
  10:11:02 STEP  891 H= 222:45 +CPU= 41.516
  10:11:48 STEP  892 H= 223:00 +CPU= 42.983
  10:12:33 STEP  893 H= 223:15 +CPU= 41.929
  10:13:19 STEP  894 H= 223:30 +CPU= 43.146
  10:14:04 STEP  895 H= 223:45 +CPU= 42.133
  10:14:51 STEP  896 H= 224:00 +CPU= 43.422
  10:15:35 STEP  897 H= 224:15 +CPU= 41.689
  10:16:19 STEP  898 H= 224:30 +CPU= 40.937
  10:17:06 STEP  899 H= 224:45 +CPU= 43.484
  10:18:02 STEP  900 H= 225:00 +CPU= 52.606
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+000900
  10:18:45 STEP  901 H= 225:15 +CPU= 41.039
  10:19:30 STEP  902 H= 225:30 +CPU= 42.466
  10:20:15 STEP  903 H= 225:45 +CPU= 41.879
  10:21:01 STEP  904 H= 226:00 +CPU= 43.057
  10:21:47 STEP  905 H= 226:15 +CPU= 43.115
  10:22:35 STEP  906 H= 226:30 +CPU= 44.304
  10:23:22 STEP  907 H= 226:45 +CPU= 44.665
  10:24:10 STEP  908 H= 227:00 +CPU= 43.955
  10:24:55 STEP  909 H= 227:15 +CPU= 42.036
  10:25:42 STEP  910 H= 227:30 +CPU= 42.717
  10:26:27 STEP  911 H= 227:45 +CPU= 42.365
  10:27:31 STEP  912 H= 228:00 +CPU= 58.694
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+000912
  10:28:14 STEP  913 H= 228:15 +CPU= 40.984
  10:28:58 STEP  914 H= 228:30 +CPU= 41.046
  10:29:43 STEP  915 H= 228:45 +CPU= 42.442
  10:30:30 STEP  916 H= 229:00 +CPU= 44.636
  10:31:15 STEP  917 H= 229:15 +CPU= 41.617
  10:31:58 STEP  918 H= 229:30 +CPU= 41.112
  10:32:45 STEP  919 H= 229:45 +CPU= 43.767
  10:33:32 STEP  920 H= 230:00 +CPU= 44.242
  10:34:17 STEP  921 H= 230:15 +CPU= 41.717
  10:35:00 STEP  922 H= 230:30 +CPU= 40.967
  10:35:46 STEP  923 H= 230:45 +CPU= 43.011
  10:36:44 STEP  924 H= 231:00 +CPU= 54.463
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+000924
  10:37:27 STEP  925 H= 231:15 +CPU= 40.682
  10:38:13 STEP  926 H= 231:30 +CPU= 42.359
  10:38:59 STEP  927 H= 231:45 +CPU= 43.047
  10:39:46 STEP  928 H= 232:00 +CPU= 44.222
  10:40:32 STEP  929 H= 232:15 +CPU= 42.971
  10:41:18 STEP  930 H= 232:30 +CPU= 43.381
  10:42:04 STEP  931 H= 232:45 +CPU= 42.872
  10:42:50 STEP  932 H= 233:00 +CPU= 42.835
  10:43:36 STEP  933 H= 233:15 +CPU= 42.937
  10:44:20 STEP  934 H= 233:30 +CPU= 41.547
  10:45:08 STEP  935 H= 233:45 +CPU= 44.494
  10:46:05 STEP  936 H= 234:00 +CPU= 52.543
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+000936
  10:46:50 STEP  937 H= 234:15 +CPU= 41.628
  10:47:34 STEP  938 H= 234:30 +CPU= 42.100
  10:48:20 STEP  939 H= 234:45 +CPU= 42.511
  10:49:06 STEP  940 H= 235:00 +CPU= 43.376
  10:49:51 STEP  941 H= 235:15 +CPU= 42.801
  10:50:37 STEP  942 H= 235:30 +CPU= 42.292
  10:51:22 STEP  943 H= 235:45 +CPU= 43.135
  10:52:08 STEP  944 H= 236:00 +CPU= 42.909
  10:52:52 STEP  945 H= 236:15 +CPU= 42.173
  10:53:39 STEP  946 H= 236:30 +CPU= 43.392
  10:54:25 STEP  947 H= 236:45 +CPU= 42.792
  10:55:21 STEP  948 H= 237:00 +CPU= 52.357
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+000948
  10:56:05 STEP  949 H= 237:15 +CPU= 41.924
  10:56:48 STEP  950 H= 237:30 +CPU= 40.843
  10:57:35 STEP  951 H= 237:45 +CPU= 43.001
  10:58:22 STEP  952 H= 238:00 +CPU= 43.186
  10:59:08 STEP  953 H= 238:15 +CPU= 43.527
  10:59:54 STEP  954 H= 238:30 +CPU= 42.653
  11:00:40 STEP  955 H= 238:45 +CPU= 42.662
  11:01:27 STEP  956 H= 239:00 +CPU= 43.995
  11:02:12 STEP  957 H= 239:15 +CPU= 42.366
  11:02:57 STEP  958 H= 239:30 +CPU= 42.412
  11:03:42 STEP  959 H= 239:45 +CPU= 41.960
  11:04:46 STEP  960 H= 240:00 +CPU= 59.789
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2at_2016092300_20_1017_12284808_1_r806671331_9.zip
Uploading the intermediate file: upload_file_9.zip
Uploading trickle at timestep: 864000
  11:05:31 STEP  961 H= 240:15 +CPU= 42.700
  11:06:20 STEP  962 H= 240:30 +CPU= 46.303
  11:07:11 STEP  963 H= 240:45 +CPU= 47.373
  11:08:02 STEP  964 H= 241:00 +CPU= 48.300
  11:08:53 STEP  965 H= 241:15 +CPU= 48.075
  11:09:45 STEP  966 H= 241:30 +CPU= 48.278
  11:10:34 STEP  967 H= 241:45 +CPU= 47.136
  11:11:27 STEP  968 H= 242:00 +CPU= 50.008
  11:12:19 STEP  969 H= 242:15 +CPU= 48.277
  11:13:11 STEP  970 H= 242:30 +CPU= 49.086
  11:14:02 STEP  971 H= 242:45 +CPU= 48.777
  11:15:07 STEP  972 H= 243:00 +CPU= 60.344
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+000972
  11:15:57 STEP  973 H= 243:15 +CPU= 47.050
  11:16:48 STEP  974 H= 243:30 +CPU= 47.760
  11:17:41 STEP  975 H= 243:45 +CPU= 49.371
  11:18:36 STEP  976 H= 244:00 +CPU= 51.249
  11:19:29 STEP  977 H= 244:15 +CPU= 49.340
  11:20:21 STEP  978 H= 244:30 +CPU= 49.500
  11:21:12 STEP  979 H= 244:45 +CPU= 48.172
  11:22:05 STEP  980 H= 245:00 +CPU= 48.982
  11:22:57 STEP  981 H= 245:15 +CPU= 48.763
  11:23:49 STEP  982 H= 245:30 +CPU= 48.502
  11:24:38 STEP  983 H= 245:45 +CPU= 45.551
  11:25:40 STEP  984 H= 246:00 +CPU= 58.745
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+000984
  11:26:30 STEP  985 H= 246:15 +CPU= 46.874
  11:27:22 STEP  986 H= 246:30 +CPU= 48.257
  11:28:14 STEP  987 H= 246:45 +CPU= 48.407
  11:29:06 STEP  988 H= 247:00 +CPU= 48.604
  11:29:57 STEP  989 H= 247:15 +CPU= 47.732
  11:30:51 STEP  990 H= 247:30 +CPU= 50.102
  11:31:41 STEP  991 H= 247:45 +CPU= 46.766
  11:32:31 STEP  992 H= 248:00 +CPU= 47.155
  11:33:23 STEP  993 H= 248:15 +CPU= 48.324
  11:34:14 STEP  994 H= 248:30 +CPU= 48.690
  11:35:07 STEP  995 H= 248:45 +CPU= 49.955
  11:36:10 STEP  996 H= 249:00 +CPU= 59.083
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+000996
  11:37:02 STEP  997 H= 249:15 +CPU= 48.949
  11:37:53 STEP  998 H= 249:30 +CPU= 47.258
  11:38:43 STEP  999 H= 249:45 +CPU= 46.652
  11:39:37 STEP 1000 H= 250:00 +CPU= 50.550
  11:40:28 STEP 1001 H= 250:15 +CPU= 48.165
  11:41:21 STEP 1002 H= 250:30 +CPU= 48.879
  11:42:14 STEP 1003 H= 250:45 +CPU= 49.554
  11:43:06 STEP 1004 H= 251:00 +CPU= 48.987
  11:43:57 STEP 1005 H= 251:15 +CPU= 47.473
  11:44:51 STEP 1006 H= 251:30 +CPU= 50.252
  11:45:41 STEP 1007 H= 251:45 +CPU= 47.572
  11:46:54 STEP 1008 H= 252:00 +CPU= 67.750
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001008
  11:47:46 STEP 1009 H= 252:15 +CPU= 49.066
  11:48:39 STEP 1010 H= 252:30 +CPU= 48.660
  11:49:33 STEP 1011 H= 252:45 +CPU= 51.064
  11:50:26 STEP 1012 H= 253:00 +CPU= 49.886
  11:51:17 STEP 1013 H= 253:15 +CPU= 47.302
  11:52:09 STEP 1014 H= 253:30 +CPU= 47.640
  11:53:01 STEP 1015 H= 253:45 +CPU= 49.042
  11:53:55 STEP 1016 H= 254:00 +CPU= 49.692
  11:54:45 STEP 1017 H= 254:15 +CPU= 46.856
  11:55:36 STEP 1018 H= 254:30 +CPU= 47.327
  11:56:28 STEP 1019 H= 254:45 +CPU= 48.204
  11:57:32 STEP 1020 H= 255:00 +CPU= 60.119
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001020
  11:58:22 STEP 1021 H= 255:15 +CPU= 46.835
  11:59:14 STEP 1022 H= 255:30 +CPU= 47.411
  12:00:08 STEP 1023 H= 255:45 +CPU= 49.350
  12:01:00 STEP 1024 H= 256:00 +CPU= 48.550
  12:01:54 STEP 1025 H= 256:15 +CPU= 49.783
  12:02:48 STEP 1026 H= 256:30 +CPU= 50.665
  12:03:39 STEP 1027 H= 256:45 +CPU= 47.836
  12:04:33 STEP 1028 H= 257:00 +CPU= 50.366
  12:05:27 STEP 1029 H= 257:15 +CPU= 50.194
  12:06:18 STEP 1030 H= 257:30 +CPU= 47.738
  12:07:10 STEP 1031 H= 257:45 +CPU= 48.295
  12:08:14 STEP 1032 H= 258:00 +CPU= 60.030
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001032
  12:09:04 STEP 1033 H= 258:15 +CPU= 46.612
  12:09:57 STEP 1034 H= 258:30 +CPU= 49.106
  12:10:51 STEP 1035 H= 258:45 +CPU= 50.107
  12:11:45 STEP 1036 H= 259:00 +CPU= 50.200
  12:12:40 STEP 1037 H= 259:15 +CPU= 49.753
  12:13:30 STEP 1038 H= 259:30 +CPU= 46.884
  12:14:20 STEP 1039 H= 259:45 +CPU= 47.074
  12:15:13 STEP 1040 H= 260:00 +CPU= 49.079
  12:16:09 STEP 1041 H= 260:15 +CPU= 51.996
  12:17:01 STEP 1042 H= 260:30 +CPU= 48.362
  12:17:50 STEP 1043 H= 260:45 +CPU= 46.090
  12:18:54 STEP 1044 H= 261:00 +CPU= 59.912
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001044
  12:19:48 STEP 1045 H= 261:15 +CPU= 49.748
  12:20:40 STEP 1046 H= 261:30 +CPU= 48.513
  12:21:28 STEP 1047 H= 261:45 +CPU= 45.336
  12:22:21 STEP 1048 H= 262:00 +CPU= 48.896
  12:23:12 STEP 1049 H= 262:15 +CPU= 48.257
  12:24:06 STEP 1050 H= 262:30 +CPU= 49.494
  12:24:58 STEP 1051 H= 262:45 +CPU= 48.166
  12:25:49 STEP 1052 H= 263:00 +CPU= 48.592
  12:26:40 STEP 1053 H= 263:15 +CPU= 48.251
  12:27:32 STEP 1054 H= 263:30 +CPU= 48.373
  12:28:23 STEP 1055 H= 263:45 +CPU= 48.151
  12:29:37 STEP 1056 H= 264:00 +CPU= 69.164
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2at_2016092300_20_1017_12284808_1_r806671331_10.zip
Uploading the intermediate file: upload_file_10.zip
  12:30:30 STEP 1057 H= 264:15 +CPU= 48.293
  12:31:21 STEP 1058 H= 264:30 +CPU= 47.668
  12:32:12 STEP 1059 H= 264:45 +CPU= 47.567
  12:33:05 STEP 1060 H= 265:00 +CPU= 49.052
  12:33:56 STEP 1061 H= 265:15 +CPU= 47.242
  12:34:47 STEP 1062 H= 265:30 +CPU= 47.007
  12:35:39 STEP 1063 H= 265:45 +CPU= 48.924
  12:36:32 STEP 1064 H= 266:00 +CPU= 49.276
  12:37:26 STEP 1065 H= 266:15 +CPU= 50.408
  12:38:19 STEP 1066 H= 266:30 +CPU= 48.753
  12:39:13 STEP 1067 H= 266:45 +CPU= 49.591
  12:40:17 STEP 1068 H= 267:00 +CPU= 59.987
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001068
  12:41:06 STEP 1069 H= 267:15 +CPU= 46.113
  12:41:55 STEP 1070 H= 267:30 +CPU= 45.810
  12:42:46 STEP 1071 H= 267:45 +CPU= 47.590
  12:43:38 STEP 1072 H= 268:00 +CPU= 48.796
  12:44:32 STEP 1073 H= 268:15 +CPU= 49.564
  12:45:25 STEP 1074 H= 268:30 +CPU= 49.708
  12:46:17 STEP 1075 H= 268:45 +CPU= 47.937
  12:47:12 STEP 1076 H= 269:00 +CPU= 50.038
  12:48:04 STEP 1077 H= 269:15 +CPU= 48.892
  12:48:57 STEP 1078 H= 269:30 +CPU= 49.056
  12:49:51 STEP 1079 H= 269:45 +CPU= 50.408
  12:50:56 STEP 1080 H= 270:00 +CPU= 60.091
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001080
  12:51:46 STEP 1081 H= 270:15 +CPU= 47.402
  12:52:38 STEP 1082 H= 270:30 +CPU= 48.745
  12:53:29 STEP 1083 H= 270:45 +CPU= 47.188
  12:54:18 STEP 1084 H= 271:00 +CPU= 45.537
  12:55:10 STEP 1085 H= 271:15 +CPU= 49.092
  12:56:03 STEP 1086 H= 271:30 +CPU= 48.662
  12:56:56 STEP 1087 H= 271:45 +CPU= 50.051
  12:57:49 STEP 1088 H= 272:00 +CPU= 49.352
  12:58:42 STEP 1089 H= 272:15 +CPU= 49.655
  12:59:35 STEP 1090 H= 272:30 +CPU= 49.644
  13:00:27 STEP 1091 H= 272:45 +CPU= 48.682
  13:01:31 STEP 1092 H= 273:00 +CPU= 58.875
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001092
  13:02:23 STEP 1093 H= 273:15 +CPU= 47.703
  13:03:12 STEP 1094 H= 273:30 +CPU= 45.506
  13:04:03 STEP 1095 H= 273:45 +CPU= 46.885
  13:04:56 STEP 1096 H= 274:00 +CPU= 49.072
  13:05:48 STEP 1097 H= 274:15 +CPU= 48.791
  13:06:40 STEP 1098 H= 274:30 +CPU= 48.056
  13:07:30 STEP 1099 H= 274:45 +CPU= 47.191
  13:08:22 STEP 1100 H= 275:00 +CPU= 48.978
  13:09:15 STEP 1101 H= 275:15 +CPU= 48.970
  13:10:07 STEP 1102 H= 275:30 +CPU= 47.829
  13:10:58 STEP 1103 H= 275:45 +CPU= 47.744
  13:12:14 STEP 1104 H= 276:00 +CPU= 70.442
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001104
  13:13:04 STEP 1105 H= 276:15 +CPU= 47.483
  13:13:55 STEP 1106 H= 276:30 +CPU= 47.401
  13:14:46 STEP 1107 H= 276:45 +CPU= 47.667
  13:15:37 STEP 1108 H= 277:00 +CPU= 48.294
  13:16:29 STEP 1109 H= 277:15 +CPU= 48.403
  13:17:21 STEP 1110 H= 277:30 +CPU= 49.476
  13:18:17 STEP 1111 H= 277:45 +CPU= 50.736
  13:19:09 STEP 1112 H= 278:00 +CPU= 49.128
  13:20:00 STEP 1113 H= 278:15 +CPU= 48.053
  13:20:51 STEP 1114 H= 278:30 +CPU= 47.470
  13:21:41 STEP 1115 H= 278:45 +CPU= 46.964
  13:22:47 STEP 1116 H= 279:00 +CPU= 61.186
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001116
  13:23:37 STEP 1117 H= 279:15 +CPU= 46.874
  13:24:30 STEP 1118 H= 279:30 +CPU= 48.410
  13:25:21 STEP 1119 H= 279:45 +CPU= 48.135
  13:26:12 STEP 1120 H= 280:00 +CPU= 48.267
  13:27:04 STEP 1121 H= 280:15 +CPU= 48.477
  13:27:55 STEP 1122 H= 280:30 +CPU= 48.219
  13:28:45 STEP 1123 H= 280:45 +CPU= 46.857
  13:29:39 STEP 1124 H= 281:00 +CPU= 50.705
  13:30:33 STEP 1125 H= 281:15 +CPU= 50.620
  13:31:24 STEP 1126 H= 281:30 +CPU= 47.770
  13:32:18 STEP 1127 H= 281:45 +CPU= 49.903
  13:33:22 STEP 1128 H= 282:00 +CPU= 60.821
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001128
  13:34:14 STEP 1129 H= 282:15 +CPU= 48.256
  13:35:03 STEP 1130 H= 282:30 +CPU= 46.058
  13:35:56 STEP 1131 H= 282:45 +CPU= 48.845
  13:36:49 STEP 1132 H= 283:00 +CPU= 49.227
  13:37:43 STEP 1133 H= 283:15 +CPU= 50.249
  13:38:33 STEP 1134 H= 283:30 +CPU= 46.703
  13:39:23 STEP 1135 H= 283:45 +CPU= 46.819
  13:40:17 STEP 1136 H= 284:00 +CPU= 50.592
  13:41:11 STEP 1137 H= 284:15 +CPU= 50.167
  13:42:04 STEP 1138 H= 284:30 +CPU= 49.252
  13:42:54 STEP 1139 H= 284:45 +CPU= 47.339
  13:43:58 STEP 1140 H= 285:00 +CPU= 58.551
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001140
  13:44:47 STEP 1141 H= 285:15 +CPU= 46.036
  13:45:37 STEP 1142 H= 285:30 +CPU= 46.990
  13:46:28 STEP 1143 H= 285:45 +CPU= 47.524
  13:47:21 STEP 1144 H= 286:00 +CPU= 48.861
  13:48:16 STEP 1145 H= 286:15 +CPU= 50.578
  13:49:09 STEP 1146 H= 286:30 +CPU= 49.531
  13:49:59 STEP 1147 H= 286:45 +CPU= 47.512
  13:50:49 STEP 1148 H= 287:00 +CPU= 47.626
  13:51:42 STEP 1149 H= 287:15 +CPU= 49.310
  13:52:34 STEP 1150 H= 287:30 +CPU= 48.235
  13:53:22 STEP 1151 H= 287:45 +CPU= 45.151
  13:54:35 STEP 1152 H= 288:00 +CPU= 67.578
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2at_2016092300_20_1017_12284808_1_r806671331_11.zip
Uploading the intermediate file: upload_file_11.zip
  13:55:27 STEP 1153 H= 288:15 +CPU= 48.087
  13:56:18 STEP 1154 H= 288:30 +CPU= 46.771
  13:57:10 STEP 1155 H= 288:45 +CPU= 48.342
  13:58:00 STEP 1156 H= 289:00 +CPU= 46.135
  13:58:51 STEP 1157 H= 289:15 +CPU= 47.210
  13:59:41 STEP 1158 H= 289:30 +CPU= 46.667
  14:00:35 STEP 1159 H= 289:45 +CPU= 50.318
  14:01:31 STEP 1160 H= 290:00 +CPU= 51.249
  14:02:24 STEP 1161 H= 290:15 +CPU= 48.555
  14:03:17 STEP 1162 H= 290:30 +CPU= 48.522
  14:04:08 STEP 1163 H= 290:45 +CPU= 47.353
  14:05:09 STEP 1164 H= 291:00 +CPU= 57.439
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001164
  14:06:02 STEP 1165 H= 291:15 +CPU= 48.804
  14:06:50 STEP 1166 H= 291:30 +CPU= 44.638
  14:07:42 STEP 1167 H= 291:45 +CPU= 48.468
  14:08:33 STEP 1168 H= 292:00 +CPU= 47.612
  14:09:25 STEP 1169 H= 292:15 +CPU= 48.465
  14:10:15 STEP 1170 H= 292:30 +CPU= 46.897
  14:11:06 STEP 1171 H= 292:45 +CPU= 47.367
  14:11:59 STEP 1172 H= 293:00 +CPU= 49.643
  14:12:51 STEP 1173 H= 293:15 +CPU= 48.705
  14:13:42 STEP 1174 H= 293:30 +CPU= 48.923
  14:14:34 STEP 1175 H= 293:45 +CPU= 48.073
  14:15:38 STEP 1176 H= 294:00 +CPU= 58.667
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001176
  14:16:32 STEP 1177 H= 294:15 +CPU= 50.234
  14:17:23 STEP 1178 H= 294:30 +CPU= 47.585
  14:18:17 STEP 1179 H= 294:45 +CPU= 49.870
  14:19:11 STEP 1180 H= 295:00 +CPU= 49.966
  14:20:02 STEP 1181 H= 295:15 +CPU= 47.685
  14:20:54 STEP 1182 H= 295:30 +CPU= 48.098
  14:21:44 STEP 1183 H= 295:45 +CPU= 46.938
  14:22:37 STEP 1184 H= 296:00 +CPU= 49.490
  14:23:27 STEP 1185 H= 296:15 +CPU= 46.884
  14:24:19 STEP 1186 H= 296:30 +CPU= 48.657
  14:25:11 STEP 1187 H= 296:45 +CPU= 48.506
  14:26:15 STEP 1188 H= 297:00 +CPU= 59.272
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001188
  14:27:06 STEP 1189 H= 297:15 +CPU= 47.814
  14:27:56 STEP 1190 H= 297:30 +CPU= 47.339
  14:28:47 STEP 1191 H= 297:45 +CPU= 47.166
  14:29:40 STEP 1192 H= 298:00 +CPU= 49.933
  14:30:31 STEP 1193 H= 298:15 +CPU= 47.936
  14:31:23 STEP 1194 H= 298:30 +CPU= 47.715
  14:32:13 STEP 1195 H= 298:45 +CPU= 47.980
  14:33:06 STEP 1196 H= 299:00 +CPU= 49.411
  14:33:58 STEP 1197 H= 299:15 +CPU= 48.287
  14:34:48 STEP 1198 H= 299:30 +CPU= 47.134
  14:35:38 STEP 1199 H= 299:45 +CPU= 47.594
  14:36:49 STEP 1200 H= 300:00 +CPU= 65.468
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001200
  14:37:43 STEP 1201 H= 300:15 +CPU= 50.911
  14:38:36 STEP 1202 H= 300:30 +CPU= 49.325
  14:39:30 STEP 1203 H= 300:45 +CPU= 50.107
  14:40:21 STEP 1204 H= 301:00 +CPU= 48.158
  14:41:11 STEP 1205 H= 301:15 +CPU= 47.116
  14:42:04 STEP 1206 H= 301:30 +CPU= 49.643
  14:42:57 STEP 1207 H= 301:45 +CPU= 49.091
  14:43:50 STEP 1208 H= 302:00 +CPU= 49.996
  14:44:43 STEP 1209 H= 302:15 +CPU= 49.469
  14:45:36 STEP 1210 H= 302:30 +CPU= 49.459
  14:46:27 STEP 1211 H= 302:45 +CPU= 47.691
  14:47:32 STEP 1212 H= 303:00 +CPU= 60.738
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001212
  14:48:21 STEP 1213 H= 303:15 +CPU= 46.295
  14:49:11 STEP 1214 H= 303:30 +CPU= 47.000
  14:50:04 STEP 1215 H= 303:45 +CPU= 49.470
  14:50:57 STEP 1216 H= 304:00 +CPU= 49.016
  14:51:49 STEP 1217 H= 304:15 +CPU= 49.148
  14:52:42 STEP 1218 H= 304:30 +CPU= 49.319
  14:53:35 STEP 1219 H= 304:45 +CPU= 49.500
  14:54:29 STEP 1220 H= 305:00 +CPU= 50.898
  14:55:22 STEP 1221 H= 305:15 +CPU= 48.672
  14:56:14 STEP 1222 H= 305:30 +CPU= 49.438
  14:57:07 STEP 1223 H= 305:45 +CPU= 50.222
  14:58:13 STEP 1224 H= 306:00 +CPU= 61.436
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001224
  14:59:04 STEP 1225 H= 306:15 +CPU= 47.819
  14:59:55 STEP 1226 H= 306:30 +CPU= 47.671
  15:00:47 STEP 1227 H= 306:45 +CPU= 47.991
  15:01:41 STEP 1228 H= 307:00 +CPU= 49.812
  15:02:33 STEP 1229 H= 307:15 +CPU= 48.707
  15:03:25 STEP 1230 H= 307:30 +CPU= 48.687
  15:04:17 STEP 1231 H= 307:45 +CPU= 48.128
  15:05:12 STEP 1232 H= 308:00 +CPU= 52.171
  15:06:07 STEP 1233 H= 308:15 +CPU= 50.453
  15:06:55 STEP 1234 H= 308:30 +CPU= 45.901
  15:07:48 STEP 1235 H= 308:45 +CPU= 50.210
  15:08:52 STEP 1236 H= 309:00 +CPU= 60.327
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001236
  15:09:46 STEP 1237 H= 309:15 +CPU= 49.978
  15:10:39 STEP 1238 H= 309:30 +CPU= 49.661
  15:11:34 STEP 1239 H= 309:45 +CPU= 51.190
  15:12:32 STEP 1240 H= 310:00 +CPU= 54.411
  15:13:27 STEP 1241 H= 310:15 +CPU= 50.060
  15:14:23 STEP 1242 H= 310:30 +CPU= 52.793
  15:15:18 STEP 1243 H= 310:45 +CPU= 52.118
  15:16:17 STEP 1244 H= 311:00 +CPU= 55.483
  15:17:14 STEP 1245 H= 311:15 +CPU= 52.593
  15:18:13 STEP 1246 H= 311:30 +CPU= 54.601
  15:19:10 STEP 1247 H= 311:45 +CPU= 53.050
  15:20:29 STEP 1248 H= 312:00 +CPU= 73.709
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2at_2016092300_20_1017_12284808_1_r806671331_12.zip
Uploading the intermediate file: upload_file_12.zip
  15:21:24 STEP 1249 H= 312:15 +CPU= 50.362
  15:22:21 STEP 1250 H= 312:30 +CPU= 52.313
  15:23:17 STEP 1251 H= 312:45 +CPU= 52.369
  15:24:14 STEP 1252 H= 313:00 +CPU= 52.343
  15:25:09 STEP 1253 H= 313:15 +CPU= 52.205
  15:26:04 STEP 1254 H= 313:30 +CPU= 51.231
  15:27:01 STEP 1255 H= 313:45 +CPU= 53.207
  15:28:01 STEP 1256 H= 314:00 +CPU= 55.391
  15:28:59 STEP 1257 H= 314:15 +CPU= 54.117
  15:29:55 STEP 1258 H= 314:30 +CPU= 52.285
  15:30:53 STEP 1259 H= 314:45 +CPU= 54.105
  15:32:02 STEP 1260 H= 315:00 +CPU= 63.888
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001260
  15:32:58 STEP 1261 H= 315:15 +CPU= 52.075
  15:33:55 STEP 1262 H= 315:30 +CPU= 52.561
  15:34:52 STEP 1263 H= 315:45 +CPU= 53.439
  15:35:51 STEP 1264 H= 316:00 +CPU= 55.797
  15:36:47 STEP 1265 H= 316:15 +CPU= 52.546
  15:37:47 STEP 1266 H= 316:30 +CPU= 55.898
  15:38:45 STEP 1267 H= 316:45 +CPU= 53.246
  15:39:43 STEP 1268 H= 317:00 +CPU= 53.924
  15:40:43 STEP 1269 H= 317:15 +CPU= 56.195
  15:41:46 STEP 1270 H= 317:30 +CPU= 58.153
  15:42:45 STEP 1271 H= 317:45 +CPU= 55.550
  15:44:01 STEP 1272 H= 318:00 +CPU= 70.638
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001272
  15:45:02 STEP 1273 H= 318:15 +CPU= 56.329
  15:46:04 STEP 1274 H= 318:30 +CPU= 58.401
  15:47:07 STEP 1275 H= 318:45 +CPU= 58.191
  15:48:12 STEP 1276 H= 319:00 +CPU= 61.147
  15:49:14 STEP 1277 H= 319:15 +CPU= 57.489
  15:50:15 STEP 1278 H= 319:30 +CPU= 56.518
  15:51:17 STEP 1279 H= 319:45 +CPU= 57.756
  15:52:23 STEP 1280 H= 320:00 +CPU= 61.443
  15:53:24 STEP 1281 H= 320:15 +CPU= 57.633
  15:54:30 STEP 1282 H= 320:30 +CPU= 60.218
  15:55:32 STEP 1283 H= 320:45 +CPU= 57.134
  15:56:48 STEP 1284 H= 321:00 +CPU= 70.601
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001284
  15:57:48 STEP 1285 H= 321:15 +CPU= 55.819
  15:58:51 STEP 1286 H= 321:30 +CPU= 58.749
  15:59:55 STEP 1287 H= 321:45 +CPU= 59.493
  16:00:57 STEP 1288 H= 322:00 +CPU= 57.805
  16:02:02 STEP 1289 H= 322:15 +CPU= 59.913
  16:03:03 STEP 1290 H= 322:30 +CPU= 57.092
  16:04:07 STEP 1291 H= 322:45 +CPU= 59.353
  16:05:11 STEP 1292 H= 323:00 +CPU= 59.419
  16:06:12 STEP 1293 H= 323:15 +CPU= 57.028
  16:07:13 STEP 1294 H= 323:30 +CPU= 56.716
  16:08:15 STEP 1295 H= 323:45 +CPU= 58.326
  16:09:42 STEP 1296 H= 324:00 +CPU= 80.682
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001296
  16:10:42 STEP 1297 H= 324:15 +CPU= 56.045
  16:11:47 STEP 1298 H= 324:30 +CPU= 59.196
  16:12:46 STEP 1299 H= 324:45 +CPU= 55.849
  16:13:49 STEP 1300 H= 325:00 +CPU= 57.970
  16:14:53 STEP 1301 H= 325:15 +CPU= 60.094
  16:15:56 STEP 1302 H= 325:30 +CPU= 58.470
  16:16:59 STEP 1303 H= 325:45 +CPU= 58.790
  16:18:02 STEP 1304 H= 326:00 +CPU= 58.315
  16:19:04 STEP 1305 H= 326:15 +CPU= 57.129
  16:20:05 STEP 1306 H= 326:30 +CPU= 57.369
  16:21:07 STEP 1307 H= 326:45 +CPU= 57.846
  16:22:20 STEP 1308 H= 327:00 +CPU= 68.445
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001308
  16:23:22 STEP 1309 H= 327:15 +CPU= 58.040
  16:24:25 STEP 1310 H= 327:30 +CPU= 58.256
  16:25:28 STEP 1311 H= 327:45 +CPU= 58.735
  16:26:30 STEP 1312 H= 328:00 +CPU= 57.676
  16:27:29 STEP 1313 H= 328:15 +CPU= 54.940
  16:28:30 STEP 1314 H= 328:30 +CPU= 56.624
  16:29:33 STEP 1315 H= 328:45 +CPU= 59.293
  16:30:35 STEP 1316 H= 329:00 +CPU= 58.423
  16:31:37 STEP 1317 H= 329:15 +CPU= 57.406
  16:32:41 STEP 1318 H= 329:30 +CPU= 59.169
  16:33:46 STEP 1319 H= 329:45 +CPU= 60.279
  16:35:00 STEP 1320 H= 330:00 +CPU= 69.845
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001320
  16:36:00 STEP 1321 H= 330:15 +CPU= 55.844
  16:37:04 STEP 1322 H= 330:30 +CPU= 58.615
  16:38:05 STEP 1323 H= 330:45 +CPU= 57.803
  16:39:10 STEP 1324 H= 331:00 +CPU= 60.117
  16:40:11 STEP 1325 H= 331:15 +CPU= 57.174
  16:41:11 STEP 1326 H= 331:30 +CPU= 56.049
  16:42:13 STEP 1327 H= 331:45 +CPU= 57.311
  16:43:17 STEP 1328 H= 332:00 +CPU= 59.884
  16:44:20 STEP 1329 H= 332:15 +CPU= 58.648
  16:45:20 STEP 1330 H= 332:30 +CPU= 56.729
  16:46:22 STEP 1331 H= 332:45 +CPU= 58.203
  16:47:41 STEP 1332 H= 333:00 +CPU= 72.947
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001332
  16:48:43 STEP 1333 H= 333:15 +CPU= 57.761
  16:49:47 STEP 1334 H= 333:30 +CPU= 59.750
  16:50:47 STEP 1335 H= 333:45 +CPU= 56.373
  16:51:48 STEP 1336 H= 334:00 +CPU= 56.828
  16:52:51 STEP 1337 H= 334:15 +CPU= 58.359
  16:53:52 STEP 1338 H= 334:30 +CPU= 55.974
  16:54:54 STEP 1339 H= 334:45 +CPU= 58.509
  16:55:57 STEP 1340 H= 335:00 +CPU= 58.891
  16:57:01 STEP 1341 H= 335:15 +CPU= 59.314
  16:58:03 STEP 1342 H= 335:30 +CPU= 58.354
  16:59:06 STEP 1343 H= 335:45 +CPU= 57.638
  17:00:31 STEP 1344 H= 336:00 +CPU= 79.582
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2at_2016092300_20_1017_12284808_1_r806671331_13.zip
Uploading the intermediate file: upload_file_13.zip
  17:01:35 STEP 1345 H= 336:15 +CPU= 58.175
  17:02:36 STEP 1346 H= 336:30 +CPU= 56.855
  17:03:38 STEP 1347 H= 336:45 +CPU= 57.505
  17:04:37 STEP 1348 H= 337:00 +CPU= 54.954
  17:05:39 STEP 1349 H= 337:15 +CPU= 57.342
  17:06:43 STEP 1350 H= 337:30 +CPU= 59.300
  17:07:43 STEP 1351 H= 337:45 +CPU= 55.210
  17:08:44 STEP 1352 H= 338:00 +CPU= 57.095
  17:09:45 STEP 1353 H= 338:15 +CPU= 57.449
  17:10:48 STEP 1354 H= 338:30 +CPU= 58.174
  17:11:50 STEP 1355 H= 338:45 +CPU= 58.168
  17:13:04 STEP 1356 H= 339:00 +CPU= 69.335
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001356
  17:14:04 STEP 1357 H= 339:15 +CPU= 55.982
  17:15:06 STEP 1358 H= 339:30 +CPU= 56.880
  17:16:05 STEP 1359 H= 339:45 +CPU= 54.847
  17:17:03 STEP 1360 H= 340:00 +CPU= 55.032
  17:18:01 STEP 1361 H= 340:15 +CPU= 53.763
  17:19:01 STEP 1362 H= 340:30 +CPU= 56.386
  17:19:59 STEP 1363 H= 340:45 +CPU= 54.785
  17:21:00 STEP 1364 H= 341:00 +CPU= 56.200
  17:21:57 STEP 1365 H= 341:15 +CPU= 53.348
  17:22:57 STEP 1366 H= 341:30 +CPU= 55.736
  17:23:55 STEP 1367 H= 341:45 +CPU= 54.703
  17:25:06 STEP 1368 H= 342:00 +CPU= 65.645
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001368
  17:26:05 STEP 1369 H= 342:15 +CPU= 54.858
  17:27:03 STEP 1370 H= 342:30 +CPU= 54.310
  17:28:02 STEP 1371 H= 342:45 +CPU= 54.637
  17:28:57 STEP 1372 H= 343:00 +CPU= 52.276
  17:29:53 STEP 1373 H= 343:15 +CPU= 52.189
  17:30:50 STEP 1374 H= 343:30 +CPU= 54.022
  17:31:50 STEP 1375 H= 343:45 +CPU= 55.808
  17:32:51 STEP 1376 H= 344:00 +CPU= 57.271
  17:33:50 STEP 1377 H= 344:15 +CPU= 54.888
  17:34:49 STEP 1378 H= 344:30 +CPU= 55.346
  17:35:46 STEP 1379 H= 344:45 +CPU= 52.717
  17:37:02 STEP 1380 H= 345:00 +CPU= 70.702
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001380
  17:38:00 STEP 1381 H= 345:15 +CPU= 53.746
  17:38:59 STEP 1382 H= 345:30 +CPU= 54.925
  17:39:58 STEP 1383 H= 345:45 +CPU= 55.346
  17:40:55 STEP 1384 H= 346:00 +CPU= 53.622
  17:41:55 STEP 1385 H= 346:15 +CPU= 55.765
  17:42:54 STEP 1386 H= 346:30 +CPU= 55.207
  17:43:52 STEP 1387 H= 346:45 +CPU= 53.764
  17:44:49 STEP 1388 H= 347:00 +CPU= 53.419
  17:45:45 STEP 1389 H= 347:15 +CPU= 52.871
  17:46:43 STEP 1390 H= 347:30 +CPU= 54.066
  17:47:40 STEP 1391 H= 347:45 +CPU= 52.884
  17:49:01 STEP 1392 H= 348:00 +CPU= 74.929
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001392
  17:49:57 STEP 1393 H= 348:15 +CPU= 52.956
  17:50:53 STEP 1394 H= 348:30 +CPU= 52.395
  17:51:52 STEP 1395 H= 348:45 +CPU= 54.202
  17:52:52 STEP 1396 H= 349:00 +CPU= 55.492
  17:53:49 STEP 1397 H= 349:15 +CPU= 52.855
  17:54:48 STEP 1398 H= 349:30 +CPU= 55.402
  17:55:48 STEP 1399 H= 349:45 +CPU= 56.443
  17:56:48 STEP 1400 H= 350:00 +CPU= 55.418
  17:57:48 STEP 1401 H= 350:15 +CPU= 55.676
  17:58:48 STEP 1402 H= 350:30 +CPU= 56.259
  17:59:46 STEP 1403 H= 350:45 +CPU= 53.957
  18:00:59 STEP 1404 H= 351:00 +CPU= 67.351
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001404
  18:01:58 STEP 1405 H= 351:15 +CPU= 55.377
  18:02:59 STEP 1406 H= 351:30 +CPU= 56.613
  18:03:58 STEP 1407 H= 351:45 +CPU= 54.753
  18:04:56 STEP 1408 H= 352:00 +CPU= 54.606
  18:05:55 STEP 1409 H= 352:15 +CPU= 55.155
  18:06:55 STEP 1410 H= 352:30 +CPU= 55.608
  18:07:53 STEP 1411 H= 352:45 +CPU= 53.816
  18:08:58 STEP 1412 H= 353:00 +CPU= 60.008
  18:09:54 STEP 1413 H= 353:15 +CPU= 52.975
  18:10:52 STEP 1414 H= 353:30 +CPU= 53.514
  18:11:50 STEP 1415 H= 353:45 +CPU= 54.316
  18:13:05 STEP 1416 H= 354:00 +CPU= 69.306
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001416
  18:14:04 STEP 1417 H= 354:15 +CPU= 55.777
  18:15:03 STEP 1418 H= 354:30 +CPU= 54.754
  18:16:02 STEP 1419 H= 354:45 +CPU= 54.528
  18:17:00 STEP 1420 H= 355:00 +CPU= 54.923
  18:17:59 STEP 1421 H= 355:15 +CPU= 55.129
  18:18:58 STEP 1422 H= 355:30 +CPU= 55.102
  18:19:55 STEP 1423 H= 355:45 +CPU= 53.844
  18:20:54 STEP 1424 H= 356:00 +CPU= 54.956
  18:21:53 STEP 1425 H= 356:15 +CPU= 54.563
  18:22:52 STEP 1426 H= 356:30 +CPU= 55.053
  18:23:53 STEP 1427 H= 356:45 +CPU= 57.007
  18:25:05 STEP 1428 H= 357:00 +CPU= 66.918
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001428
  18:26:04 STEP 1429 H= 357:15 +CPU= 55.408
  18:26:59 STEP 1430 H= 357:30 +CPU= 52.499
  18:27:58 STEP 1431 H= 357:45 +CPU= 54.925
  18:28:59 STEP 1432 H= 358:00 +CPU= 56.797
  18:29:59 STEP 1433 H= 358:15 +CPU= 56.132
  18:30:59 STEP 1434 H= 358:30 +CPU= 55.632
  18:32:01 STEP 1435 H= 358:45 +CPU= 58.037
  18:33:01 STEP 1436 H= 359:00 +CPU= 55.508
  18:34:03 STEP 1437 H= 359:15 +CPU= 57.508
  18:35:04 STEP 1438 H= 359:30 +CPU= 56.708
  18:36:03 STEP 1439 H= 359:45 +CPU= 56.158
  18:37:20 STEP 1440 H= 360:00 +CPU= 71.695
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.3016354875E-21      I       0.7330134128E-06      I
ICloud fractionI      0.0000000000E+00      I       0.4209600911E-01      I
I  Relat. Hum. I      0.1642870258E+00      I       0.2317836173E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.2229354732E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    324675908 BYTES IN      7 RECORDS TRANSFERRED IN    0.0010 SECONDS324675.9 Mbytes/s, TOTAL TIME=    0.0219( 4.6%)
 18:37:20 STEP 1440 H= 360:00 +CPU= 71.695
 END CNT3
 NSTEP =  1440 CNT0   000000000  50.775  50.775  54.215   0.937               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        43246/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    43246 ************   134.3     0.0   134.3     0.0   252.7
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    8219.7    8219.7     21.95      0.00
   9 SPCM     - SPECTRAL COMP.                    1440    1599.6    1599.6      3.94      0.00
  10 SCAN2M - PHYSICS                             1441   16222.6   16222.6     39.96      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121    1683.5    1683.5      0.35      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63     119.5     119.5      0.01      0.00
  14 SUINIF                                          1    5651.1    5651.1      0.01      0.00
  17 GRIDFPOS IN CNT4                              121      45.8      45.8      0.01      0.00
  18 SUSPECG                                         1    2781.3    2781.3      0.00      0.00
  19 SUSPEC                                          1    2787.4    2787.4      0.00      0.00
  24 SUGRIDU                                         1    2139.0    2139.0      0.00      0.00
  25 SPECRT                                          1     248.3     248.3      0.00      0.00
  26 SUGRIDF                                         1     476.4     476.4      0.00      0.00
  27 RESTART FILES - WRITING                        30    6790.1    6790.1      0.35      0.00
  28 RESTART FILES - READING                         1       0.1       0.1      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               121    8527.3    8527.3      1.76      0.00
  31 POSDDH IN STEPO                                 7       1.1       1.1      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441    8034.1    8034.1     19.79      0.00
  39 SU0YOMB                                         1     371.8     371.8      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      54.2      54.2      0.13      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     910.2     910.2      2.24      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440     135.7     135.7      0.33      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.5       0.5      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     638.1     638.1      3.41      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     326.8     326.8      1.68      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006     152.4     152.4      0.78      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     181.5     181.5      0.97      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      42.7      42.7      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125     126.4     126.4      0.68      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      68.5      68.5      0.35      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125     224.9     224.9      1.20      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      97.3      97.3      0.50      0.00
 400 GSTATS                                     167734       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                156066       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    58505.0 CPU TIME   54928.7 VECTOR TIME    54928.7


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       22.2
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc/slots/69/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/69/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/69/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc/slots/69/NODE.001_01
Adding to the zip: /var/lib/boinc/slots/69/ifs.stat
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12284808/ICMSHh7zg+001428
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2at_2016092300_20_1017_12284808_1_r806671331_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
18:40:54 (4008326): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a2at_2016092300_20_1017_12284808_1_r806671331_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2at_2016092300_20_1017_12284808_1_r806671331_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2at_2016092300_20_1017_12284808_1_r806671331_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2at_2016092300_20_1017_12284808_1_r806671331_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2at_2016092300_20_1017_12284808_1_r806671331_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Jun 2024 18:40:33 1532374 22440004 oifs_43r3_bl_a2at_2016092300_20_1017_12284808_1 1,295,100 54,929 0.0424
08 Jun 2024 11:05:27 1532374 22440004 oifs_43r3_bl_a2at_2016092300_20_1017_12284808_1 864,000 29,610 0.0343


©2024 climateprediction.net