climateprediction.net home page
Task 22433821

Task 22433821

Name oifs_43r3_bl_a0bv_2016092300_20_1017_12282254_0
Workunit 12282254
Created 7 Jun 2024, 11:27:50 UTC
Sent 7 Jun 2024, 22:18:47 UTC
Report deadline 6 Aug 2024, 22:18:47 UTC
Received 9 Jun 2024, 23:40:31 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1532338
Run time 13 hours 41 min 43 sec
CPU time 13 hours 41 min 43 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 5.63 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,538.24 MB
Peak swap size 5,980.80 MB
Peak disk usage 1,286.41 MB
Stderr
<core_client_version>7.16.16</core_client_version>
<![CDATA[
<stderr_txt>
:15 +CPU= 31.776
  12:53:37 STEP  834 H= 208:30 +CPU= 32.480
  12:54:10 STEP  835 H= 208:45 +CPU= 33.163
  12:54:44 STEP  836 H= 209:00 +CPU= 33.485
  12:55:17 STEP  837 H= 209:15 +CPU= 32.689
  12:55:52 STEP  838 H= 209:30 +CPU= 34.507
  12:56:25 STEP  839 H= 209:45 +CPU= 32.818
  12:57:07 STEP  840 H= 210:00 +CPU= 41.234
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+000840
  12:57:37 STEP  841 H= 210:15 +CPU= 29.584
  12:58:06 STEP  842 H= 210:30 +CPU= 29.063
  12:58:36 STEP  843 H= 210:45 +CPU= 30.054
  12:59:07 STEP  844 H= 211:00 +CPU= 30.653
  12:59:34 STEP  845 H= 211:15 +CPU= 27.057
  13:00:10 STEP  846 H= 211:30 +CPU= 36.185
  13:00:43 STEP  847 H= 211:45 +CPU= 32.478
  13:01:19 STEP  848 H= 212:00 +CPU= 36.294
  13:01:53 STEP  849 H= 212:15 +CPU= 33.813
  13:02:28 STEP  850 H= 212:30 +CPU= 33.616
  13:03:02 STEP  851 H= 212:45 +CPU= 33.754
  13:03:45 STEP  852 H= 213:00 +CPU= 43.245
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+000852
  13:04:16 STEP  853 H= 213:15 +CPU= 30.544
  13:04:47 STEP  854 H= 213:30 +CPU= 31.492
  13:05:20 STEP  855 H= 213:45 +CPU= 32.118
  13:05:53 STEP  856 H= 214:00 +CPU= 32.850
  13:06:26 STEP  857 H= 214:15 +CPU= 32.664
  13:06:57 STEP  858 H= 214:30 +CPU= 31.417
  13:07:31 STEP  859 H= 214:45 +CPU= 33.833
  13:08:01 STEP  860 H= 215:00 +CPU= 30.030
  13:08:33 STEP  861 H= 215:15 +CPU= 31.603
  13:09:06 STEP  862 H= 215:30 +CPU= 33.555
  13:09:41 STEP  863 H= 215:45 +CPU= 34.793
  13:10:29 STEP  864 H= 216:00 +CPU= 47.306
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0bv_2016092300_20_1017_12282254_0_r488368867_8.zip
Uploading the intermediate file: upload_file_8.zip
  13:11:03 STEP  865 H= 216:15 +CPU= 33.201
  13:11:36 STEP  866 H= 216:30 +CPU= 33.047
  13:12:09 STEP  867 H= 216:45 +CPU= 32.843
  13:12:40 STEP  868 H= 217:00 +CPU= 31.150
  13:13:12 STEP  869 H= 217:15 +CPU= 32.051
  13:13:44 STEP  870 H= 217:30 +CPU= 31.656
  13:14:21 STEP  871 H= 217:45 +CPU= 37.221
  13:14:56 STEP  872 H= 218:00 +CPU= 34.918
  13:15:30 STEP  873 H= 218:15 +CPU= 33.447
  13:15:59 STEP  874 H= 218:30 +CPU= 28.827
  13:16:29 STEP  875 H= 218:45 +CPU= 29.486
  13:17:04 STEP  876 H= 219:00 +CPU= 34.916
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+000876
  13:17:37 STEP  877 H= 219:15 +CPU= 32.386
  13:18:13 STEP  878 H= 219:30 +CPU= 35.828
  13:18:45 STEP  879 H= 219:45 +CPU= 31.970
  13:19:14 STEP  880 H= 220:00 +CPU= 29.004
  13:19:40 STEP  881 H= 220:15 +CPU= 26.070
  13:20:11 STEP  882 H= 220:30 +CPU= 30.749
  13:20:42 STEP  883 H= 220:45 +CPU= 31.081
  13:21:14 STEP  884 H= 221:00 +CPU= 31.720
  13:21:48 STEP  885 H= 221:15 +CPU= 33.569
  13:22:20 STEP  886 H= 221:30 +CPU= 31.922
  13:22:51 STEP  887 H= 221:45 +CPU= 30.625
  13:23:30 STEP  888 H= 222:00 +CPU= 38.932
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+000888
  13:24:05 STEP  889 H= 222:15 +CPU= 34.204
  13:24:39 STEP  890 H= 222:30 +CPU= 34.315
  13:25:16 STEP  891 H= 222:45 +CPU= 37.225
  13:25:55 STEP  892 H= 223:00 +CPU= 38.987
  13:26:26 STEP  893 H= 223:15 +CPU= 30.423
  13:26:58 STEP  894 H= 223:30 +CPU= 32.124
  13:27:31 STEP  895 H= 223:45 +CPU= 32.658
  13:28:05 STEP  896 H= 224:00 +CPU= 33.830
  13:28:38 STEP  897 H= 224:15 +CPU= 32.520
  13:29:10 STEP  898 H= 224:30 +CPU= 31.618
  13:29:45 STEP  899 H= 224:45 +CPU= 34.730
  13:30:28 STEP  900 H= 225:00 +CPU= 40.840
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+000900
  13:30:59 STEP  901 H= 225:15 +CPU= 31.219
  13:31:30 STEP  902 H= 225:30 +CPU= 31.167
  13:32:00 STEP  903 H= 225:45 +CPU= 29.692
  13:32:34 STEP  904 H= 226:00 +CPU= 33.701
  13:33:08 STEP  905 H= 226:15 +CPU= 33.520
  13:33:41 STEP  906 H= 226:30 +CPU= 32.243
  13:34:14 STEP  907 H= 226:45 +CPU= 33.032
  13:34:51 STEP  908 H= 227:00 +CPU= 37.052
  13:35:25 STEP  909 H= 227:15 +CPU= 33.744
  13:35:56 STEP  910 H= 227:30 +CPU= 30.789
  13:36:29 STEP  911 H= 227:45 +CPU= 32.756
  13:37:17 STEP  912 H= 228:00 +CPU= 47.974
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+000912
  13:37:49 STEP  913 H= 228:15 +CPU= 31.266
  13:38:20 STEP  914 H= 228:30 +CPU= 31.055
  13:38:52 STEP  915 H= 228:45 +CPU= 31.791
  13:39:25 STEP  916 H= 229:00 +CPU= 33.668
  13:39:56 STEP  917 H= 229:15 +CPU= 29.981
  13:40:28 STEP  918 H= 229:30 +CPU= 31.777
  13:40:58 STEP  919 H= 229:45 +CPU= 30.162
  13:41:28 STEP  920 H= 230:00 +CPU= 29.760
  13:42:00 STEP  921 H= 230:15 +CPU= 32.330
  13:42:32 STEP  922 H= 230:30 +CPU= 31.899
  13:43:07 STEP  923 H= 230:45 +CPU= 34.759
  13:43:50 STEP  924 H= 231:00 +CPU= 41.714
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+000924
  13:44:21 STEP  925 H= 231:15 +CPU= 31.373
  13:44:52 STEP  926 H= 231:30 +CPU= 31.127
  13:45:25 STEP  927 H= 231:45 +CPU= 32.666
  13:45:57 STEP  928 H= 232:00 +CPU= 32.185
  13:46:28 STEP  929 H= 232:15 +CPU= 30.495
  13:47:01 STEP  930 H= 232:30 +CPU= 32.935
  13:47:30 STEP  931 H= 232:45 +CPU= 28.550
  13:48:03 STEP  932 H= 233:00 +CPU= 33.480
  13:48:40 STEP  933 H= 233:15 +CPU= 36.488
  13:49:11 STEP  934 H= 233:30 +CPU= 30.577
  13:49:43 STEP  935 H= 233:45 +CPU= 31.518
  13:50:18 STEP  936 H= 234:00 +CPU= 35.529
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+000936
  13:50:48 STEP  937 H= 234:15 +CPU= 29.837
  13:51:22 STEP  938 H= 234:30 +CPU= 33.282
  13:51:53 STEP  939 H= 234:45 +CPU= 31.402
  13:52:25 STEP  940 H= 235:00 +CPU= 32.002
  13:53:02 STEP  941 H= 235:15 +CPU= 36.323
  13:53:39 STEP  942 H= 235:30 +CPU= 37.812
  13:54:15 STEP  943 H= 235:45 +CPU= 35.661
  13:54:47 STEP  944 H= 236:00 +CPU= 31.550
  13:55:19 STEP  945 H= 236:15 +CPU= 31.485
  13:55:50 STEP  946 H= 236:30 +CPU= 31.310
  13:56:25 STEP  947 H= 236:45 +CPU= 33.848
  13:57:06 STEP  948 H= 237:00 +CPU= 41.274
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+000948
  13:57:38 STEP  949 H= 237:15 +CPU= 32.161
  13:58:15 STEP  950 H= 237:30 +CPU= 36.300
  13:58:46 STEP  951 H= 237:45 +CPU= 31.201
  13:59:21 STEP  952 H= 238:00 +CPU= 33.990
  13:59:53 STEP  953 H= 238:15 +CPU= 32.469
  14:00:26 STEP  954 H= 238:30 +CPU= 32.754
  14:01:00 STEP  955 H= 238:45 +CPU= 33.440
  14:01:33 STEP  956 H= 239:00 +CPU= 33.002
  14:02:05 STEP  957 H= 239:15 +CPU= 31.807
  14:02:36 STEP  958 H= 239:30 +CPU= 31.171
  14:03:09 STEP  959 H= 239:45 +CPU= 32.971
  14:03:54 STEP  960 H= 240:00 +CPU= 44.226
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0bv_2016092300_20_1017_12282254_0_r488368867_9.zip
Uploading the intermediate file: upload_file_9.zip
  14:04:26 STEP  961 H= 240:15 +CPU= 32.663
  14:04:59 STEP  962 H= 240:30 +CPU= 32.744
  14:05:28 STEP  963 H= 240:45 +CPU= 29.165
  14:06:02 STEP  964 H= 241:00 +CPU= 33.477
  14:06:32 STEP  965 H= 241:15 +CPU= 30.042
  14:07:04 STEP  966 H= 241:30 +CPU= 32.302
  14:07:35 STEP  967 H= 241:45 +CPU= 30.992
  14:08:04 STEP  968 H= 242:00 +CPU= 28.972
  14:08:32 STEP  969 H= 242:15 +CPU= 27.923
  14:09:07 STEP  970 H= 242:30 +CPU= 34.431
  14:09:43 STEP  971 H= 242:45 +CPU= 35.918
  14:10:27 STEP  972 H= 243:00 +CPU= 44.166
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+000972
  14:11:02 STEP  973 H= 243:15 +CPU= 35.070
  14:11:34 STEP  974 H= 243:30 +CPU= 31.669
  14:12:08 STEP  975 H= 243:45 +CPU= 33.623
  14:12:42 STEP  976 H= 244:00 +CPU= 34.767
  14:13:17 STEP  977 H= 244:15 +CPU= 34.201
  14:13:52 STEP  978 H= 244:30 +CPU= 34.965
  14:14:25 STEP  979 H= 244:45 +CPU= 32.260
  14:15:01 STEP  980 H= 245:00 +CPU= 35.716
  14:15:36 STEP  981 H= 245:15 +CPU= 35.250
  14:16:08 STEP  982 H= 245:30 +CPU= 31.522
  14:16:43 STEP  983 H= 245:45 +CPU= 35.035
  14:17:25 STEP  984 H= 246:00 +CPU= 42.104
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+000984
  14:17:57 STEP  985 H= 246:15 +CPU= 32.056
  14:18:33 STEP  986 H= 246:30 +CPU= 35.747
  14:19:02 STEP  987 H= 246:45 +CPU= 28.713
  14:19:34 STEP  988 H= 247:00 +CPU= 32.291
  14:20:05 STEP  989 H= 247:15 +CPU= 30.855
  14:20:37 STEP  990 H= 247:30 +CPU= 31.003
  14:21:07 STEP  991 H= 247:45 +CPU= 30.806
  14:21:39 STEP  992 H= 248:00 +CPU= 31.714
  14:22:12 STEP  993 H= 248:15 +CPU= 32.586
  14:22:46 STEP  994 H= 248:30 +CPU= 34.122
  14:23:23 STEP  995 H= 248:45 +CPU= 35.519
  14:24:07 STEP  996 H= 249:00 +CPU= 43.632
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+000996
  14:24:42 STEP  997 H= 249:15 +CPU= 35.310
  14:25:15 STEP  998 H= 249:30 +CPU= 32.902
  14:25:47 STEP  999 H= 249:45 +CPU= 31.607
  14:26:22 STEP 1000 H= 250:00 +CPU= 34.491
  14:26:56 STEP 1001 H= 250:15 +CPU= 34.233
  14:27:28 STEP 1002 H= 250:30 +CPU= 32.121
  14:28:04 STEP 1003 H= 250:45 +CPU= 35.584
  14:28:45 STEP 1004 H= 251:00 +CPU= 40.353
  14:29:29 STEP 1005 H= 251:15 +CPU= 44.115
  14:30:03 STEP 1006 H= 251:30 +CPU= 33.620
  14:30:34 STEP 1007 H= 251:45 +CPU= 31.581
  14:31:21 STEP 1008 H= 252:00 +CPU= 46.571
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001008
  14:31:55 STEP 1009 H= 252:15 +CPU= 33.429
  14:32:31 STEP 1010 H= 252:30 +CPU= 36.056
  14:33:05 STEP 1011 H= 252:45 +CPU= 33.724
  14:33:39 STEP 1012 H= 253:00 +CPU= 34.007
  14:34:10 STEP 1013 H= 253:15 +CPU= 30.886
  14:34:42 STEP 1014 H= 253:30 +CPU= 31.813
  14:35:14 STEP 1015 H= 253:45 +CPU= 31.270
  14:35:46 STEP 1016 H= 254:00 +CPU= 32.673
  14:36:23 STEP 1017 H= 254:15 +CPU= 36.810
  14:36:56 STEP 1018 H= 254:30 +CPU= 32.285
  14:37:27 STEP 1019 H= 254:45 +CPU= 31.034
  14:38:05 STEP 1020 H= 255:00 +CPU= 37.633
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001020
  14:38:37 STEP 1021 H= 255:15 +CPU= 32.352
  14:39:08 STEP 1022 H= 255:30 +CPU= 30.514
  14:39:39 STEP 1023 H= 255:45 +CPU= 31.731
  14:40:13 STEP 1024 H= 256:00 +CPU= 33.756
  14:40:47 STEP 1025 H= 256:15 +CPU= 33.412
  14:41:18 STEP 1026 H= 256:30 +CPU= 30.452
  14:41:51 STEP 1027 H= 256:45 +CPU= 33.088
  14:42:27 STEP 1028 H= 257:00 +CPU= 36.364
  14:43:01 STEP 1029 H= 257:15 +CPU= 33.370
  14:43:31 STEP 1030 H= 257:30 +CPU= 29.920
  14:44:01 STEP 1031 H= 257:45 +CPU= 30.439
  14:44:42 STEP 1032 H= 258:00 +CPU= 40.665
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001032
  14:45:15 STEP 1033 H= 258:15 +CPU= 32.834
  14:45:43 STEP 1034 H= 258:30 +CPU= 28.741
  14:46:15 STEP 1035 H= 258:45 +CPU= 32.098
  14:46:51 STEP 1036 H= 259:00 +CPU= 34.645
  14:47:17 STEP 1037 H= 259:15 +CPU= 26.871
  14:47:49 STEP 1038 H= 259:30 +CPU= 31.699
  14:48:19 STEP 1039 H= 259:45 +CPU= 29.871
  14:48:53 STEP 1040 H= 260:00 +CPU= 33.185
  14:49:25 STEP 1041 H= 260:15 +CPU= 32.352
  14:49:55 STEP 1042 H= 260:30 +CPU= 30.000
  14:50:25 STEP 1043 H= 260:45 +CPU= 29.627
  14:51:00 STEP 1044 H= 261:00 +CPU= 34.554
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001044
  14:51:31 STEP 1045 H= 261:15 +CPU= 31.307
  14:52:02 STEP 1046 H= 261:30 +CPU= 31.374
  14:52:38 STEP 1047 H= 261:45 +CPU= 35.706
  14:53:12 STEP 1048 H= 262:00 +CPU= 33.547
  14:53:43 STEP 1049 H= 262:15 +CPU= 30.308
  14:54:11 STEP 1050 H= 262:30 +CPU= 28.382
  14:54:39 STEP 1051 H= 262:45 +CPU= 27.809
  14:55:08 STEP 1052 H= 263:00 +CPU= 29.149
  14:55:37 STEP 1053 H= 263:15 +CPU= 29.167
  14:56:12 STEP 1054 H= 263:30 +CPU= 34.210
  14:56:45 STEP 1055 H= 263:45 +CPU= 33.351
  14:57:28 STEP 1056 H= 264:00 +CPU= 42.668
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0bv_2016092300_20_1017_12282254_0_r488368867_10.zip
Uploading the intermediate file: upload_file_10.zip
  14:58:02 STEP 1057 H= 264:15 +CPU= 33.612
  14:58:35 STEP 1058 H= 264:30 +CPU= 32.684
  14:59:07 STEP 1059 H= 264:45 +CPU= 32.272
  14:59:37 STEP 1060 H= 265:00 +CPU= 29.506
  15:00:09 STEP 1061 H= 265:15 +CPU= 32.663
  15:00:46 STEP 1062 H= 265:30 +CPU= 36.348
  15:01:18 STEP 1063 H= 265:45 +CPU= 32.199
  15:01:51 STEP 1064 H= 266:00 +CPU= 32.539
  15:02:22 STEP 1065 H= 266:15 +CPU= 30.869
  15:02:56 STEP 1066 H= 266:30 +CPU= 34.065
  15:03:28 STEP 1067 H= 266:45 +CPU= 32.302
  15:04:11 STEP 1068 H= 267:00 +CPU= 42.250
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001068
  15:04:40 STEP 1069 H= 267:15 +CPU= 29.750
  15:05:15 STEP 1070 H= 267:30 +CPU= 34.932
  15:05:46 STEP 1071 H= 267:45 +CPU= 30.935
  15:06:19 STEP 1072 H= 268:00 +CPU= 33.147
  15:06:48 STEP 1073 H= 268:15 +CPU= 28.437
  15:07:20 STEP 1074 H= 268:30 +CPU= 31.600
  15:07:49 STEP 1075 H= 268:45 +CPU= 29.879
  15:08:18 STEP 1076 H= 269:00 +CPU= 28.720
  15:08:49 STEP 1077 H= 269:15 +CPU= 30.854
  15:09:16 STEP 1078 H= 269:30 +CPU= 26.944
  15:09:48 STEP 1079 H= 269:45 +CPU= 31.672
  15:10:29 STEP 1080 H= 270:00 +CPU= 41.184
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001080
  15:11:01 STEP 1081 H= 270:15 +CPU= 31.955
  15:11:30 STEP 1082 H= 270:30 +CPU= 28.402
  15:12:01 STEP 1083 H= 270:45 +CPU= 31.527
  15:12:34 STEP 1084 H= 271:00 +CPU= 31.876
  15:13:06 STEP 1085 H= 271:15 +CPU= 31.926
  15:13:37 STEP 1086 H= 271:30 +CPU= 31.449
  15:14:10 STEP 1087 H= 271:45 +CPU= 32.908
  15:14:46 STEP 1088 H= 272:00 +CPU= 35.241
  15:15:21 STEP 1089 H= 272:15 +CPU= 35.187
  15:15:55 STEP 1090 H= 272:30 +CPU= 34.509
  15:16:26 STEP 1091 H= 272:45 +CPU= 30.467
  15:17:13 STEP 1092 H= 273:00 +CPU= 46.766
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001092
  15:17:47 STEP 1093 H= 273:15 +CPU= 34.100
  15:18:18 STEP 1094 H= 273:30 +CPU= 30.423
  15:18:52 STEP 1095 H= 273:45 +CPU= 33.955
  15:19:29 STEP 1096 H= 274:00 +CPU= 36.157
  15:20:02 STEP 1097 H= 274:15 +CPU= 32.380
  15:20:34 STEP 1098 H= 274:30 +CPU= 32.101
  15:21:07 STEP 1099 H= 274:45 +CPU= 32.878
  15:21:39 STEP 1100 H= 275:00 +CPU= 32.501
  15:22:13 STEP 1101 H= 275:15 +CPU= 33.662
  15:22:49 STEP 1102 H= 275:30 +CPU= 35.493
  15:23:20 STEP 1103 H= 275:45 +CPU= 30.496
  15:24:01 STEP 1104 H= 276:00 +CPU= 41.400
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001104
  15:24:40 STEP 1105 H= 276:15 +CPU= 37.402
  15:25:12 STEP 1106 H= 276:30 +CPU= 31.746
  15:25:44 STEP 1107 H= 276:45 +CPU= 31.892
  15:26:17 STEP 1108 H= 277:00 +CPU= 32.611
  15:26:50 STEP 1109 H= 277:15 +CPU= 32.543
  15:27:20 STEP 1110 H= 277:30 +CPU= 30.637
  15:27:52 STEP 1111 H= 277:45 +CPU= 31.516
  15:28:23 STEP 1112 H= 278:00 +CPU= 31.129
  15:28:57 STEP 1113 H= 278:15 +CPU= 33.967
  15:29:27 STEP 1114 H= 278:30 +CPU= 30.140
  15:29:58 STEP 1115 H= 278:45 +CPU= 30.163
  15:30:38 STEP 1116 H= 279:00 +CPU= 40.098
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001116
  15:31:11 STEP 1117 H= 279:15 +CPU= 33.018
  15:31:45 STEP 1118 H= 279:30 +CPU= 34.122
  15:32:18 STEP 1119 H= 279:45 +CPU= 32.032
  15:32:49 STEP 1120 H= 280:00 +CPU= 31.391
  15:33:23 STEP 1121 H= 280:15 +CPU= 33.630
  15:33:53 STEP 1122 H= 280:30 +CPU= 29.983
  15:34:30 STEP 1123 H= 280:45 +CPU= 36.440
  15:35:03 STEP 1124 H= 281:00 +CPU= 32.297
  15:35:32 STEP 1125 H= 281:15 +CPU= 29.467
  15:36:06 STEP 1126 H= 281:30 +CPU= 32.775
  15:36:37 STEP 1127 H= 281:45 +CPU= 31.426
  15:37:19 STEP 1128 H= 282:00 +CPU= 41.683
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001128
  15:37:51 STEP 1129 H= 282:15 +CPU= 32.528
  15:38:28 STEP 1130 H= 282:30 +CPU= 36.199
  15:39:02 STEP 1131 H= 282:45 +CPU= 34.102
  15:39:33 STEP 1132 H= 283:00 +CPU= 31.045
  15:40:06 STEP 1133 H= 283:15 +CPU= 32.749
  15:40:39 STEP 1134 H= 283:30 +CPU= 33.214
  15:41:13 STEP 1135 H= 283:45 +CPU= 33.477
  15:41:46 STEP 1136 H= 284:00 +CPU= 33.646
  15:42:23 STEP 1137 H= 284:15 +CPU= 36.041
  15:42:53 STEP 1138 H= 284:30 +CPU= 30.351
  15:43:23 STEP 1139 H= 284:45 +CPU= 30.150
  15:44:04 STEP 1140 H= 285:00 +CPU= 40.038
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001140
  15:44:35 STEP 1141 H= 285:15 +CPU= 31.157
  15:45:04 STEP 1142 H= 285:30 +CPU= 29.615
  15:45:38 STEP 1143 H= 285:45 +CPU= 33.849
  15:46:16 STEP 1144 H= 286:00 +CPU= 37.143
  15:46:50 STEP 1145 H= 286:15 +CPU= 34.332
  15:47:24 STEP 1146 H= 286:30 +CPU= 33.772
  15:47:58 STEP 1147 H= 286:45 +CPU= 33.948
  15:48:30 STEP 1148 H= 287:00 +CPU= 32.073
  15:49:04 STEP 1149 H= 287:15 +CPU= 33.347
  15:49:35 STEP 1150 H= 287:30 +CPU= 30.729
  15:50:08 STEP 1151 H= 287:45 +CPU= 33.177
  15:50:51 STEP 1152 H= 288:00 +CPU= 43.326
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0bv_2016092300_20_1017_12282254_0_r488368867_11.zip
Uploading the intermediate file: upload_file_11.zip
  15:51:28 STEP 1153 H= 288:15 +CPU= 36.842
  15:52:02 STEP 1154 H= 288:30 +CPU= 33.176
  15:52:32 STEP 1155 H= 288:45 +CPU= 30.309
  15:53:03 STEP 1156 H= 289:00 +CPU= 31.361
  15:53:36 STEP 1157 H= 289:15 +CPU= 32.540
  15:54:07 STEP 1158 H= 289:30 +CPU= 31.106
  15:54:41 STEP 1159 H= 289:45 +CPU= 33.835
  15:55:14 STEP 1160 H= 290:00 +CPU= 32.191
  15:55:46 STEP 1161 H= 290:15 +CPU= 31.986
  15:56:23 STEP 1162 H= 290:30 +CPU= 37.611
  15:56:57 STEP 1163 H= 290:45 +CPU= 33.967
  15:57:42 STEP 1164 H= 291:00 +CPU= 43.786
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001164
  15:58:15 STEP 1165 H= 291:15 +CPU= 32.732
  15:58:50 STEP 1166 H= 291:30 +CPU= 34.862
  15:59:20 STEP 1167 H= 291:45 +CPU= 30.803
  15:59:55 STEP 1168 H= 292:00 +CPU= 34.164
  16:00:24 STEP 1169 H= 292:15 +CPU= 29.317
  16:00:50 STEP 1170 H= 292:30 +CPU= 25.980
  16:01:18 STEP 1171 H= 292:45 +CPU= 27.228
  16:01:50 STEP 1172 H= 293:00 +CPU= 32.689
  16:02:21 STEP 1173 H= 293:15 +CPU= 30.935
  16:02:54 STEP 1174 H= 293:30 +CPU= 32.247
  16:03:24 STEP 1175 H= 293:45 +CPU= 30.835
  16:04:02 STEP 1176 H= 294:00 +CPU= 37.840
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001176
  16:04:31 STEP 1177 H= 294:15 +CPU= 28.776
  16:05:01 STEP 1178 H= 294:30 +CPU= 29.657
  16:05:29 STEP 1179 H= 294:45 +CPU= 28.117
  16:05:57 STEP 1180 H= 295:00 +CPU= 28.367
  16:06:29 STEP 1181 H= 295:15 +CPU= 31.371
  16:07:03 STEP 1182 H= 295:30 +CPU= 34.524
  16:07:41 STEP 1183 H= 295:45 +CPU= 37.698
  16:08:11 STEP 1184 H= 296:00 +CPU= 29.806
  16:08:45 STEP 1185 H= 296:15 +CPU= 33.378
  16:09:17 STEP 1186 H= 296:30 +CPU= 32.204
  16:09:49 STEP 1187 H= 296:45 +CPU= 31.791
  16:10:30 STEP 1188 H= 297:00 +CPU= 40.911
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001188
  16:11:03 STEP 1189 H= 297:15 +CPU= 32.305
  16:11:36 STEP 1190 H= 297:30 +CPU= 33.095
  16:12:08 STEP 1191 H= 297:45 +CPU= 31.810
  16:12:42 STEP 1192 H= 298:00 +CPU= 34.508
  16:13:14 STEP 1193 H= 298:15 +CPU= 31.349
  16:13:45 STEP 1194 H= 298:30 +CPU= 31.634
  16:14:12 STEP 1195 H= 298:45 +CPU= 26.942
  16:14:43 STEP 1196 H= 299:00 +CPU= 30.445
  16:15:10 STEP 1197 H= 299:15 +CPU= 27.523
  16:15:38 STEP 1198 H= 299:30 +CPU= 27.124
  16:16:06 STEP 1199 H= 299:45 +CPU= 28.496
  16:16:48 STEP 1200 H= 300:00 +CPU= 41.955
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001200
  16:17:20 STEP 1201 H= 300:15 +CPU= 32.235
  16:17:53 STEP 1202 H= 300:30 +CPU= 31.755
  16:18:26 STEP 1203 H= 300:45 +CPU= 33.403
  16:19:01 STEP 1204 H= 301:00 +CPU= 34.613
  16:19:28 STEP 1205 H= 301:15 +CPU= 27.342
  16:20:04 STEP 1206 H= 301:30 +CPU= 35.946
  16:20:34 STEP 1207 H= 301:45 +CPU= 29.977
  16:21:07 STEP 1208 H= 302:00 +CPU= 32.448
  16:21:39 STEP 1209 H= 302:15 +CPU= 32.505
  16:22:11 STEP 1210 H= 302:30 +CPU= 31.115
  16:22:42 STEP 1211 H= 302:45 +CPU= 30.799
  16:23:17 STEP 1212 H= 303:00 +CPU= 35.181
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001212
  16:23:51 STEP 1213 H= 303:15 +CPU= 33.894
  16:24:28 STEP 1214 H= 303:30 +CPU= 36.303
  16:24:55 STEP 1215 H= 303:45 +CPU= 27.604
  16:25:28 STEP 1216 H= 304:00 +CPU= 32.570
  16:25:57 STEP 1217 H= 304:15 +CPU= 28.531
  16:26:26 STEP 1218 H= 304:30 +CPU= 28.805
  16:26:56 STEP 1219 H= 304:45 +CPU= 30.653
  16:27:29 STEP 1220 H= 305:00 +CPU= 32.172
  16:27:58 STEP 1221 H= 305:15 +CPU= 29.653
  16:28:30 STEP 1222 H= 305:30 +CPU= 32.158
  16:29:09 STEP 1223 H= 305:45 +CPU= 38.372
  16:29:47 STEP 1224 H= 306:00 +CPU= 38.003
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001224
  16:30:20 STEP 1225 H= 306:15 +CPU= 32.919
  16:30:55 STEP 1226 H= 306:30 +CPU= 34.091
  16:31:24 STEP 1227 H= 306:45 +CPU= 29.526
  16:31:55 STEP 1228 H= 307:00 +CPU= 31.024
  16:32:26 STEP 1229 H= 307:15 +CPU= 30.882
  16:32:54 STEP 1230 H= 307:30 +CPU= 27.786
  16:33:29 STEP 1231 H= 307:45 +CPU= 34.780
  16:33:58 STEP 1232 H= 308:00 +CPU= 28.719
  16:34:26 STEP 1233 H= 308:15 +CPU= 28.637
  16:34:55 STEP 1234 H= 308:30 +CPU= 28.846
  16:35:27 STEP 1235 H= 308:45 +CPU= 32.036
  16:36:05 STEP 1236 H= 309:00 +CPU= 37.401
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001236
  16:36:35 STEP 1237 H= 309:15 +CPU= 30.261
  16:37:10 STEP 1238 H= 309:30 +CPU= 35.139
  16:37:41 STEP 1239 H= 309:45 +CPU= 30.742
  16:38:11 STEP 1240 H= 310:00 +CPU= 30.608
  16:38:41 STEP 1241 H= 310:15 +CPU= 29.261
  16:39:09 STEP 1242 H= 310:30 +CPU= 28.243
  16:39:39 STEP 1243 H= 310:45 +CPU= 30.040
  16:40:07 STEP 1244 H= 311:00 +CPU= 27.394
  16:40:32 STEP 1245 H= 311:15 +CPU= 25.395
  16:41:03 STEP 1246 H= 311:30 +CPU= 30.467
  16:41:33 STEP 1247 H= 311:45 +CPU= 30.603
  16:42:18 STEP 1248 H= 312:00 +CPU= 44.624
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0bv_2016092300_20_1017_12282254_0_r488368867_12.zip
Uploading the intermediate file: upload_file_12.zip
  16:42:52 STEP 1249 H= 312:15 +CPU= 33.523
  16:43:21 STEP 1250 H= 312:30 +CPU= 29.147
  16:43:54 STEP 1251 H= 312:45 +CPU= 32.454
  16:44:25 STEP 1252 H= 313:00 +CPU= 31.317
  16:44:54 STEP 1253 H= 313:15 +CPU= 28.868
  16:45:26 STEP 1254 H= 313:30 +CPU= 31.829
  16:45:56 STEP 1255 H= 313:45 +CPU= 29.516
  16:46:31 STEP 1256 H= 314:00 +CPU= 34.853
  16:47:02 STEP 1257 H= 314:15 +CPU= 30.831
  16:47:34 STEP 1258 H= 314:30 +CPU= 31.547
  16:48:08 STEP 1259 H= 314:45 +CPU= 33.363
  16:48:47 STEP 1260 H= 315:00 +CPU= 39.580
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001260
  16:49:23 STEP 1261 H= 315:15 +CPU= 35.206
  16:49:55 STEP 1262 H= 315:30 +CPU= 31.550
  16:50:31 STEP 1263 H= 315:45 +CPU= 36.469
  16:51:05 STEP 1264 H= 316:00 +CPU= 33.992
  16:51:35 STEP 1265 H= 316:15 +CPU= 30.001
  16:52:07 STEP 1266 H= 316:30 +CPU= 31.660
  16:52:40 STEP 1267 H= 316:45 +CPU= 32.591
  16:53:17 STEP 1268 H= 317:00 +CPU= 37.300
  16:53:51 STEP 1269 H= 317:15 +CPU= 33.760
  16:54:28 STEP 1270 H= 317:30 +CPU= 36.792
  16:55:02 STEP 1271 H= 317:45 +CPU= 33.611
  16:55:43 STEP 1272 H= 318:00 +CPU= 40.939
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001272
  16:56:17 STEP 1273 H= 318:15 +CPU= 33.791
  16:56:50 STEP 1274 H= 318:30 +CPU= 32.804
  16:57:26 STEP 1275 H= 318:45 +CPU= 35.193
  16:58:00 STEP 1276 H= 319:00 +CPU= 34.558
  16:58:32 STEP 1277 H= 319:15 +CPU= 30.877
  16:59:01 STEP 1278 H= 319:30 +CPU= 29.416
  16:59:31 STEP 1279 H= 319:45 +CPU= 30.305
  17:00:05 STEP 1280 H= 320:00 +CPU= 33.997
  17:00:41 STEP 1281 H= 320:15 +CPU= 35.505
  17:01:16 STEP 1282 H= 320:30 +CPU= 34.306
  17:01:52 STEP 1283 H= 320:45 +CPU= 35.156
  17:02:29 STEP 1284 H= 321:00 +CPU= 37.134
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001284
  17:03:01 STEP 1285 H= 321:15 +CPU= 30.641
  17:03:30 STEP 1286 H= 321:30 +CPU= 29.562
  17:04:00 STEP 1287 H= 321:45 +CPU= 29.947
  17:04:36 STEP 1288 H= 322:00 +CPU= 35.919
  17:05:12 STEP 1289 H= 322:15 +CPU= 35.987
  17:05:45 STEP 1290 H= 322:30 +CPU= 32.446
  17:06:22 STEP 1291 H= 322:45 +CPU= 36.947
  17:06:58 STEP 1292 H= 323:00 +CPU= 36.464
  17:07:31 STEP 1293 H= 323:15 +CPU= 32.126
  17:08:04 STEP 1294 H= 323:30 +CPU= 32.698
  17:08:37 STEP 1295 H= 323:45 +CPU= 33.786
  17:09:22 STEP 1296 H= 324:00 +CPU= 43.841
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001296
  17:09:53 STEP 1297 H= 324:15 +CPU= 31.113
  17:10:25 STEP 1298 H= 324:30 +CPU= 32.179
  17:10:56 STEP 1299 H= 324:45 +CPU= 30.297
  17:11:29 STEP 1300 H= 325:00 +CPU= 33.513
  17:12:01 STEP 1301 H= 325:15 +CPU= 30.893
  17:12:33 STEP 1302 H= 325:30 +CPU= 32.558
  17:13:05 STEP 1303 H= 325:45 +CPU= 31.564
  17:13:38 STEP 1304 H= 326:00 +CPU= 33.034
  17:14:10 STEP 1305 H= 326:15 +CPU= 31.062
  17:14:43 STEP 1306 H= 326:30 +CPU= 33.051
  17:15:18 STEP 1307 H= 326:45 +CPU= 34.365
  17:16:00 STEP 1308 H= 327:00 +CPU= 42.453
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001308
  17:16:31 STEP 1309 H= 327:15 +CPU= 30.660
  17:17:06 STEP 1310 H= 327:30 +CPU= 35.264
  17:17:44 STEP 1311 H= 327:45 +CPU= 37.172
  17:18:18 STEP 1312 H= 328:00 +CPU= 33.822
  17:18:51 STEP 1313 H= 328:15 +CPU= 32.518
  17:19:23 STEP 1314 H= 328:30 +CPU= 31.916
  17:19:57 STEP 1315 H= 328:45 +CPU= 33.405
  17:20:31 STEP 1316 H= 329:00 +CPU= 34.166
  17:21:01 STEP 1317 H= 329:15 +CPU= 30.673
  17:21:34 STEP 1318 H= 329:30 +CPU= 32.228
  17:22:06 STEP 1319 H= 329:45 +CPU= 32.641
  17:22:47 STEP 1320 H= 330:00 +CPU= 40.253
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001320
  17:23:20 STEP 1321 H= 330:15 +CPU= 33.014
  17:23:56 STEP 1322 H= 330:30 +CPU= 36.060
  17:24:29 STEP 1323 H= 330:45 +CPU= 33.088
  17:25:04 STEP 1324 H= 331:00 +CPU= 35.181
  17:25:40 STEP 1325 H= 331:15 +CPU= 35.966
  17:26:16 STEP 1326 H= 331:30 +CPU= 35.475
  17:26:50 STEP 1327 H= 331:45 +CPU= 34.205
  17:27:24 STEP 1328 H= 332:00 +CPU= 33.141
  17:27:56 STEP 1329 H= 332:15 +CPU= 32.232
  17:28:27 STEP 1330 H= 332:30 +CPU= 30.992
  17:28:58 STEP 1331 H= 332:45 +CPU= 31.138
  17:29:38 STEP 1332 H= 333:00 +CPU= 39.634
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001332
  17:30:12 STEP 1333 H= 333:15 +CPU= 33.455
  17:30:50 STEP 1334 H= 333:30 +CPU= 38.101
  17:31:23 STEP 1335 H= 333:45 +CPU= 32.894
  17:31:57 STEP 1336 H= 334:00 +CPU= 34.404
  17:32:29 STEP 1337 H= 334:15 +CPU= 31.675
  17:33:04 STEP 1338 H= 334:30 +CPU= 34.990
  17:33:35 STEP 1339 H= 334:45 +CPU= 31.267
  17:34:08 STEP 1340 H= 335:00 +CPU= 32.660
  17:34:39 STEP 1341 H= 335:15 +CPU= 30.746
  17:35:10 STEP 1342 H= 335:30 +CPU= 31.487
  17:35:46 STEP 1343 H= 335:45 +CPU= 35.217
  17:36:32 STEP 1344 H= 336:00 +CPU= 45.293
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0bv_2016092300_20_1017_12282254_0_r488368867_13.zip
Uploading the intermediate file: upload_file_13.zip
  17:37:06 STEP 1345 H= 336:15 +CPU= 34.049
Uploading trickle at timestep: 1209600
  17:37:41 STEP 1346 H= 336:30 +CPU= 34.873
  17:38:15 STEP 1347 H= 336:45 +CPU= 33.534
  17:38:48 STEP 1348 H= 337:00 +CPU= 32.426
  17:39:21 STEP 1349 H= 337:15 +CPU= 32.617
  17:39:53 STEP 1350 H= 337:30 +CPU= 31.288
  17:40:24 STEP 1351 H= 337:45 +CPU= 31.453
  17:40:56 STEP 1352 H= 338:00 +CPU= 31.860
  17:41:29 STEP 1353 H= 338:15 +CPU= 31.800
  17:42:05 STEP 1354 H= 338:30 +CPU= 36.656
  17:42:43 STEP 1355 H= 338:45 +CPU= 37.416
  17:43:21 STEP 1356 H= 339:00 +CPU= 38.361
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001356
  17:43:53 STEP 1357 H= 339:15 +CPU= 31.549
  17:44:28 STEP 1358 H= 339:30 +CPU= 34.741
  17:45:00 STEP 1359 H= 339:45 +CPU= 32.079
  17:45:35 STEP 1360 H= 340:00 +CPU= 35.838
  17:46:12 STEP 1361 H= 340:15 +CPU= 36.197
  17:46:46 STEP 1362 H= 340:30 +CPU= 34.224
  17:47:18 STEP 1363 H= 340:45 +CPU= 31.609
  17:47:48 STEP 1364 H= 341:00 +CPU= 30.571
  17:48:25 STEP 1365 H= 341:15 +CPU= 35.978
  17:49:00 STEP 1366 H= 341:30 +CPU= 35.214
  17:49:36 STEP 1367 H= 341:45 +CPU= 35.500
  17:50:18 STEP 1368 H= 342:00 +CPU= 42.864
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001368
  17:50:50 STEP 1369 H= 342:15 +CPU= 31.393
  17:51:24 STEP 1370 H= 342:30 +CPU= 33.851
  17:51:56 STEP 1371 H= 342:45 +CPU= 32.324
  17:52:27 STEP 1372 H= 343:00 +CPU= 30.900
  17:52:57 STEP 1373 H= 343:15 +CPU= 29.235
  17:53:28 STEP 1374 H= 343:30 +CPU= 31.354
  17:53:59 STEP 1375 H= 343:45 +CPU= 30.673
  17:54:30 STEP 1376 H= 344:00 +CPU= 31.439
  17:54:58 STEP 1377 H= 344:15 +CPU= 28.400
  17:55:28 STEP 1378 H= 344:30 +CPU= 29.190
  17:55:57 STEP 1379 H= 344:45 +CPU= 29.409
  17:56:35 STEP 1380 H= 345:00 +CPU= 37.942
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001380
  17:57:04 STEP 1381 H= 345:15 +CPU= 29.055
  17:57:34 STEP 1382 H= 345:30 +CPU= 29.800
  17:58:03 STEP 1383 H= 345:45 +CPU= 28.927
  17:58:35 STEP 1384 H= 346:00 +CPU= 32.584
  17:59:08 STEP 1385 H= 346:15 +CPU= 32.986
  17:59:37 STEP 1386 H= 346:30 +CPU= 28.475
  18:00:11 STEP 1387 H= 346:45 +CPU= 33.244
  18:00:44 STEP 1388 H= 347:00 +CPU= 33.401
  18:01:17 STEP 1389 H= 347:15 +CPU= 32.999
  18:01:48 STEP 1390 H= 347:30 +CPU= 30.941
  18:02:23 STEP 1391 H= 347:45 +CPU= 34.543
  18:03:09 STEP 1392 H= 348:00 +CPU= 46.439
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001392
  18:03:47 STEP 1393 H= 348:15 +CPU= 37.527
  18:04:22 STEP 1394 H= 348:30 +CPU= 34.597
  18:04:55 STEP 1395 H= 348:45 +CPU= 33.313
  18:05:29 STEP 1396 H= 349:00 +CPU= 32.921
  18:06:03 STEP 1397 H= 349:15 +CPU= 33.520
  18:06:35 STEP 1398 H= 349:30 +CPU= 31.550
  18:07:04 STEP 1399 H= 349:45 +CPU= 29.269
  18:07:35 STEP 1400 H= 350:00 +CPU= 30.884
  18:08:06 STEP 1401 H= 350:15 +CPU= 31.265
  18:08:41 STEP 1402 H= 350:30 +CPU= 33.950
  18:09:13 STEP 1403 H= 350:45 +CPU= 31.779
  18:09:55 STEP 1404 H= 351:00 +CPU= 41.408
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001404
  18:10:33 STEP 1405 H= 351:15 +CPU= 37.796
  18:11:07 STEP 1406 H= 351:30 +CPU= 34.321
  18:11:44 STEP 1407 H= 351:45 +CPU= 37.173
  18:12:19 STEP 1408 H= 352:00 +CPU= 34.758
  18:12:54 STEP 1409 H= 352:15 +CPU= 34.268
  18:13:25 STEP 1410 H= 352:30 +CPU= 30.560
  18:13:54 STEP 1411 H= 352:45 +CPU= 29.575
  18:14:27 STEP 1412 H= 353:00 +CPU= 32.717
  18:14:56 STEP 1413 H= 353:15 +CPU= 28.845
  18:15:25 STEP 1414 H= 353:30 +CPU= 29.178
  18:15:58 STEP 1415 H= 353:45 +CPU= 32.359
  18:16:36 STEP 1416 H= 354:00 +CPU= 38.064
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001416
  18:17:10 STEP 1417 H= 354:15 +CPU= 33.673
  18:17:43 STEP 1418 H= 354:30 +CPU= 33.738
  18:18:22 STEP 1419 H= 354:45 +CPU= 38.014
  18:18:55 STEP 1420 H= 355:00 +CPU= 33.953
  18:19:27 STEP 1421 H= 355:15 +CPU= 31.252
  18:20:00 STEP 1422 H= 355:30 +CPU= 33.490
  18:20:35 STEP 1423 H= 355:45 +CPU= 34.210
  18:21:10 STEP 1424 H= 356:00 +CPU= 34.978
  18:21:43 STEP 1425 H= 356:15 +CPU= 33.346
  18:22:17 STEP 1426 H= 356:30 +CPU= 33.492
  18:22:56 STEP 1427 H= 356:45 +CPU= 39.193
  18:23:46 STEP 1428 H= 357:00 +CPU= 49.781
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001428
  18:24:21 STEP 1429 H= 357:15 +CPU= 35.107
  18:24:58 STEP 1430 H= 357:30 +CPU= 36.074
  18:25:32 STEP 1431 H= 357:45 +CPU= 33.554
  18:26:03 STEP 1432 H= 358:00 +CPU= 30.706
  18:26:35 STEP 1433 H= 358:15 +CPU= 31.984
  18:27:09 STEP 1434 H= 358:30 +CPU= 33.136
  18:27:42 STEP 1435 H= 358:45 +CPU= 33.020
  18:28:17 STEP 1436 H= 359:00 +CPU= 35.140
  18:28:51 STEP 1437 H= 359:15 +CPU= 33.297
  18:29:23 STEP 1438 H= 359:30 +CPU= 31.715
  18:29:56 STEP 1439 H= 359:45 +CPU= 32.472
  18:30:32 STEP 1440 H= 360:00 +CPU= 36.796
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.9761226304E-22      I       0.1852634543E-05      I
ICloud fractionI      0.0000000000E+00      I       0.2730466997E-01      I
I  Relat. Hum. I      0.1026337956E-01      I       0.1231319216E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.2343414987E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    323156100 BYTES IN      7 RECORDS TRANSFERRED IN    0.0006 SECONDS538593.5 Mbytes/s, TOTAL TIME=    0.0120( 5.0%)
 18:30:32 STEP 1440 H= 360:00 +CPU= 36.796
 END CNT3
 NSTEP =  1440 CNT0   000000000  26.381  26.381  26.404   0.999               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN        30030/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    528    0       46      1044068    30030 ************    55.4     1.5    53.9     2.2   117.0
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1093    5156.6    5156.6     16.87      0.00
   9 SPCM     - SPECTRAL COMP.                    1008    1372.0    1372.0      4.14      0.00
  10 SCAN2M - PHYSICS                             1009   15032.9   15032.9     45.40      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 84     974.7     974.7      0.25      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 43      66.3      66.3      0.01      0.00
  17 GRIDFPOS IN CNT4                               84      38.9      38.9      0.01      0.00
  27 RESTART FILES - WRITING                        21    3898.8    3898.8      0.25      0.00
  28 RESTART FILES - READING                         1    3120.5    3120.5      0.01      0.00
  29 SU4FPOS IN CNT4                                84       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                                84    6646.2    6646.2      1.67      0.00
  31 POSDDH IN STEPO                                 5       1.0       1.0      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1009    6866.0    6866.0     20.74      0.00
  39 SU0YOMB                                         1     270.7     270.7      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1009      33.7      33.7      0.10      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1008     703.6     703.6      2.12      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1008      78.5      78.5      0.24      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 43       0.5       0.5      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     2188     459.5     459.5      3.01      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      2100     264.3     264.3      1.66      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       2100      86.9      86.9      0.55      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      2188     147.6     147.6      0.97      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      39.2      39.2      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           2188      58.1      58.1      0.38      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           2100      38.6      38.6      0.24      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           2188     196.7     196.7      1.29      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           2100      82.0      82.0      0.52      0.00
 400 GSTATS                                     117647       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                109409       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    33410.9 CPU TIME   33271.1 VECTOR TIME    33271.1


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       38.8
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/57/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/57/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/57/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282254/ICMGGh7zg+001416
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0bv_2016092300_20_1017_12282254_0_r488368867_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
18:34:04 (764536): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a0bv_2016092300_20_1017_12282254_0_r488368867_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a0bv_2016092300_20_1017_12282254_0_r488368867_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a0bv_2016092300_20_1017_12282254_0_r488368867_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a0bv_2016092300_20_1017_12282254_0_r488368867_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a0bv_2016092300_20_1017_12282254_0_r488368867_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 Jun 2024 23:41:24 1532338 22433821 oifs_43r3_bl_a0bv_2016092300_20_1017_12282254_0 1,295,100 49,303 0.0381
09 Jun 2024 23:41:24 1532338 22433821 oifs_43r3_bl_a0bv_2016092300_20_1017_12282254_0 1,209,600 46,080 0.0381


©2024 climateprediction.net