climateprediction.net home page
Task 22440723

Task 22440723

Name oifs_43r3_bl_a1s1_2016092300_20_1017_12284132_1
Workunit 12284132
Created 8 Jun 2024, 8:55:23 UTC
Sent 8 Jun 2024, 8:57:22 UTC
Report deadline 7 Aug 2024, 8:57:22 UTC
Received 10 Jun 2024, 10:40:53 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1498497
Run time 23 hours 43 min 36 sec
CPU time 23 hours 35 min 40 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 2.81 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,016.38 MB
Peak swap size 5,980.79 MB
Peak disk usage 1,350.84 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
EP  835 H= 208:45 +CPU= 54.199
  19:51:30 STEP  836 H= 209:00 +CPU= 55.211
  19:52:24 STEP  837 H= 209:15 +CPU= 53.554
  19:53:18 STEP  838 H= 209:30 +CPU= 53.741
  19:54:11 STEP  839 H= 209:45 +CPU= 52.538
  19:55:16 STEP  840 H= 210:00 +CPU= 65.317
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000840
  19:56:09 STEP  841 H= 210:15 +CPU= 52.825
  19:57:00 STEP  842 H= 210:30 +CPU= 51.148
  19:57:52 STEP  843 H= 210:45 +CPU= 52.451
  19:58:46 STEP  844 H= 211:00 +CPU= 53.908
  19:59:39 STEP  845 H= 211:15 +CPU= 52.478
  20:00:33 STEP  846 H= 211:30 +CPU= 53.948
  20:01:27 STEP  847 H= 211:45 +CPU= 53.532
  20:02:21 STEP  848 H= 212:00 +CPU= 53.881
  20:03:14 STEP  849 H= 212:15 +CPU= 52.684
  20:04:03 STEP  850 H= 212:30 +CPU= 49.262
  20:04:54 STEP  851 H= 212:45 +CPU= 51.507
  20:06:01 STEP  852 H= 213:00 +CPU= 66.525
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000852
  20:06:53 STEP  853 H= 213:15 +CPU= 51.323
  20:07:42 STEP  854 H= 213:30 +CPU= 49.256
  20:08:34 STEP  855 H= 213:45 +CPU= 51.827
  20:09:25 STEP  856 H= 214:00 +CPU= 50.711
  20:10:15 STEP  857 H= 214:15 +CPU= 50.030
  20:11:08 STEP  858 H= 214:30 +CPU= 52.932
  20:12:01 STEP  859 H= 214:45 +CPU= 53.139
  20:12:53 STEP  860 H= 215:00 +CPU= 51.614
  20:13:45 STEP  861 H= 215:15 +CPU= 51.573
  20:14:40 STEP  862 H= 215:30 +CPU= 55.009
  20:15:32 STEP  863 H= 215:45 +CPU= 52.565
  20:16:42 STEP  864 H= 216:00 +CPU= 69.044
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1s1_2016092300_20_1017_12284132_1_r696937581_8.zip
Uploading the intermediate file: upload_file_8.zip
  20:17:34 STEP  865 H= 216:15 +CPU= 52.121
  20:18:27 STEP  866 H= 216:30 +CPU= 52.290
  20:19:21 STEP  867 H= 216:45 +CPU= 53.690
  20:20:15 STEP  868 H= 217:00 +CPU= 53.632
  20:21:07 STEP  869 H= 217:15 +CPU= 51.916
  20:22:00 STEP  870 H= 217:30 +CPU= 52.754
  20:22:53 STEP  871 H= 217:45 +CPU= 53.299
  20:23:47 STEP  872 H= 218:00 +CPU= 53.342
  20:24:39 STEP  873 H= 218:15 +CPU= 52.506
  20:25:32 STEP  874 H= 218:30 +CPU= 52.080
  20:26:24 STEP  875 H= 218:45 +CPU= 51.900
  20:27:28 STEP  876 H= 219:00 +CPU= 64.450
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000876
  20:28:20 STEP  877 H= 219:15 +CPU= 51.930
  20:29:11 STEP  878 H= 219:30 +CPU= 50.586
  20:30:03 STEP  879 H= 219:45 +CPU= 52.369
  20:30:55 STEP  880 H= 220:00 +CPU= 51.705
  20:31:47 STEP  881 H= 220:15 +CPU= 51.457
  20:32:38 STEP  882 H= 220:30 +CPU= 51.018
  20:33:29 STEP  883 H= 220:45 +CPU= 50.898
  20:34:21 STEP  884 H= 221:00 +CPU= 52.200
  20:35:12 STEP  885 H= 221:15 +CPU= 50.798
  20:36:06 STEP  886 H= 221:30 +CPU= 54.004
  20:37:05 STEP  887 H= 221:45 +CPU= 58.354
  20:38:17 STEP  888 H= 222:00 +CPU= 72.401
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000888
  20:39:16 STEP  889 H= 222:15 +CPU= 58.385
  20:40:15 STEP  890 H= 222:30 +CPU= 58.593
  20:41:14 STEP  891 H= 222:45 +CPU= 58.809
  20:42:14 STEP  892 H= 223:00 +CPU= 60.036
  20:43:12 STEP  893 H= 223:15 +CPU= 58.534
  20:44:11 STEP  894 H= 223:30 +CPU= 58.786
  20:45:11 STEP  895 H= 223:45 +CPU= 59.146
  20:46:11 STEP  896 H= 224:00 +CPU= 59.642
  20:47:09 STEP  897 H= 224:15 +CPU= 58.243
  20:48:09 STEP  898 H= 224:30 +CPU= 59.097
  20:49:08 STEP  899 H= 224:45 +CPU= 59.346
  20:50:21 STEP  900 H= 225:00 +CPU= 72.721
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000900
  20:51:21 STEP  901 H= 225:15 +CPU= 59.515
  20:52:20 STEP  902 H= 225:30 +CPU= 59.046
  20:53:19 STEP  903 H= 225:45 +CPU= 59.147
  20:54:20 STEP  904 H= 226:00 +CPU= 60.140
  20:55:19 STEP  905 H= 226:15 +CPU= 58.897
  20:56:18 STEP  906 H= 226:30 +CPU= 59.160
  20:57:19 STEP  907 H= 226:45 +CPU= 60.399
  20:58:20 STEP  908 H= 227:00 +CPU= 60.475
  20:59:19 STEP  909 H= 227:15 +CPU= 59.546
  21:00:19 STEP  910 H= 227:30 +CPU= 59.073
  21:01:18 STEP  911 H= 227:45 +CPU= 58.654
  21:02:39 STEP  912 H= 228:00 +CPU= 80.518
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000912
  21:03:37 STEP  913 H= 228:15 +CPU= 58.441
  21:04:37 STEP  914 H= 228:30 +CPU= 59.005
  21:05:35 STEP  915 H= 228:45 +CPU= 58.590
  21:06:36 STEP  916 H= 229:00 +CPU= 60.255
  21:07:35 STEP  917 H= 229:15 +CPU= 58.753
  21:08:34 STEP  918 H= 229:30 +CPU= 58.577
  21:09:32 STEP  919 H= 229:45 +CPU= 58.097
  21:10:32 STEP  920 H= 230:00 +CPU= 60.232
  21:11:31 STEP  921 H= 230:15 +CPU= 58.891
  21:12:30 STEP  922 H= 230:30 +CPU= 58.748
  21:13:30 STEP  923 H= 230:45 +CPU= 59.261
  21:14:43 STEP  924 H= 231:00 +CPU= 73.328
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000924
  21:15:42 STEP  925 H= 231:15 +CPU= 58.112
  21:16:34 STEP  926 H= 231:30 +CPU= 52.648
  21:17:27 STEP  927 H= 231:45 +CPU= 52.064
  21:18:20 STEP  928 H= 232:00 +CPU= 53.777
  21:19:14 STEP  929 H= 232:15 +CPU= 53.183
  21:20:07 STEP  930 H= 232:30 +CPU= 53.678
  21:21:00 STEP  931 H= 232:45 +CPU= 52.160
  21:21:51 STEP  932 H= 233:00 +CPU= 51.691
  21:22:44 STEP  933 H= 233:15 +CPU= 52.138
  21:23:38 STEP  934 H= 233:30 +CPU= 53.971
  21:24:31 STEP  935 H= 233:45 +CPU= 53.195
  21:25:38 STEP  936 H= 234:00 +CPU= 66.650
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000936
  21:26:31 STEP  937 H= 234:15 +CPU= 53.017
  21:27:23 STEP  938 H= 234:30 +CPU= 51.510
  21:28:15 STEP  939 H= 234:45 +CPU= 52.408
  21:29:09 STEP  940 H= 235:00 +CPU= 53.597
  21:30:02 STEP  941 H= 235:15 +CPU= 52.645
  21:30:54 STEP  942 H= 235:30 +CPU= 51.716
  21:31:44 STEP  943 H= 235:45 +CPU= 50.275
  21:32:38 STEP  944 H= 236:00 +CPU= 53.839
  21:33:30 STEP  945 H= 236:15 +CPU= 52.239
  21:34:22 STEP  946 H= 236:30 +CPU= 51.341
  21:35:13 STEP  947 H= 236:45 +CPU= 50.945
  21:36:21 STEP  948 H= 237:00 +CPU= 67.639
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000948
  21:37:14 STEP  949 H= 237:15 +CPU= 53.126
  21:38:08 STEP  950 H= 237:30 +CPU= 53.426
  21:39:01 STEP  951 H= 237:45 +CPU= 53.087
  21:39:55 STEP  952 H= 238:00 +CPU= 53.647
  21:40:46 STEP  953 H= 238:15 +CPU= 51.458
  21:41:37 STEP  954 H= 238:30 +CPU= 51.252
  21:42:31 STEP  955 H= 238:45 +CPU= 53.860
  21:43:26 STEP  956 H= 239:00 +CPU= 54.866
  21:44:19 STEP  957 H= 239:15 +CPU= 52.321
  21:45:12 STEP  958 H= 239:30 +CPU= 53.087
  21:46:06 STEP  959 H= 239:45 +CPU= 53.383
  21:47:21 STEP  960 H= 240:00 +CPU= 74.849
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1s1_2016092300_20_1017_12284132_1_r696937581_9.zip
Uploading the intermediate file: upload_file_9.zip
Uploading trickle at timestep: 864000
  21:48:13 STEP  961 H= 240:15 +CPU= 52.779
  21:49:05 STEP  962 H= 240:30 +CPU= 51.567
  21:49:58 STEP  963 H= 240:45 +CPU= 52.981
  21:50:51 STEP  964 H= 241:00 +CPU= 53.135
  21:51:45 STEP  965 H= 241:15 +CPU= 53.691
  21:52:38 STEP  966 H= 241:30 +CPU= 53.177
  21:53:30 STEP  967 H= 241:45 +CPU= 52.052
  21:54:23 STEP  968 H= 242:00 +CPU= 52.635
  21:55:14 STEP  969 H= 242:15 +CPU= 50.736
  21:56:04 STEP  970 H= 242:30 +CPU= 50.243
  21:56:56 STEP  971 H= 242:45 +CPU= 51.725
  21:58:02 STEP  972 H= 243:00 +CPU= 66.036
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000972
  21:58:59 STEP  973 H= 243:15 +CPU= 57.397
  21:59:58 STEP  974 H= 243:30 +CPU= 58.918
  22:00:57 STEP  975 H= 243:45 +CPU= 58.061
  22:01:56 STEP  976 H= 244:00 +CPU= 59.644
  22:02:55 STEP  977 H= 244:15 +CPU= 58.692
  22:03:55 STEP  978 H= 244:30 +CPU= 59.460
  22:04:54 STEP  979 H= 244:45 +CPU= 59.394
  22:05:56 STEP  980 H= 245:00 +CPU= 61.028
  22:06:55 STEP  981 H= 245:15 +CPU= 59.177
  22:07:54 STEP  982 H= 245:30 +CPU= 58.391
  22:08:53 STEP  983 H= 245:45 +CPU= 59.006
  22:10:07 STEP  984 H= 246:00 +CPU= 73.603
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000984
  22:11:05 STEP  985 H= 246:15 +CPU= 58.427
  22:12:05 STEP  986 H= 246:30 +CPU= 59.733
  22:13:04 STEP  987 H= 246:45 +CPU= 58.887
  22:14:04 STEP  988 H= 247:00 +CPU= 59.842
  22:15:04 STEP  989 H= 247:15 +CPU= 59.604
  22:16:03 STEP  990 H= 247:30 +CPU= 58.449
  22:17:02 STEP  991 H= 247:45 +CPU= 59.296
  22:18:03 STEP  992 H= 248:00 +CPU= 60.740
  22:19:02 STEP  993 H= 248:15 +CPU= 58.958
  22:20:01 STEP  994 H= 248:30 +CPU= 58.673
  22:20:59 STEP  995 H= 248:45 +CPU= 58.136
  22:22:14 STEP  996 H= 249:00 +CPU= 74.404
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000996
  22:23:13 STEP  997 H= 249:15 +CPU= 59.214
  22:24:13 STEP  998 H= 249:30 +CPU= 59.374
  22:25:12 STEP  999 H= 249:45 +CPU= 59.408
  22:26:14 STEP 1000 H= 250:00 +CPU= 60.934
  22:27:12 STEP 1001 H= 250:15 +CPU= 58.470
  22:28:11 STEP 1002 H= 250:30 +CPU= 58.636
  22:29:10 STEP 1003 H= 250:45 +CPU= 59.309
  22:30:12 STEP 1004 H= 251:00 +CPU= 61.175
  22:31:11 STEP 1005 H= 251:15 +CPU= 59.376
  22:32:11 STEP 1006 H= 251:30 +CPU= 59.804
  22:33:11 STEP 1007 H= 251:45 +CPU= 59.753
  22:34:33 STEP 1008 H= 252:00 +CPU= 81.824
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001008
  22:35:33 STEP 1009 H= 252:15 +CPU= 59.863
  22:36:33 STEP 1010 H= 252:30 +CPU= 59.815
  22:37:30 STEP 1011 H= 252:45 +CPU= 56.991
  22:38:32 STEP 1012 H= 253:00 +CPU= 60.884
  22:39:31 STEP 1013 H= 253:15 +CPU= 59.539
  22:40:30 STEP 1014 H= 253:30 +CPU= 59.042
  22:41:29 STEP 1015 H= 253:45 +CPU= 58.685
  22:42:31 STEP 1016 H= 254:00 +CPU= 61.444
  22:43:31 STEP 1017 H= 254:15 +CPU= 59.803
  22:44:31 STEP 1018 H= 254:30 +CPU= 59.576
  22:45:31 STEP 1019 H= 254:45 +CPU= 60.269
  22:46:44 STEP 1020 H= 255:00 +CPU= 72.762
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001020
  22:47:43 STEP 1021 H= 255:15 +CPU= 59.212
  22:48:43 STEP 1022 H= 255:30 +CPU= 59.343
  22:49:37 STEP 1023 H= 255:45 +CPU= 53.801
  22:50:30 STEP 1024 H= 256:00 +CPU= 52.972
  22:51:22 STEP 1025 H= 256:15 +CPU= 51.991
  22:52:12 STEP 1026 H= 256:30 +CPU= 50.745
  22:53:06 STEP 1027 H= 256:45 +CPU= 53.356
  22:53:59 STEP 1028 H= 257:00 +CPU= 52.910
  22:54:51 STEP 1029 H= 257:15 +CPU= 52.529
  22:55:44 STEP 1030 H= 257:30 +CPU= 52.056
  22:56:36 STEP 1031 H= 257:45 +CPU= 52.505
  22:57:44 STEP 1032 H= 258:00 +CPU= 67.274
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001032
  22:58:38 STEP 1033 H= 258:15 +CPU= 54.113
  22:59:30 STEP 1034 H= 258:30 +CPU= 51.571
  23:00:22 STEP 1035 H= 258:45 +CPU= 52.909
  23:01:17 STEP 1036 H= 259:00 +CPU= 54.566
  23:02:11 STEP 1037 H= 259:15 +CPU= 53.521
  23:03:05 STEP 1038 H= 259:30 +CPU= 54.160
  23:03:58 STEP 1039 H= 259:45 +CPU= 52.671
  23:04:51 STEP 1040 H= 260:00 +CPU= 53.505
  23:05:44 STEP 1041 H= 260:15 +CPU= 52.533
  23:06:38 STEP 1042 H= 260:30 +CPU= 53.979
  23:07:32 STEP 1043 H= 260:45 +CPU= 53.868
  23:08:39 STEP 1044 H= 261:00 +CPU= 66.956
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001044
  23:09:32 STEP 1045 H= 261:15 +CPU= 52.759
  23:10:24 STEP 1046 H= 261:30 +CPU= 51.575
  23:11:14 STEP 1047 H= 261:45 +CPU= 50.582
  23:12:06 STEP 1048 H= 262:00 +CPU= 51.624
  23:12:59 STEP 1049 H= 262:15 +CPU= 52.351
  23:13:52 STEP 1050 H= 262:30 +CPU= 52.431
  23:14:44 STEP 1051 H= 262:45 +CPU= 52.115
  23:15:36 STEP 1052 H= 263:00 +CPU= 52.758
  23:16:28 STEP 1053 H= 263:15 +CPU= 51.284
  23:17:20 STEP 1054 H= 263:30 +CPU= 51.892
  23:18:12 STEP 1055 H= 263:45 +CPU= 51.915
  23:19:24 STEP 1056 H= 264:00 +CPU= 71.929
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1s1_2016092300_20_1017_12284132_1_r696937581_10.zip
Uploading the intermediate file: upload_file_10.zip
  23:20:16 STEP 1057 H= 264:15 +CPU= 51.782
  23:21:09 STEP 1058 H= 264:30 +CPU= 52.665
  23:22:00 STEP 1059 H= 264:45 +CPU= 51.328
  23:22:54 STEP 1060 H= 265:00 +CPU= 53.805
  23:23:47 STEP 1061 H= 265:15 +CPU= 52.212
  23:24:39 STEP 1062 H= 265:30 +CPU= 52.162
  23:25:31 STEP 1063 H= 265:45 +CPU= 52.029
  23:26:23 STEP 1064 H= 266:00 +CPU= 51.673
  23:27:17 STEP 1065 H= 266:15 +CPU= 53.928
  23:28:11 STEP 1066 H= 266:30 +CPU= 53.569
  23:29:04 STEP 1067 H= 266:45 +CPU= 53.646
  23:30:10 STEP 1068 H= 267:00 +CPU= 65.393
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001068
  23:31:04 STEP 1069 H= 267:15 +CPU= 53.974
  23:31:56 STEP 1070 H= 267:30 +CPU= 52.491
  23:32:52 STEP 1071 H= 267:45 +CPU= 54.920
  23:33:47 STEP 1072 H= 268:00 +CPU= 55.022
  23:34:40 STEP 1073 H= 268:15 +CPU= 53.370
  23:35:33 STEP 1074 H= 268:30 +CPU= 52.586
  23:36:25 STEP 1075 H= 268:45 +CPU= 52.024
  23:37:18 STEP 1076 H= 269:00 +CPU= 52.761
  23:38:10 STEP 1077 H= 269:15 +CPU= 52.478
  23:39:04 STEP 1078 H= 269:30 +CPU= 53.314
  23:40:05 STEP 1079 H= 269:45 +CPU= 59.072
  23:41:19 STEP 1080 H= 270:00 +CPU= 73.593
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001080
  23:42:19 STEP 1081 H= 270:15 +CPU= 58.958
  23:43:18 STEP 1082 H= 270:30 +CPU= 59.207
  23:44:19 STEP 1083 H= 270:45 +CPU= 59.742
  23:45:20 STEP 1084 H= 271:00 +CPU= 60.764
  23:46:19 STEP 1085 H= 271:15 +CPU= 59.325
  23:47:19 STEP 1086 H= 271:30 +CPU= 59.297
  23:48:19 STEP 1087 H= 271:45 +CPU= 59.069
  23:49:20 STEP 1088 H= 272:00 +CPU= 60.281
  23:50:20 STEP 1089 H= 272:15 +CPU= 59.329
  23:51:23 STEP 1090 H= 272:30 +CPU= 59.548
  23:52:22 STEP 1091 H= 272:45 +CPU= 58.731
  23:53:37 STEP 1092 H= 273:00 +CPU= 74.334
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001092
  23:54:35 STEP 1093 H= 273:15 +CPU= 58.105
  23:55:34 STEP 1094 H= 273:30 +CPU= 59.294
  23:56:34 STEP 1095 H= 273:45 +CPU= 59.426
  23:57:34 STEP 1096 H= 274:00 +CPU= 60.188
  23:58:33 STEP 1097 H= 274:15 +CPU= 58.720
  23:59:33 STEP 1098 H= 274:30 +CPU= 59.652
  00:00:32 STEP 1099 H= 274:45 +CPU= 58.830
  00:01:32 STEP 1100 H= 275:00 +CPU= 60.012
  00:02:31 STEP 1101 H= 275:15 +CPU= 58.231
  00:03:30 STEP 1102 H= 275:30 +CPU= 59.567
  00:04:30 STEP 1103 H= 275:45 +CPU= 59.224
  00:05:52 STEP 1104 H= 276:00 +CPU= 81.675
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001104
  00:06:51 STEP 1105 H= 276:15 +CPU= 59.495
  00:07:52 STEP 1106 H= 276:30 +CPU= 60.080
  00:08:54 STEP 1107 H= 276:45 +CPU= 62.144
  00:09:58 STEP 1108 H= 277:00 +CPU= 63.982
  00:11:00 STEP 1109 H= 277:15 +CPU= 62.014
  00:11:57 STEP 1110 H= 277:30 +CPU= 57.184
  00:12:52 STEP 1111 H= 277:45 +CPU= 54.060
  00:13:48 STEP 1112 H= 278:00 +CPU= 55.883
  00:14:42 STEP 1113 H= 278:15 +CPU= 54.034
  00:15:36 STEP 1114 H= 278:30 +CPU= 53.653
  00:16:30 STEP 1115 H= 278:45 +CPU= 54.259
  00:17:37 STEP 1116 H= 279:00 +CPU= 66.752
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001116
  00:18:32 STEP 1117 H= 279:15 +CPU= 54.839
  00:19:28 STEP 1118 H= 279:30 +CPU= 55.767
  00:20:23 STEP 1119 H= 279:45 +CPU= 55.757
  00:21:19 STEP 1120 H= 280:00 +CPU= 55.693
  00:22:15 STEP 1121 H= 280:15 +CPU= 56.093
  00:23:12 STEP 1122 H= 280:30 +CPU= 56.831
  00:24:05 STEP 1123 H= 280:45 +CPU= 52.987
  00:25:01 STEP 1124 H= 281:00 +CPU= 55.598
  00:25:55 STEP 1125 H= 281:15 +CPU= 54.148
  00:26:48 STEP 1126 H= 281:30 +CPU= 52.791
  00:27:42 STEP 1127 H= 281:45 +CPU= 53.567
  00:28:50 STEP 1128 H= 282:00 +CPU= 68.003
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001128
  00:29:44 STEP 1129 H= 282:15 +CPU= 53.994
  00:30:37 STEP 1130 H= 282:30 +CPU= 53.321
  00:31:33 STEP 1131 H= 282:45 +CPU= 55.689
  00:32:31 STEP 1132 H= 283:00 +CPU= 58.246
  00:33:28 STEP 1133 H= 283:15 +CPU= 56.099
  00:34:23 STEP 1134 H= 283:30 +CPU= 55.650
  00:35:19 STEP 1135 H= 283:45 +CPU= 56.080
  00:36:15 STEP 1136 H= 284:00 +CPU= 55.854
  00:37:11 STEP 1137 H= 284:15 +CPU= 55.561
  00:38:08 STEP 1138 H= 284:30 +CPU= 56.288
  00:39:02 STEP 1139 H= 284:45 +CPU= 53.965
  00:40:09 STEP 1140 H= 285:00 +CPU= 67.559
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001140
  00:41:06 STEP 1141 H= 285:15 +CPU= 56.107
  00:42:00 STEP 1142 H= 285:30 +CPU= 54.280
  00:42:56 STEP 1143 H= 285:45 +CPU= 56.184
  00:43:54 STEP 1144 H= 286:00 +CPU= 57.556
  00:44:49 STEP 1145 H= 286:15 +CPU= 55.056
  00:45:44 STEP 1146 H= 286:30 +CPU= 54.529
  00:46:38 STEP 1147 H= 286:45 +CPU= 53.945
  00:47:33 STEP 1148 H= 287:00 +CPU= 55.203
  00:48:27 STEP 1149 H= 287:15 +CPU= 54.509
  00:49:21 STEP 1150 H= 287:30 +CPU= 53.222
  00:50:17 STEP 1151 H= 287:45 +CPU= 56.421
  00:51:34 STEP 1152 H= 288:00 +CPU= 76.319
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1s1_2016092300_20_1017_12284132_1_r696937581_11.zip
Uploading the intermediate file: upload_file_11.zip
  00:52:30 STEP 1153 H= 288:15 +CPU= 55.960
  00:53:23 STEP 1154 H= 288:30 +CPU= 53.554
  00:54:17 STEP 1155 H= 288:45 +CPU= 53.106
  00:55:10 STEP 1156 H= 289:00 +CPU= 53.164
  00:56:05 STEP 1157 H= 289:15 +CPU= 54.740
  00:57:01 STEP 1158 H= 289:30 +CPU= 56.650
  00:58:04 STEP 1159 H= 289:45 +CPU= 62.666
  00:59:06 STEP 1160 H= 290:00 +CPU= 61.982
  01:00:07 STEP 1161 H= 290:15 +CPU= 60.669
  01:01:07 STEP 1162 H= 290:30 +CPU= 60.154
  01:02:09 STEP 1163 H= 290:45 +CPU= 61.150
  01:03:25 STEP 1164 H= 291:00 +CPU= 75.846
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001164
  01:04:25 STEP 1165 H= 291:15 +CPU= 60.520
  01:05:26 STEP 1166 H= 291:30 +CPU= 60.693
  01:06:27 STEP 1167 H= 291:45 +CPU= 61.054
  01:07:30 STEP 1168 H= 292:00 +CPU= 62.446
  01:08:31 STEP 1169 H= 292:15 +CPU= 61.313
  01:09:33 STEP 1170 H= 292:30 +CPU= 61.493
  01:10:35 STEP 1171 H= 292:45 +CPU= 61.994
  01:11:37 STEP 1172 H= 293:00 +CPU= 61.960
  01:12:38 STEP 1173 H= 293:15 +CPU= 61.163
  01:13:40 STEP 1174 H= 293:30 +CPU= 61.198
  01:14:40 STEP 1175 H= 293:45 +CPU= 60.528
  01:15:57 STEP 1176 H= 294:00 +CPU= 76.264
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001176
  01:16:58 STEP 1177 H= 294:15 +CPU= 61.127
  01:18:00 STEP 1178 H= 294:30 +CPU= 61.648
  01:19:01 STEP 1179 H= 294:45 +CPU= 61.468
  01:20:04 STEP 1180 H= 295:00 +CPU= 62.632
  01:21:06 STEP 1181 H= 295:15 +CPU= 61.896
  01:22:08 STEP 1182 H= 295:30 +CPU= 62.470
  01:23:10 STEP 1183 H= 295:45 +CPU= 61.251
  01:24:13 STEP 1184 H= 296:00 +CPU= 62.804
  01:25:15 STEP 1185 H= 296:15 +CPU= 62.152
  01:26:17 STEP 1186 H= 296:30 +CPU= 61.636
  01:27:18 STEP 1187 H= 296:45 +CPU= 61.701
  01:28:35 STEP 1188 H= 297:00 +CPU= 76.698
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001188
  01:29:37 STEP 1189 H= 297:15 +CPU= 61.821
  01:30:38 STEP 1190 H= 297:30 +CPU= 60.902
  01:31:40 STEP 1191 H= 297:45 +CPU= 61.301
  01:32:42 STEP 1192 H= 298:00 +CPU= 62.472
  01:33:44 STEP 1193 H= 298:15 +CPU= 61.732
  01:34:46 STEP 1194 H= 298:30 +CPU= 61.584
  01:35:47 STEP 1195 H= 298:45 +CPU= 60.927
  01:36:51 STEP 1196 H= 299:00 +CPU= 64.022
  01:37:53 STEP 1197 H= 299:15 +CPU= 61.551
  01:38:54 STEP 1198 H= 299:30 +CPU= 61.068
  01:39:56 STEP 1199 H= 299:45 +CPU= 61.729
  01:41:19 STEP 1200 H= 300:00 +CPU= 82.731
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001200
  01:42:20 STEP 1201 H= 300:15 +CPU= 60.934
  01:43:22 STEP 1202 H= 300:30 +CPU= 61.672
  01:44:24 STEP 1203 H= 300:45 +CPU= 61.831
  01:45:28 STEP 1204 H= 301:00 +CPU= 63.344
  01:46:30 STEP 1205 H= 301:15 +CPU= 62.363
  01:47:31 STEP 1206 H= 301:30 +CPU= 61.219
  01:48:32 STEP 1207 H= 301:45 +CPU= 60.048
  01:49:29 STEP 1208 H= 302:00 +CPU= 56.651
  01:50:24 STEP 1209 H= 302:15 +CPU= 55.343
  01:51:22 STEP 1210 H= 302:30 +CPU= 57.977
  01:52:19 STEP 1211 H= 302:45 +CPU= 56.927
  01:53:35 STEP 1212 H= 303:00 +CPU= 76.051
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001212
  01:54:36 STEP 1213 H= 303:15 +CPU= 60.879
  01:55:37 STEP 1214 H= 303:30 +CPU= 61.001
  01:56:39 STEP 1215 H= 303:45 +CPU= 61.480
  01:57:42 STEP 1216 H= 304:00 +CPU= 62.591
  01:58:42 STEP 1217 H= 304:15 +CPU= 60.542
  01:59:43 STEP 1218 H= 304:30 +CPU= 60.720
  02:00:45 STEP 1219 H= 304:45 +CPU= 61.720
  02:01:48 STEP 1220 H= 305:00 +CPU= 62.960
  02:02:50 STEP 1221 H= 305:15 +CPU= 61.494
  02:03:52 STEP 1222 H= 305:30 +CPU= 61.842
  02:04:53 STEP 1223 H= 305:45 +CPU= 61.190
  02:06:09 STEP 1224 H= 306:00 +CPU= 75.784
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001224
  02:07:10 STEP 1225 H= 306:15 +CPU= 60.990
  02:08:12 STEP 1226 H= 306:30 +CPU= 61.494
  02:09:14 STEP 1227 H= 306:45 +CPU= 61.923
  02:10:17 STEP 1228 H= 307:00 +CPU= 63.050
  02:11:12 STEP 1229 H= 307:15 +CPU= 55.157
  02:12:05 STEP 1230 H= 307:30 +CPU= 53.229
  02:12:58 STEP 1231 H= 307:45 +CPU= 52.430
  02:13:51 STEP 1232 H= 308:00 +CPU= 52.920
  02:14:43 STEP 1233 H= 308:15 +CPU= 52.288
  02:15:37 STEP 1234 H= 308:30 +CPU= 53.998
  02:16:32 STEP 1235 H= 308:45 +CPU= 54.304
  02:17:39 STEP 1236 H= 309:00 +CPU= 66.748
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001236
  02:18:34 STEP 1237 H= 309:15 +CPU= 54.806
  02:19:29 STEP 1238 H= 309:30 +CPU= 55.740
  02:20:25 STEP 1239 H= 309:45 +CPU= 55.268
  02:21:22 STEP 1240 H= 310:00 +CPU= 57.309
  02:22:20 STEP 1241 H= 310:15 +CPU= 57.692
  02:23:15 STEP 1242 H= 310:30 +CPU= 55.453
  02:24:10 STEP 1243 H= 310:45 +CPU= 54.362
  02:25:03 STEP 1244 H= 311:00 +CPU= 53.389
  02:25:59 STEP 1245 H= 311:15 +CPU= 55.714
  02:26:56 STEP 1246 H= 311:30 +CPU= 56.661
  02:27:51 STEP 1247 H= 311:45 +CPU= 55.217
  02:29:08 STEP 1248 H= 312:00 +CPU= 76.484
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1s1_2016092300_20_1017_12284132_1_r696937581_12.zip
Uploading the intermediate file: upload_file_12.zip
  02:30:04 STEP 1249 H= 312:15 +CPU= 54.700
  02:30:58 STEP 1250 H= 312:30 +CPU= 54.827
  02:31:53 STEP 1251 H= 312:45 +CPU= 54.906
  02:32:51 STEP 1252 H= 313:00 +CPU= 57.549
  02:33:47 STEP 1253 H= 313:15 +CPU= 55.881
  02:34:42 STEP 1254 H= 313:30 +CPU= 55.209
  02:35:37 STEP 1255 H= 313:45 +CPU= 54.487
  02:36:33 STEP 1256 H= 314:00 +CPU= 56.163
  02:37:28 STEP 1257 H= 314:15 +CPU= 55.247
  02:38:23 STEP 1258 H= 314:30 +CPU= 54.991
  02:39:20 STEP 1259 H= 314:45 +CPU= 56.262
  02:40:30 STEP 1260 H= 315:00 +CPU= 69.734
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001260
  02:41:25 STEP 1261 H= 315:15 +CPU= 55.585
  02:42:22 STEP 1262 H= 315:30 +CPU= 56.072
  02:43:18 STEP 1263 H= 315:45 +CPU= 55.760
  02:44:14 STEP 1264 H= 316:00 +CPU= 56.027
  02:45:09 STEP 1265 H= 316:15 +CPU= 55.296
  02:46:05 STEP 1266 H= 316:30 +CPU= 55.383
  02:47:01 STEP 1267 H= 316:45 +CPU= 55.973
  02:47:57 STEP 1268 H= 317:00 +CPU= 56.490
  02:48:52 STEP 1269 H= 317:15 +CPU= 54.959
  02:49:48 STEP 1270 H= 317:30 +CPU= 55.741
  02:50:44 STEP 1271 H= 317:45 +CPU= 55.769
  02:51:53 STEP 1272 H= 318:00 +CPU= 69.094
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001272
  02:52:49 STEP 1273 H= 318:15 +CPU= 56.434
  02:53:43 STEP 1274 H= 318:30 +CPU= 53.302
  02:54:37 STEP 1275 H= 318:45 +CPU= 53.754
  02:55:32 STEP 1276 H= 319:00 +CPU= 55.241
  02:56:26 STEP 1277 H= 319:15 +CPU= 54.372
  02:57:20 STEP 1278 H= 319:30 +CPU= 53.149
  02:58:11 STEP 1279 H= 319:45 +CPU= 51.864
  02:59:07 STEP 1280 H= 320:00 +CPU= 55.029
  03:00:03 STEP 1281 H= 320:15 +CPU= 56.120
  03:00:59 STEP 1282 H= 320:30 +CPU= 56.014
  03:01:55 STEP 1283 H= 320:45 +CPU= 55.680
  03:03:05 STEP 1284 H= 321:00 +CPU= 69.464
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001284
  03:04:01 STEP 1285 H= 321:15 +CPU= 56.559
  03:04:57 STEP 1286 H= 321:30 +CPU= 55.258
  03:05:51 STEP 1287 H= 321:45 +CPU= 54.552
  03:06:47 STEP 1288 H= 322:00 +CPU= 56.095
  03:07:43 STEP 1289 H= 322:15 +CPU= 54.856
  03:08:38 STEP 1290 H= 322:30 +CPU= 55.211
  03:09:33 STEP 1291 H= 322:45 +CPU= 55.168
  03:10:29 STEP 1292 H= 323:00 +CPU= 55.690
  03:11:22 STEP 1293 H= 323:15 +CPU= 52.676
  03:12:16 STEP 1294 H= 323:30 +CPU= 54.007
  03:13:12 STEP 1295 H= 323:45 +CPU= 55.991
  03:14:27 STEP 1296 H= 324:00 +CPU= 74.265
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001296
  03:15:20 STEP 1297 H= 324:15 +CPU= 52.839
  03:16:16 STEP 1298 H= 324:30 +CPU= 55.566
  03:17:11 STEP 1299 H= 324:45 +CPU= 55.094
  03:18:07 STEP 1300 H= 325:00 +CPU= 55.921
  03:19:03 STEP 1301 H= 325:15 +CPU= 55.476
  03:19:58 STEP 1302 H= 325:30 +CPU= 54.771
  03:20:54 STEP 1303 H= 325:45 +CPU= 55.296
  03:21:50 STEP 1304 H= 326:00 +CPU= 56.377
  03:22:46 STEP 1305 H= 326:15 +CPU= 55.546
  03:23:41 STEP 1306 H= 326:30 +CPU= 54.789
  03:24:36 STEP 1307 H= 326:45 +CPU= 54.911
  03:25:44 STEP 1308 H= 327:00 +CPU= 68.182
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001308
  03:26:40 STEP 1309 H= 327:15 +CPU= 55.482
  03:27:34 STEP 1310 H= 327:30 +CPU= 54.816
  03:28:30 STEP 1311 H= 327:45 +CPU= 55.145
  03:29:27 STEP 1312 H= 328:00 +CPU= 56.941
  03:30:22 STEP 1313 H= 328:15 +CPU= 54.960
  03:31:16 STEP 1314 H= 328:30 +CPU= 53.659
  03:32:11 STEP 1315 H= 328:45 +CPU= 55.529
  03:33:07 STEP 1316 H= 329:00 +CPU= 55.664
  03:34:02 STEP 1317 H= 329:15 +CPU= 54.939
  03:34:57 STEP 1318 H= 329:30 +CPU= 54.622
  03:35:50 STEP 1319 H= 329:45 +CPU= 53.310
  03:36:57 STEP 1320 H= 330:00 +CPU= 67.196
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001320
  03:37:47 STEP 1321 H= 330:15 +CPU= 49.765
  03:38:41 STEP 1322 H= 330:30 +CPU= 53.214
  03:39:38 STEP 1323 H= 330:45 +CPU= 56.854
  03:40:33 STEP 1324 H= 331:00 +CPU= 55.331
  03:41:28 STEP 1325 H= 331:15 +CPU= 55.223
  03:42:24 STEP 1326 H= 331:30 +CPU= 55.440
  03:43:20 STEP 1327 H= 331:45 +CPU= 55.658
  03:44:14 STEP 1328 H= 332:00 +CPU= 54.600
  03:45:09 STEP 1329 H= 332:15 +CPU= 54.065
  03:46:02 STEP 1330 H= 332:30 +CPU= 53.410
  03:46:56 STEP 1331 H= 332:45 +CPU= 54.004
  03:48:05 STEP 1332 H= 333:00 +CPU= 68.173
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001332
  03:49:00 STEP 1333 H= 333:15 +CPU= 55.413
  03:49:54 STEP 1334 H= 333:30 +CPU= 54.293
  03:50:48 STEP 1335 H= 333:45 +CPU= 53.588
  03:51:43 STEP 1336 H= 334:00 +CPU= 54.704
  03:52:40 STEP 1337 H= 334:15 +CPU= 56.852
  03:53:35 STEP 1338 H= 334:30 +CPU= 54.998
  03:54:31 STEP 1339 H= 334:45 +CPU= 56.063
  03:55:27 STEP 1340 H= 335:00 +CPU= 56.335
  03:56:22 STEP 1341 H= 335:15 +CPU= 54.702
  03:57:15 STEP 1342 H= 335:30 +CPU= 53.320
  03:58:09 STEP 1343 H= 335:45 +CPU= 53.786
  03:59:23 STEP 1344 H= 336:00 +CPU= 73.384
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1s1_2016092300_20_1017_12284132_1_r696937581_13.zip
Uploading the intermediate file: upload_file_13.zip
  04:00:16 STEP 1345 H= 336:15 +CPU= 52.871
  04:01:10 STEP 1346 H= 336:30 +CPU= 53.447
  04:02:04 STEP 1347 H= 336:45 +CPU= 53.864
  04:03:02 STEP 1348 H= 337:00 +CPU= 58.706
  04:04:05 STEP 1349 H= 337:15 +CPU= 62.100
  04:05:06 STEP 1350 H= 337:30 +CPU= 61.036
  04:06:08 STEP 1351 H= 337:45 +CPU= 62.421
  04:07:10 STEP 1352 H= 338:00 +CPU= 62.157
  04:08:12 STEP 1353 H= 338:15 +CPU= 61.539
  04:09:14 STEP 1354 H= 338:30 +CPU= 61.701
  04:10:16 STEP 1355 H= 338:45 +CPU= 61.596
  04:11:32 STEP 1356 H= 339:00 +CPU= 75.872
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001356
  04:12:33 STEP 1357 H= 339:15 +CPU= 61.030
  04:13:34 STEP 1358 H= 339:30 +CPU= 60.710
  04:14:35 STEP 1359 H= 339:45 +CPU= 61.371
  04:15:37 STEP 1360 H= 340:00 +CPU= 62.092
  04:16:39 STEP 1361 H= 340:15 +CPU= 61.844
  04:17:42 STEP 1362 H= 340:30 +CPU= 62.253
  04:18:44 STEP 1363 H= 340:45 +CPU= 61.766
  04:19:47 STEP 1364 H= 341:00 +CPU= 63.289
  04:20:48 STEP 1365 H= 341:15 +CPU= 61.466
  04:21:50 STEP 1366 H= 341:30 +CPU= 61.391
  04:22:51 STEP 1367 H= 341:45 +CPU= 61.225
  04:24:08 STEP 1368 H= 342:00 +CPU= 76.694
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001368
  04:25:10 STEP 1369 H= 342:15 +CPU= 62.116
  04:26:12 STEP 1370 H= 342:30 +CPU= 61.944
  04:27:14 STEP 1371 H= 342:45 +CPU= 61.171
  04:28:16 STEP 1372 H= 343:00 +CPU= 62.702
  04:29:18 STEP 1373 H= 343:15 +CPU= 61.894
  04:30:21 STEP 1374 H= 343:30 +CPU= 62.333
  04:31:21 STEP 1375 H= 343:45 +CPU= 60.153
  04:32:17 STEP 1376 H= 344:00 +CPU= 55.947
  04:33:12 STEP 1377 H= 344:15 +CPU= 54.950
  04:34:06 STEP 1378 H= 344:30 +CPU= 53.464
  04:34:59 STEP 1379 H= 344:45 +CPU= 53.029
  04:36:08 STEP 1380 H= 345:00 +CPU= 68.537
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001380
  04:37:03 STEP 1381 H= 345:15 +CPU= 55.546
  04:37:59 STEP 1382 H= 345:30 +CPU= 55.379
  04:38:54 STEP 1383 H= 345:45 +CPU= 55.311
  04:39:50 STEP 1384 H= 346:00 +CPU= 55.898
  04:40:45 STEP 1385 H= 346:15 +CPU= 54.578
  04:41:41 STEP 1386 H= 346:30 +CPU= 55.914
  04:42:36 STEP 1387 H= 346:45 +CPU= 55.229
  04:43:32 STEP 1388 H= 347:00 +CPU= 55.091
  04:44:27 STEP 1389 H= 347:15 +CPU= 55.015
  04:45:23 STEP 1390 H= 347:30 +CPU= 55.956
  04:46:18 STEP 1391 H= 347:45 +CPU= 55.013
  04:47:49 STEP 1392 H= 348:00 +CPU= 75.946
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001392
  04:48:46 STEP 1393 H= 348:15 +CPU= 56.403
  04:49:40 STEP 1394 H= 348:30 +CPU= 54.576
  04:50:35 STEP 1395 H= 348:45 +CPU= 54.632
  04:51:32 STEP 1396 H= 349:00 +CPU= 56.772
  04:52:27 STEP 1397 H= 349:15 +CPU= 55.465
  04:53:23 STEP 1398 H= 349:30 +CPU= 55.312
  04:54:19 STEP 1399 H= 349:45 +CPU= 56.375
  04:55:17 STEP 1400 H= 350:00 +CPU= 57.460
  04:56:13 STEP 1401 H= 350:15 +CPU= 56.100
  04:57:10 STEP 1402 H= 350:30 +CPU= 56.955
  04:58:06 STEP 1403 H= 350:45 +CPU= 55.795
  04:59:14 STEP 1404 H= 351:00 +CPU= 67.882
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001404
  05:00:10 STEP 1405 H= 351:15 +CPU= 56.319
  05:01:07 STEP 1406 H= 351:30 +CPU= 55.926
  05:02:03 STEP 1407 H= 351:45 +CPU= 55.762
  05:03:01 STEP 1408 H= 352:00 +CPU= 56.941
  05:03:57 STEP 1409 H= 352:15 +CPU= 55.582
  05:04:52 STEP 1410 H= 352:30 +CPU= 54.629
  05:05:49 STEP 1411 H= 352:45 +CPU= 56.859
  05:06:47 STEP 1412 H= 353:00 +CPU= 58.250
  05:07:50 STEP 1413 H= 353:15 +CPU= 62.353
  05:08:52 STEP 1414 H= 353:30 +CPU= 61.238
  05:09:54 STEP 1415 H= 353:45 +CPU= 61.370
  05:11:09 STEP 1416 H= 354:00 +CPU= 74.787
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001416
  05:12:10 STEP 1417 H= 354:15 +CPU= 60.949
  05:13:12 STEP 1418 H= 354:30 +CPU= 61.629
  05:14:13 STEP 1419 H= 354:45 +CPU= 60.838
  05:15:17 STEP 1420 H= 355:00 +CPU= 63.016
  05:16:18 STEP 1421 H= 355:15 +CPU= 61.319
  05:17:21 STEP 1422 H= 355:30 +CPU= 62.001
  05:18:25 STEP 1423 H= 355:45 +CPU= 62.018
  05:19:29 STEP 1424 H= 356:00 +CPU= 63.009
  05:20:32 STEP 1425 H= 356:15 +CPU= 62.859
  05:21:33 STEP 1426 H= 356:30 +CPU= 61.447
  05:22:35 STEP 1427 H= 356:45 +CPU= 62.125
  05:23:52 STEP 1428 H= 357:00 +CPU= 76.506
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001428
  05:24:53 STEP 1429 H= 357:15 +CPU= 61.149
  05:25:56 STEP 1430 H= 357:30 +CPU= 61.939
  05:26:58 STEP 1431 H= 357:45 +CPU= 61.809
  05:28:02 STEP 1432 H= 358:00 +CPU= 63.371
  05:29:04 STEP 1433 H= 358:15 +CPU= 61.295
  05:30:05 STEP 1434 H= 358:30 +CPU= 61.590
  05:31:07 STEP 1435 H= 358:45 +CPU= 61.102
  05:32:09 STEP 1436 H= 359:00 +CPU= 62.137
  05:33:12 STEP 1437 H= 359:15 +CPU= 62.885
  05:34:16 STEP 1438 H= 359:30 +CPU= 61.344
  05:35:17 STEP 1439 H= 359:45 +CPU= 60.830
  05:36:36 STEP 1440 H= 360:00 +CPU= 78.374
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.1633168090E-20      I       0.2228941917E-06      I
ICloud fractionI      0.0000000000E+00      I       0.3115907742E-02      I
I  Relat. Hum. I      0.2218977352E+00      I       0.2542714139E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.6038809614E+02      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    315510132 BYTES IN      7 RECORDS TRANSFERRED IN    0.0010 SECONDS315510.1 Mbytes/s, TOTAL TIME=    0.0209( 4.8%)
 05:36:36 STEP 1440 H= 360:00 +CPU= 78.374
 END CNT3
 NSTEP =  1440 CNT0   000000000  58.234  58.234  58.511   0.995               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        43246/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    43246 ************   161.5     0.0   161.5     0.0   309.0
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 *********       0.0    100.00   -100.00
   1 CNT4     - FORWARD INTEGRATION                  1 *********       0.0    100.01   -100.01
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    8403.6    8403.6      0.00      0.00
   9 SPCM     - SPECTRAL COMP.                    1440    1794.6    1794.6      0.00      0.00
  10 SCAN2M - PHYSICS                             1441   29042.9   29042.9      0.00      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121    1740.1    1740.1      0.00      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      97.6      97.6      0.00      0.00
  14 SUINIF                                          1   17319.9   17319.9      0.00      0.00
  17 GRIDFPOS IN CNT4                              121      65.1      65.1      0.00      0.00
  18 SUSPECG                                         1    8608.0    8608.0      0.00      0.00
  19 SUSPEC                                          1    8622.5    8622.5      0.00      0.00
  24 SUGRIDU                                         1    7469.6    7469.6      0.00      0.00
  25 SPECRT                                          1     609.6     609.6      0.00      0.00
  26 SUGRIDF                                         1     618.2     618.2      0.00      0.00
  27 RESTART FILES - WRITING                        30    7018.0    7018.0      0.00      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               121   12695.0   12695.0      0.00      0.00
  31 POSDDH IN STEPO                                 7      42.0      42.0      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441 -136922.0       0.0    152.29   -152.29
  39 SU0YOMB                                         1     721.7     721.7      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      59.9      59.9      0.00      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     481.4     481.4      0.00      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440     104.4     104.4      0.00      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.5       0.5      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     922.5     922.5      0.00      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     553.1     553.1      0.00      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006     232.1     232.1      0.00      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     355.3     355.3      0.00      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      95.7      95.7      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125     100.7     100.7      0.00      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      53.3      53.3      0.00      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125     179.0     179.0      0.00      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006     105.6     105.6      0.00      0.00
 400 GSTATS                                     167734       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                156066       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME  -129560.2 CPU TIME   84939.9 VECTOR TIME    84939.9


===-=== END   OF TIMING STATISTICS ===-===
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/9/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/9/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12284132/ICMGGh7zg+001440
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1s1_2016092300_20_1017_12284132_1_r696937581_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
05:40:15 (14094): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a1s1_2016092300_20_1017_12284132_1_r696937581_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a1s1_2016092300_20_1017_12284132_1_r696937581_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a1s1_2016092300_20_1017_12284132_1_r696937581_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a1s1_2016092300_20_1017_12284132_1_r696937581_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a1s1_2016092300_20_1017_12284132_1_r696937581_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
10 Jun 2024 09:38:47 1498497 22440723 oifs_43r3_bl_a1s1_2016092300_20_1017_12284132_1 1,295,100 84,940 0.0656
10 Jun 2024 01:48:37 1498497 22440723 oifs_43r3_bl_a1s1_2016092300_20_1017_12284132_1 864,000 56,881 0.0658


©2024 climateprediction.net