climateprediction.net home page
Task 22438353

Task 22438353

Name oifs_43r3_bl_a3s9_2016092300_20_1017_12286732_0
Workunit 12286732
Created 7 Jun 2024, 17:56:14 UTC
Sent 7 Jun 2024, 18:00:10 UTC
Report deadline 6 Aug 2024, 18:00:10 UTC
Received 8 Jun 2024, 13:55:24 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1538900
Run time 18 hours 43 min 53 sec
CPU time 18 hours 33 min 44 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 3.83 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,025.08 MB
Peak swap size 5,980.80 MB
Peak disk usage 1,282.96 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
 208:30 +CPU= 43.072
  23:11:16 STEP  835 H= 208:45 +CPU= 47.064
  23:12:05 STEP  836 H= 209:00 +CPU= 49.358
  23:12:53 STEP  837 H= 209:15 +CPU= 48.048
  23:13:41 STEP  838 H= 209:30 +CPU= 47.300
  23:14:29 STEP  839 H= 209:45 +CPU= 48.334
  23:15:28 STEP  840 H= 210:00 +CPU= 59.295
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000840
  23:16:14 STEP  841 H= 210:15 +CPU= 45.367
  23:17:00 STEP  842 H= 210:30 +CPU= 45.726
  23:17:47 STEP  843 H= 210:45 +CPU= 47.474
  23:18:33 STEP  844 H= 211:00 +CPU= 45.938
  23:19:18 STEP  845 H= 211:15 +CPU= 45.182
  23:20:07 STEP  846 H= 211:30 +CPU= 47.855
  23:20:53 STEP  847 H= 211:45 +CPU= 46.673
  23:21:42 STEP  848 H= 212:00 +CPU= 48.710
  23:22:31 STEP  849 H= 212:15 +CPU= 48.043
  23:23:19 STEP  850 H= 212:30 +CPU= 48.271
  23:24:07 STEP  851 H= 212:45 +CPU= 48.156
  23:25:01 STEP  852 H= 213:00 +CPU= 53.849
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000852
  23:25:47 STEP  853 H= 213:15 +CPU= 46.347
  23:26:36 STEP  854 H= 213:30 +CPU= 48.617
  23:27:22 STEP  855 H= 213:45 +CPU= 45.373
  23:28:11 STEP  856 H= 214:00 +CPU= 49.118
  23:28:58 STEP  857 H= 214:15 +CPU= 47.447
  23:29:46 STEP  858 H= 214:30 +CPU= 47.798
  23:30:35 STEP  859 H= 214:45 +CPU= 48.147
  23:31:25 STEP  860 H= 215:00 +CPU= 48.762
  23:32:13 STEP  861 H= 215:15 +CPU= 47.778
  23:33:02 STEP  862 H= 215:30 +CPU= 47.967
  23:33:47 STEP  863 H= 215:45 +CPU= 44.697
  23:34:51 STEP  864 H= 216:00 +CPU= 63.645
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3s9_2016092300_20_1017_12286732_0_r1636640015_8.zip
Uploading the intermediate file: upload_file_8.zip
  23:35:41 STEP  865 H= 216:15 +CPU= 47.298
  23:36:28 STEP  866 H= 216:30 +CPU= 46.341
  23:37:16 STEP  867 H= 216:45 +CPU= 47.103
  23:38:04 STEP  868 H= 217:00 +CPU= 48.772
  23:38:52 STEP  869 H= 217:15 +CPU= 47.393
  23:39:39 STEP  870 H= 217:30 +CPU= 47.250
  23:40:26 STEP  871 H= 217:45 +CPU= 47.152
  23:41:15 STEP  872 H= 218:00 +CPU= 47.357
  23:42:03 STEP  873 H= 218:15 +CPU= 48.470
  23:42:51 STEP  874 H= 218:30 +CPU= 47.752
  23:43:37 STEP  875 H= 218:45 +CPU= 46.188
  23:44:37 STEP  876 H= 219:00 +CPU= 59.309
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000876
  23:45:24 STEP  877 H= 219:15 +CPU= 47.496
  23:46:12 STEP  878 H= 219:30 +CPU= 47.645
  23:46:56 STEP  879 H= 219:45 +CPU= 44.464
  23:47:46 STEP  880 H= 220:00 +CPU= 49.084
  23:48:32 STEP  881 H= 220:15 +CPU= 46.399
  23:49:20 STEP  882 H= 220:30 +CPU= 47.795
  23:50:08 STEP  883 H= 220:45 +CPU= 47.370
  23:50:55 STEP  884 H= 221:00 +CPU= 47.574
  23:51:43 STEP  885 H= 221:15 +CPU= 46.455
  23:52:30 STEP  886 H= 221:30 +CPU= 46.813
  23:53:18 STEP  887 H= 221:45 +CPU= 47.433
  23:54:15 STEP  888 H= 222:00 +CPU= 56.853
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000888
  23:55:02 STEP  889 H= 222:15 +CPU= 47.554
  23:55:50 STEP  890 H= 222:30 +CPU= 46.911
  23:56:38 STEP  891 H= 222:45 +CPU= 48.628
  23:57:27 STEP  892 H= 223:00 +CPU= 48.741
  23:58:15 STEP  893 H= 223:15 +CPU= 48.038
  23:59:01 STEP  894 H= 223:30 +CPU= 45.676
  23:59:47 STEP  895 H= 223:45 +CPU= 46.284
  00:00:36 STEP  896 H= 224:00 +CPU= 48.649
  00:01:22 STEP  897 H= 224:15 +CPU= 45.095
  00:02:10 STEP  898 H= 224:30 +CPU= 47.522
  00:02:55 STEP  899 H= 224:45 +CPU= 44.954
  00:03:53 STEP  900 H= 225:00 +CPU= 57.293
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000900
  00:04:40 STEP  901 H= 225:15 +CPU= 46.410
  00:05:26 STEP  902 H= 225:30 +CPU= 46.001
  00:06:13 STEP  903 H= 225:45 +CPU= 46.722
  00:07:01 STEP  904 H= 226:00 +CPU= 47.724
  00:07:49 STEP  905 H= 226:15 +CPU= 47.667
  00:08:36 STEP  906 H= 226:30 +CPU= 47.222
  00:09:24 STEP  907 H= 226:45 +CPU= 47.069
  00:10:13 STEP  908 H= 227:00 +CPU= 49.020
  00:11:01 STEP  909 H= 227:15 +CPU= 46.993
  00:11:49 STEP  910 H= 227:30 +CPU= 47.694
  00:12:36 STEP  911 H= 227:45 +CPU= 47.145
  00:13:38 STEP  912 H= 228:00 +CPU= 61.382
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000912
  00:14:27 STEP  913 H= 228:15 +CPU= 46.787
  00:15:15 STEP  914 H= 228:30 +CPU= 47.886
  00:16:03 STEP  915 H= 228:45 +CPU= 48.054
  00:16:47 STEP  916 H= 229:00 +CPU= 44.365
  00:17:35 STEP  917 H= 229:15 +CPU= 47.688
  00:18:23 STEP  918 H= 229:30 +CPU= 48.280
  00:19:09 STEP  919 H= 229:45 +CPU= 45.638
  00:19:55 STEP  920 H= 230:00 +CPU= 45.976
  00:20:44 STEP  921 H= 230:15 +CPU= 47.905
  00:21:32 STEP  922 H= 230:30 +CPU= 48.417
  00:22:20 STEP  923 H= 230:45 +CPU= 47.676
  00:23:19 STEP  924 H= 231:00 +CPU= 59.378
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000924
  00:24:07 STEP  925 H= 231:15 +CPU= 47.624
  00:24:55 STEP  926 H= 231:30 +CPU= 48.062
  00:25:43 STEP  927 H= 231:45 +CPU= 47.446
  00:26:31 STEP  928 H= 232:00 +CPU= 48.227
  00:27:19 STEP  929 H= 232:15 +CPU= 47.605
  00:28:07 STEP  930 H= 232:30 +CPU= 47.681
  00:28:52 STEP  931 H= 232:45 +CPU= 45.778
  00:29:37 STEP  932 H= 233:00 +CPU= 44.123
  00:30:24 STEP  933 H= 233:15 +CPU= 46.704
  00:31:11 STEP  934 H= 233:30 +CPU= 47.532
  00:32:00 STEP  935 H= 233:45 +CPU= 48.274
  00:32:59 STEP  936 H= 234:00 +CPU= 59.401
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000936
  00:33:47 STEP  937 H= 234:15 +CPU= 47.911
  00:34:34 STEP  938 H= 234:30 +CPU= 46.927
  00:35:24 STEP  939 H= 234:45 +CPU= 49.203
  00:36:13 STEP  940 H= 235:00 +CPU= 49.057
  00:37:01 STEP  941 H= 235:15 +CPU= 47.635
  00:37:47 STEP  942 H= 235:30 +CPU= 45.511
  00:38:36 STEP  943 H= 235:45 +CPU= 47.805
  00:39:24 STEP  944 H= 236:00 +CPU= 47.287
  00:40:11 STEP  945 H= 236:15 +CPU= 46.952
  00:40:58 STEP  946 H= 236:30 +CPU= 47.479
  00:41:46 STEP  947 H= 236:45 +CPU= 47.684
  00:42:46 STEP  948 H= 237:00 +CPU= 59.574
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000948
  00:43:34 STEP  949 H= 237:15 +CPU= 47.842
  00:44:21 STEP  950 H= 237:30 +CPU= 47.453
  00:45:10 STEP  951 H= 237:45 +CPU= 48.121
  00:45:59 STEP  952 H= 238:00 +CPU= 49.711
  00:46:49 STEP  953 H= 238:15 +CPU= 49.667
  00:47:38 STEP  954 H= 238:30 +CPU= 48.976
  00:48:28 STEP  955 H= 238:45 +CPU= 49.315
  00:49:18 STEP  956 H= 239:00 +CPU= 49.887
  00:50:07 STEP  957 H= 239:15 +CPU= 48.606
  00:50:58 STEP  958 H= 239:30 +CPU= 49.887
  00:51:48 STEP  959 H= 239:45 +CPU= 49.642
  00:52:58 STEP  960 H= 240:00 +CPU= 69.274
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3s9_2016092300_20_1017_12286732_0_r1636640015_9.zip
Uploading the intermediate file: upload_file_9.zip
Uploading trickle at timestep: 864000
  00:53:50 STEP  961 H= 240:15 +CPU= 49.270
  00:54:40 STEP  962 H= 240:30 +CPU= 50.531
  00:55:31 STEP  963 H= 240:45 +CPU= 50.339
  00:56:21 STEP  964 H= 241:00 +CPU= 50.581
  00:57:12 STEP  965 H= 241:15 +CPU= 49.996
  00:58:02 STEP  966 H= 241:30 +CPU= 50.451
  00:58:52 STEP  967 H= 241:45 +CPU= 49.242
  00:59:42 STEP  968 H= 242:00 +CPU= 50.437
  01:00:33 STEP  969 H= 242:15 +CPU= 50.466
  01:01:22 STEP  970 H= 242:30 +CPU= 49.097
  01:02:12 STEP  971 H= 242:45 +CPU= 49.685
  01:03:14 STEP  972 H= 243:00 +CPU= 61.765
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000972
  01:04:03 STEP  973 H= 243:15 +CPU= 48.886
  01:04:53 STEP  974 H= 243:30 +CPU= 48.827
  01:05:44 STEP  975 H= 243:45 +CPU= 49.919
  01:06:35 STEP  976 H= 244:00 +CPU= 50.590
  01:07:24 STEP  977 H= 244:15 +CPU= 48.873
  01:08:14 STEP  978 H= 244:30 +CPU= 49.526
  01:09:04 STEP  979 H= 244:45 +CPU= 49.982
  01:09:55 STEP  980 H= 245:00 +CPU= 51.050
  01:10:45 STEP  981 H= 245:15 +CPU= 49.185
  01:11:35 STEP  982 H= 245:30 +CPU= 50.435
  01:12:26 STEP  983 H= 245:45 +CPU= 49.782
  01:13:29 STEP  984 H= 246:00 +CPU= 62.410
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000984
  01:14:19 STEP  985 H= 246:15 +CPU= 49.602
  01:15:09 STEP  986 H= 246:30 +CPU= 50.094
  01:15:58 STEP  987 H= 246:45 +CPU= 49.252
  01:16:48 STEP  988 H= 247:00 +CPU= 50.336
  01:17:38 STEP  989 H= 247:15 +CPU= 49.714
  01:18:28 STEP  990 H= 247:30 +CPU= 49.136
  01:19:17 STEP  991 H= 247:45 +CPU= 49.684
  01:20:08 STEP  992 H= 248:00 +CPU= 50.813
  01:20:59 STEP  993 H= 248:15 +CPU= 50.568
  01:21:49 STEP  994 H= 248:30 +CPU= 49.245
  01:22:40 STEP  995 H= 248:45 +CPU= 50.454
  01:23:43 STEP  996 H= 249:00 +CPU= 63.406
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000996
  01:24:33 STEP  997 H= 249:15 +CPU= 49.184
  01:25:22 STEP  998 H= 249:30 +CPU= 49.022
  01:26:13 STEP  999 H= 249:45 +CPU= 50.598
  01:27:05 STEP 1000 H= 250:00 +CPU= 51.518
  01:27:56 STEP 1001 H= 250:15 +CPU= 49.364
  01:28:46 STEP 1002 H= 250:30 +CPU= 50.147
  01:29:36 STEP 1003 H= 250:45 +CPU= 50.146
  01:30:27 STEP 1004 H= 251:00 +CPU= 50.284
  01:31:16 STEP 1005 H= 251:15 +CPU= 49.274
  01:32:07 STEP 1006 H= 251:30 +CPU= 49.610
  01:32:57 STEP 1007 H= 251:45 +CPU= 49.765
  01:34:04 STEP 1008 H= 252:00 +CPU= 65.815
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001008
  01:34:55 STEP 1009 H= 252:15 +CPU= 49.817
  01:35:46 STEP 1010 H= 252:30 +CPU= 50.215
  01:36:35 STEP 1011 H= 252:45 +CPU= 49.101
  01:37:26 STEP 1012 H= 253:00 +CPU= 50.814
  01:38:17 STEP 1013 H= 253:15 +CPU= 50.626
  01:39:06 STEP 1014 H= 253:30 +CPU= 48.880
  01:39:56 STEP 1015 H= 253:45 +CPU= 50.143
  01:40:48 STEP 1016 H= 254:00 +CPU= 51.631
  01:41:39 STEP 1017 H= 254:15 +CPU= 50.666
  01:42:29 STEP 1018 H= 254:30 +CPU= 50.031
  01:43:20 STEP 1019 H= 254:45 +CPU= 50.609
  01:44:23 STEP 1020 H= 255:00 +CPU= 62.620
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001020
  01:45:13 STEP 1021 H= 255:15 +CPU= 50.447
  01:46:03 STEP 1022 H= 255:30 +CPU= 49.837
  01:46:52 STEP 1023 H= 255:45 +CPU= 48.977
  01:47:44 STEP 1024 H= 256:00 +CPU= 51.335
  01:48:33 STEP 1025 H= 256:15 +CPU= 48.872
  01:49:22 STEP 1026 H= 256:30 +CPU= 49.509
  01:50:13 STEP 1027 H= 256:45 +CPU= 50.580
  01:51:05 STEP 1028 H= 257:00 +CPU= 51.193
  01:51:56 STEP 1029 H= 257:15 +CPU= 50.358
  01:52:46 STEP 1030 H= 257:30 +CPU= 50.235
  01:53:36 STEP 1031 H= 257:45 +CPU= 49.388
  01:54:38 STEP 1032 H= 258:00 +CPU= 61.976
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001032
  01:55:26 STEP 1033 H= 258:15 +CPU= 48.315
  01:56:15 STEP 1034 H= 258:30 +CPU= 49.298
  01:57:04 STEP 1035 H= 258:45 +CPU= 48.183
  01:57:54 STEP 1036 H= 259:00 +CPU= 50.161
  01:58:44 STEP 1037 H= 259:15 +CPU= 50.267
  01:59:36 STEP 1038 H= 259:30 +CPU= 51.100
  02:00:28 STEP 1039 H= 259:45 +CPU= 50.946
  02:01:18 STEP 1040 H= 260:00 +CPU= 50.804
  02:02:08 STEP 1041 H= 260:15 +CPU= 49.773
  02:02:58 STEP 1042 H= 260:30 +CPU= 49.050
  02:03:47 STEP 1043 H= 260:45 +CPU= 49.639
  02:04:50 STEP 1044 H= 261:00 +CPU= 62.015
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001044
  02:05:41 STEP 1045 H= 261:15 +CPU= 50.048
  02:06:31 STEP 1046 H= 261:30 +CPU= 50.272
  02:07:21 STEP 1047 H= 261:45 +CPU= 49.931
  02:08:12 STEP 1048 H= 262:00 +CPU= 50.433
  02:09:02 STEP 1049 H= 262:15 +CPU= 50.022
  02:09:52 STEP 1050 H= 262:30 +CPU= 50.119
  02:10:43 STEP 1051 H= 262:45 +CPU= 50.127
  02:11:33 STEP 1052 H= 263:00 +CPU= 50.590
  02:12:25 STEP 1053 H= 263:15 +CPU= 50.655
  02:13:16 STEP 1054 H= 263:30 +CPU= 50.974
  02:14:07 STEP 1055 H= 263:45 +CPU= 49.839
  02:15:17 STEP 1056 H= 264:00 +CPU= 69.105
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3s9_2016092300_20_1017_12286732_0_r1636640015_10.zip
Uploading the intermediate file: upload_file_10.zip
  02:16:07 STEP 1057 H= 264:15 +CPU= 49.199
  02:16:56 STEP 1058 H= 264:30 +CPU= 48.808
  02:17:47 STEP 1059 H= 264:45 +CPU= 50.130
  02:18:38 STEP 1060 H= 265:00 +CPU= 50.515
  02:19:28 STEP 1061 H= 265:15 +CPU= 50.130
  02:20:18 STEP 1062 H= 265:30 +CPU= 50.225
  02:21:08 STEP 1063 H= 265:45 +CPU= 49.543
  02:21:59 STEP 1064 H= 266:00 +CPU= 50.844
  02:22:49 STEP 1065 H= 266:15 +CPU= 49.727
  02:23:38 STEP 1066 H= 266:30 +CPU= 49.062
  02:24:28 STEP 1067 H= 266:45 +CPU= 49.958
  02:25:31 STEP 1068 H= 267:00 +CPU= 62.322
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001068
  02:26:22 STEP 1069 H= 267:15 +CPU= 50.396
  02:27:11 STEP 1070 H= 267:30 +CPU= 49.451
  02:28:01 STEP 1071 H= 267:45 +CPU= 49.883
  02:28:53 STEP 1072 H= 268:00 +CPU= 51.574
  02:29:43 STEP 1073 H= 268:15 +CPU= 50.064
  02:30:34 STEP 1074 H= 268:30 +CPU= 50.459
  02:31:24 STEP 1075 H= 268:45 +CPU= 50.001
  02:32:16 STEP 1076 H= 269:00 +CPU= 51.893
  02:33:07 STEP 1077 H= 269:15 +CPU= 49.976
  02:33:57 STEP 1078 H= 269:30 +CPU= 50.004
  02:34:48 STEP 1079 H= 269:45 +CPU= 50.904
  02:35:52 STEP 1080 H= 270:00 +CPU= 63.308
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001080
  02:36:42 STEP 1081 H= 270:15 +CPU= 49.266
  02:37:33 STEP 1082 H= 270:30 +CPU= 50.661
  02:38:22 STEP 1083 H= 270:45 +CPU= 49.729
  02:39:14 STEP 1084 H= 271:00 +CPU= 51.218
  02:40:04 STEP 1085 H= 271:15 +CPU= 50.166
  02:40:54 STEP 1086 H= 271:30 +CPU= 50.107
  02:41:44 STEP 1087 H= 271:45 +CPU= 49.622
  02:42:36 STEP 1088 H= 272:00 +CPU= 51.498
  02:43:27 STEP 1089 H= 272:15 +CPU= 49.509
  02:44:17 STEP 1090 H= 272:30 +CPU= 50.475
  02:45:08 STEP 1091 H= 272:45 +CPU= 50.543
  02:46:11 STEP 1092 H= 273:00 +CPU= 62.028
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001092
  02:47:01 STEP 1093 H= 273:15 +CPU= 50.003
  02:47:52 STEP 1094 H= 273:30 +CPU= 51.011
  02:48:43 STEP 1095 H= 273:45 +CPU= 49.363
  02:49:33 STEP 1096 H= 274:00 +CPU= 50.087
  02:50:23 STEP 1097 H= 274:15 +CPU= 49.258
  02:51:12 STEP 1098 H= 274:30 +CPU= 49.149
  02:52:02 STEP 1099 H= 274:45 +CPU= 49.567
  02:52:54 STEP 1100 H= 275:00 +CPU= 52.055
  02:53:44 STEP 1101 H= 275:15 +CPU= 49.349
  02:54:35 STEP 1102 H= 275:30 +CPU= 50.294
  02:55:26 STEP 1103 H= 275:45 +CPU= 50.022
  02:56:34 STEP 1104 H= 276:00 +CPU= 67.263
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001104
  02:57:24 STEP 1105 H= 276:15 +CPU= 50.172
  02:58:14 STEP 1106 H= 276:30 +CPU= 49.821
  02:59:04 STEP 1107 H= 276:45 +CPU= 49.843
  02:59:55 STEP 1108 H= 277:00 +CPU= 51.714
  03:00:45 STEP 1109 H= 277:15 +CPU= 49.575
  03:01:36 STEP 1110 H= 277:30 +CPU= 50.531
  03:02:26 STEP 1111 H= 277:45 +CPU= 50.120
  03:03:17 STEP 1112 H= 278:00 +CPU= 51.144
  03:04:07 STEP 1113 H= 278:15 +CPU= 49.421
  03:04:57 STEP 1114 H= 278:30 +CPU= 49.671
  03:05:48 STEP 1115 H= 278:45 +CPU= 50.080
  03:06:51 STEP 1116 H= 279:00 +CPU= 63.232
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001116
  03:07:41 STEP 1117 H= 279:15 +CPU= 50.468
  03:08:31 STEP 1118 H= 279:30 +CPU= 49.888
  03:09:23 STEP 1119 H= 279:45 +CPU= 51.159
  03:10:14 STEP 1120 H= 280:00 +CPU= 51.559
  03:11:05 STEP 1121 H= 280:15 +CPU= 50.680
  03:11:56 STEP 1122 H= 280:30 +CPU= 51.004
  03:12:47 STEP 1123 H= 280:45 +CPU= 51.025
  03:13:39 STEP 1124 H= 281:00 +CPU= 51.463
  03:14:30 STEP 1125 H= 281:15 +CPU= 50.707
  03:15:20 STEP 1126 H= 281:30 +CPU= 50.299
  03:16:11 STEP 1127 H= 281:45 +CPU= 50.576
  03:17:15 STEP 1128 H= 282:00 +CPU= 64.085
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001128
  03:18:04 STEP 1129 H= 282:15 +CPU= 49.520
  03:18:54 STEP 1130 H= 282:30 +CPU= 49.514
  03:19:45 STEP 1131 H= 282:45 +CPU= 50.510
  03:20:37 STEP 1132 H= 283:00 +CPU= 51.418
  03:21:27 STEP 1133 H= 283:15 +CPU= 50.025
  03:22:16 STEP 1134 H= 283:30 +CPU= 49.003
  03:23:06 STEP 1135 H= 283:45 +CPU= 49.992
  03:23:58 STEP 1136 H= 284:00 +CPU= 51.150
  03:24:48 STEP 1137 H= 284:15 +CPU= 50.436
  03:25:38 STEP 1138 H= 284:30 +CPU= 50.022
  03:26:29 STEP 1139 H= 284:45 +CPU= 50.206
  03:27:33 STEP 1140 H= 285:00 +CPU= 63.652
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001140
  03:28:23 STEP 1141 H= 285:15 +CPU= 50.384
  03:29:14 STEP 1142 H= 285:30 +CPU= 50.685
  03:30:05 STEP 1143 H= 285:45 +CPU= 50.532
  03:30:55 STEP 1144 H= 286:00 +CPU= 50.641
  03:31:45 STEP 1145 H= 286:15 +CPU= 49.362
  03:32:36 STEP 1146 H= 286:30 +CPU= 50.780
  03:33:26 STEP 1147 H= 286:45 +CPU= 50.061
  03:34:18 STEP 1148 H= 287:00 +CPU= 51.619
  03:35:07 STEP 1149 H= 287:15 +CPU= 49.201
  03:35:59 STEP 1150 H= 287:30 +CPU= 50.864
  03:36:50 STEP 1151 H= 287:45 +CPU= 50.904
  03:37:59 STEP 1152 H= 288:00 +CPU= 68.408
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3s9_2016092300_20_1017_12286732_0_r1636640015_11.zip
Uploading the intermediate file: upload_file_11.zip
  03:38:50 STEP 1153 H= 288:15 +CPU= 50.551
  03:39:41 STEP 1154 H= 288:30 +CPU= 50.040
  03:40:31 STEP 1155 H= 288:45 +CPU= 49.963
  03:41:21 STEP 1156 H= 289:00 +CPU= 50.245
  03:42:12 STEP 1157 H= 289:15 +CPU= 51.000
  03:43:02 STEP 1158 H= 289:30 +CPU= 49.563
  03:43:53 STEP 1159 H= 289:45 +CPU= 50.877
  03:44:44 STEP 1160 H= 290:00 +CPU= 50.850
  03:45:34 STEP 1161 H= 290:15 +CPU= 50.432
  03:46:25 STEP 1162 H= 290:30 +CPU= 50.083
  03:47:15 STEP 1163 H= 290:45 +CPU= 50.392
  03:48:26 STEP 1164 H= 291:00 +CPU= 67.809
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001164
  03:49:20 STEP 1165 H= 291:15 +CPU= 52.520
  03:50:13 STEP 1166 H= 291:30 +CPU= 51.489
  03:51:04 STEP 1167 H= 291:45 +CPU= 49.542
  03:51:55 STEP 1168 H= 292:00 +CPU= 50.826
  03:52:45 STEP 1169 H= 292:15 +CPU= 48.765
  03:53:36 STEP 1170 H= 292:30 +CPU= 49.289
  03:54:26 STEP 1171 H= 292:45 +CPU= 50.402
  03:55:19 STEP 1172 H= 293:00 +CPU= 51.573
  03:56:10 STEP 1173 H= 293:15 +CPU= 50.454
  03:57:00 STEP 1174 H= 293:30 +CPU= 50.013
  03:57:51 STEP 1175 H= 293:45 +CPU= 50.140
  03:58:54 STEP 1176 H= 294:00 +CPU= 63.034
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001176
  03:59:44 STEP 1177 H= 294:15 +CPU= 49.942
  04:00:35 STEP 1178 H= 294:30 +CPU= 50.176
  04:01:26 STEP 1179 H= 294:45 +CPU= 50.224
  04:02:18 STEP 1180 H= 295:00 +CPU= 51.971
  04:03:08 STEP 1181 H= 295:15 +CPU= 50.116
  04:03:59 STEP 1182 H= 295:30 +CPU= 50.470
  04:04:49 STEP 1183 H= 295:45 +CPU= 50.115
  04:05:41 STEP 1184 H= 296:00 +CPU= 50.588
  04:06:30 STEP 1185 H= 296:15 +CPU= 49.380
  04:07:21 STEP 1186 H= 296:30 +CPU= 50.431
  04:08:12 STEP 1187 H= 296:45 +CPU= 49.809
  04:09:14 STEP 1188 H= 297:00 +CPU= 62.447
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001188
  04:10:06 STEP 1189 H= 297:15 +CPU= 50.490
  04:10:56 STEP 1190 H= 297:30 +CPU= 49.950
  04:11:46 STEP 1191 H= 297:45 +CPU= 49.551
  04:12:37 STEP 1192 H= 298:00 +CPU= 50.040
  04:13:26 STEP 1193 H= 298:15 +CPU= 49.285
  04:14:16 STEP 1194 H= 298:30 +CPU= 48.995
  04:15:06 STEP 1195 H= 298:45 +CPU= 48.541
  04:15:58 STEP 1196 H= 299:00 +CPU= 51.832
  04:16:48 STEP 1197 H= 299:15 +CPU= 50.230
  04:17:40 STEP 1198 H= 299:30 +CPU= 51.248
  04:18:31 STEP 1199 H= 299:45 +CPU= 50.573
  04:19:39 STEP 1200 H= 300:00 +CPU= 67.766
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001200
  04:20:30 STEP 1201 H= 300:15 +CPU= 49.910
  04:21:21 STEP 1202 H= 300:30 +CPU= 50.612
  04:22:11 STEP 1203 H= 300:45 +CPU= 49.897
  04:23:02 STEP 1204 H= 301:00 +CPU= 50.838
  04:23:52 STEP 1205 H= 301:15 +CPU= 49.593
  04:24:43 STEP 1206 H= 301:30 +CPU= 50.006
  04:25:34 STEP 1207 H= 301:45 +CPU= 51.430
  04:26:27 STEP 1208 H= 302:00 +CPU= 52.169
  04:27:17 STEP 1209 H= 302:15 +CPU= 50.056
  04:28:08 STEP 1210 H= 302:30 +CPU= 50.866
  04:28:58 STEP 1211 H= 302:45 +CPU= 50.338
  04:30:03 STEP 1212 H= 303:00 +CPU= 63.155
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001212
  04:30:54 STEP 1213 H= 303:15 +CPU= 49.966
  04:31:44 STEP 1214 H= 303:30 +CPU= 50.443
  04:32:35 STEP 1215 H= 303:45 +CPU= 50.614
  04:33:28 STEP 1216 H= 304:00 +CPU= 52.402
  04:34:18 STEP 1217 H= 304:15 +CPU= 50.187
  04:35:09 STEP 1218 H= 304:30 +CPU= 50.900
  04:36:01 STEP 1219 H= 304:45 +CPU= 50.753
  04:36:53 STEP 1220 H= 305:00 +CPU= 51.944
  04:37:44 STEP 1221 H= 305:15 +CPU= 51.017
  04:38:35 STEP 1222 H= 305:30 +CPU= 50.638
  04:39:25 STEP 1223 H= 305:45 +CPU= 50.661
  04:40:29 STEP 1224 H= 306:00 +CPU= 63.158
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001224
  04:41:20 STEP 1225 H= 306:15 +CPU= 50.592
  04:42:11 STEP 1226 H= 306:30 +CPU= 50.761
  04:43:01 STEP 1227 H= 306:45 +CPU= 49.913
  04:43:53 STEP 1228 H= 307:00 +CPU= 51.974
  04:44:44 STEP 1229 H= 307:15 +CPU= 50.165
  04:45:35 STEP 1230 H= 307:30 +CPU= 50.943
  04:46:26 STEP 1231 H= 307:45 +CPU= 50.456
  04:47:18 STEP 1232 H= 308:00 +CPU= 51.268
  04:48:09 STEP 1233 H= 308:15 +CPU= 50.557
  04:49:00 STEP 1234 H= 308:30 +CPU= 50.536
  04:49:50 STEP 1235 H= 308:45 +CPU= 50.619
  04:50:54 STEP 1236 H= 309:00 +CPU= 63.716
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001236
  04:51:46 STEP 1237 H= 309:15 +CPU= 50.721
  04:52:35 STEP 1238 H= 309:30 +CPU= 49.661
  04:53:25 STEP 1239 H= 309:45 +CPU= 49.513
  04:54:16 STEP 1240 H= 310:00 +CPU= 50.476
  04:55:06 STEP 1241 H= 310:15 +CPU= 49.633
  04:55:56 STEP 1242 H= 310:30 +CPU= 49.408
  04:56:46 STEP 1243 H= 310:45 +CPU= 50.530
  04:57:36 STEP 1244 H= 311:00 +CPU= 49.825
  04:58:27 STEP 1245 H= 311:15 +CPU= 48.818
  04:59:16 STEP 1246 H= 311:30 +CPU= 49.018
  05:00:06 STEP 1247 H= 311:45 +CPU= 49.384
  05:01:14 STEP 1248 H= 312:00 +CPU= 68.198
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3s9_2016092300_20_1017_12286732_0_r1636640015_12.zip
Uploading the intermediate file: upload_file_12.zip
  05:02:06 STEP 1249 H= 312:15 +CPU= 50.984
  05:02:56 STEP 1250 H= 312:30 +CPU= 50.083
  05:03:47 STEP 1251 H= 312:45 +CPU= 50.445
  05:04:38 STEP 1252 H= 313:00 +CPU= 51.472
  05:05:31 STEP 1253 H= 313:15 +CPU= 50.819
  05:06:21 STEP 1254 H= 313:30 +CPU= 49.968
  05:07:12 STEP 1255 H= 313:45 +CPU= 50.434
  05:08:03 STEP 1256 H= 314:00 +CPU= 50.922
  05:08:53 STEP 1257 H= 314:15 +CPU= 49.439
  05:09:43 STEP 1258 H= 314:30 +CPU= 50.428
  05:10:33 STEP 1259 H= 314:45 +CPU= 49.801
  05:11:37 STEP 1260 H= 315:00 +CPU= 62.030
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001260
  05:12:27 STEP 1261 H= 315:15 +CPU= 50.132
  05:13:19 STEP 1262 H= 315:30 +CPU= 50.613
  05:14:09 STEP 1263 H= 315:45 +CPU= 49.817
  05:15:01 STEP 1264 H= 316:00 +CPU= 51.788
  05:15:52 STEP 1265 H= 316:15 +CPU= 50.886
  05:16:44 STEP 1266 H= 316:30 +CPU= 51.735
  05:17:36 STEP 1267 H= 316:45 +CPU= 50.055
  05:18:28 STEP 1268 H= 317:00 +CPU= 51.813
  05:19:21 STEP 1269 H= 317:15 +CPU= 50.914
  05:20:12 STEP 1270 H= 317:30 +CPU= 50.949
  05:21:04 STEP 1271 H= 317:45 +CPU= 51.278
  05:22:08 STEP 1272 H= 318:00 +CPU= 63.326
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001272
  05:22:58 STEP 1273 H= 318:15 +CPU= 49.707
  05:23:48 STEP 1274 H= 318:30 +CPU= 49.762
  05:24:37 STEP 1275 H= 318:45 +CPU= 49.717
  05:25:28 STEP 1276 H= 319:00 +CPU= 50.177
  05:26:18 STEP 1277 H= 319:15 +CPU= 49.408
  05:27:09 STEP 1278 H= 319:30 +CPU= 49.312
  05:27:59 STEP 1279 H= 319:45 +CPU= 49.580
  05:28:49 STEP 1280 H= 320:00 +CPU= 50.711
  05:29:39 STEP 1281 H= 320:15 +CPU= 49.071
  05:30:28 STEP 1282 H= 320:30 +CPU= 49.238
  05:31:21 STEP 1283 H= 320:45 +CPU= 49.136
  05:32:23 STEP 1284 H= 321:00 +CPU= 62.437
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001284
  05:33:14 STEP 1285 H= 321:15 +CPU= 50.332
  05:34:04 STEP 1286 H= 321:30 +CPU= 49.302
  05:34:54 STEP 1287 H= 321:45 +CPU= 49.242
  05:35:46 STEP 1288 H= 322:00 +CPU= 50.996
  05:36:37 STEP 1289 H= 322:15 +CPU= 48.936
  05:37:28 STEP 1290 H= 322:30 +CPU= 50.955
  05:38:18 STEP 1291 H= 322:45 +CPU= 50.279
  05:39:11 STEP 1292 H= 323:00 +CPU= 52.003
  05:40:01 STEP 1293 H= 323:15 +CPU= 50.279
  05:40:52 STEP 1294 H= 323:30 +CPU= 49.890
  05:41:43 STEP 1295 H= 323:45 +CPU= 50.465
  05:42:50 STEP 1296 H= 324:00 +CPU= 67.470
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001296
  05:43:41 STEP 1297 H= 324:15 +CPU= 50.666
  05:44:31 STEP 1298 H= 324:30 +CPU= 50.232
  05:45:23 STEP 1299 H= 324:45 +CPU= 51.309
  05:46:14 STEP 1300 H= 325:00 +CPU= 50.799
  05:47:04 STEP 1301 H= 325:15 +CPU= 50.133
  05:47:55 STEP 1302 H= 325:30 +CPU= 50.654
  05:48:46 STEP 1303 H= 325:45 +CPU= 50.239
  05:49:39 STEP 1304 H= 326:00 +CPU= 52.488
  05:50:29 STEP 1305 H= 326:15 +CPU= 50.138
  05:51:20 STEP 1306 H= 326:30 +CPU= 49.918
  05:52:10 STEP 1307 H= 326:45 +CPU= 50.420
  05:53:14 STEP 1308 H= 327:00 +CPU= 62.804
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001308
  05:54:03 STEP 1309 H= 327:15 +CPU= 49.580
  05:54:53 STEP 1310 H= 327:30 +CPU= 49.500
  05:55:44 STEP 1311 H= 327:45 +CPU= 50.284
  05:56:36 STEP 1312 H= 328:00 +CPU= 50.160
  05:57:26 STEP 1313 H= 328:15 +CPU= 49.983
  05:58:16 STEP 1314 H= 328:30 +CPU= 50.219
  05:59:06 STEP 1315 H= 328:45 +CPU= 49.609
  05:59:58 STEP 1316 H= 329:00 +CPU= 51.488
  06:00:49 STEP 1317 H= 329:15 +CPU= 51.367
  06:01:40 STEP 1318 H= 329:30 +CPU= 50.169
  06:02:31 STEP 1319 H= 329:45 +CPU= 50.769
  06:03:34 STEP 1320 H= 330:00 +CPU= 62.991
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001320
  06:04:25 STEP 1321 H= 330:15 +CPU= 50.530
  06:05:16 STEP 1322 H= 330:30 +CPU= 50.183
  06:06:06 STEP 1323 H= 330:45 +CPU= 49.388
  06:06:57 STEP 1324 H= 331:00 +CPU= 50.751
  06:07:46 STEP 1325 H= 331:15 +CPU= 49.423
  06:08:36 STEP 1326 H= 331:30 +CPU= 49.731
  06:09:27 STEP 1327 H= 331:45 +CPU= 50.500
  06:10:18 STEP 1328 H= 332:00 +CPU= 51.452
  06:11:09 STEP 1329 H= 332:15 +CPU= 50.121
  06:12:00 STEP 1330 H= 332:30 +CPU= 50.646
  06:12:50 STEP 1331 H= 332:45 +CPU= 50.519
  06:13:53 STEP 1332 H= 333:00 +CPU= 62.850
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001332
  06:14:43 STEP 1333 H= 333:15 +CPU= 49.911
  06:15:35 STEP 1334 H= 333:30 +CPU= 50.614
  06:16:25 STEP 1335 H= 333:45 +CPU= 50.479
  06:17:16 STEP 1336 H= 334:00 +CPU= 50.779
  06:18:07 STEP 1337 H= 334:15 +CPU= 50.148
  06:18:57 STEP 1338 H= 334:30 +CPU= 50.465
  06:19:47 STEP 1339 H= 334:45 +CPU= 50.207
  06:20:37 STEP 1340 H= 335:00 +CPU= 49.661
  06:21:27 STEP 1341 H= 335:15 +CPU= 48.620
  06:22:15 STEP 1342 H= 335:30 +CPU= 48.430
  06:23:03 STEP 1343 H= 335:45 +CPU= 47.659
  06:24:11 STEP 1344 H= 336:00 +CPU= 68.292
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3s9_2016092300_20_1017_12286732_0_r1636640015_13.zip
Uploading the intermediate file: upload_file_13.zip
  06:25:01 STEP 1345 H= 336:15 +CPU= 49.291
  06:25:50 STEP 1346 H= 336:30 +CPU= 48.778
  06:26:37 STEP 1347 H= 336:45 +CPU= 47.444
  06:27:26 STEP 1348 H= 337:00 +CPU= 49.267
  06:28:14 STEP 1349 H= 337:15 +CPU= 47.418
  06:29:04 STEP 1350 H= 337:30 +CPU= 50.303
  06:29:54 STEP 1351 H= 337:45 +CPU= 49.671
  06:30:45 STEP 1352 H= 338:00 +CPU= 51.147
  06:31:36 STEP 1353 H= 338:15 +CPU= 50.729
  06:32:27 STEP 1354 H= 338:30 +CPU= 50.644
  06:33:19 STEP 1355 H= 338:45 +CPU= 50.548
  06:34:23 STEP 1356 H= 339:00 +CPU= 61.586
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001356
  06:35:13 STEP 1357 H= 339:15 +CPU= 49.302
  06:36:04 STEP 1358 H= 339:30 +CPU= 49.506
  06:36:55 STEP 1359 H= 339:45 +CPU= 50.736
  06:37:47 STEP 1360 H= 340:00 +CPU= 51.884
  06:38:38 STEP 1361 H= 340:15 +CPU= 49.458
  06:39:28 STEP 1362 H= 340:30 +CPU= 50.145
  06:40:19 STEP 1363 H= 340:45 +CPU= 50.725
  06:41:10 STEP 1364 H= 341:00 +CPU= 50.746
  06:42:02 STEP 1365 H= 341:15 +CPU= 52.044
  06:42:53 STEP 1366 H= 341:30 +CPU= 50.711
  06:43:44 STEP 1367 H= 341:45 +CPU= 50.437
  06:44:48 STEP 1368 H= 342:00 +CPU= 62.872
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001368
  06:45:39 STEP 1369 H= 342:15 +CPU= 50.489
  06:46:29 STEP 1370 H= 342:30 +CPU= 50.476
  06:47:20 STEP 1371 H= 342:45 +CPU= 50.725
  06:48:11 STEP 1372 H= 343:00 +CPU= 50.497
  06:49:02 STEP 1373 H= 343:15 +CPU= 51.254
  06:49:54 STEP 1374 H= 343:30 +CPU= 51.109
  06:50:45 STEP 1375 H= 343:45 +CPU= 49.882
  06:51:37 STEP 1376 H= 344:00 +CPU= 51.780
  06:52:28 STEP 1377 H= 344:15 +CPU= 51.016
  06:53:20 STEP 1378 H= 344:30 +CPU= 51.253
  06:54:10 STEP 1379 H= 344:45 +CPU= 50.210
  06:55:13 STEP 1380 H= 345:00 +CPU= 62.656
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001380
  06:56:05 STEP 1381 H= 345:15 +CPU= 50.066
  06:56:56 STEP 1382 H= 345:30 +CPU= 50.241
  06:57:47 STEP 1383 H= 345:45 +CPU= 49.484
  06:58:38 STEP 1384 H= 346:00 +CPU= 51.462
  06:59:29 STEP 1385 H= 346:15 +CPU= 50.414
  07:00:20 STEP 1386 H= 346:30 +CPU= 50.341
  07:01:11 STEP 1387 H= 346:45 +CPU= 50.104
  07:02:02 STEP 1388 H= 347:00 +CPU= 50.904
  07:02:51 STEP 1389 H= 347:15 +CPU= 49.253
  07:03:41 STEP 1390 H= 347:30 +CPU= 48.224
  07:04:29 STEP 1391 H= 347:45 +CPU= 48.767
  07:05:37 STEP 1392 H= 348:00 +CPU= 67.088
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001392
  07:06:27 STEP 1393 H= 348:15 +CPU= 49.071
  07:07:16 STEP 1394 H= 348:30 +CPU= 48.953
  07:08:05 STEP 1395 H= 348:45 +CPU= 49.075
  07:08:56 STEP 1396 H= 349:00 +CPU= 50.393
  07:09:46 STEP 1397 H= 349:15 +CPU= 50.710
  07:10:35 STEP 1398 H= 349:30 +CPU= 48.599
  07:11:24 STEP 1399 H= 349:45 +CPU= 48.904
  07:12:13 STEP 1400 H= 350:00 +CPU= 49.055
  07:13:01 STEP 1401 H= 350:15 +CPU= 47.102
  07:13:51 STEP 1402 H= 350:30 +CPU= 49.516
  07:14:41 STEP 1403 H= 350:45 +CPU= 49.941
  07:15:43 STEP 1404 H= 351:00 +CPU= 61.389
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001404
  07:16:31 STEP 1405 H= 351:15 +CPU= 48.390
  07:17:19 STEP 1406 H= 351:30 +CPU= 48.024
  07:18:08 STEP 1407 H= 351:45 +CPU= 48.567
  07:18:58 STEP 1408 H= 352:00 +CPU= 49.874
  07:19:48 STEP 1409 H= 352:15 +CPU= 49.873
  07:20:37 STEP 1410 H= 352:30 +CPU= 48.339
  07:21:26 STEP 1411 H= 352:45 +CPU= 48.906
  07:22:15 STEP 1412 H= 353:00 +CPU= 48.380
  07:23:04 STEP 1413 H= 353:15 +CPU= 49.049
  07:23:53 STEP 1414 H= 353:30 +CPU= 48.683
  07:24:41 STEP 1415 H= 353:45 +CPU= 48.256
  07:25:41 STEP 1416 H= 354:00 +CPU= 59.595
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001416
  07:26:29 STEP 1417 H= 354:15 +CPU= 48.267
  07:27:19 STEP 1418 H= 354:30 +CPU= 49.292
  07:28:07 STEP 1419 H= 354:45 +CPU= 48.075
  07:28:57 STEP 1420 H= 355:00 +CPU= 49.542
  07:29:46 STEP 1421 H= 355:15 +CPU= 48.831
  07:30:34 STEP 1422 H= 355:30 +CPU= 48.144
  07:31:23 STEP 1423 H= 355:45 +CPU= 48.340
  07:32:14 STEP 1424 H= 356:00 +CPU= 50.248
  07:33:02 STEP 1425 H= 356:15 +CPU= 48.298
  07:33:51 STEP 1426 H= 356:30 +CPU= 48.479
  07:34:40 STEP 1427 H= 356:45 +CPU= 49.294
  07:35:41 STEP 1428 H= 357:00 +CPU= 58.530
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001428
  07:36:29 STEP 1429 H= 357:15 +CPU= 47.761
  07:37:13 STEP 1430 H= 357:30 +CPU= 43.931
  07:37:59 STEP 1431 H= 357:45 +CPU= 46.090
  07:38:48 STEP 1432 H= 358:00 +CPU= 49.190
  07:39:38 STEP 1433 H= 358:15 +CPU= 49.392
  07:40:27 STEP 1434 H= 358:30 +CPU= 49.139
  07:41:17 STEP 1435 H= 358:45 +CPU= 49.219
  07:42:07 STEP 1436 H= 359:00 +CPU= 49.253
  07:42:54 STEP 1437 H= 359:15 +CPU= 47.017
  07:43:42 STEP 1438 H= 359:30 +CPU= 48.407
  07:44:31 STEP 1439 H= 359:45 +CPU= 49.255
  07:45:34 STEP 1440 H= 360:00 +CPU= 62.104
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.9222312424E-21      I       0.2546060999E-06      I
ICloud fractionI      0.0000000000E+00      I       0.2381608752E-02      I
I  Relat. Hum. I      0.3417607015E-01      I       0.7926075265E-01      I
I  PASS 01     I      0.0000000000E+00      I       0.4731668760E+02      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    312372692 BYTES IN      7 RECORDS TRANSFERRED IN    0.0008 SECONDS390465.9 Mbytes/s, TOTAL TIME=    0.0197( 4.1%)
 07:45:34 STEP 1440 H= 360:00 +CPU= 62.104
 END CNT3
 NSTEP =  1440 CNT0   000000000  46.107  46.107  46.182   0.998               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        43246/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    43246 ************   110.1     0.0   110.1     0.0   235.3
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.98      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    6791.9    6791.9     15.78      0.00
   9 SPCM     - SPECTRAL COMP.                    1440    1209.5    1209.5      2.59      0.00
  10 SCAN2M - PHYSICS                             1441   22787.0   22787.0     48.85      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121    1263.1    1263.1      0.23      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      68.0      68.0      0.01      0.00
  14 SUINIF                                          1   10229.9   10229.9      0.02      0.00
  17 GRIDFPOS IN CNT4                              121      53.3      53.3      0.01      0.00
  18 SUSPECG                                         1    5589.9    5589.9      0.01      0.00
  19 SUSPEC                                          1    5598.8    5598.8      0.01      0.00
  24 SUGRIDU                                         1    4031.1    4031.1      0.01      0.00
  25 SPECRT                                          1     333.0     333.0      0.00      0.00
  26 SUGRIDF                                         1     266.9     266.9      0.00      0.00
  27 RESTART FILES - WRITING                        30    5094.4    5094.4      0.23      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               121   10143.8   10143.8      1.83      0.00
  31 POSDDH IN STEPO                                 7       1.4       1.4      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441    9271.4    9271.4     19.88      0.00
  39 SU0YOMB                                         1     556.0     556.0      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      44.1      44.1      0.09      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     562.9     562.9      1.21      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440     118.6     118.6      0.25      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.4       0.4      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     850.0     850.0      3.95      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     446.5     446.5      2.00      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006     164.2     164.2      0.73      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     250.3     250.3      1.16      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      56.9      56.9      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      78.9      78.9      0.37      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      39.6      39.6      0.18      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125     160.9     160.9      0.75      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      86.8      86.8      0.39      0.00
 400 GSTATS                                     167734       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                156066       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    67213.3 CPU TIME   66824.3 VECTOR TIME    66824.3


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       19.3
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/0/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/0/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286732/ICMGGh7zg+001344
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3s9_2016092300_20_1017_12286732_0_r1636640015_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
07:49:09 (3947486): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a3s9_2016092300_20_1017_12286732_0_r1636640015_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3s9_2016092300_20_1017_12286732_0_r1636640015_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3s9_2016092300_20_1017_12286732_0_r1636640015_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3s9_2016092300_20_1017_12286732_0_r1636640015_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3s9_2016092300_20_1017_12286732_0_r1636640015_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Jun 2024 13:55:31 1538900 22438353 oifs_43r3_bl_a3s9_2016092300_20_1017_12286732_0 1,295,100 66,824 0.0516
08 Jun 2024 06:04:18 1538900 22438353 oifs_43r3_bl_a3s9_2016092300_20_1017_12286732_0 864,000 42,249 0.0489


©2024 climateprediction.net