climateprediction.net home page
Task 22440726

Task 22440726

Name oifs_43r3_bl_a0l4_2016092300_20_1017_12282587_1
Workunit 12282587
Created 8 Jun 2024, 8:57:03 UTC
Sent 8 Jun 2024, 8:57:22 UTC
Report deadline 7 Aug 2024, 8:57:22 UTC
Received 9 Jun 2024, 8:48:04 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1498497
Run time 22 hours 49 min 43 sec
CPU time 22 hours 44 min 19 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 2.81 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,024.82 MB
Peak swap size 5,980.79 MB
Peak disk usage 1,371.64 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
 H= 208:30 +CPU= 58.318
  17:44:54 STEP  835 H= 208:45 +CPU= 57.825
  17:45:53 STEP  836 H= 209:00 +CPU= 58.803
  17:46:49 STEP  837 H= 209:15 +CPU= 56.855
  17:47:46 STEP  838 H= 209:30 +CPU= 56.840
  17:48:44 STEP  839 H= 209:45 +CPU= 57.760
  17:49:54 STEP  840 H= 210:00 +CPU= 70.082
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000840
  17:50:48 STEP  841 H= 210:15 +CPU= 53.543
  17:51:44 STEP  842 H= 210:30 +CPU= 56.378
  17:52:40 STEP  843 H= 210:45 +CPU= 55.839
  17:53:41 STEP  844 H= 211:00 +CPU= 60.758
  17:54:38 STEP  845 H= 211:15 +CPU= 57.667
  17:55:34 STEP  846 H= 211:30 +CPU= 55.218
  17:56:31 STEP  847 H= 211:45 +CPU= 57.697
  17:57:32 STEP  848 H= 212:00 +CPU= 60.740
  17:58:32 STEP  849 H= 212:15 +CPU= 60.434
  17:59:31 STEP  850 H= 212:30 +CPU= 58.183
  18:00:29 STEP  851 H= 212:45 +CPU= 57.991
  18:01:42 STEP  852 H= 213:00 +CPU= 73.209
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000852
  18:02:43 STEP  853 H= 213:15 +CPU= 60.718
  18:03:42 STEP  854 H= 213:30 +CPU= 59.220
  18:04:41 STEP  855 H= 213:45 +CPU= 59.139
  18:05:39 STEP  856 H= 214:00 +CPU= 57.560
  18:06:35 STEP  857 H= 214:15 +CPU= 56.652
  18:07:33 STEP  858 H= 214:30 +CPU= 57.936
  18:08:31 STEP  859 H= 214:45 +CPU= 57.717
  18:09:30 STEP  860 H= 215:00 +CPU= 59.257
  18:10:26 STEP  861 H= 215:15 +CPU= 56.121
  18:11:17 STEP  862 H= 215:30 +CPU= 50.598
  18:12:15 STEP  863 H= 215:45 +CPU= 57.242
  18:13:34 STEP  864 H= 216:00 +CPU= 78.664
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0l4_2016092300_20_1017_12282587_1_r1889452229_8.zip
Uploading the intermediate file: upload_file_8.zip
  18:14:33 STEP  865 H= 216:15 +CPU= 58.562
  18:15:31 STEP  866 H= 216:30 +CPU= 57.526
  18:16:30 STEP  867 H= 216:45 +CPU= 58.069
  18:17:30 STEP  868 H= 217:00 +CPU= 60.006
  18:18:29 STEP  869 H= 217:15 +CPU= 58.584
  18:19:28 STEP  870 H= 217:30 +CPU= 59.239
  18:20:29 STEP  871 H= 217:45 +CPU= 60.606
  18:21:31 STEP  872 H= 218:00 +CPU= 62.178
  18:22:32 STEP  873 H= 218:15 +CPU= 60.991
  18:23:33 STEP  874 H= 218:30 +CPU= 60.728
  18:24:36 STEP  875 H= 218:45 +CPU= 61.120
  18:25:53 STEP  876 H= 219:00 +CPU= 76.912
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000876
  18:26:55 STEP  877 H= 219:15 +CPU= 61.788
  18:27:57 STEP  878 H= 219:30 +CPU= 61.533
  18:28:58 STEP  879 H= 219:45 +CPU= 61.209
  18:30:01 STEP  880 H= 220:00 +CPU= 61.998
  18:31:01 STEP  881 H= 220:15 +CPU= 60.468
  18:32:02 STEP  882 H= 220:30 +CPU= 61.255
  18:33:03 STEP  883 H= 220:45 +CPU= 60.698
  18:34:06 STEP  884 H= 221:00 +CPU= 62.558
  18:35:07 STEP  885 H= 221:15 +CPU= 61.152
  18:36:07 STEP  886 H= 221:30 +CPU= 59.812
  18:37:08 STEP  887 H= 221:45 +CPU= 61.109
  18:38:25 STEP  888 H= 222:00 +CPU= 76.534
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000888
  18:39:27 STEP  889 H= 222:15 +CPU= 61.388
  18:40:29 STEP  890 H= 222:30 +CPU= 61.995
  18:41:31 STEP  891 H= 222:45 +CPU= 62.497
  18:42:35 STEP  892 H= 223:00 +CPU= 63.470
  18:43:36 STEP  893 H= 223:15 +CPU= 61.494
  18:44:37 STEP  894 H= 223:30 +CPU= 60.669
  18:45:38 STEP  895 H= 223:45 +CPU= 60.637
  18:46:40 STEP  896 H= 224:00 +CPU= 61.731
  18:47:41 STEP  897 H= 224:15 +CPU= 61.416
  18:48:42 STEP  898 H= 224:30 +CPU= 60.589
  18:49:38 STEP  899 H= 224:45 +CPU= 55.753
  18:50:43 STEP  900 H= 225:00 +CPU= 65.219
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000900
  18:51:38 STEP  901 H= 225:15 +CPU= 54.455
  18:52:31 STEP  902 H= 225:30 +CPU= 53.641
  18:53:28 STEP  903 H= 225:45 +CPU= 56.032
  18:54:22 STEP  904 H= 226:00 +CPU= 54.654
  18:55:19 STEP  905 H= 226:15 +CPU= 56.662
  18:56:14 STEP  906 H= 226:30 +CPU= 55.206
  18:57:11 STEP  907 H= 226:45 +CPU= 56.722
  18:58:07 STEP  908 H= 227:00 +CPU= 55.536
  18:59:03 STEP  909 H= 227:15 +CPU= 56.346
  19:00:00 STEP  910 H= 227:30 +CPU= 56.441
  19:00:54 STEP  911 H= 227:45 +CPU= 54.045
  19:02:09 STEP  912 H= 228:00 +CPU= 72.619
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000912
  19:03:03 STEP  913 H= 228:15 +CPU= 53.550
  19:03:56 STEP  914 H= 228:30 +CPU= 52.891
  19:04:49 STEP  915 H= 228:45 +CPU= 53.313
  19:05:45 STEP  916 H= 229:00 +CPU= 55.811
  19:06:42 STEP  917 H= 229:15 +CPU= 56.325
  19:07:37 STEP  918 H= 229:30 +CPU= 55.027
  19:08:32 STEP  919 H= 229:45 +CPU= 55.328
  19:09:28 STEP  920 H= 230:00 +CPU= 56.025
  19:10:24 STEP  921 H= 230:15 +CPU= 55.441
  19:11:19 STEP  922 H= 230:30 +CPU= 54.902
  19:12:15 STEP  923 H= 230:45 +CPU= 55.746
  19:13:23 STEP  924 H= 231:00 +CPU= 67.735
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000924
  19:14:18 STEP  925 H= 231:15 +CPU= 55.178
  19:15:11 STEP  926 H= 231:30 +CPU= 52.843
  19:16:05 STEP  927 H= 231:45 +CPU= 54.288
  19:17:03 STEP  928 H= 232:00 +CPU= 57.181
  19:17:58 STEP  929 H= 232:15 +CPU= 55.055
  19:18:54 STEP  930 H= 232:30 +CPU= 55.770
  19:19:47 STEP  931 H= 232:45 +CPU= 52.819
  19:20:44 STEP  932 H= 233:00 +CPU= 56.800
  19:21:40 STEP  933 H= 233:15 +CPU= 55.942
  19:22:35 STEP  934 H= 233:30 +CPU= 54.583
  19:23:29 STEP  935 H= 233:45 +CPU= 54.440
  19:24:39 STEP  936 H= 234:00 +CPU= 69.524
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000936
  19:25:33 STEP  937 H= 234:15 +CPU= 53.898
  19:26:28 STEP  938 H= 234:30 +CPU= 54.551
  19:27:20 STEP  939 H= 234:45 +CPU= 52.884
  19:28:13 STEP  940 H= 235:00 +CPU= 52.832
  19:29:07 STEP  941 H= 235:15 +CPU= 53.564
  19:30:00 STEP  942 H= 235:30 +CPU= 52.413
  19:30:53 STEP  943 H= 235:45 +CPU= 53.105
  19:31:48 STEP  944 H= 236:00 +CPU= 55.434
  19:32:44 STEP  945 H= 236:15 +CPU= 55.331
  19:33:39 STEP  946 H= 236:30 +CPU= 55.574
  19:34:34 STEP  947 H= 236:45 +CPU= 54.478
  19:35:41 STEP  948 H= 237:00 +CPU= 67.399
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000948
  19:36:36 STEP  949 H= 237:15 +CPU= 54.060
  19:37:31 STEP  950 H= 237:30 +CPU= 55.449
  19:38:25 STEP  951 H= 237:45 +CPU= 53.393
  19:39:20 STEP  952 H= 238:00 +CPU= 55.353
  19:40:16 STEP  953 H= 238:15 +CPU= 55.065
  19:41:10 STEP  954 H= 238:30 +CPU= 54.064
  19:42:04 STEP  955 H= 238:45 +CPU= 53.884
  19:43:00 STEP  956 H= 239:00 +CPU= 55.864
  19:43:54 STEP  957 H= 239:15 +CPU= 54.274
  19:44:49 STEP  958 H= 239:30 +CPU= 54.936
  19:45:43 STEP  959 H= 239:45 +CPU= 54.148
  19:46:58 STEP  960 H= 240:00 +CPU= 73.317
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0l4_2016092300_20_1017_12282587_1_r1889452229_9.zip
Uploading the intermediate file: upload_file_9.zip
Uploading trickle at timestep: 864000
  19:47:51 STEP  961 H= 240:15 +CPU= 53.482
  19:48:45 STEP  962 H= 240:30 +CPU= 53.354
  19:49:39 STEP  963 H= 240:45 +CPU= 53.774
  19:50:35 STEP  964 H= 241:00 +CPU= 56.130
  19:51:28 STEP  965 H= 241:15 +CPU= 53.281
  19:52:24 STEP  966 H= 241:30 +CPU= 55.940
  19:53:20 STEP  967 H= 241:45 +CPU= 55.732
  19:54:16 STEP  968 H= 242:00 +CPU= 55.700
  19:55:12 STEP  969 H= 242:15 +CPU= 55.391
  19:56:05 STEP  970 H= 242:30 +CPU= 52.907
  19:56:59 STEP  971 H= 242:45 +CPU= 54.561
  19:58:07 STEP  972 H= 243:00 +CPU= 67.702
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000972
  19:59:04 STEP  973 H= 243:15 +CPU= 56.176
  20:00:00 STEP  974 H= 243:30 +CPU= 56.148
  20:00:55 STEP  975 H= 243:45 +CPU= 55.388
  20:01:53 STEP  976 H= 244:00 +CPU= 57.421
  20:02:49 STEP  977 H= 244:15 +CPU= 56.360
  20:03:45 STEP  978 H= 244:30 +CPU= 55.357
  20:04:41 STEP  979 H= 244:45 +CPU= 56.402
  20:05:39 STEP  980 H= 245:00 +CPU= 57.892
  20:06:34 STEP  981 H= 245:15 +CPU= 54.855
  20:07:28 STEP  982 H= 245:30 +CPU= 53.530
  20:08:23 STEP  983 H= 245:45 +CPU= 54.887
  20:09:32 STEP  984 H= 246:00 +CPU= 68.653
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000984
  20:10:29 STEP  985 H= 246:15 +CPU= 56.732
  20:11:24 STEP  986 H= 246:30 +CPU= 55.126
  20:12:20 STEP  987 H= 246:45 +CPU= 55.718
  20:13:18 STEP  988 H= 247:00 +CPU= 57.688
  20:14:13 STEP  989 H= 247:15 +CPU= 55.365
  20:15:09 STEP  990 H= 247:30 +CPU= 55.242
  20:16:03 STEP  991 H= 247:45 +CPU= 54.763
  20:17:00 STEP  992 H= 248:00 +CPU= 56.113
  20:17:54 STEP  993 H= 248:15 +CPU= 54.560
  20:18:50 STEP  994 H= 248:30 +CPU= 55.701
  20:19:46 STEP  995 H= 248:45 +CPU= 55.375
  20:20:55 STEP  996 H= 249:00 +CPU= 69.208
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000996
  20:21:50 STEP  997 H= 249:15 +CPU= 54.520
  20:22:45 STEP  998 H= 249:30 +CPU= 54.692
  20:23:38 STEP  999 H= 249:45 +CPU= 53.187
  20:24:32 STEP 1000 H= 250:00 +CPU= 54.266
  20:25:26 STEP 1001 H= 250:15 +CPU= 53.316
  20:26:19 STEP 1002 H= 250:30 +CPU= 53.636
  20:27:15 STEP 1003 H= 250:45 +CPU= 55.202
  20:28:12 STEP 1004 H= 251:00 +CPU= 56.799
  20:29:06 STEP 1005 H= 251:15 +CPU= 54.185
  20:30:01 STEP 1006 H= 251:30 +CPU= 55.466
  20:30:56 STEP 1007 H= 251:45 +CPU= 55.127
  20:32:10 STEP 1008 H= 252:00 +CPU= 73.039
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001008
  20:33:06 STEP 1009 H= 252:15 +CPU= 56.149
  20:34:00 STEP 1010 H= 252:30 +CPU= 53.660
  20:34:54 STEP 1011 H= 252:45 +CPU= 54.285
  20:35:51 STEP 1012 H= 253:00 +CPU= 56.413
  20:36:46 STEP 1013 H= 253:15 +CPU= 55.162
  20:37:41 STEP 1014 H= 253:30 +CPU= 54.513
  20:38:35 STEP 1015 H= 253:45 +CPU= 53.791
  20:39:32 STEP 1016 H= 254:00 +CPU= 56.825
  20:40:27 STEP 1017 H= 254:15 +CPU= 55.384
  20:41:22 STEP 1018 H= 254:30 +CPU= 55.073
  20:42:16 STEP 1019 H= 254:45 +CPU= 53.500
  20:43:25 STEP 1020 H= 255:00 +CPU= 68.682
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001020
  20:44:20 STEP 1021 H= 255:15 +CPU= 54.995
  20:45:15 STEP 1022 H= 255:30 +CPU= 54.655
  20:46:09 STEP 1023 H= 255:45 +CPU= 54.573
  20:47:07 STEP 1024 H= 256:00 +CPU= 57.436
  20:48:03 STEP 1025 H= 256:15 +CPU= 55.683
  20:48:57 STEP 1026 H= 256:30 +CPU= 54.355
  20:49:52 STEP 1027 H= 256:45 +CPU= 54.478
  20:50:47 STEP 1028 H= 257:00 +CPU= 54.971
  20:51:43 STEP 1029 H= 257:15 +CPU= 55.593
  20:52:37 STEP 1030 H= 257:30 +CPU= 54.061
  20:53:31 STEP 1031 H= 257:45 +CPU= 54.644
  20:54:42 STEP 1032 H= 258:00 +CPU= 70.823
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001032
  20:55:37 STEP 1033 H= 258:15 +CPU= 54.371
  20:56:31 STEP 1034 H= 258:30 +CPU= 53.596
  20:57:25 STEP 1035 H= 258:45 +CPU= 54.618
  20:58:21 STEP 1036 H= 259:00 +CPU= 55.390
  20:59:16 STEP 1037 H= 259:15 +CPU= 55.211
  21:00:10 STEP 1038 H= 259:30 +CPU= 53.894
  21:01:05 STEP 1039 H= 259:45 +CPU= 54.647
  21:02:01 STEP 1040 H= 260:00 +CPU= 56.762
  21:02:58 STEP 1041 H= 260:15 +CPU= 55.981
  21:03:51 STEP 1042 H= 260:30 +CPU= 53.782
  21:04:48 STEP 1043 H= 260:45 +CPU= 56.916
  21:05:59 STEP 1044 H= 261:00 +CPU= 69.988
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001044
  21:06:55 STEP 1045 H= 261:15 +CPU= 56.542
  21:07:50 STEP 1046 H= 261:30 +CPU= 54.960
  21:08:44 STEP 1047 H= 261:45 +CPU= 54.047
  21:09:39 STEP 1048 H= 262:00 +CPU= 54.176
  21:10:34 STEP 1049 H= 262:15 +CPU= 55.283
  21:11:30 STEP 1050 H= 262:30 +CPU= 55.339
  21:12:25 STEP 1051 H= 262:45 +CPU= 54.876
  21:13:21 STEP 1052 H= 263:00 +CPU= 56.133
  21:14:16 STEP 1053 H= 263:15 +CPU= 55.111
  21:15:09 STEP 1054 H= 263:30 +CPU= 52.879
  21:16:03 STEP 1055 H= 263:45 +CPU= 53.607
  21:17:19 STEP 1056 H= 264:00 +CPU= 75.737
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0l4_2016092300_20_1017_12282587_1_r1889452229_10.zip
Uploading the intermediate file: upload_file_10.zip
  21:18:12 STEP 1057 H= 264:15 +CPU= 53.258
  21:19:07 STEP 1058 H= 264:30 +CPU= 54.174
  21:20:01 STEP 1059 H= 264:45 +CPU= 54.011
  21:20:56 STEP 1060 H= 265:00 +CPU= 55.311
  21:21:52 STEP 1061 H= 265:15 +CPU= 55.275
  21:22:47 STEP 1062 H= 265:30 +CPU= 55.456
  21:23:44 STEP 1063 H= 265:45 +CPU= 56.233
  21:24:41 STEP 1064 H= 266:00 +CPU= 57.001
  21:25:35 STEP 1065 H= 266:15 +CPU= 53.794
  21:26:31 STEP 1066 H= 266:30 +CPU= 56.334
  21:27:27 STEP 1067 H= 266:45 +CPU= 55.346
  21:28:35 STEP 1068 H= 267:00 +CPU= 67.661
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001068
  21:29:31 STEP 1069 H= 267:15 +CPU= 56.442
  21:30:28 STEP 1070 H= 267:30 +CPU= 56.549
  21:31:22 STEP 1071 H= 267:45 +CPU= 54.762
  21:32:17 STEP 1072 H= 268:00 +CPU= 54.111
  21:33:11 STEP 1073 H= 268:15 +CPU= 54.311
  21:34:06 STEP 1074 H= 268:30 +CPU= 54.121
  21:34:59 STEP 1075 H= 268:45 +CPU= 53.621
  21:35:55 STEP 1076 H= 269:00 +CPU= 55.193
  21:36:50 STEP 1077 H= 269:15 +CPU= 55.682
  21:37:45 STEP 1078 H= 269:30 +CPU= 54.622
  21:38:39 STEP 1079 H= 269:45 +CPU= 53.817
  21:39:45 STEP 1080 H= 270:00 +CPU= 66.022
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001080
  21:40:41 STEP 1081 H= 270:15 +CPU= 55.516
  21:41:36 STEP 1082 H= 270:30 +CPU= 55.294
  21:42:30 STEP 1083 H= 270:45 +CPU= 53.566
  21:43:24 STEP 1084 H= 271:00 +CPU= 54.512
  21:44:19 STEP 1085 H= 271:15 +CPU= 54.146
  21:45:12 STEP 1086 H= 271:30 +CPU= 53.279
  21:46:05 STEP 1087 H= 271:45 +CPU= 52.672
  21:47:02 STEP 1088 H= 272:00 +CPU= 56.558
  21:47:57 STEP 1089 H= 272:15 +CPU= 55.353
  21:48:51 STEP 1090 H= 272:30 +CPU= 54.184
  21:49:46 STEP 1091 H= 272:45 +CPU= 55.073
  21:50:57 STEP 1092 H= 273:00 +CPU= 69.952
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001092
  21:51:51 STEP 1093 H= 273:15 +CPU= 54.642
  21:52:46 STEP 1094 H= 273:30 +CPU= 54.660
  21:53:40 STEP 1095 H= 273:45 +CPU= 54.262
  21:54:37 STEP 1096 H= 274:00 +CPU= 56.507
  21:55:32 STEP 1097 H= 274:15 +CPU= 55.036
  21:56:27 STEP 1098 H= 274:30 +CPU= 54.734
  21:57:23 STEP 1099 H= 274:45 +CPU= 55.901
  21:58:19 STEP 1100 H= 275:00 +CPU= 55.443
  21:59:14 STEP 1101 H= 275:15 +CPU= 55.675
  22:00:10 STEP 1102 H= 275:30 +CPU= 55.324
  22:01:05 STEP 1103 H= 275:45 +CPU= 55.036
  22:02:20 STEP 1104 H= 276:00 +CPU= 74.360
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001104
  22:03:15 STEP 1105 H= 276:15 +CPU= 54.750
  22:04:10 STEP 1106 H= 276:30 +CPU= 54.986
  22:05:05 STEP 1107 H= 276:45 +CPU= 54.637
  22:06:00 STEP 1108 H= 277:00 +CPU= 55.239
  22:06:55 STEP 1109 H= 277:15 +CPU= 54.439
  22:07:49 STEP 1110 H= 277:30 +CPU= 54.591
  22:08:45 STEP 1111 H= 277:45 +CPU= 55.198
  22:09:41 STEP 1112 H= 278:00 +CPU= 56.297
  22:10:35 STEP 1113 H= 278:15 +CPU= 53.912
  22:11:29 STEP 1114 H= 278:30 +CPU= 53.191
  22:12:21 STEP 1115 H= 278:45 +CPU= 52.704
  22:13:29 STEP 1116 H= 279:00 +CPU= 67.727
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001116
  22:14:24 STEP 1117 H= 279:15 +CPU= 54.795
  22:15:19 STEP 1118 H= 279:30 +CPU= 55.071
  22:16:15 STEP 1119 H= 279:45 +CPU= 56.113
  22:17:11 STEP 1120 H= 280:00 +CPU= 55.448
  22:18:05 STEP 1121 H= 280:15 +CPU= 54.507
  22:19:01 STEP 1122 H= 280:30 +CPU= 55.415
  22:19:56 STEP 1123 H= 280:45 +CPU= 54.925
  22:20:52 STEP 1124 H= 281:00 +CPU= 56.287
  22:21:48 STEP 1125 H= 281:15 +CPU= 55.650
  22:22:43 STEP 1126 H= 281:30 +CPU= 55.256
  22:23:39 STEP 1127 H= 281:45 +CPU= 56.049
  22:24:50 STEP 1128 H= 282:00 +CPU= 70.066
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001128
  22:25:45 STEP 1129 H= 282:15 +CPU= 54.921
  22:26:41 STEP 1130 H= 282:30 +CPU= 56.058
  22:27:38 STEP 1131 H= 282:45 +CPU= 56.640
  22:28:36 STEP 1132 H= 283:00 +CPU= 58.142
  22:29:32 STEP 1133 H= 283:15 +CPU= 55.932
  22:30:27 STEP 1134 H= 283:30 +CPU= 55.252
  22:31:23 STEP 1135 H= 283:45 +CPU= 55.218
  22:32:18 STEP 1136 H= 284:00 +CPU= 54.989
  22:33:14 STEP 1137 H= 284:15 +CPU= 55.837
  22:34:09 STEP 1138 H= 284:30 +CPU= 55.787
  22:35:05 STEP 1139 H= 284:45 +CPU= 55.522
  22:36:13 STEP 1140 H= 285:00 +CPU= 67.580
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001140
  22:37:08 STEP 1141 H= 285:15 +CPU= 55.137
  22:38:02 STEP 1142 H= 285:30 +CPU= 54.360
  22:38:57 STEP 1143 H= 285:45 +CPU= 54.672
  22:39:55 STEP 1144 H= 286:00 +CPU= 58.277
  22:40:48 STEP 1145 H= 286:15 +CPU= 52.714
  22:41:43 STEP 1146 H= 286:30 +CPU= 54.796
  22:42:37 STEP 1147 H= 286:45 +CPU= 53.874
  22:43:33 STEP 1148 H= 287:00 +CPU= 55.302
  22:44:28 STEP 1149 H= 287:15 +CPU= 55.496
  22:45:23 STEP 1150 H= 287:30 +CPU= 54.320
  22:46:18 STEP 1151 H= 287:45 +CPU= 54.742
  22:47:35 STEP 1152 H= 288:00 +CPU= 76.755
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0l4_2016092300_20_1017_12282587_1_r1889452229_11.zip
Uploading the intermediate file: upload_file_11.zip
  22:48:32 STEP 1153 H= 288:15 +CPU= 57.040
  22:49:28 STEP 1154 H= 288:30 +CPU= 55.542
  22:50:24 STEP 1155 H= 288:45 +CPU= 56.100
  22:51:21 STEP 1156 H= 289:00 +CPU= 56.867
  22:52:18 STEP 1157 H= 289:15 +CPU= 56.735
  22:53:14 STEP 1158 H= 289:30 +CPU= 55.687
  22:54:10 STEP 1159 H= 289:45 +CPU= 55.764
  22:55:07 STEP 1160 H= 290:00 +CPU= 57.435
  22:56:04 STEP 1161 H= 290:15 +CPU= 55.979
  22:56:59 STEP 1162 H= 290:30 +CPU= 55.800
  22:57:56 STEP 1163 H= 290:45 +CPU= 56.185
  22:59:05 STEP 1164 H= 291:00 +CPU= 69.128
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001164
  22:59:59 STEP 1165 H= 291:15 +CPU= 54.538
  23:00:54 STEP 1166 H= 291:30 +CPU= 54.855
  23:01:49 STEP 1167 H= 291:45 +CPU= 55.055
  23:02:48 STEP 1168 H= 292:00 +CPU= 58.243
  23:03:44 STEP 1169 H= 292:15 +CPU= 55.744
  23:04:39 STEP 1170 H= 292:30 +CPU= 55.487
  23:05:34 STEP 1171 H= 292:45 +CPU= 54.389
  23:06:30 STEP 1172 H= 293:00 +CPU= 56.091
  23:07:25 STEP 1173 H= 293:15 +CPU= 54.779
  23:08:20 STEP 1174 H= 293:30 +CPU= 54.850
  23:09:17 STEP 1175 H= 293:45 +CPU= 57.475
  23:10:27 STEP 1176 H= 294:00 +CPU= 69.742
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001176
  23:11:23 STEP 1177 H= 294:15 +CPU= 55.548
  23:12:19 STEP 1178 H= 294:30 +CPU= 56.467
  23:13:14 STEP 1179 H= 294:45 +CPU= 54.487
  23:14:09 STEP 1180 H= 295:00 +CPU= 55.144
  23:15:05 STEP 1181 H= 295:15 +CPU= 56.059
  23:16:01 STEP 1182 H= 295:30 +CPU= 55.609
  23:16:56 STEP 1183 H= 295:45 +CPU= 54.858
  23:17:52 STEP 1184 H= 296:00 +CPU= 56.165
  23:18:48 STEP 1185 H= 296:15 +CPU= 55.964
  23:19:50 STEP 1186 H= 296:30 +CPU= 61.198
  23:20:51 STEP 1187 H= 296:45 +CPU= 61.559
  23:22:08 STEP 1188 H= 297:00 +CPU= 76.628
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001188
  23:23:10 STEP 1189 H= 297:15 +CPU= 61.584
  23:24:12 STEP 1190 H= 297:30 +CPU= 62.178
  23:25:14 STEP 1191 H= 297:45 +CPU= 61.871
  23:26:17 STEP 1192 H= 298:00 +CPU= 62.909
  23:27:20 STEP 1193 H= 298:15 +CPU= 62.717
  23:28:22 STEP 1194 H= 298:30 +CPU= 61.883
  23:29:24 STEP 1195 H= 298:45 +CPU= 61.813
  23:30:26 STEP 1196 H= 299:00 +CPU= 62.137
  23:31:27 STEP 1197 H= 299:15 +CPU= 60.752
  23:32:29 STEP 1198 H= 299:30 +CPU= 61.742
  23:33:30 STEP 1199 H= 299:45 +CPU= 61.634
  23:34:55 STEP 1200 H= 300:00 +CPU= 83.996
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001200
  23:35:58 STEP 1201 H= 300:15 +CPU= 62.015
  23:37:00 STEP 1202 H= 300:30 +CPU= 62.195
  23:38:00 STEP 1203 H= 300:45 +CPU= 59.924
  23:39:03 STEP 1204 H= 301:00 +CPU= 62.604
  23:40:06 STEP 1205 H= 301:15 +CPU= 62.813
  23:41:07 STEP 1206 H= 301:30 +CPU= 61.416
  23:42:10 STEP 1207 H= 301:45 +CPU= 62.094
  23:43:13 STEP 1208 H= 302:00 +CPU= 63.421
  23:44:15 STEP 1209 H= 302:15 +CPU= 61.964
  23:45:18 STEP 1210 H= 302:30 +CPU= 62.334
  23:46:19 STEP 1211 H= 302:45 +CPU= 61.496
  23:47:37 STEP 1212 H= 303:00 +CPU= 77.531
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001212
  23:48:40 STEP 1213 H= 303:15 +CPU= 62.264
  23:49:43 STEP 1214 H= 303:30 +CPU= 63.049
  23:50:45 STEP 1215 H= 303:45 +CPU= 61.898
  23:51:48 STEP 1216 H= 304:00 +CPU= 63.233
  23:52:50 STEP 1217 H= 304:15 +CPU= 62.007
  23:53:53 STEP 1218 H= 304:30 +CPU= 62.300
  23:54:55 STEP 1219 H= 304:45 +CPU= 61.542
  23:55:58 STEP 1220 H= 305:00 +CPU= 63.519
  23:57:00 STEP 1221 H= 305:15 +CPU= 61.661
  23:58:02 STEP 1222 H= 305:30 +CPU= 61.940
  23:59:04 STEP 1223 H= 305:45 +CPU= 61.880
  00:00:21 STEP 1224 H= 306:00 +CPU= 76.587
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001224
  00:01:23 STEP 1225 H= 306:15 +CPU= 62.152
  00:02:25 STEP 1226 H= 306:30 +CPU= 61.877
  00:03:27 STEP 1227 H= 306:45 +CPU= 62.009
  00:04:30 STEP 1228 H= 307:00 +CPU= 62.635
  00:05:32 STEP 1229 H= 307:15 +CPU= 61.873
  00:06:34 STEP 1230 H= 307:30 +CPU= 61.697
  00:07:36 STEP 1231 H= 307:45 +CPU= 61.798
  00:08:37 STEP 1232 H= 308:00 +CPU= 61.361
  00:09:33 STEP 1233 H= 308:15 +CPU= 55.368
  00:10:25 STEP 1234 H= 308:30 +CPU= 51.826
  00:11:17 STEP 1235 H= 308:45 +CPU= 52.155
  00:12:25 STEP 1236 H= 309:00 +CPU= 68.139
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001236
  00:13:20 STEP 1237 H= 309:15 +CPU= 54.815
  00:14:16 STEP 1238 H= 309:30 +CPU= 55.649
  00:15:13 STEP 1239 H= 309:45 +CPU= 56.849
  00:16:09 STEP 1240 H= 310:00 +CPU= 55.642
  00:17:06 STEP 1241 H= 310:15 +CPU= 56.954
  00:18:02 STEP 1242 H= 310:30 +CPU= 56.049
  00:18:56 STEP 1243 H= 310:45 +CPU= 53.955
  00:19:53 STEP 1244 H= 311:00 +CPU= 56.498
  00:20:47 STEP 1245 H= 311:15 +CPU= 54.381
  00:21:42 STEP 1246 H= 311:30 +CPU= 54.790
  00:22:38 STEP 1247 H= 311:45 +CPU= 55.842
  00:23:55 STEP 1248 H= 312:00 +CPU= 76.198
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0l4_2016092300_20_1017_12282587_1_r1889452229_12.zip
Uploading the intermediate file: upload_file_12.zip
  00:24:51 STEP 1249 H= 312:15 +CPU= 55.929
  00:25:47 STEP 1250 H= 312:30 +CPU= 55.629
  00:26:43 STEP 1251 H= 312:45 +CPU= 55.696
  00:27:38 STEP 1252 H= 313:00 +CPU= 54.998
  00:28:33 STEP 1253 H= 313:15 +CPU= 55.120
  00:29:28 STEP 1254 H= 313:30 +CPU= 54.757
  00:30:22 STEP 1255 H= 313:45 +CPU= 54.285
  00:31:19 STEP 1256 H= 314:00 +CPU= 57.000
  00:32:16 STEP 1257 H= 314:15 +CPU= 57.113
  00:33:13 STEP 1258 H= 314:30 +CPU= 56.933
  00:34:10 STEP 1259 H= 314:45 +CPU= 56.209
  00:35:19 STEP 1260 H= 315:00 +CPU= 69.262
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001260
  00:36:16 STEP 1261 H= 315:15 +CPU= 56.915
  00:37:11 STEP 1262 H= 315:30 +CPU= 55.002
  00:38:08 STEP 1263 H= 315:45 +CPU= 56.769
  00:39:06 STEP 1264 H= 316:00 +CPU= 57.761
  00:40:01 STEP 1265 H= 316:15 +CPU= 54.776
  00:40:57 STEP 1266 H= 316:30 +CPU= 55.668
  00:41:52 STEP 1267 H= 316:45 +CPU= 54.851
  00:42:47 STEP 1268 H= 317:00 +CPU= 54.845
  00:43:44 STEP 1269 H= 317:15 +CPU= 57.391
  00:44:45 STEP 1270 H= 317:30 +CPU= 60.340
  00:45:46 STEP 1271 H= 317:45 +CPU= 61.164
  00:47:02 STEP 1272 H= 318:00 +CPU= 75.933
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001272
  00:48:04 STEP 1273 H= 318:15 +CPU= 61.809
  00:49:06 STEP 1274 H= 318:30 +CPU= 62.024
  00:50:08 STEP 1275 H= 318:45 +CPU= 62.217
  00:51:11 STEP 1276 H= 319:00 +CPU= 62.509
  00:52:13 STEP 1277 H= 319:15 +CPU= 61.765
  00:53:15 STEP 1278 H= 319:30 +CPU= 61.659
  00:54:16 STEP 1279 H= 319:45 +CPU= 61.316
  00:55:20 STEP 1280 H= 320:00 +CPU= 63.875
  00:56:22 STEP 1281 H= 320:15 +CPU= 61.298
  00:57:24 STEP 1282 H= 320:30 +CPU= 62.036
  00:58:26 STEP 1283 H= 320:45 +CPU= 61.906
  00:59:43 STEP 1284 H= 321:00 +CPU= 77.392
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001284
  01:00:45 STEP 1285 H= 321:15 +CPU= 61.759
  01:01:46 STEP 1286 H= 321:30 +CPU= 60.839
  01:02:47 STEP 1287 H= 321:45 +CPU= 61.200
  01:03:51 STEP 1288 H= 322:00 +CPU= 63.017
  01:04:52 STEP 1289 H= 322:15 +CPU= 61.672
  01:05:54 STEP 1290 H= 322:30 +CPU= 61.325
  01:06:56 STEP 1291 H= 322:45 +CPU= 62.047
  01:07:59 STEP 1292 H= 323:00 +CPU= 62.737
  01:09:01 STEP 1293 H= 323:15 +CPU= 62.577
  01:10:03 STEP 1294 H= 323:30 +CPU= 61.271
  01:11:04 STEP 1295 H= 323:45 +CPU= 60.943
  01:12:26 STEP 1296 H= 324:00 +CPU= 82.189
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001296
  01:13:28 STEP 1297 H= 324:15 +CPU= 61.734
  01:14:30 STEP 1298 H= 324:30 +CPU= 61.928
  01:15:33 STEP 1299 H= 324:45 +CPU= 62.009
  01:16:36 STEP 1300 H= 325:00 +CPU= 63.089
  01:17:37 STEP 1301 H= 325:15 +CPU= 61.396
  01:18:39 STEP 1302 H= 325:30 +CPU= 61.857
  01:19:41 STEP 1303 H= 325:45 +CPU= 61.812
  01:20:44 STEP 1304 H= 326:00 +CPU= 61.960
  01:21:45 STEP 1305 H= 326:15 +CPU= 61.467
  01:22:46 STEP 1306 H= 326:30 +CPU= 61.199
  01:23:48 STEP 1307 H= 326:45 +CPU= 61.857
  01:25:06 STEP 1308 H= 327:00 +CPU= 77.173
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001308
  01:26:07 STEP 1309 H= 327:15 +CPU= 61.578
  01:27:09 STEP 1310 H= 327:30 +CPU= 61.546
  01:28:11 STEP 1311 H= 327:45 +CPU= 61.754
  01:29:14 STEP 1312 H= 328:00 +CPU= 62.880
  01:30:16 STEP 1313 H= 328:15 +CPU= 61.570
  01:31:18 STEP 1314 H= 328:30 +CPU= 61.690
  01:32:20 STEP 1315 H= 328:45 +CPU= 61.871
  01:33:22 STEP 1316 H= 329:00 +CPU= 62.739
  01:34:24 STEP 1317 H= 329:15 +CPU= 61.657
  01:35:25 STEP 1318 H= 329:30 +CPU= 60.830
  01:36:26 STEP 1319 H= 329:45 +CPU= 60.779
  01:37:42 STEP 1320 H= 330:00 +CPU= 75.956
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001320
  01:38:43 STEP 1321 H= 330:15 +CPU= 61.298
  01:39:45 STEP 1322 H= 330:30 +CPU= 61.779
  01:40:47 STEP 1323 H= 330:45 +CPU= 61.672
  01:41:50 STEP 1324 H= 331:00 +CPU= 62.431
  01:42:51 STEP 1325 H= 331:15 +CPU= 61.475
  01:43:49 STEP 1326 H= 331:30 +CPU= 57.181
  01:44:43 STEP 1327 H= 331:45 +CPU= 54.037
  01:45:39 STEP 1328 H= 332:00 +CPU= 56.355
  01:46:34 STEP 1329 H= 332:15 +CPU= 54.541
  01:47:28 STEP 1330 H= 332:30 +CPU= 53.909
  01:48:28 STEP 1331 H= 332:45 +CPU= 60.209
  01:49:45 STEP 1332 H= 333:00 +CPU= 76.302
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001332
  01:50:47 STEP 1333 H= 333:15 +CPU= 61.871
  01:51:48 STEP 1334 H= 333:30 +CPU= 61.522
  01:52:50 STEP 1335 H= 333:45 +CPU= 61.384
  01:53:53 STEP 1336 H= 334:00 +CPU= 62.975
  01:54:54 STEP 1337 H= 334:15 +CPU= 61.277
  01:55:57 STEP 1338 H= 334:30 +CPU= 62.079
  01:56:58 STEP 1339 H= 334:45 +CPU= 61.063
  01:58:00 STEP 1340 H= 335:00 +CPU= 62.167
  01:59:02 STEP 1341 H= 335:15 +CPU= 61.391
  02:00:03 STEP 1342 H= 335:30 +CPU= 60.943
  02:01:05 STEP 1343 H= 335:45 +CPU= 61.937
  02:02:28 STEP 1344 H= 336:00 +CPU= 82.782
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0l4_2016092300_20_1017_12282587_1_r1889452229_13.zip
Uploading the intermediate file: upload_file_13.zip
  02:03:30 STEP 1345 H= 336:15 +CPU= 62.067
  02:04:32 STEP 1346 H= 336:30 +CPU= 61.183
  02:05:33 STEP 1347 H= 336:45 +CPU= 61.273
  02:06:37 STEP 1348 H= 337:00 +CPU= 63.093
  02:07:38 STEP 1349 H= 337:15 +CPU= 61.412
  02:08:40 STEP 1350 H= 337:30 +CPU= 61.606
  02:09:40 STEP 1351 H= 337:45 +CPU= 60.697
  02:10:44 STEP 1352 H= 338:00 +CPU= 62.914
  02:11:45 STEP 1353 H= 338:15 +CPU= 61.659
  02:12:47 STEP 1354 H= 338:30 +CPU= 61.901
  02:13:49 STEP 1355 H= 338:45 +CPU= 61.288
  02:15:05 STEP 1356 H= 339:00 +CPU= 76.232
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001356
  02:16:07 STEP 1357 H= 339:15 +CPU= 61.377
  02:17:08 STEP 1358 H= 339:30 +CPU= 60.938
  02:18:10 STEP 1359 H= 339:45 +CPU= 61.680
  02:19:13 STEP 1360 H= 340:00 +CPU= 63.222
  02:20:15 STEP 1361 H= 340:15 +CPU= 60.935
  02:21:16 STEP 1362 H= 340:30 +CPU= 61.259
  02:22:18 STEP 1363 H= 340:45 +CPU= 61.871
  02:23:21 STEP 1364 H= 341:00 +CPU= 62.728
  02:24:22 STEP 1365 H= 341:15 +CPU= 60.717
  02:25:23 STEP 1366 H= 341:30 +CPU= 61.363
  02:26:24 STEP 1367 H= 341:45 +CPU= 60.960
  02:27:42 STEP 1368 H= 342:00 +CPU= 77.384
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001368
  02:28:44 STEP 1369 H= 342:15 +CPU= 61.898
  02:29:46 STEP 1370 H= 342:30 +CPU= 61.786
  02:30:48 STEP 1371 H= 342:45 +CPU= 61.550
  02:31:51 STEP 1372 H= 343:00 +CPU= 62.911
  02:32:53 STEP 1373 H= 343:15 +CPU= 61.936
  02:33:54 STEP 1374 H= 343:30 +CPU= 61.408
  02:34:56 STEP 1375 H= 343:45 +CPU= 61.072
  02:35:59 STEP 1376 H= 344:00 +CPU= 62.880
  02:37:00 STEP 1377 H= 344:15 +CPU= 61.510
  02:38:02 STEP 1378 H= 344:30 +CPU= 61.828
  02:39:04 STEP 1379 H= 344:45 +CPU= 61.687
  02:40:21 STEP 1380 H= 345:00 +CPU= 76.779
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001380
  02:41:23 STEP 1381 H= 345:15 +CPU= 61.760
  02:42:24 STEP 1382 H= 345:30 +CPU= 61.470
  02:43:26 STEP 1383 H= 345:45 +CPU= 61.496
  02:44:28 STEP 1384 H= 346:00 +CPU= 62.372
  02:45:30 STEP 1385 H= 346:15 +CPU= 61.777
  02:46:32 STEP 1386 H= 346:30 +CPU= 61.318
  02:47:33 STEP 1387 H= 346:45 +CPU= 61.307
  02:48:36 STEP 1388 H= 347:00 +CPU= 62.368
  02:49:37 STEP 1389 H= 347:15 +CPU= 61.490
  02:50:39 STEP 1390 H= 347:30 +CPU= 61.149
  02:51:40 STEP 1391 H= 347:45 +CPU= 61.269
  02:53:04 STEP 1392 H= 348:00 +CPU= 83.482
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001392
  02:54:06 STEP 1393 H= 348:15 +CPU= 61.718
  02:55:07 STEP 1394 H= 348:30 +CPU= 61.141
  02:56:09 STEP 1395 H= 348:45 +CPU= 61.693
  02:57:12 STEP 1396 H= 349:00 +CPU= 62.808
  02:58:13 STEP 1397 H= 349:15 +CPU= 61.344
  02:59:16 STEP 1398 H= 349:30 +CPU= 62.110
  03:00:18 STEP 1399 H= 349:45 +CPU= 61.849
  03:01:21 STEP 1400 H= 350:00 +CPU= 63.276
  03:02:23 STEP 1401 H= 350:15 +CPU= 62.177
  03:03:25 STEP 1402 H= 350:30 +CPU= 61.317
  03:04:27 STEP 1403 H= 350:45 +CPU= 61.855
  03:05:44 STEP 1404 H= 351:00 +CPU= 76.867
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001404
  03:06:45 STEP 1405 H= 351:15 +CPU= 60.909
  03:07:46 STEP 1406 H= 351:30 +CPU= 61.237
  03:08:48 STEP 1407 H= 351:45 +CPU= 61.407
  03:09:51 STEP 1408 H= 352:00 +CPU= 62.373
  03:10:52 STEP 1409 H= 352:15 +CPU= 61.523
  03:11:54 STEP 1410 H= 352:30 +CPU= 61.821
  03:12:56 STEP 1411 H= 352:45 +CPU= 61.489
  03:13:59 STEP 1412 H= 353:00 +CPU= 63.528
  03:15:00 STEP 1413 H= 353:15 +CPU= 60.593
  03:16:01 STEP 1414 H= 353:30 +CPU= 61.005
  03:17:03 STEP 1415 H= 353:45 +CPU= 61.706
  03:18:20 STEP 1416 H= 354:00 +CPU= 76.699
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001416
  03:19:21 STEP 1417 H= 354:15 +CPU= 60.807
  03:20:23 STEP 1418 H= 354:30 +CPU= 62.002
  03:21:24 STEP 1419 H= 354:45 +CPU= 61.311
  03:22:27 STEP 1420 H= 355:00 +CPU= 63.167
  03:23:30 STEP 1421 H= 355:15 +CPU= 62.165
  03:24:31 STEP 1422 H= 355:30 +CPU= 61.345
  03:25:33 STEP 1423 H= 355:45 +CPU= 61.694
  03:26:36 STEP 1424 H= 356:00 +CPU= 62.858
  03:27:38 STEP 1425 H= 356:15 +CPU= 61.814
  03:28:39 STEP 1426 H= 356:30 +CPU= 61.303
  03:29:41 STEP 1427 H= 356:45 +CPU= 61.535
  03:30:58 STEP 1428 H= 357:00 +CPU= 76.760
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001428
  03:31:59 STEP 1429 H= 357:15 +CPU= 61.469
  03:33:01 STEP 1430 H= 357:30 +CPU= 61.726
  03:34:03 STEP 1431 H= 357:45 +CPU= 61.671
  03:35:06 STEP 1432 H= 358:00 +CPU= 63.199
  03:36:09 STEP 1433 H= 358:15 +CPU= 62.071
  03:37:10 STEP 1434 H= 358:30 +CPU= 61.230
  03:38:11 STEP 1435 H= 358:45 +CPU= 60.993
  03:39:13 STEP 1436 H= 359:00 +CPU= 61.964
  03:40:14 STEP 1437 H= 359:15 +CPU= 60.556
  03:41:15 STEP 1438 H= 359:30 +CPU= 61.161
  03:42:16 STEP 1439 H= 359:45 +CPU= 60.866
  03:43:35 STEP 1440 H= 360:00 +CPU= 77.371
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.4286343401E-21      I       0.2503440192E-06      I
ICloud fractionI      0.0000000000E+00      I       0.2919496926E-01      I
I  Relat. Hum. I      0.2949471043E+00      I       0.3539798727E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.1643193650E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    303922548 BYTES IN      7 RECORDS TRANSFERRED IN    0.0010 SECONDS303922.6 Mbytes/s, TOTAL TIME=    0.0236( 4.2%)
 03:43:35 STEP 1440 H= 360:00 +CPU= 77.371
 END CNT3
 NSTEP =  1440 CNT0   000000000  57.199  57.199  57.505   0.995               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        43246/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    43246 ************   134.6     0.0   134.5     0.0   277.8
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.98      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    7985.4    7985.4     15.22      0.00
   9 SPCM     - SPECTRAL COMP.                    1440    1668.4    1668.4      2.93      0.00
  10 SCAN2M - PHYSICS                             1441   28203.6   28203.6     49.59      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121    1511.4    1511.4      0.22      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      89.3      89.3      0.01      0.00
  14 SUINIF                                          1   15247.8   15247.8      0.02      0.00
  17 GRIDFPOS IN CNT4                              121      59.7      59.7      0.01      0.00
  18 SUSPECG                                         1    8542.4    8542.4      0.01      0.00
  19 SUSPEC                                          1    8556.7    8556.7      0.01      0.00
  24 SUGRIDU                                         1    6031.7    6031.7      0.01      0.00
  25 SPECRT                                          1     434.0     434.0      0.00      0.00
  26 SUGRIDF                                         1     225.4     225.4      0.00      0.00
  27 RESTART FILES - WRITING                        30    6096.1    6096.1      0.22      0.00
  28 RESTART FILES - READING                         1       0.1       0.1      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               121   12146.9   12146.9      1.79      0.00
  31 POSDDH IN STEPO                                 7      30.4      30.4      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441   11632.2   11632.2     20.45      0.00
  39 SU0YOMB                                         1     725.7     725.7      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      57.2      57.2      0.10      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     444.5     444.5      0.78      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440      97.3      97.3      0.17      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.4       0.4      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     873.2     873.2      3.33      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     536.1     536.1      1.97      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006     225.2     225.2      0.83      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     342.3     342.3      1.31      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      78.0      78.0      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      95.5      95.5      0.36      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      50.1      50.1      0.18      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125     167.8     167.8      0.64      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      98.5      98.5      0.36      0.00
 400 GSTATS                                     167734       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                156066       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    81952.9 CPU TIME   81859.5 VECTOR TIME    81859.5


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       15.8
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/2/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/2/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282587/ICMGGh7zg+001440
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0l4_2016092300_20_1017_12282587_1_r1889452229_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
03:47:15 (8453): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a0l4_2016092300_20_1017_12282587_1_r1889452229_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a0l4_2016092300_20_1017_12282587_1_r1889452229_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a0l4_2016092300_20_1017_12282587_1_r1889452229_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a0l4_2016092300_20_1017_12282587_1_r1889452229_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a0l4_2016092300_20_1017_12282587_1_r1889452229_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 Jun 2024 07:45:31 1498497 22440726 oifs_43r3_bl_a0l4_2016092300_20_1017_12282587_1 1,295,100 81,859 0.0632
09 Jun 2024 00:16:55 1498497 22440726 oifs_43r3_bl_a0l4_2016092300_20_1017_12282587_1 864,000 53,325 0.0617


©2024 climateprediction.net